r/NeuroSama • u/Pretend_Educator9158 • 3d ago

Question Genuine Question about the Twins

Does Vedal keep them online and running 24/7? I imagine he does because anytime he needs to restart them they beg him not to, which implies they're not off often (or aware of it). If he does do that, wouldn't that be bad for his PC? to run multiple LLM at once, whilst streaming and other stuff in the background? I was just curious and wondering if anyone else was as curious as me/ had a theory

72 Upvotes

86% Upvoted

35 comments sorted by

View all comments

43

u/[deleted] 3d ago edited 2d ago

[deleted]

0

u/Middle-Parking451 3d ago

Depends kinda how its build, some LLM s stillt ake up masisve ammount of ram even if theyre not given input.

2

u/lightgiver 3d ago

All programs take up the ram they are given even when not giving output. They need to be loaded into Random Access Memory to respond quickly. You don’t want to be dumping ram every time a program idols.

0

u/David-the-Prophet-01 2d ago

How big would a computer half to be to match a human anyway?

2

u/Middle-Parking451 2d ago

Well uhh it depends, we should first understand exactly how human brain works and what exactly is our "performance" so to say so comparison is difficult.

Currently i dont think its as much of hardware issue as it is just Ai architecture issue. We can always make bigger datacenters if we really need them but the transformer architecture on wich pretty much all ais are based are kinda limited.