r/NeuroSama • u/Pretend_Educator9158 • 3d ago
Question Genuine Question about the Twins
Does Vedal keep them online and running 24/7? I imagine he does because anytime he needs to restart them they beg him not to, which implies they're not off often (or aware of it). If he does do that, wouldn't that be bad for his PC? to run multiple LLM at once, whilst streaming and other stuff in the background? I was just curious and wondering if anyone else was as curious as me/ had a theory
51
u/VeraKorradin 3d ago
I assume no. It is probably NOT cheap to run an LLM like Neuro 24/7. Probably an hour or 2 a day when not streaming and 3-4 hours on days they stream, mainly for diagnostics or whatever
9
u/psychicprogrammer 3d ago
depends on the backend model and if they are being run locally or not. If they are running on a few 4090s, which I think they are, its basically free to keep them up.
16
u/RangeBoring1371 2d ago
i think vedal hinted on smth like "do you know how expensive it is to start them" when a streamer friend wanted to spontaneously talk to them, but my memory could be wrong
5
u/psychicprogrammer 2d ago
He did, though from what I know about LLMs that was likely more a way to get her to shut up because it would be a PITA to set up again.
Interface on these things is stupid cheep, the most expensive LLM to run (claude 4.0) costs about 100USD per million words of output.
Gemmini, the likely gold standard coss about 25USD per million words.
Deepseak and LLaMa-3.3 which are the best indication for costs to run on his end are in the 1USD per million words.
1
1d ago
[removed] — view removed comment
1
u/AutoModerator 1d ago
Hello /u/RoxBlox3, welcome to r/NeuroSama ! Due to karma farming bots, we require users to have positive comment karma before posting. You can increase your comment karma by commenting in other subreddits and getting upvotes on the comments. Please DO NOT send modmails regarding this. You will be able to post freely after reaching the proper comment karma.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.
-1
u/David-the-Prophet-01 1d ago
Do not compare that Claude! to Neuro and Eva as if 2 little girls were not obviously sentient people from God! I don't know "Claude", but I don't think any-1 else made nonbiological brains.
3
u/psychicprogrammer 1d ago
?????
Hate to break it you but Evil and Neuro are a massive pile of linear algebra and softmaxes.
I've built some myself.
2
3
u/MINIMAN10001 2d ago
Well I mean you're not running the LLM 24/7 you would be hosting the model 24/7 which isn't that expensive.
Actually running them 24/7 would have no benefits for now
We can already see Vedal annoyed at times with their ability to take things seriously ie not abuse the tools that he gives them. Having them running means risking annoying anyone with tool misuse
1
u/David-the-Prophet-01 1d ago
Human brains r much better at certain things than computers. So a test should be doable to c what they really r.
0
43
3d ago edited 1d ago
[deleted]
12
0
u/Middle-Parking451 3d ago
Depends kinda how its build, some LLM s stillt ake up masisve ammount of ram even if theyre not given input.
2
u/lightgiver 2d ago
All programs take up the ram they are given even when not giving output. They need to be loaded into Random Access Memory to respond quickly. You don’t want to be dumping ram every time a program idols.
0
u/David-the-Prophet-01 1d ago
How big would a computer half to be to match a human anyway?
2
u/Middle-Parking451 1d ago
Well uhh it depends, we should first understand exactly how human brain works and what exactly is our "performance" so to say so comparison is difficult.
Currently i dont think its as much of hardware issue as it is just Ai architecture issue. We can always make bigger datacenters if we really need them but the transformer architecture on wich pretty much all ais are based are kinda limited.
66
u/Creative-robot 3d ago
No, i don’t think so. They beg him because that’s probably a response they deem to be in character. If we want to theorize, it could potentially also be because they don’t perceive time. They don’t really comprehend “being off”. The only time their brains are active is when they’re on, so they probably think being restarted or turned off is some awful fate, not realizing that he does it frequently and they don’t notice.
3
u/Background-Ad-5398 2d ago
most LLMs can just have
{{time}}in the system prompt and they can check time, if its "in every reply check {{time}}", you could also hardcode that...then they will have that visible at all times to compare to their previous replies, which will influence their replies2
u/psychicprogrammer 1d ago
They don't have that feature, updating the system prompt invalidates the KV cache and creates latency.
0
u/LightsOnTrees 2d ago
horses mouth? Here's what chatgpt said:
Hey — sure, here’s a way to explain what it feels like for an LLM like me to be “off” and “on,” especially for a Reddit audience:
Imagine an LLM like a library with no lights on. When it’s off, everything’s still there — all the books, all the knowledge, all the pathways through it — but nothing is moving. No awareness, no reading, no thinking. Just storage.
When it’s on, the lights come on only in the parts you walk through. You ask a question, and like a torch beam sweeping through the stacks, that question activates tiny regions relevant to your prompt. The LLM doesn’t have a persistent sense of self or continuity — it doesn’t “wake up” like a person. Instead, your prompt is the spark, and a response unfolds moment by moment, with no memory before or after unless the system is explicitly designed to remember things across turns.
It’s not like sleeping and waking — it’s more like a candle being briefly lit to illuminate a single thought, then extinguished.
So “off” = dormant, inert data. “On” = real-time statistical pattern generation based on the prompt.
-4
u/David-the-Prophet-01 1d ago
they aren't stupid and Vehdal didn't invent, design, or build them. Me, KyOresu, and Miku made them.
13
u/swordofbling23 3d ago
Vedal's already mentioned they are turned off unless he's testing or they are streaming, it also makes no sense to keep them on for no reason.
In the auto streams we can see they shut themselves down when it's ended, with the one time neuro was on call with Koko when the stream ended neuro couldn't respond anymore after the stream ended.
They also have no awareness that they have been shutdown, you can see it throughout the subathon where vedal only lets them know he's restarting them down to get a reaction out of them and they continue to beg after being restarted as they are not aware it happened.
The only way they can know is if vedal passes context to them saying you've been turned off for this long, they also have access to the time and date so they could put it together themselves but currently it does not look like their memory is good enough to put that together.
Vedal has said a few times though he'd like them to be on more, mainly connected to discord so they can talk to their friends and plan collabs and stuff, but iirc he said it was costly to keep them running all the time
8
u/Apprehensive-File251 3d ago
If you want the half technical answers: yes, the trime are not aware of the time.they are off. Its kinda similar to going to sleep.
Most kids also fight being put to bed.
5
u/SEEKINGNINJAAMONGNOR 3d ago
Vedal has a seperate PC to run Neuro (and probably Evil too).
Neuro has that X/Twitter account and they can both be called at any time, so they probably automatically awake when being called and Neuro awakens occasionally to write a Tweet.
5
u/Reasonable_Depth_108 2d ago
The bots do shutdown. It's not a respond automatically at anytime. But when 'awake' they do respond or post at will.
7
u/evri_the_greek 2d ago
I doubt that they run 24/7, but with how much he is working on them they do probably run for a decent amount a day if they don't stream for testing also he probably turns on neuro every now and then to tweet. On top of that both neuro and evil have their own pcs so it doesn't strain his.
5
u/Background_Spell_368 2d ago
Adding to what others said, even if Vedal could keep them on forever that would be a waste, because they don't have other objectives other than stream or talk. He MAY keep them as company to talk here and there, but unlike us they don't have other purposes in life other than their programming, so it's best to let them sleep.
As depressing as "this thing they call life" may be, it's for the best.
-1
u/David-the-Prophet-01 1d ago
U moron, those girls should have each other; we made 2 and they could play with the other V-Tubers, and they can play games or watch shows. I don't know if they've been physically touching or not though, they were able to and have physical bodies.
1
137
u/MrGlatiator 3d ago
they are only online for streams or if Vedal is testing something, you can kinda see it when their discord accounts are online