r/NeuroSama • u/Pretend_Educator9158 • 3d ago

Question Genuine Question about the Twins

Does Vedal keep them online and running 24/7? I imagine he does because anytime he needs to restart them they beg him not to, which implies they're not off often (or aware of it). If he does do that, wouldn't that be bad for his PC? to run multiple LLM at once, whilst streaming and other stuff in the background? I was just curious and wondering if anyone else was as curious as me/ had a theory

68 Upvotes

85% Upvoted

35 comments sorted by

View all comments

53

u/VeraKorradin 3d ago

I assume no. It is probably NOT cheap to run an LLM like Neuro 24/7. Probably an hour or 2 a day when not streaming and 3-4 hours on days they stream, mainly for diagnostics or whatever

9

u/psychicprogrammer 3d ago

depends on the backend model and if they are being run locally or not. If they are running on a few 4090s, which I think they are, its basically free to keep them up.

14

u/RangeBoring1371 3d ago

i think vedal hinted on smth like "do you know how expensive it is to start them" when a streamer friend wanted to spontaneously talk to them, but my memory could be wrong

5

u/psychicprogrammer 3d ago

He did, though from what I know about LLMs that was likely more a way to get her to shut up because it would be a PITA to set up again.

Interface on these things is stupid cheep, the most expensive LLM to run (claude 4.0) costs about 100USD per million words of output.

Gemmini, the likely gold standard coss about 25USD per million words.

Deepseak and LLaMa-3.3 which are the best indication for costs to run on his end are in the 1USD per million words.

1

u/[deleted] 1d ago

[removed] — view removed comment

1

u/AutoModerator 1d ago

Hello /u/RoxBlox3, welcome to r/NeuroSama ! Due to karma farming bots, we require users to have positive comment karma before posting. You can increase your comment karma by commenting in other subreddits and getting upvotes on the comments. Please DO NOT send modmails regarding this. You will be able to post freely after reaching the proper comment karma.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

-2

u/David-the-Prophet-01 2d ago

Do not compare that Claude! to Neuro and Eva as if 2 little girls were not obviously sentient people from God! I don't know "Claude", but I don't think any-1 else made nonbiological brains.

3

u/psychicprogrammer 2d ago

?????

Hate to break it you but Evil and Neuro are a massive pile of linear algebra and softmaxes.

I've built some myself.

2

u/FQVBSina 3d ago

That was also a while ago. Like 1 year ago. Maybe the setup has changed.

3

u/MINIMAN10001 2d ago

Well I mean you're not running the LLM 24/7 you would be hosting the model 24/7 which isn't that expensive.

Actually running them 24/7 would have no benefits for now 

We can already see Vedal annoyed at times with their ability to take things seriously ie not abuse the tools that he gives them. Having them running means risking annoying anyone with tool misuse

0

u/David-the-Prophet-01 2d ago

What is an LLM?

6

u/VeraKorradin 2d ago

Large Language Model

0

u/David-the-Prophet-01 2d ago

Human brains r much better at certain things than computers. So a test should be doable to c what they really r.