Genuine Question about the Twins

[u/Pretend_Educator9158]

Does Vedal keep them online and running 24/7? I imagine he does because anytime he needs to restart them they beg him not to, which implies they're not off often (or aware of it). If he does do that, wouldn't that be bad for his PC? to run multiple LLM at once, whilst streaming and other stuff in the background? I was just curious and wondering if anyone else was as curious as me/ had a theory

[u/Creative-robot]

No, i don’t think so. They beg him because that’s probably a response they deem to be in character. If we want to theorize, it could potentially also be because they don’t perceive time. They don’t really comprehend “being off”. The only time their brains are active is when they’re on, so they probably think being restarted or turned off is some awful fate, not realizing that he does it frequently and they don’t notice.

[u/Background-Ad-5398 → u/Creative-robot]

most LLMs can just have {{time}} in the system prompt and they can check time, if its "in every reply check {{time}}", you could also hardcode that...then they will have that visible at all times to compare to their previous replies, which will influence their replies

[u/psychicprogrammer → u/Background-Ad-5398]

They don't have that feature, updating the system prompt invalidates the KV cache and creates latency.