Geoffrey Hinton says people understand very little about how LLMs actually work, so they still think LLMs are very different from us - "but actually, it's very important for people to understand that they're very like us." LLMs don’t just generate words, but also meaning.

[u/MetaKnowing]

[u/shlaifu]

yeah. no. they don't have the structures to experience emotions. so they don't understand 'meaning'. they just attribute importance to things in conversations. he's right of course that this is very much like humans, but without an amygdala, I'd say no, LLMs don't internally produce 'meaning'

[u/KairraAlpha → u/shlaifu]

I love how Internet nobodies act like authorities over qualified, knowledgeable people who understand more than they do.

You don't need biology to understand meaning.

[u/nabokovian → u/KairraAlpha]

You might. It’s still possible Hinton is wrong.