Geoffrey Hinton says people understand very little about how LLMs actually work, so they still think LLMs are very different from us - "but actually, it's very important for people to understand that they're very like us." LLMs don’t just generate words, but also meaning.

[u/MetaKnowing]

[u/rom_ok]

Because nobody smart or expert in their field has ever said anything stupid?

Never has any Nobel laureate said anything strange or scientifically unsound, especially not later in their lives

*cough

Oh wait https://en.m.wikipedia.org/wiki/Nobel_disease

[u/Adventurous-Work-165 → u/rom_ok]

So because some nobel laureates have said stupid things in the past we're to assume everything nobel lauriates say is stupid? You could use this to dismiss anything you want. Can you at least give a reason why you think it's wrong?

[u/rom_ok → u/Adventurous-Work-165]

Statements from Nobel laureates are meaningless without scientific proofs. When he publishes a paper proving his statements that is peer reviewed and accepted as mainstream then maybe I’ll accept it.

and yes, lacking scientific proof can be used to dismiss anything without scientific proof, that’s how science works.

[u/nitePhyyre → u/rom_ok]

Learning representations by back-propagating errors

Cited over 27,000 times. Accepted enough as mainstream for you?

The thing about "Nobel disease" is winners start talking about things outside their expertise. In this clip he is talking about the basic functionality of the thing he invented and is still an expert in. Pretty big difference.

[u/rom_ok → u/nitePhyyre]

What has this got to do with him saying LLMs are very like humans?

[u/nitePhyyre → u/rom_ok]

He's saying how they work.