Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Game over for pure LLMs. Even Rich Sutton has gotten off the bus

garymarcus.substack.com

Post reply on HN
Print view View original

51–53 of 53 posts

Re: Game over for pure LLMs. Even Rich Sutton has gotten off the bus

#51

Post by signa11 »

sigmoid10 wrote: post #7

Looking at the quoted tweet it is immediately obvious that these people have no clue about the current state of research. Yes they might have had some more or less relevant contributions to classical ML, but AI has taken off without (or rather despite) them and if history of AI has shown anything, it's that people like those are not the ones who will pave the way forward. In a field like this, there's no use to liste…

sez $random-person on the interweebs.

more seriously though, as best as i can understand, what he is trying to say is that there must be a *LOGICAL* framework independent of compute or what you get is just a parrot (stochastic one at best) that operates within the smoothed edges of a distributed statistical field.

Re: Game over for pure LLMs. Even Rich Sutton has gotten off the bus

#52

Post by jonplackett »

justlikereddit wrote: post #44
jonplackett wrote: post #6

Earlier quoted context omitted.

There’s quite a gulf of difference between saying something is a dead end to full on general artificial intelligence, and saying it’s all dead and will collapse. I have no idea if LLMs will be general AI, but they defo aren’t going anywhere

I think the question we've failed to properly ask is "are all humans general intelligences". I frequently encounter people who appear less refined in reasoning and communication than an LLM. Granted, being an awkward communicator is excusable but interrogation of these peoples belief systems seem to reveal a word model more than a world model.

The other way to look at it is that people are still really useful and helpful even if they don’t have a PHD or super advanced reasoning capabilities. A lot of useful work requires neither. So LLMs can do that work at least.
Post reply on HN