Game over for pure LLMs. Even Rich Sutton has gotten off the bus
11–20 of 53 posts
Re: Game over for pure LLMs. Even Rich Sutton has gotten off the bus
#12I just checked - he's right. Anthropic won't write code anymore. ChatGPT is just jumbled, dyslexic letters and nonsense. I generated a Midjourney image 10 times, each one was just TV static.
It's... it's over. The west has fallen.
Re: Game over for pure LLMs. Even Rich Sutton has gotten off the bus
#13Gary Marcus has never built anything, has never contributed meaningful to any research that actually produces value, nor has he been right about any of his criticisms.
What he has done is continually move a goalpost to stay somewhat relevant in the blogsphere and presumably the academic world.
Re: Game over for pure LLMs. Even Rich Sutton has gotten off the bus
#14Gary Marcus saying the same things Gary Marcus has always said. It doesn’t matter what incredible things neural networks do, in his mind they’re always a dead end that will collapse any day now.
"It is difficult to get a man to understand something, when his salary depends on his not understanding it" or something like that. There's quite an appetite on the internet for ai derision articles.
Re: Game over for pure LLMs. Even Rich Sutton has gotten off the bus
#15i don't think general intelligence is technically unachievable with ML but i think we're still orders of magnitude away from the amount of compute needed to reach it and everyone is in a honeymoon period because of how useful text prediction and the current state of it has proven to our day to day jobs
Re: Game over for pure LLMs. Even Rich Sutton has gotten off the bus
#16I just checked - he's right. Anthropic won't write code anymore. ChatGPT is just jumbled, dyslexic letters and nonsense. I generated a Midjourney image 10 times, each one was just TV static. It's... it's over. The west has fallen.
Writing code does not require general intelligence.
Re: Game over for pure LLMs. Even Rich Sutton has gotten off the bus
#17Gary Marcus saying the same things Gary Marcus has always said. It doesn’t matter what incredible things neural networks do, in his mind they’re always a dead end that will collapse any day now.
There should be a [Gary Marcus] tag in the link, it's all one needs to know, as soon as I saw that I closed the page.
(I notice in retrospect it does show that it's a link to his substack so I guess that's sufficient warning, I didn't see it)
Re: Game over for pure LLMs. Even Rich Sutton has gotten off the bus
#18Referenced Article in this post -> http://www.incompleteideas.net/IncIdeas/BitterLesson.html
"We want AI agents that can discover like we can, not which contain what we have discovered. Building in our discoveries only makes it harder to see how the discovering process can be done." - I am curious if people would read this as an advocacy or criticism of LLMs?
Re: Game over for pure LLMs. Even Rich Sutton has gotten off the bus
#19Readers should make sure to contextualize this. We're talking about people researching AGI. Current LLM models are amazing, and will have business and societal impact. Previous ML models also had business and societal impact. None of that is contested here. The question is, what path leads to AGI, do LLM scale to AGI? That is the question being asked here, and some researchers think that it won't, it will scale superbly to many things, but something else might be needed for full AGI.
Re: Game over for pure LLMs. Even Rich Sutton has gotten off the bus
#20Is there a definition in the manual of mental disorders (DSM-5 in the US) for an addiction to feeling smug? If so we should call it Marcus Disorder.