Earlier quoted context omitted.
And magic tricks look like magic. Turns out they’re not magical. I am so floored that at least half of this community, usually skeptical to a fault, evangelizes LLMs so ardently. Truly blows my mind. I’m open to them becoming more than a statistical token predictor, and I think it would be really neat to see that happen. They’re nowhere close to anything other than a next-token-predictor.
> I’m open to them becoming more than a statistical token predictor, and I think it would be really neat to see that happen What exactly do you mean by that? I've seen this exact comment stated many times, but I always wonder: What limitations of AI chat bots do you currently see that are due to them using next token prediction?
It’s kind of like you’re saying “prove god doesn’t exist” when it’s supposed to be “prove god exists.”
If a problem isn’t documented LLMs simply have nowhere to go. It can’t really handle the knowledge boundary [1] at all, since it has no reasoning ability it just hallucinates or runs around in circles trying the same closest solution over and over.
It’s awesome that they get some stuff right frequently and can work fast like a computer but it’s very obvious that there really isn’t anything in there that we would call “reasoning.”