Earlier quoted context omitted.
I won't speak for what's "all the way down", but on whatever level humans perform reflective reasoning, it's self-evident that we don't simply "predict the next word" in the way a LLM does. Whether or not a LLM is capable of "creating anything new" is a different argument altogether. "New" is in eye of the beholder and it is often said that nothing is new under the sun, but we already know that unthinking processes w…
Please provide evidence that intelligent speech isn’t simply predicting the next word, as it’s obviously not self-evident to me.
Edit: also when programming, I form mental structures and code them without verbalizing them, same with maths or when drawing or making music. A thought is maybe a prediction, but language seems not to be the abstraction it’s operated on.