Earlier quoted context omitted.
> The tokens could be patterns of colored shapes with no actual meaning, only statistical distributions and nothing about how the LLMs work would change. I can put your brain in a vat and stimulate your sensory neurons with a statistical distribution with no actual meaning, and nothing about how your brain works would change either. The LLM and your brain would attempt to interpret meaning with referent from training…
>I can put your brain in a vat and stimulate your sensory neurons with a statistical distribution with no actual meaning, and nothing about how your brain works would change either. The LLM and your brain would attempt to interpret meaning with referent from training, and both would be confused at the information-free stimuli. Because during "training" in both cases, the stimuli received from the environment is struc…
Yes, it will be confused as well, and for all outwards observable signs will fail to make sense of the stimuli, yet it will "aware" of its inability to understand, much like a human brain would.
If you doubt that, open a new session and type some random tokens, you will get the answer that it's confused.
Any other statement as to "consciousness" verges into the philosophical and unanswerable via empirical means.
And ah, to frame it as an appeal to authority when the topic is precisely the subject of a neuroscientist's study.
Sounds like you know a thing or two about nonsense and emotional attachment to bad ideas.