Earlier quoted context omitted.
Come on, now. That's irrelevant. Reality is by definition our physical reality , which is about an infinite number of levels more detailed than the, you know, _virtual_ digital world computers exist in. Whatever world we construct for LLMs, no matter how detailed we make it, will always be a blocky projection of the real domain onto a virtual one. It follows then that any insight gained in the virtual world is at bes…
>Whatever world we construct for LLMs, no matter how detailed we make it, will always be a blocky projection of the real domain onto a virtual one. I don't know exactly why but I never really understood this argument. Might be some kind of control thing? Because for me it's pretty simple, it's basically free to give access to reality. Just add "sensory organs" as it were. I can argue you can make them perceive realit…
I dunno what you mean by "free". The model is trained on text. To "give" the model sensory organs it would need to be trained on those sensory organs.
Current models can predict text, because that's what the weights represent. Models with sensory organs will need to be trained on the output of those sensory organs.
That sounds close to impossible in the foreseeable future.