I'm not completely convinced by this comparison between blind chess and prompting LLMs. In blind chess you get deterministic information about the state of the board: each mental update to your board model can be precise, and you have the full state at every point in time. LLMs are notoriously non-deterministic, and even at temperature zero you still can't predict exactly where the weights will take you next. I suppo…
LLMs are notoriously non-deterministic, and even at temperature zero you still can't predict exactly where the weights will take you next. An LLM can be made to be completely deterministic. I use them in this mode so I can reproduce test cases. Of course it requires complete control over the model, etc. but this myth that a computer program is non-deterministic needs to end. You can 100% predict where the weights “wi…
Do you mean reproduce?
Sorry it's just if you are saying what your statement implying then either the model is very simple, or you've figured out something incredible