Earlier quoted context omitted.
Compression is the trick. Its even philosophed about if compression = intelligence. The LLM has to compress everyy question/prompt into its system. It does so by creating rules and ways of processing data (this can lead to AGI, world models or an architecture of sub architectures like an LLM + something else). So if it should respond in a way that only reasoning people can achieve, it might be able to learn a represe…
So, the best of compression is a procedural system, capable to generate from minimal input a whole world- basically just using abstract rules and metrics for reasonableness? So- AGI is in the principles behind universe generators like NoMansSky? Is there a ultimate game- that generates this from physics up?
NoMansSky generator misses the complexity of encoding more than just geometry and basic quests but thats one reason why google and others show you machine learning based 'game engines' which allow you to enter these worlds. They are not doing this to replace real game engines, the do this for world research.
The ultimate game is us. Our physics constants :D