The ability of GPT-4 is not so much "figuring out" as it is "already knowing." Currently it seems.
Can LLM be trained like training Go AI? Such as alphago
1–4 of 4 posts
Re: Can LLM be trained like training Go AI? Such as alphago
#2LLM and AlphaGo (DRNN) are different architectures, training regimes, and optimizers. They are not designed for the same inputs & outputs
Re: Can LLM be trained like training Go AI? Such as alphago
#3There are models trained via RNN, but LLMs usually use Transformer architecture with a bit of human feedback on top which sort of uses reinforcement learning like AlphaGo
Re: Can LLM be trained like training Go AI? Such as alphago
#4AlphaGo is also “already knowing” the same way LLMs are. At the end of the day they are just neural nets trained for different tasks. The training process is the “figuring out” part in both cases.