Earlier quoted context omitted.
It isn’t about training anymore. It is about harnesses. Just look at new math proofs that will come out, as one example. Exploration vs Exploitation is a thing in AI but you seem to think that human creativity can’t be surpassed by harnesses and prompts like “generate 100 types of possible…” You’re wrong. What you call creativity is often a manual application of a simple self-prompt that people do. One can have a loo…
There is no "new ideas" with AI. Claiming the opposite is a fundamental misunderstanding of the technology.
There have been lots of instances of knowledge being rediscovered even when it was previously published but sitting on some shelf forgotten. LLMs ability to digest large volumes of data will I think help with this issue.
We will still need to reproduce and verify conclusions but will be interesting to see what might come from this.