Earlier quoted context omitted.
It isn’t about training anymore. It is about harnesses. Just look at new math proofs that will come out, as one example. Exploration vs Exploitation is a thing in AI but you seem to think that human creativity can’t be surpassed by harnesses and prompts like “generate 100 types of possible…” You’re wrong. What you call creativity is often a manual application of a simple self-prompt that people do. One can have a loo…
There is no "new ideas" with AI. Claiming the opposite is a fundamental misunderstanding of the technology.
What is an idea really and what’s your definition of new?
If i get a LLM to spit out, I dunno, a deployment system written in haskell that uses bittorrent or something, none of those bits are new, but certainly there will be unique challenges to solve in the code and it’s a new system.
Where is the line for new? Is it in combining old ideas? If not then does any software have “new” ideas? It’s all combinations of processor instructions after all…