Earlier quoted context omitted.
> AI (in this form) will never be able to solve things we truly cannot solve yet. Argument?
The strongest argument for this is structural: what LLMs are. In a brutal simplistic way: each token is represented in a high dimensional vector. LLMs operate on them. They are the true, underlying meaning of the token for the LLM. Think of it as 1000+ ways to think of that word/token. Those meanings are baked in at training time. So, LLMs might be able to cross-reference them and solve a class of problems that flew…
What exact problem would need to be solved by LLMs to convince you that they DO discover novel solutions?