Arguably the human-ness (or even animal-ness) of thought is, at its root, characterized as the ability abstract in a novel manner (the neurocog term for innovate). In other words, it is the ability to find patterns between two concepts that weren't, ever, prior announced. A computer that could do this would then be AI. A computer that cannot would fall short of that category, however otherwise dazzling in stitching t…
LLMs can do this already. They are well past this. It's just they can't do it as well as humans and they can hallucinate as well. The problems we are having with LLMs aren't the fact that they aren't creative. It's the fact that they are too creative. They make up too much stuff that isn't true.
You are conflating the meaning of "creativity".
In this dicussion, "creativity" refers to a type of definable cognitive process (abstraction) that has an output that is rooted in a starting concept.
ie: One abstracts a non-explicit concept from the starting concept, and then arrives at a novel yet related expression or concept that shares the abstraction.
This is the nature of human creative logic that underlies reasoning. It has nothing to do with inventing unlrelated / untrue concepts (ie" "too much creativity" in your alternative definition).
As such "untrue" output is a failure of creative logic, not too much of it.
If the creative thought process is actually engaged in, then the relatively trivial part is coming up with "correct" output.
The hard part is the process, not the output. To the point that incorrect output strongly suggests a substandard or alternative process.
Say I asked you to provide an object that was a rough analogy to a birthday party balloon, and you said a winter coat. Would that be an example of "too much creativity" or a failure of creative (abstract) thought?
One arguably (partially) correct answer would be a bowling ball. First I abstract the shape of a sphere from the balloon, and then find another match for it in a bowling ball.
Purely as an example of rudumentary abstract thought.
Ai does this easily. What it can't do is apply this process to complex concept and language expression.
For example, a bowling ball is only partially analgolous to a balloon. They are both spheres, etc. But they are conceptual opposites in terms of mass.
A more correct creative answer might be a propelled low altitude firework
This answer, which requires more abstraction talent, is an example of what any LLM will increasingly have difficulty giving.
And we don't need Ai to tell us that a firework is roughly analagous to a balloon. We need vastly more complex creative analysis and output.
Solving the simplest allegory is in another category of complexity.
I get the view that we need to recognize what it can do and its potential. That's great. But that doesn't change its forsseable limitations that are also important to recognize.