> Artificial intelligence systems found to Excel at imitation, but not innovation
And they do it using the Microsoft spreadsheet software?
Artificial intelligence systems found to excel at imitation, but not innovation
11–20 of 126 posts
Re: Artificial intelligence systems found to excel at imitation, but not innovation
#12One can casually observe that LLMs quite excel at composition though: gluing together pieces of knowledge in ways no one did before (examples: a program that does X using language Y, a painting that mashes up two themes).
Most knowledge workers' activities aren't innovative or imitational - similarly, we compose stuff, so LLMs are a fair competitor.
Re: Artificial intelligence systems found to excel at imitation, but not innovation
#13The innovation test they use relies heavily on reasoning, something that the stock LLMs tested are known to be deficient in. Adding reasoning to large language models is an active research area (see e.g. https://arxiv.org/abs/2212.10403).
Link to actual paper FTA: https://journals.sagepub.com/doi/10.1177/17456916231201401
Re: Artificial intelligence systems found to excel at imitation, but not innovation
#14Re: Artificial intelligence systems found to excel at imitation, but not innovation
#15Even their imitation is just superficial, at least for the prompts the average user is motivated to write.
I might not be able to differentiate AI content from any human content, but I can differentiate it from high quality human content.
Which is a bit sad, since AI will probably eliminate most lower end content creation jobs. This doesn't improve the state of the content industry for users, but saves companies quite some money...
Re: Artificial intelligence systems found to excel at imitation, but not innovation
#16One can casually observe that LLMs quite excel at composition though: gluing together pieces of knowledge in ways no one did before (examples: a program that does X using language Y, a painting that mashes up two themes). Most knowledge workers' activities aren't innovative or imitational - similarly, we compose stuff, so LLMs are a fair competitor.
... and our judgments of composition favor recall over precision. Which is to say that as human judges we're good at finding sense in something generated if it's plausible. We'll take a proposition (eg in a composition) and construct a justification for it. "I can see how that makes sense". I am conflating plausible combination with high recall. Precision, in this sense, is that no proposition would be acceptable without evidence or precedent. With all precision, no new idea is ok. So a "knob" for recall vs precision on a generative system would nice. Is "temperature" that knob?
Re: Artificial intelligence systems found to excel at imitation, but not innovation
#17Even their imitation is just superficial, at least for the prompts the average user is motivated to write. I might not be able to differentiate AI content from any human content, but I can differentiate it from high quality human content. Which is a bit sad, since AI will probably eliminate most lower end content creation jobs. This doesn't improve the state of the content industry for users, but saves companies quit…
>but saves companies quite some money
That's all that matters to companies.
Re: Artificial intelligence systems found to excel at imitation, but not innovation
#18Innovation involves a lot of "standing on the shoulders of giants"... imitation is a necessary first step.
I say we leave the innovation to humans.
Re: Artificial intelligence systems found to excel at imitation, but not innovation
#19> Artificial intelligence systems found to Excel at imitation, but not innovation And they do it using the Microsoft spreadsheet software?
Is this one of those quirky HN automatic title edits or was this just a typo from the post author?
Re: Artificial intelligence systems found to excel at imitation, but not innovation
#20Even their imitation is just superficial, at least for the prompts the average user is motivated to write. I might not be able to differentiate AI content from any human content, but I can differentiate it from high quality human content. Which is a bit sad, since AI will probably eliminate most lower end content creation jobs. This doesn't improve the state of the content industry for users, but saves companies quit…
>but saves companies quite some money That's all that matters to companies.
Until they can't find seniors anymore.