Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Artificial intelligence systems found to excel at imitation, but not innovation

techxplore.com

Post reply on HN
Print view View original

71–80 of 126 posts

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#71

Post by natpalmer1776 »

raymondh wrote: post #67

What counts as an innovation is in the eye of the beholder. Mark Rober demonstrated Gemini's creative ability by having it suggest a video, details of contents, and how to produce it. The results were impressive but far from world changing: https://www.youtube.com/watch?v=mHZSrtl4zX0

I would argue that just because it can suggest a new video with all the fixings does not necessarily mean that it is being innovative in the sense that the concepts produced would in some way alter the 'state of art' at a cultural level.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#72

Post by HarHarVeryFunny »

corethree wrote: post #66
HarHarVeryFunny wrote: post #63

Earlier quoted context omitted.

I think that a lot of hallucination might just be due to not planning ahead - basically a case of running mouth before engaging brain, and then being in a situation where one has uttered a bunch of nonsense - basically backed oneself into a conversational corner. A human might catch themselves with "err, never mind, forget that!", but the LLM's only recourse is to continue extrapolating the nonsense the only way it k…

As the query prompter you are in control of the feedback loop. You can ask the AI to re-examine it's output to catch errors just as a human would do for himself. Practically speaking this does work to a limited extent. Sometimes the AI just sticks with it's guns and runs with it just like a human might.

Sure, but I was addressing the issue of why "hallucinations" occur in the first place, and how to fix them.

Having a human in the loop does seem pretty much required at the moment, but it doesn't help when asking the AI for the answer to something you don't know, and therefore not being able to realize that the confident answer was hallucinated and wrong. Of course multiple-answer quizzes are easier to get right by process of elimination, so the human might sometimes be able to say "THAT can't be right" and catch SOME of the hallucinations.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#74

Post by gwern »

"In the next stage of the experiment, 85% of children and 95% of adults were also able to innovate...Effective tools were selected...75% by the best-performing model."

"AI lacks the crucial human ability of innovation, researchers at the University of California, Berkeley have found."

It says a lot about how we evaluate AI these days, and how we move the goalposts at hypersonic speed, that the summary of benchmarking this astounding leap in AI capabilities is 'AI unable to innovate, only imitate' instead of 'AI goes from zero to near-human level in just a few years, no limit in sight'.

When it comes to DL, if the glass is even 1% empty, then it 'lacks the crucial property of having contents', I guess...

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#75

Post by pixl97 »

HKH2 wrote: post #22
k__ wrote: post #15

Even their imitation is just superficial, at least for the prompts the average user is motivated to write. I might not be able to differentiate AI content from any human content, but I can differentiate it from high quality human content. Which is a bit sad, since AI will probably eliminate most lower end content creation jobs. This doesn't improve the state of the content industry for users, but saves companies quit…

> AI will probably eliminate most lower end content creation jobs. This doesn't improve the state of the content industry for users, but saves companies quite some money. What does it say if your work can't be distinguished from AI clichés? Maybe it's what the industry needs.

Innovation probably isn't as wanted as you think.

I don't want the menu at some place I'm eating at to be innovative, I want it to be legible.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#76

Post by xcv123 »

kjkjadksj wrote: post #30
visarga wrote: post #21

Earlier quoted context omitted.

AI is going to be in a different place in 5 or 10 years.

Thats what they were saying about crypto too

That's a non sequitur.

Cryptocurrencies failure to live up to the hype has almost nothing to do with algorithms or technological issues.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#77

Post by onos »

gwern wrote: post #74

"In the next stage of the experiment, 85% of children and 95% of adults were also able to innovate...Effective tools were selected...75% by the best-performing model." "AI lacks the crucial human ability of innovation, researchers at the University of California, Berkeley have found." It says a lot about how we evaluate AI these days, and how we move the goalposts at hypersonic speed, that the summary of benchmarking…

There’s plenty of content lauding ai. When initial goals are met is it not a good time to set new ones?

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#78

Post by pixl97 »

kjkjadksj wrote: post #30
visarga wrote: post #21

Earlier quoted context omitted.

AI is going to be in a different place in 5 or 10 years.

Thats what they were saying about crypto too

That's what they were saying about the internet too.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#79

Post by RosanaAnaDana »

pixl97 wrote: post #75
HKH2 wrote: post #22

Earlier quoted context omitted.

> AI will probably eliminate most lower end content creation jobs. This doesn't improve the state of the content industry for users, but saves companies quite some money. What does it say if your work can't be distinguished from AI clichés? Maybe it's what the industry needs.

Innovation probably isn't as wanted as you think. I don't want the menu at some place I'm eating at to be innovative, I want it to be legible.

> Innovation probably isn't as wanted as you think.

Hollywood having given over almost entirely to franchises regurgitating the same tired plots and stories ad-nauseam would seem to agree with you.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#80

Post by sidlls »

corethree wrote: post #47
vemv wrote: post #12

One can casually observe that LLMs quite excel at composition though: gluing together pieces of knowledge in ways no one did before (examples: a program that does X using language Y, a painting that mashes up two themes). Most knowledge workers' activities aren't innovative or imitational - similarly, we compose stuff, so LLMs are a fair competitor.

All innovation is composition plus random generation. Which LLMs already do. LLMs have a rudimentary form of innovation. It's not quite as good as humans but it's getting there.

All innovation is composition plus random generation.

That’s a fairly bold claim. What supporting data do you have to justify it?

Post reply on HN