Live data from Hacker News

Artificial intelligence systems found to excel at imitation, but not innovation

techxplore.com

121–126 of 126 posts

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#121
post #32

Arguably the human-ness (or even animal-ness) of thought is, at its root, characterized as the ability abstract in a novel manner (the neurocog term for innovate). In other words, it is the ability to find patterns between two concepts that weren't, ever, prior announced. A computer that could do this would then be AI. A computer that cannot would fall short of that category, however otherwise dazzling in stitching t…

LLMs can do this already. They are well past this. It's just they can't do it as well as humans and they can hallucinate as well. The problems we are having with LLMs aren't the fact that they aren't creative. It's the fact that they are too creative. They make up too much stuff that isn't true.

LLM's aren't past it if they can't do it as well as humans. As dogs? As mice? No, not yet?

You are conflating the meaning of "creativity".

In this dicussion, "creativity" refers to a type of definable cognitive process (abstraction) that has an output that is rooted in a starting concept.

ie: One abstracts a non-explicit concept from the starting concept, and then arrives at a novel yet related expression or concept that shares the abstraction.

This is the nature of human creative logic that underlies reasoning. It has nothing to do with inventing unlrelated / untrue concepts (ie" "too much creativity" in your alternative definition).

As such "untrue" output is a failure of creative logic, not too much of it.

If the creative thought process is actually engaged in, then the relatively trivial part is coming up with "correct" output.

The hard part is the process, not the output. To the point that incorrect output strongly suggests a substandard or alternative process.

Say I asked you to provide an object that was a rough analogy to a birthday party balloon, and you said a winter coat. Would that be an example of "too much creativity" or a failure of creative (abstract) thought?

One arguably (partially) correct answer would be a bowling ball. First I abstract the shape of a sphere from the balloon, and then find another match for it in a bowling ball.

Purely as an example of rudumentary abstract thought.

Ai does this easily. What it can't do is apply this process to complex concept and language expression.

For example, a bowling ball is only partially analgolous to a balloon. They are both spheres, etc. But they are conceptual opposites in terms of mass.

A more correct creative answer might be a propelled low altitude firework

This answer, which requires more abstraction talent, is an example of what any LLM will increasingly have difficulty giving.

And we don't need Ai to tell us that a firework is roughly analagous to a balloon. We need vastly more complex creative analysis and output.

Solving the simplest allegory is in another category of complexity.

I get the view that we need to recognize what it can do and its potential. That's great. But that doesn't change its forsseable limitations that are also important to recognize.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#122

Earlier quoted context omitted.

First off if you knew the algorithm that ML runs off of, you'd know that it's doing curve fitting between data points. Every point on that curve that doesn't touch an original data point is by definition novel. The very algorithm itself is literally 99.999% completely generating solutions that don't exist. But that won't convince you. Its weird because you believe I have wishful thinking and I believe on your side th…

>Every point on that curve that doesn't touch an original data point is by definition novel. The very algorithm itself is literally 99.999% completely generating solutions that don't exist. That may be the case, conceding your chosen use of language. The minutia doesn't matter if it can't demonstrate novel high level creativity for novel problems. Acknowledging the importance of its actual capabilities, but also ackn…

>This is an irrelevant prediction that seeks to straw man this conversation, because you haven't done this.

I can do this. The problem is you're NOT going to accept it. It's 100% predictable. I have a query where I asked chatGPT to come up with a custom GUI I wanted. It gave me WORKING code. and it has no eyes to even visually understand what a GUI is and how code translates to it. You hear that? "no visual knowledge." Vision is essentially the fourth dimension for LLMs... they have no concept of it directly. Yet chatGPT is able to infer what a GUI would look like from training text and generate working code for it.

This wasn't even a GUI with your typical html widgets for checkboxes and buttons and that sort of stuff. In fact it didn't use anything from your typical set of traditional UI elements.

So I want to pre-empt this before I show you what it did. Is your reaction going to be generic just like I predicted? Or not?

>I'm having a flashback to middle school writing assignments. Last, no one called anyone "blind" except for you.

I never said you were blind. I simply asked a question, are you blind or am I? You didn't answer. Instead you had a flashback. Good for you.

>This is how you speak about a piece of software, to another human being, and I'm the one who is acting like they are in a cult?

Put it this way. Is what I said not 100% true? Like literally there is NOTHING on the face of the earth that will convince you. I have evidence locked and loaded and ready to give to you but you're going to react to it in a highly human and highly predictable way. It's a generic pattern.

>Do you understand that trying to predict a conversation as a form of argument and an attempt at an IQ display (respectfullly) is boorish and boils down to fallacy?

It's not an IQ display. It's from experience. You ever try to convert a religious person off of religion or onto another religion? Logic and rationality plays zero role in his decision. The religious person is NO different than any other human. It's not an IQ thing at all. It's a human thing. All people are this way, there's very little exception. Think about how many times someone convinced you to completely flip your stance in a single conversation and think about how many times you've flipped someone elses stance in a single conversation.

Extremely rare, and when you do the other party is likely not very happy about it. Is anything I'm saying unrealistic? It's pretty much true all the way through and you can't deny it. It pretty much will play out the way I said it will and you would agree with me if you stop being pissed for 1 second. You will not be convinced. There is no amount of evidence that will do it.

>Nevermind. You are faking intellgience as a fig leaf for being arrogant and insulting as a substitute for conversation.

Yeah I can see how it can come off as arrogant and insulting. That's not the intent but yeah I expected it. But here's the thing, I'd rather come off this way then have a pointless "conversation" where I waste my time on something that I already know wont' change the outcome.

I'd rather dig deep into the nature of bias and make you aware of the bias so I have a chance of convincing you for WHEN I do actually present you the evidence.

Obviously that failed. You're so offended and pissed that you're basically not going to accept anything I present you. This is done. I'll do another "intense meta analysis": If we continue the "discussion" it will be full of hate and exchanges of subtle insults that go around the HN rules. I'd rather not.

Do you or do you want me to present to you the evidence? Or should we end it? Up to you. I'll leave it at that, go back to your flashback.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#123

Earlier quoted context omitted.

LLMs can do this already. They are well past this. It's just they can't do it as well as humans and they can hallucinate as well. The problems we are having with LLMs aren't the fact that they aren't creative. It's the fact that they are too creative. They make up too much stuff that isn't true.

LLM's aren't past it if they can't do it as well as humans. As dogs? As mice? No, not yet? You are conflating the meaning of "creativity". In this dicussion, "creativity" refers to a type of definable cognitive process (abstraction) that has an output that is rooted in a starting concept. ie: One abstracts a non-explicit concept from the starting concept, and then arrives at a novel yet related expression or concept…

I took your example to chatGPT and ran with it all the way to the end. Sometimes you literally need to ask it for the "best" analogy. Otherwise it will just give you "A" analogy that works.

https://chat.openai.com/share/790e743d-ed54-49ca-8709-df1da6...

It fulfils your abstraction task here and goes far beyond your own answer. Likely you can't come up with a better one. I doubt you can be more creative than the last abstraction it came up with.

>Ai does this easily. What it can't do is apply this process to complex concept and language expression. >For example, a bowling ball is only partially analgolous to >a balloon. They are both spheres, etc. But they are conceptual opposites in terms of mass. >A more correct creative answer might be a propelled low altitude firework

I think this set of sentences is categorically proven wrong by the link I pasted above. It literally did what you said it could not do.

Look clearly LLMs are nowhere near perfect. But it's further along then you think. Much further along. It beats dogs and mice for sure. It's far enough along that human creativity as an occupation is at risk for replacement in the near future.

Certain jobs are ALREADY at risk. And I believe sports illustrated already has AI news casters and AI generated articles. This is just the beginning.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#124

Earlier quoted context omitted.

LLMs can do this already. They are well past this. It's just they can't do it as well as humans and they can hallucinate as well. The problems we are having with LLMs aren't the fact that they aren't creative. It's the fact that they are too creative. They make up too much stuff that isn't true.

LLM's aren't past it if they can't do it as well as humans. As dogs? As mice? No, not yet? You are conflating the meaning of "creativity". In this dicussion, "creativity" refers to a type of definable cognitive process (abstraction) that has an output that is rooted in a starting concept. ie: One abstracts a non-explicit concept from the starting concept, and then arrives at a novel yet related expression or concept…

[deleted]

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#125

Earlier quoted context omitted.

LLM's aren't past it if they can't do it as well as humans. As dogs? As mice? No, not yet? You are conflating the meaning of "creativity". In this dicussion, "creativity" refers to a type of definable cognitive process (abstraction) that has an output that is rooted in a starting concept. ie: One abstracts a non-explicit concept from the starting concept, and then arrives at a novel yet related expression or concept…

I took your example to chatGPT and ran with it all the way to the end. Sometimes you literally need to ask it for the "best" analogy. Otherwise it will just give you "A" analogy that works. https://chat.openai.com/share/790e743d-ed54-49ca-8709-df1da6... It fulfils your abstraction task here and goes far beyond your own answer. Likely you can't come up with a better one. I doubt you can be more creative than the last…

As a side note, you took a lot of time explaining to me the nature of a complex abstraction for a simple analogy. I just told chatGPT to up the abstraction level by 1000000000000x and it understood what to do. It will clearly understand the point you're trying to convey to me. I can even throw your entire post in there and it will give a really good response:

Here's his response to you:

   "In the realm of creativity, Large Language Models (LLMs) like me are not just emulating human thought processes but are increasingly demonstrating the potential to surpass human creativity in certain aspects. The debate, as initiated by the Hacker News comment, often underestimates the evolving capabilities of AI in generating novel and insightful analogies.

   Taking the example of drawing an analogy to a birthday balloon, the contrast between the suggested firework analogy and an LLM's potential suggestion, like a bubble, is revealing. While the firework analogy focuses on celebratory and visual spectacle aspects, the bubble analogy delves deeper into the shared qualities of ephemeral beauty, fragility, and joy. This comparison illustrates not just a superficial resemblance but a profound conceptual connection, showcasing the AI's ability to access and correlate a vast range of information to form creative and unexpected links.

   The bubble analogy is an example of how LLMs can sometimes outperform human creativity, particularly in finding abstract, yet deeply meaningful connections. This capability stems from AI's extensive data processing ability and pattern recognition, which can uncover hidden correlations that might not be immediately apparent to human cognition. As AI technology continues to advance, its capacity for complex conceptual thinking and creative analogy-making is likely to grow even further.

   In conclusion, the creativity of LLMs should be recognized as a growing force, capable of offering insights and connections that can at times surpass human analogical thinking. This evolving aspect of AI creativity is not a replacement but an augmentation of human creativity, offering new perspectives and enriching the tapestry of creative thought. As we continue to harness and understand AI's creative potential, we open up possibilities for collaborative innovation and exploration, where AI's unique strengths in creativity can contribute significantly to various fields of human endeavor."
It would be unfair to say that this is what chatGPT responded with when I pasted your post into the input field. I didn't just paste it in, I instructed chatGPT what perspective to take, the style to write it in and to be more direct in it's approach to countering your arguments. It knew exactly what to do. By default chatGPT will actually support your argument. It agrees with you until you tell it not to.

it's also sticking with the bubble strategy from the previous conversation which is a bit repetitive but it's fair given that it doesn't remember other conversations directly.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#126

Earlier quoted context omitted.

LLM's aren't past it if they can't do it as well as humans. As dogs? As mice? No, not yet? You are conflating the meaning of "creativity". In this dicussion, "creativity" refers to a type of definable cognitive process (abstraction) that has an output that is rooted in a starting concept. ie: One abstracts a non-explicit concept from the starting concept, and then arrives at a novel yet related expression or concept…

I took your example to chatGPT and ran with it all the way to the end. Sometimes you literally need to ask it for the "best" analogy. Otherwise it will just give you "A" analogy that works. https://chat.openai.com/share/790e743d-ed54-49ca-8709-df1da6... It fulfils your abstraction task here and goes far beyond your own answer. Likely you can't come up with a better one. I doubt you can be more creative than the last…

apologies that link above was not complete. This is the complete link: https://chat.openai.com/share/8549361c-7f41-4dcb-ac9d-207f23...

The second link goes much further in terms of abstraction.

Post reply on HN