Live data from Hacker News

Artificial intelligence systems found to excel at imitation, but not innovation

techxplore.com

111–120 of 126 posts

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#111

Earlier quoted context omitted.

How do you think our brains work?

I don't know how our brains work. If you don't just want to be snarky: I think the difference between acquisition and learning is important, I think the role of instruction might be important, I think the role of practice is important.

If the stream of data that is our 5 senses of reality is devoid of statistical significance of any kind, how do you propose our brains can learn anything?

Of course, brains as we know it (or complex systems of any sort for that matter) would not exist in such a reality.

In other words it is first and foremost the presence of complex statistical relationships inherent to data/reality that facilitates emergence of other complex systems. Such as the notion of "intelligence" and brains.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#112

Earlier quoted context omitted.

I don't know how our brains work. If you don't just want to be snarky: I think the difference between acquisition and learning is important, I think the role of instruction might be important, I think the role of practice is important.

If the stream of data that is our 5 senses of reality is devoid of statistical significance of any kind, how do you propose our brains can learn anything? Of course, brains as we know it (or complex systems of any sort for that matter) would not exist in such a reality. In other words it is first and foremost the presence of complex statistical relationships inherent to data/reality that facilitates emergence of othe…

We need statistical significance.

is not the same as

Statistical significance is enough.

These are two different things.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#113

Earlier quoted context omitted.

If the stream of data that is our 5 senses of reality is devoid of statistical significance of any kind, how do you propose our brains can learn anything? Of course, brains as we know it (or complex systems of any sort for that matter) would not exist in such a reality. In other words it is first and foremost the presence of complex statistical relationships inherent to data/reality that facilitates emergence of othe…

We need statistical significance. is not the same as Statistical significance is enough. These are two different things.

In case you are interested, I wrote a piece in defense of understanding in LLMs[1]. The section under the heading "Why think LLMs have understanding at all" is the most relevant.

[1] https://www.reddit.com/r/naturalism/comments/1236vzf

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#114
post #12

One can casually observe that LLMs quite excel at composition though: gluing together pieces of knowledge in ways no one did before (examples: a program that does X using language Y, a painting that mashes up two themes). Most knowledge workers' activities aren't innovative or imitational - similarly, we compose stuff, so LLMs are a fair competitor.

... and our judgments of composition favor recall over precision. Which is to say that as human judges we're good at finding sense in something generated if it's plausible. We'll take a proposition (eg in a composition) and construct a justification for it. "I can see how that makes sense". I am conflating plausible combination with high recall. Precision, in this sense, is that no proposition would be acceptable wit…

[deleted]

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#115

As I see it the AI schism is more about the debate between functionalism/computationalism and the idea that the chinese room thought experiment was an argument for, "biological naturalism". There is a lot of effort dedicated to showing that AIs dont have some innate quality called "consciousnes" or "sentience" or what have you. There is not just a lot of effort to show that, but also to show that that is somehow a li…

Consciousness and sentience are just poorly defined vocabulary that delude people into thinking it's meaningful categorizations. There's just a bunch of traits related to intelligence and we categorize that if something has enough of those traits then it's "alive". But the words "consciousness" and "sentience" are so poorly defined that we can't pinpoint the formal grouping of what these traits actually are. So for a…

I don't agree.

First off, just because definitions are fuzzy, doesn't make them arbitrary.

And the boundaries between words may be fuzzy, but the consequences of these fuzzy definitions can have severe consequences. Race is a social construction, yet its definitions, fuzzy as they may be, have had huge consequences and shape the world we see today just by them existing. If we consider AI to be sentient, then that means we can leap and subscribe certain rights, which have legal consequences (For example, is AI "learning" fair use because it's learning like a human and is sentient).

Profoundness or not, these are very important discussions to have, and are certainly meaningful to discuss, even if these terms can not be neatly defined.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#116

Earlier quoted context omitted.

Consciousness and sentience are just poorly defined vocabulary that delude people into thinking it's meaningful categorizations. There's just a bunch of traits related to intelligence and we categorize that if something has enough of those traits then it's "alive". But the words "consciousness" and "sentience" are so poorly defined that we can't pinpoint the formal grouping of what these traits actually are. So for a…

I don't agree. First off, just because definitions are fuzzy, doesn't make them arbitrary. And the boundaries between words may be fuzzy, but the consequences of these fuzzy definitions can have severe consequences. Race is a social construction, yet its definitions, fuzzy as they may be, have had huge consequences and shape the world we see today just by them existing. If we consider AI to be sentient, then that mea…

Meaningful to discuss in the context of law, rules, rights and regulations.

Not meaningful to discuss in a universal context. As in where did we come from? How did the universe form? What is the nature of reality? The question is not profound in this sense as it is just a categorization problem. From this perspective they are arbitrary.

Of course categorization is very meaningful in other contexts like the ones I listed in my first paragraph. But you have to realize that you're getting into stuff like law, literature, poetry, ethics and things that are arbitrarily given meaning because we are human. Questions in this area are not profound nor meaningful from the "universal context" which is the frame of my point and this branching thread.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#117

Earlier quoted context omitted.

Consciousness and sentience are just poorly defined vocabulary that delude people into thinking it's meaningful categorizations. There's just a bunch of traits related to intelligence and we categorize that if something has enough of those traits then it's "alive". But the words "consciousness" and "sentience" are so poorly defined that we can't pinpoint the formal grouping of what these traits actually are. So for a…

I don't agree. First off, just because definitions are fuzzy, doesn't make them arbitrary. And the boundaries between words may be fuzzy, but the consequences of these fuzzy definitions can have severe consequences. Race is a social construction, yet its definitions, fuzzy as they may be, have had huge consequences and shape the world we see today just by them existing. If we consider AI to be sentient, then that mea…

Meaningful to discuss in the context of law, rules, rights and regulations.

Not meaningful to discuss in a universal context. As in where did we come from? How did the universe form? What is the nature of reality? The question is not profound in this sense as it is just a categorization problem. From this perspective they are arbitrary.

Of course categorization is very meaningful in other contexts like the ones I listed in my first paragraph. But you have to realize that you're getting into stuff like law, literature, poetry, ethics and things that are arbitrarily given meaning because we are human. Questions in this area are not profound nor meaningful from the "universal context" which is the frame of my point and this branching thread.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#118
post #32

Arguably the human-ness (or even animal-ness) of thought is, at its root, characterized as the ability abstract in a novel manner (the neurocog term for innovate). In other words, it is the ability to find patterns between two concepts that weren't, ever, prior announced. A computer that could do this would then be AI. A computer that cannot would fall short of that category, however otherwise dazzling in stitching t…

LLMs can do this already. They are well past this. It's just they can't do it as well as humans and they can hallucinate as well. The problems we are having with LLMs aren't the fact that they aren't creative. It's the fact that they are too creative. They make up too much stuff that isn't true.

Show me where ChatGPT4 can solve for a novel allegory.

That type of processing is not within the scope of its capability.

Ask it. Prod it. Try to force it. It'll tell you.

I like Ai. But It's important to be realistic. It can't abstract in a completely creative way from a basis of language with embedded and only-implied meta-patterns, the latter which is the nature of human cognition.

I just tried asking Bing ChatGPT to solve the most rudimentary allegory: presented in a single sentence and with given three solution options. It deflected endlessly, before telling me that it couldn't solve it for the benefit of my self-growth and then signing itself off!

It'll be nice when open source Ai renders these clownish interactions obsolete, but there still isn't evidence that it can begin to mimic the plasticity of human cognition.

What it can do is bs a lot when it hits a dead end.

Ai can match shapes, as a rudimentary part of its ability. That is a start. But what it needs to be able to do is decaode complex narrative as a shape, and then identify the same shape in other narratives and concepts. Thereby making a novel connection born out of abstract thought. Or it even might create a new model (ie: allegory) using the prior undetected pattern. As high IQ humans do, subconsciously and sometimes consciously.

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#119

Earlier quoted context omitted.

LLMs can do this already. They are well past this. It's just they can't do it as well as humans and they can hallucinate as well. The problems we are having with LLMs aren't the fact that they aren't creative. It's the fact that they are too creative. They make up too much stuff that isn't true.

Show me where ChatGPT4 can solve for a novel allegory. That type of processing is not within the scope of its capability. Ask it. Prod it. Try to force it. It'll tell you. I like Ai. But It's important to be realistic. It can't abstract in a completely creative way from a basis of language with embedded and only-implied meta-patterns, the latter which is the nature of human cognition. I just tried asking Bing ChatGPT…

First off if you knew the algorithm that ML runs off of, you'd know that it's doing curve fitting between data points. Every point on that curve that doesn't touch an original data point is by definition novel. The very algorithm itself is literally 99.999% completely generating solutions that don't exist. But that won't convince you.

Its weird because you believe I have wishful thinking and I believe on your side that you are in denial. When I query chatGPT I look for intelligence, when you query it you look for flaws.

The pattern in our argument will be obvious and repetitive just like the output of an LLM.

What will happen is this. I will present to you a prompt and the result which I believe verifies the status of chatGPT as an AI capable of solving novel problems.

You will look at that query and you will say something along the lines that the problem and answer set already exists in the data and it's just regurgitating existing solutions from the training set.

We can attempt to pre empt this. I can allow you to come up with a prompt to produce something novel but what will happen is that you will choose a prompt biased towards your argument and I will choose a prompt clearly biased towards mine and we will each have excuses for why the other is invalid.

That's how humans work. We don't believe things based off of rational arguments, we construct rational arguments based off of pre existing beliefs. But you are unaware of this. It's like religion people are unaware of their own bias.

You will never believe ai can produce novel things. Nothing anyone can say will ever convince you at this moment. What may convince you is over a span of 10 years as ai improves your opinion slowly flips the same way a scientologist slowly comes to terms that he is in a cult.

I want to bypass all this in built bias I want both of us to admit to logical statements before we present our arguments and if that logical statement is violated you are wrong. Definitively. Bias and excuses be damned.

First ai can't always produce novel and correct output. It only does this sometimes. As we all know it's inconsistent. So examples of AI being stupid does not preclude it from being smart.

What if I have it construct a GUI? An arbitrary GUI that I need for a work assignment. chatGPT has no eyes so there's no visual data it can copy the solution from. If it were to construct a working code solution it would have to be novel by definition. If I present to you such a prompt and answer pair. Would that convince you? Of course not because you already know I have such a prompt prepared and these debates are more about competition then it is about learning. But I ask anyway. Would it convince you?

I'm curious whether my intense meta-analysis helps you see the alternate possibility here: that I am not just hopeful of AI to be great and that it's possible that you are the one in denial about the inevitable and unknown future that novel AI will herald. Unlikely. by definition we are all blind to our bias, am I blind or are you?

Re: Artificial intelligence systems found to excel at imitation, but not innovation

#120

Earlier quoted context omitted.

Show me where ChatGPT4 can solve for a novel allegory. That type of processing is not within the scope of its capability. Ask it. Prod it. Try to force it. It'll tell you. I like Ai. But It's important to be realistic. It can't abstract in a completely creative way from a basis of language with embedded and only-implied meta-patterns, the latter which is the nature of human cognition. I just tried asking Bing ChatGPT…

First off if you knew the algorithm that ML runs off of, you'd know that it's doing curve fitting between data points. Every point on that curve that doesn't touch an original data point is by definition novel. The very algorithm itself is literally 99.999% completely generating solutions that don't exist. But that won't convince you. Its weird because you believe I have wishful thinking and I believe on your side th…

>Every point on that curve that doesn't touch an original data point is by definition novel. The very algorithm itself is literally 99.999% completely generating solutions that don't exist.

That may be the case, conceding your chosen use of language. The minutia doesn't matter if it can't demonstrate novel high level creativity for novel problems.

Acknowledging the importance of its actual capabilities, but also acknowledging that we are arguing over one: applied abstract thinking. If it can't output what is requested, then there is a lie somehwere in the description of its processing IF it is held to be capable.

>When I query chatGPT I look for intelligence, when you query it you look for flaws.

I disagree with your binary frame. One can't acknowledge its ability and where it falls short?

>What will happen is this. I will present to you a prompt and the result which I believe verifies the status of chatGPT as an AI capable of solving novel problems

This is an irrelevant prediction that seeks to straw man this conversation, because you haven't done this.

Keep in mind that my argument rests in creative language analysis. Not in its ability to process math, biological systems logic, nor anything parallel.

> We can attempt to pre empt this. I can allow you to come up with a prompt to produce something novel but what will happen is that you will choose a prompt biased towards your argument and I will choose a prompt clearly biased towards mine and we will each have excuses for why the other is invalid

Do you understand that trying to predict a conversation as a form of argument and an attempt at an IQ display (respectfullly) is boorish and boils down to fallacy?

>But you are unaware of this.

Nevermind. You are faking intellgience as a fig leaf for being arrogant and insulting as a substitute for conversation.

>You will never believe ai can produce novel things. Nothing anyone can say will ever convince you at this moment. What may convince you is over a span of 10 years as ai improves your opinion slowly flips the same way a scientologist slowly comes to terms that he is in a cult.

This is how you speak about a piece of software, to another human being, and I'm the one who is acting like they are in a cult?

>my intense meta-analysis

You think that you have presented "intense meta-analysis"?

My recommendation to you, toward improving your writing and thinking, is to pare down the number of words that you use toward the goal of distilling the actual information that you present. Here, it isn't much. Its an accusation of bias, religious thinking, and insults. Combined with sparse comments on the tech and a barely decipherable fully hypothetical thought experiment without a clear stream of logic. There was nothing intense nor meta about it, aside from the intensity of the word count.

>am I blind or are you?

I'm having a flashback to middle school writing assignments. Last, no one called anyone "blind" except for you.

Post reply on HN