Live data from Hacker News

Rodney Brooks on limitations of generative AI

techcrunch.com

51–60 of 202 posts

Re: Rodney Brooks on limitations of generative AI

#51
post #49

Earlier quoted context omitted.

There will never be, and can never be, "artificial intelligence". (The creation of consciousness is impossible.) It's a fun/interesting device in science fiction , just like the concept of golems (animated beings) are in folk tales. But it's complete nonsense to talk about it as a possibility in the real world so yes, the label of 'machine learning' is a far, far better label to use for this powerful and interesting…

I'll happily engage in specifics if you provide an argument for your position. Here's mine (which is ironically self-defeating but has a grain of truth): single-sentence theories about reality are probably wrong.

I just went back and added a parenthetical statement after my first sentence before seeing this reply (on refresh).

> The creation of consciousness is impossible.

That's where I'd start my argument.

Machines can 'learn', given iterative training and some form of memory but they can not think nor understand. That requires consciousness, and the idea that consciousness can be emergent (which it is my understanding that the 'AI' argument rests upon), has never been shown. It is an unproven fantasy.

Re: Rodney Brooks on limitations of generative AI

#52
post #36

Earlier quoted context omitted.

I’m still waiting for SalesForce to integrate an LLM into Slack so I can ask it business logic and decisions long lost. Still waiting for Microsoft to integrate an LLM into outlook so I can get a summary of a 20 email long chain I just got CCed into. I don’t think the iPod comparison is a valid one. People only have so much time to listen to music. Past a certain point, no one has enough good music they like to put i…

Why should the response be better just because there is "more data"? Should I be adding extra random tokens to my prompts to make the LLM "smarter"?

More context. Not random data.

Re: Rodney Brooks on limitations of generative AI

#53
post #51

Earlier quoted context omitted.

I'll happily engage in specifics if you provide an argument for your position. Here's mine (which is ironically self-defeating but has a grain of truth): single-sentence theories about reality are probably wrong.

I just went back and added a parenthetical statement after my first sentence before seeing this reply (on refresh). > The creation of consciousness is impossible. That's where I'd start my argument. Machines can 'learn', given iterative training and some form of memory but they can not think nor understand. That requires consciousness, and the idea that consciousness can be emergent (which it is my understanding that…

And I guess I'd start my retort by saying that it can't be impossible, because here we are talking about it =P

Re: Rodney Brooks on limitations of generative AI

#54
post #51

Earlier quoted context omitted.

I just went back and added a parenthetical statement after my first sentence before seeing this reply (on refresh). > The creation of consciousness is impossible. That's where I'd start my argument. Machines can 'learn', given iterative training and some form of memory but they can not think nor understand. That requires consciousness, and the idea that consciousness can be emergent (which it is my understanding that…

And I guess I'd start my retort by saying that it can't be impossible, because here we are talking about it =P

No, you don't have any proof for the creation of consciousness, including human consciousness (which is what I understand you are referring to).

In my view, and in the view of major religions (Hinduism, Buddhism, etc) plus various philosophers, consciousness is eternal and the only real thing in the universe. All else is illusion.

You don't have to accept that view but you do have to prove that consciousness can be created. An 'existence proof' is not sufficient because existence does not necessarily imply creation.

Re: Rodney Brooks on limitations of generative AI

#55

Earlier quoted context omitted.

I’m still waiting for SalesForce to integrate an LLM into Slack so I can ask it business logic and decisions long lost. Still waiting for Microsoft to integrate an LLM into outlook so I can get a summary of a 20 email long chain I just got CCed into. I don’t think the iPod comparison is a valid one. People only have so much time to listen to music. Past a certain point, no one has enough good music they like to put i…

> Still waiting for Microsoft to integrate an LLM into outlook Given that Microsoft this year is all-in on LLM AI, this is surely coming. But perhaps it will be a premium, paid feature?

It’s an additional $20-30/user/mo license, and has already existed in production for several months.

Re: Rodney Brooks on limitations of generative AI

#57
post #54

Earlier quoted context omitted.

And I guess I'd start my retort by saying that it can't be impossible, because here we are talking about it =P

No, you don't have any proof for the creation of consciousness, including human consciousness (which is what I understand you are referring to). In my view, and in the view of major religions (Hinduism, Buddhism, etc) plus various philosophers, consciousness is eternal and the only real thing in the universe. All else is illusion. You don't have to accept that view but you do have to prove that consciousness can be c…

Look, I don't want to get into the weeds of this because personally I don't think it's relevant to the issue of intelligence, but here's a list of things I think are evident about consciousness:

1. People have different kinds of conscious experience (just talk to other humans to get the picture).

2. Consciousness varies, and can be present or not-present at any given moment (sleep, death, hallucinogenic drugs, anaesthesia).

3. Many things don't have the properties of consciousness that I attribute to my subjective experience (rocks, maybe lifeforms that don't have nerve cells, lots of unknowns here).

Given this, it's obvious that consciousness can be created from non-consciousness, you need merely to have sex and wait 9 months. Add to that the fact that humans weren't a thing a million years ago, for instance, and you have to conclude that it's possible for an optimisation system to produce consciousness eventually (natural selection).

Re: Rodney Brooks on limitations of generative AI

#58

We'll see GPT-5 in a few months and that will be vastly more useful information to update your sense of whether the current approach will continue to work than anyone's speculation today.

Right. Given we have so few data points at least GPT 5 will offer a completely new one. That will actually be new information.

Re: Rodney Brooks on limitations of generative AI

#59

To me, this reads like a very reasonable take. He suggests to limit the scope of the AI problem, add manual overrides in case there are unexpected situations, and he (rightly, in my opinion) predicts that the business case for exponentially scaling LLM models isn't there. With that context, I like his iPod example. Apple probably could have made a 3TB iPod to stick to Moore's law for another few years, but after they…

Is there a reason why memory was used and not compute power as an example? I don't understand how cherry picking random examples from past explain future of AI. If he think business needs does not exist he should explain how he arrived at that conclusion instead of a random iPod example.

It's an analogy. He's making the point that even though something can scale at an exponential rate, it doesn't mean there is a business need for such scaling

Re: Rodney Brooks on limitations of generative AI

#60
post #2

Amara's law -- "We tend to overestimate the effect of a technology in the short run and underestimate the effect in the long run."

and bard/gemini and chatgpt consistently given look-good-but-broken examples when asked for help with code.

the bubble on this is going to make the .com crash look like peanuts.

Post reply on HN