Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

secondbreakfast.co

Post reply on HN
Print view View original

21–30 of 129 posts

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#21

Post by famouswaffles »

dwohnitmok wrote: post #4

> Almost all AGI doomsayers assume AGI will have agency. They have this vision of the machine deciding it’s time to end civilization. No. Agency is not a necessary condition for AI to do massive damage. I don't believe agency is really well-defined either. An AI merely needs to be hooked up to enough physical systems, have sufficiently complex reaction mechanisms, and some way of looping to do a lot of damage. For th…

You can imbue an LLM with agency. Actual "do whatever you want" agency. It's not hard. In fact it's already being done in a few projects.

You can embody an LLM too. This too is not hard. Cost is probably the most prohibitive thing.

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#22

Post by secondbreakfast »

danbmil99 wrote: post #15

in the now infamous Lex interview, Sam Altman proposes a test for consciousness (he attributes it to Ilya Sutskever): Somehow, create an AI by training on everything we train on now, _except_ leave out any mention of consciousness, theory of mind, cognitive science etc (maybe impossible in practice but stay with me here). Then, when the model is mature (and it is not nerf'd to avoid certain subjects) you ask it somet…

Going to actually link to this comment in my footnote, I loved that snippet from his interview

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#23

Post by raydiatian »

Madmallard wrote: post #13
jasfi wrote: post #10

I couldn't believe it when someone posted a story about a possible AI winter approaching, and with so many comments agreeing. GPT-4 is a game-changer that's only getting started.

it is useful in a lot of ways but it doesn't "solve" software like people think it does. it's just better google search.

This.

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#24

Post by jasfi »

Madmallard wrote: post #13
jasfi wrote: post #10

I couldn't believe it when someone posted a story about a possible AI winter approaching, and with so many comments agreeing. GPT-4 is a game-changer that's only getting started.

it is useful in a lot of ways but it doesn't "solve" software like people think it does. it's just better google search.

It's augmenting software developers in a way that's badly needed. I personally hope it stays that way, but people are always pushing the limits and there's still a lot of improvements that could be made to these systems.

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#25

Post by wslh »

I always wonder what is superintelligence understanding there is not a sole definition or science fiction approach.

Just brainstorming, I think superintelligence could be showing intelligence from more than one brain. For example, an AGI that discovers math theorems discovered by more than one mathematician in different ages. Another could be inferring things that humanity cannot do in any time.

More ideas?

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#27

Post by famouswaffles »

computerex wrote: post #19

The definition of super-intelligent AGI seems arbitrary. GPT-4 destroys humans on the sheer volume and breadth of knowledge that it has. You could very reasonably say that that's super-intelligent.

That's because it is and the posts keep shifting.

AGI used to mean artificial and generally intelligent ( which we have passed), then it meant on par with human experts and now it seems to mean better than all experts combined. At this point why not stop the farce and replace the G in there with Godlike.

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#28

Post by Animats »

parisivy wrote: post #14

At which point, would we change our legal system to allow AGIs to own property or have fiduciary duties over a company? What would be the minimum requirements for it to happen.

Incorporating in a jurisdiction which allows anonymous ownership. Such as Nevada.

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#29

Post by tjr »

jasfi wrote: post #24
Madmallard wrote: post #13

Earlier quoted context omitted.

it is useful in a lot of ways but it doesn't "solve" software like people think it does. it's just better google search.

It's augmenting software developers in a way that's badly needed. I personally hope it stays that way, but people are always pushing the limits and there's still a lot of improvements that could be made to these systems.

Why do you think it is badly needed?

Not arguing with you, just curious what you're thinking here.

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#30

Post by knome »

parisivy wrote: post #14

At which point, would we change our legal system to allow AGIs to own property or have fiduciary duties over a company? What would be the minimum requirements for it to happen.

I had thought about this a few years back. My final thought to avoid intervention from a human owner was that the company could be fully owned by a second company, which is then fully owned by the first. This chain would effectively remove the businesses from human ownership, and the AI would inherit the "personhood" of the business entities. I don't know where the legality is for such a thing.
Post reply on HN