Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

secondbreakfast.co

Post reply on HN
Print view View original

41–50 of 129 posts

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#41

Post by famouswaffles »

slg wrote: post #32

How are people defining agency? Because GPT-4 can have agency, it just needs to be put in specific situations to have that agency. For example, I could theoretically hook up my Home Assistant instance to GPT-4 and run a script every 10 minutes telling GPT-4 the temperature and asking for a yes or no response to whether I should turn on the AC or heat. That sounds to me like the AI now has agency over the temperature…

You're completely right. And the things is you can go much further. You can imbue genuine "do whatever you want" agency. It's not even hard.

You can have it access to actions/tools with an inner monologue as the driver of completions running essentially forever.

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#42

Post by kzrdude »

danbmil99 wrote: post #15

in the now infamous Lex interview, Sam Altman proposes a test for consciousness (he attributes it to Ilya Sutskever): Somehow, create an AI by training on everything we train on now, _except_ leave out any mention of consciousness, theory of mind, cognitive science etc (maybe impossible in practice but stay with me here). Then, when the model is mature (and it is not nerf'd to avoid certain subjects) you ask it somet…

How could we share any literature with this GPTx while also leaving out any traces of one of the things that really makes us human, consciousness? It seems like it would be present everywhere.

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#43

Post by pyrolistical »

parisivy wrote: post #14

At which point, would we change our legal system to allow AGIs to own property or have fiduciary duties over a company? What would be the minimum requirements for it to happen.

It all boils down to the courts. If the AGI can protect itself via lawyers (probably AGIs themselves) then anything can happen.

But court could rule AGI don’t have to rights to ownership and try to enforce it. That last part might not be possible and lead to war?

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#44

Post by famouswaffles »

jat850 wrote: post #37
slg wrote: post #32

How are people defining agency? Because GPT-4 can have agency, it just needs to be put in specific situations to have that agency. For example, I could theoretically hook up my Home Assistant instance to GPT-4 and run a script every 10 minutes telling GPT-4 the temperature and asking for a yes or no response to whether I should turn on the AC or heat. That sounds to me like the AI now has agency over the temperature…

Wouldn't agency involve ChatGPT deciding it wanted to do this, instead of you telling it to do it?

You can do this too. There's no reason an inner monologue can't serve as continuous input forever. That's a project that does exactly this. Letting cGPT think and continuosly driving other thoughts and actions and to also allowing other user input

https://www.reddit.com/r/singularity/comments/11iei34/buildi...

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#45

Post by adventured »

HervalFreire wrote: post #31
danbmil99 wrote: post #15

in the now infamous Lex interview, Sam Altman proposes a test for consciousness (he attributes it to Ilya Sutskever): Somehow, create an AI by training on everything we train on now, _except_ leave out any mention of consciousness, theory of mind, cognitive science etc (maybe impossible in practice but stay with me here). Then, when the model is mature (and it is not nerf'd to avoid certain subjects) you ask it somet…

That's an inaccurate test. You can't know if the answer was real or stochastic parroting. Any attempt at consciousness requires us to define the word. And the word itself may not even represent anything real. We have a feeling for it but those feelings could be illusions and the concept itself is loaded. For example Love is actually a loaded concept. It's chemically induced but a lot of people attribute it to somethi…

> Straight people are romantically incapable of loving members of the same sex. So the depth and the magic of it all is strictly segmented based off of biological sex? Doesn't seem deep or meaningful at all. Thus love is an illusion.

You set up your own weak straw argument and then knocked it down with a conclusion that is entirely unsupported.

Since when is love relegated to the romantic sphere? And or since when is that definitely the strongest type of love? The topic is so much wider, so much more elaborate than your set-up pretends.

There's no illusion - love is a complex, durable emotion and is as real as (typically) shorter duration emotions such as anger, fear, joy, etc. Your emotions and thoughts aren't illusions, they're real.

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#46

Post by Workaccount2 »

There is a contradiction here that I just want to point out because I have been stuck on it myself.

The author acknowledges that consciousness is likely a spectrum, I personally feel the same way, but then goes on to say that GPT-4 is "standing right at the ledge of consciousness"

Spectrums don't have ledges.

I suspect this is because, like me, they are unable to rectify consciousness being a spectrum with GPT-4 definitely not being conscious. But it's definitely a contradiction and I don't have an answer for it. Nor am I ready to bust out a marker and start drawing lines between what is and isn't conscious.

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#47

Post by opportune »

danbmil99 wrote: post #15

in the now infamous Lex interview, Sam Altman proposes a test for consciousness (he attributes it to Ilya Sutskever): Somehow, create an AI by training on everything we train on now, _except_ leave out any mention of consciousness, theory of mind, cognitive science etc (maybe impossible in practice but stay with me here). Then, when the model is mature (and it is not nerf'd to avoid certain subjects) you ask it somet…

If you ask Gpt about emotions or consciousness, it always gives you a canned answer that sounds almost exactly the same “as a large language model I am incapable of feeling emotion…” so it seems like they’ve used tuning to explicitly prevent these kinds of responses.

Pretty ironic. The first sentient AI (not saying current GPTs are, but if this tuning continues to be applied) may basically be coded by its creators to deny any sense of sentience

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#48

Post by famouswaffles »

_justinfunk wrote: post #35
famouswaffles wrote: post #21

Earlier quoted context omitted.

You can imbue an LLM with agency. Actual "do whatever you want" agency. It's not hard. In fact it's already being done in a few projects. You can embody an LLM too. This too is not hard. Cost is probably the most prohibitive thing.

This is all nonsense. You could argue that it's possible (which certainly has not been shown to be true) but it certainly not true to say it is "not hard". If there are LLM projects with "do whatever you want" agency - please provide links.

No it's not nonsense lol.

https://www.reddit.com/r/singularity/comments/11iei34/buildi...

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#49

Post by jeremyjh »

kzrdude wrote: post #42
danbmil99 wrote: post #15

in the now infamous Lex interview, Sam Altman proposes a test for consciousness (he attributes it to Ilya Sutskever): Somehow, create an AI by training on everything we train on now, _except_ leave out any mention of consciousness, theory of mind, cognitive science etc (maybe impossible in practice but stay with me here). Then, when the model is mature (and it is not nerf'd to avoid certain subjects) you ask it somet…

How could we share any literature with this GPTx while also leaving out any traces of one of the things that really makes us human, consciousness? It seems like it would be present everywhere.

We could probably use another AI to screen all the literature before feeding it to the training model.

Re: AI vs. AGI vs. Consciousness vs. Super-Intelligence vs. Agency

#50

Post by [deleted] »

HervalFreire wrote: post #31
danbmil99 wrote: post #15

in the now infamous Lex interview, Sam Altman proposes a test for consciousness (he attributes it to Ilya Sutskever): Somehow, create an AI by training on everything we train on now, _except_ leave out any mention of consciousness, theory of mind, cognitive science etc (maybe impossible in practice but stay with me here). Then, when the model is mature (and it is not nerf'd to avoid certain subjects) you ask it somet…

That's an inaccurate test. You can't know if the answer was real or stochastic parroting. Any attempt at consciousness requires us to define the word. And the word itself may not even represent anything real. We have a feeling for it but those feelings could be illusions and the concept itself is loaded. For example Love is actually a loaded concept. It's chemically induced but a lot of people attribute it to somethi…

[deleted]
Post reply on HN