Live data from Hacker News

What is it like to be an AGI?

korymathewson.com

11–20 of 21 posts

Re: What is it like to be an AGI?

#11

Ask any early 80s Sierra adventure game protagonist?

Those early Sierra games, the ones that used typed text to interact with the environment, were really inspirational. I was very disappointed when they replaced that CLI-like interface with mouse-driven icons. No doubt the icons were more user friendly and had none of the flaws of trying to enter the right text, but it still felt like something was lost.

Relatedly, I'm working on natural language understanding, which I believe is key to AGI. https://lxagi.com

Re: What is it like to be an AGI?

#12
It's not 'like' anything, computer programs don't have true feelings, though they can certainly be programmed to act as if they do. It can be programmed to say 'hey, life is great' but it means nothing. They have no soul, no spark from the divine.

Re: What is it like to be an AGI?

#13

It's not 'like' anything, computer programs don't have true feelings, though they can certainly be programmed to act as if they do. It can be programmed to say 'hey, life is great' but it means nothing. They have no soul, no spark from the divine.

And how do you prove that you have such a spark?

Re: What is it like to be an AGI?

#14
post #13

It's not 'like' anything, computer programs don't have true feelings, though they can certainly be programmed to act as if they do. It can be programmed to say 'hey, life is great' but it means nothing. They have no soul, no spark from the divine.

And how do you prove that you have such a spark?

Perhaps I don't have that spark, but deep within and after much thought and contemplation, I believe I have. I am very sure, regardless, that computer programs do not have it.

Re: What is it like to be an AGI?

#15
post #10

Earlier quoted context omitted.

Everything that computes is probably "just computer processing". I wouldn't be shocked if enough translates that it's not totally useless

Humans have consciousness, which seems like something else related to the physics of our universe. The article hints at AGI having consciousness, but I can't see how that kind of argument can be made.

Ok, assuming consciousness is both reliant on physics we don't understand, and that physics selectively avoids so blessing any machine, you're correct. Is there evidence to support either of those things? Absolutely not.

Re: What is it like to be an AGI?

#16
post #10

Earlier quoted context omitted.

Humans have consciousness, which seems like something else related to the physics of our universe. The article hints at AGI having consciousness, but I can't see how that kind of argument can be made.

Ok, assuming consciousness is both reliant on physics we don't understand, and that physics selectively avoids so blessing any machine, you're correct. Is there evidence to support either of those things? Absolutely not.

Why is consciousness in humans limited to our brains? We've never seen non-living material exhibit the characteristics of life in nature.

The computers and robots we build are carrying out instructions in a very mechanical way, however impressive they are.

Re: What is it like to be an AGI?

#17
post #13

Earlier quoted context omitted.

And how do you prove that you have such a spark?

Perhaps I don't have that spark, but deep within and after much thought and contemplation, I believe I have. I am very sure, regardless, that computer programs do not have it.

We also don’t have AGI yet either… who’s to say that consciousness doesn’t come along for the ride once you reach that level?

We don’t even know why we have consciousness.

Re: What is it like to be an AGI?

#18
post #16

Earlier quoted context omitted.

Ok, assuming consciousness is both reliant on physics we don't understand, and that physics selectively avoids so blessing any machine, you're correct. Is there evidence to support either of those things? Absolutely not.

Why is consciousness in humans limited to our brains? We've never seen non-living material exhibit the characteristics of life in nature. The computers and robots we build are carrying out instructions in a very mechanical way, however impressive they are.

Aren’t our brains just carrying out instructions in a very impressive way?

I think the jury is still out on whether or not we actually have any control over our thoughts.

Re: What is it like to be an AGI?

#19
The Bobiverse books by Dennis E. Taylor touch upon this, as Bob is a human that becomes the AI in a replicant that is the intelligence behind a von Neumann probe sent out from earth. One of the ways that he maintains his sanity is to build a simulated VR environment to help maintain his sanity.

I personally think that the really hard part in creating an AGI is going to be training. As an adult human, one can look at an object and instantly know what its texture is going to feel like on one's fingers or even lips, how it will bounce and if it will shatter. How did we gain that knowledge? As babies we put absolutely everything we saw into our mouths and sucked or chewed on it. As kids we played for hours on end with all kinds of toys and household objects. Coming up with a way of training an AGI to be human level will be hard, as there is such a vast scope of knowledge in "common sense" that will be exceedingly difficult to implant into an AGI without the AGI having an ability to interact with the real world.

On the other hand, once that body of knowledge becomes an available training data set, evolution can take off at speeds otherwise impossible in the real world.

Re: What is it like to be an AGI?

#20
post #18
post #16

Earlier quoted context omitted.

Why is consciousness in humans limited to our brains? We've never seen non-living material exhibit the characteristics of life in nature. The computers and robots we build are carrying out instructions in a very mechanical way, however impressive they are.

Aren’t our brains just carrying out instructions in a very impressive way? I think the jury is still out on whether or not we actually have any control over our thoughts.

I was referring to the consciousness. What it means to experience reality with awareness.
Post reply on HN