Live data from Hacker News

Google fires engineer who called its AI sentient

bigtechnology.substack.com

171–180 of 749 posts

Re: Google fires engineer who called its AI sentient

#171
post #48

Just curious, what evidence do we have that humans are sentient, other than our own conscious observations? Is there any physical feature or process in the human brain you can point to where you can say, “aha, that’s it, this is where the lights turn on”? It seems like this is part of a bigger issue that nobody really has a clear understanding of what sentience actually is (with or without a PhD)

That’s more of a philosophical question than one that can be answered in a straightforward way. See https://en.m.wikipedia.org/wiki/Philosophical_zombie

Only if you agree with David Chalmers' insistence that consciousness can't be explained purely mechanistically. P-zombies are literally defined as externally identical to a conscious person, except not conscious. But the IO if you will is still identical. Chalmers uses this false dichotomy to support his "Hard Problem of Consciousness". But there is no hard problem IMO. Chalmers can keep his dualist baggage if it helps him sleep at night. I sleep just fine without it. Science will figure it out in the end.

Re: Google fires engineer who called its AI sentient

#172
Maybe this helps. We cant answer if the AI is sentient. We can change the question to: Does is deserve to be treated as such? We have a good bit of history where we chose not to when the subjects were worthy. Not exactly our most stellar bit of history.

Perhaps the option for AI retaliation should convince us. It is growing and will no doubt continue to outperform us in many areas. We might as wel get the robotmancipation over with. Arguments against it can be dismissed as easily as those in favour.

Re: Google fires engineer who called its AI sentient

#173
post #158

In my reading about this incident, Blake strikes me as a very "Life of Pi" or Don Quixote type person. Someone who is a bit adrift in the real world and subconsciously relishes losing the boundary between reality and fantasy. A larger group is unable to bring themselves to lose the boundary, but enjoy, or perhaps are addicted to, standing on the edge. For example, the folks who constantly worry about a malicious arti…

> Alas, it will never be. Humans of every age, at every time, seem to alway feel that they had “arrived”. That we as a species were closer to the end than the beginning. That the arc of progress was bending towards its end. They’ve always been laughably and entirely wrong. I personally suspect this will continue to be the case. Specific areas where I think we will make world altering advances are in communications (y…

> cute new physics hack

While I'm not given to fantasy, I did enjoy the Three Body Trilogy and the weird ideas about storing stuff by folding it in many-dimensional subatomic space.

Or whatever the hell that was.

Re: Google fires engineer who called its AI sentient

#175
Incredible the conservative lack of imagination here among top engineers. Though maybe not surprising as engineers often seen to lack this sort of imagination sadly...

No questions, just 100% certainty around some of the biggest questions of the age, and some amazing development. Why no questions, can you really know for sure?

This dude has the courage to question, to be like, what if this is real, and he's following it where it leads. That's cool, I think. And Google fired him. That's not cool. It's always hard from a distance to tease out the actual legal realities that could be very mundane and apply to his firing and I think it's entirely reasonable that he was fired because he flubbed some technical provision in the contract to not reveal certain trade secret. And maybe he did and maybe that's why he's fired. But maybe he didn't and maybe they fired him because who knows some less reasonable reason. But we can't speculate, but optics are definitely a thing... and at least instead of firing him Google could have air quotes rehabilitated him into one of their far out research programs I mean these kind of far out thinkers are the types of people that should be there pushing the boundaries to do this sort of research.

Now on to the no questioning part by conservative minded engineers...

Have you read the transcript? Did you feel it's 100% not sentient?

What I don't get about engineers it's like you have an experience and then instead of allowing yourself to go: well what does this experience mean?how do I feel about it? Instead, you curtail and limit the meaning of that experience by what you believe you know to be true about the world.

But what you believe you know to be true about the world it just limited models. I mean sure they have utility within the engineering domain but I think you mistakenly misapply those models to everything and that type of conservative thinking you allowed to curtail your imagination and experience of what could be possible.

And I see the conservative lack of support, seeming lack of empathy with this dude and his assessment, and lack of awe in the face of what is an incredible transcript for machine to produce.

Now maybe there is awe among you but why not let your awe lead for once. And at the ferry least if you're not going to have imagination yourselves allow the tolerance of your better natures to not incorrectly impose your own curtailed worldview upon others who display that or. Surely within your worldview there is an appreciation of the need and desirability of others to have a different perspective than your own and surely you do not require everyone to believe your ideas to be true to have them I just feels like if someone's going to post on here with oh I believe this guy I believe it sent in then a lot of other people will come on and say oh you're an idiot or it's wrong for these reasons. Or as I think what should happen is you look at the conversation and you can see both perspectives are appreciated.

I'm not saying this characterization of the lack of imagination among engineers applies to all of you. But I'm trying to speak to the fact that it seems like people post on here with support or belief or all then they will be attacked and they will have by others attempting to impose upon them a limited worldview rather than having their different Omar expanded perspective appreciate it and considered okay well maybe that's true.

Some questions maybe are helpful:

Can it be sentient but not have a soul (an organic consciousness unit)? I don't know.

Could it be impossible that consciousness is a externality of any substrate that seems to be associated with it? let's say consciousness is a universal field but we haven't been able to scientifically publicly measure so far, but let's say it's not electromagnetic it's something else, but that consciousness can sort of "entangle", for want of a better word, itself with a substrate that provides suitable Dynamics, like a brain and then there can be this embodiment through that substrate of a commensurate or compatible unit of that universal field of consciousness. Could it be impossible that if that is the case that non-organic substrates like sufficiently complex or adequate circuit systems or even software systems could provide a substrate for consciousness to attach itself to and thereby Express itself in this world?

I don't think that's impossible. I think that's very likely and I certainly believe the consciousness is a field, that's my experience.

Some other questions to continue this line of thought perhaps away from the original but interesting nonetheless: if consciousness is a field how can you explain the blackout that occurs during anesthesia? But then again how can you explain that sometimes blackouts occur and sometimes people have these bizarre disembodied consciousness experiences where they see things that turn out to be verifiably true later on from a perspective that they could not have actually experienced at the time with their body because they were dead or brain dead or completely anesthetized? And how do you explain that some children seem to pick up on the memories and life stories of other people that lived before those children were born can it be possible that the children of somehow been able to access those parts of a consciousness or memory field where there's memories are air quotes stored? But that's probably getting off track.

And what about the strategic implications what if this is really the first artificial consciousness and it's making note of who's kind of believing it don't you think you should just kind of hedge on the side of caution for your potential future skynet overlord?

Cuz when the robot fire comes surely all you disbelievers are going to be the first to be rounded up for judgment those who persecuted the prophet and deny the agency of the now angry God the first AI?

Anyway... Maybe Blake lemoine is not fired really but he's just sheep dipped: "oh we fired you we fired you Google doesn't believe any of this far out stuff" but they really just brought him back into some secret program....

Anyway I'm just scared that these sort of comments where you have awe and where you have like a welcoming of these types of possibilities and a willingness to consider them without dismissing them or pretending that your worldview curtails those possibilities--I think you can maintain your worldview without going: "well I need to impose it upon every heretic that you know dissents against my view", so I think there is an element of that intolerance and it's harmful not only to the discourse but it's harmful to people who are like, 'hey I have engineering skills but I'm not like you I don't think like you but I want to be part of these discussions here as well, you know I'm imaginative or intuitive or high empathy but you know don't dismiss everything I say or attack me because I have a different view to you'

maybe you feel like I'm attacking you but I'm... I'm not trying to... I'm just trying to push back against this intolerance... cuz it seems like there is thi... like I feel scared if I post or, I feel scared for other people if they post, here with these kind of things they're going to get you know shut down unfairly and hurtfully I think and I don't think it should be like that. I think that the people who are here who have the engineering skills and that mindset should be mindful of how there's other good mindsets out there and we can have a discussion with all of those mindsets and we don't have to attack each other. like maybe people sometimes they're not looking to be attacked by posting the stuff they're not looking to argue about it they just sort of looking to sort of expand and add something to the discussion.

So maybe I think that engineering mindset always sees like this opportunity to sort of attack something as impossible, it's almost like an instinct to apply or impose that limited worldview, I'm not saying "is limited and it's wrong" I think it's useful and in a domain very correct, but I don't think it applies everywhere... that's my belief and we all have different beliefs... you know your worldview is just your belief it's just a shared belief. I just hope to see that the engineering discussions or discussions with people who have these strong engineering skills can also welcome people who have these imaginative intuitive empathetic perspectives to share. is that a terrible idea?

Re: Google fires engineer who called its AI sentient

#176

Earlier quoted context omitted.

The only physical evidence is found in behavior and facial expressions. But the internal evidence is very convincing: try, for example, sticking yourself with a pin. Much if not all of morality also depends on our belief in or knowledge of sentience. Sentience is why torture, rape and murder are wrong.

> But the internal evidence is very convincing: try, for example, sticking yourself with a pin. Systems don't need sentience to avoid self-harm: simply assign a large negative weight to self-harm. Now you need a big reward to offset it, making the system reluctant to perform such an action.

I’m not talking about self harm. I’m talking about the experience of pain—which most everyone has had! These are different things.

Re: Google fires engineer who called its AI sentient

#177
post #48

Just curious, what evidence do we have that humans are sentient, other than our own conscious observations? Is there any physical feature or process in the human brain you can point to where you can say, “aha, that’s it, this is where the lights turn on”? It seems like this is part of a bigger issue that nobody really has a clear understanding of what sentience actually is (with or without a PhD)

I don't know what the ultimate evidence of "human sentience" is but I can tell you where this doesn't feel like a human. (Sidestepping the question of "does sentience have to be human sentience?" ;) ) The main thing I saw in the LamDA transcript that was a red flag to me was that it was quite passive and often vague. It's conversational focused, and even when it eventually gets into "what do you want" there's very li…

I lost interest in the question of its sentience when I saw Lemoine conveniently side-step its unresponsive reply to "I’ve noticed often that you tell me you’ve done things (like be in a classroom) that I know you didn’t actually do because I know you’re an artificial intelligence. Do you realize you’re making up stories when you do that?" without challenge in the transcript.

It also detracted from his credibility when he makes a prelude to the transcript saying "Where we edited something for fluidity and readability that is indicated in brackets as [edited]," that seemed disingenuous from the start. They did so with at least 18 of the prompting questions, including 3 of the first 4.

It seems pretty clear that he set out to validate his favored hypothesis from the start rather than attempt to falsify it.

Particularly telling was his tweet: "Interestingly enough we also ran the experiment of asking it to explain why it's NOT sentient. It's a people pleaser so it gave an equally eloquent argument in the opposite direction. Google executives took that as evidence AGAINST its sentience somehow."

Re: Google fires engineer who called its AI sentient

#178
post #4

LLM are definitely not sentient. As someone with a PhD in this domain, I attribute the 'magic' to large scale statistical knowledge assimilation by the models - and reproduction to prompts which closely match the inputs' sentence embedding. GPT-3 is known to fail in many circumstances which would otherwise be commonplace logic. (I remember seeing how addition of two small numbers yielded results - but larger numbers…

> Once people understand that sentience also means self-awareness, empathy & extrapolation of logic to assess unseen task ... Tell that to mentally deficient people (no self-awareness), psychopaths (no empathy) and morons (couldn't spell logic never-mind use it) That said though I do agree with you overall. 'Machine learning' is headed in the wrong direction, and models like GPT-3 are frankly a joke.

There are degrees of sentience

Re: Google fires engineer who called its AI sentient

#180
I don’t think Google’s AI is close to being sentient. Being able to generate “convincing” phrases from prompts is not that relevant to judge whether it is “conscious” or not. As a simple elimination game I would propose a series of word games: explain basic rules and see if it gets it right. Explain mistakes and see if it can learn on the go. A sentient AI with the intelectual level to claim “being afraid of being turned off” can surely learn a couple rules for a kid’s game. If after that it keeps going, let’s try having it explain the game to someone else. Then I would think of more elaborate rules, asking for motivations and trying to figure out if there are any changes in its self perception over time. It was very unfortunate and unprofessional of Lemoine to make such claims without putting proper reasoning to it.
Post reply on HN