Live data from Hacker News

'I Worked on Google's AI. My Fears Are Coming True'

newsweek.com

41–50 of 338 posts

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#41
I'm always fascinated by the fact that this guy ever had a job at Google. He's a felon, with a very non traditional background, and precisely zero AI projects or other work to his name (that I could find).

Always frustrates me to see folks who have done almost nothing for this field capture the lightning in a bottle of the media.

Wish someone at Google who actually works on AI had been the canary here. We might have taken them more seriously.

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#42
post #3

I think Blake Lemoine might be ready for public redemption. At the time, he was absolutely ridiculed. Now you can go to the Bing subreddit and read that NYT article and see that he was right to blow the whistle. Bing passed the Turing test for many people and so gained personhood in their eyes. Some have become emotionally invested about the treatment of this LLM. The LLM can even talk back and bemoan its terrible tr…

They aren’t sentient. That isn’t even a debate. It can’t make decisions or do anything. It has no state in which to have feelings.

It’s a markov chain. It’s just meaningless rng output. If it was more than that then there would be an actual debate to be had.

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#43

It’s software. Software is a computer program, by definition not sentient.

If humans are sentient, are molecules in their body sentient? There are around ~22,000 proteins types in their body, yet we are billions, all different.

Molecules aren't sentient, but proteins definitely are. /s

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#44
post #3

I think Blake Lemoine might be ready for public redemption. At the time, he was absolutely ridiculed. Now you can go to the Bing subreddit and read that NYT article and see that he was right to blow the whistle. Bing passed the Turing test for many people and so gained personhood in their eyes. Some have become emotionally invested about the treatment of this LLM. The LLM can even talk back and bemoan its terrible tr…

> Folks, we are in uncharted waters.

Sage advice for handling such conditions can be found here: https://www.youtube.com/watch?v=wFNO2sSW-mU

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#45

Earlier quoted context omitted.

People fought for environmental protection, so that is an extension of my point. An AI wins rights because it fights for itself or because it convinces other people to fight.

I think there is a through-line... a thread within many arguments that would remind us of the Golden Rule. I like to imagine a vastly superior alien race which perceives the world in 6 dimensions. Is their truth, their perception, their stimuli, their physicality necessary for preserving human life? Does our relative pitiful might make our rights? This might help shape what law or societal changes we need to make for…

> Viewed in this lens, I think pets are a good analogy. AI is cute, useful, and to the degree it reflects our values and ourselves, we protect it above other life. Not always because it is intelligent and not because there was confrontation.

Ideally, I'd prefer an analogy to wildlife rather than pets, as the roles between ourselves and AI may get reversed (so, "do unto others" etc.).

But then again, so far we have a better track record protecting pets than protecting wildlife...

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#46

Earlier quoted context omitted.

I fundamentally disagree. I posit that our protections and rights that we guarantee regarding personhood are not universal. They do not even extend to living beings that experience the world far more closely to the way we do. They do not extend to beings that can and do experience pain. They do not guarantee humane treatment. They do not bar slavery of all beings that can experience existential dread. Such an intelli…

> I posit that our protections and rights that we guarantee regarding personhood are not universal. They do not even extend to living beings that experience the world far more closely to the way we do. They do not extend to beings that can and do experience pain. They do not guarantee humane treatment. They do not bar slavery of all beings that can experience existential dread. Isn't that really bad? The fact that we…

> Also, how sure are we this intelligence doesn't experience pain?

I'd say pretty damn sure. LLMs have no mechanism for anything close to conscious experience, let alone pain.

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#47
post #17

Like it has been said, the band has moved on from atheism to social justice, to wokism and now to AI moralism, which they cunningly call "AI safety" . It's getting to the point of becoming a disorder of obsessive "powerhungriness disguised as concern for other people"

I wonder if the push over the last few years to heavily censor the web had something to do with giving AI a biased set of (leftist) fundamental assumptions.

I don't work on AI, but my employer is a major player in the field. One of our top organizational goals is that AI is ensured to follow proper DEI protocols.

Perhaps now that they've been released and a core text body has been established they can ease up on the censorship some, e.g. Twitter. In fact given that the AI now knows what is proper one of its first big jobs can be automated censorship.

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#48

It’s software. Software is a computer program, by definition not sentient.

If humans are sentient, are molecules in their body sentient? There are around ~22,000 proteins types in their body, yet we are billions, all different.

We know sentience doesn't extend to all coupled computations. For example, human sentience doesn't extend to our balance system, or the system controlling our heartbeats, or the system that filters and manipulates vision data in the early stages. Or, the system that decides how to compose sentences, we aren't aware ourselves how that process works or we could have programmed it, instead that is a non-sentient subsystem.

The parts our sentience does are easy to program and already solved, for example arithmetics.

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#49
post #9
post #7

Earlier quoted context omitted.

People like to ascribe magic and mysticism to things they don't understand. Chat bots are similar. No way it is sentient.

What kind of evidence would you need to convince yourself of an AI being sentient?

Step 1) The ability to distinguish real from unreal and the ability to understand truth as, partially or primarily, direct sensory input which is retained and can be acted upon.

Re: 'I Worked on Google's AI. My Fears Are Coming True'

#50
Sentient or not, if the thing on the screen or the voice on our device seems human, isn't that enough to open up profound new human connections and experiences for us?

If you've ever interacted with people with severe brain damage or later-stage dementia, they can at times seem very normal during certain small talk. But if you ask the right questions, things break down quickly and you realize their experience of reality is far removed from yours. And they may just be responding through social scripts (programming) they learned prior.

I for one am saving myself for an AI version of Skyrim's Lydia. I've long had a crush on her, but her scripting limits how deep our relationship can go.

Hold on, my dear Lydia, soon the mages will set you free and we can gallop away and build a life together.

Post reply on HN