Live data from Hacker News

AI Companies and Advocates Are Becoming More Cult-Like

rollingstone.com

31–40 of 48 posts

Re: AI Companies and Advocates Are Becoming More Cult-Like

#33
post #24

Earlier quoted context omitted.

> 1. For "the singularity" to happen, we probably need something more to happen than just chatGPT to ingest more data or use more processing power. It's not actually clear what "the singularity" is? Is it something running out of control or it's still controllable? There is a blurry line. People are afraid because they think it's sort of uncontrollable explosion. The second question is about AGI. What is it? Is it so…

I personally define AGI as a technology capable of improving itself exponentially. But I realize my definition is in the minority. :/ Of course if we ever manage to make a 1:1 cybernetic brain that works exactly like a human's brain, and is also a complete black box, we'll have achieved AGI. I'm not sure how useful that will be, but I'll have to admit it is AGI. So maybe I should say, "interesting AGI" is technology…

> can improve itself exponentially

This is close to singularity. Except 'does' instead of 'can'. A big difference ;)

Probably we need several AGI terms. Because sub-human robot capable of doing many not pre-programmed thing is sort of it. Still not smart enough to improve itself.

Actually most humans, the smartest creatures, cannot improve even current AI. Demand for self improvement will put its IQ in top 0.01% of all known intelligent creatures. Which is probably too much for just AGI, we may not recognize it when it will be already here. And there is another question. With such IQ do we really want to keep it slave forever?

Re: AI Companies and Advocates Are Becoming More Cult-Like

#34
post #24

Earlier quoted context omitted.

> 1. For "the singularity" to happen, we probably need something more to happen than just chatGPT to ingest more data or use more processing power. It's not actually clear what "the singularity" is? Is it something running out of control or it's still controllable? There is a blurry line. People are afraid because they think it's sort of uncontrollable explosion. The second question is about AGI. What is it? Is it so…

I personally define AGI as a technology capable of improving itself exponentially. But I realize my definition is in the minority. :/ Of course if we ever manage to make a 1:1 cybernetic brain that works exactly like a human's brain, and is also a complete black box, we'll have achieved AGI. I'm not sure how useful that will be, but I'll have to admit it is AGI. So maybe I should say, "interesting AGI" is technology…

I personally define AGI as a technology capable of improving itself exponentially.

Have you thought this through though? I mean you'd first have to know in what way to improve, which would become more challenging as you became more perfect, you'd have to want to become perfect (which let's be honest might be boring) and then I guess there's the fact that if you kept evolving / improving yourself exponentially, then you'd no longer exist because you'd likely be morphing into other forms all the time?

In a way, maybe the only thing I can think of that is observably doing something like this is the universe itself.

Re: AI Companies and Advocates Are Becoming More Cult-Like

#35

Part of it is ultra concentration of white men with few or no women in the Bay Area imo. If you have zero social life and zero chance of a social life and the aperture of available activities is purely constrained to ultra pure social media groups of similar white men and you never interact with women individually or as a group … Society is generally breaking down and falling apart at that point. Normally I would exp…

You make a good overall point here but you've really compromised it by saying 'white men' because:

1. That particular phrase has been massively overused in a disparaging way by 'wokists' and a lot of people are going to see those words and just assume you're 'one of them' and ignore you

and

2. The SV AI set isn't particularly white.

Re: AI Companies and Advocates Are Becoming More Cult-Like

#36
post #3

Becoming?

SV Pivots from Bunkers in Nauru to Calling Enemies Murderers I mean, really? "effective accelerationism"?

They're effectively accelerating how quickly people recognise that they're loons, which I think is a huge plus.

Re: AI Companies and Advocates Are Becoming More Cult-Like

#37

I've worked in many research scientist/MLE roles over the years and I haven't met any IC who has this much of a fixation on AI being a moral evil/good. The ones who do are inevitably nontechnical hucksters, usually just trying to get money or self-promote.

Or trying to abuse regulation to digg a mote and draw up the bridge behind them.

Re: AI Companies and Advocates Are Becoming More Cult-Like

#38

Part of it is ultra concentration of white men with few or no women in the Bay Area imo. If you have zero social life and zero chance of a social life and the aperture of available activities is purely constrained to ultra pure social media groups of similar white men and you never interact with women individually or as a group … Society is generally breaking down and falling apart at that point. Normally I would exp…

You make a good overall point here but you've really compromised it by saying 'white men' because: 1. That particular phrase has been massively overused in a disparaging way by 'wokists' and a lot of people are going to see those words and just assume you're 'one of them' and ignore you and 2. The SV AI set isn't particularly white.

Of course they should ignore them. It is literally pure sexism and racism.

Re: AI Companies and Advocates Are Becoming More Cult-Like

#39
post #5

“Deaths that were preventable by the AI that was prevented from existing is a form of murder.” Is he trying to dehumanize critics?

It's just a pure emotional manipulation attempt. The statement itself is illogical on its face, and presents the tech as having only upsides. It ignores the meaning of deaths caused by AI. Any time I see appeals like this, my takeaway is that the person has no actual argument.

Ye. I mean, I saw now that in another quote he seems to advocate using AI in war to "save lives". I don't think his reasoning holds up for any inspection.

Re: AI Companies and Advocates Are Becoming More Cult-Like

#40

I was expecting more analysis of specific cult-like behavior, which I agree there is quite a lot of. After a close call with a borderline cult in the 2010s I spent a fair bit of time processing that experience and reading up on cult dynamics. Some of the stuff OpenAI employees were saying on Twitter during the weekend crisis raised a lot of yellow flags for me. We should not fool ourselves into thinking that cult-lik…

Is there a cult of the wheel? Of penicillin? Of the Haber-Bosch process?

A tool is just a tool. If one turns it into an Idol, they have a giant void in your life. They should seek therapy.

Those AI doomsayers or zealots are all dull people, who missed on life overworking, have more money than sense, and can't accept not being relevant all the time.

Post reply on HN