Live data from Hacker News

Statement on AI Risk

safe.ai

161–170 of 964 posts

Re: Statement on AI Risk

#161

Pathetic attempt at regulatory capture. Let’s all be smart enough to not fall for this crap, eh?

That might be why Sam Altman signed it but why do you think that all the academics did so as well. Do you think he just bribed them all or something?

I think academics are much, much more naive than we like to think. The same trick that pharma played on doctors is being played here.

Just because you can do fancy math doesn't mean you understand how to play the game.

Re: Statement on AI Risk

#163

Pathetic attempt at regulatory capture. Let’s all be smart enough to not fall for this crap, eh?

That might be why Sam Altman signed it but why do you think that all the academics did so as well. Do you think he just bribed them all or something?

Decades of research in every field being sponsored by corporations haven't made academics' interests clear for you yet?

Re: Statement on AI Risk

#164

Pathetic attempt at regulatory capture. Let’s all be smart enough to not fall for this crap, eh?

That might be why Sam Altman signed it but why do you think that all the academics did so as well. Do you think he just bribed them all or something?

There will always be enough academics to sign anything even marginally notorious.

Re: Statement on AI Risk

#165
post #159

Earlier quoted context omitted.

I am saying there is no distinction. If AI is a risk to humanity, then the internet in general must be as well.

So if there is no distinction, by your own words, can you take yourself seriously or not? That is, by your own words, both AI and the Internet either pose a risk or they both do not; 'there is no distinction.'

I do not think the internet, or AI in its current form, is a existential risk to humanity, no.

Re: Statement on AI Risk

#166

I signed the letter. At some point, humans are going to be outcompeted by AI at basically every important job. At that point, how are we going to maintain political power in the long run? Humanity is going to be like an out-of-touch old person on the internet - we'll either have to delegate everything important (which is risky), or eventually get scammed or extorted out of all our resources and influence.

I don't understand all the downvotes although how do you see ML assistant profs being outcompeted by AI? You probably have unique feel to students, a non replicable approach to study and explain concepts. How can an AI compete with you?

Re: Statement on AI Risk

#168
Lots here commenting about how this is just an attempt to build a moat through regulatory capture. I think this is true, but it can simultaneously be true that AI poses the grave danger to human society being warned about. I think it would be helpful if many of those mentioned in the article warning against the dangers of AI were a bit more specific on substantive ways that danger may manifest. Many read these warnings and envision Skynet and terminator killbots, but I think the danger is far more mundane, and involved a hyper-acceleration of things we already see today: a decay in the ability to differentiate between real and fabricated information, the obsoletion of large swathes of the workforce with no plans or systems in place to help people retrain or integrate into the economy, at a scale never before seen, the continued bifurcation of the financial haves and have-nots in society, the rampant consumption and commodification of individuals data and privacy invasion, AI tools enabling increased non-militaristic geopolitical antagonism between nations in the form of propaganda and cyberattacks on non-military targets, increased fraud and cybercrime, and so on.

Basically none of these are new, and none will directly be the “extinction” of the human race, but AI very plausibly could intensify them to a scale and pace that human society cannot handle, and their knock on effects lead to what amounts to a car-crash in slow motion.

It is almost certainly the case that Altman and the like are simultaneously entrenching themselves as the only ones who get to play ball, but that doesn’t mean the threats do not exist. And while I’m sure many on HackerNews tend to be more of the libertarian, move fast and break things mindset, I personally would prefer if society would move to a more proactive, fire-prevention method of operation over the current reactive, fire extinguishing one, at least where this is concerned.

Re: Statement on AI Risk

#169

Earlier quoted context omitted.

This doesn’t work either. The consequence of extinction is infinity (to humans). Likelihood * infinity = infinity. So by hand-waving at a catastrophic sci-fi scenario they can demand we heed their demands, whatever that is.

At the extremes you get into the territory of Pascal's Mugging [1]. Which is a delightfully simple example of how our simple methods of stating goals quickly goes wrong 1: https://en.wikipedia.org/wiki/Pascal%27s_mugging

Is AI Safety a Pascal's Mugging?

[Robert Miles AI Safety]

https://www.youtube.com/watch?v=JRuNA2eK7w0

Re: Statement on AI Risk

#170

LLMs are just text prediction. I don't see the linear path from LLM to AGI. Was there similar hysteria when the calculator or PC first came out?

I know there were similar hysterias when automated weaving looms and other extreme labor saving machines came out. These machines did actually put a lot of people out of work, but they grew the economy so much that the net number of jobs increased.

In a way it's actually a bit dystopian that the "everyone will be put out of work" predictions never come true, because it means we never get that promised age of leisure. Here we are with something like a hundred thousand times the productivity of a medieval peasant working as much or more than a medieval peasant. The hedonic treadmill and the bullshit job creating effects of commerce and bureaucracy eat all our productivity gains.

The economy is actually a red queen's race:

https://en.wikipedia.org/wiki/Red_Queen%27s_race

Post reply on HN