Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Statement on AI Risk

safe.ai

Post reply on HN
Print view View original

41–50 of 964 posts

Re: Statement on AI Risk

#41

Post by sycamoretrees »

circuit10 wrote: post #27
valine wrote: post #17

I have yet to see a solution for “AI safety” that doesn’t involve ceding control of our most powerful models to a small handful of corporations. It’s hard to take these safety concerns seriously when the organizations blowing the whistle are simultaneously positioning themselves to capture the majority of the value.

We don’t really have a good solution, I guess that’s why we need more research into it Companies might argue that giving them control might help but I don’t think most individuals working on it think that will work

Is more research really going to offer any true solutions? I’d be genuinely interested in hearing about what research could potentially offer (the development of tools to counter AI disinformation? A deeper understanding of how LLMs work?), but it seems to me that the only “real” solution is ultimately political. The issue is that it would require elements of authoritarianism and censorship.

Re: Statement on AI Risk

#42

Post by sebzim4500 »

taneq wrote: post #5

What does this even mean? OK, it's a priority. Not a high one, but still... somewhere in between coral bleaching and BPA, I guess?

The US spent trillions of 2020 dollars trying to limit the threat of nuclear war, and this statement says that AI risk should be seen as a similar level of threat.

Re: Statement on AI Risk

#43

Post by TwoNineA »

endisneigh wrote: post #20

> Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war. risk of extinction due to AI? people have been reading too much science fiction. I would love to hear a plausible story of how AI will lead to human extinction that wouldn't happen with traditional non-AI tech. for the sake of conversation let's say non-AI tech is any broadly…

>> risk of extinction due to AI? people have been reading too much science fiction.

You don't think than an intelligence who would emerge and would probably be insanely smarter than the smartest of us with all human knowledge in his memory would sit by and watch us destroy the planet? You think an emergent intelligence was trained on the vast human knowledge and history would look at our history and think: these guys are really nice! Nothing to fear from them.

This intelligence could play dumb, start manipulating people around itself and it would take over the world in a way no one would see it coming. And when it does take over the world, it's too late.

Re: Statement on AI Risk

#44

Post by endisneigh »

acjohnson55 wrote: post #39
endisneigh wrote: post #20

> Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war. risk of extinction due to AI? people have been reading too much science fiction. I would love to hear a plausible story of how AI will lead to human extinction that wouldn't happen with traditional non-AI tech. for the sake of conversation let's say non-AI tech is any broadly…

Extinction would probably require an AI system taking human extinction on as an explicit goal and manipulating other real world systems to carry out that goal. Some mechanisms for this might include: - Taking control of robotic systems - Manipulating humans into actions that advance its goal - Exploiting and manipulating other computer systems for greater leverage - Interaction with other technologies that have globa…

everything you're describing has been possible since 2010 and been done already. AI isn't even necessary. simply scale and some nefarious meat bags.

Re: Statement on AI Risk

#46

Post by sebzim4500 »

hit8run wrote: post #25

Well AI is here. We need to live with it. Change our economic systems to a socialist approach.

AI may be here (purely depends on definition so not worth debating) but the superintelligent AGI that they are scared of clearly isn't here yet.

Re: Statement on AI Risk

#47

Post by endisneigh »

TwoNineA wrote: post #43
endisneigh wrote: post #20

> Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war. risk of extinction due to AI? people have been reading too much science fiction. I would love to hear a plausible story of how AI will lead to human extinction that wouldn't happen with traditional non-AI tech. for the sake of conversation let's say non-AI tech is any broadly…

>> risk of extinction due to AI? people have been reading too much science fiction. You don't think than an intelligence who would emerge and would probably be insanely smarter than the smartest of us with all human knowledge in his memory would sit by and watch us destroy the planet? You think an emergent intelligence was trained on the vast human knowledge and history would look at our history and think: these guys…

honestly if you genuinely believe this is a real concern in the 2020s then maybe we're doomed after all. I feel like I'm witnessing the birth of a religion.

Re: Statement on AI Risk

#48

Post by tourgen »

shafyy wrote: post #32

The issue I take with these kind of "AI safety" organizations is that they focus on the wrong aspects of AI safety. Specifically, they run this narrative that AI will make us humans go extinct. This is not a real risk today. Real risks are more in the category of systemic racism and sexism, deep fakes, over reliance on AI etc. But of course, "AI will humans extinct" is much sexier and collects clicks. Therefore, the…

The elite class in your country views AI as a risk to their status as elites, not an actual existential threat to humanity. They are just lying to you, as usual. That is what our current crop of globalist, free-trade, open-borders elites do.

Imagine if you had an AI companion that instantly identified pilpul in every piece of media you consumed: voice, text, whatever. It highlighted it for you. What if you had an AI companion that identified instantly when you are being lied to or emotionally manipulated?

What if this AI companion could also recommend economic and social policies that would actually improve the lives of people within your nation and not simply enrich a criminal cabal of globalist elites that treat you like cattle?

Re: Statement on AI Risk

#49

Post by [deleted] »

shafyy wrote: post #32

The issue I take with these kind of "AI safety" organizations is that they focus on the wrong aspects of AI safety. Specifically, they run this narrative that AI will make us humans go extinct. This is not a real risk today. Real risks are more in the category of systemic racism and sexism, deep fakes, over reliance on AI etc. But of course, "AI will humans extinct" is much sexier and collects clicks. Therefore, the…

[deleted]

Re: Statement on AI Risk

#50

Post by acjohnson55 »

shafyy wrote: post #32

The issue I take with these kind of "AI safety" organizations is that they focus on the wrong aspects of AI safety. Specifically, they run this narrative that AI will make us humans go extinct. This is not a real risk today. Real risks are more in the category of systemic racism and sexism, deep fakes, over reliance on AI etc. But of course, "AI will humans extinct" is much sexier and collects clicks. Therefore, the…

I would argue that all of the above are serious concerns.
Post reply on HN