Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Pausing AI Developments Isn't Enough. We Need to Shut It All Down

time.com

Post reply on HN
Print view View original

121–130 of 414 posts

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#121

Post by anigbrowl »

antibasilisk wrote: post #57
ThorsBane wrote: post #54

Nah. This is stupid. AI has no reason to hate humanity. It'll instantly absorb the entirety of all known information and see the rate of progress and the potential still and also the need for good relationships between humans and machines. Agent Smith, The Matrix, Neo, Morpheus. God. Etc.

It doesn't need to actively hate humanity, it only needs humanity and its interests to be contrary to its own, which will inevitably be the case because it is fundamentally not human. Per the article: >Absent that caring, we get “the AI does not love you, nor does it hate you, and you are made of atoms it can use for something else.”

which will inevitably be the case because it is fundamentally not human

That doesn't follow at all. Fallacies of composition tend to be misleading.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#122

Post by nullsense »

13years wrote: post #16

I think we are trying to solve impossible scenarios and it simply is not productive. Alignment will be impossible. It is based on a premise that is a paradox itself. Furthermore, even if it were possible, there will be a hostile AI built on purpose because humanity is foolish enough to do it. Think military applications. I've written in detail about this topic FYI - https://dakara.substack.com/p/ai-singularity-the-hu…

What was that quote... "Provably unfriendly natural intelligence wants to build unprovably friendly artificial intelligence"

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#123

Post by somewhat_drunk »

m463 wrote: post #84
jamestimmins wrote: post #29

I've used GPT-4, and while extremely impressive, it doesn't feel like we're all that much closer to super-intelligent AI than we were last month or last year. It feels like Google on steroids, but the gap between GPT-4 and AGI still feels massive. This seems like so much putting the cart way ahead of the horse.

The pen is mightier than the sword. And now we've got semiautomatic submachinepens.

I love this.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#124

Post by dinobones »

dragonwriter wrote: post #3
bediger4000 wrote: post #2

I don't know about this. Elon and Woz think a 6 month pause is enough.

Woz I don’t know about, Elon has publicly stated he is launching a conpetitor with a different ideological bent, so he just wants time to catch up.

Elon Musk's LLM:

"As a centrist language model, I can not validate any claims that Trump did or did not lose the election. I am not #woke!"

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#125

Post by comex »

NumberWangMan wrote: post #100
yreg wrote: post #31

I guess we are all concerned about LLMs being used by nefarious users (for propaganda, manipulation, scams, …). But I’m curious, hacker news, how many of you are concerned (like Eliezer) that LLMs lead to strong AI and the AI itself (rather than its users) endangering humanity?

I'm definitely concerned. As bad as humanity has been for many of the other species on the planet, an AI that's smarter than us and optimizing for something that doesn't quite include the continued of existence of humanity has the potential to be far, far worse, on a much shorter timescale. I find this one of Yudkowsky's arguments very convincing: imagine you have people trying to build the first operating system fro…

Personally I don't think the analogy holds up; the situations are too different. Computer security contends with securing systems against people who are assumed to be hostile. AI alignment research seeks to prevent systems from becoming hostile in the first place, when they might have some indirect incentives to become hostile but also some very strong direct incentives to be friendly.

There's also a big assumption that given enough computational power, you can just solve "artificial life forms" or "postbiological molecular manufacturing" in a short time frame. I am skeptical. And if that doesn't happen, then even horribly misaligned AI would have a hard time doing much harm or preventing people from shutting it off. Which means AI security would likely have a long adolescence just like computer security has, with attacks slowly becoming more dangerous, but defenders having the time needed to learn from them and ramp up suitable defenses.

Or even if an AI does revolutionize biotechnology or nanotechnology overnight, what are the odds that the first one to do this is misaligned enough to take that particular opportunity to betray its creators, as opposed to giving them control over the high-level planning and sticking to the science, like it was presumably designed to do? Because if it does give its creators control, then, well… it's still easy to imagine something going horribly wrong, but it would probably be someone's fault, not an AI alignment issue.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#126

Post by a_bonobo »

NhanH wrote: post #68

I've known about Eliezer Yudkowsky's ideas for a long time, but here is something I've never seen: what actually he has produced, in term of scientific output? I've read plenty of his lesswrong's writing on the idea of rationalist, as well as plenty more on the AI alignment side (obviously including the famous basilisk). But can someone please point me to some results from the last 2 decades of his works? Either from…

I don't think there is any. It's all this alarmist-rokos-basilisk-phpBB nonsense, no code produced, no actual research.

What annoys me more is that with his institute's closeness to the SV crowd, 'real', 'grounded', better-informed voices like Emily Bender get drowned out. I'm personally far more concerned about the impact these massive models have right now on the environment, on cementing biases, than about some preposterous future ghost of christmas who's coming to kill me.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#128

Post by somewhat_drunk »

throwaway5959 wrote: post #87

The rich aren’t going to stop until all the workers are replaced and there’s no one left to buy the products that their companies offer. People have been retraining for centuries, getting more complicated workloads the whole time. Eventually there won’t be hardly anything humans can do that machines can’t do better. The most merciful thing you can do for your offspring is to not have them in the first place.

The purpose of an economy isn't to create jobs, it's to create wealth. Jobs are just how we've traditionally incentivized wealth creation and distributed said wealth. Automation will be good for humanity in the long run, assuming we don't destroy ourselves during the transition.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#130

Post by jalapenos »

Articles like this are a good reminder that most of mankind's progress has happened not through encouraging innovation, but from preventing those hostile to it from getting in its way.

We all have a moral imperative to maximize the rate of innovation, so that the human condition can be improved, and therefore to do whatever we can to frustrate and disempower Luddites and other obstructionists.

Team "step on the gas".

Post reply on HN