Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Pause Giant AI Experiments: An Open Letter

futureoflife.org

Post reply on HN
Print view View original

191–200 of 1001 posts

Re: Pause Giant AI Experiments: An Open Letter

#191

Post by brucethemoose2 »

larve wrote: post #109
brucethemoose2 wrote: post #5

"Please stop training these AI" is almost comical, even if they are right and the signers are significant. It would be far more effective to lobby for legislation on, say, liability related to the use of AI, data privacy (especially when it comes to training datasets), psycological manipulation, actual AGI research bounds and so on. They are just burning donator money with messages like that, and the research is not…

The message is "pause training for a few months so we can figure out how to approach liability, safety and regulation". You are fighting a strawman.

Fair, thats really what I meant to type, but its still an impractical demand. Most entities pursuing this aren't going to stop training because some high profile people asked them nicely.

Re: Pause Giant AI Experiments: An Open Letter

#192

Post by ChatGTP »

knrdev wrote: post #172
fwlr wrote: post #104

Some of those signatories are indeed interesting. Elon Musk, Steve Wozniak. Some big companies are there: the CEOs/co-founders of Skype, Pinterest, Ripple. Some AI companies are there too. CEOs/founders/head researchers from Stability, DeepMind, Metaculus. Some Microsoft employees, but no big repsentatives. Academic AI research is there, including Stuart Russell, John Hopfield and Max Tegmark. Some major names from t…

> Wonder what sparked this. Being left behind. Losers want to catch up.

Why would Steve Wozniack be worried about catching up?

The guy is a retired billionaire ?

Re: Pause Giant AI Experiments: An Open Letter

#194

Post by winternett »

juancn wrote: post #156

Stopping now would be extremely dangerous and borderline stupid. If you stop now, you're just left behind, because there's no way everyone will stop. At this point the only logical course of action in an adversarial situation is to double down and keep researching, otherwise some other country or culture with different (and possibly worse) values ends up dominating the technology and you're left behind in the dust. T…

They need to stop testing in PROD, and they also need to prove that Ai can function without an Internet connection and without any human intervention at all... Ai should not be deployed deeply until it works more flawlessly, but the same people who hyped and foisted Crypto onto everything and everyone (Including vital world banking infrastructure) are at the wheel on Ai marketing now, and that's not good at all.

Those things, as well as vital testing as a gate for deployment, aren't being upheld, and that's exactly what makes promises grandiosely destructive and keeps outcomes harmfully and wildly unpredictable.

I think in months to come we'll find out that many of the great new Ai products launched will prove themselves to simply be inauthentic-ly scripted fraud-based solutions backed by hidden human intervention because of this environment of unchecked expansion and eager over-deployment.

Re: Pause Giant AI Experiments: An Open Letter

#195

Post by MacsHeadroom »

archon1410 wrote: post #112

Some "alignment folks" have suggested the government try to start treating GPUs like Uranium or nuclear reactors to stop anyone from developing AIs. Not sure if that's implementable though—cuttig edge GPUs are all manufactured in China. I doubt they'll be able to coordinate with the CCP on this issue. Do GPUs use those fancy chips that only made in Taiwan using equipment only a single Dutch company makes? It might be…

>Do GPUs use those fancy chips that only made in Taiwan using equipment only a single Dutch company makes?

Yes, but it's a German company (Zeiss Optical).

>Yes, yes, yes, and yes.

Agree.

Re: Pause Giant AI Experiments: An Open Letter

#197

Post by MacsHeadroom »

kelseyfrog wrote: post #106
riku_iki wrote: post #9

Earlier quoted context omitted.

They have 900 signatures already..

I signed it as Jeff Bezos and Mark Zuckerberg paired with strategic portfolio moves.

You didn't, or if you did they were filtered due to being unverified. Public names near the top are real verified signatures. This is Max Tegmark's website and is reputable.

Re: Pause Giant AI Experiments: An Open Letter

#198

Post by reasonableklout »

brucethemoose2 wrote: post #191
larve wrote: post #109

Earlier quoted context omitted.

The message is "pause training for a few months so we can figure out how to approach liability, safety and regulation". You are fighting a strawman.

Fair, thats really what I meant to type, but its still an impractical demand. Most entities pursuing this aren't going to stop training because some high profile people asked them nicely.

I don't see petitions like this as demands, but as coordination mechanisms. If there are only a few industry actors with the resources to train gigantic AI models and they each want to stop but won't because they don't know if their competitors will, it's good for them all to have 1 place to say "I want to stop". Alternatively, if there are tons of industry actors racing and the only way to stop or slow down training is via governmental action - and the government won't act because they don't know how it will affect the industry - it's good to be able to point to "that one petition with 1000 highly influential signatories from the industry asking for regulation and explaining its effects".

Re: Pause Giant AI Experiments: An Open Letter

#199

Post by MacsHeadroom »

brucethemoose2 wrote: post #62
contravariant wrote: post #35

Earlier quoted context omitted.

Is anyone even trying to develop an AGI by the way? I mean a language model is neat, may even pick up some emergent features, but in the end it has no real identity. It's basically a memoryless computer doing improv where it tries to pick continue a conversation someone else had.

Maybe not a "real" AGI, but a system that could adequately impersonate an AGI with improv and self training seems quite practical in the near future. https://en.m.wikipedia.org/wiki/Philosophical_zombie

Humans are my favorite kind of philosophical zombie. Not a single one has ever given a sound argument that they are anything else.

Re: Pause Giant AI Experiments: An Open Letter

#200

Post by reasonableklout »

knrdev wrote: post #172
fwlr wrote: post #104

Some of those signatories are indeed interesting. Elon Musk, Steve Wozniak. Some big companies are there: the CEOs/co-founders of Skype, Pinterest, Ripple. Some AI companies are there too. CEOs/founders/head researchers from Stability, DeepMind, Metaculus. Some Microsoft employees, but no big repsentatives. Academic AI research is there, including Stuart Russell, John Hopfield and Max Tegmark. Some major names from t…

> Wonder what sparked this. Being left behind. Losers want to catch up.

You think Yoshua Bengio, Turing laureate for deep learning and one of the masterminds behind the last decade of AI advancement, is a "loser who wants to catch up"?
Post reply on HN