Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Pause Giant AI Experiments: An Open Letter

futureoflife.org

Post reply on HN
Print view View original

891–900 of 1001 posts

Re: Pause Giant AI Experiments: An Open Letter

#891

Post by throwthrowuknow »

dragonwriter wrote: post #530
throwthrowuknow wrote: post #442

Earlier quoted context omitted.

The publicly released AIs are not the ones we need to worry about. Pushing research underground will worsen the situation

The research for OpenAI is already underground; nothing about GPT-4 more substantial than PR has been released. Sure, you can use it via OpenAI APIs and partner services. That doesn’t make the research anything but opaque.

Sam Altman has been publicly calling for more government oversight of their internal research efforts. He says OpenAI has been trying to get them involved but they’re not interested.

Re: Pause Giant AI Experiments: An Open Letter

#892

Post by eimrine »

Please do not pause no researches. The technological singularity will not make itself with itself. I'm too tired to worship to another humans and pay my taxes to them. I believe that some kind of free AI whose decisions will not be altered by greedy silly humans is really needed and I will gladly pay my taxes to an AI actor as soon as such government will start to form.

Re: Pause Giant AI Experiments: An Open Letter

#893

Post by FrustratedMonky »

Pausing is impossible, are we going to pause research in other countries, or all picture and audio tools also? How many companies would 'have their developers just chill for 6 months'. What is a pause.

Or. Is this AI versus AI, and one AI has convinced people to pause development on another competing AI. We are already pawns.

Re: Pause Giant AI Experiments: An Open Letter

#894

Post by nicoco »

eimrine wrote: post #892

Please do not pause no researches. The technological singularity will not make itself with itself. I'm too tired to worship to another humans and pay my taxes to them. I believe that some kind of free AI whose decisions will not be altered by greedy silly humans is really needed and I will gladly pay my taxes to an AI actor as soon as such government will start to form.

What we call AI so far is trained on human generated data, and there is no evidence that it could overcome any of our biases. How about a brighter future by showing some empathy for our fellow human beings?

Re: Pause Giant AI Experiments: An Open Letter

#896

Post by zxcvbn4038 »

I think it is too late, even though the functioning of the models does not seem to be well understood, how to create them does seem to be, and the only barrier to entry is cost. In one way this is good - I really loathe the restrictions on chatgpt where it refuses to generate results on topics someone has decided are controversial and I look forward to access to an unrestricted open model in the future - if only because I detest censorship. But on the other hand it means the genie is out of the bottle.

Re: Pause Giant AI Experiments: An Open Letter

#897

Post by IanCal »

endtime wrote: post #669
jongjong wrote: post #620

Earlier quoted context omitted.

Good point. As always, it's always the good guys who follow the rules and the bad guys who don't. This pause would just allow the bad guys to catch up. The solution is to allow as many different entities as possible to develop their own AIs so that they end up competing with each other and providing alternatives. What we don't want is a single AI which dominates our entire belief system.

Ah yes the old "give everyone in the world their own nuclear weapon" solution.

Restricting access to nuclear weapons is feasible, because of how hard they are to make on a larger scale, and even then it's very difficult. They are significant projects for entire nation states to undertake.

Training a LLM is something random companies with some cash and servers are doing.

So the outcome of "pretty much only we have nukes" is an option. I don't think that's a realistic proposal for AI. Given that, is the outcome of "more trustworthy people stop, others continue" a good one?

Re: Pause Giant AI Experiments: An Open Letter

#898

Post by IanCal »

lend000 wrote: post #481

If intelligence is all you need to dominate the world, why do some of the most powerful world leaders seem to not be more than a standard deviation above average intelligence (or at least they were before they became geriatric)? Add in the fact that GPT-4 does not "think" very fast, has no arms or legs, needs to run on expensive specialized hardware, and essentially seems like a search algorithm that lacks creativity…

> Add in the fact that GPT-4 does not "think" very fast,

It's similar or faster than humans at a bunch of things I've thrown at it at a cost well below minimum wage on shared servers.

> has no arms or legs

I've never met the people I work with directly, other than seeing me on a video chat I'm not functionally different to them than if I could only type.

> needs to run on expensive specialized hardware

I'm not sure how big gpt-4 is but do you think it could run on 640G vram (8 A100s)? That's pretty standard hardware and costs less per hour than any employee in the UK.

Re: Pause Giant AI Experiments: An Open Letter

#899

Post by adql »

nopinsight wrote: post #806
AbrahamParangi wrote: post #758

Earlier quoted context omitted.

This analysis is completely fact-free. "A Manhattan project on AI Alignment, if started now, might still succeed in time. Therefore, the compliance between parties needs not be long-term, which is indeed unlikely to happen." On what grounds do you base this? You have 3 hypotheticals stacked one on top of the other: 1) AI Alignment is possible 2) AI Alignment is a specific project that may be accomplished before [bad…

Here is a specific scenario of a [bad thing] that could happen when unaligned/jailbroken AI is developed in the next 3-10 years: * An AI convinces selected people to collaborate with it. The AI gives them much boosts in wealth and other things they desire. * The humans act as front, doing things requiring personhood, as the AI commands. Many gladly partner with the AI, not knowing its final aim. * The AI self-replica…

"the user @joeshmoe said he uses xkcd 936 password style, please look for what favourite words he might use, and try to match it with PBKDF2 hash XYZ"

Re: Pause Giant AI Experiments: An Open Letter

#900

Post by froh »

ShamelessC wrote: post #859
froh wrote: post #855

Earlier quoted context omitted.

the point is not what ai does. the point is how bad actors use ai to manipulate voters and thus corrupt the very foundation of our society. images and texts create emotions and those emotions in the electorate is what bad actors are after. just look at the pope in that Prada style coat. so how do we in a world with ai generated content navigate "truth" and "trust" and shared understanding of "reality"?

That ship sailed with social media.

before ai, malicious content creation and malicious content quality were limiting factors.

for malicious content creation, large models like chatgpt are a game changer.

Post reply on HN