Live data from Hacker News

Everyone should slow down AI development except for me

xeiaso.net

301–310 of 313 posts

Re: Everyone should slow down AI development except for me

#301

Earlier quoted context omitted.

> There is no way I use the same model as US Army for $20. Don't underestimate market pressure. If there are no regulations, why would a company give the US Army access to a better product?

They have hundreds billions dollars budgets.

Then they should have contracts with __all__ AI labs, not just one.

Re: Everyone should slow down AI development except for me

#302
post #238

They are talking about slowing down the public facing AI development. Because then nation states can create a capabilities gap between them and the public. Why does nobody seem to be pointing out this obvious explanation? It explains why the “we need to race China” concern suddenly vanished in the discussion. The government can simply gag Sam, Dario, Musk on national security basis, getting them all behind the public…

I’m pretty confident this has already happened. Public models are behind their internal models and just above Chinese models. Only thing closing the gap is Chinese models pushing. I’m not American. There is no way I use the same model as US Army for $20. When we have Sol they have Astra. When we have Astra they have Nova, Nebula, Galaxia…

I would not be surprised if they were a year behind because of all kinds of legacy systems and vetting requirements.

If we're talking about the 3 letter agencies well then..

Re: Everyone should slow down AI development except for me

#303
post #201

Earlier quoted context omitted.

> Supersonic passenger aircraft were operated profitably Were they? IIRC joint project by British and French national airlines, they expected to sell loads, hardly anyone wanted to buy the planes, the two airlines kept them flying out of government embarassment.

should probably spell it out: _it wasn't allowed to get to supersonic speed_. Same way we dont _allow_ eugenics.

Sure, the regulation that guarded against externalizing certain costs might well have been the only thing precluding profitability. Importantly it wasn't some shared cultural value leading to voluntarily leaving money on the table. Rather the regulator imposed it.

We are able to effectively regulate things like the operation of massive aircraft, eugenics, the dumping of toxic waste, or the refinement of nuclear material. But there are also plenty of things that we can't effectively regulate for purely practical reasons.

Re: Everyone should slow down AI development except for me

#304
post #258
post #216

Earlier quoted context omitted.

I know people at METR and Anthropic. When they tell you they're worried the tech they're working on may kill everyone despite their best efforts, perhaps believe them.

Or you know, stop working on it if its that dangerous? This whole thing of a bunch of employees saying that they are scared of building what they are building, but do it anyway because they are somehow going to make it different? Their model has been used in the planning of mass murdering in war as well as spying on the entire worlds population as well as helping ICE out in the US. They need to stop this BS fearmonge…

> Or you know, stop working on it if its that dangerous?

Selection effect.

Everyone who thinks "the biggest difference I can make is staying in/joining/founding new AI research lab" does that.

Everyone who thinks "the biggest difference I can make is leaving/whistleblowing", does that.

Treating both groups as the same by virtue of employer is the goomba fallacy.

Re: Everyone should slow down AI development except for me

#306

Earlier quoted context omitted.

They have hundreds billions dollars budgets.

Then they should have contracts with __all__ AI labs, not just one.

Besides the current political dispute with Anthropic, they do.

Re: Everyone should slow down AI development except for me

#307

Prediction: in a few years, we will laugh at this hysteria and call it a moral panic.

Prediction: Much like Y2K people will think we were all incredibly backwards and uneducated because we thought a bunch of potato computers were going to break the world.

Re: Everyone should slow down AI development except for me

#308
post #165

Obligatory "what's Lygma?" But in all seriousness, this AI doomerism has reached a comedic inflection point. A few years ago, GPT-2 was too dangerous to release, then some Google weirdo said Gemini had a soul or something, then Mythos-tier became a meme, then some kid quit and went on FOX News talking about Skynet, and now Amodei and Altman are both on the "we need to slow down" train again; this is after we've alrea…

[dead]

Re: Everyone should slow down AI development except for me

#309
post #216

Earlier quoted context omitted.

I know people at METR and Anthropic. When they tell you they're worried the tech they're working on may kill everyone despite their best efforts, perhaps believe them.

Do you think they’re exaggerating (again) or do you think they should taken at face value and treated as hostile actors?

There's plenty of people who think greenhouse gas/global warming campaigns against fossil fuels are "exaggerating", that "earth was warm/the climate changed in the past", that a fee degrees isn't bad, that CO2 is good for plants.

Are you likeminded?

In this case, it's as if the oil and coal companies all said in the 60s and 70s "oh no, this research we did, it's all really bad; we need help to figure out how to transition away from this incredibly economically important input", rather than the observed reality where their entire PR campaign was approximately:

  there is no problem everything is fine and all critics are smelly hippies and/or communists; and/or hate the poor who are raised out of poverty by all the economic growth from the fossil fuel industry.
What if the oil and coal companies were basically all pro nuclear, pro hyrdo, pro wind, pro solar, and believed in peak oil?

Re: Everyone should slow down AI development except for me

#310
This is about consolidation of power.

Open weight models are catching up to the frontier. It also seems like frontier models reached some limit, whether this is capex related, business model related or something else. Nobody knows but it's happening to all frontier labs it seems.

It's been fear mongered many times that ai will kill us all. But this time, a person with around 2-3 months of tenure at anthropic managed to go viral with no previous social media account activity, gets picked up by all news outlets and kicks off yet another round of fear mongering.

So the real questions to ask

* is all of this to increase the valuations before IPO?

* what is the real barrier to entry for open weight models to be used by the public?

* what is the Financials of these companies showing that's causing this outcry on safety?

People need to think really critically about the things happening around them. Don't only just look at the face value of what's being presented here.

Post reply on HN