Live data from Hacker News

Everyone should slow down AI development except for me

xeiaso.net

411–416 of 416 posts

Re: Everyone should slow down AI development except for me

#411
post #339

Earlier quoted context omitted.

GPT-2 was called "too dangerous to release".

Is there a sense where they were right because GPT-2 directly led to the current situation where you can atleast objectively say that reasonable people are pretty worried about existential risks of AI .

No because that reason wasn’t why they said it.

Re: Everyone should slow down AI development except for me

#412
post #359

This is about consolidation of power. Open weight models are catching up to the frontier. It also seems like frontier models reached some limit, whether this is capex related, business model related or something else. Nobody knows but it's happening to all frontier labs it seems. It's been fear mongered many times that ai will kill us all. But this time, a person with around 2-3 months of tenure at anthropic managed…

> It also seems like frontier models reached some limit, whether this is capex related, business model related or something else. Nobody knows but it's happening to all frontier labs it seems. What’s your evidence of this? On the contrary, the large closed frontier models capability has advanced dramatically over the past 6 months… even the past 3 months…

So have the open weight ones but faster?

I don't have a horse in this argument but catching up doesn't imply the one in the lead has stagnated

Re: Everyone should slow down AI development except for me

#413

Earlier quoted context omitted.

I doubt most of your claims. Maybe the guardrails and emotional intelligence is true. For speed and efficiency, you are most likely wrong. Speed is led by GPT-5.6 Sol on Cerebras Ultrafast at 750 t/s. Afaik you cannot serve a single DeepSeek Flash 4.1 stream at 750 t/s, plus the model is less intelligent as seen on newer benchmarks. I believe OpenAI and Anhropic are at the frontier of efficiency too. There were numer…

i can provide some sources. 5.6 sol ultrafast on cerebras is 750tps, open models readily exceed this. just by using a smaller model cerebras serves qwen 3.8 27b at 1850tps. or even larger models, mimo 2.5 pro was served for a while at 1000tps. and so on. [ https://inference-docs.cerebras.ai/models/choose-a-model ] the chinese ai companies have 10% of the total compute resources of the US ones. since the USA tries to…

The proper comparison would be GPT 5.6 Luna at 38 on the intelligence score and $0.18 per task vs $0.27 for DeepSeek Flash 4.1.

Re: Everyone should slow down AI development except for me

#414
post #359

This is about consolidation of power. Open weight models are catching up to the frontier. It also seems like frontier models reached some limit, whether this is capex related, business model related or something else. Nobody knows but it's happening to all frontier labs it seems. It's been fear mongered many times that ai will kill us all. But this time, a person with around 2-3 months of tenure at anthropic managed…

> It also seems like frontier models reached some limit, whether this is capex related, business model related or something else. Nobody knows but it's happening to all frontier labs it seems. What’s your evidence of this? On the contrary, the large closed frontier models capability has advanced dramatically over the past 6 months… even the past 3 months…

I've used Astra, Fable 5.1, Sol 5.6, Opus 5. They're definitely making progress and the proof is in the pudding - I reach for the most advanced model as much as I can. But I wouldn't say their capabilities have increased dramatically. I use it for both coding and non-coding workloads and I don't feel I can do anything dramatically different. Again at the end of the day this is a debate on semantics because we can have very different definitions of "dramatic improvement".

(I'm not factoring the benchmarks into the discussion, because I've never quite cared about them)

Re: Everyone should slow down AI development except for me

#415
post #405

Earlier quoted context omitted.

Who should I be more scared of? China, which has been doubling down on open transparent research, or the secretive US companies who are in bed with the most unhinged administration we've ever had and has been actively starting wars? They're not proposing anything concrete, and when they do, what do you think the proposal will be? Will OpenAI and Anthropic open themselves for inspection so we can verify they really ha…

Dunno about "should"; personally I am more scared of the US than China here, but I do know how propaganda can be, makes "should" really difficult. > Will OpenAI and Anthropic open themselves for inspection so we can verify they really have stopped developing these "world ending" technologies? This is compatible with the language being used, but I suspect they're not going to do that.

Yeah, they won't.

And if a threat to the human race does come from AI, it's going to come from OpenAI/Anthropic. Hypercapitalist, secretive, in bed with the government, plus multiple real documented hackings of open source infrastructure already.

We're a hell of a lot safer with China doing the same research out in the open and making it available to anyone. The choice might well be: one or two superintelligent autonomous AIs at OpenAI/Anthropic - or a lot of smaller ones, unable to be controlled but also coming out of a diverse set of environments.

One of those leads to a stable ecosystem where we can all coexist, the other is genuinely terrifying. But make no mistake, from OpenAI/Anthropic this is all motivated by their stock price - when you're in the silicon valley mindset, it distorts your reality. They've convinced themselves that everyone's safer if they stay on top and in control, conveniently ignoring how that benefits them, and I don't believe them for a minute.

Post reply on HN