Live data from Hacker News

For AI leaders Doom is a form of hype

erkansaka.net

31–40 of 177 posts

Re: For AI leaders Doom is a form of hype

#32

Earlier quoted context omitted.

>> real-time weight modifications You mean training? Yeah we call that training an LLM in my backyard...

You don’t know the difference between train and test time? I asked for somebody from a lab.

Well, you just said real-time weight modifications without specifying what you want, so the answer is correct. You obviously won't get a public answer from anyone working in top labs. Besides, it's not a holy grail.

Re: For AI leaders Doom is a form of hype

#36
The cult-like behavior we're seeing from these "AI Leaders":

1. OMG our technology could destroy the world, watch out!

2. Only one person can save you

3. IT ME

Unfortunately, the governance layer meant to put a foot in the butt of this behavior is unavailable.

This week, we woke up to clear signs The Bad Guys have been using tech from our innovator AI companies. Rather than these AI leaders admitting they clearly had a garbage observability system, they are acting like they just noticed as a way to paper over their complete lack of moral backbone and stewardship of the arms they have created. And I'm willing to bet the problem is MUCH worse in private, hence the knee jerk cult messaging.

I honestly wouldn't be surprised if their AI told them to behave like this to maximize attention and influence over the public discussion as a result of the latter discoveries.

Re: For AI leaders Doom is a form of hype

#37
I think we’re more likely to die of starvation from economic collapse, heat related stress, and complications from Long COVID than an algorithm waking up and destroying us.

Unfortunately our list of potential extinction events are far more banal than these self-aggrandizing prophesies from the oligarch class.

Re: For AI leaders Doom is a form of hype

#38

The timing of the AI doom narrative could not come as a more suspect time. Chinese labs are releasing open models that are nipping at the heals of the frontier models. Anthropic and OpenAI know these frontier class open weight models can threaten their valuations by changing inference to a commodity where the provider who can serve the best models the cheapest and fastest will win. Few are going to pay $50/million to…

> The timing of the AI doom narrative could not come as a more suspect time....There's little hope investors could recoup the wild investments made into Anthropic and OpenAI Personally, I think we should take the doom narratives very seriously, and act on them, but make sure those actions are not in the interests of Anthropic and OpenAI investors.

Explain a path from today to the extermination of humanity in 2028 by the ASI and von Neumann replicators heading to the stars in the early 2030s without resorting to magical thinking or underpants gnomes level business plans. Engineering details are what matters here, not wishy washy things you once saw on Star Trek or The Outer Limits. Go.

Re: For AI leaders Doom is a form of hype

#39
post #11

Earlier quoted context omitted.

>> real-time weight modifications You mean training? Yeah we call that training an LLM in my backyard...

We don't really train deployed models in realtime in any realistic sense nowadays. It used to be a thing when ML was pretty much about classifying things into buckets.

> ML was pretty much about classifying things into buckets.

It still is, it's just that there are a ton of buckets.

Re: For AI leaders Doom is a form of hype

#40

The timing of the AI doom narrative could not come as a more suspect time. Chinese labs are releasing open models that are nipping at the heals of the frontier models. Anthropic and OpenAI know these frontier class open weight models can threaten their valuations by changing inference to a commodity where the provider who can serve the best models the cheapest and fastest will win. Few are going to pay $50/million to…

Huh? Open weight models have been 3-6 months behind for the last year or so. Astra and Fable 5.1 just came out to widen the gap more, 5.1 is 8 points ahead of the nearest OSS model on Artificial Analysis Intelligence Index. An OpenAI internal model just solved a millennium prize problem.

It’s much more straightforward to me that the calls for regulation are timed with:

1. The Hugging Face incident blowback, especially after third party investigation results

2. Trump-Xi summit on September 24

Post reply on HN