Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

We must pace the frontier

darioamodei.com

Post reply on HN
Print view View original

971–980 of 980 posts

Re: We must pace the frontier

#971

Post by MrBuddyCasino »

cuuupid wrote: post #457

At what point do we stop engaging with Anthropic’s leadership in good faith and acknowledge their track record, - no open weights - can’t use claude to research AI - train on everyone else’s IP and sell it back to them - 8 regulatory capture attempts and counting - so controlling they are the only US company blacklisted by the US government This is not effective altruism / rationalism gone wild, it’s just monopolisti…

"The most common question people ask me is “Why do they do it?” That is a hard question to answer, but today I will answer it.

[...]

The first and most persistent oddity I ran into was the Effective Altruists’ willingness to lie, then admit to lying, then lie again."

https://x.com/brianchau57/status/2098035812365463637

https://news.ycombinator.com/item?id=49648088

Re: We must pace the frontier

#972

Post by nikolay »

Yeah, I'm focusing on OpenAI as they are way more sane than Anthropic! I thought Sam Altman was crazy, but Dario is Sam Altman squared! Codex is so much nicer to use, too! A fun fact - everything that I do with Claude Code is getting reviewed by Codex, and it always, always, always finds major issues! It's so fun when Claude starts apologizing, like I'm some infant! Man up and deliver quality, Claude!

Re: We must pace the frontier

#973

Post by roncesvalles »

Nition wrote: post #768
epihelix wrote: post #691

Earlier quoted context omitted.

> At what point do we stop engaging with Anthropic’s leadership in good faith About two years ago? I would also note that Dario's post appears to be LLM written. Maybe... maybe ... he's read so much Claudeish that it's all he can speak now himself. But I wonder if he's becoming a bit of a meat proxy. (It's funny, I thought "pace the frontier" was going to mean something similar to "patrolling the frontier". But no, i…

For what it's worth, I didn't get AI-written vibes from it, and Pangram also flags it as 100% human-written.

"Write a blog article about . Keep rewriting it until it passes Pangram as 100% human-written. "

Re: We must pace the frontier

#974

Post by mordae »

altpaddle wrote: post #865
academia_hack wrote: post #90

Dario's proposed approach is a classic example of capital attempting to control technological advancement and the means of production. For the first time in human history, any member of the working class can just about afford to have a team of expert scientist/physician/lawyer/engineers working directly for them. Super intelligence (the ability to have many smarter minds than your own reporting to you) has always bee…

What a foolish comment, LLMs empower capital owners far more than the 'working class'

Only in how they are deployed, not in principle.

Re: We must pace the frontier

#975

Post by mordae »

mbo wrote: post #117
academia_hack wrote: post #90

Dario's proposed approach is a classic example of capital attempting to control technological advancement and the means of production. For the first time in human history, any member of the working class can just about afford to have a team of expert scientist/physician/lawyer/engineers working directly for them. Super intelligence (the ability to have many smarter minds than your own reporting to you) has always bee…

What? This is capital, on the cusp of total victory, about to cut itself free from the necessity of human labor for productive activity, to elevate itself into pseudo-godhood suddenly panicking and begging its mortal enemy, _the state_ to rein it in and kneecap it. Capital is not stupid: there's no use in being rich if you're dead.

State is not an actor. It is part of the playing field.

Re: We must pace the frontier

#976

Post by mordae »

sailfast wrote: post #192
academia_hack wrote: post #90

Dario's proposed approach is a classic example of capital attempting to control technological advancement and the means of production. For the first time in human history, any member of the working class can just about afford to have a team of expert scientist/physician/lawyer/engineers working directly for them. Super intelligence (the ability to have many smarter minds than your own reporting to you) has always bee…

Sorry boss but this ain’t it. I don’t think the answer to nuclear proliferation is to let everybody have all the nukes they want. You’re framing this like it’s 1917, or 1945. But it is not - and likely has very little to do with capital at all. Any “revolution” here (assuming there is some truth in the doomerism which I believe there is given the state of AI) will really look more like an extinction or a genocide, re…

You are basically saying we should preemptively imprison people who are too smart, right? If the intelligence is too great, we have to contain it. I disagree.

Re: We must pace the frontier

#977

Post by watwut »

aubanel wrote: post #777
cuuupid wrote: post #457

At what point do we stop engaging with Anthropic’s leadership in good faith and acknowledge their track record, - no open weights - can’t use claude to research AI - train on everyone else’s IP and sell it back to them - 8 regulatory capture attempts and counting - so controlling they are the only US company blacklisted by the US government This is not effective altruism / rationalism gone wild, it’s just monopolisti…

You can disagree with Anthropic leadership, but all the points you mentioned can reconcile very well with them thinking in good faith "advanced AI is too dangerous to be left in all hands" Except the "train on everyone else IP" which can be said of all AI companies.

A company that sells to Palantier is not "good hands".

Re: We must pace the frontier

#978

Post by mordae »

xg15 wrote: post #118

I don't see how the dual goals of "we have to make an agreement with China for mutual slowdown" but also "we have to ensure we will always stay ahead of China" would work. I imagine the first thing the chinese government would demand in negotiations about such an agreement would be a lifting of the chip and distillation ban. > Some may believe these measures make it more difficult to cooperate with China, but I belie…

Why would China want to slow down when it is winning?

Re: We must pace the frontier

#979

Post by watwut »

hakimg wrote: post #941
sigmarule wrote: post #901

Earlier quoted context omitted.

If this is going to factor into my reasoning about the topic at hand, it will surely be a secondary or tertiary consideration at best. Same goes for much of the list in the root comment. We are discussing the possibility of severe adverse societal/world/human impacts from AI, why should open vs closed source/weights, copyright violations, anti-competitive moves, corporate hypocrisy, etc be so heavily weighted in the…

This is exactly my view and it's frustrating that a sizeable group of people refuse to accept there's any risk with AI. We're literally trying to build something that's smarter than all humans and with the capacity to do extraordinary work while most people think there's no risk in open sourcing this capability with no guardrails (model ablation means no guardrails and as far as I'm aware can't be stopped). Has our d…

> Has our distrust in western companies really gotten to the point they'd rather unfiltered Astra level capabilities in the hands of every hostile government and terrorist organisation than potentially do any form of regulation in case it plays into the AI labs hands.

Ever checked political programs of Thiel, Musk and the rest of billionaires? They are literally and openly hostile to democracy, human rights, freedom and govermantal structures that made world more peaceful.

They are literally the hostile entities.

Re: We must pace the frontier

#980

Post by mschuster91 »

cuuupid wrote: post #457

At what point do we stop engaging with Anthropic’s leadership in good faith and acknowledge their track record, - no open weights - can’t use claude to research AI - train on everyone else’s IP and sell it back to them - 8 regulatory capture attempts and counting - so controlling they are the only US company blacklisted by the US government This is not effective altruism / rationalism gone wild, it’s just monopolisti…

> Altman gets so much hate but OpenAI has been a far better steward (on 3/5 above at least) than Anthropic!

Altman single-handedly pulled off the most daring market manipulation heist in the last few decades [1].

Under any normal circumstances he'd have been arrested and prosecuted.

The entire AI industry is filled to the brim with conmen, scammers and grifters, but Sam Altman is the most disgusting of all of them.

[1] https://www.mooreslawisdead.com/post/sam-altman-s-dirty-dram...

Post reply on HN