Live data from Hacker News

We must pace the frontier

darioamodei.com

761–770 of 942 posts

Re: We must pace the frontier

#762

Earlier quoted context omitted.

> User just disputes the charge and it kind of disappears. The banking system just absorbs it, No it doesn’t. > It's all priced in. So you admit awareness that fraud loss doesn’t kind of disappear . We all pay for it, either via higher merchant fees or higher interest rates, sometimes both, on card purchases.

Yes, it absolutely does "kind of disappear". That's exactly what happens from the customer's perspective. And that's their own deliberate choice too: they chose this instead of building an actually secure system. Passing these costs to the customer is the real victim blaming here, and it should be straight up illegal. Sadly not enough countries enforce caps on credit card fees, but some do, and more should follow sui…

That only works if you believe people are retarded.

Card users are well aware that fraud losses are covered by the fees they pay for using a card, whether those fees are made explicitly or not.

If customers of services aren’t paying for the service, who will? What other source of revenue do merchants have?

Australia just passed legislation that merchants aren’t allowed to charge a fee for using a card. That is: they aren’t allowed to have a line item on the receipt for using a card.

The customers still pay, because all of the merchant’s revenue comes from their customers.

So what will happen is: merchants will charge more for every product so they don’t lose.

This means even when paying with cash you will effectively pay the card surcharge.

Of the ten or so merchants I spoke with in the two weeks prior to the legislation being enacted, they all said exactly that.

Customers aren’t stupid, despite the fact that there are some stupid customers.

Meanwhile, the banks reduced their card service fees by, on average, 0.1%.

So if you tally card + cash transactions, customers are worse off because merchants can no longer charge only those customers who pay by card. Instead, they have to raise prices for everyone.

There are approximately no problems people face where the answer is: more government.

Re: We must pace the frontier

#763
While I respect Dario taking responsibility here, this line disturbs me: "The US and other democratic governments attempt to coordinate with authoritarian governments"

We all know he is talking about China, and I'm pretty sure China doesn't appreciate being called "authoritarian". I am sure he doesn't mean it, but in all of his essays, his language around non-US nations always disturbs me a little bit..

--

Also Dario, if you happen to read this, I want you to know that I have loved using Claude Code for programming. But I am now using DeepSeek v4.1 Flash - simply because it is the same good experience, but Open Weights. Making the Open Model space succeed is where I am investing my time - it's giving back to the people, true and simple.

Re: We must pace the frontier

#764

Earlier quoted context omitted.

Do you have any familiarity with Anthropic at all? At no point did they ever say open weights are a good idea. Their entire thesis is AI IS VERY DANGEROUS AND WE MUST DO IT RIGHT. You can hate it, but everything they do is consistent with this thesis, and everything they say is consistent with their actions! You just want them to want different things.

It reads like “AI is dangerous, only we should be allowed to make money from it”

Exactly

He doesn't need anyones permission to do so, go ahead no one is stopping you! If you feel so strongly about it, lead by example. Perhaps others will follow, maybe even China. Regardless backup your sentiment with actions!

Re: We must pace the frontier

#765
He doesn't need anyones permission to do so, go ahead no one is stopping you! If you feel so strongly about it, lead by example. Perhaps others will follow, maybe even China. Regardless, backup your sentiment with actions.

Also everyone, collectively, stop thinking about neural networks too 'hard'. Whilst you're at it stop doing maths too!

Re: We must pace the frontier

#766

He doesn't need anyones permission to do so, go ahead no one is stopping you! If you feel so strongly about it, lead by example. Perhaps others will follow, maybe even China. Regardless, backup your sentiment with actions. Also everyone, collectively, stop thinking about neural networks too 'hard'. Whilst you're at it stop doing maths too!

You obviously didn’t read it, because he announced things they are commencing unilaterally and immediately.

And other proposals that require collaboration and/or regulation.

Back up your sentiment by reading the source.

Re: We must pace the frontier

#767

He doesn't need anyones permission to do so, go ahead no one is stopping you! If you feel so strongly about it, lead by example. Perhaps others will follow, maybe even China. Regardless, backup your sentiment with actions. Also everyone, collectively, stop thinking about neural networks too 'hard'. Whilst you're at it stop doing maths too!

That's reductive. Without coordinated cooperation, enough actors will defect so game theory plus market forces will force acceleration on the frontier overall.

Re: We must pace the frontier

#768

At what point do we stop engaging with Anthropic’s leadership in good faith and acknowledge their track record, - no open weights - can’t use claude to research AI - train on everyone else’s IP and sell it back to them - 8 regulatory capture attempts and counting - so controlling they are the only US company blacklisted by the US government This is not effective altruism / rationalism gone wild, it’s just monopolisti…

> At what point do we stop engaging with Anthropic’s leadership in good faith About two years ago? I would also note that Dario's post appears to be LLM written. Maybe... maybe ... he's read so much Claudeish that it's all he can speak now himself. But I wonder if he's becoming a bit of a meat proxy. (It's funny, I thought "pace the frontier" was going to mean something similar to "patrolling the frontier". But no, i…

For what it's worth, I didn't get AI-written vibes from it, and Pangram also flags it as 100% human-written.

Re: We must pace the frontier

#769
I really deeply worry about who is deciding what 'aligned' is. Amodei & his ilk talk like the hard part is getting the LLMs to behave, as if we've figured out morality itself. I don't think LLMs are going to be as dangerously capable as quickly as he does, but if I'm wrong and he's right, and they're building some sort of digital-lesser-god, I don't feel good that techbros at OpenAI and Anthropic are the moral arbitrators.

Re: We must pace the frontier

#770

At what point do we stop engaging with Anthropic’s leadership in good faith and acknowledge their track record, - no open weights - can’t use claude to research AI - train on everyone else’s IP and sell it back to them - 8 regulatory capture attempts and counting - so controlling they are the only US company blacklisted by the US government This is not effective altruism / rationalism gone wild, it’s just monopolisti…

I have many issues with Anthropic, but I will say that their actions are fully consistent with a group of people who earnestly believe that AI is extremely dangerous In fact, I would say that the Occam’s razor explanation is not that they are seeking regulatory capture, but that they earnestly believe in the x-risk, and that they are the most thoughtful and capable people to address it You may disagree, you may think…

Simplest explanation isn’t that they are attempting this well-documented, well-understood corporate tactic? Because believing AI doom is simpler?

God complex would be a pretty simple explanation.

Regulatory capture isn’t an “elaborate ruse.” For god’s sake, its Wikipedia page is 19 years old. I am not asking you to study political science or read Foucault.

If you are going to invoke Occam’s Razor, you can’t ignore the simplest explanation, which has a 19 year old entry on Wikipedia and over 100 years old historical precedence.

Post reply on HN