Live data from Hacker News

Our position on open-weights models

anthropic.com

711–720 of 1001 posts

Re: Our position on open-weights models

#711
I wonder how long it'll be before AI labs find a revenue stream that doesn't involve renting out their models, and stop letting us ride on their coattails.

They'd tease us with solutions to hard problems, with code that is orders of intelligence higher than any human or public model can grok.

That'd turn all the whining to begging real quick.

Re: Our position on open-weights models

#712
> For example, I worry that biology will have a strong attacker-defender asymmetry, where sufficiently capable models may be able to quickly weaponize pandemic-level viruses with widely available materials, whereas defense against these agents is a multi-year operational task in the best case (as we saw with Operation Warp Speed)5. Questions like this should be empirically answered by rigorous pre-release testing, not assumed in advance.

One of two outcomes are true in this scenario: 1) this is unrealistic fear-mongering or 2) we're all fucked.

I just don't see how our solution to this can be export controls or bans. If the fear of a bioweapon engineered by an open weight AI is a legitimate threat, our only option is to develop effective countermeasures (and perhaps the same AI will assist with protecting). Open weights are not going away and pretending like some sort of "ban" will prevent bad actors from accessing them is a fairy tale.

Re: Our position on open-weights models

#716
post #81

Hate to break it to you Dario but the way things stand right now the world at large trusts the Chinese establishment a lot more than the American one.

Reading some of what Liang Wenfeng said on the investor call a few days ago gave me hope for humanity. I really want to believe AI is going to be a tool for good, not going to just enrich a few billionaires again.

Re: Our position on open-weights models

#717
Pardon my French. Eat a bag of dicks.

Of course you didn’t advocate for the bans of open weight models. I will concede that.

It’s only the at you did literally everything else that you can to eliminate competition because otherwise there is no moat.

And half of the US economy is propped up by this AI bubble.

This isn’t about China doing evil things with models, most of which that you accuse of China - you and the US have already done and are doing.

The most obvious one being double-tapping a girls school.

Anthropic models directly integrated into Palantir’s Maven. The blood is on your hands.

Here’s something to chew on, maybe China is looking to integrate AI into its military and weaponise it as a direct response to the US doing that first.

So please, spare us the moralising.

As a closing thought: who the fuck even gave you the mandate to be the arbiter and judge of right and wrong, evil and good?

Re: Our position on open-weights models

#718
post #172

To everyone here pushing for total proliferation of open models -- what should be done about open weight bioweapon and cyber-offense capabilities? Is it simply the cost of freedom that we should allow attackers to access these tools? The OpenAI / Hugging Face incident shows what a GPT 5.6 level model can do off the leash; within ~6 months, open weight models will match this and every bad actor under the sun will be a…

I was a genetic engineer for ~20 years and have worked on frontier LLMs for the last 8. I used to engineer viral vectors and studied how to evade human immune systems for gene therapies... The biorisk scenarios that the AI safety folks flog are fever-dreamed fantasies that have only the most tenuous connection to biological reality. As someone who cares about the real bio-risks of natural pathogens, I get pretty tire…

> The biorisk scenarios that the AI safety folks flog are fever-dreamed fantasies that have only the most tenuous connection to biological reality.

As an expert, could you also provide your arguments please?

Re: Our position on open-weights models

#719
I made this comment 31 days ago: Absolutely everything can be taken away. The simplest way to remove open models is probably to declare them a tool that terrorists could use. Crazy? Yes, the world is totally crazy these days. https://news.ycombinator.com/item?id=48692660

And now, here we are:

  > Anthropic has never advocated for a ban on open-weights models.
  > ... preventing AI biological weapons ...

Re: Our position on open-weights models

#720
What Dario said is half true. The untrue half is that the ship to stop China from overtaking the US in AI has sailed long ago. While China is busy getting their frontier models trained on smuggled chips using distilled data from millions of shell accounts, the US is busy debating whether to check voter IDs, or secure borders. It is just delusional to think the US is actually capable to stop China from getting the chips they want.
Post reply on HN