Every single risk he identifies as a concern regarding China is exactly my concerns with the US having absolute control. Literally the exact same concerns
Our position on open-weights models
931–940 of 1001 posts
Re: Our position on open-weights models
#932Ban distillation of our outputs, but our distillation of the sum-total of civilisation's intellectual output – proprietary or otherwise – is fair use? Either everyone licenses, or nobody does. And if you can't enforce licensing bans for everyone, the de-facto loser is those who you'd probably want to support the most, start-ups and universities, while your adversaries gain the upper hand. The strongest argument for r…
On the other hand, the open weights models could crawl and annotate and rl the training data that Anthropic and OAI did in exactly the same way, and take the exact same legal hits. They use distillation because it's cheaper not to do so.
What is the other hand here? They could do slow/costly illegal think #1 instead of the fast/cheaper illegal thing #2 that they currently do?
Re: Our position on open-weights models
#933Re: Our position on open-weights models
#934Schrödinger's China at once is an evil entity looking to use AI for their own nefarious purposes yet also willing to cooperate with their main competitor to prevent other actors (who??) from achieving similar goals (all while under a chip embargo too!!) The reality is much less confusing: Anthropic CEO does not wish for models with similar (or greater) capabilities compared to his own closed and overpriced ones to be…
I was reading the post and thinking "wow, that's pretty clear for a smart man used to writing for other smart men. it'll be really difficult to misunderstand". I read the first couple of comments and stand corrected. A much simpler summary: - open models good. - smart models _can_ be bad - smart open models that can do biotech work are dangerous. worth the hassle of certification _if_ we can get everybody on board wi…
Re: Our position on open-weights models
#935Re: Our position on open-weights models
#936To everyone here pushing for total proliferation of open models -- what should be done about open weight bioweapon and cyber-offense capabilities? Is it simply the cost of freedom that we should allow attackers to access these tools? The OpenAI / Hugging Face incident shows what a GPT 5.6 level model can do off the leash; within ~6 months, open weight models will match this and every bad actor under the sun will be a…
The Hugging Face incident is a great example of why open source models with defensive cyber capabilities are needed. Hugging Face did not have access to cyber-capable frontier models and kept hitting safeguards. Only by using the open source GLM-5.2 were they able to survive an attack. A world where open source models are banned is one where cybersecurity is impossible if you're not on OpenAI or Anthropic's allowlist…
Re: Our position on open-weights models
#937"My primary concern is the risk that authoritarian governments—not solely the Chinese Communist Party (CCP), although the CCP is clearly the most capable threat—build AI models that are more powerful than those built by the US, and use them to achieve permanent military superiority or perpetrate incredibly deep repression of their own people." Hmmmm.
The US is already under an authoritarian regime, the only thing keeping the wheels on the bus is a very tired and barely-effective judiciary. This is a temporary situation because either this regime is going to be knocked out of power, or it's going to follow through on its core Seven Mountains Mandate[1] theology and go full totalitarian . Normally totalitarianism fears are overblown, but I think that these zealots…
Yeah, I know. That was my point, the irony in that statement.
Re: Our position on open-weights models
#938Involving politics so much that I thought I was reading this on BBC instead of Anthropic.
As a developer I fully support whoever want to make AI accessible and affordable and clean, which USA biggest providers aren't doing.
On the other hand I see Chinese models being on bar with them with far less cost and more transparency but yet somehow they are still the bad guys out there :D
Classic
Re: Our position on open-weights models
#939Re: Our position on open-weights models
#940There's not much stopping US from becoming an authoritarian regime, and the US is already using AI against its own citizens.