https://x.com/biggest/status/2081891756769952075?s=46 Official stance of an anthropic-employee being against Dario amodei opinion.
Where do you get ‘official’?
Mirror: https://xcancel.com/Biggest/status/2081891756769952075?s=46
Our position on open-weights models
781–790 of 1001 posts
Re: Our position on open-weights models
#782Schrödinger's China at once is an evil entity looking to use AI for their own nefarious purposes yet also willing to cooperate with their main competitor to prevent other actors (who??) from achieving similar goals (all while under a chip embargo too!!) The reality is much less confusing: Anthropic CEO does not wish for models with similar (or greater) capabilities compared to his own closed and overpriced ones to be…
is it so hard to fathom that China whilst wanting to beat the US in many ways doesn't want a biological war to destroy the world?
Re: Our position on open-weights models
#783To everyone here pushing for total proliferation of open models -- what should be done about open weight bioweapon and cyber-offense capabilities? Is it simply the cost of freedom that we should allow attackers to access these tools? The OpenAI / Hugging Face incident shows what a GPT 5.6 level model can do off the leash; within ~6 months, open weight models will match this and every bad actor under the sun will be a…
I was a genetic engineer for ~20 years and have worked on frontier LLMs for the last 8. I used to engineer viral vectors and studied how to evade human immune systems for gene therapies... The biorisk scenarios that the AI safety folks flog are fever-dreamed fantasies that have only the most tenuous connection to biological reality. As someone who cares about the real bio-risks of natural pathogens, I get pretty tire…
> The biorisk scenarios that the AI safety folks flog are fever-dreamed fantasies that have only the most tenuous connection to biological reality
Do you not think that at the rate ai intelligence and ability is increasing, this could realistically change one day soon?
Re: Our position on open-weights models
#784Pro-US slop. The greatest threat is our own government. They are the ones with a right-wing government building a repressive apparatus across a huge number of datacenters and are proven to spy on the entire world. Anyone remember the Snowden leaks? Guantanamo bay? Alligator Alcatraz? Random murders by internal security? Blowing up a building full of school girls?
Re: Our position on open-weights models
#785"without US chips" is an interesting framing, considering most of these chips aren't made in the USA? Mostly it's made in other asian contries(Taiwan, Japan, South Korea), or am I wrong?
Probably refers to US design rather than manufacturing
Re: Our position on open-weights models
#786To everyone here pushing for total proliferation of open models -- what should be done about open weight bioweapon and cyber-offense capabilities? Is it simply the cost of freedom that we should allow attackers to access these tools? The OpenAI / Hugging Face incident shows what a GPT 5.6 level model can do off the leash; within ~6 months, open weight models will match this and every bad actor under the sun will be a…
I was a genetic engineer for ~20 years and have worked on frontier LLMs for the last 8. I used to engineer viral vectors and studied how to evade human immune systems for gene therapies... The biorisk scenarios that the AI safety folks flog are fever-dreamed fantasies that have only the most tenuous connection to biological reality. As someone who cares about the real bio-risks of natural pathogens, I get pretty tire…
If you are optimistic about this given your expertise, I am very glad to hear it. As someone scientific but with little background in biology, I've been concerned about the bioweapons angle for a long time (and not because AI companies tell me to worry about it). Can you please explain a bit more about why you are not concerned? Between standard bioweapons like sarin and gain-of-function research on viruses, it's not obviously implausible to me that LLMs a few generations from now won't be able to guide a determined layperson through the steps needed to make something very destructive.
Re: Our position on open-weights models
#787This argument might make a modicum of sense if the US hasn’t spent the last 2 years establishing itself as a bigger enemy of the west that China.
Re: Our position on open-weights models
#788In the first paragraph, > Anyone who has read my past writing should know that I don’t regard such bans as a useful measure, Later (on banning chip sales to china) > we should crack down on the rampant smuggling and workarounds used to obtain access to such chips. If you truly believe that bans don't work, the same applies to hardware too. Furthermore, Dario says later "To address these concerns, I do support the fol…
At this point, Anthropic releasing a sonnet 4.x class open weights model would be a positive PR move that doesn’t affect their bottom line.
That would go against the narrative they built over the years, that open weight models are dangerous because they will end up telling you how to create a biological weapon that will destroy the world
Re: Our position on open-weights models
#789Clown.
I switched from openAI to anthropic because OAI were the bigger clowns in the industry and didn't want to support them, anthropic seemed like the better alternative that didn't cooperate with governamental shenanigans and actually focused on building a better product. But now they are both clowns and anthropic is reaching a ceiling on quality. I'll jump ship as soon as I find a good subsidized Chinese model provider. US companies only path forward is to become retarded instead of competitive.
Re: Our position on open-weights models
#790To everyone here pushing for total proliferation of open models -- what should be done about open weight bioweapon and cyber-offense capabilities? Is it simply the cost of freedom that we should allow attackers to access these tools? The OpenAI / Hugging Face incident shows what a GPT 5.6 level model can do off the leash; within ~6 months, open weight models will match this and every bad actor under the sun will be a…
The bioweapon thing is absolute movie plot fiction. Go speak to some biologists about this and they'll set you straight. Cyber capabilities go both ways. Better offensive capabilities means better penetration testing by white hat security experts, which leads to better protections.
So many commenters are asserting this but no one is giving an argument or references. Cults have been able to make sarin. The DNA sequence for smallpox is pubicly available. Where are you getting your confidence that LLM-assisted bioweapons are of no concern?