61–70 of 1001 posts
if someone figures out a way to give an LLM full operational control over a virus lab, we've got a whole different set of problems than the ones Dario is describing
Aren't Anthropic models used in project maven: https://en.wikipedia.org/wiki/Project_Maven ?
> Anthropic has never advocated for a ban on open-weights models. > All sufficiently capable models, open and closed, should go through mandatory safety testing. Yeah, this is anthropic advocating for a ban on open weight models. Who runs this test? What happens if this test is too costly or the administrator refuses to allow certain people to participate. This is exactly how the US has banned goods in the past, by r…
Welcome to bizarro world!
Fist off: "the most dangerous model may be one that is trained in secret" Second: "use in drones [...] for surveillance and repression" I am very appreciative of the freedoms of the west but this type of hypocrisy and lack of self-awareness is bonkers and it should be called out.
If he had just left that bit out it wouldn't be so obvious that he's just clutching at straws at this point. In some twisted sense it's almost sad to see.
“Anthropic has never advocated for a ban on open-weights models. Open-weights models that don’t have dangerous capabilities are a public good…” A bit confused on this part, what model doesn’t have dangerous capabilities?
It seems possible to deliberately not train on some offensive capabilities and still have a very useful model. For example, Opus 5 deliberately did not train on exploiting vulnerabilities, and so performed less well on exploits than Mythos, yet was equally proficient at finding such vulnerabilities, according to the Opus 5 system card in their "OSS-Fuzz" eval [1]. [1]: https://www.securityweek.com/anthropics-opus-5-n…
Surely finding is the hard part, and any LLM should be able to easily exploit a vulnerability it already knows about?
As expected they will try hard to use government to kill competitors.
> ... (while exempting less capable models, such as those from startups and academia, entirely)
The devil is in the details, but this isn't anti-competitive as stated.