Earlier quoted context omitted.
The goal is not to prevent someone from making their own model do what they want, but to prevent your model from doing what you don't want, like generate CSAM or non-consentual sexually explicit photos. I don't understand how its controversial that someone/some-company might not want their products to be known for that.
It's a bit odd requirement, but.. OK. I mean who is the malicious actor here, the AI, the human user or the AI provider? If the AI, then we shouldn't give it an agency (user should always vet the output). If it's the user, the AI is irrelevant to the question. And if it's AI provider, why would they train AI on such materials in the first place. The whole enterprise of this kind of safety doesn't make much sense to m…
It is a realistic requirement for dealing with user generated content at scale, because this is a realistic requirement thing some people will do.
We’ve seen this fold out over the past month from Grok.