Earlier quoted context omitted.
So “Only if you’re OpenAI” :) If the weights were public, the community would figure out a way to fine tune it.
It’s not a matter of ‘figuring out’. The model supports fine tuning. It’s a core feature of the openai API. Running ‘fine tuned’ versions of GPT-3 that are created by customers is literally their SaaS model. They have examples in the documentation. Here: https://help.openai.com/en/articles/5528730-fine-tuning-a-cl...
A friend of mine was going to build a writing assistant on top of GPT-3. She got a lot of encouragement from them. Then one day the social media storm hit OpenAI, and suddenly safety became a non-negotiable feature of their api. And along with that came the restriction “absolutely no products that can generate unlimited amounts of text, even if you can pay for the credits.”
Poof, no more business.
Imagine buying a keyboard that restricted what you could type.
All of these problems go away when you have access to the weights.