Earlier quoted context omitted.
Open models are probably also comparatively astronomically expensive to train - just less so than the frontier models because they’re somewhat smaller, +/- the creators are more incentivised to focus on getting more from less compute because they’re have to, +/- they rely on distillation of the frontier models and this is more efficient. But efficiencies aside; creation of open models still requires a lot of money an…
I don't think it needs to be framed purely as generosity. You just need a sufficiently self-interested actor that sees open ecosystems as a necessary part of reducing their own risk profile, relative to the alternative of complete reliance of a third-party business that can take an exorbitant cut and/or Sherlock them at any time. Valve and SteamOS are a good example of what this idea looks like in practice. (Though t…
This would be an argument for an organisation developing its own model; but not per se for releasing the weights openly.
The possible explanations (I'm aware of, which overlap somewhat) for spending large amounts of money on models then releasing them for free (i.e. the current Chinese approach) are soft power, marketing for a future paid model business (i.e. competing with the US models for customers and mindshare during the time you can't compete directly at the bleeding edge), and/or a geopolitical move to diminish the value of the US's frontier model companies.