Earlier quoted context omitted.
I have not see any reporting or evidence at all that Anthropic or OpenAI is able to make money on inference yet. > Turns out there was a lot of low-hanging fruit in terms of inference optimization that hadn't been plucked yet. That does not mean the frontier labs are pricing their APIs to cover their costs yet. It can both be true that it has gotten cheaper for them to provide inference and that they still are subsid…
> they still are subsidizing inference costs. They are for sure subsidising costs on all you can prompt packages (20-100-200$ /mo). They do that for data gathering mostly, and at a smaller degree for user retention. > evidence at all that Anthropic or OpenAI is able to make money on inference yet. You can infer that from what 3rd party inference providers are charging. The largest open models atm are dsv3 (~650B para…
so my unused tokens compensate for the few heavy users