Earlier quoted context omitted.
No, that is probably one of the worst cases they probably saw. Most likely the subscription inference cost is much lower than you expect. If you look at costs for similar open models they are much lower than what you get by buying from anthropic, so that is the real cost basis I expect. It's likely Amazon is making a fucking killing though.
While $5000 is a lot, the people who rack up close or just over a thousand "API equivalent cost" are pretty common. > Most likely the subscription inference cost is much lower than you expect. This is probably not true because they'd be screaming it off every rooftop were that the case. Same deal with the API inference. Even the "profitable on inference" claim is sourced back to hearsay of informal statements made by…
I think if you're not Anthropic and you don't have access to the actual data, then you can't say for sure. A bunch of anecdotes on terminally-AI people on twitter is not making a convincing case for me, IMO.
On the other hand, if similarly sized models cost much much cheaper than this, why, in the world, would Anthropic have much higher costs than that?
Also, counterpoint, maybe they want you to think that they have higher costs so you're more willing to actually pay for it?