Live data from Hacker News

No, it doesn't cost Anthropic $5k per Claude Code user

martinalderson.com

321–330 of 374 posts

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#321
post #283

"Any conversation about token costs devolves into an ad-hoc, informally-specified, bug-ridden implementation of half of generally accepted accounting principles." We have a way of determining if Anthropic is, or has the capability of being profitable, and what the levers to that may be. AI may be world-changing, but the accounting principles behind AI labs are no different than those behind a Pizza Hut. Even if the c…

Of course a model does not really depreciate, the problem is they are forced by competitive pressure to offer newer/better models at the same price. This is what the elites of the gilded age called "ruinous competition", and the solution today will be the same as back then: monopoly power. This has been the business plan of the tech VC industry for 25+ years.

Do they not depreciate?

The models don't learn without training, and they have finite context windows. As software updates around the world, don't they have to be trained on the new information to stay up to date?

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#322
post #321
post #283

Earlier quoted context omitted.

Of course a model does not really depreciate, the problem is they are forced by competitive pressure to offer newer/better models at the same price. This is what the elites of the gilded age called "ruinous competition", and the solution today will be the same as back then: monopoly power. This has been the business plan of the tech VC industry for 25+ years.

Do they not depreciate? The models don't learn without training, and they have finite context windows. As software updates around the world, don't they have to be trained on the new information to stay up to date?

Fair, but in this context people are generally contemplating the need to replace the model with a new, much larger and more expensive model, not just refresh the training set.

It's partly about updating what it "knows", but more about keeping up with competitive pressure on capabilities.

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#323
post #295

"Any conversation about token costs devolves into an ad-hoc, informally-specified, bug-ridden implementation of half of generally accepted accounting principles." We have a way of determining if Anthropic is, or has the capability of being profitable, and what the levers to that may be. AI may be world-changing, but the accounting principles behind AI labs are no different than those behind a Pizza Hut. Even if the c…

Dario has made a specific cohort argument here. His numbers (from various interviews) are: you train a model in 2023 for $100M, deploy it, and it earns $200M over its lifetime. Meanwhile you train the 2024 model for $1B, which goes on to earn $2B. Each vintage returns 2x on its training cost. However, the GAAP P&L tells the opposite story. You book $200M revenue in the same year you spend $1B training the next model,…

If you have to continually spend greater amounts of money to keep up with the competition on every new model then it is dying.

Every single time a company comes around and goes "Actually GAAP are wrong, look at my new math that says were good" its led to much wailing and gnashing of teeth in the future when it inevitably isnt.

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#324

Earlier quoted context omitted.

This is why most businesses only have ChatGPT subscriptions. Plus their integration into existing Microsoft products and billing.

Trusting Microsoft seems like a right move /s

Microsoft already has all their business data in the form of handing document storage and emails. Trusting another of their services to also not use that data for Microsoft's own purposes is reasonable.

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#325
post #322
post #321

Earlier quoted context omitted.

Do they not depreciate? The models don't learn without training, and they have finite context windows. As software updates around the world, don't they have to be trained on the new information to stay up to date?

Fair, but in this context people are generally contemplating the need to replace the model with a new, much larger and more expensive model, not just refresh the training set. It's partly about updating what it "knows", but more about keeping up with competitive pressure on capabilities.

I’m actually not familiar enough to know. Can models be refreshed for cheaper? I thought due to the black box nature of them that there would be no difference between updating and generating a whole new model.

Maybe they can get to a “good enough” level where the next model isn’t 10x the price but if the business model requires ever increasing sizes to paper over the r&d costs from the previous set then I don’t understand how they would transition to profitability

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#326

"Any conversation about token costs devolves into an ad-hoc, informally-specified, bug-ridden implementation of half of generally accepted accounting principles." We have a way of determining if Anthropic is, or has the capability of being profitable, and what the levers to that may be. AI may be world-changing, but the accounting principles behind AI labs are no different than those behind a Pizza Hut. Even if the c…

The world labor market is ~35T USD yearly, and so that is roughly the order of magnitude to balance against frontier model training cost. E.g. Dario Amodei has his "data center of PhDs" level where he assumes that's "good enough" to stop training frontier models; so if that can take even 5% of global labor market that's ~1.5T a year revenue, balanced against current model training costs of ~1B. 3 orders of magnitude…

> The world labor market is ~35T USD yearly, and so that is roughly the order of magnitude to balance against frontier model training cost.

Crazy that people can write sentences like this with a straight face these days.

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#327
post #322
post #321

Earlier quoted context omitted.

Do they not depreciate? The models don't learn without training, and they have finite context windows. As software updates around the world, don't they have to be trained on the new information to stay up to date?

Fair, but in this context people are generally contemplating the need to replace the model with a new, much larger and more expensive model, not just refresh the training set. It's partly about updating what it "knows", but more about keeping up with competitive pressure on capabilities.

People? There's a guy upthread quoting the Anthropic CEO on how they view the value of increasing training against the offset of the entirety of the $35T worldwide labor market... It's not "people". It's the salesmen.

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#328
post #106

I calculated only last weekend that my team would cost, if we would run Claude Code on retail API costs, around $200k/mo. We pay $1400/month in Max subscriptions. So that's $50k/user... But what tokens CC is reporting in their json -> a lot of this must be cached etc, so doubt it's anywhere near $50k cost, but not sure how to figure out what it would cost and I'm sure as hell not going to try.

I'm surprised, isn't it forbidden to use the Max plan as part of a company? Just curious, as I thought it was forbidden by the ToS but I'm not sure if I have a good understanding of it

> Just curious, as I thought it was forbidden by the ToS but I'm not sure if I have a good understanding of it

Could you quote the relevant part that you think forbids it for us?

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#329
post #133
post #106

Earlier quoted context omitted.

I'm surprised, isn't it forbidden to use the Max plan as part of a company? Just curious, as I thought it was forbidden by the ToS but I'm not sure if I have a good understanding of it

There is nothing in the TOS last time I checked forbidding it's use with Claude code. It's only forbidden to utilize it in the running of the business. So getting Claude code subscriptions for developers should be permissable and not be against anything... However, if you created a rest endpoint to eg run a preconfigured prompt as part of your platform, that'd be against it But I'm neither a lawyer nor work for anthr…

> It's only forbidden to utilize it in the running of the business.

Sorry, but could you clarify what this means?

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#330

off-topic, but, please stop hosting websites behind cloudflare, just nginx is enough, cloudflare is cancer.

Have you ever hosted a website without Cloudflare?

In my case, the access logs alone from bots scanning for vulns grew so large that the server started creating.

Fortunately I wasn't running anything vulnerable!

Post reply on HN