Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

No, it doesn't cost Anthropic $5k per Claude Code user

martinalderson.com

Post reply on HN
Print view View original

141–150 of 374 posts

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#141

Post by epolanski »

popcorncowboy wrote: post #117
faangguyindia wrote: post #114

Claude subscription is equivalant of spot instance And APIs are on-demand service equivalant. Priority is set to APIs and leftover compute is used by Subscription Plans. When there is no capacity, subscriptions are routed to Highly Quantized cheaper models behind the scenes. Selling subscription makes it cheaper to run such inference at scale otherwise many times your capacity is just sitting there idle. Also, these…

> Claude is 2x better than Codex This hasn't been true in a long time.

Not only that, but since the release of 5.4 and 5.3 codex I've been running them in parallel and I've been let down by Opus 4.6 with maximum thinking way more than I've been let down with OpenAI models.

In fact I'm more and more inclined to run my own benchmarks from now on, because I seriously distrust those I see online.

Even if the benchmarks are indeed valid, they just don't reflect my use cases, usages and ability to navigate my projects and my dependencies.

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#142

Post by anonzzzies »

sunaurus wrote: post #134
aweb wrote: post #106

Earlier quoted context omitted.

I'm surprised, isn't it forbidden to use the Max plan as part of a company? Just curious, as I thought it was forbidden by the ToS but I'm not sure if I have a good understanding of it

Surely that can't be true? The expectation would be that people pay $200 a month for building open source and personal hobby software with Claude?

Yeah, that would end that really quickly. I use Pro for personal stuff. If $200 is not allowed for companies I don't think anyone would use it, at all.

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#143

Post by bandrami »

aurareturn wrote: post #108
bandrami wrote: post #61

Earlier quoted context omitted.

Weird that they're all looking for outside money then

Inference is profitable. No one is selling at a loss. It’s training to keep up with competitors that is causing losses.

> Inference is profitable

Eh. We don't really know that, and the people saying that have an interest in the rest of the world believing it's true.

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#144

Post by anonzzzies »

ffsm8 wrote: post #133
aweb wrote: post #106

Earlier quoted context omitted.

I'm surprised, isn't it forbidden to use the Max plan as part of a company? Just curious, as I thought it was forbidden by the ToS but I'm not sure if I have a good understanding of it

There is nothing in the TOS last time I checked forbidding it's use with Claude code. It's only forbidden to utilize it in the running of the business. So getting Claude code subscriptions for developers should be permissable and not be against anything... However, if you created a rest endpoint to eg run a preconfigured prompt as part of your platform, that'd be against it But I'm neither a lawyer nor work for anthr…

Ah, that makes sense. I hope they mean that then. We are just devs using it to write code; not selling it on.

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#145

Post by eru »

himata4113 wrote: post #90
eru wrote: post #88

Earlier quoted context omitted.

They can run any number of inference experiments. Like a lot of the alignment work they have going on. I am not saying this would be a great use of their compute, but idle is far from the only alternative. (Unless electricity is the binding constraint?)

Electricity is charged whenever you use it or not, so very unlikely, but sure, they can find uses for it. Although they are not going to make that much money compared to claude code subscriptions.

> Electricity is charged whenever you use it or not, [...]

Huh, what? You know you can turn off unused equipment, and at least my nvidia GPU can use more or less Watts even when turned on?

Or does Anthropic have a flatline deal for electricity and cooling?

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#146

Post by jdjfnfndn »

aurareturn wrote: post #27

By the way, one of the charts in the article shows that Opus 4.6 is 10x costlier than Kimi K2.5. I thought there was no moat in AI? Even being 10x costlier, Anthropic still doesn't have enough compute to meet demand. Those "AI has no moat" opinions are going to be so wrong so soon.

[dead]

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#147

Post by [deleted] »

codemog wrote: post #115
scandox wrote: post #93

Earlier quoted context omitted.

I'm fascinated to know the kind of work that allows you to intelligently allocate so much resources. I use Claude extensively and feel that I great value out of it but I reach a limit in terms of what I can do that makes sense relatively quickly it seems.

[flagged]

[deleted]

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#148

Post by fc417fc802 »

jychang wrote: post #102
fc417fc802 wrote: post #96

Earlier quoted context omitted.

> In practice, tps is a reflection of vram memory bandwidth during inference. > Comparing tps ratios- by saying a model is roughly 2x faster or slower than another model- can tell you a lot about the active param count. You sure about that? I thought you could shard between GPUs along layer boundaries during inference (but not training obviously). You just end up with an increasingly deep pipeline. So time to first t…

That doesn't work. Think about it a bit more. Hint: what's in the kv cache when you start processing the 2nd token? And that's called layer parallelism (as opposed to tensor parallelism). It allows you to run larger models (pooling vram across gpus) but does not allow you to run models faster. Tensor parallelism DOES allow you to run models faster across multiple GPUs, but you're limited to how fast you can synchroni…

Oh I see. I went and confused total aggregate throughput with per-query throughput there didn't I.

Re: No, it doesn't cost Anthropic $5k per Claude Code user

#149

Post by fennecfoxy »

re-thc wrote: post #99
jychang wrote: post #52

Earlier quoted context omitted.

That's a tautology. People think chinese models are 10x more efficient because they're 10x cheaper, and then you use that to claim that they're 10x more efficient. Opus isn't that expensive to host. Look at Amazon Bedrock's t/s numbers for Opus 4.5 vs other chinese models. They're around the same order of magnitude- which means that Opus has roughly the same amount of active params as the chinese models. Also, you ca…

> That's a tautology. People think chinese models are 10x more efficient because they're 10x cheaper They do have different infrastructure / electricity costs and they might not run on nvidia hardware. It's not just the models.

I mean GN has covered the Nvidia black market in China enough that we pretty much know that they run on Nvidia hardware still.
Post reply on HN