Earlier quoted context omitted.
I reevaluated my priors long ago when I saw that scaling laws show no sign of stopping, no sign of plateau. Strangely some people on HN seem to desperately cling to the notion that it's all going to come to a halt. This is unscientific. What evidence do you have - any evidence - that the scaling laws are due to come to an end?
I suspect it's not that people do not see the progress, they fail to fully trust laws not truly backed by physics like the transistor laws. We empirically see that scaling works and continue to work.
Anthropic expands partnership with Google and Broadcom for next-gen compute
81–90 of 139 posts
Re: Anthropic expands partnership with Google and Broadcom for next-gen compute
#82Can someone explain why everything is being marketed in terms of power consumption?
Some of it might be market-signaling to the broader energy industry: "hey would you PLEASE build more power plants and power lines? Look at all this money we have, we will pay for it!"
Re: Anthropic expands partnership with Google and Broadcom for next-gen compute
#83Can someone explain why everything is being marketed in terms of power consumption?
Maybe it's just because the specifics on FLOPs are more complicated, especially given how many different floating point formats are floating around in ML. Even NVIDIA has like 6 different FLOPs numbers on their GPUs nowadays.
Re: Anthropic expands partnership with Google and Broadcom for next-gen compute
#84Earlier quoted context omitted.
> but the published data immediately seems to admit that this is a bad choice of unit because it costs a lot more to output a token than input one And, that's silly, because API pricing is more expensive for output than input tokens, 5x so for Anthropic [1], and 6x so for OpenAI! [1] https://platform.claude.com/docs/en/about-claude/pricing [2] https://openai.com/api/pricing
I think for the same model wall time is probably a more intuitive metric; at the end of the day what you’re doing is renting GPU time slices. Large outputs dominate compute time so are more expensive. IMO input and output token counts are actually still a bad metric since they linearise non linear cost increases and I suspect we’ll see another change in the future where they bucket by context length. XL output contex…
They already bucket when context goes above 200k
Re: Anthropic expands partnership with Google and Broadcom for next-gen compute
#85$19B -> $30B annualized revenue in a month ? Feels like the lede is buried here!
All of big tech (except Google obviously) is pushing hard for Claude Code internally. I’m talking “you all have unlimited tokens and we’re going to have a leaderboard of who used the most” kind of push.
"we’re going to have a leaderboard of who used the most"
Yeah I've seen stuff like that and it's a bit bewildering for me. Feels a bit like AWS is new and we're competing to see who can deploy the most EC2 instances.
Re: Anthropic expands partnership with Google and Broadcom for next-gen compute
#86Earlier quoted context omitted.
AFAIK the data does not need to be text.
Well diffusers are trained unsupervised on raw pictures. I don't know how they train multi-modal LLMs on images, but yes obviously they are consuming other media than just text. I don't think, but would be happy to be corrected, that models glean much of their "knowledge" from non-textual training data.
you couldnt be more wrong
Re: Anthropic expands partnership with Google and Broadcom for next-gen compute
#87I don’t understand Claude Code’s moat here. What can it do that opencode can’t or couldn’t fairly easily implement?
Re: Anthropic expands partnership with Google and Broadcom for next-gen compute
#88I don’t understand Claude Code’s moat here. What can it do that opencode can’t or couldn’t fairly easily implement?
The moat is in:
1. Opus and Sonnet.
2. Compute capacity. Anthropic has much more of it than your average coding startup.
3. The developing ecosystem around Claude Code.
Re: Anthropic expands partnership with Google and Broadcom for next-gen compute
#89I don’t understand Claude Code’s moat here. What can it do that opencode can’t or couldn’t fairly easily implement?
The moat is in: 1. Opus and Sonnet. 2. Compute capacity. Anthropic has much more of it than your average coding startup. 3. The developing ecosystem around Claude Code.
none of the three are even remote moat
Re: Anthropic expands partnership with Google and Broadcom for next-gen compute
#90Earlier quoted context omitted.
The numbers are certainly audited by their investors. Anthropic isn't foreign to PR talk, but investors know what to look for in their book. They aren't stupid unlike how they are viewed on HN. There are more investment money than Anthropic need. They can pick and choose.
"The numbers are certainly audited by their investors." Hahaha. Mate nobody cares about that nor trusts it. Everyone is waiting in anticipation for the S-1 filing.
I do, and I do trust the numbers. I doubt Anthropic is pursuing fraud given that they already don't have enough compute to serve demand. What is the point of lying to the public, investors and risk going to jail?