Live data from Hacker News

Anthropic expands partnership with Google and Broadcom for next-gen compute

anthropic.com

101–110 of 139 posts

Re: Anthropic expands partnership with Google and Broadcom for next-gen compute

#102
post #99
post #46

Earlier quoted context omitted.

[flagged]

AI being a bubble it's not mutually exclusive of being a real and useful technology and the existence of non-snake oil companies. Cisco was a bubble in the dot com crash, despite being a company that provide real value and profit, just not at the level of the crazy expectations from the time.

I'm literally talking about the fact that Anthropic is making $30B Annual Revenue, which is the result of less than $10B investment two years ago.

The public hasn't seen the insane ROA/ROI on GPUs. So all AI adjacent stocks are massively undervalued.

Re: Anthropic expands partnership with Google and Broadcom for next-gen compute

#103

I guess gigawatts is how we roughly measure computing capacity at the datacenter scale? Also saw something similar here: > Costs and pricing are expressed per “token”, but the published data immediately seems to admit that this is a bad choice of unit because it costs a lot more to output a token than input one. It seems to me that the actual marginal quantity being produced and consumed is “processing power”, which…

Gigawatts seems like more a statement of the power supply and dissipation of the actual facility. I’m assuming you can cram more chips in there if you have more efficient chips to make use of spare capacity? Trying to measure the actual compute is a moving target since you’d be upgrading things over time, whereas the power aspects are probably more fixed by fire code, building size, and utilities.

[deleted]

Re: Anthropic expands partnership with Google and Broadcom for next-gen compute

#104

Earlier quoted context omitted.

Gigawatts seems like more a statement of the power supply and dissipation of the actual facility. I’m assuming you can cram more chips in there if you have more efficient chips to make use of spare capacity? Trying to measure the actual compute is a moving target since you’d be upgrading things over time, whereas the power aspects are probably more fixed by fire code, building size, and utilities.

Measuring data centers in watts is like measuring cars in horsepower. Power isn't a direct measure of performance, but of the primary constraint on performance. When in doubt choose the thermodynamic perspective.

Gigawatts are units of power, gigawatthours are units of energy.

The equivalent of cars would be pricing by how much gas you burned, not horsepower.

Re: Anthropic expands partnership with Google and Broadcom for next-gen compute

#105
post #3

Earlier quoted context omitted.

the question is will we experience resource constraints before we get there? what if the step up to post-scarcity is gated by a compute level just out of our reach?

human ingenuity will solve this

NFTs will solve this

Re: Anthropic expands partnership with Google and Broadcom for next-gen compute

#106
post #102
post #99

Earlier quoted context omitted.

AI being a bubble it's not mutually exclusive of being a real and useful technology and the existence of non-snake oil companies. Cisco was a bubble in the dot com crash, despite being a company that provide real value and profit, just not at the level of the crazy expectations from the time.

I'm literally talking about the fact that Anthropic is making $30B Annual Revenue, which is the result of less than $10B investment two years ago. The public hasn't seen the insane ROA/ROI on GPUs. So all AI adjacent stocks are massively undervalued.

I’m not sure your numbers are accurate, they raised $13bn in funding in September last year. Also do note that a lot of the money is cross-subsidized by Google who is funding the TPUs as an investment, so I wouldn’t be so confident that they are returning money quite yet (though it does seem that Anthropic might make it).

Re: Anthropic expands partnership with Google and Broadcom for next-gen compute

#107
post #22

I’m surprised Anthropic wanted to partner with Broadcom when they have such a negative reputation with antics such as their VMWare acquisition.

Broadcom builds the TPU chip. Google designs it. You can’t avoid partnering with Broadcom if you want TPUs in significant volume .

TSMC builds the TPU chip. Broadcom does the rest of the electronics (motherboard, networking, etc...)

Re: Anthropic expands partnership with Google and Broadcom for next-gen compute

#108
post #107

Earlier quoted context omitted.

Broadcom builds the TPU chip. Google designs it. You can’t avoid partnering with Broadcom if you want TPUs in significant volume .

TSMC builds the TPU chip. Broadcom does the rest of the electronics (motherboard, networking, etc...)

And and Broadcom designs a huge part of the chip. They take Google's (mostly) logical design and providing everything TSMC need to physically make the chip (including imports g IP such as serdes, PLLs, and test).

Re: Anthropic expands partnership with Google and Broadcom for next-gen compute

#109
How is compute shortage to satisfy demand manifested? Obviously they never close sign-ups, so only option is to extended queues? But if demand grows like crazy, then queues should get longer, yet my pro claude plan seems snappy with only occasional retries due to 429.
Post reply on HN