Live data from Hacker News

Anthropic is expanding to Colossus2. Will use GB200

twitter.com

221–230 of 367 posts

Re: Anthropic is expanding to Colossus2. Will use GB200

#221

Earlier quoted context omitted.

That's very doubtful given recent news that Colossus is running at 11% capacity and has hundreds of thousands of idle GPUs. xAI acquired too many GPUs and currently doesn't have enough customers to use them. That's why they are making compute deals with Anthropic and Cursor. xAI is bleeding money and this compute deal with Anthropic will pay for all of xAI's capex ($25 billion) in 2 years.

> will pay for all of xAI's capex ($25 billion) in 2 years This is a confusing framing; you pay down capex with profit not revenue, and there is presumably a high opex cost.

Nevertheless, you are still talking about 15B / year - when the initial investment was So you are still covering all of that.

Re: Anthropic is expanding to Colossus2. Will use GB200

#222

Earlier quoted context omitted.

That's very doubtful given recent news that Colossus is running at 11% capacity and has hundreds of thousands of idle GPUs. xAI acquired too many GPUs and currently doesn't have enough customers to use them. That's why they are making compute deals with Anthropic and Cursor. xAI is bleeding money and this compute deal with Anthropic will pay for all of xAI's capex ($25 billion) in 2 years.

11% MFU does not mean 89% of GPUs are idle, it means that they're using the GPUs ineffectively.

This might actually be worse from a power costs standpoint.

Re: Anthropic is expanding to Colossus2. Will use GB200

#223
post #173

Earlier quoted context omitted.

I believe that was in the original script, and rewritten after some exec didn't understand how brains could be computers.

If it was indeed the original script, the reason they changed to batteries is maybe not because "some exec" is an idiot, but because it worked better from a storytelling perspective. Even if treating people as batteries doesn't make much sense as we are pretty terrible power plants, the message is clear and impactful. It is common for movies to oversimplify things, because they want to avoid having the viewer from be…

Matrix franchise is well known for not trying to pack in too much complexity /s

Re: Anthropic is expanding to Colossus2. Will use GB200

#224

Earlier quoted context omitted.

This comment is very similar to what russian propaganda does. It's not aimed at convincing you to support them, but to convince you everyone is lying and there is no meaningful difference between each position, so you stay apathetic.

Yeah yeah every opinion you don't share or like is a russian bot or literally hitler.

I see what you did there. Nice.

Re: Anthropic is expanding to Colossus2. Will use GB200

#225

Earlier quoted context omitted.

That's very doubtful given recent news that Colossus is running at 11% capacity and has hundreds of thousands of idle GPUs. xAI acquired too many GPUs and currently doesn't have enough customers to use them. That's why they are making compute deals with Anthropic and Cursor. xAI is bleeding money and this compute deal with Anthropic will pay for all of xAI's capex ($25 billion) in 2 years.

11% MFU does not mean 89% of GPUs are idle, it means that they're using the GPUs ineffectively.

11% capacity is not 11% MFU. The first is about actually using the hardware for something in the first place, the latter is about how efficiently you compute. Different things.

Re: Anthropic is expanding to Colossus2. Will use GB200

#226

Earlier quoted context omitted.

Can't run inference on encrypted weights and get any kind of performance out of it.

The whole system has encryption all the way through. Otherwise, OpenAI/Anthropic would never use external clouds since the weights are some of the most valuable assets in the world.

Matmuls need access to decrypted weights to do their work.

Which means that getting the full weights out isn't even an "if" - it's "how much effort". The encryption wouldn't do much more than a gentleman's agreement would.

The only real move for Anthropic there is to outline contract penalties for letting weights get leaked, and never give less trusted external inference providers access to cutting edge system weights.

Exposure is limited either way. Opus 4.7 weights are a deprecating asset - it's bleeding edge today, very valuable now, but it'll lose a lot of its value the moment Opus 5.0 drops.

Re: Anthropic is expanding to Colossus2. Will use GB200

#227

Why is xAI giving up their advantage? Is this a signal that their frontier model improvements are plateauing and decided there is no value in hoarding all their compute?

Elon got rid of most of the core xAI researchers recently. It looked like firings and he said something like Grok needs to be rewritten because it was fundamentally built in a bad way. My guess - Grok was not one of the top two models and had no traction beyond users on Twitter - so investing in it did not make sense. Or maybe he needs time to build a new team and rebuild Grok, and while he’s doing that, he needs rev…

Boy I’d love to have the sort of ‘no real advantage’ that got me $1.9bn in revenue per month from Anthropic.

Make no mistake - Elon’s charging premium pricing because he has something Anthropic realllly needs. In exchange, he will get significant revenues added to the balance sheet along with the cursor team right around IPO. It’s very good business for Elon and SpaceX.

Re: Anthropic is expanding to Colossus2. Will use GB200

#228
post #192

Earlier quoted context omitted.

I basically open up a new conversation, copy paste a link to Theo's latest video and ask it to summarize his yapping :p

I copy paste the transcript because sometimes youtube has blocked AIs from scrapping

Would YouTube really block Gemini? I thought summarizing (or asking questions about) YouTube videos was one of their advertised features.

Re: Anthropic is expanding to Colossus2. Will use GB200

#229

Earlier quoted context omitted.

I think they overestimated the demand for Grok, which is mostly useless, and now they have too much compute on hand.

I see this as a huge warning sign. If a frontier ai lab is in this position of renting their own capacity, imagine how much overcapacity there is in the system. Outside of VC money, and circular financing, the only external money coming into ai are into open-ai, and anthropic via their subscriptions and APIs.

To the contrary - there’s so much demand that Dario needs Elon’s compute and is willing to pay premium month to month pricing for it.

Re: Anthropic is expanding to Colossus2. Will use GB200

#230
post #18

I think that's the datacenter with the gas turbine generators that operate without permits because they're "portable." Data centers have tremendous externalities but colossus is a particularly nasty offender, and not just due its size. Edit: They did it with Colossus and now they're doing the exact same thing with Colossus2. https://www.selc.org/news/xai-built-an-illegal-power-plant-t...

The newer location is about 3 miles southwest of the Memphis Airport (MEM), one of the world’s largest cargo airports and the center of FedEx operations (500 take-off and landings per day most concentrated in a 6 h FedEx window with lots of engines running on ramps and that produces about 2000 tons of NOx per year). I live about 18 miles downwind of the new Colossus sites, the airport, and lots of truck logistics sit…

Cattle can't choose how to be slaughtered, though.
Post reply on HN