Earlier quoted context omitted.
That's very doubtful given recent news that Colossus is running at 11% capacity and has hundreds of thousands of idle GPUs. xAI acquired too many GPUs and currently doesn't have enough customers to use them. That's why they are making compute deals with Anthropic and Cursor. xAI is bleeding money and this compute deal with Anthropic will pay for all of xAI's capex ($25 billion) in 2 years.
> will pay for all of xAI's capex ($25 billion) in 2 years This is a confusing framing; you pay down capex with profit not revenue, and there is presumably a high opex cost.
Anthropic is expanding to Colossus2. Will use GB200
221–230 of 367 posts
Re: Anthropic is expanding to Colossus2. Will use GB200
#222Earlier quoted context omitted.
That's very doubtful given recent news that Colossus is running at 11% capacity and has hundreds of thousands of idle GPUs. xAI acquired too many GPUs and currently doesn't have enough customers to use them. That's why they are making compute deals with Anthropic and Cursor. xAI is bleeding money and this compute deal with Anthropic will pay for all of xAI's capex ($25 billion) in 2 years.
11% MFU does not mean 89% of GPUs are idle, it means that they're using the GPUs ineffectively.
Re: Anthropic is expanding to Colossus2. Will use GB200
#223Earlier quoted context omitted.
I believe that was in the original script, and rewritten after some exec didn't understand how brains could be computers.
If it was indeed the original script, the reason they changed to batteries is maybe not because "some exec" is an idiot, but because it worked better from a storytelling perspective. Even if treating people as batteries doesn't make much sense as we are pretty terrible power plants, the message is clear and impactful. It is common for movies to oversimplify things, because they want to avoid having the viewer from be…
Re: Anthropic is expanding to Colossus2. Will use GB200
#224Earlier quoted context omitted.
This comment is very similar to what russian propaganda does. It's not aimed at convincing you to support them, but to convince you everyone is lying and there is no meaningful difference between each position, so you stay apathetic.
Yeah yeah every opinion you don't share or like is a russian bot or literally hitler.
Re: Anthropic is expanding to Colossus2. Will use GB200
#225Earlier quoted context omitted.
That's very doubtful given recent news that Colossus is running at 11% capacity and has hundreds of thousands of idle GPUs. xAI acquired too many GPUs and currently doesn't have enough customers to use them. That's why they are making compute deals with Anthropic and Cursor. xAI is bleeding money and this compute deal with Anthropic will pay for all of xAI's capex ($25 billion) in 2 years.
11% MFU does not mean 89% of GPUs are idle, it means that they're using the GPUs ineffectively.
Re: Anthropic is expanding to Colossus2. Will use GB200
#226Earlier quoted context omitted.
Can't run inference on encrypted weights and get any kind of performance out of it.
The whole system has encryption all the way through. Otherwise, OpenAI/Anthropic would never use external clouds since the weights are some of the most valuable assets in the world.
Which means that getting the full weights out isn't even an "if" - it's "how much effort". The encryption wouldn't do much more than a gentleman's agreement would.
The only real move for Anthropic there is to outline contract penalties for letting weights get leaked, and never give less trusted external inference providers access to cutting edge system weights.
Exposure is limited either way. Opus 4.7 weights are a deprecating asset - it's bleeding edge today, very valuable now, but it'll lose a lot of its value the moment Opus 5.0 drops.
Re: Anthropic is expanding to Colossus2. Will use GB200
#227Why is xAI giving up their advantage? Is this a signal that their frontier model improvements are plateauing and decided there is no value in hoarding all their compute?
Elon got rid of most of the core xAI researchers recently. It looked like firings and he said something like Grok needs to be rewritten because it was fundamentally built in a bad way. My guess - Grok was not one of the top two models and had no traction beyond users on Twitter - so investing in it did not make sense. Or maybe he needs time to build a new team and rebuild Grok, and while he’s doing that, he needs rev…
Make no mistake - Elon’s charging premium pricing because he has something Anthropic realllly needs. In exchange, he will get significant revenues added to the balance sheet along with the cursor team right around IPO. It’s very good business for Elon and SpaceX.
Re: Anthropic is expanding to Colossus2. Will use GB200
#228Earlier quoted context omitted.
I basically open up a new conversation, copy paste a link to Theo's latest video and ask it to summarize his yapping :p
I copy paste the transcript because sometimes youtube has blocked AIs from scrapping
Re: Anthropic is expanding to Colossus2. Will use GB200
#229Earlier quoted context omitted.
I think they overestimated the demand for Grok, which is mostly useless, and now they have too much compute on hand.
I see this as a huge warning sign. If a frontier ai lab is in this position of renting their own capacity, imagine how much overcapacity there is in the system. Outside of VC money, and circular financing, the only external money coming into ai are into open-ai, and anthropic via their subscriptions and APIs.
Re: Anthropic is expanding to Colossus2. Will use GB200
#230I think that's the datacenter with the gas turbine generators that operate without permits because they're "portable." Data centers have tremendous externalities but colossus is a particularly nasty offender, and not just due its size. Edit: They did it with Colossus and now they're doing the exact same thing with Colossus2. https://www.selc.org/news/xai-built-an-illegal-power-plant-t...
The newer location is about 3 miles southwest of the Memphis Airport (MEM), one of the world’s largest cargo airports and the center of FedEx operations (500 take-off and landings per day most concentrated in a 6 h FedEx window with lots of engines running on ramps and that produces about 2000 tons of NOx per year). I live about 18 miles downwind of the new Colossus sites, the airport, and lots of truck logistics sit…