Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic is expanding to Colossus2. Will use GB200

twitter.com

Post reply on HN
Print view View original

241–250 of 367 posts

Re: Anthropic is expanding to Colossus2. Will use GB200

#241

Post by 4qashG »

vessenes wrote: post #234
nikcub wrote: post #21

Earlier quoted context omitted.

Anthropic this quarter will have revenue of $10.9B, up from $4.8B last quarter[0]. They're paying SpaceX $1.25B per month for compute[1] - which is more than what SpaceX earn on space. SpaceX spent about $30-40B in capex on Colossus 1 & 2. This is all real revenue, real spend, real usage. Hetzner just aren't at this scale. Not even close. If they wanted to get into this business - first, they're late. Second, it's at…

Thank you. It’s arguably even more tiring to hunt it down on HN, and often thankless.

"I'm an investor, the founder of new alchemy, co-founder Lamina1, former CEO of coinlab.com, Chairman of the Bitcoin Foundation, Ethereum security researcher, holder of patent 9298806, general nerd. Currently working at Capital6, my private equity fund."

You poor misunderstood Bitcoin booster! Now you have to deal with AI critics! How about getting a real job?

Re: Anthropic is expanding to Colossus2. Will use GB200

#242

Post by hackinthebochs »

watwut wrote: post #211
hackinthebochs wrote: post #157

Earlier quoted context omitted.

For conversational or general knowledge questions I also much prefer Grok. Musk's vanity aside, it is much less censored than the other frontier models.

Where less censored means "censors facts and left leaning claims while actively promoting far-right lies".

Far more mundane that whatever bogeyman you imagine, it will discuss things like COVID origins or not treat favored classes as a special case e.g. when asked to make a joke.

Re: Anthropic is expanding to Colossus2. Will use GB200

#243

Post by tfgg »

jbs789 wrote: post #220
shenberg wrote: post #165

Earlier quoted context omitted.

11% MFU does not mean 89% of GPUs are idle, it means that they're using the GPUs ineffectively.

The post you’re referring to doesn’t even include “89%” or “idle”. I’m not sure I understand the point you’re making then rebutting.

The original post of 11% is referring to leaked numbers about _MFU_, which has erroneously been re-reported as fraction of GPUs being used at all. The parent post is trying to correct this misconception.

Re: Anthropic is expanding to Colossus2. Will use GB200

#244

Post by HarHarVeryFunny »

alienreborn wrote: post #13

Why is xAI giving up their advantage? Is this a signal that their frontier model improvements are plateauing and decided there is no value in hoarding all their compute?

Musk's goal with X.ai from the start seems to have been primarily to compete with OpenAI, and given that Grok itself isn't doing that (not even mentioned in competitive benchmark tables), and his data centers are therefore mostly sitting idle, this deal with Anthropic helps him achieve that goal by helping OpenAI's #1 competitor.

Note how the initial deal was only for the older Colossus #1 data center, and now after losing his lawsuit against OpenAI the Anthropic deal has been expanded to Colossus #2 also. Coincidence?

Re: Anthropic is expanding to Colossus2. Will use GB200

#245

Post by [deleted] »

rdtsc wrote: post #215
Kelteseth wrote: post #155

Earlier quoted context omitted.

So for a guy that literally has a company that produces batteries and solar panels, choose to use gas turbines. So much for saving the planet.

> So for a guy that literally has a company that produces batteries and solar panels, choose to use gas turbines “Sorry, we have to shut down your database because it’s been overcast for the last two days” Now, they could have a mix, of course, but just running on solar and batteries at that power is not realistic.

[deleted]

Re: Anthropic is expanding to Colossus2. Will use GB200

#246

Post by signatoremo »

ChicagoDave wrote: post #125

Sigh. I’d hoped Anthropic would steer clear of blatantly unethical practices but here they go in bed with that guy and his horribly damaging data center.

I suppose you're also using Chinese models, who all have to be at the behest of the Communist party. China also have "horribly damaging" coal power plants. Do they acquire training data ethically? Do they censor? Be honest with yourself. Your concerns have nothing to do with ethic.

Re: Anthropic is expanding to Colossus2. Will use GB200

#247

Post by cbm-vic-20 »

Glohrischi wrote: post #212
urams wrote: post #20

Very possible Elon is doing this to make give Anthropic better chances against OAI while he attempts to reshape xAI. Also possible he sees infra as the future of xAI if he really believes in the value of space compute. Hard to see this any of this as anything other than a bearish sign for Grok though.

That would be absolutly ludicris. His own product is competing against anthropic.

It's a money maker. Maybe not a number one spot, but they don't have to stand up any more datacenters.

Re: Anthropic is expanding to Colossus2. Will use GB200

#248

Post by sjsdaiuasgdia »

renticulous wrote: post #196
tristanj wrote: post #191

Earlier quoted context omitted.

They tried and failed. xAi made a mistake building Colossus 1 and ended up with heterogenous cluster of H100/H200/GB200 GPUs. This is a nightmare to train huge models on because each card has different specs, features, and hardware requirements. During gradient synchronization, a heterogeneous cluster would bottleneck on the slowest GPU (H100) so the faster GPUs would end up idling. They also probably ran into unexpe…

How can something so obvious be overlooked by team building the data centre? Can't the sharding be uneven so that weaker GPUs still finish fast by taking on a smaller workload?

I imagine it involved a petulant billionaire screaming "Fucking build it. Build it NOW!" in response to expert feedback.

Re: Anthropic is expanding to Colossus2. Will use GB200

#249

Post by jatora »

giancarlostoro wrote: post #133
virgildotcodes wrote: post #52

Here's a probably stupid question - if someone were unbounded by ethics and conceivably had enough power and connections to power to shield themselves from many consequences of their actions - and that person owned these DCs, could they in theory observe all the streams of tokens coming in and out of these models, and even exfiltrate copies of these models wholesale to have their own teams do what they will with them…

You could, but Grok is pretty high up there, it might not be "#1" but its definitely up there with the giants, people seem to overlook it. Gemini has a similar problem, it was #1 once, and it seems like Google isn't hell bent on chasing #1 they just want to keep iterating over time, they know they just need it to be "good enough" and they'll keep having repeat customers. If Elon REALLY wanted to do anything like that…

No Grok is not 'up there'. Not by any stretch of the imagination is it anywhere close to anthropic or openai in any single domain whatsoever. Not even close to deepseek. It really isnt a good model. Their research team's talent is just not good, unfortunately.

Re: Anthropic is expanding to Colossus2. Will use GB200

#250

Post by ACCount37 »

aurareturn wrote: post #237
ACCount37 wrote: post #226

Earlier quoted context omitted.

Matmuls need access to decrypted weights to do their work. Which means that getting the full weights out isn't even an "if" - it's "how much effort". The encryption wouldn't do much more than a gentleman's agreement would. The only real move for Anthropic there is to outline contract penalties for letting weights get leaked, and never give less trusted external inference providers access to cutting edge system weight…

That would require hacking Nvidia's GPUs/racks to extract the weights. The weights are encrypted, sent to the GPU/rack encrypted. When it does inference, it will use decrypted weights but there is no way to get those weights unless you find a way to exploit Nvidia's GPU security. Do you think OpenAI would send CoreWeave their GPT 5.5 Pro weights if an admin employee at CoreWeave can access the full weights unencrypte…

It would require exactly that. A bit more involved than "scp that big file", yes. But you make a mistake by treating it as a hard blocker.

Like I said: it's a gentleman's agreement. If Musk said "I want Opus 4.7 weights", and those weights were on Colossus 1 hardware, he'd have those weights on his desktop, unencrypted, within a couple of weeks.

There's also the side channel line, because having inference on your hardware typically allows you to do things like snoop into KV cache and peek at per-layer, or even per-expert, residuals. Which allows for some very advanced distillation attacks. Might be easier/more deniable to pull that off than dumping full weights, in some circumstances.

Post reply on HN