Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic is expanding to Colossus2. Will use GB200

twitter.com

Post reply on HN
Print view View original

231–240 of 367 posts

Re: Anthropic is expanding to Colossus2. Will use GB200

#231

Post by vessenes »

Lucasoato wrote: post #175

Ok, maybe this question is a bit silly, but could it possibly be that Elon is doing this to steal Anthropic models secrets and using them to improve Grok?

Love the curiosity. I recommend you spend that curiosity on figuring out why both companies are in the situation they are that this deal is a win-win: Elon has provided a masterclass in public company launch and management over the last 15 years. (And in recent years done it amidst an incredibly divisive reputational environment).

Put another way - they could maybe try to do this. But it would be worth literally nothing compared to the actual benefits to SX of this deal. And add an immense amount of risk. There’s much more clever and interesting things to do.

Re: Anthropic is expanding to Colossus2. Will use GB200

#232

Post by petesergeant »

ayende wrote: post #221
petesergeant wrote: post #174

Earlier quoted context omitted.

> will pay for all of xAI's capex ($25 billion) in 2 years This is a confusing framing; you pay down capex with profit not revenue, and there is presumably a high opex cost.

Nevertheless, you are still talking about 15B / year - when the initial investment was So you are still covering all of that.

> That investment also probably covers things like power, salaries, etc.

That does not seem probable to me, other than for the initial build-out.

Re: Anthropic is expanding to Colossus2. Will use GB200

#233

Post by vessenes »

labrador wrote: post #69

Musk said Anthropic Claude was woke DEI until he said it wasn't. It must be hard for Musk fans to keep up.

I mean … they’re mostly sitting on their SpaceX stock and rubbing their hands gleefully. What do they have to keep up with?

Disclosure: former (small) SX investor.

Re: Anthropic is expanding to Colossus2. Will use GB200

#234

Post by vessenes »

nikcub wrote: post #21
123aad wrote: post #11

Earlier quoted context omitted.

Fake __AI__ revenue. Maybe Hetzner should build Colossus4, rent it out and book it as AI revenue instead of hardware rental revenue and get a P/E of 100.

Anthropic this quarter will have revenue of $10.9B, up from $4.8B last quarter[0]. They're paying SpaceX $1.25B per month for compute[1] - which is more than what SpaceX earn on space. SpaceX spent about $30-40B in capex on Colossus 1 & 2. This is all real revenue, real spend, real usage. Hetzner just aren't at this scale. Not even close. If they wanted to get into this business - first, they're late. Second, it's at…

Thank you. It’s arguably even more tiring to hunt it down on HN, and often thankless.

Re: Anthropic is expanding to Colossus2. Will use GB200

#235

Post by fooster »

burnerRhodov3 wrote: post #177
oezi wrote: post #137

Earlier quoted context omitted.

Yes, quite a bad reputation hit for Anthropic to get in bed with Musk. Tesla lost half its marketshare in Europe because Elon is meddling in our democracy, is promoting right wing populist parties and supporting Trump in general.

Europe has a hugely shrinking demographic, and is actively decoupling from the United States. There's almost no innovation and you are making the mistake of getting in bed with China and constantly suing our tech companies. Europe needs to focus more on Europe and less US politics.

This might have something to do with the US president threatening to attack Greenland? Decoupling from the US is the only sane thing to do.

Re: Anthropic is expanding to Colossus2. Will use GB200

#236

Post by HarHarVeryFunny »

virgildotcodes wrote: post #52

Here's a probably stupid question - if someone were unbounded by ethics and conceivably had enough power and connections to power to shield themselves from many consequences of their actions - and that person owned these DCs, could they in theory observe all the streams of tokens coming in and out of these models, and even exfiltrate copies of these models wholesale to have their own teams do what they will with them…

Bear in mind these data centers were built for X.ai to use themselves, so there would have been no reason to backdoor them. Also, this is all off-the shelf equipment: Dell & Supermicro servers with NVidia compute modules and ethernet switches.

Re: Anthropic is expanding to Colossus2. Will use GB200

#237

Post by aurareturn »

ACCount37 wrote: post #226
aurareturn wrote: post #218

Earlier quoted context omitted.

The whole system has encryption all the way through. Otherwise, OpenAI/Anthropic would never use external clouds since the weights are some of the most valuable assets in the world.

Matmuls need access to decrypted weights to do their work. Which means that getting the full weights out isn't even an "if" - it's "how much effort". The encryption wouldn't do much more than a gentleman's agreement would. The only real move for Anthropic there is to outline contract penalties for letting weights get leaked, and never give less trusted external inference providers access to cutting edge system weight…

That would require hacking Nvidia's GPUs/racks to extract the weights. The weights are encrypted, sent to the GPU/rack encrypted. When it does inference, it will use decrypted weights but there is no way to get those weights unless you find a way to exploit Nvidia's GPU security.

Do you think OpenAI would send CoreWeave their GPT 5.5 Pro weights if an admin employee at CoreWeave can access the full weights unencrypted? Of course not.

Re: Anthropic is expanding to Colossus2. Will use GB200

#238

Post by m4rtink »

redox99 wrote: post #44
gaze wrote: post #18

I think that's the datacenter with the gas turbine generators that operate without permits because they're "portable." Data centers have tremendous externalities but colossus is a particularly nasty offender, and not just due its size. Edit: They did it with Colossus and now they're doing the exact same thing with Colossus2. https://www.selc.org/news/xai-built-an-illegal-power-plant-t...

What's the tremendous externality of gas generators? People heat their own homes with natural gas and it's no big deal. How can a datacenter that is miles away be worse than that?

Its totally inefficient - burning the same gas in a co-generation plant, ideally combined with district heating, would produce the same amount of pollution and basically make use of all the energy.

Re: Anthropic is expanding to Colossus2. Will use GB200

#239

Post by aurareturn »

davedx wrote: post #202
aurareturn wrote: post #188

Earlier quoted context omitted.

Pretty sure models are encrypted all the way.

Dude, Chinese labs distil attack via the APIs , if Musk wanted to do something like that, technically he could. Legally it would be a giant slam dunk liability though

Distilling is different from "siphoning the model weights". I would think that Anthropic has a system for this. After all, they deploy to different clouds already. Their weights are worth billions, I presume that they take security very seriously and have done a lot of homework to trust no one.

Re: Anthropic is expanding to Colossus2. Will use GB200

#240

Post by brianwawok »

ruszki wrote: post #162
akimbostrawman wrote: post #139

Earlier quoted context omitted.

Opposed to all other models being the bastion of objectivity? Must be truly vindicating to have to hear other peoles opinions after decades in the silicon valley bubble.

There is a difference between when somebody openly instructs their model to infer disproven lies vs who doesn’t do this. And it’s quite tiring that this is even a question because of politics. As somebody from Hungary: the biggest impact of my mood was that this kind of thinking went back with the collapse of far right there to where it belongs: to a deep hole which is not in front of normal people. Average people su…

Qwen has post training to tell you incorrect answers about Taiwan. Seems worse to me
Post reply on HN