Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic is expanding to Colossus2. Will use GB200

twitter.com

Post reply on HN
Print view View original

321–330 of 367 posts

Re: Anthropic is expanding to Colossus2. Will use GB200

#321

Post by giancarlostoro »

urams wrote: post #20

Very possible Elon is doing this to make give Anthropic better chances against OAI while he attempts to reshape xAI. Also possible he sees infra as the future of xAI if he really believes in the value of space compute. Hard to see this any of this as anything other than a bearish sign for Grok though.

I think its a mix of both of your first two points. He has hinted that he will be producing chips for Tesla and SpaceX here in the US in the future, so there will be a time where Elon will have every critical component we need for Tesla and SpaceX here in the US and not overseas, and fully in-house. Once he does this, nothing stops him from selling components. He's also insanely efficient at standing up data centers, so I would not be surprised if he gets enlisted by someone like Anthropic to setup infrastructure for him.

Re: Anthropic is expanding to Colossus2. Will use GB200

#322

Post by redox99 »

ben_w wrote: post #142
redox99 wrote: post #74

Earlier quoted context omitted.

I wouldn't call noise pollution a "tremendous externality". The gas turbines should just be placed far enough from where people live.

Should, but in fact are too close.

It's not a tremendous externality. It only affects a very small group that lives nearby.

A tremendous externality was leaded gas that was everywhere.

Re: Anthropic is expanding to Colossus2. Will use GB200

#323

Post by [deleted] »

virgildotcodes wrote: post #52

Here's a probably stupid question - if someone were unbounded by ethics and conceivably had enough power and connections to power to shield themselves from many consequences of their actions - and that person owned these DCs, could they in theory observe all the streams of tokens coming in and out of these models, and even exfiltrate copies of these models wholesale to have their own teams do what they will with them…

[deleted]

Re: Anthropic is expanding to Colossus2. Will use GB200

#324

Post by killerstorm »

HarHarVeryFunny wrote: post #236
virgildotcodes wrote: post #52

Here's a probably stupid question - if someone were unbounded by ethics and conceivably had enough power and connections to power to shield themselves from many consequences of their actions - and that person owned these DCs, could they in theory observe all the streams of tokens coming in and out of these models, and even exfiltrate copies of these models wholesale to have their own teams do what they will with them…

Bear in mind these data centers were built for X.ai to use themselves, so there would have been no reason to backdoor them. Also, this is all off-the shelf equipment: Dell & Supermicro servers with NVidia compute modules and ethernet switches.

The fact that X.ai build it for themselves means that they are in full control. It's not challenging to install a rootkit on hardware under your control. Also if traffic within the datacenter is unencrypted, you can probably get copy of all comms via switches.

It's generally far easier to install spying software under a computer under your control than to detect it.

Re: Anthropic is expanding to Colossus2. Will use GB200

#325

Post by andriy_koval »

tristanj wrote: post #89
urams wrote: post #20

Very possible Elon is doing this to make give Anthropic better chances against OAI while he attempts to reshape xAI. Also possible he sees infra as the future of xAI if he really believes in the value of space compute. Hard to see this any of this as anything other than a bearish sign for Grok though.

That's very doubtful given recent news that Colossus is running at 11% capacity and has hundreds of thousands of idle GPUs. xAI acquired too many GPUs and currently doesn't have enough customers to use them. That's why they are making compute deals with Anthropic and Cursor. xAI is bleeding money and this compute deal with Anthropic will pay for all of xAI's capex ($25 billion) in 2 years.

> xAI is bleeding money and this compute deal with Anthropic will pay for all of xAI's capex ($25 billion) in 2 years.

minus maintenance and energy cost.

Re: Anthropic is expanding to Colossus2. Will use GB200

#326

Post by __MatrixMan__ »

virgildotcodes wrote: post #52

Here's a probably stupid question - if someone were unbounded by ethics and conceivably had enough power and connections to power to shield themselves from many consequences of their actions - and that person owned these DCs, could they in theory observe all the streams of tokens coming in and out of these models, and even exfiltrate copies of these models wholesale to have their own teams do what they will with them…

Given Musk's previous antics, this strikes me as a relevant line of reasoning.

How do you trust space infra? You can't show up and audit some kind of airgap. Whatever encryption keys you have are likely accessible in memory sometime.

Re: Anthropic is expanding to Colossus2. Will use GB200

#327

Post by lavezzi »

stevefan1999 wrote: post #184

Aren't Anthropic afraid of Elon siphoning the model weights out from the network buses?

Concern maybe elsewhere, but I like how we have gone full circle.

SpaceX expects to complete its $60 billion acquisition of AI coding startup Cursor roughly 30 days after it begins trading publicly, according to Bloomberg.

Cursor's Composer 2 model was built on Kimi K2.5, who were in turn accused of 'distillation' attacks by Anthropic.

Anthropic now relies on SpaceX for compute demands.

Re: Anthropic is expanding to Colossus2. Will use GB200

#328

Post by sulam »

jpadkins wrote: post #298
sulam wrote: post #294

Earlier quoted context omitted.

Tl;dr — but it’s too heavy You’re making some decent points here, but you’re either forgetting or ignoring the major thing that people usually neglect to mention when they want to make a case for this (crazy) idea — weight. Unless SpaceX is going to completely redesign hardware such that it is optimized entirely for its mass, it requires many ( many ) launches to even get a small set of racks into space. I don’t norm…

Have you calculated the CO2 output of Terran datacenters run on natural gas vs. space datacenters run on solar? The launch CO2 usage is one time, the datacenter energy is for the life of the equipment.

A Falcony Heavy probably generates 1 kiloton of CO2 per launch. Data centers on the planet are highly variable depending on their energy mix. It's true that a large a datacenter running on natural gas or coal power is significantly more in a year, but the sheer number of launches required to get that same data center into space is actually comparable, and there's no saying that this is the end of it. Oh and we should also have questions about how you safely de-orbit these things.

Re: Anthropic is expanding to Colossus2. Will use GB200

#329

Post by irq-1 »

jtr1 wrote: post #295
_heimdall wrote: post #201

Earlier quoted context omitted.

Solar and batteries are a bad choice for a constant 24/7 load. That's the exact reason we will never go fully solar (or wind) unless an insanely impressive battery breakthrough makes storage effectively free while using only common, renewable components rather than rare earths. Solar, wind, etc are excellent parts of an energy system, but its nearly impossible to cover base load at scale with generation that may only…

You may want to update your priors [1][2][3] 1. https://www.carbonbrief.org/guest-post-how-solar-panels-and-... 2. https://www.fastcompany.com/91500104/google-minnesota-data-c... 3. https://www.rootsanalysis.com/sodium-ion-battery-market

https://www.fastcompany.com/91500104/google-minnesota-data-c...

> The new plant in Minnesota will be big enough to deliver 300 megawatts of power and store an enormous 30 gigawatt-hours of energy, making it the largest battery by capacity that’s been announced so far. By comparison, that’s more storage than all of the battery projects built in the U.S. in 2024 added together.

Re: Anthropic is expanding to Colossus2. Will use GB200

#330

Post by lovich »

tristanj wrote: post #263
47282847 wrote: post #190

Earlier quoted context omitted.

> The US has a robust corporate legal system Thanks for the chuckle. ;)

It's an accurate statement. The US (specifically Delaware) has a world-class corporate law system. Delaware has a court dedicated to only corporate and commercial disputes, with 200+ years of case law.

Man, good thing no one’s ever done something like reincorporate Tesla and SpaceX in Texas after loosing a court case in said Delaware court and having a pissy fit about it.
Post reply on HN