Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic is expanding to Colossus2. Will use GB200

twitter.com

Post reply on HN
Print view View original

81–90 of 367 posts

Re: Anthropic is expanding to Colossus2. Will use GB200

#81

Post by kibibu »

tristanj wrote: post #49
aurareturn wrote: post #2

More signs that xAI might be giving up on the AGI race. xAI let Cursor train a model on Colossus 2, gave the entire Colossus1 to Anthropic, and is now giving compute in Colossus2 to Anthropic as well.

Bad read on the situation. xAI has too much compute and not enough customers using it. They have around half a million GPUs, some of which are stolen from Tesla, running at 11% utilization. xAI predicted more people would be using Grok, but Grok is not a SOTA model & users primarily want to use SOTA models. They have excess capacity and it makes sense to rent out GPUs to other customers while they improve their model…

Grok is also tuned to align with Musk's personal beliefs. I wouldn't touch it with a 10 foot pole.

Re: Anthropic is expanding to Colossus2. Will use GB200

#82

Post by usef- »

Torn wrote: post #57
hemul3n wrote: post #54

Earlier quoted context omitted.

I dug into this topic in some detail on my blog and it's both enraging and depressing. https://poiesic.com/posts/pattern-recognition

This is a really great watch from Benn Jordan on the topic https://www.youtube.com/watch?v=_bP80DEAbuo Some wild things happening with those, and infrasound. Colossus is shown 4 mins in

This was debunked: https://blog.andymasley.com/p/contra-benn-jordan-data-center...

Re: Anthropic is expanding to Colossus2. Will use GB200

#84

Post by monster_truck »

robwwilliams wrote: post #76
gaze wrote: post #18

I think that's the datacenter with the gas turbine generators that operate without permits because they're "portable." Data centers have tremendous externalities but colossus is a particularly nasty offender, and not just due its size. Edit: They did it with Colossus and now they're doing the exact same thing with Colossus2. https://www.selc.org/news/xai-built-an-illegal-power-plant-t...

The newer location is about 3 miles southwest of the Memphis Airport (MEM), one of the world’s largest cargo airports and the center of FedEx operations (500 take-off and landings per day most concentrated in a 6 h FedEx window with lots of engines running on ramps and that produces about 2000 tons of NOx per year). I live about 18 miles downwind of the new Colossus sites, the airport, and lots of truck logistics sit…

Your math is way wrong. The airport is and will be far, far worse. You didn't even mention all of the lead

Re: Anthropic is expanding to Colossus2. Will use GB200

#85

Post by BobbyTables2 »

idle_zealot wrote: post #34
georgemcbay wrote: post #24

Earlier quoted context omitted.

Yup, and now Anthropic is complicit in the environmental damage and health problems for local residents that these data centers are causing. But hey, number must go up, right?

Have you considered that the march of progress requires human blood to grease the gears and mulched skulls to pave the (highly efficient) road? Really, when you take into account all of the future lives this will improve and save it's difficult to claim any cost now is too high. Would you stand in their way and delay the day that Mythos cures cancer? This is a joke. Read it in a mocking tone.

I wonder what percentage of GDP expenditure will give us SkyNet.

Undoubtedly, it will find cures to all cancers… The ARR and stock appreciation will be amazing. Except the cures will be found long after it has wiped out all humans.

Re: Anthropic is expanding to Colossus2. Will use GB200

#86

Post by nelox »

gaze wrote: post #18

I think that's the datacenter with the gas turbine generators that operate without permits because they're "portable." Data centers have tremendous externalities but colossus is a particularly nasty offender, and not just due its size. Edit: They did it with Colossus and now they're doing the exact same thing with Colossus2. https://www.selc.org/news/xai-built-an-illegal-power-plant-t...

xAI’s turbines produce meaningful local/regional pollution (especially NOx in a vulnerable area) but represent a rounding error nationally and globally.

Re: Anthropic is expanding to Colossus2. Will use GB200

#87

Post by HDThoreaun »

hemul3n wrote: post #54
gaze wrote: post #18

I think that's the datacenter with the gas turbine generators that operate without permits because they're "portable." Data centers have tremendous externalities but colossus is a particularly nasty offender, and not just due its size. Edit: They did it with Colossus and now they're doing the exact same thing with Colossus2. https://www.selc.org/news/xai-built-an-illegal-power-plant-t...

I dug into this topic in some detail on my blog and it's both enraging and depressing. https://poiesic.com/posts/pattern-recognition

I dont know, Id say the enraging thing is that the government is so incompetent and unable to expand electricity supply that datacenters are forced into using loopholes to get power the only way they can.

Re: Anthropic is expanding to Colossus2. Will use GB200

#88

Post by usef- »

amazingamazing wrote: post #10

I don't see a scenario where it really makes sense to be a frontier lab long term. Eventually model quality will plateau then you distill and get 90% for 10% or less cost.

This might come down to when you expect plateau to happen. You could have said similar about transistor density many decades ago.

(I'm not denying it could happen next year for all we know. But we simply don't know, and from what I hear from researchers the breadth of ideas we've tried are still small)

Re: Anthropic is expanding to Colossus2. Will use GB200

#89

Post by tristanj »

urams wrote: post #20

Very possible Elon is doing this to make give Anthropic better chances against OAI while he attempts to reshape xAI. Also possible he sees infra as the future of xAI if he really believes in the value of space compute. Hard to see this any of this as anything other than a bearish sign for Grok though.

That's very doubtful given recent news that Colossus is running at 11% capacity and has hundreds of thousands of idle GPUs. xAI acquired too many GPUs and currently doesn't have enough customers to use them. That's why they are making compute deals with Anthropic and Cursor.

xAI is bleeding money and this compute deal with Anthropic will pay for all of xAI's capex ($25 billion) in 2 years.

Re: Anthropic is expanding to Colossus2. Will use GB200

#90

Post by rdgthree »

virgildotcodes wrote: post #52

Here's a probably stupid question - if someone were unbounded by ethics and conceivably had enough power and connections to power to shield themselves from many consequences of their actions - and that person owned these DCs, could they in theory observe all the streams of tokens coming in and out of these models, and even exfiltrate copies of these models wholesale to have their own teams do what they will with them…

xAI had a lot of negotiating power here because Anthropic had ~0 comparable options and ultimately desperately needed the compute now. So, it wouldn't surprise me if data sharing was an explicit part of the agreement
Post reply on HN