Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic is expanding to Colossus2. Will use GB200

twitter.com

Post reply on HN
Print view View original

131–140 of 367 posts

Re: Anthropic is expanding to Colossus2. Will use GB200

#131

Post by olmo23 »

baq wrote: post #108
amazingamazing wrote: post #10

I don't see a scenario where it really makes sense to be a frontier lab long term. Eventually model quality will plateau then you distill and get 90% for 10% or less cost.

Opus and GPT are so different there’s room for both and I wouldn’t be ignoring Gemini even if it isn’t ahem great at coding, since it’s quite obviously very good otherwise. In the times before you also would rather have very smart people working together instead of one very smart dude alone even if he had an identical twin.

My go-to usecase for Gemini is summarizing Youtube tech-influencers.

Re: Anthropic is expanding to Colossus2. Will use GB200

#132

Post by [deleted] »

gaze wrote: post #18

I think that's the datacenter with the gas turbine generators that operate without permits because they're "portable." Data centers have tremendous externalities but colossus is a particularly nasty offender, and not just due its size. Edit: They did it with Colossus and now they're doing the exact same thing with Colossus2. https://www.selc.org/news/xai-built-an-illegal-power-plant-t...

[deleted]

Re: Anthropic is expanding to Colossus2. Will use GB200

#133

Post by giancarlostoro »

virgildotcodes wrote: post #52

Here's a probably stupid question - if someone were unbounded by ethics and conceivably had enough power and connections to power to shield themselves from many consequences of their actions - and that person owned these DCs, could they in theory observe all the streams of tokens coming in and out of these models, and even exfiltrate copies of these models wholesale to have their own teams do what they will with them…

You could, but Grok is pretty high up there, it might not be "#1" but its definitely up there with the giants, people seem to overlook it. Gemini has a similar problem, it was #1 once, and it seems like Google isn't hell bent on chasing #1 they just want to keep iterating over time, they know they just need it to be "good enough" and they'll keep having repeat customers.

If Elon REALLY wanted to do anything like that he would be better off poaching talent from competitors, less legal hell to go through.

Re: Anthropic is expanding to Colossus2. Will use GB200

#134

Post by vasco »

robwwilliams wrote: post #76
gaze wrote: post #18

I think that's the datacenter with the gas turbine generators that operate without permits because they're "portable." Data centers have tremendous externalities but colossus is a particularly nasty offender, and not just due its size. Edit: They did it with Colossus and now they're doing the exact same thing with Colossus2. https://www.selc.org/news/xai-built-an-illegal-power-plant-t...

The newer location is about 3 miles southwest of the Memphis Airport (MEM), one of the world’s largest cargo airports and the center of FedEx operations (500 take-off and landings per day most concentrated in a 6 h FedEx window with lots of engines running on ramps and that produces about 2000 tons of NOx per year). I live about 18 miles downwind of the new Colossus sites, the airport, and lots of truck logistics sit…

> I’ll take Anthropic in preference to Grok NOx

It's the same datacenter? Ran by the same people?

Re: Anthropic is expanding to Colossus2. Will use GB200

#136

Post by usef- »

krige wrote: post #109
usef- wrote: post #82

Earlier quoted context omitted.

This was debunked: https://blog.andymasley.com/p/contra-benn-jordan-data-center...

The debunk is extremely sketchy on many points. https://www.bearlythinking.com/p/andy-masley-doesnt-understa...

That post is mentioned at the bottom of what I linked.

He has a full post response here: https://blog.andymasley.com/p/to-be-clear-i-do-understand-ho...

Re: Anthropic is expanding to Colossus2. Will use GB200

#137

Post by oezi »

ChicagoDave wrote: post #125

Sigh. I’d hoped Anthropic would steer clear of blatantly unethical practices but here they go in bed with that guy and his horribly damaging data center.

Yes, quite a bad reputation hit for Anthropic to get in bed with Musk. Tesla lost half its marketshare in Europe because Elon is meddling in our democracy, is promoting right wing populist parties and supporting Trump in general.

Re: Anthropic is expanding to Colossus2. Will use GB200

#138

Post by cma »

giancarlostoro wrote: post #130
CSMastermind wrote: post #118

Earlier quoted context omitted.

More people should try Grok. I don't use it for coding but it's replaced a lot of my ChatGPT usage. Definitely more perferred model for quick questions or easy answers.

One thing I do like about Grok is that it makes it stupid easy to see what its referencing, and gives you the links to those resources. Which most models sometimes either don't bother, or don't do much of a good job of doing. It's not the top model, but it is definitely high up there, people's blind rage for anything Elon Musk is the only reason most people don't realize how capable it is unfortunately. Grok is not e…

What's the blind rage, he's totally out in the open.

Re: Anthropic is expanding to Colossus2. Will use GB200

#139

Post by akimbostrawman »

kibibu wrote: post #81
tristanj wrote: post #49

Earlier quoted context omitted.

Bad read on the situation. xAI has too much compute and not enough customers using it. They have around half a million GPUs, some of which are stolen from Tesla, running at 11% utilization. xAI predicted more people would be using Grok, but Grok is not a SOTA model & users primarily want to use SOTA models. They have excess capacity and it makes sense to rent out GPUs to other customers while they improve their model…

Grok is also tuned to align with Musk's personal beliefs. I wouldn't touch it with a 10 foot pole.

Opposed to all other models being the bastion of objectivity? Must be truly vindicating to have to hear other peoles opinions after decades in the silicon valley bubble.

Re: Anthropic is expanding to Colossus2. Will use GB200

#140

Post by [deleted] »

kibibu wrote: post #81
tristanj wrote: post #49

Earlier quoted context omitted.

Bad read on the situation. xAI has too much compute and not enough customers using it. They have around half a million GPUs, some of which are stolen from Tesla, running at 11% utilization. xAI predicted more people would be using Grok, but Grok is not a SOTA model & users primarily want to use SOTA models. They have excess capacity and it makes sense to rent out GPUs to other customers while they improve their model…

Grok is also tuned to align with Musk's personal beliefs. I wouldn't touch it with a 10 foot pole.

[deleted]
Post reply on HN