Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic is expanding to Colossus2. Will use GB200

twitter.com

Post reply on HN
Print view View original

51–60 of 367 posts

Re: Anthropic is expanding to Colossus2. Will use GB200

#51

Post by Rover222 »

tw04 wrote: post #16
alienreborn wrote: post #13

Why is xAI giving up their advantage? Is this a signal that their frontier model improvements are plateauing and decided there is no value in hoarding all their compute?

What advantage? Has there ever been any indication they’re leading in any segment? Sure Elon has thrown a bunch of money at hardware, but to what end? And frankly as bad as Altman is from a: if AI is really going to disrupt humanity do I want this guy in charge? Elon is 10x worse. So why would the best and the brightest ever work for him?

The datacenter advantage, obviously

Re: Anthropic is expanding to Colossus2. Will use GB200

#52

Post by virgildotcodes »

Here's a probably stupid question - if someone were unbounded by ethics and conceivably had enough power and connections to power to shield themselves from many consequences of their actions - and that person owned these DCs, could they in theory observe all the streams of tokens coming in and out of these models, and even exfiltrate copies of these models wholesale to have their own teams do what they will with them in the pursuit of building their own competitive models?

Or is there something fundamental in the way these models get deployed (encryption or something or than legal contracts?) at this scale that prohibits the owners of the infra from gaining this level of insight / access?

Re: Anthropic is expanding to Colossus2. Will use GB200

#53

Post by Rover222 »

fasbg1 wrote: post #5

I though Claude is too woke. Musk has posted that at least 50 times in the last year. But booking outrageous rental fees as fake AI revenue ahead of the SpaceX IPO apparently takes precedence.

He talked with the Anthropic team, and his concerns lessened. It's actually a good thing to be able to change one's mind.

Re: Anthropic is expanding to Colossus2. Will use GB200

#54

Post by hemul3n »

gaze wrote: post #18

I think that's the datacenter with the gas turbine generators that operate without permits because they're "portable." Data centers have tremendous externalities but colossus is a particularly nasty offender, and not just due its size. Edit: They did it with Colossus and now they're doing the exact same thing with Colossus2. https://www.selc.org/news/xai-built-an-illegal-power-plant-t...

I dug into this topic in some detail on my blog and it's both enraging and depressing.

https://poiesic.com/posts/pattern-recognition

Re: Anthropic is expanding to Colossus2. Will use GB200

#55

Post by hugh-avherald »

morkalork wrote: post #45
idle_zealot wrote: post #34

Earlier quoted context omitted.

Have you considered that the march of progress requires human blood to grease the gears and mulched skulls to pave the (highly efficient) road? Really, when you take into account all of the future lives this will improve and save it's difficult to claim any cost now is too high. Would you stand in their way and delay the day that Mythos cures cancer? This is a joke. Read it in a mocking tone.

When do we start building pyramids and doing the Sardaukar blood letting ritual?

When the 10-year yield hits 6%. Basic macroeconomics.

Re: Anthropic is expanding to Colossus2. Will use GB200

#56

Post by fragmede »

virgildotcodes wrote: post #52

Here's a probably stupid question - if someone were unbounded by ethics and conceivably had enough power and connections to power to shield themselves from many consequences of their actions - and that person owned these DCs, could they in theory observe all the streams of tokens coming in and out of these models, and even exfiltrate copies of these models wholesale to have their own teams do what they will with them…

There's accusations that the Chinese labs have done essentially that to OpenAI and Anthropic and exfiltrated their models without having DC access, so if you had DC access, yes, you could do that. If you had DC access though you could just copy the model onto an SSD.

Re: Anthropic is expanding to Colossus2. Will use GB200

#57

Post by Torn »

hemul3n wrote: post #54
gaze wrote: post #18

I think that's the datacenter with the gas turbine generators that operate without permits because they're "portable." Data centers have tremendous externalities but colossus is a particularly nasty offender, and not just due its size. Edit: They did it with Colossus and now they're doing the exact same thing with Colossus2. https://www.selc.org/news/xai-built-an-illegal-power-plant-t...

I dug into this topic in some detail on my blog and it's both enraging and depressing. https://poiesic.com/posts/pattern-recognition

This is a really great watch from Benn Jordan on the topic https://www.youtube.com/watch?v=_bP80DEAbuo

Some wild things happening with those, and infrasound. Colossus is shown 4 mins in

Re: Anthropic is expanding to Colossus2. Will use GB200

#58

Post by gdhkgdhkvff »

er1276 wrote: post #23
nikcub wrote: post #21

Earlier quoted context omitted.

Anthropic this quarter will have revenue of $10.9B, up from $4.8B last quarter[0]. They're paying SpaceX $1.25B per month for compute[1] - which is more than what SpaceX earn on space. SpaceX spent about $30-40B in capex on Colossus 1 & 2. This is all real revenue, real spend, real usage. Hetzner just aren't at this scale. Not even close. If they wanted to get into this business - first, they're late. Second, it's at…

Jesus Christ, the Hetzner example is obviously an example of booking revenue as AI revenue (where investors assume it is generated by Grok subscriptions) vs. hardware rental revenue , which traditionally not valued as highly. Nowhere does the hypothetical state that Hetzner, an example for hardware rental , has the funding or the capabilities to execute the sarcastic example . But ok, now hardware rentals have a P/E…

Investors aren’t dumb. These numbers are being reported and the fact that the data centers are being rented out is publicly disclosed everywhere. Investors know full well that the revenue is from the data center rental. No (non-retail) investor is going to see the jump in revenue and think “I better buy up because grok must be kicking ass!”

And yes, if hetzner built a massive AI hyper scale datacenter and rented it out for billions, with the expectation that they would keep building more, they would also see massive PE ratios because it’s expected that their revenue would be going up.

Re: Anthropic is expanding to Colossus2. Will use GB200

#59

Post by Nition »

broknbottle wrote: post #41
georgemcbay wrote: post #24

Earlier quoted context omitted.

Yup, and now Anthropic is complicit in the environmental damage and health problems for local residents that these data centers are causing. But hey, number must go up, right?

Some of you may die, but it’s a sacrifice that I am willing to make.

A superintelligent AI will be safe though, because it learnt its morality from us.

Re: Anthropic is expanding to Colossus2. Will use GB200

#60

Post by jacobrast »

fillskills wrote: post #47
urams wrote: post #20

Very possible Elon is doing this to make give Anthropic better chances against OAI while he attempts to reshape xAI. Also possible he sees infra as the future of xAI if he really believes in the value of space compute. Hard to see this any of this as anything other than a bearish sign for Grok though.

We could see the first company vertically integrated from etching to chip to data center

What do you mean by etching? Google does also it's own chip design with TPUs, data centers, and models but afaik only TSMC Intel and Samsung do the actual semiconductor fabrication
Post reply on HN