Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic is expanding to Colossus2. Will use GB200

twitter.com

Post reply on HN
Print view View original

331–340 of 367 posts

Re: Anthropic is expanding to Colossus2. Will use GB200

#331

Post by lovich »

wongarsu wrote: post #282
utopiah wrote: post #267

Earlier quoted context omitted.

> space compute Heard anybody remotely competent about space talk the topic? It's pretty much a literal laugh every time.

Some of the proposals are laughable, some of the example calculations are. The idea of running AI training sounds extremely challenging. But the idea of inference in space doesn't seem absurd The power budget of a starlink v2 mini satellite is estimated at around 20kW based on the known solar panel size. That also matches what a satellite of that size would roughly dissipate without dedicated radiators, using just so…

What could possibly change that would make it a more economically viable option than putting it on earth. Nothing about space improves how data centers operate, and there are several new issues introduced by being in space.

And that’s before you get past the cost of actually putting the shit up there instead of just driving or shipping by rail.

It’s just more looney tunes delusion from a guy who is just talking out his ass about shit he thinks is cool, like the cyber truck was.

Re: Anthropic is expanding to Colossus2. Will use GB200

#332

Post by lovich »

weirdmantis69 wrote: post #309
beAbU wrote: post #297

Earlier quoted context omitted.

The starlink satellites have hall effect thrusters, and presumably beefy laser and radio comms systems that will account for a lot of the energy budget. Also, they are sometimes in the earth's shadow, a naive calculation says they have 2x the solar budget they need, in order to charge up batteries for shade-time operations. There is no where near 20kw of compute in a single satellite, and thus no where near 20kw of h…

The terrestrial based systems getting protested, blocked, and demonized everywhere? Those ones?

For everyone that’s blocked there seems to be another popping up even when the local populace voted against it.

Even then, space is still a harder place to put a satellite than any rural area on the planet.

Re: Anthropic is expanding to Colossus2. Will use GB200

#333

Post by tiagod »

_heimdall wrote: post #301
jtr1 wrote: post #295

Earlier quoted context omitted.

You may want to update your priors [1][2][3] 1. https://www.carbonbrief.org/guest-post-how-solar-panels-and-... 2. https://www.fastcompany.com/91500104/google-minnesota-data-c... 3. https://www.rootsanalysis.com/sodium-ion-battery-market

Sodium is an interesting chemistry, though it has different voltage curves than lithium ion once hardware is built to match it they may scale well for industrial use. That still doesn't avoid the more fundamental math of having to store such massive amounts of energy though, even if you skip batteries and pump water to retention ponds uphill. Even for small scale residential, the recommendation is to store 3 days wor…

The Iberian blackout resulted from a way deeper and more complex reasons than your comment implies, and does not yet have a complete explanation.

The "inertia" issues already have solutions being used in production (in Australia, for example).

Re: Anthropic is expanding to Colossus2. Will use GB200

#334

Post by mike_d »

giancarlostoro wrote: post #133
virgildotcodes wrote: post #52

Here's a probably stupid question - if someone were unbounded by ethics and conceivably had enough power and connections to power to shield themselves from many consequences of their actions - and that person owned these DCs, could they in theory observe all the streams of tokens coming in and out of these models, and even exfiltrate copies of these models wholesale to have their own teams do what they will with them…

You could, but Grok is pretty high up there, it might not be "#1" but its definitely up there with the giants, people seem to overlook it. Gemini has a similar problem, it was #1 once, and it seems like Google isn't hell bent on chasing #1 they just want to keep iterating over time, they know they just need it to be "good enough" and they'll keep having repeat customers. If Elon REALLY wanted to do anything like that…

You must have missed the part where he did poach all the top talent from Google and OpenAI, and then they all quit because they couldn't stand working for him.

Re: Anthropic is expanding to Colossus2. Will use GB200

#335

Post by aurareturn »

ACCount37 wrote: post #250
aurareturn wrote: post #237

Earlier quoted context omitted.

That would require hacking Nvidia's GPUs/racks to extract the weights. The weights are encrypted, sent to the GPU/rack encrypted. When it does inference, it will use decrypted weights but there is no way to get those weights unless you find a way to exploit Nvidia's GPU security. Do you think OpenAI would send CoreWeave their GPT 5.5 Pro weights if an admin employee at CoreWeave can access the full weights unencrypte…

It would require exactly that. A bit more involved than "scp that big file", yes. But you make a mistake by treating it as a hard blocker. Like I said: it's a gentleman's agreement. If Musk said "I want Opus 4.7 weights", and those weights were on Colossus 1 hardware, he'd have those weights on his desktop, unencrypted, within a couple of weeks. There's also the side channel line, because having inference on your har…

Maybe Elon will use Mythos to hack the encryption and steal Mythos’ weights. =)

Re: Anthropic is expanding to Colossus2. Will use GB200

#336

Post by _heimdall »

tiagod wrote: post #333
_heimdall wrote: post #301

Earlier quoted context omitted.

Sodium is an interesting chemistry, though it has different voltage curves than lithium ion once hardware is built to match it they may scale well for industrial use. That still doesn't avoid the more fundamental math of having to store such massive amounts of energy though, even if you skip batteries and pump water to retention ponds uphill. Even for small scale residential, the recommendation is to store 3 days wor…

The Iberian blackout resulted from a way deeper and more complex reasons than your comment implies, and does not yet have a complete explanation. The "inertia" issues already have solutions being used in production (in Australia, for example).

Oh it was extremely complex and I didn't intend to imply that the full explanation would fit in a single HN comment.

The inertia problem you mention wasn't solved in Spain though, and whether it can be solved or already is elsewhere is irrelevant here.

Re: Anthropic is expanding to Colossus2. Will use GB200

#337

Post by scubbo »

jatora wrote: post #249
giancarlostoro wrote: post #133

Earlier quoted context omitted.

You could, but Grok is pretty high up there, it might not be "#1" but its definitely up there with the giants, people seem to overlook it. Gemini has a similar problem, it was #1 once, and it seems like Google isn't hell bent on chasing #1 they just want to keep iterating over time, they know they just need it to be "good enough" and they'll keep having repeat customers. If Elon REALLY wanted to do anything like that…

No Grok is not 'up there'. Not by any stretch of the imagination is it anywhere close to anthropic or openai in any single domain whatsoever. Not even close to deepseek. It really isnt a good model. Their research team's talent is just not good, unfortunately.

> in any single domain

I hear that it is very much up there in _one_ domain. You know the one.

Re: Anthropic is expanding to Colossus2. Will use GB200

#338

Post by sometimelurker »

wongarsu wrote: post #189
stevefan1999 wrote: post #184

Aren't Anthropic afraid of Elon siphoning the model weights out from the network buses?

Is xAI a competitor worth worrying about? They make good models, at times SotA (at least if you don't need coding, their last good coding model was six months ago), with lower safeguards than either Anthropic or OpenAI, and they still fail to capture meaningful market share or mind share. The name Grok is tainted by the twitter bot of the same name operated by xAI/X. Being owned by Musk lets the company appear unstab…

> Is xAI a competitor worth worrying about?

they have GPUs so yes

Re: Anthropic is expanding to Colossus2. Will use GB200

#339

Post by whattheheckheck »

tristanj wrote: post #262
pyrale wrote: post #256

Earlier quoted context omitted.

It does until you're embedded enough with the surveillance system [1]. If a company was able to get immunity in the wat AT&T got it, no contract would protect the other side. [1]: https://en.wikipedia.org/wiki/Hepting_v._AT%26T

That case has nothing to do with contract law.

And the govt protects its citizens and God is real

Re: Anthropic is expanding to Colossus2. Will use GB200

#340

Post by fooster »

burnerRhodov3 wrote: post #305
fooster wrote: post #235

Earlier quoted context omitted.

This might have something to do with the US president threatening to attack Greenland? Decoupling from the US is the only sane thing to do.

Denmark has a freakin' King. You guys are still a monarchy... Greenland is closer to the US than Europe, and we defended and gave back demark during WW2. Demark provides almost no financial support to Greenland, and can't defend it. It will prove to be very strategically important as the ice caps melt. Russia invaded Ukraine, and Demark lets russia use the Danish straights to transport oil despite the US asking them…

All of that aside it is not American territory and it won’t be unless it is taken by force against the will of the people that live there (and Denmark). People don’t like be threatened in particular by countries which they’re allied with.
Post reply on HN