Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Higher usage limits for Claude and a compute deal with SpaceX

anthropic.com

Post reply on HN
Print view View original

251–260 of 519 posts

Re: Higher usage limits for Claude and a compute deal with SpaceX

#251

Post by boredatoms »

mcmcmc wrote: post #211
dzhiurgis wrote: post #201

Earlier quoted context omitted.

Scott Manley, I’d say one of the top pop space youtubers say otherwise. If anything it’s easier in space. On earth most complexity in datacenter is cooling. In space you just radiate it away. And SpaceX already proven they can launch sort of datacenters 10k times by launching Starlink (up to 20KW of solar each IIRC). FWIW Musk should support Bernie Sanders more. Putting moratoriums on datacenters would make space bas…

“YouTuber” is an extremely poor qualification for a supposedly trusted source

He's a physicist though, not just a mic jockey

Re: Higher usage limits for Claude and a compute deal with SpaceX

#252

Post by vel0city »

dzhiurgis wrote: post #201
Sammi wrote: post #192

Earlier quoted context omitted.

Anyone who has googled just once to ask if datacenters in space make any sense, has found out they don't because they can't get rid of heat. That leaves only two kinds of people left who are still talking excitedly about datacenters in space: The uninformed and the grifters.

Scott Manley, I’d say one of the top pop space youtubers say otherwise. If anything it’s easier in space. On earth most complexity in datacenter is cooling. In space you just radiate it away. And SpaceX already proven they can launch sort of datacenters 10k times by launching Starlink (up to 20KW of solar each IIRC). FWIW Musk should support Bernie Sanders more. Putting moratoriums on datacenters would make space bas…

He just mentions and walks through idea of having some amount of compute up there and what the heat rejection calculations roughly look like. He doesn't actually explore the economics of doing such a thing or discuss if it's actually worth doing.

It's not that you can't put a server in space, but the costs to do it almost assuredly don't make any sense. Because, if you can do it in space you can do it easier on the ground and save yourself millions in launch cost and extra complexity. Your cooling challenges are way cheaper and simpler in an atmosphere.

There's nothing much being in space really gets you, other than it makes it harder for a government to take your computers away. Not impossible, just harder.

Re: Higher usage limits for Claude and a compute deal with SpaceX

#253

Post by kcb »

exabrial wrote: post #237

This is where I see the economy of AI going: * Inference becomes cheap - speciality accelerators hit the market and race to the bottom begins * Training remains expensive - This works out for Anthropic/OpenAI, they go into the business of training * Models become rental units or purchasable assets, you run on inference hardware - Rent or own inference hardware * Or you pay someone to do all of the above for you, at a…

There's no magic bullet for inference on cheap accelerators. Any accelerator will still require large amounts of high bandwidth memory.

Re: Higher usage limits for Claude and a compute deal with SpaceX

#254

Post by ur-whale »

brokencode wrote: post #44
arian_ wrote: post #14

Anthropic renting out the data center Elon built for Grok is the kind of plot twist you can't make up.

Pretty smart for SpaceX though. They’re turning an asset they made for a money-pit (Grok) into probably a major source of revenue ahead of their IPO.

[dead]

Re: Higher usage limits for Claude and a compute deal with SpaceX

#255

Post by pdimitar »

shimman wrote: post #198
anthonypasq wrote: post #104

Earlier quoted context omitted.

most of the big tech ceos have mentioned this.

Most big tech CEOs are people that only "succeeded" due to have an unregulated monopoly or picking the right lotto ticket and not due to any innate above average intelligence. Go look at the 100s of billions in wasted capital and tell me who benefitted from such waste while workers + children suffer from lack of medical care. You honestly expect this trajectory to continue unabated?

> You honestly expect this trajectory to continue unabated?

Knowing humanity's history, yes. Not sure we're ever going to see a second French Revolution. People are pacified and are not rioting. And they really should. Most of us are kind of privileged. I know people out there who are barely holding on and the recent fuel + food price increases might push them over the edge to actual poverty.

Re: Higher usage limits for Claude and a compute deal with SpaceX

#256

Post by lijok »

dmlittle wrote: post #240
dgfl wrote: post #230

Earlier quoted context omitted.

The existence of starlink proves that this is false. Look at most current pitches, they don’t talk about GW-class monsters anymore. There’s absolutely nothing stopping a 20-30kW satellite bus the size of starlink (or I guess up to 100kW? once starship is available - it’s all about payload fairing diameter) from hosting ~1 rack of compute and antennas. The economics may or may not make sense, we’ll have to see. There’…

It's worth noting that GPUs have a much higher failure rate than traditional CPUs. Over 10x the failure rate due thermal stress. The amount of heat generated is very different. You can't really replace a GPU in a satellite (at least today?) which would place most of these satellites as space debris in a ~5 year horizon.

Which is the same lifetime as a starlink sat

Re: Higher usage limits for Claude and a compute deal with SpaceX

#257

Post by thrownthatway »

HarHarVeryFunny wrote: post #108
kfrzcode wrote: post #61

Earlier quoted context omitted.

literally the entire economy is powered by fossil fuels

As far as electricity goes, the US is currently 50/50 fossil fuels and renewables (solar, wind, etc).

No do the entire economy.

Re: Higher usage limits for Claude and a compute deal with SpaceX

#258

Post by ur-whale »

brokencode wrote: post #44
arian_ wrote: post #14

Anthropic renting out the data center Elon built for Grok is the kind of plot twist you can't make up.

Pretty smart for SpaceX though. They’re turning an asset they made for a money-pit (Grok) into probably a major source of revenue ahead of their IPO.

[dead]

Re: Higher usage limits for Claude and a compute deal with SpaceX

#259

Post by lijok »

ceejayoz wrote: post #245
small_model wrote: post #239

Earlier quoted context omitted.

SpaceX have presented on this and it's fairly straightforward and they already do it with starlink satellites, just at a larger scale. Sound like you are the uniformed one (or an EDS victim)

Starlink satellites don't generate the sort of heat a datacenter full of GPUs does. The ISS has enormous radiators, and it's only in space because it's a space station. Putting datacenters there is just goofy given the amount of available space on the ground .

Why are you comparing the output of a datacenter to the output of a single sat?

How much power do starlink sats draw and how does it compare to say 8x H200s?

Re: Higher usage limits for Claude and a compute deal with SpaceX

#260

Post by sroussey »

losvedir wrote: post #213

> 300 megawatts of new capacity (over 220,000 NVIDIA GPUs) The scale is just mindboggling here. Are there any blog posts or anything discussing what kind of infrastructure is used for even just the inference side (nevermind the training) for SotA models like Opus? I would have thought it might be secret, but given that you can actually run the models yourself on AWS Bedrock doesn't that give an indication?

> 300 megawatts of new capacity (over 220,000 NVIDIA GPUs)

That’s just for the SpaceX part (over provisioning for grok, lol).

The Amazon and Google deals are each over an order of magnitude larger! Pretty wild indeed!

Post reply on HN