Live data from Hacker News

45°C cooling design cuts data center water use to near zero

blogs.nvidia.com

41–50 of 450 posts

Re: 45°C cooling design cuts data center water use to near zero

#41
post #40
post #38

Earlier quoted context omitted.

By definition it is compute nodes in space. That is what a router is, a computer. Just a matter of scale. They could be improved to more compute and more storage per node. The framework is already there: treat these as disposable vs having to think about supporting them through maintenance.

A datacenter is about data. Your network of space router is in no way something a reasonable person would consider a datacenter... Even less an inference datacenter.

Why, because on board storage is too small and the compute nodes are underpowered? And that can't ever change? A reasonable person doesn't understand technology usually. That is increasingly an understanding left to the wizard class.

I mean people make clusters out of raspberry pis and minipcs.

Re: 45°C cooling design cuts data center water use to near zero

#42
post #26
post #22

This is also the type of thing that makes space based data centers more viable. I was previously more skeptical on the concept but have come around. I do think ground based centers will have better economics when they can be built though, and this addresses noise and water complaints which are the big 2 regional complaints. It seems like lots of bottlenecks are getting solved quickly, except for maybe memory.

How does that change the calculus for space datacenters? There is still no reasons or benefits to having them in space. You still have to rely solely on radiative cooling. That doesn’t solve any of the maintenance problems. Space datacenters is a really dumb and unrealistic idea Musk is talking about to hype his companies, it’s not meant to actually be done. Anything in space is more expensive and way harder to do, f…

> Anything in space is more expensive and way harder to do, for a datacenter there is no benefit.

If we pick an extremely fast orbit, then relativity means the hardware will age out (slightly) slower, so I'm sure that'll help with the maintenance issue.

It's the wrong way around though. Ideally we want to speed up our current compute ability not slow it down; if it experiences more time than we do then it can do more. Relative-MHz means my slower hardware becomes tangibly fast again.

General Relativity says mass warps space time, so we need to get these datacentres out of the Earth's gravity well. And the Sun's, and the Milky Way's; out into the deepest void of intergalactic space. The good news is that a maintenance callout is still quicker than some of the earth based DC's I've had gear in, but the bad news is that it doesn't get us much of anything at all.

Special Relativity lets us abuse time with speed (something I discovered as a teenager). Going faster than Earth means we experience less time, so we just need to try and slow down comparative to our home base. The earth is orbiting the Sun at ~30km/s, the solar system is orbiting the centre of the Milky Way at ~230km/s and our local group of galaxies is moving relative to the Cosmic Microwave Background at ~600km/s. We can easily get our DataSpaceCentre up to 1,000km/s or more, so we just need to point it relative to all that movement we mentioned above making stationary relative to the universe. It's completely doable, but (as well as far more variable response times to callouts) only gets us an extra second of compute over a human lifetime.

Fundamentally, we're attacking this problem in the wrong direction. Earth's gravity is comparatively minor, and our piddly ~600km/s relative movement is a tiny fraction of the speed of light. We should be filling The Earth with compute, and then decamping humanity into space and travelling at relativistic speeds. Or put the compute in space and move the Earth into the event horizon of a black hole. You can't do the inverse of Interstellar keeping Earth where it is, the maths isn't in our favour. If everyone lived on (a less moist) Miller's Planet, we'd get 7 years of compute every hour. It puts Moore's Law to shame; the relative MHz are obscene.

There's the obvious problem of communications. I'm led to believe there's issues with radio and light, so this probably isn't a job for fibre. Veritasium seemed to imply a battery, switch, lightbulb and a wire stretching around the globe would light instantaneously, so I'm sure we can come up with a new copper Ethernet standard for low latency over solar distances.

Invest early, we're going straight past the moon!

Re: 45°C cooling design cuts data center water use to near zero

#43
post #38

Earlier quoted context omitted.

It's not, it's more like a space based network, the processing and storage is minimal.

By definition it is compute nodes in space. That is what a router is, a computer. Just a matter of scale. They could be improved to more compute and more storage per node. The framework is already there: treat these as disposable vs having to think about supporting them through maintenance.

If you look at how small a Starlink sat is, and how much of that space is taken up by power generation and storage, antennas, signal conditioning, RF electronics and more, I'm sure that whatever resources are running the computing in the entire starlink fleet orbiting the world can fit all together in one single row of servers in an existing datacenter.

And yes, a space-based computing node would not need quite as much of some of these things but they'll still need them in some way. It's not like you can just plug in a power and ethernet cable into them.

I doubt this will scale to a level that is actually useful. It's a nice experiment, just like Microsoft when they threw a datacenter container into the ocean. But not practical in the current conditions: https://news.microsoft.com/source/features/sustainability/pr...

Yes they say it is amazing and sustainable there in that blog post, yet somehow they've never bothered to do it again.

Re: 45°C cooling design cuts data center water use to near zero

#44
post #38

Earlier quoted context omitted.

By definition it is compute nodes in space. That is what a router is, a computer. Just a matter of scale. They could be improved to more compute and more storage per node. The framework is already there: treat these as disposable vs having to think about supporting them through maintenance.

If you look at how small a Starlink sat is, and how much of that space is taken up by power generation and storage, antennas, signal conditioning, RF electronics and more, I'm sure that whatever resources are running the computing in the entire starlink fleet orbiting the world can fit all together in one single row of servers in an existing datacenter. And yes, a space-based computing node would not need quite as mu…

They can't make them a little bit bigger? But also I found this interesting image on the scale at hand here of a given launch of starlinks, no clue how many are included in a single launch, and it is a substantial amount of rack space they have been sending up at once:

https://i.redd.it/zh7qvyfqgvx21.jpg

So to me they have solved the issue of having a space based compute array network interfacing with the earth. They have solved the issue of launching and deploying this array. And their given launches seem to have a substantial payload of compute going up at once just in sheer volume. And right now the only real difference is that the nodes they are launching are just pretty weakly specced. Everything else is in place and turnkey.

Re: 45°C cooling design cuts data center water use to near zero

#45
post #41
post #40

Earlier quoted context omitted.

A datacenter is about data. Your network of space router is in no way something a reasonable person would consider a datacenter... Even less an inference datacenter.

Why, because on board storage is too small and the compute nodes are underpowered? And that can't ever change? A reasonable person doesn't understand technology usually. That is increasingly an understanding left to the wizard class. I mean people make clusters out of raspberry pis and minipcs.

There is nothing magical here, you definitely don’t need to be a wizard to understand the hardware necessary for AI inference. You can make nice little clusters with rpis, yes, there is nothing magical about that, it’s pretty much baremetal 101. But no, you cannot run any meaningful inference on that cluster.

Maybe look at what is inside a datacenters, the amount of power required is very large, and the hardware to run the inference + network isn’t small. Then try to see how much sending that to space cost

Re: 45°C cooling design cuts data center water use to near zero

#46
post #26

Earlier quoted context omitted.

How does that change the calculus for space datacenters? There is still no reasons or benefits to having them in space. You still have to rely solely on radiative cooling. That doesn’t solve any of the maintenance problems. Space datacenters is a really dumb and unrealistic idea Musk is talking about to hype his companies, it’s not meant to actually be done. Anything in space is more expensive and way harder to do, f…

> Anything in space is more expensive and way harder to do, for a datacenter there is no benefit. If we pick an extremely fast orbit, then relativity means the hardware will age out (slightly) slower, so I'm sure that'll help with the maintenance issue. It's the wrong way around though. Ideally we want to speed up our current compute ability not slow it down; if it experiences more time than we do then it can do more…

You’re surprisingly good at this, ngl

Re: 45°C cooling design cuts data center water use to near zero

#47
post #29

Earlier quoted context omitted.

I’ve been to datacenters, but not the huuuge ones people seem to talk about in the context of AI. They are noisy inside (due to air cooling, which is largely avoided by the tech in the OP), but they’re entirely unremarkable outside compared to any other commercial or industrial building. Computers are not inherently loud, nor is power conversion. Power plants are all over, even in populated areas. They’re not so bad…

It depends a lot on things like geology and some people are a lot more sensitive. It is really an issue. I don't have any datacenters near me but I can hear some heavy hums from the washing machine 3 floors up when it put my head on my pillow, for some reason it just propagates through the building physically. When I walk around I don't hear it. Datacenter noise can be the same. IMO they should be put away from habit…

> I don't have any datacenters near me but I can hear some heavy hums from the washing machine 3 floors up when it put my head on my pillow, for some reason it just propagates through the building physically. When I walk around I don't hear it. Datacenter noise can be the same.

Right. Vibration propagates through solid (and liquid) materials.

But this can all be measured and controlled, and there's nothing special about datacenters. A building that is hundreds of feet away will couple to your pillow much less strongly than a washing machine in your building. And the washing machine often has a wildly unbalanced load and minimal decoupling between itself and the floor, whereas a big fan in a datacenter or other industrial building ought to be balanced and also ought to be installed on decoupling mounts.

If datacenter operators (cough xAI) are being lazy about properly selecting, installing and maintaining equipment, then you can have a problem. Otherwise you have a much smaller problem.

Re: 45°C cooling design cuts data center water use to near zero

#48
post #29

Earlier quoted context omitted.

Do you live near a datacenter? Property value goes down, constant humming.. the way we heat up the earth right now, i don't think you have to worry about heating

I’ve been to datacenters, but not the huuuge ones people seem to talk about in the context of AI. They are noisy inside (due to air cooling, which is largely avoided by the tech in the OP), but they’re entirely unremarkable outside compared to any other commercial or industrial building. Computers are not inherently loud, nor is power conversion. Power plants are all over, even in populated areas. They’re not so bad…

It's like anything else in this world. Corner cutting and being shitty leads to shitty outcomes

Re: 45°C cooling design cuts data center water use to near zero

#50
> In favorable climates, NVIDIA’s 45-degree liquid-cooling architecture ....

What's a favorable climate, apart from, obviously, Greenland? The piece is a little light on details on the correlation between outside temperatures and efficiency & cost. It'd be nice to see even a broad-strokes discussion of that.

Post reply on HN