Nvidia Hopper GPU Architecture and H100 Accelerator • Hacker News Board

Re: Nvidia Hopper GPU Architecture and H100 Accelerator

#181

Post by sliken » Thu, Mar 24, 2022, 9:21 PM UTC

wmwmwm wrote: post #53

macrolocal wrote: post #47

Earlier quoted context omitted.

50% sparsity and rated at 700W. The new DGX is 10kW!

I was recently researching how you'd host systems like this in a datacentre and was blown away to find out that you can cool 40kW in a single air cooled rack - this might be old news for many, but it was 2x or 3x what I expected! Glad I'm not paying the electricity bill :)

Possible, yes. Easy, no. Don't assume any ole air cooled rack (or datacenter) can manage 40k per rack. It makes it really important to do the hot isle/cold isle well, manage the airflow carefully, block any empty rack units, etc. etc. etc.

Re: Nvidia Hopper GPU Architecture and H100 Accelerator

#182

Post by oblio » Thu, Mar 24, 2022, 10:02 PM UTC

spoonjim wrote: post #179

oblio wrote: post #155

Earlier quoted context omitted.

And you think they shouldn't have that right because of social concerns like accumulation of wealth?

No, because they don’t own my identity! If my name is valuable I can will it to them. I can will my money to them. I just don’t think they should be able to endorse political candidates with my name after I’m dead, unless I specifically gave them that right by contract.

You'd be dead...

Re: Nvidia Hopper GPU Architecture and H100 Accelerator

#183

Post by wmwmwm » Fri, Mar 25, 2022, 8:16 AM UTC

sliken wrote: post #181

wmwmwm wrote: post #53

Earlier quoted context omitted.

I was recently researching how you'd host systems like this in a datacentre and was blown away to find out that you can cool 40kW in a single air cooled rack - this might be old news for many, but it was 2x or 3x what I expected! Glad I'm not paying the electricity bill :)

Possible, yes. Easy, no. Don't assume any ole air cooled rack (or datacenter) can manage 40k per rack. It makes it really important to do the hot isle/cold isle well, manage the airflow carefully, block any empty rack units, etc. etc. etc.

Yes, wouldn’t want to try and design it myself! I think the datacentre providers I was looking at spend quite a while doing CFD simulations to get it right!