Live data from Hacker News

Dell exec reveals Nvidia has a 1,000-watt GPU in the works

theregister.com

31–40 of 59 posts

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#31

The big question is "Will it blend (with the datacenter dynamics, power distribution and cooling)?". Considering a conservative 4GPU system adds a 1.2KW additional overhead, packing these together densely in racks is a huge ordeal.

The big questions is, my heat pump is 2.6 kW, can I remove the heat pump and run 2 of these GPUs instead?

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#32

The big question is "Will it blend (with the datacenter dynamics, power distribution and cooling)?". Considering a conservative 4GPU system adds a 1.2KW additional overhead, packing these together densely in racks is a huge ordeal.

These days you can already get water-cooled servers [1] and rack-mount water distribution manifolds [2]

[1] https://www.supermicro.com/en/solutions/liquid-cooling [2] https://www.ibm.com/docs/en/power8?topic=POWER8/p8had/p8had_...

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#33

The big question is "Will it blend (with the datacenter dynamics, power distribution and cooling)?". Considering a conservative 4GPU system adds a 1.2KW additional overhead, packing these together densely in racks is a huge ordeal.

These days you can already get water-cooled servers [1] and rack-mount water distribution manifolds [2] [1] https://www.supermicro.com/en/solutions/liquid-cooling [2] https://www.ibm.com/docs/en/power8?topic=POWER8/p8had/p8had_...

I mean, we have these, but changing to a bigger CDU just because you decided to get a rack of GPU servers is not always fun/easy/doable.

Even if you just upgrade them, then there's the primary loop's capacity.

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#34

With the recent breakthrough in ternary weight models it'll be interesting to see how needed this kind of bruteforce power will be.

Why not have both software and hardware improvements? This is like saying we shouldn't have any new CPUs after the the PDP-1 because quicksort got invented

Yeah, there's this weird notion that OSS work on running LLMs on consumer hardware, and researching more efficient architectures, is somehow in opposition or competition to the Evil AI Wielding Corporations. It's not. Like always, whatever tool an individual has, a corporation can afford to use more of it, and use it better.

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#35
post #31

The big question is "Will it blend (with the datacenter dynamics, power distribution and cooling)?". Considering a conservative 4GPU system adds a 1.2KW additional overhead, packing these together densely in racks is a huge ordeal.

The big questions is, my heat pump is 2.6 kW, can I remove the heat pump and run 2 of these GPUs instead?

If you find a way to extract compute from the work done by a compressor, sure. But then you'll be able to afford the heatpump and any number of GPUs, for the money you get from overturning laws of thermodynamics.

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#37
post #26
post #6

Earlier quoted context omitted.

Huh? This is an AI accelerator card. So you should be looking at performance per Watt, instead of absolute numbers. The linked article doesn't mention anything about that.

The best way to enjoy HN is to just ignore these comments. There are a lot of bored, angsty, frustrated, lonely people, many struggling with mental illness that like to make comments like this for no other reason than getting attention.

Not everyone who doesn't share your worldview is mentally ill.

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#38

The big question is "Will it blend (with the datacenter dynamics, power distribution and cooling)?". Considering a conservative 4GPU system adds a 1.2KW additional overhead, packing these together densely in racks is a huge ordeal.

These days you can already get water-cooled servers [1] and rack-mount water distribution manifolds [2] [1] https://www.supermicro.com/en/solutions/liquid-cooling [2] https://www.ibm.com/docs/en/power8?topic=POWER8/p8had/p8had_...

I can't find it anymore, but I remember reading a few years ago about a watercooled server farm that used an outdoor water fountain. It wasn't a single rack, but a few 100s of them

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#39
post #31

Earlier quoted context omitted.

The big questions is, my heat pump is 2.6 kW, can I remove the heat pump and run 2 of these GPUs instead?

If you find a way to extract compute from the work done by a compressor , sure. But then you'll be able to afford the heatpump and any number of GPUs, for the money you get from overturning laws of thermodynamics.

I better start working on it then!
Post reply on HN