The big question is "Will it blend (with the datacenter dynamics, power distribution and cooling)?". Considering a conservative 4GPU system adds a 1.2KW additional overhead, packing these together densely in racks is a huge ordeal.
Dell exec reveals Nvidia has a 1,000-watt GPU in the works
31–40 of 59 posts
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#32The big question is "Will it blend (with the datacenter dynamics, power distribution and cooling)?". Considering a conservative 4GPU system adds a 1.2KW additional overhead, packing these together densely in racks is a huge ordeal.
[1] https://www.supermicro.com/en/solutions/liquid-cooling [2] https://www.ibm.com/docs/en/power8?topic=POWER8/p8had/p8had_...
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#33The big question is "Will it blend (with the datacenter dynamics, power distribution and cooling)?". Considering a conservative 4GPU system adds a 1.2KW additional overhead, packing these together densely in racks is a huge ordeal.
These days you can already get water-cooled servers [1] and rack-mount water distribution manifolds [2] [1] https://www.supermicro.com/en/solutions/liquid-cooling [2] https://www.ibm.com/docs/en/power8?topic=POWER8/p8had/p8had_...
Even if you just upgrade them, then there's the primary loop's capacity.
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#34With the recent breakthrough in ternary weight models it'll be interesting to see how needed this kind of bruteforce power will be.
Why not have both software and hardware improvements? This is like saying we shouldn't have any new CPUs after the the PDP-1 because quicksort got invented
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#35The big question is "Will it blend (with the datacenter dynamics, power distribution and cooling)?". Considering a conservative 4GPU system adds a 1.2KW additional overhead, packing these together densely in racks is a huge ordeal.
The big questions is, my heat pump is 2.6 kW, can I remove the heat pump and run 2 of these GPUs instead?
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#36Nice, we'll be able to consume the Earth's resources even faster. Congrats everyone!
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#37Earlier quoted context omitted.
Huh? This is an AI accelerator card. So you should be looking at performance per Watt, instead of absolute numbers. The linked article doesn't mention anything about that.
The best way to enjoy HN is to just ignore these comments. There are a lot of bored, angsty, frustrated, lonely people, many struggling with mental illness that like to make comments like this for no other reason than getting attention.
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#38The big question is "Will it blend (with the datacenter dynamics, power distribution and cooling)?". Considering a conservative 4GPU system adds a 1.2KW additional overhead, packing these together densely in racks is a huge ordeal.
These days you can already get water-cooled servers [1] and rack-mount water distribution manifolds [2] [1] https://www.supermicro.com/en/solutions/liquid-cooling [2] https://www.ibm.com/docs/en/power8?topic=POWER8/p8had/p8had_...
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#39Earlier quoted context omitted.
The big questions is, my heat pump is 2.6 kW, can I remove the heat pump and run 2 of these GPUs instead?
If you find a way to extract compute from the work done by a compressor , sure. But then you'll be able to afford the heatpump and any number of GPUs, for the money you get from overturning laws of thermodynamics.
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#40Looks like a solution in search of a problem.