Dell exec reveals Nvidia has a 1,000-watt GPU in the works
theregister.com
Dell exec reveals Nvidia has a 1,000-watt GPU in the works
1–10 of 59 posts
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#2The big question is "Will it blend (with the datacenter dynamics, power distribution and cooling)?".
Considering a conservative 4GPU system adds a 1.2KW additional overhead, packing these together densely in racks is a huge ordeal.
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#3Looks like a solution in search of a problem.
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#4Looks like a solution in search of a problem.
AI workloads are currently going through their "developers are expensive, hardware is cheap(ish)" era. Nobody is trying very hard to fit models to GPUs, and optimize utilization and whatnot.
Instead they throw in more GPUs. So B100 will fit right into the bill.
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#5Nice, we'll be able to consume the Earth's resources even faster. Congrats everyone!
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#6Nice, we'll be able to consume the Earth's resources even faster. Congrats everyone!
Huh? This is an AI accelerator card. So you should be looking at performance per Watt, instead of absolute numbers. The linked article doesn't mention anything about that.
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#7Nice, we'll be able to consume the Earth's resources even faster. Congrats everyone!
We've never consumed resources faster, yet there's never been more resources made accessible by our efforts for us all to consume. Every tech advance unlocks more!
Space exploration and mining will be a step change in accessible resources. Why not enjoy the non-scarcity!
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#8Looks like a solution in search of a problem.
AI workloads are currently going through their "developers are expensive, hardware is cheap(ish)" era. Nobody is trying very hard to fit models to GPUs, and optimize utilization and whatnot. Instead they throw in more GPUs. So B100 will fit right into the bill.
There's a lot of work being put in to make LLMs run on consumer hardware, albeit it's being done by the open source community and not the companies themselves.
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#9Earlier quoted context omitted.
AI workloads are currently going through their "developers are expensive, hardware is cheap(ish)" era. Nobody is trying very hard to fit models to GPUs, and optimize utilization and whatnot. Instead they throw in more GPUs. So B100 will fit right into the bill.
There's a lot of work being put in to make LLMs run on consumer hardware, albeit it's being done by the open source community and not the companies themselves.
Apple is most definitely working on running them on iPhones.
Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works
#10Earlier quoted context omitted.
AI workloads are currently going through their "developers are expensive, hardware is cheap(ish)" era. Nobody is trying very hard to fit models to GPUs, and optimize utilization and whatnot. Instead they throw in more GPUs. So B100 will fit right into the bill.
There's a lot of work being put in to make LLMs run on consumer hardware, albeit it's being done by the open source community and not the companies themselves.
I mean, for the training part. Inference is easy (relative to training). Even my 3 year old camera can do real-time eye/face-tracking for humans and mammals via a real-time neural network running on a dedicated low power DSP.