Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Dell exec reveals Nvidia has a 1,000-watt GPU in the works

theregister.com

Post reply on HN
Print view View original

11–20 of 59 posts

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#11

Post by willis936 »

dpacmittal wrote: post #8
bayindirh wrote: post #4

Earlier quoted context omitted.

AI workloads are currently going through their "developers are expensive, hardware is cheap(ish)" era. Nobody is trying very hard to fit models to GPUs, and optimize utilization and whatnot. Instead they throw in more GPUs. So B100 will fit right into the bill.

There's a lot of work being put in to make LLMs run on consumer hardware, albeit it's being done by the open source community and not the companies themselves.

The consumer hardware is made by the same company and there's little competition. Rather than undercut the price of commercial hardware, what commercial applications for GPUs has done is raise the price floor of consumer GPUs. The companies are not undercutting themselves. It's profit city.

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#12

Post by bayindirh »

willis936 wrote: post #11
dpacmittal wrote: post #8

Earlier quoted context omitted.

There's a lot of work being put in to make LLMs run on consumer hardware, albeit it's being done by the open source community and not the companies themselves.

The consumer hardware is made by the same company and there's little competition. Rather than undercut the price of commercial hardware, what commercial applications for GPUs has done is raise the price floor of consumer GPUs. The companies are not undercutting themselves. It's profit city.

I think AI accelerators in ARM based systems will be start to eat that green company from below. Even Intel's bottom of the barrel N95/N100 has accelerators now.

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#13

Post by swader999 »

ovi256 wrote: post #7
yau8edq12i wrote: post #5

Nice, we'll be able to consume the Earth's resources even faster. Congrats everyone!

We've never consumed resources faster, yet there's never been more resources made accessible by our efforts for us all to consume. Every tech advance unlocks more! Space exploration and mining will be a step change in accessible resources. Why not enjoy the non-scarcity!

We'll blow ourselves up before climate and scarcity are solved. AI might help with this.

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#14

Post by bayindirh »

rapsey wrote: post #9
dpacmittal wrote: post #8

Earlier quoted context omitted.

There's a lot of work being put in to make LLMs run on consumer hardware, albeit it's being done by the open source community and not the companies themselves.

Apple is most definitely working on running them on iPhones.

They are already running some of the Siri stuff completely offline and on device, AFAIK.

Also, they have tons of image related AI infrastructure running on iPhones already.

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#15

Post by amelius »

eru wrote: post #6
yau8edq12i wrote: post #5

Nice, we'll be able to consume the Earth's resources even faster. Congrats everyone!

Huh? This is an AI accelerator card. So you should be looking at performance per Watt, instead of absolute numbers. The linked article doesn't mention anything about that.

Yeah so they should increase the efficiency instead of the power.

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#16

Post by hardware2win »

bayindirh wrote: post #4
Timber-6539 wrote: post #3

Looks like a solution in search of a problem.

AI workloads are currently going through their "developers are expensive, hardware is cheap(ish)" era. Nobody is trying very hard to fit models to GPUs, and optimize utilization and whatnot. Instead they throw in more GPUs. So B100 will fit right into the bill.

>"developers are expensive, hardware is cheap(ish)"

Is it even true?

H100 is worth 1 year of salary of mid engineer in eastern eu - 40k usd before tax

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#17

Post by ta1243 »

ovi256 wrote: post #7
yau8edq12i wrote: post #5

Nice, we'll be able to consume the Earth's resources even faster. Congrats everyone!

We've never consumed resources faster, yet there's never been more resources made accessible by our efforts for us all to consume. Every tech advance unlocks more! Space exploration and mining will be a step change in accessible resources. Why not enjoy the non-scarcity!

Depends what the externalities of that resource usage are, and who bares them.

Currently while NVidea shareholders reap the reward, it's people in the global south that suffer the immediate consequences (although the rest of us will eventually too)

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#18

Post by epolanski »

amelius wrote: post #15
eru wrote: post #6

Earlier quoted context omitted.

Huh? This is an AI accelerator card. So you should be looking at performance per Watt, instead of absolute numbers. The linked article doesn't mention anything about that.

Yeah so they should increase the efficiency instead of the power.

Well, there's no yeah, because there's no ratio...

For all you could know energy went twofold and performance threefold..

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#19

Post by bayindirh »

hardware2win wrote: post #16
bayindirh wrote: post #4

Earlier quoted context omitted.

AI workloads are currently going through their "developers are expensive, hardware is cheap(ish)" era. Nobody is trying very hard to fit models to GPUs, and optimize utilization and whatnot. Instead they throw in more GPUs. So B100 will fit right into the bill.

>"developers are expensive, hardware is cheap(ish)" Is it even true? H100 is worth 1 year of salary of mid engineer in eastern eu - 40k usd before tax

Generally it's thought in the hourly cost, plus how much productivity it adds to your workflow.

IOW, you pay yearly price of an engineer, plus some hourly cost, but it generally adds more productivity rather than optimizing what you have at hand.

> H100 is worth 1 year of salary of mid engineer in eastern eu

If you can have them supplied to you, in the first place.

Re: Dell exec reveals Nvidia has a 1,000-watt GPU in the works

#20

Post by Voultapher »

eru wrote: post #6
yau8edq12i wrote: post #5

Nice, we'll be able to consume the Earth's resources even faster. Congrats everyone!

Huh? This is an AI accelerator card. So you should be looking at performance per Watt, instead of absolute numbers. The linked article doesn't mention anything about that.

As long as we insist on doing the same thing, we will never use less in total. Point me to any sizable consumption field where gains in efficiency didn't translate to more usage.
Post reply on HN