Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

theverge.com

Post reply on HN
Print view View original

371–380 of 776 posts

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#371

Post by jbarrow »

bmenrigh wrote: post #340
jbarrow wrote: post #331

Earlier quoted context omitted.

I’m really curious what training is going to be like on it, though. If it’s good, then absolutely! :) But it seems more aimed at inference from what I’ve read?

I was wondering the same thing. Training is much more memory-intensive so the usual low memory of consumer GPUs is a big issue. But with 128GB of unified memory the Digits machine seems promising. I bet there are some other limitations that make training not viable on it.

Primarily concerned about the memory bandwidth for training.

Though I think I've been able to max out my M2 when using the MacBook's integrated memory with MLX, so maybe that won't be an issue.

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#372

Post by SequoiaHope »

ashleyn wrote: post #362
jbarrow wrote: post #288

The increasing TDP trend is going crazy for the top-tier consumer cards: 3090 - 350W 3090 Ti - 450W 4090 - 450W 5090 - 575W 3x3090 (1050W) is less than 2x5090 (1150W), plus you get 72GB of VRAM instead of 64GB, if you can find a motherboard that supports 3 massive cards or good enough risers (apparently near impossible?).

most household circuits can only support 15-20 amps at the plug. there will be an upper limit to this and i suspect this is nvidia compromising on TDP in the short term to move faster on compute

I wonder if they will start putting lithium batteries in desktops so they can draw higher peak power.

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#373

Post by dcuthbertson »

frognumber wrote: post #333
nfriedly wrote: post #269

Earlier quoted context omitted.

Yep. If I needed a new GPU, that's what I'd go for. I'm pretty happy with what I have for the moment, though.

I'd go for the A770 over the B580. 16GB > 12GB, and that makes a difference for a lot of AI workloads. An older 3060 12GB is also a better option than the B580. It runs around $280, and has much better compatibility (and, likely, better performance). What I'd love to see on all of these are specs on idle power. I don't mind the 5090 approaching a gigawatt peak, but I want to know what it's doing the rest of the time…

A gigawatt?! Just a little more power and I won't need a DeLorean for time travel!

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#374

Post by 6SixTy »

jbarrow wrote: post #288

The increasing TDP trend is going crazy for the top-tier consumer cards: 3090 - 350W 3090 Ti - 450W 4090 - 450W 5090 - 575W 3x3090 (1050W) is less than 2x5090 (1150W), plus you get 72GB of VRAM instead of 64GB, if you can find a motherboard that supports 3 massive cards or good enough risers (apparently near impossible?).

Nvidia wants you to buy their datacenter or professional cards for AI. Those often come with better perf/W targets, more VRAM, and better form factors allowing for a higher compute density.

For consumers, they do not care.

PCIe Gen 4 dictates a tighter tolerance on signalling to achieve a faster bus speed, and it took quite a good amount of time for good quality Gen 4 risers to come to market. I have zero doubt in my mind that Gen 5 steps that up even further making the product design just that much harder.

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#375

Post by jbarrow »

SequoiaHope wrote: post #372
ashleyn wrote: post #362

Earlier quoted context omitted.

most household circuits can only support 15-20 amps at the plug. there will be an upper limit to this and i suspect this is nvidia compromising on TDP in the short term to move faster on compute

I wonder if they will start putting lithium batteries in desktops so they can draw higher peak power.

There's a company doing that for stovetops, which I found really interesting (https://www.impulselabs.com)!

Unfortunately, when training on a desktop it's _relatively_ continuous power draw, and can go on for days. :/

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#376

Post by williamDafoe »

It looks like the new cards are NO FASTER than the old cards. So they are hyping the fake frames, fake pixels, fake AI rendering. Anything fake = good, anything real = bad.

This is the same thing they did with the RTX 4000 series. More fake frames, less GPU horsepower, "Moore's Law is Dead", Jensen wrings his hands, "Nothing I can do! Moore's Law is Dead!" which is how Intel has been slacking since 2013.

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#377

Post by vinyl7 »

williamDafoe wrote: post #376

It looks like the new cards are NO FASTER than the old cards. So they are hyping the fake frames, fake pixels, fake AI rendering. Anything fake = good, anything real = bad. This is the same thing they did with the RTX 4000 series. More fake frames, less GPU horsepower, "Moore's Law is Dead", Jensen wrings his hands, "Nothing I can do! Moore's Law is Dead!" which is how Intel has been slacking since 2013.

Everything is fake these days. We have mass psychosis...everyone is living in a collective schizophrenic delusion

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#378

Post by holoduke »

williamDafoe wrote: post #376

It looks like the new cards are NO FASTER than the old cards. So they are hyping the fake frames, fake pixels, fake AI rendering. Anything fake = good, anything real = bad. This is the same thing they did with the RTX 4000 series. More fake frames, less GPU horsepower, "Moore's Law is Dead", Jensen wrings his hands, "Nothing I can do! Moore's Law is Dead!" which is how Intel has been slacking since 2013.

Its more like the 20 series. Definitely faster and for me worth the upgrade. I just count the transistors for a reference. 92 and 77 billion. So yeah not that much.

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#379

Post by ginko »

hibikir wrote: post #289
ActionHank wrote: post #191

Earlier quoted context omitted.

They are intentionally keeping the VRAM small on these cards to force people to buy their larger, more expensive offerings.

If the VRAM wasn't small, the cards would all get routed to non gaming uses. Remember the state of the market when the 3000 series was new?

Then they should sell more of them.

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#380

Post by dabinat »

jbarrow wrote: post #288

The increasing TDP trend is going crazy for the top-tier consumer cards: 3090 - 350W 3090 Ti - 450W 4090 - 450W 5090 - 575W 3x3090 (1050W) is less than 2x5090 (1150W), plus you get 72GB of VRAM instead of 64GB, if you can find a motherboard that supports 3 massive cards or good enough risers (apparently near impossible?).

This is the #1 reason why I haven’t upgraded my 2080 Ti. Using my laser printer while my computer is on (even if it’s idle) already makes my UPS freak out.

But NVIDIA is claiming that the 5070 is equivalent to the 4090, so maybe they’re expecting you to wait a generation and get the lower card if you care about TDP? Although I suspect that equivalence only applies to gaming; probably for ML you’d still need the higher-tier card.

Post reply on HN