Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs • Hacker News Board

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#261

Post by xnyan » Tue, Jan 07, 2025, 4:27 PM UTC

CivBase wrote: post #211

ks2048 wrote: post #192

This is maybe a dumb question, but why is it so hard to buy Nvidia GPUs? I can understand lack of supply, but why can't I go on nvidia.com and buy something the same way I go on apple.com and buy hardware? I'm looking for GPUs and navigating all these different resellers with wildly different prices and confusing names (on top of the already confusing set of available cards).

I've always assumed their add-in board (AIB) partners (like MSI, ASUS, Gigabyte, etc) are able to produce PCBs and other components at higher volumes and lower costs than NVIDIA.

Not just the production of the finished boards, but also marketing, distribution to vendors and support/RMA for defective products.

There is profit in this, but it’s also a whole set of skills that doesn’t really make sense for Nvidia.

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#262

Post by marginalia_nu » Tue, Jan 07, 2025, 4:29 PM UTC

ActionHank wrote: post #191

blixt wrote: post #156

Pretty interesting watching their tech explainers on YouTube about the changes in their AI solutions. Apparently they switched from CNNs to transformers for upscaling (with ray tracing support) if I understood correctly though for frame generation makes even more sense to me. 32 GB VRAM on the highest end GPU seems almost small after running LLMs with 128 GB RAM on the M3 Max, but the speed will most likely more than…

They are intentionally keeping the VRAM small on these cards to force people to buy their larger, more expensive offerings.

Makes sense. The games industry doesn't want another crypto mining-style GPU shortage.

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#263

Post by Insanity » Tue, Jan 07, 2025, 4:29 PM UTC

Somewhat related, any recommendations for 'pc builders' where you can configure a PC with the hardware you want, but have it assembled and shipped to you instead of having to build it yourself? With shipping to Canada ideally.

I'm planning to upgrade (prob to a mid-end) as my 5 year old computer is starting to show it's age, and with the new GPUs releasing this might be a good time.

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#264

Post by logankeenan » Tue, Jan 07, 2025, 4:30 PM UTC

terhechte wrote: post #179

blixt wrote: post #156

Pretty interesting watching their tech explainers on YouTube about the changes in their AI solutions. Apparently they switched from CNNs to transformers for upscaling (with ray tracing support) if I understood correctly though for frame generation makes even more sense to me. 32 GB VRAM on the highest end GPU seems almost small after running LLMs with 128 GB RAM on the M3 Max, but the speed will most likely more than…

If you have 128gb ram, try running MoE models, they're a far better fit for Apple's hardware because they trade memory for inference performance. using something like Wizard2 8x22b requires a huge amount of memory to host the 176b model, but only one 22b slice has to be active at a time so you get the token speed of a 22b model.

Do you have any recommendations on models to try?

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#265

Post by knowitnone » Tue, Jan 07, 2025, 4:34 PM UTC

tbolt wrote: post #235

ActionHank wrote: post #191

Earlier quoted context omitted.

They are intentionally keeping the VRAM small on these cards to force people to buy their larger, more expensive offerings.

Maybe, but if they strapped these with 64gb+ wouldn’t that be wasted on folks buying it for its intended purpose? Gaming. Though the “intended use” is changing and has been for a bit now.

hmmm, maybe they can had different offerings like 16GB, 32GB, 64GB, etc. Maybe we can even have 4 wheels on a car.

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#266

Post by perching_aix » Tue, Jan 07, 2025, 4:34 PM UTC

vel0city wrote: post #184

perching_aix wrote: post #120

Earlier quoted context omitted.

> It’s 3 extrapolated frames not interpolated. Do you have a source for this? Doesn't sound like a very good idea. Nor do I think there's additional latency mind you, but not because it's not interpolation.

Interpolation means you have frame 1 and frame 2, now compute the interstitial steps between these two. Extrapolation means you have frame 1, and sometime in the future you'll get a frame 2. But until then, take the training data and the current frame and "guess" what the next few frames will be. Interpolation requires you to have the final state between the added frames, extrapolation means you don't yet know what t…

I understand this - doesn't address anything of what I said.

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#267

Post by mox1 » Tue, Jan 07, 2025, 4:34 PM UTC

tbolt wrote: post #235

ActionHank wrote: post #191

Earlier quoted context omitted.

They are intentionally keeping the VRAM small on these cards to force people to buy their larger, more expensive offerings.

Maybe, but if they strapped these with 64gb+ wouldn’t that be wasted on folks buying it for its intended purpose? Gaming. Though the “intended use” is changing and has been for a bit now.

Not really, the more textures you can put into memory the faster they can do their thing.

PC gamers would say that a modern mid-range card (1440p card) should really have 16GB of vram. So a 5060 or even a 5070 with less than that amount is kind of silly.

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#268

Post by Kelteseth » Tue, Jan 07, 2025, 4:35 PM UTC

voidUpdate wrote: post #198

Ooo, that means its probably time for me to get a used 2080, or maybe even a 3080 if I'm feeling special

Why not go for AMD? I just got a 7900XTX for 850 euros, it runs ollama or comfyUI via WSl2 quite nicely.

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#269

Post by nfriedly » Tue, Jan 07, 2025, 4:35 PM UTC

garbageman wrote: post #256

nfriedly wrote: post #250

Meh. Feels like astronomical prices for the smallest upgrades they could get away with. I miss when high-end GPUs were $300-400, and you could get something reasonable for $100-200. I guess that's just integrated graphics these days. The most I've ever spent on a GPU is ~$300, and I don't really see that changing anytime soon, so it'll be a long time before I'll even consider one of these cards.

Intel ARC B580 is $249 MSRP and right up your alley in that case.

Yep. If I needed a new GPU, that's what I'd go for. I'm pretty happy with what I have for the moment, though.

Re: Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

#270

Post by mjevans » Tue, Jan 07, 2025, 4:35 PM UTC

jmuguy wrote: post #219

geertj wrote: post #173

Any advice on how to buy the founders edition when it launches, possibly from folks who bought the 4090 FE last time around? I have a feeling there will be a lot of demand.

Do you live somewhat near a Microcenter? They'll likely have these as in-store pick up only, no online reservations, 1 per customer. Recently got a 9800X3D CPU from them, its nice they're trying to prevent scalping.

As someone living (near) Seattle, this is a major issue for me every product launch and I don't have a solution.

The area's geography just isn't conducive to allowing a single brick and mortar store to survive and compete with online retail for costs vs volume; but without a B&M store there's no good way to do physical presence anti-scalper tactics.

I can't even get in a purchase opportunity lottery since AMD / Nvidia don't do that sort of thing for allocating restock quota tickets that could be used as tokens to restock product if a purchase is to the correct shipping address.