Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Jensen Huang keynote at CES 2025 [video]

youtube.com

Post reply on HN
Print view View original

71–80 of 104 posts

Re: Jensen Huang keynote at CES 2025 [video]

#71

Post by Mr_Minderbinder »

ninetyninenine wrote: post #64
ksec wrote: post #27

I actually got a lot more upbeat about the potential of AI after watching this keynote more so than any other demonstration or presentation. Blackwell is still based on N4, a derivative of 5nm. We know we will have N3 GPU next year, and they should be working with TSMC on capacity planning for N2. Currently Blackwell is pretty much limited by capacity of either TSMC, HBM or packaging. And unless the AI hype dies off…

Is GPU improvement is driven more by gaming then by AI hype? Gaming is the biggest industry and there is real money coming from that. Does speculative money from VCs actually overshadow actual money spent by consumers? I know stock prices is driven by AI hype but how much does it actually effect the bottom line of Nvidia? I think GPU improvement happens regardless of AI.

NVIDIA’s net income grew ~580% year-on-year in their 2024 fiscal year. FY2025 is on track for 100%+ growth, essentially 14x in the last 2 years. This is not coming from gaming, “AI hype” is having a huge effect on NVIDIA’s bottom line.

Re: Jensen Huang keynote at CES 2025 [video]

#72

Post by downrightmike »

knowitnone wrote: post #49
bgnn wrote: post #44

Earlier quoted context omitted.

5g, wifi, bluetooth etc. what makes a mobile processor monile processor other than the CPU

yeah, those are just modules that anybody can just buy. NVIDIA already makes jetsons which are basically SBCs with decent GPU. so again, what does Mediatek provide?

Monopoly accusation shield. "But we're sharing the tech!"

Re: Jensen Huang keynote at CES 2025 [video]

#73

Post by kristianp »

Mr_Minderbinder wrote: post #71
ninetyninenine wrote: post #64

Earlier quoted context omitted.

Is GPU improvement is driven more by gaming then by AI hype? Gaming is the biggest industry and there is real money coming from that. Does speculative money from VCs actually overshadow actual money spent by consumers? I know stock prices is driven by AI hype but how much does it actually effect the bottom line of Nvidia? I think GPU improvement happens regardless of AI.

NVIDIA’s net income grew ~580% year-on-year in their 2024 fiscal year. FY2025 is on track for 100%+ growth, essentially 14x in the last 2 years. This is not coming from gaming, “AI hype” is having a huge effect on NVIDIA’s bottom line.

It all depends on whether AI companies can continue to find significant improvements to their models this year. Are transformers reaching their limits? Can researchers find the next level of performance or are we headed for another AI slump?

Re: Jensen Huang keynote at CES 2025 [video]

#74

Post by behnamoh »

Jedd wrote: post #65
behnamoh wrote: post #42

Earlier quoted context omitted.

32GB is still not a lot.

This feels like a weird complaint, given you started by saying it was 24GB, and then argued that the person who told you it was actually 32GB was making that up.

Looks like Nvidia did a simple calculation:

    32GB (for 5090) / 24GB (for 4090) ≃ 1.33
Then multiply 4090's price by that:

    $1500 × 1.33 ≃ $2000
All else equal, this means that price per GB of VRAM stayed the same. But in reality, other things improved too (like the bandwidth) which I appreciate.

I just think that for home AI use, 32GB isn't that helpful. In my experience and especially for agents, models at 32B parameters just start to be useful. Below that, they're useful only for simple tasks.

Re: Jensen Huang keynote at CES 2025 [video]

#76

Post by jhanschoo »

ninetyninenine wrote: post #64
ksec wrote: post #27

I actually got a lot more upbeat about the potential of AI after watching this keynote more so than any other demonstration or presentation. Blackwell is still based on N4, a derivative of 5nm. We know we will have N3 GPU next year, and they should be working with TSMC on capacity planning for N2. Currently Blackwell is pretty much limited by capacity of either TSMC, HBM or packaging. And unless the AI hype dies off…

Is GPU improvement is driven more by gaming then by AI hype? Gaming is the biggest industry and there is real money coming from that. Does speculative money from VCs actually overshadow actual money spent by consumers? I know stock prices is driven by AI hype but how much does it actually effect the bottom line of Nvidia? I think GPU improvement happens regardless of AI.

Interpreting your question about "GPU improvement" from a product perspective, my read is that NVIDIA is of course targeting AI applications and the datacenter. To that end it just focuses on silicon that makes most sense for AI compute, and not so much for gaming.

Of course, the GPUs for the datacenter and for gaming are the same designs, so my read is that in gaming NVIDIA makes up for lack of actual performance for traditional rendering by pushing technologies that can utilize tensor cores like AI upscaling, frame prediction, ray tracing + denoising, etc.., that don't actually contribute to game graphics as much as they could have if they did an architecture tailored to gaming needs instead, with the technologies that they have. It's also sexier in theory to talk about exclusive AI-powered technologies proprietary to NVIDIA than just better performance.

Re: Jensen Huang keynote at CES 2025 [video]

#77

Post by smallmancontrov »

qingcharles wrote: post #68
jsheard wrote: post #4

Earlier quoted context omitted.

It's 32GB, that was leaked well before the event. > If Apple M4 Ultra gets close to 1.8 TB/s bandwidth of 5090 If past trends hold (Ultra = 2x Max) it'll be around 1.1 TB/s, so closer to the 4090.

It makes for a hard choice. M4 Ultra with say 128GB of RAM vs ... 2 x 5090 with 64GB of RAM for about the same price? More tokens/sec on the dual 5090, but way bigger model on the M4. Plus the dual 5090 might trip your breakers.

If anyone in this thread had watched the linked video or even read a summary, they ought to be at least talking about the DIGITS announcement.

128GB of VRAM for $3000.

Slow? Yes. It isn't meant to compete with the datacenter chips, it's just a way to stop the embarrassment of being beaten at HPC workstations by apple, but it does the job.

Re: Jensen Huang keynote at CES 2025 [video]

#78

Post by sliken »

The Nvidia Project Digits looked rather interesting. Much like a Apple studio ultra. 2 dies, "high" bandwidth unified memory, 20 cores, tiny mac mini sized case, and 2 SFP+ for 2 connectX ports (unsure if that's IB or ethernet).

Claim it will be quite good at AI (1 Tflop of fp4), but sadly don't mention the memory bandwidth. It's somewhere in the range of awesome to terrible depending on the bandwidth.

Re: Jensen Huang keynote at CES 2025 [video]

#79

Post by seanmcdirmid »

sliken wrote: post #78

The Nvidia Project Digits looked rather interesting. Much like a Apple studio ultra. 2 dies, "high" bandwidth unified memory, 20 cores, tiny mac mini sized case, and 2 SFP+ for 2 connectX ports (unsure if that's IB or ethernet). Claim it will be quite good at AI (1 Tflop of fp4), but sadly don't mention the memory bandwidth. It's somewhere in the range of awesome to terrible depending on the bandwidth.

Am looking forward to hearing about this in the next few months. Apple has been super late in updating the macstudio, and even the old models are still super expensive, even used.

Re: Jensen Huang keynote at CES 2025 [video]

#80

Post by teleforce »

sliken wrote: post #78

The Nvidia Project Digits looked rather interesting. Much like a Apple studio ultra. 2 dies, "high" bandwidth unified memory, 20 cores, tiny mac mini sized case, and 2 SFP+ for 2 connectX ports (unsure if that's IB or ethernet). Claim it will be quite good at AI (1 Tflop of fp4), but sadly don't mention the memory bandwidth. It's somewhere in the range of awesome to terrible depending on the bandwidth.

Previous HN post on Project Digits (494 comments) [1].

[1] Nvidia's Project Digits is a 'personal AI supercomputer'

https://news.ycombinator.com/item?id=42619139

Post reply on HN