Live data from Hacker News

Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

cnbc.com

1–10 of 340 posts

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#3

Stock unchanged in afterhours. A lot of people were hoping for a big pop on some big development.

not only that, it lost steam during the day, maybe it was overheated too much and no more news can pump it up any further.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#6
FP8 being 2.5x Hopper is kind of disappointing after such a long time. Since its 2 fused chips, that means it’s 25% effective delta.

though it seems most of the progress has been on memory throughput and power use which is still very impressive.

I wonder how this will trickle down to the consumer segment.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#9
post #6

FP8 being 2.5x Hopper is kind of disappointing after such a long time. Since its 2 fused chips, that means it’s 25% effective delta. though it seems most of the progress has been on memory throughput and power use which is still very impressive. I wonder how this will trickle down to the consumer segment.

Jensen revealed later that the LLM inference is 30x due to architectural improvements, it's massive. I don't know if it's latency or just 2-3x performance boost with 30x more customers served in the same chip. Either way, 30x is massive.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#10
post #7

I haven't listened to Jensen speak before, but am I the only one who thought the presentation wasn't very polished? Not a knock on anything he has accomplished, just an observation that sorta surprised me

He has more important things to do than perfecting a presentation. He likes his employees to message him freely with things they think he can help with.
Post reply on HN