I haven't listened to Jensen speak before, but am I the only one who thought the presentation wasn't very polished? Not a knock on anything he has accomplished, just an observation that sorta surprised me
Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
11–20 of 340 posts
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#12I haven't listened to Jensen speak before, but am I the only one who thought the presentation wasn't very polished? Not a knock on anything he has accomplished, just an observation that sorta surprised me
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#13Stock unchanged in afterhours. A lot of people were hoping for a big pop on some big development.
whole conference has been proceeding like this now. look if you invite cramer and the wall street crowd, you should throw in some dollar figures. like - who is paying for all this. how much. and why. talk is entirely about token generation bandwidth, exaflops and petaflops, data parallel vs tensor parallel vs pipeline parallel - do you honestly think cramer knows the difference between an ml pipeline and an oil pipeline ?
i am watching this conf with my kid - proper GenZ member - who got up after 5 mins and said man who is this comedian, his jokes are so bad, and left :(
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#14FP8 being 2.5x Hopper is kind of disappointing after such a long time. Since its 2 fused chips, that means it’s 25% effective delta. though it seems most of the progress has been on memory throughput and power use which is still very impressive. I wonder how this will trickle down to the consumer segment.
Jensen revealed later that the LLM inference is 30x due to architectural improvements, it's massive. I don't know if it's latency or just 2-3x performance boost with 30x more customers served in the same chip. Either way, 30x is massive.
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#15Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#16Stock unchanged in afterhours. A lot of people were hoping for a big pop on some big development.
That being said, their stock is absolutely and hilariously overvalued.
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#17Stock unchanged in afterhours. A lot of people were hoping for a big pop on some big development.
They are waiting for earnings projections for such a pop since right now it is extremely overbought and struggling to move past >$1,000 per share.
For now, Microsoft and OpenAI will use these chips, but in the long term they are just looking at this and plotting to build their own chips and reducing their dependence on Nvidia and will be ready to switch once their contracts have run out.
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#18Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#19I haven't listened to Jensen speak before, but am I the only one who thought the presentation wasn't very polished? Not a knock on anything he has accomplished, just an observation that sorta surprised me
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#20FP8 being 2.5x Hopper is kind of disappointing after such a long time. Since its 2 fused chips, that means it’s 25% effective delta. though it seems most of the progress has been on memory throughput and power use which is still very impressive. I wonder how this will trickle down to the consumer segment.
Jensen revealed later that the LLM inference is 30x due to architectural improvements, it's massive. I don't know if it's latency or just 2-3x performance boost with 30x more customers served in the same chip. Either way, 30x is massive.