Live data from Hacker News

Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

cnbc.com

41–50 of 340 posts

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#41

Earlier quoted context omitted.

Tell me more about why you believe their stock is hilariously overvalued.

They are priced as if they are the only ones who are capable of creating chips that can crunch LLM algos. But AMD, Google, Intel, and even Apple are also capable. Apple is in talks with Google to bring Gemini to the iPhone, and it will obviously also be on android phones. So almost every phone on earth is poised to be using Gemini in the near future, and Gemini runs entirely on Google's own custom hardware (which is…

This seems as good a place as any to be Corrected by the Internet, so... correct me if I'm wrong.

Making a graphics chip that is as good as Nvidia: Very difficult. Huge moat, huge effort, lots of barriers, lots of APIs, lot of experience, lots of decades of experience to overcome.

Making something that can run a NN: Much, much easier. I'd guess, start-up level feasible. The math is much simpler. There's a lot of it, but my biggest concern would be less about pulling it off and more around whether my custom hardware is still the correct custom hardware by the time it is released. You'd think you could even eke out a bit of a performance advantage in not having all the other graphics stuff around. LLMs in their current state are characterized by vast swathes of input data and unbelievably repetitive number crunching, not complicated silicon architectures and decades-refined algorithms. (I mean, the algorithms are decades refined, but they're still simple as programs go.)

I understand nVidia's graphics moat. I do not understand the moat implied by their stock valuation, that as you say, they are the only people who will ever be able to build AI hardware. That doesn't seem remotely true.

So... correct me Internet. Explain why nVidia has persistent advantages in the specific field of neural nets that can not be overcome. I'm seriously listening, because I'm curious; this is a deliberate Cunningham's Law invocation, not me speaking from authority.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#42
post #7

I haven't listened to Jensen speak before, but am I the only one who thought the presentation wasn't very polished? Not a knock on anything he has accomplished, just an observation that sorta surprised me

The beginning in particular seemed pretty rough, but he seemed to mostly get into a groove about halfway into it. At least he started talking a lot smoother around then.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#43
post #7

I haven't listened to Jensen speak before, but am I the only one who thought the presentation wasn't very polished? Not a knock on anything he has accomplished, just an observation that sorta surprised me

I think it's a good reminder that objectively great CEO's and leaders can be kind of cringe when presenting. A lot of times people like that get passed up in promotions in favor of smooth talkers.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#44

Time to sell. When they start becoming a platform, it means they have nothing more concrete in the near future. Sell now and buy again later once the price corrects.

Don't bet against a CEO who knows what is talking about, has 80% market share and an arm tattoo of his own company logo.... :-)

So far the short sellers, learned that bitter lesson.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#45
post #9
post #6

FP8 being 2.5x Hopper is kind of disappointing after such a long time. Since its 2 fused chips, that means it’s 25% effective delta. though it seems most of the progress has been on memory throughput and power use which is still very impressive. I wonder how this will trickle down to the consumer segment.

Jensen revealed later that the LLM inference is 30x due to architectural improvements, it's massive. I don't know if it's latency or just 2-3x performance boost with 30x more customers served in the same chip. Either way, 30x is massive.

He always does that. They stack up a bunch of special case features like sparsity that most people don't use in practice to get these unrealistic numbers. It'll be faster, certainly, but 30x will only be achievable in very special cases I'm sure.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#46

Time to sell. When they start becoming a platform, it means they have nothing more concrete in the near future. Sell now and buy again later once the price corrects.

Does a company like Nvidia has to have anything more concrete than newer, bigger and faster chips?

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#48
post #7

I haven't listened to Jensen speak before, but am I the only one who thought the presentation wasn't very polished? Not a knock on anything he has accomplished, just an observation that sorta surprised me

It's typical. He isn't a great public speaker IMO. Not terrible but not great.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#49
post #34

Earlier quoted context omitted.

Tell me more about why you believe their stock is hilariously overvalued.

Because their stock value is highly coupled with crypto mining and AI craze. The move from PoW to PoS for most crypto networks in combination with bust of ‘22. NVDA slid down in value. OpenAI debuts ChatGPT in late 2022 and now it’s suddenly bumping in price as the hype and rush for GPUs from companies of all types buys up their stock of GPUs. Demand is far outpacing the supply. Nvda can’t keep up. Thus, share price…

If you are a true believer that AI is not a craze, then the stock can only go up from here. If you think there is a chance that everyone gets bored of AI and moves on to some other fad that is not in Nvidia’s wheelhouse, then it’s probably down from here. I’m staying out of this bet: don’t have the stomach for it.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#50

Time to sell. When they start becoming a platform, it means they have nothing more concrete in the near future. Sell now and buy again later once the price corrects.

Does a company like Nvidia has to have anything more concrete than newer, bigger and faster chips?

[deleted]
Post reply on HN