Live data from Hacker News

Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

cnbc.com

151–160 of 340 posts

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#151

Time to sell. When they start becoming a platform, it means they have nothing more concrete in the near future. Sell now and buy again later once the price corrects.

I wouldn't be 100% against them, but it is disappointing that they don't have any better ideas.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#152
post #113

Earlier quoted context omitted.

How is 2.5x disappointing in one generation?

Did you skip the sentence immediately after that one? It’s two fused chips. So 1.25x per chip. 25% uplift. Not 2.5x uplift. The 2.5x is for the whole package.

Is that how it works? Why don't we just put many chips in one computer?

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#153
post #131

Like a lot of the commenters here, I have a problem with this headline. They don't "seek to become a platform company", as in making their own cloud platform where they rent GPU time, meaning they stop selling GPUs to other cloud platforms. That easy misinterpretation makes good clickbait, but no, that's not what the article says - the article has Huang bragging that CUDA already is a parallel computing platform, for…

Someone please "chip in" and confirm or deny if this interpretation is correct?

"Platform" can have several different meanings and some people in this thread are picking the most evil meaning as an excuse to shit on Nvidia. It's true that Nvidia is providing the GPU, the CPU, the server, the rack, the network, the drivers, and the orchestration software to run AI training/inference. (If you want that stuff. You could just buy GPUs if you want.) It's fair to call that a platform.

Nvidia is not becoming a cloud provider (beyond a small eval environment perhaps).

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#154
post #64

What is FP4, 4 bit floating point? If so, the comparison graph [0] with 30x above Hopper was a bit misleading. [0] https://youtu.be/Y2F8yisiS6E?t=4698

https://arxiv.org/pdf/2310.10537.pdf

Discussed in a previous post https://news.ycombinator.com/item?id=37930663

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#156
post #113

Earlier quoted context omitted.

How is 2.5x disappointing in one generation?

Did you skip the sentence immediately after that one? It’s two fused chips. So 1.25x per chip. 25% uplift. Not 2.5x uplift. The 2.5x is for the whole package.

> two fused chips

Jensen's comment about being first was such a dig to Emerald Rapids.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#157
post #142
post #89

Earlier quoted context omitted.

Whenever I see an open job req for canonical I run for the hills.

They must have a fast revolving door. I have know so many people who worked there in the last few years but seem to have moved in. Probably depends on the team and the worst ones have a lot of churn.

From what I see on Glassdoor they have bad, toxic management so that would explain a lot.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#158
post #121

Earlier quoted context omitted.

How can 4 bits possibly be enough? Are intermediate calculations done at a higher width and then converted down back to FP4?

- Training isn’t done at 4-bits, to date this small size has only been for inference. - Research for a while now has been finding that smaller weights are surprisingly effective. It’s kind of a counterintuitive result, but one way to think about it is there are billions of weights working together. So taken as a whole you still have a large amount of information.

Maybe the rounding errors are noise that is somewhat useful in a big enough neutral net. Image generators also generate noise to work on

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#159

Earlier quoted context omitted.

NVDA's forward PE is ~37, about what it has been for the past ~5 years I've been tracking that. So it's not overpriced based on that metric. If you're convinced the stock is that overvalued, go short some or, if you like to live dangerously, buy some long-term put options (don't be an idiot and buy short-term options.) I have no idea if NVDA is like Cisco Systems in 2000, or if it's something unique. What I am aware…

That's exactly what I'm saying below - PE is still very high, hence projecting the past growth into the future. But the scale changed a bit. A 37 PE ratio is extremely high by historical standards - this was reserved for very promising, small startups. Not for 2T companies. I know this got distorted in the past 15 years by abnormally low interest rates, but sooner or later it will come back to something that makes se…

Then be the options seller. You can sell cash secured puts, or a put credit spread, or a call credit spread. Calls are even more expensive than puts right now.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#160
post #7

I haven't listened to Jensen speak before, but am I the only one who thought the presentation wasn't very polished? Not a knock on anything he has accomplished, just an observation that sorta surprised me

Its refreshing. Another tech keynote that I regularly watch (Apple) is far too polished these days.
Post reply on HN