Stock unchanged in afterhours. A lot of people were hoping for a big pop on some big development.
Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
161–170 of 340 posts
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#162Earlier quoted context omitted.
If you are a true believer that AI is not a craze, then the stock can only go up from here. If you think there is a chance that everyone gets bored of AI and moves on to some other fad that is not in Nvidia’s wheelhouse, then it’s probably down from here. I’m staying out of this bet: don’t have the stomach for it.
There's another case for pessimism as well: cost. It's possible that many AI applications aren't worth the money required for the extra compute. AI-enhanced search comes to mind here: how is Microsoft going to monetize users of Copilot in Bing to justify the extra cost? Right now a lot of this stuff is heavily subsidized by VCs or the MSFTs of the world, but when it comes time to make a profit we'll see what actually…
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#163Earlier quoted context omitted.
Canonical’s culture [1] is the antithesis of what nvidia wants. [1] https://www.reddit.com/r/recruitinghell/comments/1bec2zk/lit...
That's not culture , that's Shuttleworth.
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#164Earlier quoted context omitted.
Isn't sparsity almost always a win at this point? Making everything fully connected is a major waste.
The kind of sparsity that the hardware supports is not fully general. I'm not aware of any large models trained using it. Maybe they are all leaving 2x perf on the table for no reason, but maybe not. I don't think sparsity is really proven to be "almost always a win" for training.
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#165Earlier quoted context omitted.
That's exactly what I'm saying below - PE is still very high, hence projecting the past growth into the future. But the scale changed a bit. A 37 PE ratio is extremely high by historical standards - this was reserved for very promising, small startups. Not for 2T companies. I know this got distorted in the past 15 years by abnormally low interest rates, but sooner or later it will come back to something that makes se…
Then be the options seller. You can sell cash secured puts, or a put credit spread, or a call credit spread. Calls are even more expensive than puts right now.
Frankly, I don't understand why we made it possible for individuals to gamble by selling options. As Charlie Munger used to say, Wall Street will sell shit as long as shit can be sold.
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#166Earlier quoted context omitted.
And MS and everyone else have plenty of interest in helping AMD commodify CUDA compatibility.
It's so weird it's taking them so long, because as far as anyone can tell AMD is mostly competent enough to make GPUs within some percentage points of Nvidia, the "breadth of complexity" in what these things do at the end of the day is ... rather underwhelming, the software stack may appear to be changing all the time but is also distinctly JavaScript-frotend-esque... is there an insider that knows what the holdup is…
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#167Earlier quoted context omitted.
Did you skip the sentence immediately after that one? It’s two fused chips. So 1.25x per chip. 25% uplift. Not 2.5x uplift. The 2.5x is for the whole package.
> two fused chips Jensen's comment about being first was such a dig to Emerald Rapids.
I believe this is just the first for a GPU only product.
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#168Earlier quoted context omitted.
Did you skip the sentence immediately after that one? It’s two fused chips. So 1.25x per chip. 25% uplift. Not 2.5x uplift. The 2.5x is for the whole package.
Is that how it works? Why don't we just put many chips in one computer?
Then the B200 package is 2 of these plus a CPU. So a total of 4 GPU dies in each unit.
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#169Earlier quoted context omitted.
Well, stock price is not a good short term indicator about Nvidia developments, nor any company for that matter. Nvidia is doing a very good job. That being said, their stock is absolutely and hilariously overvalued.
NVDA's forward PE is ~37, about what it has been for the past ~5 years I've been tracking that. So it's not overpriced based on that metric. If you're convinced the stock is that overvalued, go short some or, if you like to live dangerously, buy some long-term put options (don't be an idiot and buy short-term options.) I have no idea if NVDA is like Cisco Systems in 2000, or if it's something unique. What I am aware…
You've also had three or four bona fide bubbles in that span, starting around 2017. First was Bitcoin along with the stock market as a whole (with Nvidia being one of the leading stocks of that bull market advance).
Then you had Tesla go parabolic and lots of people become rich. Then you had the whole post-COVID speculative mania.
The result of this has been extreme credulity by the average person. Today's keynote is the perfect summation of this phenomenon. I saw multiple people who almost certainly couldn't explain in any level of detail how Nvidia GPUs are used for training and inference, but rather rely on the secondhand talking points like CUDA that they've learned by watching Jim Cramer, watching this keynote with excitement and anticipating how much it would pump their shares or call options.
Contrast this with Steve Jobs keynotes from 15 years ago when Apple's best days were well ahead of them. Most keynotes were questioned, in some cases even mocked. When Tesla stock broke out, many people couldn't make sense of it. Ditto for cryptocurrencies. But now, taking their cues from those cycles, the average person wants to ride the next bubble to riches and is trying to catch the wave and so now believes every story attached to a rising asset price.
CEO's aren't blind to this and are using every opportunity to create favorable storylines. The leadup to a keynote like this carries with it an enormous amount of pressure to deliver. Hence a company like Nvidia leaning into generative artwork and straight up made up storylines like robot development.
At the end of the day, I'm afraid that there likely isn't all that much substance and the evidence is beginning to pile up that the megacap tech stocks have run out of ideas which is why they are laying off people en masse and appealing to the AI hype cycle to carry their stocks higher.
Consider that Nvidia has gone up 8x- 800%!- in just over a year. The cycles are moving faster and faster. I remember just a year ago when lots of people said Nvidia at $250 was insane. Now here we are with the stock at more than three times that level and most people are calling it cheap. The stock market seems to have in certain areas like semis, completely disconnected from the fundamentals and taken flight. Yes, Nvidia earnings have grown. But understand that this is all part of a positive feedback loop where tech CEO's are pressured by their competitors and shareholders to show that they are investing in AI. Thus they all talk about it on their earnings calls and spend massively. All of their stocks rise in unison as you have a market that increasingly looks like its chasing momentum stock trends up. Nvidia's moves of late have almost nothing to do with any fundamental developments in the company. It has been routinely trading upwards of $45 billion a day. The Friday before last that number was over $100 billion. These are absolutely insane figures. Compare that to Microsoft, the largest company by market cap in the world, which trades on average around $8 billion per day.
I think this is generally how bull markets end and I think we may be actually forming the top of the great bull market for the megacaps that began around 2010 but really hit its stride starting in 2017.
Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’
#170Earlier quoted context omitted.
They showed 30x was for FP4. Who is using FP4 in practice?
But maybe you should. Once the software stack is ready for it there'll be more people since the performance gains are so massive.