Live data from Hacker News

Nvidia’s $589B DeepSeek rout

finance.yahoo.com

151–160 of 1001 posts

Re: Nvidia’s $589B DeepSeek rout

#153

Earlier quoted context omitted.

Meta should actually go up from this. If deep seek is perfect they don't need to pay for an expensive Llama team. And even if deep seek isn't perfect, the low cost training strategies they've invented could be used by Meta to reduce the cost of Llama training. Although Meta develops models they don't sell them. So a world where foundation models are free is fine for them.

But if they don't sell them, are they spending 50 billion a year on open source goodwill?

From Meta’s perspective, AI could be incredibly profitable in the context of generating adverts or interactive chat bots for businesses.

They just don’t want to use OpenAI/Google models because they fear being screwed over by them with anti-advert terms of service or price increases. Similar to what they suffered with Apple.

Re: Nvidia’s $589B DeepSeek rout

#154
post #32

Well this is very bad for the private AI companies but Big Tech will be fine, especially Meta and Apple. Everyone else who over-leveraged into the private AI companies (Anthropic, OpenAI) are going to have their valuations under scrutiny.

What does Apple have to do with AI

Nothing, and I think that was the point GP was making. Since not much of Apple's valuation is tied to AI hype they won't suffer (at least not close to as much) from the bubble bursting.

Re: Nvidia’s $589B DeepSeek rout

#155

Good time to buy then, I don’t understand how stupid some traders can be. A more efficient model is better for NVIDIA not worse. More compute is still better given the same model. And as more efficient models proliferate it means more edge computing which means more customers with lower negotiating power than Meta and Google… This is like thinking that if people need to dig only 1 day instead of an entire month to ge…

In said gold rush scenario, the price of gold itself would have collapsed.

And since the gold supply is limited, fewer shovels would indeed be required.

Re: Nvidia’s $589B DeepSeek rout

#156
post #107
post #75

Earlier quoted context omitted.

I agree with Aswath Damodaran here. NVDA is priced for perfection in AI, but also whatever is next. In addition, IMO NVDA’s margins are a gift and a curse. They look great to investors, but also mean all their customers are aggressively looking to produce their own GPUs.

They are also priced on the idea that nothing will challenge them. If AMD, Intel, or anyone else comes out with a challenger for their top GPUs at competitive prices, that’s a problem. I’m surprised they haven’t yet.

The biggest challengers are likely the hyperscalers and companies like Meta. It sort of flew under the radar when Meta released an update on their GPU plans last year and said their cluster would be as powerful as X NVDA GPUs, and not that it would have X NVDA GPUs [1].

Also, I should add that Deepseek just showed the top GPUs are not necessary to deliver big value.

[1] https://engineering.fb.com/2024/03/12/data-center-engineerin...

This announcement is one step in our ambitious infrastructure roadmap. By the end of 2024, we’re aiming to continue to grow our infrastructure build-out that will include 350,000 NVIDIA H100 GPUs as part of a portfolio that will feature compute power equivalent to nearly 600,000 H100s.

Re: Nvidia’s $589B DeepSeek rout

#157
post #2

Nvidia -13% in Frankfurt stock market just now. Valuations of private unicorns like OpenAi and Anthropic must be in free fall. DeepSeek spends $6 million in old H800 hardware to develop open source model that overtakes ChatGPT. AI gets better, but profit margins sink with strong competition. Chinese AI startup DeepSeek overtakes ChatGPT on Apple App Store https://news.ycombinator.com/item?id=42839656 Edit: Nvidia now…

It's a very strange result.

I believe that NVIDIA is overvalued, but if DeepSeek really is as great as has been said, then it'll be even greater when scaled up to OpenAI sizes, and when you get more out you have more reason to pay, so this should if it pans out lead to more demand for GPUs-- basically Jevon's paradox.

Re: Nvidia’s $589B DeepSeek rout

#158

Good time to buy then, I don’t understand how stupid some traders can be. A more efficient model is better for NVIDIA not worse. More compute is still better given the same model. And as more efficient models proliferate it means more edge computing which means more customers with lower negotiating power than Meta and Google… This is like thinking that if people need to dig only 1 day instead of an entire month to ge…

>the trading post will somehow sell fewer shovels

There is a point where there are enough shovels circulating that the demand for new shovels falters, even with zero drawback in the rush. And if so much gold was being mined that it overwhelmed the market and reduced the commodity price, the value of better shovels is reduced.

DeepSeek and friends basically reduce the commodity value of AI (and to be fair, Facebook, Microsoft et al are trying to do the same thing with their open source models, trying to chop the legs out of the upstart AI cos). If AI is worth less, there are going to be fewer mega capitalized AI ventures buying a trillion dollars worth of rapidly-depreciating GPUs in hopes at eeking out some minor advantage.

I wouldn't short nvidia stock, but at the same time there is a point where the spend of GPUs just isn't rational anymore.

>And as more efficient models proliferate it means more edge computing which means more customers with lower negotiating power than Meta and Google

Edge compute has infinitely more competition than the data center.

Re: Nvidia’s $589B DeepSeek rout

#159
post #105
post #65

Earlier quoted context omitted.

They have a lot of H100: https://www.reddit.com/r/NVDA_Stock/comments/1iadc0s/evidenc...

four GPUs are very convincing indeed! :D

That's 8 (not 4), on a NVIDIA platform board to start with.

You can't buy them as "GPU"s and integrate them to your system. NVIDIA sells your the platform (GPUs + platform board which includes switches and all the support infra), and you integrate that behemoth of a board to your server, as a single unit.

So that open server and the wrapped ones at the back are more telling than it looks.

Re: Nvidia’s $589B DeepSeek rout

#160
The part of this that doesn’t jibe with me is the fact that they also released this incredibly detailed technical report on their architecture and training strategy. The paper is well-written and has a lot of specifics. Exactly the opposite of what you would do if you had truly made an advancement of world-altering magnitude. All this says to me is that the models themselves have very little intrinsic value / are highly fungible. The true value lies in the software interfaces to the models, and the ability to make it easy to plug your data into the models.

My guess is the consumer market will ultimately be won by 2-3 players that make the best app / interface and leverage some kind of network effect, and enterprise market will just be captured by the people who have the enterprise data, I.e. MSFT, AMZN, GOOG. Depending on just how impactful AI can be for consumers, this could upend Apple if a full mobile hardware+OS redesign is able to create a step change in seamlessness of UI. That seems to me to be the biggest unknown now - how will hardware and devices adapt?

NVDA will still do quite well because as others have noted, if it’s cheaper to train, the balance will just shift toward deploying more edge devices for inference, which is necessary to realize the value built up in the bubble anyway. Some day the compute will become more fungible but the momentum behind the nvidia ecosystem is way too strong right now.

Post reply on HN