Nvidia is now more valuable than Amazon and Google

Post by benreesman » Tue, Feb 13, 2024, 11:50 PM UTC

MichaelZuo wrote: post #351

benreesman wrote: post #304

Earlier quoted context omitted.

I’m saying that we have “deregulated” big-cap tech to the point of not enforcing laws that we enforced even a decade ago. This is analogous to the last time a sector 100% captured the regulators which was high finance in the Greenspan era last time. Ended poorly. The likely height of big-cap tech regulation was the regulated monopoly of ATT/Bell Labs/Western Digital all through the 20th century. I prefer the outcomes…

I never claimed to have “fail to understand my point” ? Are you sure your not misreading something?

Post by aurareturn » Wed, Feb 14, 2024, 12:06 AM UTC

AnthonyMouse wrote: post #342

aurareturn wrote: post #276

Earlier quoted context omitted.

I think you answered your own question, really. Although I would modify your statement slightly: Original: Selling 30M GPUs with a huge margin is more profitable than selling 60M GPUs with a modest margin. Modified: Nvidia and AMD must sell at a higher ASP because the market for discrete GPUs has shrunk from 60m to 30m/year. That's your answer! It's what I've been arguing for since my very first post. It isn't Nvidia…

> Modified: Nvidia and AMD must sell at a higher ASP because the market for discrete GPUs has shrunk from 60m to 30m/year. That makes no sense as a reason not to sell more . It also makes no sense in general because discrete GPUs aren't a distinct technology. The H100 isn't literally a bunch of RTX cards glued together, but it's approximately that and the same R&D goes into both, implying that the higher demand for t…

Post by fennecbutt » Wed, Feb 14, 2024, 1:02 AM UTC

behnamoh wrote: post #16

Somehow I wish it weren't true because I hate monopolies in any markets. Nvidia has been enjoying their absurd premium on consumer and production GPUs and intentionally removed the NVLink capability in the GeForce 4090 series (3090 had them) to avoid cannibalizing their A100 and H100 business. With NVLink, people could chain multiple GPUs and increase the overall VRAM without much reduction in bandwidth. But without…

Post by eru » Wed, Feb 14, 2024, 4:20 AM UTC

latchkey wrote: post #334

eru wrote: post #141

Earlier quoted context omitted.

You are right to worry about power efficiency. Though do keep in mind that power is also fungible with money, especially in a data centre. I suspect a lot of AI inference (thought probably not the majority) will happen on mobile devices in the future. There power is also at a premium, and less fungible with money.

> Though do keep in mind that power is also fungible with money, especially in a data centre. Untrue. I have filled 3 very large data centers where there was no more power to be had. Data centers are constrained by power. At some limit, you can't just spend more money to get more power. It also becomes a cooling issue, the more power your GPUs consume, the more heat they generate, the more cooling that is required, t…

Post by latchkey » Wed, Feb 14, 2024, 6:27 AM UTC

eru wrote: post #358

latchkey wrote: post #334

Earlier quoted context omitted.

> Though do keep in mind that power is also fungible with money, especially in a data centre. Untrue. I have filled 3 very large data centers where there was no more power to be had. Data centers are constrained by power. At some limit, you can't just spend more money to get more power. It also becomes a cooling issue, the more power your GPUs consume, the more heat they generate, the more cooling that is required, t…

You are right about any given data centre in the short run. But you can use money to rent more data centres.