Live data from Hacker News

Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

cnbc.com

111–120 of 340 posts

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#111

"Platform company" means multi-chip in this case? Seems logical since it's becoming impractical to cram so many transistors on a single die.

no it means rent seeking. imagine aws if they also sold all computers in the world, now you can only rent from them

So like IBM at the beginning of computers

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#112
post #66

I think at this point, they should stop making it video “cards” but rather video “stations”, a full tower station with power supply and one giant “card” inside with proper cooling, etc., might also justify the crazy prices anyway.

That’s the DGX GB200 they announced today, with liquid cooling.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#113
post #6

FP8 being 2.5x Hopper is kind of disappointing after such a long time. Since its 2 fused chips, that means it’s 25% effective delta. though it seems most of the progress has been on memory throughput and power use which is still very impressive. I wonder how this will trickle down to the consumer segment.

How is 2.5x disappointing in one generation?

Did you skip the sentence immediately after that one?

It’s two fused chips. So 1.25x per chip. 25% uplift. Not 2.5x uplift. The 2.5x is for the whole package.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#114
post #58

Earlier quoted context omitted.

They are priced as if they are the only ones who are capable of creating chips that can crunch LLM algos. But AMD, Google, Intel, and even Apple are also capable. Apple is in talks with Google to bring Gemini to the iPhone, and it will obviously also be on android phones. So almost every phone on earth is poised to be using Gemini in the near future, and Gemini runs entirely on Google's own custom hardware (which is…

Good luck with that. Gemini Advanced is simply unusable right now....It's so bad its hard to believe nobody picked up on that yet.

Go to Gemini Advanced and try a common programming task in Parallel with Claude and ChatGPT4. Within 2 prompts Claude and ChatGPT4 will give nice working code you can use as a basis while Gemini Advanced will ignore your prompts, provide partial code and quickly tell you it can do more, until you tell it exactly what you want. It will go from looking usable to stuck on "I can do A or I can do B you tell me what you prefer hell" in less than 2 or 3 prompts...Unusable. And I say that as paying customer that will soon cancel the service.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#115

Stock unchanged in afterhours. A lot of people were hoping for a big pop on some big development.

Well, stock price is not a good short term indicator about Nvidia developments, nor any company for that matter. Nvidia is doing a very good job. That being said, their stock is absolutely and hilariously overvalued.

NVDA's forward PE is ~37, about what it has been for the past ~5 years I've been tracking that. So it's not overpriced based on that metric.

If you're convinced the stock is that overvalued, go short some or, if you like to live dangerously, buy some long-term put options (don't be an idiot and buy short-term options.)

I have no idea if NVDA is like Cisco Systems in 2000, or if it's something unique. What I am aware of is that there's around 5-7 trillion that were moved from stocks to t-bills since the Fed raised rates in March 2022. If and when they drop their rates back to the historical ~2.5%, it's reasonable to predict these funds will go back into stocks, which will presumably drive up prices.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#116
post #41

Earlier quoted context omitted.

They are priced as if they are the only ones who are capable of creating chips that can crunch LLM algos. But AMD, Google, Intel, and even Apple are also capable. Apple is in talks with Google to bring Gemini to the iPhone, and it will obviously also be on android phones. So almost every phone on earth is poised to be using Gemini in the near future, and Gemini runs entirely on Google's own custom hardware (which is…

This seems as good a place as any to be Corrected by the Internet, so... correct me if I'm wrong. Making a graphics chip that is as good as Nvidia: Very difficult. Huge moat, huge effort, lots of barriers, lots of APIs, lot of experience, lots of decades of experience to overcome. Making something that can run a NN: Much, much easier. I'd guess, start-up level feasible. The math is much simpler. There's a lot of it,…

> So... correct me Internet. Explain why nVidia has persistent advantages in the specific field of neural nets that can not be overcome. I'm seriously listening, because I'm curious; this is a deliberate Cunningham's Law invocation, not me speaking from authority.

To become a person who writes driver infrastructure for this sort of thing, you need to be a smart person who commits, probably, several of their most productive years to becoming an expert in a particular niche skillset. This only makes sense if you get a job somewhere that has a proven commitment of taking driver work seriously and rewarding it over multiple years.

NVidia is the only company in history that has ever written non-awful drivers, and therefore it's not so implausible to believe that it might be the only company that can ever hire people who write non-awful drivers, and will continue to be the only company that can write non-awful drivers.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#117
post #86
post #59

Earlier quoted context omitted.

Please do not give them this idea. Ubuntu is actually a pretty great daily driver desktop Linux, and I'd hate for that to lose priority and disappear. I'm not a fan of what happened to the Red Hat ecosystem for exactly the same reasons.

As someone who has used Ubuntu in the past and has now moved onto greener pastures, I appreciate everything Canonical and Ubuntu have done for the Linux community but there are many better options today and Canonical is already far from the company it once used to be.

There have always been better distributions than Ubuntu. That isn’t something new. What Canonical did better than anyone else was mass market appeal. Or at least appeal to a wider market than Linux traditionally had. But as someone who’s used Linux since the 90s, I was always underwhelmed by Ubuntu as a distribution.

That all said, I have to work with a lot of CentOS and Rocky workstations for VFX and I enjoy those for desktop Linux even less than Ubuntu.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#118

Double digit peta flop mass produced. "The computing power needed to replicate the human brain’s relevant activities has been estimated by various authors, with answers ranging from 10^12 to 10^28 FLOPS." Petaflop is 10^15 Crazy times.

I’ll be happy with this if we use it to design viable fusion power plants. And I’ll be severely disappointed if it’s mostly used for ad targeting.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#119
post #114
post #58

Earlier quoted context omitted.

Good luck with that. Gemini Advanced is simply unusable right now....It's so bad its hard to believe nobody picked up on that yet.

Go to Gemini Advanced and try a common programming task in Parallel with Claude and ChatGPT4. Within 2 prompts Claude and ChatGPT4 will give nice working code you can use as a basis while Gemini Advanced will ignore your prompts, provide partial code and quickly tell you it can do more, until you tell it exactly what you want. It will go from looking usable to stuck on "I can do A or I can do B you tell me what you p…

You're not wrong, but it wouldn't be surprising if Google irons things out with a few more updates. The point is that it would be foolish to write off Gemini right now, and Gemini is totally independent of Nvidia's dominance.

Re: Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

#120
post #64

What is FP4, 4 bit floating point? If so, the comparison graph [0] with 30x above Hopper was a bit misleading. [0] https://youtu.be/Y2F8yisiS6E?t=4698

>bit misleading.

Only partially, because in LLMs FP4 isn't half as useful as FP8. So if you have gear that crushes at FP4 then that's what you use and you benefit from that increased speed (at minimal accuracy loss).

Definitely some marketing creativity in there, but its not entirely wrong as a measure of real world usage

Post reply on HN