Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’

Post by PartiallyTyped » Tue, Mar 19, 2024, 6:55 AM UTC

acchow wrote: post #10

jairuhme wrote: post #7

I haven't listened to Jensen speak before, but am I the only one who thought the presentation wasn't very polished? Not a knock on anything he has accomplished, just an observation that sorta surprised me

He has more important things to do than perfecting a presentation. He likes his employees to message him freely with things they think he can help with.

Post by neverokay » Tue, Mar 19, 2024, 7:03 AM UTC

joshellington wrote: post #206

neverokay wrote: post #203

Earlier quoted context omitted.

Doesn’t matter how good your in-house tech team was, your company still outsourced it to cloud infra. That’s what Nvidia faces. Doesn’t matter how good the current in-house teams are using direct hardware, the trend in corporate is shift to a vendor (Google/AWS). Nvidia can watch this inevitable shift or get ready to offer itself as a platform too.

I get it, the service model always shines the brightest in the eye of the revenue calculator. But I have immediate skepticism they’ll be able to execute at a competitive level. Their core competency has always been manufacture and production, not service-based things. It’s a big rock to push up a tall hill.

Post by creshal » Tue, Mar 19, 2024, 7:05 AM UTC

wmf wrote: post #188

LTL_FTC wrote: post #180

Earlier quoted context omitted.

Did you read that in the linked article? I couldn’t find it. But maybe due to the better efficiency with regard to the performance boost (5x) and the ability to now use 27 trillion parameters versus 1.7 Trillion, one can presumably finish the same amount of work in 1/25th of the time and bam, reduction in power consumption. As you say, I’m skeptical the max power draw itself is 25x lower.

I think Jensen said something like needing 25x fewer GPUs (vs. A100) to get the same performance, which amounts to essentially the same thing.

Post by unmole » Tue, Mar 19, 2024, 7:27 AM UTC

xarope wrote: post #193

xmprt wrote: post #86

Earlier quoted context omitted.

As someone who has used Ubuntu in the past and has now moved onto greener pastures, I appreciate everything Canonical and Ubuntu have done for the Linux community but there are many better options today and Canonical is already far from the company it once used to be.

what would your top suggestions be for server or desktop, instead of ubuntu? Arch (too unstable for server?), Silverblue?

Post by omnimus » Tue, Mar 19, 2024, 7:43 AM UTC

joshellington wrote: post #206

neverokay wrote: post #203

Earlier quoted context omitted.

Doesn’t matter how good your in-house tech team was, your company still outsourced it to cloud infra. That’s what Nvidia faces. Doesn’t matter how good the current in-house teams are using direct hardware, the trend in corporate is shift to a vendor (Google/AWS). Nvidia can watch this inevitable shift or get ready to offer itself as a platform too.

I get it, the service model always shines the brightest in the eye of the revenue calculator. But I have immediate skepticism they’ll be able to execute at a competitive level. Their core competency has always been manufacture and production, not service-based things. It’s a big rock to push up a tall hill.