Live data from Hacker News

Nvidia CEO Introduces Nvidia Ampere Architecture, Nvidia A100 GPU

blogs.nvidia.com

81–90 of 347 posts

Re: Nvidia CEO Introduces Nvidia Ampere Architecture, Nvidia A100 GPU

#81
post #23
post #16

Probably even more closed than ever. They tend to become more and more restrictive with every new hardware generation. I wonder where their promised open source announcement they preannounced before.

Yeah. That's been my general problem with adopting NVidia for anything. They make good hardware, but there's a lot of lock-in, and not a lot of transparency. That introduces business risk. I'm not in a position where I need GPGPU, but if there wasn't that risk, and generally there were mature, open standards, I'd definitely use it. The major breakpoint would be when libraries like Numpy do it natively, and better yet…

> The major breakpoint would be when libraries like Numpy do it natively

That already happened [0]. NVIDIA has a 1:1 replacement for Numpy called CuPy that does this and is what powers their RAPIDS framework (which is a 1:1 replacement for Pandas that runs on GPUs).

Some people were complaining in [0] about CuPy reproducing numpy's bugs..

[0]: https://news.ycombinator.com/item?id=22830201

Re: Nvidia CEO Introduces Nvidia Ampere Architecture, Nvidia A100 GPU

#82
post #71

The numbers for their SATURNV supercomputer are either untrue or absolutely staggering. 4.6 exaflops? #1 on the Top 500 list of supercomputers just barely passed 200 petaflops at peak performance. If you add up the entire list you only get 1.65 exaflops. And LINPACK isn't usually network-bound. How can this possibly be true?

[deleted]

Re: Nvidia CEO Introduces Nvidia Ampere Architecture, Nvidia A100 GPU

#83
post #3

Oof. Double-precision is only 2.5x better, which is less impressive than 20x for float. I still haven't found anything more cost-effective for double precision data processing (cost + dev time) than a rack full of used Xeons...

Titan V100's are pretty good for double precision, needs almost same operation intensity as Xeons to fully utilize them.

Re: Nvidia CEO Introduces Nvidia Ampere Architecture, Nvidia A100 GPU

#85
post #80

Earlier quoted context omitted.

Epic demo was running on PS5 so no NVIDIA involvement there.

Oh yes, I forgot they've entirely lost this console generation.

Well not entirely (and depending on what you count as this console generation): the Nintendo Switch is based on an NVidia SOC. Although that's probably not the biggest money maker.

Re: Nvidia CEO Introduces Nvidia Ampere Architecture, Nvidia A100 GPU

#86
post #65
post #33

In my experience, Jensen Huang's keynotes are unprofessional in the best possible way. I remember thinking during an entire GTC presentation "Wait, this guy is the CEO?" He seemed like an excited engineer who happened to stumble onto stage.

Did you see his video before the keynote? I had a good chuckle. https://www.youtube.com/watch?v=So7TNRhIYJ8

That’s a fancy kitchen.

Re: Nvidia CEO Introduces Nvidia Ampere Architecture, Nvidia A100 GPU

#87
post #64

The TensorFloat-32 results look really impressive, but yikes that is not a good name. "TensorFloat" is extremely confusable with "TensorFlow," and it would really more accurately be called a 19 bit format.

'brain floating point' is also bad, but no one cares because it's just bfloat16. If this becomes popular, it will just be tf32 or tfloat32 or something.

Re: Nvidia CEO Introduces Nvidia Ampere Architecture, Nvidia A100 GPU

#89
post #33

In my experience, Jensen Huang's keynotes are unprofessional in the best possible way. I remember thinking during an entire GTC presentation "Wait, this guy is the CEO?" He seemed like an excited engineer who happened to stumble onto stage.

Love his informal style. This video from him presenting at Stanford about the beginnings of Nvidia is so awesome exactly for that reason: "...You talk about that for about 6 months. The big event for the day would be 'Hey, where do you guys want to go for lunch?'" Beautiful when you pair it with the fact that they built a company worth many billions of dollars.

https://youtu.be/yU3GUHDf0mk

Re: Nvidia CEO Introduces Nvidia Ampere Architecture, Nvidia A100 GPU

#90
post #18

I'm confused. Is there any relationship between the recent Ampere Arm64 servers ( https://news.ycombinator.com/item?id=22475036 ) and Nvidia's "Ampere Architecture", or is it just a case of them using the same name?

I don't like that people downvoted you for asking a question. If someone thinks the question is stupid or not doesn't mean that a downvote is warranted. (nor an upvote, answer the question and move on.) To answer though; it's just a coincidence, as you might already know Nvidia uses famous scientists (especially in the field of electricity) as the names of their microarchitectures. * Volta (Alessandro Volta, inventor…

I'm sure Nvidia is paying a nice licensing fee to Ampere for the registered trademark. Otherwise it'd be sheer stupidity.
Post reply on HN