Live data from Hacker News

Nvidia will build 700-petaflop supercomputer for University of Florida

venturebeat.com

31–40 of 112 posts

Re: Nvidia will build 700-petaflop supercomputer for University of Florida

#31

I'm a bit baffled. How high are the tuitions at the university of florida? This supercomputer is more powerful than many at the national labs and must cost a fortune (multiple 100 millions of dollars).

Research at most US major universities is funded from federal grants, not from tuition. A place like the University of Florida, MIT, Michigan State, whatever, is conducting research with government money in a manner very similar to a national lab.

Re: Nvidia will build 700-petaflop supercomputer for University of Florida

#33

Does anyone know why everyone is still buying Nvidia instead of custom AI accelerators from other vendors? For example, on paper the new Graphcore machines look like an easy win, or at least a risk worth taking. (I see this particular supercomputer was funded by Nvidia but my question is about the general trend).

Risk mitigation, maintenance, resell value (?), support, reliability. The custom AI accelerators you mentioned, how long have those been in business for? How many units have they moved? How many generations of hardware have they produced? Will they still be around to replace or upgrade units in 5-10 years? How flexible are they in their workload?

That's a lot of factors to keep in mind when you're spending millions on a supercomputer. I'd go for an established hardware provider as well. I'm not knocking the custom AI chips, but I wouldn't try and max out my budget with those - keep them for smaller applications for now.

Re: Nvidia will build 700-petaflop supercomputer for University of Florida

#34

Does anyone know why everyone is still buying Nvidia instead of custom AI accelerators from other vendors? For example, on paper the new Graphcore machines look like an easy win, or at least a risk worth taking. (I see this particular supercomputer was funded by Nvidia but my question is about the general trend).

From my very limited understanding the Graphcore machines outperform CUDA only significantly in inference, in training the improvements might not be sufficient to switch technology.

Re: Nvidia will build 700-petaflop supercomputer for University of Florida

#35

Does anyone know why everyone is still buying Nvidia instead of custom AI accelerators from other vendors? For example, on paper the new Graphcore machines look like an easy win, or at least a risk worth taking. (I see this particular supercomputer was funded by Nvidia but my question is about the general trend).

Risk mitigation, maintenance, resell value (?), support, reliability. The custom AI accelerators you mentioned, how long have those been in business for? How many units have they moved? How many generations of hardware have they produced? Will they still be around to replace or upgrade units in 5-10 years? How flexible are they in their workload? That's a lot of factors to keep in mind when you're spending millions o…

Your supercomputer won’t last more than a couple years, 5 at max. Then it will simply be unjustifiably expensive to run when newer, more power efficient hardware becomes available.

What matters is the software platform and compatibility: you don’t want to retool and port all your existing programs. That’s where having a platform - CUDA - becomes a deal-maker.

What I don’t understand is how consumers - big, institutional consumers- don’t insist on viable vendor neutral platforms like OpenCL. Obviously they’re the only ones that have an interest in cross-vendor compatibility.

Re: Nvidia will build 700-petaflop supercomputer for University of Florida

#36
post #35

Earlier quoted context omitted.

Risk mitigation, maintenance, resell value (?), support, reliability. The custom AI accelerators you mentioned, how long have those been in business for? How many units have they moved? How many generations of hardware have they produced? Will they still be around to replace or upgrade units in 5-10 years? How flexible are they in their workload? That's a lot of factors to keep in mind when you're spending millions o…

Your supercomputer won’t last more than a couple years, 5 at max. Then it will simply be unjustifiably expensive to run when newer, more power efficient hardware becomes available. What matters is the software platform and compatibility: you don’t want to retool and port all your existing programs. That’s where having a platform - CUDA - becomes a deal-maker. What I don’t understand is how consumers - big, institutio…

CUDA is valuable and seen as a positive, even if it's vendor locked. It's battle tested. Engineers are familiar with it. Support is provided because it's all under one roof. Performance targets, roadmap timeframes, etc can be assured.

The same reason a big institutional consumer will happily pay Microsoft for Windows Enterprise, instead of demanding Microsoft rebuild Windows using open source technologies.

A supercomputer or DC cluster has a fixed lifespan and amortization period, if you can get something in a contract, with everything you want for a price you are happy with, why would you introduce risk to it by demanding open standards for no benefit?

Re: Nvidia will build 700-petaflop supercomputer for University of Florida

#37
post #26

Earlier quoted context omitted.

I'm in favor of getting high powered compute in everyone's hands, so this is great to me.

Why? I mean, we already have (my old 2013 desktop would - I guess - compete with a cray 1 from the 1980s). What do you expect will happen if people get more CPU?

Better simulations? Successfully working on previously intractable problems?

Re: Nvidia will build 700-petaflop supercomputer for University of Florida

#38

Does anyone know why everyone is still buying Nvidia instead of custom AI accelerators from other vendors? For example, on paper the new Graphcore machines look like an easy win, or at least a risk worth taking. (I see this particular supercomputer was funded by Nvidia but my question is about the general trend).

There is a trend towards larger models in the state of the art of deep learning research. The total cost of the on-chip memory on the NVidia GPU is still a good value proposition compared to current custom deep learning accelerators. This cost to get to large on-chip memory, combined with the flexibility of CUDA for other types of scientific applications, makes it harder for such accelerators to compete with Nvidia in such large academic research clusters. I hope that this situation changes over the next couple of years.

Re: Nvidia will build 700-petaflop supercomputer for University of Florida

#40

I'm a bit baffled. How high are the tuitions at the university of florida? This supercomputer is more powerful than many at the national labs and must cost a fortune (multiple 100 millions of dollars).

In addition to what everyone else has said, UF has over 50,000 students, making it one of the five largest universities in the USA, iirc.
Post reply on HN