Live data from Hacker News

Nvidia will build 700-petaflop supercomputer for University of Florida

venturebeat.com

101–110 of 112 posts

Re: Nvidia will build 700-petaflop supercomputer for University of Florida

#103
post #70

Earlier quoted context omitted.

All 50k Students aren't engineers...

As a UF CS grad, I bet less than 100 students will get hands on this computer each year. Maybe way less than 100. Although I wasn't a graduate student so maybe way more of them have access than I realize.

i don't know how far off you are but i had access to an 8GPU allocation last fall and all I had to do was ask. longer term would've cost money though. Interesting fact was someone in the chemistry department had something like a 360GPU allocation (probably for DFT).

Re: Nvidia will build 700-petaflop supercomputer for University of Florida

#105
post #94
post #13

Sigh, I wish people wouldn’t say “peta flop ” for these. https://www.nvidia.com/en-us/data-center/a100/ is the most official reference. If you scroll to the bottom, you’ll see that an A100 part can do ~20 Teraflops (either FP32 or FP64 in little-matrix aka tensor mode). When they say “each A100 can do 5 petaflops”, they mean each DGX which has 8 such cards and thus they mean 600-ish something-ops per card. The genero…

I agree with you as well as with the response to your comment, in that both nVidia and Google are engaging in misleading claims about their TPUs. But I'd like to add two points: - I don't think they can get away with it when it comes to Top-500 rankings. Those rankings are based on LINPACK scores and this supercomputer would end up not scoring high enough and will be placed in the right spot in the list. So it's not…

Fuly agree - TL;DR pick the right benchmark.

If you are doing AI the Top500,is meaningless and if you are doing classical HPC these ExaFlop int8 supercomputers are meaningless

Re: Nvidia will build 700-petaflop supercomputer for University of Florida

#106
post #85
post #9

Earlier quoted context omitted.

It's $50 million. That's all. See https://blogs.nvidia.com/blog/2020/07/21/university-of-flori... for the numbers. It's probable the hardware is being offered at a deep discount. The building and infrastructure will cost an additional $20m, covered by the University.

I dunno if there's a deep discount. This is 140 DGX A100 systems. The advertised price for each DGX A100 is $199,000, so 140 of them is ~$28 million. It's plausible the networking, storage, cooling, power distribution, etc (i.e. everything but the compute nodes) could cost $22 million.

Yes, I think the 50 mil number was off. Add discounts, tax breaks etc., and we are talking less than sticker price for the whole setup minus real estate.

Re: Nvidia will build 700-petaflop supercomputer for University of Florida

#107
post #93
post #84

Earlier quoted context omitted.

You're the "disclaimer: I work for google cloud" person, right? Maybe you can help solve this problem (and it's a real one, it massively sucks that everyone counts whatever "flops" they want). Start here: https://cloud.google.com/tpu > Cloud TPU v3 Pod > 100+ petaflops Is the Cloud TPU v3 even functionally capable of computing in fp64 at any performance?

Yes, (and I considered including that disclaimer). I give them shit about that all the time. I'm an equal-opportunity complainer.

I'm glad to hear it.

but it's sorta disheartening that whoever makes these decisions apparently don't care. Marketing going to market, I guess.

Re: Nvidia will build 700-petaflop supercomputer for University of Florida

#108
post #104

Just baffling that they were on the verge of closing their CS department 8 years ago. https://www.forbes.com/sites/stevensalzberg/2012/04/22/unive...

I think this was a bit of a clickbait headline, and the real story was bit more nuanced. They were trying to do some reorgs (kind of like merging/splittling different CS, ECE, Information Systems etc. depts.).

Re: Nvidia will build 700-petaflop supercomputer for University of Florida

#109
post #107
post #93

Earlier quoted context omitted.

Yes, (and I considered including that disclaimer). I give them shit about that all the time. I'm an equal-opportunity complainer.

I'm glad to hear it. but it's sorta disheartening that whoever makes these decisions apparently don't care. Marketing going to market, I guess.

> Marketing going to market

This is one of those situations where the vulgate enhances comprehension - here eliminating ambiguity:

Marketing gonna market

Re: Nvidia will build 700-petaflop supercomputer for University of Florida

#110
post #12

I'm a bit baffled. How high are the tuitions at the university of florida? This supercomputer is more powerful than many at the national labs and must cost a fortune (multiple 100 millions of dollars).

No, those national lab supercomputers typically quote double-precision flops, whereas this appears to be about float16 tensor ops for inner product (they call it "AI flops"). The A100 is 9.7 general purpose Tflops of float64, versus 624 Tflops of float16 / bfloat16 (perhaps also just tensor cores not general purpose)? So quoting it the same way, this Florida machine would only be a (700 * (9.7 / 624)) = 10.9 Pflop su…

besides, the next generation of cray (Shasta) provides an on prem cloud environment where you can get 1000 computers or one supercomputer depending on your needs. I think that's a better deal than a supercomputer that can't do anything else.

one day when disaggregated hardware becomes common in data centers the idea of a supercomputer will seem dated

Post reply on HN