Japan Captures TOP500 Crown with Arm-Powered Supercomputer
31–40 of 220 posts
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#32Given that today's HPC architectures are mostly power constrained, and a majority of the FLOPS often come from GPUs (for their flop/watt ratios), this direction is not surprising. ARM has been making major strides in the high performance area. The new AWS Graviton processors are pretty nice from what I have heard. And then there's the ARM in Mac. Yup and Julia will run on all of these! While I say all of this, I shou…
Get ready for a surprise then: all those FLOPS are coming from the ARM cores.... This beast has no GPUs: https://postk-web.r-ccs.riken.jp/spec.html
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#33Earlier quoted context omitted.
A64fx have on board HMB -> that means no dram. If you look at the fugaku mother board their is no Dimm slots. All the memory is on the same package as the CPU. This delivers a huge boost in bandwith. HMB stand for high memory bandwidth. It offers up to 900 GB/s. Now if you add the tofu interconnect on top you have a systems finely tuned for maximising data movement. Remember : compute is cheap, communication is expen…
That's fascinating. I know that AMD has been touting HBM as a faster memory subsystem for their GPUs, is that the same as HMB where it's stacked? Or are they just calling it something similar?
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#34Earlier quoted context omitted.
Get ready for a surprise then: all those FLOPS are coming from the ARM cores.... This beast has no GPUs: https://postk-web.r-ccs.riken.jp/spec.html
So looking at anandtech's breakdown the CPUs are closer to a knights landing 'CPU/GPU' than a traditional CPU (currently). They also have a ton of HBM2 right next to the dies so this should be insanely fast as they can feed those cores very very quickly regardless of how fast each core is by clock and pipeline. That should massively reduce stalls.
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#35Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#36I suggest building a supercomputer out of Ivy Bridge Celerons. They are dirty cheap, like $2 in bulk, yet quite performant.
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#37Earlier quoted context omitted.
To be fair, I wouldn't host my website on my world-class supercomputer either, if I had one...
To be even fairer, I've served a shit ton of traffic on a small DigitalOcean droplet and never had issues because my stack is reasonable.
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#38Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#39Not to be dismissive, but can't anyone "build" the biggest supercomputer by reserving enough instances at AWS or GCP? I'm sure that AWS or GCP would like to encourage this competition, but it seems a bit, well, boring.
The ranking is calculated based on the Linpack benchmark. Being a parallel application, performance is not simply scaled to number of processors; the network interconnect is hugely important. Now, although Linpack is a better evaluation metric for a supercomputer than simply totaling up # of processors and RAM size, it's still a very specific benchmark of questionable real-world utility; people like it because it giv…
Combine this with the fact that many applications are limited by network throughput rather than by CPU/SSD/RAM/PCIE, and performance becomes a hard thing to quantify even in terms of "how many ARM cores do i need to buy to make my CPU not be the bottleneck"
There are benchmarks for ARM linux compilation and ARM openjdk performance benchmarks which are a good start, but I don't know how to compare SKUs between those ARMs and the ones found in top500 supercomputers.
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#40The site of the organisation responsible for assessing the fastest computers in the world succumbs to the hacker news hug of death.