Live data from Hacker News

Japan Captures TOP500 Crown with Arm-Powered Supercomputer

top500.org

131–140 of 220 posts

Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer

#131
post #5

Well the link is dead. But I am guessing it is from Fujitsu A64FX, a 512 bit SIMD extension for ARM. Edit: Turns out I was right. May be this link is better. https://www.anandtech.com/show/15869/new-1-supercomputer-fuj...

To be clear, the extension -- Scalable Vector Extensions -- is for any width between 128 bits and 2048 bits. (It's in the name!) The implementation in Fujitsu A64FX seems to be 512 bit specifically.

Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer

#133
post #123

I cannot think of any plausible way in which Apple could have influenced the date of this announcement, but the timing, given what is expected to be announced later today, is uncanny.

The chips in the supercomputer are not exactly ARM, they do have arm-8 instruction set but that's just for loading the proprietary vector extension unit. Pretty much a GPU alike stuff with arm-8 set to be able to run its OS.

[deleted]

Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer

#134
post #71

As I have said countless times in the past: - Moore's law is dead at the level of the transistor - Architecture, HPC updates will keep coming for many years into the future - AGI has already escaped Moore's law (i.e., development of a fully functional AGI will not be constrained by lack of Moore's law progress). And that's what really matters. - Related note on AGI: it has escaped the data problem as well (as in we h…

Why do you say that AGI has escaped Moore's law? Especially, how can you say so when you don't know what the right set of algorithms are?

Oh then you're not going to like what I'm going to say next:

- Somewhere between 2015 and 2025, multiple individual groups will have cracked the AGI problem independently. (but 2015 is in the past, which means there are likely groups out there that have cracked the problem and keeping it a secret).

- AGI-in-the-basement scenario is very doable and has been or will be done, many times over.

Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer

#135

The end of the US semiconductor industry is now in sight. The only US owned state of the art fabs in the US belong to Intel. Intel survives because they have a high margin on x86 CPUs. Today, TMSC announced 5nm, and the top supercomputer is ARM-based. Apple seems to be going ARM. Chromebooks are ARM. Microsoft now offers Windows on ARM, on the Surface Pro X. Mobile never used x86. x86 is on the way out. What's left f…

> The only US owned state of the art fabs in the US belong to Intel

Is the "US owned" clarification to exclude Global Foundries' New York fab? :D

> Chromebooks are ARM

Maybe half of them.

> What's left for Intel?

Fabricating others' designs like TSMC?

But also, Intel isn't going away any time soon, just not being a monopoly anymore.

Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer

#136
post #88

Earlier quoted context omitted.

That's pretty cool! That probably means that applications will have an easier time. Looks like it has 512-bit SIMD. I wonder what BLAS they are using, and if the contributions are open sourced.

(SVE isn't 512-bit SIMD like AVX512.) I don't know what BLAS they're using, though I know they've long worked on their own, but BLIS has gained SVE support recently, for what it's worth.

SVE is whatever width the chip designer wants, Fujitsu's implementation is 512-bit according to AnandTech

Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer

#137
post #19
post #11

Earlier quoted context omitted.

A64fx have on board HMB -> that means no dram. If you look at the fugaku mother board their is no Dimm slots. All the memory is on the same package as the CPU. This delivers a huge boost in bandwith. HMB stand for high memory bandwidth. It offers up to 900 GB/s. Now if you add the tofu interconnect on top you have a systems finely tuned for maximising data movement. Remember : compute is cheap, communication is expen…

That's fascinating. I know that AMD has been touting HBM as a faster memory subsystem for their GPUs, is that the same as HMB where it's stacked? Or are they just calling it something similar?

"HMB" is a typo, it is the same HBM.

And yeah.. honestly I'm surprised AMD didn't do the HBM-CPU thing first. An HBM2-powered EPYC would've been an amazing product.

Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer

#138
post #123

I cannot think of any plausible way in which Apple could have influenced the date of this announcement, but the timing, given what is expected to be announced later today, is uncanny.

The chips in the supercomputer are not exactly ARM, they do have arm-8 instruction set but that's just for loading the proprietary vector extension unit. Pretty much a GPU alike stuff with arm-8 set to be able to run its OS.

No, it's not a proprietary extension, it's Arm's Scalable Vector Extension!

Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer

#139
post #123

I cannot think of any plausible way in which Apple could have influenced the date of this announcement, but the timing, given what is expected to be announced later today, is uncanny.

The chips in the supercomputer are not exactly ARM, they do have arm-8 instruction set but that's just for loading the proprietary vector extension unit. Pretty much a GPU alike stuff with arm-8 set to be able to run its OS.

I do not get the "not exactly ARM" bit. The chip has a lot of cores that execute standard ARM code with SVE instructions mixed in. You can download the manual for the SVE from ARM's website. Following a quick search I also see that GCC has a flag for generating SVE instructions.

Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer

#140

The end of the US semiconductor industry is now in sight. The only US owned state of the art fabs in the US belong to Intel. Intel survives because they have a high margin on x86 CPUs. Today, TMSC announced 5nm, and the top supercomputer is ARM-based. Apple seems to be going ARM. Chromebooks are ARM. Microsoft now offers Windows on ARM, on the Surface Pro X. Mobile never used x86. x86 is on the way out. What's left f…

> The only US owned state of the art fabs in the US belong to Intel Is the "US owned" clarification to exclude Global Foundries' New York fab? :D > Chromebooks are ARM Maybe half of them. > What's left for Intel? Fabricating others' designs like TSMC? But also, Intel isn't going away any time soon, just not being a monopoly anymore.

Global Foundries New York fab (Fab 8), from Wikipedia:

Technology: 28 nm and 14 nm. 7 nm planned. However, in August 2018, GlobalFoundries made the decision to suspend 7 nm development and planned production, citing the unaffordable costs to outfit Fab 8 for 7 nm production. GlobalFoundries held open the possibility of resuming 7 nm operations in the future if additional resources could be secured.

So, not a state of the art fab. Couldn't afford to keep up.

Post reply on HN