Well the link is dead. But I am guessing it is from Fujitsu A64FX, a 512 bit SIMD extension for ARM. Edit: Turns out I was right. May be this link is better. https://www.anandtech.com/show/15869/new-1-supercomputer-fuj...
Japan Captures TOP500 Crown with Arm-Powered Supercomputer
131–140 of 220 posts
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#132https://www.hotchips.org/hc30/2conf/2.13_Fujitsu_HC30.Fujits...
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#133I cannot think of any plausible way in which Apple could have influenced the date of this announcement, but the timing, given what is expected to be announced later today, is uncanny.
The chips in the supercomputer are not exactly ARM, they do have arm-8 instruction set but that's just for loading the proprietary vector extension unit. Pretty much a GPU alike stuff with arm-8 set to be able to run its OS.
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#134As I have said countless times in the past: - Moore's law is dead at the level of the transistor - Architecture, HPC updates will keep coming for many years into the future - AGI has already escaped Moore's law (i.e., development of a fully functional AGI will not be constrained by lack of Moore's law progress). And that's what really matters. - Related note on AGI: it has escaped the data problem as well (as in we h…
Why do you say that AGI has escaped Moore's law? Especially, how can you say so when you don't know what the right set of algorithms are?
- Somewhere between 2015 and 2025, multiple individual groups will have cracked the AGI problem independently. (but 2015 is in the past, which means there are likely groups out there that have cracked the problem and keeping it a secret).
- AGI-in-the-basement scenario is very doable and has been or will be done, many times over.
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#135The end of the US semiconductor industry is now in sight. The only US owned state of the art fabs in the US belong to Intel. Intel survives because they have a high margin on x86 CPUs. Today, TMSC announced 5nm, and the top supercomputer is ARM-based. Apple seems to be going ARM. Chromebooks are ARM. Microsoft now offers Windows on ARM, on the Surface Pro X. Mobile never used x86. x86 is on the way out. What's left f…
Is the "US owned" clarification to exclude Global Foundries' New York fab? :D
> Chromebooks are ARM
Maybe half of them.
> What's left for Intel?
Fabricating others' designs like TSMC?
But also, Intel isn't going away any time soon, just not being a monopoly anymore.
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#136Earlier quoted context omitted.
That's pretty cool! That probably means that applications will have an easier time. Looks like it has 512-bit SIMD. I wonder what BLAS they are using, and if the contributions are open sourced.
(SVE isn't 512-bit SIMD like AVX512.) I don't know what BLAS they're using, though I know they've long worked on their own, but BLIS has gained SVE support recently, for what it's worth.
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#137Earlier quoted context omitted.
A64fx have on board HMB -> that means no dram. If you look at the fugaku mother board their is no Dimm slots. All the memory is on the same package as the CPU. This delivers a huge boost in bandwith. HMB stand for high memory bandwidth. It offers up to 900 GB/s. Now if you add the tofu interconnect on top you have a systems finely tuned for maximising data movement. Remember : compute is cheap, communication is expen…
That's fascinating. I know that AMD has been touting HBM as a faster memory subsystem for their GPUs, is that the same as HMB where it's stacked? Or are they just calling it something similar?
And yeah.. honestly I'm surprised AMD didn't do the HBM-CPU thing first. An HBM2-powered EPYC would've been an amazing product.
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#138I cannot think of any plausible way in which Apple could have influenced the date of this announcement, but the timing, given what is expected to be announced later today, is uncanny.
The chips in the supercomputer are not exactly ARM, they do have arm-8 instruction set but that's just for loading the proprietary vector extension unit. Pretty much a GPU alike stuff with arm-8 set to be able to run its OS.
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#139I cannot think of any plausible way in which Apple could have influenced the date of this announcement, but the timing, given what is expected to be announced later today, is uncanny.
The chips in the supercomputer are not exactly ARM, they do have arm-8 instruction set but that's just for loading the proprietary vector extension unit. Pretty much a GPU alike stuff with arm-8 set to be able to run its OS.
Re: Japan Captures TOP500 Crown with Arm-Powered Supercomputer
#140The end of the US semiconductor industry is now in sight. The only US owned state of the art fabs in the US belong to Intel. Intel survives because they have a high margin on x86 CPUs. Today, TMSC announced 5nm, and the top supercomputer is ARM-based. Apple seems to be going ARM. Chromebooks are ARM. Microsoft now offers Windows on ARM, on the Surface Pro X. Mobile never used x86. x86 is on the way out. What's left f…
> The only US owned state of the art fabs in the US belong to Intel Is the "US owned" clarification to exclude Global Foundries' New York fab? :D > Chromebooks are ARM Maybe half of them. > What's left for Intel? Fabricating others' designs like TSMC? But also, Intel isn't going away any time soon, just not being a monopoly anymore.
Technology: 28 nm and 14 nm. 7 nm planned. However, in August 2018, GlobalFoundries made the decision to suspend 7 nm development and planned production, citing the unaffordable costs to outfit Fab 8 for 7 nm production. GlobalFoundries held open the possibility of resuming 7 nm operations in the future if additional resources could be secured.
So, not a state of the art fab. Couldn't afford to keep up.