Damn I should have followed that Pelosi trade last month. They aren't even trying to hide it anymore
US Government Bans Export of Nvidia A100 and H100 GPUs to China and Russia
541–550 of 645 posts
Re: US Government Bans Export of Nvidia A100 and H100 GPUs to China and Russia
#542Earlier quoted context omitted.
It's a gradient. How you throw things down on that is up to you. Guantanamo vs. reeducation and labor camps. Paying judges to help keep the local juvenile prison full vs. harvesting organs from prisoners. Suppression of free speech and the media vs. whatever we see on Twitter daily. Civilized or not is up to your perspective.
More like US prison system vs Chinese “camps”. One look at the numbers shows which of those is more oppressive. This includes things like slave labour: https://www.theguardian.com/us-news/2022/jun/15/us-prison-wo...
It's impossible to quantify oppressive. We don't know much about Chinese labor camps or re-education centers.
Even if we did, how do you measure up acts done in these places against one another? Is making license plates for pennies in the US better or worse than making t-shirts in Xinjiang? Is being wrongfully thrown in prison due to a prejudice judge seeing your only skin color worse than being thrown into prison for being Muslim who refuses to shave their beard?
Re: US Government Bans Export of Nvidia A100 and H100 GPUs to China and Russia
#543Earlier quoted context omitted.
> Under the Export Control Reform Act of 2018 (50 U.S.C. §§ 4801-4852) (ECRA), criminal penalties can include up to 20 years of imprisonment and up to $1 million in fines per violation, or both. I work in CPU design and I wouldn't risk it.
I'll eat a hat if any major league manager in the US who could decide this ever goes to prison. To be clear, I'd celebrate it, but the mortgage crisis showed that laws and punishment hardly work on top level execs.
You do. not. FUCK. with. ITAR. The penalties are very steep. When you get caught, intentional violations can have jail time attached for the responsible parties (ie. intentional data breaches would fall on the CISO or closest equivalent). If there is one thing the US government takes very seriously, it's military and defense. They have, and will, fine a company that doesn't get it's shit together into the ground.
Re: US Government Bans Export of Nvidia A100 and H100 GPUs to China and Russia
#544USA loves the free market, as long as they own most of it. So much for their talk about the future of glorious globalization.
Pretty sure during the 2016 election the mantra of anti-globalism was the war cry of the winning party.
Re: US Government Bans Export of Nvidia A100 and H100 GPUs to China and Russia
#545This doesn't just ban A100s. It bans those and "any future NVIDIA integrated circuit achieving both peak performance and chip-to-chip I/O performance equal to or greater than thresholds that are roughly equivalent to the A100." It's a ceiling on the performance that can be exported. In an exponentially scaling industry, this is the equivalent of an announcement in advance of a complete ban on competitive products 2-3…
Are these GPUs being produced in china? Maybe china will ban shipping these to the US?
Nvidia does their main chip fab in Taiwan AFAIK, along with a large number of other companies. It's one of the reasons tensions over Taiwan are worrying. China could blockade or invade Taiwan and start a "shortage" far worse than anything we've seen recently if they decided it was necessary/worthwhile.
Re: US Government Bans Export of Nvidia A100 and H100 GPUs to China and Russia
#546USA loves the free market, as long as they own most of it. So much for their talk about the future of glorious globalization.
Globalization has ended with the Russian invasion on Ukraine. What we are seeing now is a huge "divorce" between the West and China/Russia that will only get more and more intense as the international order no longer works for the biggest players.
I think the US finally realized they can not compete in a globalized world and keep 8000m people obedient and dependent, so the push to partition the world to remain relevant and competitive has now come.
What's worse is that the US is fully aware this could result in another European war, and they coldly calculate that the US mainland would be entirely spared of damage, and that the US would be the single condition for the rebuilding of Europe with unpresedented control over politics, trade, and economy.
Re: US Government Bans Export of Nvidia A100 and H100 GPUs to China and Russia
#547This doesn't just ban A100s. It bans those and "any future NVIDIA integrated circuit achieving both peak performance and chip-to-chip I/O performance equal to or greater than thresholds that are roughly equivalent to the A100." It's a ceiling on the performance that can be exported. In an exponentially scaling industry, this is the equivalent of an announcement in advance of a complete ban on competitive products 2-3…
No surprise. I imagine they'll just buy older and/or more stable stock. Worked on a three 50U rack recently with quad T4's per 2U and we're not even through 10% of that order yet.
Yeah I mean, great for running inference (and obviously training smaller models). The problem is that Scaling Laws for Transformers show us that scaling model parameter count _up_, is a sure way to improve the model's performance over your task.
So when you're playing nation-state hard-ball, since the architectures are _somewhat_ trivially copied upon being published, that means the best checkpoint goes to the one with the fastest GPU's. If China wasn't behind in deep learning, they will be.
Re: US Government Bans Export of Nvidia A100 and H100 GPUs to China and Russia
#548Earlier quoted context omitted.
> Even if they do they are far away from fabrication. Where do you think most of the electronics is manufactured?
State-of-the-art chip fabrication is still mostly based in Taiwan, with TSMC (as an example: the BR100, China's most recent native flagship gpu, is fabbed using TSMC) - China's own SMIC has appeared to struggle However, they seem to have been catching up fairly quickly - until very recently SMIC have been stuck around 14nm (state of the art in 2013, SMIC in 2019), but they recently announced they have managed to star…
Take Chinese announcements with a grain of salt. It’s the same as “IBM produced 0.1 nm transistor” stuff. It’s far from production.
They’ll get there eventually though.
Re: US Government Bans Export of Nvidia A100 and H100 GPUs to China and Russia
#549Earlier quoted context omitted.
Globalization has ended with the Russian invasion on Ukraine. What we are seeing now is a huge "divorce" between the West and China/Russia that will only get more and more intense as the international order no longer works for the biggest players.
I think the US finally realized they can not compete in a globalized world and keep 8000m people obedient and dependent, so the push to partition the world to remain relevant and competitive has now come. What's worse is that the US is fully aware this could result in another European war, and they coldly calculate that the US mainland would be entirely spared of damage, and that the US would be the single condition…
Ok, but Russia invaded Ukraine. Unless the US controls Russia now, too.
Re: US Government Bans Export of Nvidia A100 and H100 GPUs to China and Russia
#550Serious Question: What about the Apple M[x] series things? The M2 integrates an Apple designed ten-core (or eight-core) graphics processing unit (GPU). Each GPU core is split into 32 execution units, which each contain eight arithmetic logic units (ALUs). In total, the M2 GPU contains up to 320 execution units or 2,560 ALUs, which have a maximum floating point (FP32) performance of 3.6 TFLOPs.
They banned a 156 TFLOP chip, Apple's relatively pathetic 3.6 TFLOP GPU is safe.
I didn't mean this to snarky, sorry!