The knowledge came from former ASML employees. I wonder if countries will sanction these individuals given the geopolitical implications of their assistance.
How China built its ‘Manhattan Project’ to rival the West in AI chips
121–130 of 645 posts
Re: How China built its ‘Manhattan Project’ to rival the West in AI chips
#122World has gained so much from modern Chinese industrial revolution. Why suddenly everyone got cold feet? Nobody was stopping Germany or Japan on their way up even though they were literal former enemies with history of brutal warfare. China never done anything even comparable to others.
Re: How China built its ‘Manhattan Project’ to rival the West in AI chips
#123The knowledge came from former ASML employees. I wonder if countries will sanction these individuals given the geopolitical implications of their assistance.
Controversial and possibly politically incorrect take, but the People's Republic of China sends many, many, of its citizens to study at top universities and work at top companies all over the world. I'm sure even at sensitive defense related orgs too. While I am sure that the vast majority of them are just regular people, I'm also pretty sure there are True Believers amongst them whose mission is to go out into the w…
Re: How China built its ‘Manhattan Project’ to rival the West in AI chips
#124Also interesting huge project: China is building a $116 billion dam which, according to Bloomberg, is expected to generate 70 GW, just to compare: UK whole capacity (de-rated) is around 70 GW. https://www.youtube.com/watch?v=zAwJESmfy10
Re: How China built its ‘Manhattan Project’ to rival the West in AI chips
#125Earlier quoted context omitted.
Its not really just that AMD drivers are not that great (they are not) but they have been stable for a long time. Its that nvidia relentlessly works with game developers to make sure their graphics tricks work with nvidia drivers. Its so obvious you miss it. Look in the nvidia driver updates they always list games that have fixes, performance ect. AMD never (used?) to do this they just gave you the drivers and expect…
The whole “improve a game’s performance on the driver side” thing: does AMD simply not do that at all? Or just far less?
Re: How China built its ‘Manhattan Project’ to rival the West in AI chips
#126The knowledge came from former ASML employees. I wonder if countries will sanction these individuals given the geopolitical implications of their assistance.
Controversial and possibly politically incorrect take, but the People's Republic of China sends many, many, of its citizens to study at top universities and work at top companies all over the world. I'm sure even at sensitive defense related orgs too. While I am sure that the vast majority of them are just regular people, I'm also pretty sure there are True Believers amongst them whose mission is to go out into the w…
Re: How China built its ‘Manhattan Project’ to rival the West in AI chips
#127Earlier quoted context omitted.
The general trend of the industry is to move computational resources from the hands of users into data centers, so that they can control what can be done and how much they'll charge for computational services. In the medium term, a lot of what we take for granted nowadays will only be accessible from cloud providers and companies will pay more and more in subscriptions for these services.
Isn’t that mostly economics? I definitely prefer using Claude to GPT-OSS120B for a code assistant. I don’t know about you, but I don’t have $500,000 laying around to buy myself a DGX B200 with a TB of HBM and 2TB of system ram, nor the 14.3kW of power to run the thing.
Re: How China built its ‘Manhattan Project’ to rival the West in AI chips
#128Earlier quoted context omitted.
You don't need CUDA for gaming but software is still just as big of a moat. Gaming GPU drivers are complex and have tons of game-specific patches. With their new Radeon/RDNA architecture it took AMD years to overcome their reputation for having shitty drivers on their consumer GPUs (and that reputation was indeed deserved early on). And I bet if you go read GPU discussion online today you'll still find people who avo…
Cuda is 20 years old and it shows. Time for a new language that fixes the 20 years of rough edges. The Guy (Lattner) who made LLVM is working on this: https://www.modular.com/mojo Good podcast on him: https://newsletter.pragmaticengineer.com/p/from-swift-to-moj...
Mojo looked promising initially. The more details we got though, the more it became apparent that they weren't interested in actually competing with Nvidia. Mojo doesn't replace the majority of what CUDA does, it doesn't have any translation or interoperability with CUDA programs. It uses a proprietary compiler with a single implementation. They're not working in conjunction with any serious standardization orgs, they're reliant on C/C++ FFI for huge amounts of code and as far as I'm aware there's no SemVer of compute capability like CUDA offers. The more popular Mojo gets, the more entrenched Nvidia (and likely CUDA) will become. We need something more like OpenGL with mutual commitment from OEMs.
Lattner is an awesome dude, but Mojo is such a trend-chasing clusterfuck that I don't know what anyone sees in it. I'm worried that Apple's "fuck the dev experience" attitude rubbed off on Chris in the long run, and made him callous towards appeals to openness and industry-wide consortiums.
Re: How China built its ‘Manhattan Project’ to rival the West in AI chips
#129Earlier quoted context omitted.
Yeah PRC probably going to dump 1T into indigenize semi efforts by end of decade, but IMO good chance they're going to treat strategic semi as commodity utility business than make NASDAQ lines go up model. When western semi has 1st tier suppliers taking 30% margin, asml taking 50%, tsmc taking 50%, nvidia taking lol 70%, there's alot of fat on the pyramid to trim. PRC doing cost plus 10-20% will basically be able to…
The NASDAQ line go up model is why the AI boom is happening and a major factor in why it is Western companies leading the charge. The more bigger issue is that the west refused to sell chips to China so they had to figure out how to make their own. And margin compression is what free markets do. That is one of the big motivators to putting free markets everywhere, the freer the market the more compressed the margins…
Re: How China built its ‘Manhattan Project’ to rival the West in AI chips
#130Earlier quoted context omitted.
I know mass media keeps pounding this "eventual scenario" (manufacturing consent and all). Maybe it will happen, but the Chinese think on longer timelines than the ADHD West and are probably banking on A). Out-attriting, B). Out-innovating. If both happen, we might find ourselves with a situation where Taiwan voluntarily wants to align closer with China as the West flails.
China know that the one child policy has fucked their demographics and that their future isn't as rosy as it might appear now