This time AMD will win for sure (Copium)
AMD market cap is bigger than Intel.
AMD leaps after launching AI chip that could challenge Nvidia dominance
31–40 of 89 posts
Re: AMD leaps after launching AI chip that could challenge Nvidia dominance
#32AMD needs to launch drivers, not chips. Who’s going to develop ML models on a card that can’t connect to a popular ML model? I look at their financial performance and it’s staggering how they’ve missed the boat - and this is during a huge boom on gaming, crypto, and AI. Compare: https://valustox.com/AMD VS https://valustox.com/NVDA
Whats insane is that AMD has been known for it's shit drivers for over a decade now...and nothing has happened to address this. Like surely everyone internally knows it, all the execs know it, the board knows it, investors know it...but somehow it has never been addressed.
At this point it's almost like it has to be intentional, like some perceived tradeoff ingrained in the culture that generates shit software.
Re: AMD leaps after launching AI chip that could challenge Nvidia dominance
#33Earlier quoted context omitted.
That is the confusing part say you need to hire 100 people at 1 mil. per year comp to get drivers to a good state. Thats 1/3 of their quarterly profit but would prob double the revenue in a few years.
From what I've heard they aren't offering competitive salaries, so introducing people at insane comps would probably destroy existing teams(if there was no salary bumps to match)/budgets (if there was). Doubt you can do much with new hires in 1 year in such environment, by the time you start seeing results it's probably too late to capitalize on this bubble. More likely, they wait to see how the AI HW startups shake…
I heard the same too (speaking for a friend)
Re: AMD leaps after launching AI chip that could challenge Nvidia dominance
#34Earlier quoted context omitted.
That's not such a big concern, LLMs run on all things today. It won't be that hard to make them work on AMD. Before 2020 we had much more architectural diversity.
The last time I tried getting Tensorflow / Pytorch to work on my good (and cheap) AMD card, I literally ended up just buying an Nvidia card. I’m just one guy but my experience carries over to subsequent business decisions made by me, and there are many like me.
I'll throw my hat in the ring, I didn't buy an nvidia card, I simply gave up on trying to get it working.
Re: AMD leaps after launching AI chip that could challenge Nvidia dominance
#35AMD needs to launch drivers, not chips. Who’s going to develop ML models on a card that can’t connect to a popular ML model? I look at their financial performance and it’s staggering how they’ve missed the boat - and this is during a huge boom on gaming, crypto, and AI. Compare: https://valustox.com/AMD VS https://valustox.com/NVDA
> AMD needs to....
https://www.amd.com/en/newsroom/press-releases/2023-10-10-am...
Re: AMD leaps after launching AI chip that could challenge Nvidia dominance
#36Wait... this headline totally wrong.
This is the actual source[1]:
> The AMD Instinct M1300A APU was launched in January 2023 and blends a total of 13 chiplets, of which many are 3D stacked, creating a single chip package with 24 Zen 4 CPU cores fused with a CDNA 3 graphics engine and eight stacks of HBM3 memory totaling 128GB.
Its literally a typo (or renamed SKU?) for the MI300A. So... the street is jumping on AMD because of a typo echoed by a ton of outlets?
https://www.datacenterdynamics.com/en/news/genci-upgrades-ad...
Re: AMD leaps after launching AI chip that could challenge Nvidia dominance
#37Do they have a good CUDA alternative?
Can't speak to how it compares to CUDA however they are developing ROCm[0] [0]: https://www.amd.com/en/products/software/rocm.html
I can attest that it works really well on my 6900xt. Compiling CUDA kernels is merely a matter of a using a #define shim. Also, provided you download the ROCm pytorch (and force compatibility with the HSA_OVERRIDE_GFX_VERSION) everything just works.
Re: AMD leaps after launching AI chip that could challenge Nvidia dominance
#38AMD gatekeeps this functionality behind it's non-consumer cards. They don't realize that having a consumer card and being able to develop on it is a gateway to using AMD. I can use CUDA on any Nvidia card I buy. I can't believe they are so incredibly dense on this.
Re: AMD leaps after launching AI chip that could challenge Nvidia dominance
#39Earlier quoted context omitted.
Next to nothing is written that targets this. Not Stable Diffusion, not RVC, not Vall-E, not Tacotron, not Tortoise, ... Maybe the LLM space is better about this, but the generative media side definitely isn't. AMD has a market share of 0% here, and nobody publishes models with AMD support.
Could there be a compiler/transpiler from CUSA to whatever AMD is pushing ?
I think it's llama.cpp that simply #defines all cuda_ functions to rocm_ (99% name-name). Porting seems to be that trivial.
Re: AMD leaps after launching AI chip that could challenge Nvidia dominance
#40Wait... this headline totally wrong. This is the actual source[1]: > The AMD Instinct M1300A APU was launched in January 2023 and blends a total of 13 chiplets, of which many are 3D stacked, creating a single chip package with 24 Zen 4 CPU cores fused with a CDNA 3 graphics engine and eight stacks of HBM3 memory totaling 128GB. Its literally a typo (or renamed SKU?) for the MI300A. So... the street is jumping on AMD…
It is a typo but in a different way. They are referring to the MI300X (mentioned again later).
The discussion on the MI300X was on HN like 12 hours ago (after the AMD announcement event yesterday):