Live data from Hacker News

AMD leaps after launching AI chip that could challenge Nvidia dominance

msn.com

21–30 of 89 posts

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#21

They gotta keep working on the software side of things like drivers, FSR and more. AMD is so far behind on this. In the other hand though, their 3D Cache chips are amazing

On Linux, AMD drivers are far ahead of Nvidia. Switching from a 970 to a 3750 fixed a bunch of visual glitches for me.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#22
post #17

AMD needs to launch drivers, not chips. Who’s going to develop ML models on a card that can’t connect to a popular ML model? I look at their financial performance and it’s staggering how they’ve missed the boat - and this is during a huge boom on gaming, crypto, and AI. Compare: https://valustox.com/AMD VS https://valustox.com/NVDA

That's not such a big concern, LLMs run on all things today. It won't be that hard to make them work on AMD. Before 2020 we had much more architectural diversity.

The last time I tried getting Tensorflow / Pytorch to work on my good (and cheap) AMD card, I literally ended up just buying an Nvidia card.

I’m just one guy but my experience carries over to subsequent business decisions made by me, and there are many like me.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#23
post #12

Earlier quoted context omitted.

Can't speak to how it compares to CUDA however they are developing ROCm[0] [0]: https://www.amd.com/en/products/software/rocm.html

Next to nothing is written that targets this. Not Stable Diffusion, not RVC, not Vall-E, not Tacotron, not Tortoise, ... Maybe the LLM space is better about this, but the generative media side definitely isn't. AMD has a market share of 0% here, and nobody publishes models with AMD support.

Could there be a compiler/transpiler from CUSA to whatever AMD is pushing ?

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#24
post #12

Earlier quoted context omitted.

Can't speak to how it compares to CUDA however they are developing ROCm[0] [0]: https://www.amd.com/en/products/software/rocm.html

Next to nothing is written that targets this. Not Stable Diffusion, not RVC, not Vall-E, not Tacotron, not Tortoise, ... Maybe the LLM space is better about this, but the generative media side definitely isn't. AMD has a market share of 0% here, and nobody publishes models with AMD support.

The things is you can actually run Stable Diffusion.

And I got PyTorch working on my AMD 7900 XT graphics card recently, though it was a bit of a hassle to do so.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#27
post #18

AMD needs to launch drivers, not chips. Who’s going to develop ML models on a card that can’t connect to a popular ML model? I look at their financial performance and it’s staggering how they’ve missed the boat - and this is during a huge boom on gaming, crypto, and AI. Compare: https://valustox.com/AMD VS https://valustox.com/NVDA

That is the confusing part say you need to hire 100 people at 1 mil. per year comp to get drivers to a good state. Thats 1/3 of their quarterly profit but would prob double the revenue in a few years.

From what I've heard they aren't offering competitive salaries, so introducing people at insane comps would probably destroy existing teams(if there was no salary bumps to match)/budgets (if there was). Doubt you can do much with new hires in 1 year in such environment, by the time you start seeing results it's probably too late to capitalize on this bubble.

More likely, they wait to see how the AI HW startups shake up and then acquire the ones that have anything worth paying for.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#28
post #18

AMD needs to launch drivers, not chips. Who’s going to develop ML models on a card that can’t connect to a popular ML model? I look at their financial performance and it’s staggering how they’ve missed the boat - and this is during a huge boom on gaming, crypto, and AI. Compare: https://valustox.com/AMD VS https://valustox.com/NVDA

That is the confusing part say you need to hire 100 people at 1 mil. per year comp to get drivers to a good state. Thats 1/3 of their quarterly profit but would prob double the revenue in a few years.

It's not just drivers though. Nvidia has invested close to two decades into documentation, teaching materials, developer tooling and libraries for CUDA, plus all the work on gaining mindshare.

You could probably get 80% there by dedicating enough AMD developers to improving AMD support in existing AI frameworks and software, in parallel with improving drivers and whatever CUDA equivalent they are betting on right now. But it would need a massive concerted effort that few companies seem to be able to pull off (probably it's hard to align the company on the right goals)

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#29
post #12

Earlier quoted context omitted.

Next to nothing is written that targets this. Not Stable Diffusion, not RVC, not Vall-E, not Tacotron, not Tortoise, ... Maybe the LLM space is better about this, but the generative media side definitely isn't. AMD has a market share of 0% here, and nobody publishes models with AMD support.

Could there be a compiler/transpiler from CUSA to whatever AMD is pushing ?

That's what https://github.com/ROCm/HIPIFY is (as a part of ROCm)

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#30
post #17

AMD needs to launch drivers, not chips. Who’s going to develop ML models on a card that can’t connect to a popular ML model? I look at their financial performance and it’s staggering how they’ve missed the boat - and this is during a huge boom on gaming, crypto, and AI. Compare: https://valustox.com/AMD VS https://valustox.com/NVDA

That's not such a big concern, LLMs run on all things today. It won't be that hard to make them work on AMD. Before 2020 we had much more architectural diversity.

they've had a long time to get ML working as well as with CUDA and CuDNN, mostly failed attempts so far. How close are they?
Post reply on HN