Live data from Hacker News

AMD leaps after launching AI chip that could challenge Nvidia dominance

msn.com

41–50 of 89 posts

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#41

Wait... this headline totally wrong. This is the actual source[1]: > The AMD Instinct M1300A APU was launched in January 2023 and blends a total of 13 chiplets, of which many are 3D stacked, creating a single chip package with 24 Zen 4 CPU cores fused with a CDNA 3 graphics engine and eight stacks of HBM3 memory totaling 128GB. Its literally a typo (or renamed SKU?) for the MI300A. So... the street is jumping on AMD…

It is a typo but in a different way. They are referring to the MI300X (mentioned again later). The discussion on the MI300X was on HN like 12 hours ago (after the AMD announcement event yesterday): https://news.ycombinator.com/item?id=38550271 https://www.youtube.com/watch?v=tfSZqjxsr0M

That's technically not new either?

Are they just talking about MI300X availability?

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#42

AMD gatekeeps this functionality behind it's non-consumer cards. They don't realize that having a consumer card and being able to develop on it is a gateway to using AMD. I can use CUDA on any Nvidia card I buy. I can't believe they are so incredibly dense on this.

lol, this is so stupid. Don't they realise that people usually develop locally and train on a server? You don't need a super beefy GPUs to do it, so you buy nvidia. So people are used to nvidia, debug and fix bugs etc. It's not a very smart decision, looks like the decision makers have no idea what's going on.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#43
post #18

Earlier quoted context omitted.

That is the confusing part say you need to hire 100 people at 1 mil. per year comp to get drivers to a good state. Thats 1/3 of their quarterly profit but would prob double the revenue in a few years.

From what I've heard they aren't offering competitive salaries, so introducing people at insane comps would probably destroy existing teams(if there was no salary bumps to match)/budgets (if there was). Doubt you can do much with new hires in 1 year in such environment, by the time you start seeing results it's probably too late to capitalize on this bubble. More likely, they wait to see how the AI HW startups shake…

>From what I've heard they aren't offering competitive salaries

Seems like a common thing in hardware companies, they chronically underpay, which for some reason hardware/electrical engineers seem to accept, but that makes them a last-choice for competent software engineers, who have much better-paying options.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#44

AMD needs to launch drivers, not chips. Who’s going to develop ML models on a card that can’t connect to a popular ML model? I look at their financial performance and it’s staggering how they’ve missed the boat - and this is during a huge boom on gaming, crypto, and AI. Compare: https://valustox.com/AMD VS https://valustox.com/NVDA

Whats insane is that AMD has been known for it's shit drivers for over a decade now...and nothing has happened to address this. Like surely everyone internally knows it, all the execs know it, the board knows it, investors know it...but somehow it has never been addressed. At this point it's almost like it has to be intentional, like some perceived tradeoff ingrained in the culture that generates shit software.

>At this point it's almost like it has to be intentional, like some perceived tradeoff ingrained in the culture that generates shit software.

They're underpaying their hardware engineers, and if they wanted to hire good software engineers they'd need to pay more, which would cause their hardware engineers to demand better pay too.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#45
post #18

AMD needs to launch drivers, not chips. Who’s going to develop ML models on a card that can’t connect to a popular ML model? I look at their financial performance and it’s staggering how they’ve missed the boat - and this is during a huge boom on gaming, crypto, and AI. Compare: https://valustox.com/AMD VS https://valustox.com/NVDA

That is the confusing part say you need to hire 100 people at 1 mil. per year comp to get drivers to a good state. Thats 1/3 of their quarterly profit but would prob double the revenue in a few years.

1mil comp? Haha, what?

Salaries at semico companies are not even close to this

Also why would you even need ppl this good? People who earn 1 mil offer way, way more than just tech skills

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#46

AMD gatekeeps this functionality behind it's non-consumer cards. They don't realize that having a consumer card and being able to develop on it is a gateway to using AMD. I can use CUDA on any Nvidia card I buy. I can't believe they are so incredibly dense on this.

You can run inference and training on consumer AMD cards today. It works fine, including llama.cpp, stable diffusion, hugging face transformers, etc. Way cheaper for a given performance/VRAM target as well.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#47

Earlier quoted context omitted.

From what I've heard they aren't offering competitive salaries, so introducing people at insane comps would probably destroy existing teams(if there was no salary bumps to match)/budgets (if there was). Doubt you can do much with new hires in 1 year in such environment, by the time you start seeing results it's probably too late to capitalize on this bubble. More likely, they wait to see how the AI HW startups shake…

>From what I've heard they aren't offering competitive salaries Seems like a common thing in hardware companies, they chronically underpay, which for some reason hardware/electrical engineers seem to accept, but that makes them a last-choice for competent software engineers, who have much better-paying options.

> which for some reason

Didn't you just explicitly say the reason? A SWE can go off and make Google in their Gargage; a EE can't make a fab in their garage.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#48

Earlier quoted context omitted.

The last time I tried getting Tensorflow / Pytorch to work on my good (and cheap) AMD card, I literally ended up just buying an Nvidia card. I’m just one guy but my experience carries over to subsequent business decisions made by me, and there are many like me.

I'll throw my hat in the ring, I didn't buy an nvidia card, I simply gave up on trying to get it working.

Nvidia drivers on Linux aren’t a walk in the park either, but at least there’s a way to do it.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#49
post #18

Earlier quoted context omitted.

That is the confusing part say you need to hire 100 people at 1 mil. per year comp to get drivers to a good state. Thats 1/3 of their quarterly profit but would prob double the revenue in a few years.

1mil comp? Haha, what? Salaries at semico companies are not even close to this Also why would you even need ppl this good? People who earn 1 mil offer way, way more than just tech skills

NVidia is a semico and they pay much better than AMD: https://www.indeed.com/companies/compare/Amd-vs-Nvidia-b78a5... . That's a big part of why they're so far ahead now and their drivers are much better. If AMD wants to catch up to NVidia within a reasonable timeframe, they wouldn't just need to match it, they'd need to pay way better than NVidia to attract the best people.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#50

Earlier quoted context omitted.

It is a typo but in a different way. They are referring to the MI300X (mentioned again later). The discussion on the MI300X was on HN like 12 hours ago (after the AMD announcement event yesterday): https://news.ycombinator.com/item?id=38550271 https://www.youtube.com/watch?v=tfSZqjxsr0M

That's technically not new either? Are they just talking about MI300X availability?

It very much is though. the MI300X may have been known about prior to the event but specs and performance were all under embargo until December 6.
Post reply on HN