Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AMD leaps after launching AI chip that could challenge Nvidia dominance

msn.com

Post reply on HN
Print view View original

61–70 of 89 posts

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#61

Post by godshatter »

Symmetry wrote: post #24
echelon wrote: post #12

Earlier quoted context omitted.

Next to nothing is written that targets this. Not Stable Diffusion, not RVC, not Vall-E, not Tacotron, not Tortoise, ... Maybe the LLM space is better about this, but the generative media side definitely isn't. AMD has a market share of 0% here, and nobody publishes models with AMD support.

The things is you can actually run Stable Diffusion. And I got PyTorch working on my AMD 7900 XT graphics card recently, though it was a bit of a hassle to do so.

You can also run Stable Diffusion in cpu mode, if you don't mind it being slower. I have an NVIDIA card but it's not powerful enough to run it. I'm on Ubuntu.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#62

Post by Symmetry »

nightski wrote: post #38

AMD gatekeeps this functionality behind it's non-consumer cards. They don't realize that having a consumer card and being able to develop on it is a gateway to using AMD. I can use CUDA on any Nvidia card I buy. I can't believe they are so incredibly dense on this.

That's something that's started changing over the last few months. Official support for the RX 7900 GPUs for Linux has been added to the most recent versions of ROCm and over on the ROCm subreddit people are reporting success getting other RDNA 3 cards working. On Windows you've got consumer cards from the previous generation getting official support too.

This is, obviously, way overdue and it might not be enough to let AMD get back into the race but

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#63

Post by skyyler »

joshstrange wrote: post #57
skyyler wrote: post #54

Earlier quoted context omitted.

Did you read that article you linked? >The important thing to remember is don’t use possessive apostrophes with any pronouns, either possessive pronouns or possessive adjectives. >If you see an apostrophe with a pronoun, it must be part of a contraction. >its—possessive adjective of it >it’s—contraction for “it is” "its" would be correct in the root comment.

No I didn't read it fully, I knew what the concept was called, found an article, skimmed it until I was sure it was talking about the thing I thought it was. I'm almost positive I was taught in school that "it's" is a valid possessive apostrophe case and honestly I think it's stupid that it's not. I find "its" more confusing personally.

>I knew what the concept was called, found an article, skimmed it until I was sure it was talking about the thing I thought it was

You just managed to summarise why having conversations with strangers is so difficult on the internet these days.

Instead of considering that you were incorrect, even for a moment, you sought an article that you thought would confirm the ideas that you already had. Without even actually reading it, you used it as evidence that you were correct all along.

Even though the article very clearly illustrates that you were mistaken.

Fascinating.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#64

Post by Symmetry »

thrtythreeforty wrote: post #55
65a wrote: post #46

Earlier quoted context omitted.

You can run inference and training on consumer AMD cards today. It works fine, including llama.cpp, stable diffusion, hugging face transformers, etc. Way cheaper for a given performance/VRAM target as well.

Maybe so. But it isn't confidence inspiring when I go to see which cards are supported and I see this issue: https://github.com/ROCm/ROCm/issues/1714 With Nvidia cards, I know that if I buy any Nvidia card made in the last 10 years, CUDA code will run on it. Period. (Yes, different language levels require newer hardware, but Nvidia docs are quite clear about which CUDA versions require which silicon.) I have an AMD Z…

That's from 2022. AMDs move to start generally supporting consumer cards is very recent.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#65

Post by joshstrange »

skyyler wrote: post #63
joshstrange wrote: post #57

Earlier quoted context omitted.

No I didn't read it fully, I knew what the concept was called, found an article, skimmed it until I was sure it was talking about the thing I thought it was. I'm almost positive I was taught in school that "it's" is a valid possessive apostrophe case and honestly I think it's stupid that it's not. I find "its" more confusing personally.

>I knew what the concept was called, found an article, skimmed it until I was sure it was talking about the thing I thought it was You just managed to summarise why having conversations with strangers is so difficult on the internet these days. Instead of considering that you were incorrect, even for a moment, you sought an article that you thought would confirm the ideas that you already had. Without even actually r…

You do understand that's not really what happened here right?

The concept IS called possessive apostrophe and literally until this minute I wasn't aware that "it's" isn't grammatically correct when the "it" in the sentence is being used possessively. I didn't just find an article I thought agreed with me and fire it off, I thought "it's" was valid and riffic didn't know about possessive apostrophes (which again, I had wrong in this case). I didn't look for "it's" in the article because that wasn't up for debate in my mind (again, I can't stress this enough, I was wrong about the usage, any comment I've ever made uses "it's" in this case because that's how I thought it was used), I was just looking for the concept as a whole to link. I got a minor piece wrong and you want to lump me in with everyone who picks the first article that "agrees" with them.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#66

Post by zamalek »

thrtythreeforty wrote: post #55
65a wrote: post #46

Earlier quoted context omitted.

You can run inference and training on consumer AMD cards today. It works fine, including llama.cpp, stable diffusion, hugging face transformers, etc. Way cheaper for a given performance/VRAM target as well.

Maybe so. But it isn't confidence inspiring when I go to see which cards are supported and I see this issue: https://github.com/ROCm/ROCm/issues/1714 With Nvidia cards, I know that if I buy any Nvidia card made in the last 10 years, CUDA code will run on it. Period. (Yes, different language levels require newer hardware, but Nvidia docs are quite clear about which CUDA versions require which silicon.) I have an AMD Z…

There's a difference between officially supported, and supported. My 6900XT, an unsupported card, works just fine.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#67

Post by p_j_w »

djmips wrote: post #58
lesuorac wrote: post #47

Earlier quoted context omitted.

> which for some reason Didn't you just explicitly say the reason? A SWE can go off and make Google in their Gargage; a EE can't make a fab in their garage.

AMD doesn't even own a fab.

They own licenses to the insanely expensive software you need to build a modern IC.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#68

Post by paulmd »

LeanderK wrote: post #42
nightski wrote: post #38

AMD gatekeeps this functionality behind it's non-consumer cards. They don't realize that having a consumer card and being able to develop on it is a gateway to using AMD. I can use CUDA on any Nvidia card I buy. I can't believe they are so incredibly dense on this.

lol, this is so stupid. Don't they realise that people usually develop locally and train on a server? You don't need a super beefy GPUs to do it, so you buy nvidia. So people are used to nvidia, debug and fix bugs etc. It's not a very smart decision, looks like the decision makers have no idea what's going on.

AMD’s opencl runtime also historically has an incredible number of bugs and paper features that make any sort of portability between nvidia and AMD cards quite difficult - you are running a special build and a different codepath for AMD anyway, there was no gain from using the ostensibly portable approach.

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#69

Post by latchkey »

nightski wrote: post #38

AMD gatekeeps this functionality behind it's non-consumer cards. They don't realize that having a consumer card and being able to develop on it is a gateway to using AMD. I can use CUDA on any Nvidia card I buy. I can't believe they are so incredibly dense on this.

In my eyes, the real problem is that there is no cost effective developer access to high end cards, like the MI300x. This breaks the developer flywheel that you would normally point at consumer cards for.

Where can you rent time on one? Traditionally, AMD has only helped build super computers, like Frontier and El Capitan, out of these cards.

This time around Azure [0] and other CSP's (cloud service providers) are working to change that. I will have the best of the best of their cards/systems for rent soon.

[0] https://techcommunity.microsoft.com/t5/azure-high-performanc...

Re: AMD leaps after launching AI chip that could challenge Nvidia dominance

#70

Post by latchkey »

paulmd wrote: post #68
LeanderK wrote: post #42

Earlier quoted context omitted.

lol, this is so stupid. Don't they realise that people usually develop locally and train on a server? You don't need a super beefy GPUs to do it, so you buy nvidia. So people are used to nvidia, debug and fix bugs etc. It's not a very smart decision, looks like the decision makers have no idea what's going on.

AMD’s opencl runtime also historically has an incredible number of bugs and paper features that make any sort of portability between nvidia and AMD cards quite difficult - you are running a special build and a different codepath for AMD anyway, there was no gain from using the ostensibly portable approach.

The gain is that you can't find time on NVIDIA cards right now. Decentralizing away from a single provider lowers the risk on your business significantly.

Case in point, OpenAI closed new signups because they couldn't keep up with demand and they literally have all the resources in the world to make things happen.

Post reply on HN