Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Analysts estimate Nvidia owns 98% of the data center GPU market

extremetech.com

Post reply on HN
Print view View original

71–80 of 85 posts

Re: Analysts estimate Nvidia owns 98% of the data center GPU market

#71

Post by AnthonyMouse »

incrudible wrote: post #69
AnthonyMouse wrote: post #62

Earlier quoted context omitted.

It doesn't matter if you believe the first person who figures it out. Ten other people will try it and then there will be ten people saying they fixed it and a hundred people will try it. At some point you either believe everyone who has tried it or you lose business because your competitors have figured it out and you haven't.

Ten people saying “it works now” is not going to lead to ten times that many risking their time and money on AMD. “Works for me” is a meme for a reason.

The number of people who believe you is the average probability that someone believes you times number of people you tell. In the bronze age this was really bad because you had to travel on horseback and contacting people in the same industry in other cities was quite slow and burdensome. Now we have the internet and communicating with someone on the other side of the world takes 200ms, so the speed at which new information spreads is fast.

Meanwhile those people then know each other, so as soon as someone credible claims it works, several other credible believe them, try it themselves, and say the same thing. It doesn't really matter if you think it's 10 or 100 or 1.2, it's exponential spread at the speed of the internet.

Re: Analysts estimate Nvidia owns 98% of the data center GPU market

#73

Post by latchkey »

AnthonyMouse wrote: post #41
wongarsu wrote: post #14

Earlier quoted context omitted.

OpenCL is only about a year younger than Cuda. Nobody stopped AMD from investing into it. But where Nvidia spent the last 16 years continuously investing into providing the best performance and development experience, AMD rarely invested into either. Instead they focused on video games, with some projects that helped them profit from the crypto hype but lacked the necessary commitment to achieve much of anything beyo…

16 years ago AMD was on the verge of bankruptcy and was already smaller than Nvidia despite being a company that makes GPUs and CPUs and , at the time, had their own fabs. They had no money to invest in anything, and that didn't really change until Ryzen. You may be able to identify its release date from this graph: https://www.macrotrends.net/stocks/charts/AMD/amd/market-cap Now they have to take the money and use i…

It runs a bit deeper than than money though. If a company doesn't have software as part of their culture, no amount of money is going to turn that around until they make a conscious decision to do so.

AI has been the first technology to really kick them in the pants to get off their asses and really invest in that aspect. There are a ton of job openings around AI software now within AMD. I'm seeing new ones get posted almost daily on LI. It'll take time, but they will fix it.

Re: Analysts estimate Nvidia owns 98% of the data center GPU market

#74

Post by renewiltord »

latchkey wrote: post #42
renewiltord wrote: post #32

Earlier quoted context omitted.

Exciting news. How's software story on this? Currently we are on CUDA, etc. We have nice big AMD Epycs (1GB of cache!) but use Nvidia for GPU. Mi300x at $40k would be tempting, but hard to justify with porting effort required.

I would start to look into using ROCm/HIP to port the code. Some of it can be done automatically and some will need customizations [0]. Then, you rent time on my systems and see what the performance is. If it is good, you rent more, for longer to bring the pricing down. Effectively, we are taking the capex/opex risk off your shoulders. The key point here is that we have actual availability and we aren't just resellin…

Thank you for the link and advice. We're using 9684X for the cache. But dual 9754 does sound good!

Re: Analysts estimate Nvidia owns 98% of the data center GPU market

#75

Post by latchkey »

renewiltord wrote: post #74
latchkey wrote: post #42

Earlier quoted context omitted.

I would start to look into using ROCm/HIP to port the code. Some of it can be done automatically and some will need customizations [0]. Then, you rent time on my systems and see what the performance is. If it is good, you rent more, for longer to bring the pricing down. Effectively, we are taking the capex/opex risk off your shoulders. The key point here is that we have actual availability and we aren't just resellin…

Thank you for the link and advice. We're using 9684X for the cache. But dual 9754 does sound good!

Oh yea, great chip as well. That cache certainly is expensive! Can I ask... what is the usecase for the cache?

Re: Analysts estimate Nvidia owns 98% of the data center GPU market

#76

Post by pests »

nabla9 wrote: post #6
mjevans wrote: post #3

It would be nice if... Maybe some regulatory body could declare this an obvious 'monopoly' and at least force the 'language spoken' to be free for anyone to implement without patent worries?

Monopolies are not illegal per se. Misusing monopoly power is illegal. Nvidia has monopoly in the market, but unless they use their position illeagally, that's OK. GPU market is competitive and Nvidia has put in the work others like AMD or Intel never bothered to do.

What about Alcoa?

Re: Analysts estimate Nvidia owns 98% of the data center GPU market

#77

Post by latchkey »

AnthonyMouse wrote: post #29
incrudible wrote: post #15

Earlier quoted context omitted.

Intel never had a software moat. AMD has a terrible reputation for software that will be hard to shake.

Reputation is basically meaningless here. If they fix the software, people will figure that out in short order. They just have to actually do it.

They are working hard on it:

https://www.phoronix.com/news/AMD-ROCm-6.0.2-MI300

Re: Analysts estimate Nvidia owns 98% of the data center GPU market

#78

Post by latchkey »

incrudible wrote: post #30
arcanus wrote: post #25

Earlier quoted context omitted.

> Who needs GPGPU anyway, right? The world's largest computer, Frontier at oak ridge national laboratory, runs AMD GPUs. AMD is undisputably the #2 in the GPU space. https://www.top500.org/lists/top500/2023/11/

That is great, did someone ask the programmers about it though? Or did someone else see the higher FLOPs per dollar and bought in? If your job is literally programming a supercomputer and you can get AMD to fix stuff for you, maybe it aint so bad. That is not where most software comes from though.

That's why I'm building my own AMD supercomputer, for rent. Let's build the developer flywheel!

Re: Analysts estimate Nvidia owns 98% of the data center GPU market

#79

Post by renewiltord »

latchkey wrote: post #75
renewiltord wrote: post #74

Earlier quoted context omitted.

Thank you for the link and advice. We're using 9684X for the cache. But dual 9754 does sound good!

Oh yea, great chip as well. That cache certainly is expensive! Can I ask... what is the usecase for the cache?

We use the chip general purpose. HFT simulation code, empirically faster.

The GPUs are to train a model. Separate use-case, but we use same hardware for both use-cases so that's why the big cache thing.

Re: Analysts estimate Nvidia owns 98% of the data center GPU market

#80

Post by temp_praneshp »

HeatrayEnjoyer wrote: post #51
temp_praneshp wrote: post #5

Earlier quoted context omitted.

Or it would be nice if the regulatory body would fuck off

We need more anti monopoly action, not less.

Exactly what Xirgil said, Nvidia shouldn't be punished for being good at their job
Post reply on HN