OpenCL was a perfectly good alternative to CUDA. Unfortunately due to the short-sightedness of programmers using the proprietary CUDA, here we are with CUDA dominant.
Intel CEO: 'The entire industry is motivated to eliminate the CUDA market'
241–250 of 380 posts
Re: Intel CEO: 'The entire industry is motivated to eliminate the CUDA market'
#242Earlier quoted context omitted.
People argue for ROCm to support older cards because that is all they have accessible to them. AMD has lagged on getting expensive cards into the hands of end users because they've focused only on building super computers. I predict that access to the newer cards is a more likely scenario. Right now, you can't rent a MI250 or even MI300x, but that is going to change quickly. Azure is going to have them, as well as ot…
> People argue for ROCm to support older cards because that is all they have accessible to them. What they really need is to support the less expensive cards, of which the older cards are a large subset. There are a lot of people who will make contributions and fix bugs if they can actually use the thing. Some CS student at the university has to pay tuition and therefore only has an old RX570, and that isn't going to…
ROCm works on RX570 ("gfx803", including RX470+RX580 too).
Support was dropped upstream, but only because AMD no longer regularly test it. The code is still there and downstream distributors (like if you just apt-get install libamdhip64-5 && pip3 install torch) usually flip it enabled again.
https://salsa.debian.org/rocm-team/community/team-project/-/...
There is a scary red square in the table, but in my experience it worked completely fine for Stable Diffusion.
Re: Intel CEO: 'The entire industry is motivated to eliminate the CUDA market'
#243Earlier quoted context omitted.
Intel spent more than a decade under Otellini, Krzanich and Swan. Bean counters. Gelsinger was appointed out of desperation, but the problem runs much deeper. I doubt that culture is gone. It has already cost Intel many opportunities.
Otellini wasn't an engineer but still he made the historical x86-mac deal, pushed like crazy for x86-android and owned the top500 with xeon phi. The downfall began with Krzanich who had no goal besides raising the stock price and no strategy other than cutting long-term projects and other costs that got in the way. What a shame.
Krzanich started out as an engineer
Re: Intel CEO: 'The entire industry is motivated to eliminate the CUDA market'
#244Dude the entire industry is motivated to move away from x86. CUDA works and will remain the unofficial standard until something better is provided, which isn’t going to come out of a company like Intel.
Re: Intel CEO: 'The entire industry is motivated to eliminate the CUDA market'
#245Re: Intel CEO: 'The entire industry is motivated to eliminate the CUDA market'
#246Earlier quoted context omitted.
It's not just Intel. Open initiatives and consortiums (the phase two of the same) are always the losers ganging up hoping that it will give them the leg up they don't have. If you're older you'll have seen this play out over and over in the industry - the history of Unix vs. Windows NT from the 1990s was full of actions like this, networking is going through it again for the nth time (this time with UltraEthernet) an…
You're just listing the ones that didn't knock it out of the park. TCP/IP completely displaced IPX to the point that most people don't even remember what it was. Nobody uses WINS anymore, even Microsoft uses DNS. It's rare to find an operating system that doesn't implement the POSIX API. The past is littered with the corpses of proprietary technologies displaced by open standards. Because customers don't actually wan…
You didn't have a choice when it came to protocols for the Internet; it's TCP/IP and DNS or you don't get to play. Everyone was running dual stack to support their LAN and Internet and you had no choice with one of them. So, everything went TCP/IP and reduced overall complexity.
Re: Intel CEO: 'The entire industry is motivated to eliminate the CUDA market'
#247Earlier quoted context omitted.
It's a compiler problem and there is no money in compilers [1]. If someone made an intermediate representation for AI graphs and then wrote a compiler from that intermediate format into whatever backend was the deployment target then they might be able to charge money for support and bug fixes but that would be it. It's not the kind of business anyone wants to be in so there is no good intermediate format and compile…
JAX is a compiler.
[deleted]
Re: Intel CEO: 'The entire industry is motivated to eliminate the CUDA market'
#248Earlier quoted context omitted.
You're just listing the ones that didn't knock it out of the park. TCP/IP completely displaced IPX to the point that most people don't even remember what it was. Nobody uses WINS anymore, even Microsoft uses DNS. It's rare to find an operating system that doesn't implement the POSIX API. The past is littered with the corpses of proprietary technologies displaced by open standards. Because customers don't actually wan…
Windows still uses WINS and NetBIOS when DNS is unavailable.
In a business-class network, even one running Windows, if DNS breaks "everything" is going to break.
Re: Intel CEO: 'The entire industry is motivated to eliminate the CUDA market'
#249Earlier quoted context omitted.
It's a compiler problem and there is no money in compilers [1]. If someone made an intermediate representation for AI graphs and then wrote a compiler from that intermediate format into whatever backend was the deployment target then they might be able to charge money for support and bug fixes but that would be it. It's not the kind of business anyone wants to be in so there is no good intermediate format and compile…
JAX is a compiler.
So are TensorFlow and PyTorch. All AI/ML frameworks have to translate high-level tensor programs into executable artifacts for the given hardware and they're all given away for free because there is no way to make money with them. It's all open source and free. So the big tech companies subsidize the compilers because they want hardware to be the moat. It's why the running joke is that I need $80B to build AGI. The software is cheap/free, the hardware costs money.
Re: Intel CEO: 'The entire industry is motivated to eliminate the CUDA market'
#250[flagged]