Radeon Instinct – Optimized Machine and Deep Learning
1–10 of 88 posts
Re: Radeon Instinct – Optimized Machine and Deep Learning
#2Does anyone use AMD for deep learning in scientific / industry ? All the libraries for deep learning I have seen require CUDA and NVIDIA is winning by merely being the most popular API. Searching github it looks like they are university assignment projects see https://github.com/search?utf8=%E2%9C%93&q=opencl+deep+learn...
Re: Radeon Instinct – Optimized Machine and Deep Learning
#3Does anyone use AMD for deep learning in scientific / industry ? All the libraries for deep learning I have seen require CUDA and NVIDIA is winning by merely being the most popular API. Searching github it looks like they are university assignment projects see https://github.com/search?utf8=%E2%9C%93&q=opencl+deep+learn...
If AMD can release solid hardware, all they would need to do is add support for their hardware to popular open-source projects like TensorFlow.
I just hope they do the second part correctly.
Re: Radeon Instinct – Optimized Machine and Deep Learning
#4Does anyone use AMD for deep learning in scientific / industry ? All the libraries for deep learning I have seen require CUDA and NVIDIA is winning by merely being the most popular API. Searching github it looks like they are university assignment projects see https://github.com/search?utf8=%E2%9C%93&q=opencl+deep+learn...
For what it's worth, AMD has been working on a CUDA compatibility solution for at least a year now. Announcement[0] and Progress[1]
[0] http://www.anandtech.com/show/9792/amd-sc15-boltzmann-initia...
[1] http://www.anandtech.com/show/10831/amd-sc16-rocm-13-release...
Re: Radeon Instinct – Optimized Machine and Deep Learning
#5Does anyone use AMD for deep learning in scientific / industry ? All the libraries for deep learning I have seen require CUDA and NVIDIA is winning by merely being the most popular API. Searching github it looks like they are university assignment projects see https://github.com/search?utf8=%E2%9C%93&q=opencl+deep+learn...
If AMD can release solid hardware, all they would need to do is add support for their hardware to popular open-source projects like TensorFlow. I just hope they do the second part correctly.
It looks like they're doing it, or already have done so.
https://github.com/GPUOpen-ProfessionalCompute-Tools/HIP/iss...
Re: Radeon Instinct – Optimized Machine and Deep Learning
#6Does anyone use AMD for deep learning in scientific / industry ? All the libraries for deep learning I have seen require CUDA and NVIDIA is winning by merely being the most popular API. Searching github it looks like they are university assignment projects see https://github.com/search?utf8=%E2%9C%93&q=opencl+deep+learn...
Some people do, but they're by far the minority.
CUDA / cuDNN are well tuned and integrated with the most popular libraries.
At this point, in order to get people to switch not only would your hardware have to be faster, but your replacement for cuDNN would have to be better as well. Which is by no means impossible, just difficult.
Re: Radeon Instinct – Optimized Machine and Deep Learning
#7I really don't think this will make a dent in CUDA's platform. CUDA has a well established ecosystem in deep learning and compatible cards like Quadro coupled with very matured platform makes it miles ahead of platform.
That said, I would love to be proven wrong. Healthy competition such as this fosters much better results. Also CUDA is not without issues in certain matters.
Re: Radeon Instinct – Optimized Machine and Deep Learning
#8Does anyone use AMD for deep learning in scientific / industry ? All the libraries for deep learning I have seen require CUDA and NVIDIA is winning by merely being the most popular API. Searching github it looks like they are university assignment projects see https://github.com/search?utf8=%E2%9C%93&q=opencl+deep+learn...
For what it's worth, AMD has been working on a CUDA compatibility solution for at least a year now. Announcement[0] and Progress[1] [0] http://www.anandtech.com/show/9792/amd-sc15-boltzmann-initia... [1] http://www.anandtech.com/show/10831/amd-sc16-rocm-13-release...
It only works for the basic functionality they can't interop the "operational" CUDA features.
Re: Radeon Instinct – Optimized Machine and Deep Learning
#9Does anyone use AMD for deep learning in scientific / industry ? All the libraries for deep learning I have seen require CUDA and NVIDIA is winning by merely being the most popular API. Searching github it looks like they are university assignment projects see https://github.com/search?utf8=%E2%9C%93&q=opencl+deep+learn...
Looks like AMD is building replacement middleware for most of the major ML stacks, some more information on this page: http://www.anandtech.com/show/10905/amd-announces-radeon-ins...
Re: Radeon Instinct – Optimized Machine and Deep Learning
#10Does anyone use AMD for deep learning in scientific / industry ? All the libraries for deep learning I have seen require CUDA and NVIDIA is winning by merely being the most popular API. Searching github it looks like they are university assignment projects see https://github.com/search?utf8=%E2%9C%93&q=opencl+deep+learn...
For what it's worth, AMD has been working on a CUDA compatibility solution for at least a year now. Announcement[0] and Progress[1] [0] http://www.anandtech.com/show/9792/amd-sc15-boltzmann-initia... [1] http://www.anandtech.com/show/10831/amd-sc16-rocm-13-release...
Additionally, here's an example of how Caffe was porting using HIP [1]. To be honest, if the approach really does work, you might see a very quick increase in the number of applications ported.
All in all, given how elegant HIP is and that HCC seems to make GPUs more approachable than CUDA (and less silly than OpenACC), there is a great potential for AMD to gain some traction. My greatest concern is the quality and robustness of their software stack, their overly optimistic view (at least from the outside), and their relationship with the rest of the OSS world, especially given the conflicts that they seems to be running into with upstream contrib [2].
[1] https://www.youtube.com/watch?v=I7AfQ730Zwc [2] https://news.ycombinator.com/item?id=13136426