Transformer Lab Now Works with AMD GPUs

#1

Post by aliasaria » Tue, May 27, 2025, 3:47 PM UTC

Transformer Lab Now Works with AMD GPUs
old.reddit.com

Re: Transformer Lab Now Works with AMD GPUs

#2

Post by aliasaria » Tue, May 27, 2025, 3:47 PM UTC

Getting ROCm working was... an adventure. We documented the entire (painful) journey in a detailed blog post because honestly, nothing went according to plan. If you've ever wrestled with ROCm setup for ML, you'll probably relate to our struggles.

The good news? Everything works smoothly now! We'd love for you to try it out and see what you think.

Re: Transformer Lab Now Works with AMD GPUs

#3

Post by [deleted] » Tue, May 27, 2025, 3:48 PM UTC

[deleted]

Re: Transformer Lab Now Works with AMD GPUs

#4

Post by latchkey » Tue, May 27, 2025, 3:51 PM UTC

Link to the source: https://transformerlab.ai/blog/amd-support/

Re: Transformer Lab Now Works with AMD GPUs

#5

Post by latchkey » Tue, May 27, 2025, 3:53 PM UTC

aliasaria wrote: post #2

Getting ROCm working was... an adventure. We documented the entire (painful) journey in a detailed blog post because honestly, nothing went according to plan. If you've ever wrestled with ROCm setup for ML, you'll probably relate to our struggles. The good news? Everything works smoothly now! We'd love for you to try it out and see what you think.

No need to build your own box, we've got 1xMI300x VMs, for FREE (thanks to AMD), for development exactly like this. Reach out and we can get you set up.

Someone left a comment accusing me of advertising my business, then deleted it. If that’s how it came across, I apologize, but my intention was to offer something genuinely useful, for free, and directly relevant to helping the OP. Those credits weren’t easy to get, it required going all the way up to Lisa. I’m committed to making supercompute accessible to developers. Yes, it’s free like GitHub is free. But this isn’t a sales pitch.

Re: Transformer Lab Now Works with AMD GPUs

#6

Post by latchkey » Tue, May 27, 2025, 3:57 PM UTC

aliasaria wrote: post #2

Getting ROCm working was... an adventure. We documented the entire (painful) journey in a detailed blog post because honestly, nothing went according to plan. If you've ever wrestled with ROCm setup for ML, you'll probably relate to our struggles. The good news? Everything works smoothly now! We'd love for you to try it out and see what you think.

Reading your post now, half the article feels like it is just installing PyTorch. Next time, just use the pre-built docker containers. It is the recommended way and much easier.

https://rocm.docs.amd.com/projects/install-on-linux/en/lates...

Additionally, our MI300x VMs/machines come with ROCm installed and configured already. We also apply all the default recommended BIOS settings as well.

Re: Transformer Lab Now Works with AMD GPUs

#7

Post by [deleted] » Tue, May 27, 2025, 4:08 PM UTC

latchkey wrote: post #5

aliasaria wrote: post #2

Getting ROCm working was... an adventure. We documented the entire (painful) journey in a detailed blog post because honestly, nothing went according to plan. If you've ever wrestled with ROCm setup for ML, you'll probably relate to our struggles. The good news? Everything works smoothly now! We'd love for you to try it out and see what you think.

No need to build your own box, we've got 1xMI300x VMs, for FREE (thanks to AMD), for development exactly like this. Reach out and we can get you set up. Someone left a comment accusing me of advertising my business, then deleted it. If that’s how it came across, I apologize, but my intention was to offer something genuinely useful, for free, and directly relevant to helping the OP. Those credits weren’t easy to get,…

[deleted]

Re: Transformer Lab Now Works with AMD GPUs

#8

Post by anonymous_llama » Tue, May 27, 2025, 4:17 PM UTC

latchkey wrote: post #6

aliasaria wrote: post #2

Getting ROCm working was... an adventure. We documented the entire (painful) journey in a detailed blog post because honestly, nothing went according to plan. If you've ever wrestled with ROCm setup for ML, you'll probably relate to our struggles. The good news? Everything works smoothly now! We'd love for you to try it out and see what you think.

Reading your post now, half the article feels like it is just installing PyTorch. Next time, just use the pre-built docker containers. It is the recommended way and much easier. https://rocm.docs.amd.com/projects/install-on-linux/en/lates... Additionally, our MI300x VMs/machines come with ROCm installed and configured already. We also apply all the default recommended BIOS settings as well.

Hey, I think the major issue was getting torch 2.7 working on a bare-metal installation as the app needed that and the pre-built docker containers aren't out yet for torch 2.7. Transformer Lab is also much more than just the Pytorch setup as it provides several plugins which can be used for training, evaluation, dataset generation (and much more!).

Also, the pre-built docker containers unfortunately do not work on WSL which caused the majority of the issues.

I'd love to hear if you had a different experience or if I'm mistaken in any of this!

Re: Transformer Lab Now Works with AMD GPUs

#9

Post by anonymous_llama » Tue, May 27, 2025, 4:18 PM UTC

latchkey wrote: post #5

aliasaria wrote: post #2

Getting ROCm working was... an adventure. We documented the entire (painful) journey in a detailed blog post because honestly, nothing went according to plan. If you've ever wrestled with ROCm setup for ML, you'll probably relate to our struggles. The good news? Everything works smoothly now! We'd love for you to try it out and see what you think.

No need to build your own box, we've got 1xMI300x VMs, for FREE (thanks to AMD), for development exactly like this. Reach out and we can get you set up. Someone left a comment accusing me of advertising my business, then deleted it. If that’s how it came across, I apologize, but my intention was to offer something genuinely useful, for free, and directly relevant to helping the OP. Those credits weren’t easy to get,…

Thanks for offering the GPU and we'll definitely be in touch about this one. What is the best way to reach out to you?

Re: Transformer Lab Now Works with AMD GPUs

#10

Post by latchkey » Tue, May 27, 2025, 5:13 PM UTC

anonymous_llama wrote: post #8

latchkey wrote: post #6

Earlier quoted context omitted.

Reading your post now, half the article feels like it is just installing PyTorch. Next time, just use the pre-built docker containers. It is the recommended way and much easier. https://rocm.docs.amd.com/projects/install-on-linux/en/lates... Additionally, our MI300x VMs/machines come with ROCm installed and configured already. We also apply all the default recommended BIOS settings as well.

Hey, I think the major issue was getting torch 2.7 working on a bare-metal installation as the app needed that and the pre-built docker containers aren't out yet for torch 2.7. Transformer Lab is also much more than just the Pytorch setup as it provides several plugins which can be used for training, evaluation, dataset generation (and much more!). Also, the pre-built docker containers unfortunately do not work on WS…

No, this is great feedback. I don't think you're mistaken. It is actually curious to me why PyTorch 2.7 isn't available yet, it should be! I'll pass that feedback up to AMD.

As for WSL, that kind of makes sense, since they just added Windows support to ROCm and that is probably a work in progress.

https://videocardz.com/newz/amd-pledges-rocm-support-for-win...