I wonder if this is going to be a huge boon to m1 sales.
Run Stable Diffusion on Your M1 Mac’s GPU
81–90 of 415 posts
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#82Magnusviri[0], the original author of the SD M1 repo credited in this article, has merged his fork into the Lstein Stable Diffusion fork. You can now run the Lstein fork[1] with M1 as of a few hours ago. This adds a ton of functionality - GUI, Upscaling & Facial improvements, weighted subprompts etc. This has been a big undertaking over the last few days, and I highly recommend checking it out. See the mac m1 readme…
Brilliant, thank you! I just got OP's setup working, but this seems much more user-friendly. Giving it a try now... EDIT: Got it working, with a couple of pre-requisite steps: 0. `rm` the existing `stable-diffusion` repo (assuming you followed OP's original setup) 1. Install `conda`, if you don't already have it: brew install --cask miniconda 2. Install the other build requirements referenced in OP's setup: brew inst…
Can you describe how you did (/ are doing) this? Do you now need to use conda (as opposed to OPs pip only version)?
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#83Has anybody had success getting newer AMD cards working? ROCm support seems spotty at best, I have a 5700xt and I haven't had much luck getting it working.
I've tried using this set of steps [1], but have so far not had luck, mostly because the ROCm driver setup is throwing me for a loop. Tried it with an RX 6700 XT and first was going to test on Ubuntu 22.04 but realized ROCm doesn't support that OS yet, so tried again on 20.04 and ended up breaking my GPU driver! [1] https://gist.github.com/geerlingguy/ff3c3cbcf4416be2c0c1e0f8...
Yes. That's expected.
AMD market segmented their RDNA2 support in ROCm to the Navi21 set only (6800/6800 XT/6900 XT).
It is not officially supported in any way on other RDNA2 GPUs. (Or even on the desktop RDNA2 range at all, that only works because their top end Pro cards share the same die)
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#84Earlier quoted context omitted.
I haven't installed from this link specifically, but I used one of the branches on which this is based a few days ago, so the results should be similar. On a first-gen M1 Mac mini with 8GB RAM, it takes 70-90 minutes for each image. Still feels like magic, but old-school magic.
On an M1 Pro 16GB it is taking a couple minutes for each image.
Is that the difference in graphics performance between the M1 and M1 Pro or did the other person do something wrong? 70-90 minutes seems nuts
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#85Has anybody had success getting newer AMD cards working? ROCm support seems spotty at best, I have a 5700xt and I haven't had much luck getting it working.
6600XT reporting in. Spent a few hours on Windows and WSL2 setup attempts, got no where. I don't run Ubuntu at home and don't want to dual boot just for this. From looking around I think I'd have a better chance on native Ubuntu.
Buy an NVIDIA card. ROCm isn't supported in any way on WSL2, but CUDA is.
AMD just doesn't invest in their developer ecosystem. Also as you use a 6600 XT, no official ROCm support for the die that you use. Only for navi21.
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#86One beautiful thing I realized about all this progress in AI. We will still need people to do the hard yards, and get dirt between their fingernails. I am firmly in the camp of those people. Fancy algorithms won't dig holes, or lay out rail tracks of over hundreds of miles.. or build houses all across the world.
Are you following progress in robotics?
Once they combine the progress in generative algorithms and robotics, then we are truly done for.
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#87Earlier quoted context omitted.
I've tried using this set of steps [1], but have so far not had luck, mostly because the ROCm driver setup is throwing me for a loop. Tried it with an RX 6700 XT and first was going to test on Ubuntu 22.04 but realized ROCm doesn't support that OS yet, so tried again on 20.04 and ended up breaking my GPU driver! [1] https://gist.github.com/geerlingguy/ff3c3cbcf4416be2c0c1e0f8...
Yes. That's expected. AMD market segmented their RDNA2 support in ROCm to the Navi21 set only (6800/6800 XT/6900 XT). It is not officially supported in any way on other RDNA2 GPUs. (Or even on the desktop RDNA2 range at all, that only works because their top end Pro cards share the same die)
Oh... had no clue! Thanks for letting me know so I wouldn't have to spend hours banging my head against the wall.
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#88might be easier to wait for Diffusers to merge the pull request...
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#89Are we being pranked? I just followed the steps but the image output from my prompt is just a single frame of Rick Astley... EDIT: It was a false-positive (honest!) on the NSFW filter. To disable it, edit txt2img.py around line 325. Comment this line out: x_checked_image, has_nsfw_concept = check_safety(x_samples_ddim) And replace it with: x_checked_image = x_samples_ddim
Same thing happened to me which is especially odd as I literally just pasted the example command.
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#90Magnusviri[0], the original author of the SD M1 repo credited in this article, has merged his fork into the Lstein Stable Diffusion fork. You can now run the Lstein fork[1] with M1 as of a few hours ago. This adds a ton of functionality - GUI, Upscaling & Facial improvements, weighted subprompts etc. This has been a big undertaking over the last few days, and I highly recommend checking it out. See the mac m1 readme…
Nice. We'll get this guide updated for this fork. Everything's moving so fast it's hard to keep track!
We struggled to get Conda working reliably for people, which it looks like lstein's fork recommends. I'll see if we can get it working with plain pip.