Hm, when I run the example, I get this error:
> expected scalar type BFloat16 but found Float
Has anyone seen this error? It's pretty hard to google for.
Run Stable Diffusion on Your M1 Mac’s GPU
51–60 of 415 posts
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#52Earlier quoted context omitted.
1.3 sec/iter on my M1 Mac, so ~39 seconds.
That was fast. I'm only getting 5.26s/iter on an M1 Pro MBP with 16GB RAM. EDIT: Speed increased to 2.3s/iter after a reboot
Depends what fork you're running... Some seem to be using CPU-based generation, others use the MPS device backend correctly which is MUCH faster. I have another comment floating around about lstein's fork, but it takes some massaging to get it to run happily. https://github.com/lstein/stable-diffusion/
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#53Does running it locally give you anything over using the web version?
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#54For those as keen as I am to try this out, I ran these steps, only to run into an error during the pip install phase: > ERROR: Failed building wheel for onnx I was able to resolve it by doing this: > brew install protobuf Then I ran pip install again, and it worked!
What kind of speed does this run at? Eg. How long to make a 512x512 image at standard settings?
On my M1 Pro MBP with 16GB RAM, it takes ~3 minutes.
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#55Any chance of this running on an M1 iPad Pro?
Seconding this
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#56Hm, when I run the example, I get this error: > expected scalar type BFloat16 but found Float Has anyone seen this error? It's pretty hard to google for.
Yeah. Try running with PYTORCH_ENABLE_MPS_FALLBACK=1 --full-precision
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#57Has anybody had success getting newer AMD cards working? ROCm support seems spotty at best, I have a 5700xt and I haven't had much luck getting it working.
6600XT reporting in. Spent a few hours on Windows and WSL2 setup attempts, got no where. I don't run Ubuntu at home and don't want to dual boot just for this. From looking around I think I'd have a better chance on native Ubuntu.
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#58For those as keen as I am to try this out, I ran these steps, only to run into an error during the pip install phase: > ERROR: Failed building wheel for onnx I was able to resolve it by doing this: > brew install protobuf Then I ran pip install again, and it worked!
What kind of speed does this run at? Eg. How long to make a 512x512 image at standard settings?
I haven't installed from this link specifically, but I used one of the branches on which this is based a few days ago, so the results should be similar.
On a first-gen M1 Mac mini with 8GB RAM, it takes 70-90 minutes for each image.
Still feels like magic, but old-school magic.
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#59Re: Run Stable Diffusion on Your M1 Mac’s GPU
#60For those as keen as I am to try this out, I ran these steps, only to run into an error during the pip install phase: > ERROR: Failed building wheel for onnx I was able to resolve it by doing this: > brew install protobuf Then I ran pip install again, and it worked!
What kind of speed does this run at? Eg. How long to make a 512x512 image at standard settings?
Looks like I'm getting around 4s per iteration on my M1 Max. At 50 iterations, that's 200 seconds.