Hm, when I run the example, I get this error: > expected scalar type BFloat16 but found Float Has anyone seen this error? It's pretty hard to google for.
Update: I solved this error more properly by upgrading to the latest version. Thanks bfirsh.
Run Stable Diffusion on Your M1 Mac’s GPU
171–180 of 415 posts
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#172Magnusviri[0], the original author of the SD M1 repo credited in this article, has merged his fork into the Lstein Stable Diffusion fork. You can now run the Lstein fork[1] with M1 as of a few hours ago. This adds a ton of functionality - GUI, Upscaling & Facial improvements, weighted subprompts etc. This has been a big undertaking over the last few days, and I highly recommend checking it out. See the mac m1 readme…
are there benchmarks? I was following the github issue and the CPU bound one was at 4-5 minutes, the MDS one was at 30 seconds, then 18 seconds, and people were still calling that slow. What is it currently at now? and I don't know what "fast" is, to compare What are the Windows 10 with nice Nvidia chips w/ CUDA getting? Just curious whats comprehensive
> What are the Windows 10 with nice Nvidia chips w/ CUDA getting?
Are you referring to single iteration step times, or whole images? Because obviously it depends on the number of iteration steps used.
Windows 10, RTX 2070 (laptop model), lstein repo. I get about 3.2 iter/sec. A 50 step 512x512 image takes me 15 seconds.
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#173Earlier quoted context omitted.
I've tried using this set of steps [1], but have so far not had luck, mostly because the ROCm driver setup is throwing me for a loop. Tried it with an RX 6700 XT and first was going to test on Ubuntu 22.04 but realized ROCm doesn't support that OS yet, so tried again on 20.04 and ended up breaking my GPU driver! [1] https://gist.github.com/geerlingguy/ff3c3cbcf4416be2c0c1e0f8...
Yes. That's expected. AMD market segmented their RDNA2 support in ROCm to the Navi21 set only (6800/6800 XT/6900 XT). It is not officially supported in any way on other RDNA2 GPUs. (Or even on the desktop RDNA2 range at all, that only works because their top end Pro cards share the same die)
Looks like I may be out of luck with NAVI 10.
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#174Thanks for the writeup! It works smoothly on my M1 Macbook Pro!
A few days ago, I tried Stable Diffusion code and was not able to get it work :( Then I gave up...
Today, following steps in this blog post, it works for the very first try. Happy!
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#175I'm ready to pay for a Windows + AMD GPU guide at this point, why is there no single blogpost on this, please help.
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#176I'm working on getting this running. Instead of "venv/bin/activate" I had to run "source venv/bin/activate". And I got an error installing the requirements, fixed by running "pip install pyyaml" as a separate command.
There's a little "." before "venv/bin/activate" that's easy to miss. I'll update it to "source" to make it more obvious.
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#177Running into this error
`RuntimeError: expected scalar type BFloat16 but found Float`
when I run `txt2img.py`
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#178What's with the ~25% chance of an image being all black?
Also, seeds aren't replicating.
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#179How is Stable Diffusion on DreamStudio.ai so much faster than the reports here? Seems to only take 5-10 seconds to generate an image with the default settings. I.e. How are they providing access to GPU compute several orders of magnitude more powerful than an M1, for free?
The guy behind it is an ex hedge fund manager. Using private funds he's built a massive fleet of A1000s at AWS.
So it's an enormous amount of compute created from private funds that he considers to be "for humanity". Currently, he funds it and is also the "GPU overlord", he exclusively decides which applications gets to use it.
His plan, or at least his claim, is to transform this situation in it being more diversely funded (institutions, businesses, even the UN) and for access to be decided by committee with main criteria it being useful for humanity.
Let's see if he sticks to his word, but I find it inspirational. AI was on a trajectory to be solely in the hands of a hand full of ultra rich companies that can afford to train and run it, and us poor mortals being at the whims of gatekeeper terms.
This guy is on a trajectory to put AI in the hands of the people. Not just for art, for everything. If he fully sees this through, he's destined to be a tech icon.
Re: Run Stable Diffusion on Your M1 Mac’s GPU
#180Running into this error `RuntimeError: expected scalar type BFloat16 but found Float` when I run `txt2img.py`
Confirming I'm stuck on the same error when running the tutorial-instructed python scripts/txt2img.py command
RuntimeError: expected scalar type BFloat16 but found Float