Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Easy Stable Diffusion XL in your device, offline

noiselith.com

Post reply on HN
Print view View original

121–130 of 169 posts

Re: Easy Stable Diffusion XL in your device, offline

#121

Post by SV_BubbleTime »

rish wrote: post #43
tracerbulletx wrote: post #21

Earlier quoted context omitted.

I'm being kind of tongue in cheek because I understand that this is for just making things really easy and ComfyUI is a node based editor that most people would have trouble with. But the best UI for local SD generation that the community is using is https://github.com/comfyanonymous/ComfyUI

Agreed. It's worth the learning curve for the sheer power you can enable your workflows. I've always wanted to toy around with node based architectures and this seemed quite easy after using A1111 extensively. The community providing ready to go workflows has made it quite enjoyable too.

I can’t seem to get myself to switch. I’ve only used A1111 a dozen times and only for funny work images… I can’t seem to get myself to switch over to comfy because it looks rather intimidating.

Re: Easy Stable Diffusion XL in your device, offline

#122

Post by mtlmtlmtlmtl »

rgbrgb wrote: post #14

Just installed, this is very cool. Local AI is the future I want (and what I'm working on too). A few notes using it... Pros: - seems pretty self contained - built in model installer works really well and helps you download anything from CivitAI (I installed https://civitai.com/models/183354/sdxl-ms-paint-portraits ) - image generation is high quality and stable - shows intermediate steps during generation Cons: - do…

Is that 1GB idle per process or total for all 7 processes?

Re: Easy Stable Diffusion XL in your device, offline

#123

Post by samutek »

rcoveson wrote: post #104
KolmogorovComp wrote: post #102

Earlier quoted context omitted.

Glad I’m not the only one who found it inappropriate. Feels very much like a dog whistle.

What's subtle about it? In the dog whistle analogy, who are they who cannot hear the whistle? To me this is more like yelling "ROVER! COME HERE BOY!" at the top of your lungs.

The actual prompt is "magic world and the girl sitting inside a computer monitor, fantasy, cinematic close up photo."

OP is just offended by the image of an attractive woman, I guess. Apparently that's "creepy" now.

Re: Easy Stable Diffusion XL in your device, offline

#124

Post by stoobs »

SV_BubbleTime wrote: post #118
stoobs wrote: post #116

Earlier quoted context omitted.

I think that's coming from gradio?

Probably, auto1111 does the same - but I agree with GP it shouldn’t be there. If it isn’t explicitly surveillance, it could effectively be.

Yeah, it is, just need to set an env var of GRADIO_ANALYTICS_ENABLED=False to stop it - probably should be added into launch.py along with the other env vars being set at launch.

Re: Easy Stable Diffusion XL in your device, offline

#125

Post by calamari4065 »

brucethemoose2 wrote: post #73
calamari4065 wrote: post #67

Earlier quoted context omitted.

Is this at all usable on a CPU-only system with a ton of RAM?

Not really. There is a very fast LCM model preset now, but its still going to be painful. SDXL in particular isn't one of those "compute light, bandwidth bound" models like llama (or Fooocus's own mini prompt expansion llm that in fact runs on the CPU). There is a repo focused on CPU-only SD 1.5.

Yeah, llama runs acceptably on my server, but buying a GPU and setting it all up seems really unfun. Also much more expensive than my hobby budget

Re: Easy Stable Diffusion XL in your device, offline

#126

Post by mrbmbzl »

pmarreck wrote: post #114
jessepasley wrote: post #63

Earlier quoted context omitted.

Just spent about 10 minutes building it on MacBook Pro M1. I come with significant bias against Python projects, but getting Fooocus to run was very, very easy.

I finally had a chance to set it up and yes, it works great!

did you get fooocus to run on silicon mac with mps support? i cant get mps support running for the love of god - any help would be much appreciated from me (as well as the 20 or so people plus that are currently looking for a solution on github to achieve normal speed generation compared to the 15 minutes per image :)) thank you

Re: Easy Stable Diffusion XL in your device, offline

#127

Post by brucethemoose2 »

stavros wrote: post #108
brucethemoose2 wrote: post #23

I would highly recommend Fooocus to anyone who hasn't tried: https://github.com/lllyasviel/Fooocus There are a bajillion local SD pipelines, but this one is, by far , the one with the highest quality output out-of-the-box, with short prompts. Its remarkable. And thats because it integrates a bajillion SDXL augmentations that other UIs do not implement or enable by default. I've been using stable diffusion since 1.5 c…

I was afraid of the Python setup (even though I'm a Python developer), but yep: Make the virtualenv, install the dependencies, done. This is amazing, the images it generates are immediately beautiful. It does look bad that it bundles GTM, though, as a sibling commenter says. Samples: https://imgz.org/i9oicVqo/ https://imgz.org/i8Ur3WjW/ https://imgz.org/i5j6r6TZ/

Be sure to try the styles as well. Thats actually a seperate input than the prompt for SDXL, and most other UIs dont implement the style prompting.

Re: Easy Stable Diffusion XL in your device, offline

#128

Post by brucethemoose2 »

calamari4065 wrote: post #125
brucethemoose2 wrote: post #73

Earlier quoted context omitted.

Not really. There is a very fast LCM model preset now, but its still going to be painful. SDXL in particular isn't one of those "compute light, bandwidth bound" models like llama (or Fooocus's own mini prompt expansion llm that in fact runs on the CPU). There is a repo focused on CPU-only SD 1.5.

Yeah, llama runs acceptably on my server, but buying a GPU and setting it all up seems really unfun. Also much more expensive than my hobby budget

You don't need a big one, even an old 4GB GPU will massively accelerate the prompt ingestion.

Re: Easy Stable Diffusion XL in your device, offline

#130

Post by demosthanos »

blehn wrote: post #12
sophrocyne wrote: post #3

There are already a number of local, inference options that are (crucially) open-source, with more robust feature sets. And if the defense here is "but Auto1111 and Comfy don't have as user-friendly a UI", that's also already covered. https://github.com/invoke-ai/InvokeAI

No idea whether or not the UI is user-friendly, but the installation steps alone for InvokeAI are already a barrier for 99.9% of the world. Not to say Noiselith couldn't be open-source, but it's clearly offering something different from InvokeAI.

I can't even figure out how one would install Noiselith. It has some text that says "Download for free on your PC", but it's not a button or a link. Maybe they're doing some weirdly locked-down user-agent sniffing and refuse to allow me to even attempt to download any version on Linux?

InvokeAI is installed via a script, sure, but it's also just a few clicks: download, extract, double-click on a specific file, enjoy.

Post reply on HN