Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Easy Stable Diffusion XL in your device, offline

noiselith.com

Post reply on HN
Print view View original

71–80 of 169 posts

Re: Easy Stable Diffusion XL in your device, offline

#71

Post by neilv »

brucethemoose2 wrote: post #23

I would highly recommend Fooocus to anyone who hasn't tried: https://github.com/lllyasviel/Fooocus There are a bajillion local SD pipelines, but this one is, by far , the one with the highest quality output out-of-the-box, with short prompts. Its remarkable. And thats because it integrates a bajillion SDXL augmentations that other UIs do not implement or enable by default. I've been using stable diffusion since 1.5 c…

Looks like the Web UI of the self-hosted install of Fooocus sells out the user to Google Tag Manager.

Can our entire field please realize that running this surveillance is a bad move, and just stop doing it.

Re: Easy Stable Diffusion XL in your device, offline

#72

Post by tredre3 »

dreadlordbone wrote: post #38

After installation, it wouldn't run on my Windows machine unless I granted public and private network access. Kinda tripped up since it says "offlilne".

I had a similar experience.

On the first run it downloads about 30GB of data. I don't know if it would work offline on subsequent runs because for me it never ran again without crashing!

Also upon uninstallation it left behind all its data (not user data, mind you. But the executable itself, its python venv, its updater, and all the models. Uninstall basically just removed the shortcut in the start menu).

Re: Easy Stable Diffusion XL in your device, offline

#73

Post by brucethemoose2 »

calamari4065 wrote: post #67
brucethemoose2 wrote: post #23

I would highly recommend Fooocus to anyone who hasn't tried: https://github.com/lllyasviel/Fooocus There are a bajillion local SD pipelines, but this one is, by far , the one with the highest quality output out-of-the-box, with short prompts. Its remarkable. And thats because it integrates a bajillion SDXL augmentations that other UIs do not implement or enable by default. I've been using stable diffusion since 1.5 c…

Is this at all usable on a CPU-only system with a ton of RAM?

Not really. There is a very fast LCM model preset now, but its still going to be painful.

SDXL in particular isn't one of those "compute light, bandwidth bound" models like llama (or Fooocus's own mini prompt expansion llm that in fact runs on the CPU).

There is a repo focused on CPU-only SD 1.5.

Re: Easy Stable Diffusion XL in your device, offline

#74

Post by quitit »

mikae1 wrote: post #69
rgbrgb wrote: post #14

Just installed, this is very cool. Local AI is the future I want (and what I'm working on too). A few notes using it... Pros: - seems pretty self contained - built in model installer works really well and helps you download anything from CivitAI (I installed https://civitai.com/models/183354/sdxl-ms-paint-portraits ) - image generation is high quality and stable - shows intermediate steps during generation Cons: - do…

> not open source like competitors Who are the competitors?

DiffusionBee: AGPL-3.0 license (Native app)

InvokeAI: Apache license 2.0 (web-browser UI)

automatic1111: AGPL-3.0 license (web-browser UI)

ComfyUI:GPL-3.0 license (web-browser UI)

There's more, but I don't pay enough attention to it

Re: Easy Stable Diffusion XL in your device, offline

#75

Post by mikae1 »

quitit wrote: post #74
mikae1 wrote: post #69

Earlier quoted context omitted.

> not open source like competitors Who are the competitors?

DiffusionBee: AGPL-3.0 license (Native app) InvokeAI: Apache license 2.0 (web-browser UI) automatic1111: AGPL-3.0 license (web-browser UI) ComfyUI:GPL-3.0 license (web-browser UI) There's more, but I don't pay enough attention to it

Thanks! https://lmstudio.ai/ too. For the more technically inclined perhaps.

Re: Easy Stable Diffusion XL in your device, offline

#76

Post by quitit »

Vicinity9635 wrote: post #64
philote wrote: post #29

Earlier quoted context omitted.

Another con is it only works on Silicon Macs.

Apple Silicon* I presume? This could honestly be the excuse I need (want) to order an absolute beast of a macbook pro to replace my 2013 model.

If it's just for hobby/interest work, then just a heads-up that even the 1st generation Apple Silicon will turn over about one image a second with SDXL Turbo. The M3s of course are quite a bit faster.

The performance gains in recent models and PyTorch are currently outpacing hardware advances by a significant margin, and there are still large amounts of low-hanging fruit in this regard.

Re: Easy Stable Diffusion XL in your device, offline

#77

Post by skrowl »

rgbrgb wrote: post #14

Just installed, this is very cool. Local AI is the future I want (and what I'm working on too). A few notes using it... Pros: - seems pretty self contained - built in model installer works really well and helps you download anything from CivitAI (I installed https://civitai.com/models/183354/sdxl-ms-paint-portraits ) - image generation is high quality and stable - shows intermediate steps during generation Cons: - do…

[dead]

Re: Easy Stable Diffusion XL in your device, offline

#78

Post by quitit »

internet101010 wrote: post #16
sophrocyne wrote: post #3

There are already a number of local, inference options that are (crucially) open-source, with more robust feature sets. And if the defense here is "but Auto1111 and Comfy don't have as user-friendly a UI", that's also already covered. https://github.com/invoke-ai/InvokeAI

I switched to InvokeAI and won't go back to basic a1111 webui. I like how everything is laid out, there are workflow features, you can easily recall all properties (prompt, model, lora, etc.) used to generate an image, things can be organized into boards, and all off the boards/images/metadata are stored in a very well-designed sqlite database that can be tapped into via DataGrip.

automatic1111: great for the fast implementation of the most recent generative features

comfyui: excellent for workflows and recalling the workflows, as they're saved into the resulting image metadata (i.e. sharing images, shares the image generation pipeline)

InvokeAI: Great UX and community, arguably were a bit behind in features as they were focused on making the UI work well. Now at the stage of bringing in the best features of competitors - Like you, I can easily recommend it above all other options.

Re: Easy Stable Diffusion XL in your device, offline

#79

Post by dragonwriter »

mikae1 wrote: post #75
quitit wrote: post #74

Earlier quoted context omitted.

DiffusionBee: AGPL-3.0 license (Native app) InvokeAI: Apache license 2.0 (web-browser UI) automatic1111: AGPL-3.0 license (web-browser UI) ComfyUI:GPL-3.0 license (web-browser UI) There's more, but I don't pay enough attention to it

Thanks! https://lmstudio.ai/ too. For the more technically inclined perhaps.

I don't think lmstudio is competes with Stable Diffusion frontends, even for the technically-inclined.

Re: Easy Stable Diffusion XL in your device, offline

#80

Post by [deleted] »

mikae1 wrote: post #75
quitit wrote: post #74

Earlier quoted context omitted.

DiffusionBee: AGPL-3.0 license (Native app) InvokeAI: Apache license 2.0 (web-browser UI) automatic1111: AGPL-3.0 license (web-browser UI) ComfyUI:GPL-3.0 license (web-browser UI) There's more, but I don't pay enough attention to it

Thanks! https://lmstudio.ai/ too. For the more technically inclined perhaps.

[deleted]
Post reply on HN