Live data from Hacker News

Easy Stable Diffusion XL in your device, offline

noiselith.com

91–100 of 169 posts

Re: Easy Stable Diffusion XL in your device, offline

#91

How's support for AMD GPUs? I only saw Nvidia listed.

The main issue with AMD is that to get reasonable performance you need to use ROCm, and ROCm is only available on Linux. They started porting parts of ROCm to Windows but it's not enough to be usable yet, might be different in few months.

Re: Easy Stable Diffusion XL in your device, offline

#92
post #78

Earlier quoted context omitted.

I switched to InvokeAI and won't go back to basic a1111 webui. I like how everything is laid out, there are workflow features, you can easily recall all properties (prompt, model, lora, etc.) used to generate an image, things can be organized into boards, and all off the boards/images/metadata are stored in a very well-designed sqlite database that can be tapped into via DataGrip.

automatic1111: great for the fast implementation of the most recent generative features comfyui: excellent for workflows and recalling the workflows, as they're saved into the resulting image metadata (i.e. sharing images, shares the image generation pipeline) InvokeAI: Great UX and community, arguably were a bit behind in features as they were focused on making the UI work well. Now at the stage of bringing in the b…

Can you actually use those workflows in some sort of API from a script to automate it from lets say a python script. Played arround with comfy. Really nice, but i would like to automate it within my own environment.

Re: Easy Stable Diffusion XL in your device, offline

#93
post #29

Earlier quoted context omitted.

Another con is it only works on Silicon Macs.

Apple Silicon* I presume? This could honestly be the excuse I need (want) to order an absolute beast of a macbook pro to replace my 2013 model.

If you want an absolute beast, especially for this stuff, you probably want Intel + Nvidia. Apple Silicon is a beast in power efficiency but a top of the line M3 does not come close to the top of the line Intel + Nvidia combo.

Re: Easy Stable Diffusion XL in your device, offline

#94
post #78

Earlier quoted context omitted.

automatic1111: great for the fast implementation of the most recent generative features comfyui: excellent for workflows and recalling the workflows, as they're saved into the resulting image metadata (i.e. sharing images, shares the image generation pipeline) InvokeAI: Great UX and community, arguably were a bit behind in features as they were focused on making the UI work well. Now at the stage of bringing in the b…

Can you actually use those workflows in some sort of API from a script to automate it from lets say a python script. Played arround with comfy. Really nice, but i would like to automate it within my own environment.

Yeah, Invoke's nodes/workflows backend can be hit via the API. That's how the entire front-end UI (and workflow editor/IDE) are built.

I'm positive this can be done w/ Comfy too.

Re: Easy Stable Diffusion XL in your device, offline

#95
post #49

Earlier quoted context omitted.

Good lord. I can get a 2048x2048 upscaled output from a very complex ComfyUI workflow on a 4090 in 15 seconds. This includes three IPAdapter nodes, a sampling stage, a three-stage iterative latent upscaler, and multiple ControlNets. Macs are not close to competitive for inference yet.

I mean, a 4090 would appear to cost $2000, and came out a year ago; it has about 70bn transistors. The M1 could be had for $700 for a desktop, $1000 as part of a laptop, came out three years ago, and has 16bn transistors, some of which are CPU. An M3 Ultra might be a more reasonable comparison for the 4090.

24GB cards weren't always $2000. I've seen people on this very forum [1] who brought two 3090s for just $600 each.

Agree the prices are crazy right now, though.

[1] https://news.ycombinator.com/item?id=37438847

Re: Easy Stable Diffusion XL in your device, offline

#96

Earlier quoted context omitted.

Apple Silicon* I presume? This could honestly be the excuse I need (want) to order an absolute beast of a macbook pro to replace my 2013 model.

If you want an absolute beast, especially for this stuff, you probably want Intel + Nvidia. Apple Silicon is a beast in power efficiency but a top of the line M3 does not come close to the top of the line Intel + Nvidia combo.

Well this would just be the excuse. I'm typing this on a Ryzen 5950X w/32 GB of RAM and a 4090. So I guess I already have the beast?

Re: Easy Stable Diffusion XL in your device, offline

#97
post #83

Sales prompt: "Young woman with blonde curls in front of a fantasy world background, come hither eyes, sitting with her legs spread, wearing a white shirt and jeans hot pants." I mean, really??

I'm genuinely curious how many people in the open source community are pouring their sweat and blood into these projects that are, at the end of the day, enabling guys to transform their macbooks into insta-porn-books.

Re: Easy Stable Diffusion XL in your device, offline

#98
post #83

Sales prompt: "Young woman with blonde curls in front of a fantasy world background, come hither eyes, sitting with her legs spread, wearing a white shirt and jeans hot pants." I mean, really??

If the prompt wasn't somewhat sexual, divisive, or offensive it would be wide open to the chorus of "still not as good as midjourney/dall-e/imagen". Freedom from restriction is one of the main selling points.

Re: Easy Stable Diffusion XL in your device, offline

#99
post #39
post #33

Earlier quoted context omitted.

Are you the developer by any chance? If so, it would be helpful to state it.

I am. I thought this is obvious. My statement is objective. I would go as far as: it is the only app works at 8GiB macOS devices with SDXL-family models.

Nice app - but for future reference it is very much not obvious to any native English speaker. "You should check out X" sounds like a random recommendation.

Re: Easy Stable Diffusion XL in your device, offline

#100
As others have stated, Local AI (completely offline after model/weight download) is the way to go. If I have the hardware why shouldn't I be able to run all these fancy software on my own machine?

There are many great suggestions and links to other similar/better packages, so follow the comments for more info, thanks :-)

Post reply on HN