Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Easy Stable Diffusion XL in your device, offline

noiselith.com

Post reply on HN
Print view View original

51–60 of 169 posts

Re: Easy Stable Diffusion XL in your device, offline

#51

Post by ttul »

tracerbulletx wrote: post #21
weakfish wrote: post #20

Earlier quoted context omitted.

Elaborate?

I'm being kind of tongue in cheek because I understand that this is for just making things really easy and ComfyUI is a node based editor that most people would have trouble with. But the best UI for local SD generation that the community is using is https://github.com/comfyanonymous/ComfyUI

If you are a programmer at heart, ComfyUI will feel very comfortable (pun intended). It's basically a visual programming environment optimized for the type of compositional programming that machine learning models desire. The next thing this space needs is someone to build an API hosting every imaginable model on a vast farm of GPUs in the cloud. Use ComfyUI and other apps to orchestrate the models locally, but send data to the cloud and benefit from sharing GPU resources far more efficiently.

If anyone has a spare thousand hours to kill, I would build that and connect it up with the various front-ends including ComfyUI, A111, etc.. not a small amount of effort, but it will be rewarding.

Re: Easy Stable Diffusion XL in your device, offline

#52

Post by rgbrgb »

liuliu wrote: post #30
rvz wrote: post #28

Earlier quoted context omitted.

Looks like a complete contraption to setup and looks very unpleasant to use at first glance when compared against Noiselith. The hundreds of python scripts and having the user to touch the terminal shows why something like Noiselith should exist for normal users rather than developers or programmers. I would rather take a packaged solution that just works over a bunch of scripts requiring a terminal.

You have to make trade-off in software development. Fooocus trades on the best picture rather than the most beautiful interface, and also simplicity in its use. I think it is a good trade-off given the technology is improving at breaking-neck speed. Look, DiffusionBee is still maintained but still no SDXL support. Anyone who bet that the technology is done and it is time to focus on the UI is making the wrong bet.

This project is really cool and I like the stated philosophy on the README. I think it's making the right trade-off in terms of setting useful defaults and not showing you 100 arcane settings. However, the installation is too hard. It's a student project and free so I'm not criticizing the author at all but I think it's a pretty fair and useful criticism of the software and likely a significant bottleneck to adoption.

Re: Easy Stable Diffusion XL in your device, offline

#53

Post by adamjc »

liuliu wrote: post #39
miles wrote: post #33

Earlier quoted context omitted.

Are you the developer by any chance? If so, it would be helpful to state it.

I am. I thought this is obvious. My statement is objective. I would go as far as: it is the only app works at 8GiB macOS devices with SDXL-family models.

How would that be obvious to anyone?

Re: Easy Stable Diffusion XL in your device, offline

#54

Post by stets »

definitely exciting to see more local clients come out. As mentioned in other comments, there are some great ones out already. I've used automatic1111 which is quick and doesn't require a ton of tuning. But it still has lots of knobs and options which makes it difficult initially. Fooocus is super quick but of course less customization.

Then there's ComfyUI, the holy grail of complicated, but with that complication comes the ability to do so much. It is a node-based app that allows you to create custom workflows. Once your image is generated, you can pipe that "node" somewhere else and modify it, eg: upscale the image or do other things.

I'd like to see if Noiselith or some others offer support for SDXLTurbo -- it came out only a few days ago but in my opinion is a complete game-changer. It can generate 512x512 images in ~half a second on consumer GPUs. The images aren't crazy quality but that ability to make a prompt like "fox in the woods", see it instantly and then add "wearing a hat" and see it instantly generate again is so valuable. Prior to that, I'd wait 12 seconds for an image. Sounds like not a big deal, but the value of being able to iterate so quickly makes local image gen so much more fun.

Re: Easy Stable Diffusion XL in your device, offline

#56

Post by rgbrgb »

liuliu wrote: post #24
rgbrgb wrote: post #14

Just installed, this is very cool. Local AI is the future I want (and what I'm working on too). A few notes using it... Pros: - seems pretty self contained - built in model installer works really well and helps you download anything from CivitAI (I installed https://civitai.com/models/183354/sdxl-ms-paint-portraits ) - image generation is high quality and stable - shows intermediate steps during generation Cons: - do…

You should check out Draw Things on macOS. It works well enough for SDXL on 8GiB macOS devices.

Thanks. Yeah I played with your app early on and just fired it up again to see the progress. Frankly I find the interface pretty intimidating but it is cool that you can easily stitch generations together.

Unsolicited UX recs:

- strongly recommend a default model. The list you give is crazy long. It kind of recommends SD 1.5 in the UI text below the picker but has the last one selected by default. Many of them are called the same thing (ironically the name is "Generic" lol).

- have the panel on the left closed by default or show a simplified view that I can expand to an "advanced" view. Consider sorting the left panel controls by how often I would want to edit them (personally I'm not going to touch the model but it is the first thing).

You are doing great work but I wouldn't underestimate the value of simplifying the interface for a first-time user. It seems to have a ton of features but I don't know what I should actually be paying attention to / adjusting.

Is there a business model attached to this or do you have a hypothesis for what one might look like?

Re: Easy Stable Diffusion XL in your device, offline

#57

Post by [deleted] »

rgbrgb wrote: post #52
liuliu wrote: post #30

Earlier quoted context omitted.

You have to make trade-off in software development. Fooocus trades on the best picture rather than the most beautiful interface, and also simplicity in its use. I think it is a good trade-off given the technology is improving at breaking-neck speed. Look, DiffusionBee is still maintained but still no SDXL support. Anyone who bet that the technology is done and it is time to focus on the UI is making the wrong bet.

This project is really cool and I like the stated philosophy on the README. I think it's making the right trade-off in terms of setting useful defaults and not showing you 100 arcane settings. However, the installation is too hard. It's a student project and free so I'm not criticizing the author at all but I think it's a pretty fair and useful criticism of the software and likely a significant bottleneck to adoption…

[deleted]

Re: Easy Stable Diffusion XL in your device, offline

#58

Post by Filligree »

Liquix wrote: post #42
rvz wrote: post #28

Earlier quoted context omitted.

Looks like a complete contraption to setup and looks very unpleasant to use at first glance when compared against Noiselith. The hundreds of python scripts and having the user to touch the terminal shows why something like Noiselith should exist for normal users rather than developers or programmers. I would rather take a packaged solution that just works over a bunch of scripts requiring a terminal.

installation/setup is dead simple. up and running in under 3 minutes: git clone https://github.com/lllyasviel/Fooocus.git cd Fooocus pip3 install -r requirements_versions.txt python3 entry_with_update.py

Let's see...

> pip3: command not found

Okay. I'll need to install it? What package might that be in, hmm. Moving on, I already know it's python.

> /usr not writeable

Guess I'll use sudo...

= = =

Obviously I know better than to do this, but very few people would. This is not 'dead simple'! It's only simple for Python programmers who are already familiar with the ecosystem.

Now, fortunately the actual documentation does say to use venv. That's still not 'dead simple'; you still need to understand the commands involved. There's definitely space for a prepackaged binary.

Re: Easy Stable Diffusion XL in your device, offline

#59

Post by pixl97 »

Filligree wrote: post #58
Liquix wrote: post #42

Earlier quoted context omitted.

installation/setup is dead simple. up and running in under 3 minutes: git clone https://github.com/lllyasviel/Fooocus.git cd Fooocus pip3 install -r requirements_versions.txt python3 entry_with_update.py

Let's see... > pip3: command not found Okay. I'll need to install it? What package might that be in, hmm. Moving on, I already know it's python. > /usr not writeable Guess I'll use sudo... = = = Obviously I know better than to do this, but very few people would . This is not 'dead simple'! It's only simple for Python programmers who are already familiar with the ecosystem. Now, fortunately the actual documentation do…

The people that make software that does useful things, and the people that understand system security live on different planets. One day they'll meet each other and have a religious war.

This said, it's nice when developers attempt to detect the executable they need and warn what package is missing.

Re: Easy Stable Diffusion XL in your device, offline

#60

Post by liuliu »

rgbrgb wrote: post #56
liuliu wrote: post #24

Earlier quoted context omitted.

You should check out Draw Things on macOS. It works well enough for SDXL on 8GiB macOS devices.

Thanks. Yeah I played with your app early on and just fired it up again to see the progress. Frankly I find the interface pretty intimidating but it is cool that you can easily stitch generations together. Unsolicited UX recs: - strongly recommend a default model. The list you give is crazy long. It kind of recommends SD 1.5 in the UI text below the picker but has the last one selected by default. Many of them are ca…

Agreed on UX feedback. It accumulated a lot of crufts from the old technologies to the new. This just echos my early feedback that co-iterating UI and the technology is difficult, you'd better pick the side you want to be on and there is only one correct side (and unfortunately, the current app is trying hard to be on both-side).
Post reply on HN