The official blog post from Stability is finally up and would probably be a better URL to link to than the TechCrunch coverage: https://stability.ai/blog/stable-diffusion-sdxl-1-announceme...
Stable Diffusion XL 1.0
81–90 of 182 posts
Re: Stable Diffusion XL 1.0
#82It sounds like after the previous 0.9 version there was some refining done: > The refining process has produced a model that generates more vibrant and accurate colors, with better contrast, lighting, and shadows than its predecessor. The imaging process is also streamlined to deliver quicker results, yielding full 1-megapixel (1024x1024) resolution images in seconds in multiple aspect ratios. Sounds pretty impressiv…
There were, IIRC, three different post-0.9 candidate models in parallel testing to become 1.0 recently.
Re: Stable Diffusion XL 1.0
#83I'm out of date on the image-generating side of AI, but I'd like to check things out. What's the best tool for image generation that's available on a website right now? Ie, not a model that I have to run locally.
https://playgroundai.com/create Not affiliated in anyway and not very involved in the space. I just wanted to generate some images a few weeks ago and was looking for somewhere I could do that for free. The link above lets you do that but I suggest you look up prompts because its a lot more involved than I expected.
Any particularly useful resources for looking into prompts?
Re: Stable Diffusion XL 1.0
#84Earlier quoted context omitted.
https://playgroundai.com/create Not affiliated in anyway and not very involved in the space. I just wanted to generate some images a few weeks ago and was looking for somewhere I could do that for free. The link above lets you do that but I suggest you look up prompts because its a lot more involved than I expected.
Any particularly useful resources for looking into prompts?
This AI Horde UI has, IMO, some really good templates and suggestions:
Re: Stable Diffusion XL 1.0
#85I always wondered why the vision models don't seem to be following the whole "scale up as much as possible" mantra that has defined the language models of the past few years (to the same extent). Even 3.5 billion parameters is absolutely nothing compared to the likes of GPT-3, 3.5, 4, or even the larger open-source language models (e.g. LLaMA-65B). Is it just an engineering challenge that no one has stepped up for ye…
Diffusion is more parameter-efficient and you quickly saturate the target fidelity, especially with some refiner cascade. It's a solved problem. You do not need more than maybe 4B total. Images are far more redundant than text.
In fact, most interesting papers since Imagen show that you get more mileage out of scaling the text encoder part, which is, of course, a Transformer. This is what drives accuracy, text rendering, compositionality, parsing edge cases. In SD 1.5 the text encoder part (CLIP ViT-L/14) takes a measly 123M parameters.[1] In Imagen, it was T5-XXL with 4.6B [2]. I am interested in someone trying to use a really strong encoder baseline – maybe from a UL2-20B – to push this tactic further.
Seeing as you can throw out diffusion altogether and synthesize images with transformers [3], there is no reason to prioritize the diffusion part as such.
1. https://forums.fast.ai/t/stable-diffusion-parameter-budget-a...
Re: Stable Diffusion XL 1.0
#86I hope someday there’s a version of this or something comparable to it that can run on <8gb consumer hardware. The main selling point of Stable Diffusion was its ability to run in that environment.
> I hope someday there’s a version of this or something comparable to it that can run on Someday is today: from the official announcement: “SDXL 1.0 should work effectively on consumer GPUs with 8GB VRAM or readily available cloud instances.” https://stability.ai/blog/stable-diffusion-sdxl-1-announceme...
Re: Stable Diffusion XL 1.0
#87I'm out of date on the image-generating side of AI, but I'd like to check things out. What's the best tool for image generation that's available on a website right now? Ie, not a model that I have to run locally.
If you want to play around with Stable Diffusion XL: https://clipdrop.co
Since clipdrop hs an API is there any way to use it with ComfyUI or Automatic111 (or whatever that's called).
Re: Stable Diffusion XL 1.0
#88I hope someday there’s a version of this or something comparable to it that can run on <8gb consumer hardware. The main selling point of Stable Diffusion was its ability to run in that environment.
I feel like this is the greatest demand for LLMs at the moment too. It's hard to believe we're only 8 months into this industry, so I imagine we'll start seeing smaller footprints soon.
We already do. MLC-LLM and Llama.cpp have Vulkan/OpenCL/Metal 3 bit implementations. That can run llama 7B (or maybe even 13b?) in 8GB.
TBH devices just need more ram for coherent output though. Llama 13b and 33b are so much "smarter" and more coherent than 7B with 3 bit quant.
Re: Stable Diffusion XL 1.0
#89Earlier quoted context omitted.
Sort of. IIRC (which may be unlikely) Auto1111 has the base model in the text to image plane, but if you want to use the refiner that is a separate IMG2IMG step/tab. Which would be a pain in the ass imo. The "Comfy" tool is node based and you can string both together which is nice. Although if you aren't confident in your images you don't need the refiner for a bit.
I think the diffusers UIs (like Invoke and VoltaML) are going to implement the refiner soon since HF already has a pipeline for it. Comfy and A1111 are based around the original SD StabilityAI code, but the implementation must be pretty similar if they could add the base model so quickly.
Work started with the SDXL 0.9 release, and for A1111 it exited release candidatr status in the last few days.
Re: Stable Diffusion XL 1.0
#90I'm out of date on the image-generating side of AI, but I'd like to check things out. What's the best tool for image generation that's available on a website right now? Ie, not a model that I have to run locally.
https://dreamstudio.ai/
What models does dreamstudio use? I couldn't see how to view them without logging in.