Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Try Stable Diffusion's Img2Img Mode

huggingface.co

Post reply on HN
Print view View original

131–140 of 166 posts

Re: Try Stable Diffusion's Img2Img Mode

#131

Post by f38zf5vdt »

bravura wrote: post #126
f38zf5vdt wrote: post #122

Earlier quoted context omitted.

One of the first things that came out when the model was released. https://github.com/schmidtdominik/stablediffusion-interpolat...

Thank you, but this notebook appears to use images generated from text prompts. I was interested in interpolating between two given images, without generating from text.

You would need to run CLIP and generate CLIP embeddings from the images first, then feed them into the samplers. If you give it the starting images and caption them yourself, then it would also work.

Re: Try Stable Diffusion's Img2Img Mode

#132

Post by desindol »

omnimus wrote: post #102
desindol wrote: post #77

Earlier quoted context omitted.

You in 1894: Why does no one think about all the horses and stable boys. The value of art is also not in the hours you put into creating it it's about the idea behind it and how it's conveyed. Artists are also always stealing especially concept artists the only thing to say is "photobashing". You talk like someone who has absolutely no idea how the sausage is made.

Yes, yes and invention of camera will kill painters. Sure everybody knows this. But there is important difference between someone stealing and some algorithm copy replicating anything from the past in instant. One is a remix that brings something new (even if author doesn't want) the other in static its conservation. It will create side effects that will impact our (visual) culture. But who knows what those will be.

You must have missed the last 50 years with that much fear of change. Yikes.

Re: Try Stable Diffusion's Img2Img Mode

#133

Post by xd1936 »

Kiro wrote: post #84
joshuahedlund wrote: post #25

Some amazing examples of what people have done with img2img with Stable Diffusion: https://old.reddit.com/r/StableDiffusion/comments/wy7oa5/img... https://old.reddit.com/r/StableDiffusion/comments/wyq04v/usi... https://old.reddit.com/r/StableDiffusion/comments/wzlmty/its...

old.reddit is truly horrible on mobile. Once you click on an image you can't go back. Off topic, but what is the other alternative UI called that people sometimes use?

I use the Slide for Reddit app (one of many choices) and links open automatically because of the app's URL handler.

Re: Try Stable Diffusion's Img2Img Mode

#134

Post by fragmede »

mishig wrote: post #89

Hello, everyone I'm Mishig, one of the engineers worked on setting up the demo. Happy to answer any questions if you got some :) You can find the announcement tweet here: https://twitter.com/mishig25/status/1563226161924407298?s=20...

Just wanted to say thanks. It’s really cool!

Re: Try Stable Diffusion's Img2Img Mode

#135

Post by ShamelessC »

orbital-decay wrote: post #107
epups wrote: post #96

Earlier quoted context omitted.

With a 3090 it's about 10s to generate a 512x512 image from another, maybe less.

You're probably using the default PLMS sampler with 50 steps. There are better samplers, the best seem to be Euler (more predictable in regards to the number of steps) and Euler ancestral (gives more variation). Both typically need much less steps to converge, speeding up the generation.

My understanding was that PLMS was the current state-of-the-art. Would be interested if you have a citation for this "Euler" sampling method.

Re: Try Stable Diffusion's Img2Img Mode

#136

Post by machineleaning »

gitfan86 wrote: post #125
BatteryMountain wrote: post #111

Earlier quoted context omitted.

Nvidia GTX 1660 Super with 6GB of VRAM. I do runs at 384px by 384px, with batch size of 1. Sampling method has almost no impact on memory. Using k_euler with 30 steps renders an image in 10 to 20 seconds. The biggest thing that affect rending speed is the steps and the resolution, so 512x512 with C 50 using ddim is much slower than 256x256 with C 25 using k_euler. The sampling methods run mostly in the same timelines…

I'm running 1660 ti on Windows 11. I'm thinking about getting a 3090 so that I can make higher resolution images. Gfpgan runs much faster for me 5 seconds per picture

What resolution could you get on a 3090?

Re: Try Stable Diffusion's Img2Img Mode

#137

Post by namrog84 »

fareesh wrote: post #101

Is anyone working on a variation of this where the output is a blender scene?

I am very interested in possibilities of generating 3d models as well.

There is a fair amount of 3d models out there so it should be possible.

I suspect we will end up using multiple 2d images at different angles to generate a 3d model. I have seen this done before

Re: Try Stable Diffusion's Img2Img Mode

#138

Post by ShamelessC »

StevenWaterman wrote: post #85
freeqaz wrote: post #76

I've been playing with this for a few hours. It's slow going -- you really need a fast GPU with a lot of RAM to make this very usable. I ended up paying the $10 for Google Colab Pro and that's how I've been using this. Maybe I'll figure out how to get this working on my old 1080 TI to see if it's faster. Anyway, for the one that I'm using which has a web UI, you can use this Colab link. It's pretty great! https://col…

You can feed a txt2img output into the img2img pipeline as an init, that's something that I do quite often, eg https://twitter.com/SteWaterman/status/1563872748161613826 Also how slow is your p100? I'm usually getting around 3 it/s. Maybe it's just because I'm used to disco diffusion where a single image took over an hour, but this is ungodly fast to me

Colab can feel slow for other reasons, such as throttled download speeds making it very slow to download weights on a cold boot.

Re: Try Stable Diffusion's Img2Img Mode

#139

Post by nickthegreek »

comex wrote: post #13

If you have a GPU with >4GB of VRAM and you want to run this locally, here's a fork of the Stable Diffusion repo with a convenient web UI: https://github.com/hlky/stable-diffusion It supports both txt2img and img2img. (Not affiliated.) Edit: Incidentally, I tried running it on a CPU. It is possible, but it took 3 minutes instead of 10 seconds to produce an image. It also required me to hack up the script in a really…

Got this working on my 8gb 3070. 7-8s per image with default settings. Thanks for posting this!

Re: Try Stable Diffusion's Img2Img Mode

#140

Post by nickthegreek »

nilsb wrote: post #66
TuringTest wrote: post #65

Earlier quoted context omitted.

How do you set up the model? Instructions only say "Download the model checkpoint. (e.g. from huggingface)", but I can't find instructions there on how to find a ckpt file, nor exactly what file should I look for.

You'll need this file: https://huggingface.co/CompVis/stable-diffusion-v-1-4-origin... - Before you can download it you have to accept the T&C at https://huggingface.co/CompVis/stable-diffusion-v-1-4-origin...

Thank you, this saved me a lot of frustration.
Post reply on HN