Live data from Hacker News

Show HN: New AI edits images based on text instructions

github.com

71–80 of 241 posts

Re: Show HN: New AI edits images based on text instructions

#71
post #63

What are the most affordable GPUs that will run this? (it said it needs CUDA, min 11GB VRAM, so I guess my relatively puny 4GB 570RX isn't going to cut it!)

I'm running on a 2080 TI and an edit runs in 2 seconds. On my Apple M1 Max 32Gb edits take about 60 seconds.

Re: Show HN: New AI edits images based on text instructions

#72
post #64
post #62

How does this work? When I run it on a machine with a GPU (pytorch, CUDA etc installed) I still see it downloading files for each prompt. Is the image being generated on the cloud somewhere or on my local machine? Why the downloads?

Shouldn't be downloads per prompt. Processing happens on your machine. It does download models as needed. A network call per prompt would be a bug.

OK. I noticed that the images are not accurate when I give my own descriptions. Not sure if this is a limitation of Stable Diffusion. For example, for the text "cat and mouse samurai fight in a forest, watched by a porcupine" I got a cat and a mouse (with a cat's face and tail!!) in a forest sort of fighting. But no - porcupine

Thank you for creating this.

Re: Show HN: New AI edits images based on text instructions

#74
post #12

Doesn't work if any people are in the photos: https://twitter.com/kumardexati/status/1616972740728356867/p...

It does work on some things with people. I colorized a black and white photo of myself and then turned the colorized version into me as a Dwarven king.

Re: Show HN: New AI edits images based on text instructions

#75
post #64
post #62

How does this work? When I run it on a machine with a GPU (pytorch, CUDA etc installed) I still see it downloading files for each prompt. Is the image being generated on the cloud somewhere or on my local machine? Why the downloads?

Shouldn't be downloads per prompt. Processing happens on your machine. It does download models as needed. A network call per prompt would be a bug.

I keep seeing this even when the prompt is unchanged

Downloading https://huggingface.co/runwayml/stable-diffusion-v1-5/resolv... from huggingface Loading model /home/hrishi/.cache/huggingface/hub/models--runwayml--stable-diffusion-v1-5/snapshots/889b629140e71758e1e0006e355c331a5744b4bf/v1-5-pruned-emaonly.ckpt onto cuda backend...

followed by a download

Re: Show HN: New AI edits images based on text instructions

#76
post #41

Can it make it pop? Because that was the #1 request I remember dealing with.

I tried it out :-)

`aimg edit assets/girl_with_a_pearl_earring.jpg "make it pop" --prompt-strength 40 --gif`

https://user-images.githubusercontent.com/1217531/213912442-...

Re: Show HN: New AI edits images based on text instructions

#77
post #75
post #64

Earlier quoted context omitted.

Shouldn't be downloads per prompt. Processing happens on your machine. It does download models as needed. A network call per prompt would be a bug.

I keep seeing this even when the prompt is unchanged Downloading https://huggingface.co/runwayml/stable-diffusion-v1-5/resolv... from huggingface Loading model /home/hrishi/.cache/huggingface/hub/models--runwayml--stable-diffusion-v1-5/snapshots/889b629140e71758e1e0006e355c331a5744b4bf/v1-5-pruned-emaonly.ckpt onto cuda backend... followed by a download

That is strange. I'm not sure what would cause that unless it was running in some ephemeral environment. What OS? Can you open a github issue with a screenshot?

Re: Show HN: New AI edits images based on text instructions

#78
post #72
post #64

Earlier quoted context omitted.

Shouldn't be downloads per prompt. Processing happens on your machine. It does download models as needed. A network call per prompt would be a bug.

OK. I noticed that the images are not accurate when I give my own descriptions. Not sure if this is a limitation of Stable Diffusion. For example, for the text "cat and mouse samurai fight in a forest, watched by a porcupine" I got a cat and a mouse (with a cat's face and tail!!) in a forest sort of fighting. But no - porcupine Thank you for creating this.

yes stable diffusion is not great about handling multiple ideas. New image models coming out soon though.
Post reply on HN