Show HN: New AI edits images based on text instructions

#1

Post by bryced » Sun, Jan 22, 2023, 4:25 AM UTC

This works suprisingly well. Just give it instructions like "make it winter" or "remove the cars" and the photo is altered.

Here are some examples of transformations it can make: Golden gate bridge: https://raw.githubusercontent.com/brycedrennan/imaginAIry/ma... Girl with a pearl earring: https://raw.githubusercontent.com/brycedrennan/imaginAIry/ma...

I integrated this new InstructPix2Pix model into imaginAIry (python library) so it's easy to use for python developers.

Show HN: New AI edits images based on text instructions
github.com

Re: Show HN: New AI edits images based on text instructions

#2

Post by [deleted] » Sun, Jan 22, 2023, 4:25 AM UTC

[deleted]

Re: Show HN: New AI edits images based on text instructions

#3

Post by nullish_signal » Sun, Jan 22, 2023, 4:43 AM UTC

>11GB VRAM

Aaarrrgghh let me know when it's down to 4GB like Stable Diffusion

The prompt-based masking sounds incredible, with either pixel +/- or Prompt Relevance +/-

VERY impressive img2img capabilities!

Re: Show HN: New AI edits images based on text instructions

#4

Post by bryced » Sun, Jan 22, 2023, 4:47 AM UTC

nullish_signal wrote: post #3

>11GB VRAM Aaarrrgghh let me know when it's down to 4GB like Stable Diffusion The prompt-based masking sounds incredible, with either pixel +/- or Prompt Relevance +/- VERY impressive img2img capabilities!

It is stable diffusion but yes my fork does not have the memory optimizations needed to run it on only 4gb

Re: Show HN: New AI edits images based on text instructions

#5

Post by [deleted] » Sun, Jan 22, 2023, 5:34 AM UTC

[deleted]

Re: Show HN: New AI edits images based on text instructions

#6

Post by ilaksh » Sun, Jan 22, 2023, 5:44 AM UTC

Does anyone know if there is something like Google Cloud for GPUs but with an easy way to suspend the VM or container when not in use? Maybe I am just looking for container hosting with GPUs.

I am just trying to avoid some of the basic VM admin stuff like creating, starting, stopping for SaaS if someone already has a way to do. Maybe this is something like what Elastic Beanstalk does.

Re: Show HN: New AI edits images based on text instructions

#7

Post by PaulMest » Sun, Jan 22, 2023, 5:46 AM UTC

I've played with several of these Stable Diffusion frameworks and followed many tutorials and imaginAIry fit my workflow the best. I actually wrote Bryce a thank you email in December after I made an advent calendar for my wife. Super excited to see continued development here to make this approachable to people who are familiar with Python, but don't want to deal with a lot of the overhead of building and configuring SD pipelines.

Re: Show HN: New AI edits images based on text instructions

#8

Post by TekMol » Sun, Jan 22, 2023, 5:48 AM UTC

How can I try this?

Can this be run on a Digitalocean VM?

I looked around on DO's products, but none seems to advertise that it has a GPU. So maybe it is not possible?

Re: Show HN: New AI edits images based on text instructions

#9

Post by patientplatypus » Sun, Jan 22, 2023, 5:49 AM UTC

[dead]

Re: Show HN: New AI edits images based on text instructions

#10

Post by midlightdenight » Sun, Jan 22, 2023, 5:55 AM UTC

ilaksh wrote: post #6

Does anyone know if there is something like Google Cloud for GPUs but with an easy way to suspend the VM or container when not in use? Maybe I am just looking for container hosting with GPUs. I am just trying to avoid some of the basic VM admin stuff like creating, starting, stopping for SaaS if someone already has a way to do. Maybe this is something like what Elastic Beanstalk does.

Maybe not quite what you’re looking for, but I’ve seen some people mention banana.dev

https://www.banana.dev/

Never used it myself, but looks like AWS Lambda/GCP Cloud Functions tailored to ML models.