Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: New AI edits images based on text instructions

github.com

Post reply on HN
Print view View original

141–150 of 241 posts

Re: Show HN: New AI edits images based on text instructions

#141

Post by rjh29 »

c7b wrote: post #93
rjh29 wrote: post #88

Earlier quoted context omitted.

Oh yeah it's definitely still an issue right now! But I think the power of ChatGPT's ability to understand and execute instructions has convinced most people that "prompt engineering" isn't going to be a career path in the future.

Absolutely. I briefly thought about asking ChatGPT to write a prompt, but then I remembered that the training corpus is probably older than those tools (I heard that if you ask it the right way, it will tell you that its corpus ended in 21 - whether it's true or not, it sounds plausible). But that's a truly temporary issue, the respective subreddits probably have enough information to train an AI for prompt engineeri…

In the near future you can totally imagine a dialogue like that you'd have with a real designer, "can you make it pop a bit more?" or "can you move that logo to the right side?". It might some trial and error but it's only going to improve.

Making the AI truly creative (which means going beyond what the client asks for, towards things the client doesn't even know they want) would be a much larger leap and potentially take a lot longer.

Re: Show HN: New AI edits images based on text instructions

#142

Post by dist1ll »

b33j0r wrote: post #113
GordonS wrote: post #63

What are the most affordable GPUs that will run this? (it said it needs CUDA, min 11GB VRAM, so I guess my relatively puny 4GB 570RX isn't going to cut it!)

Can you imagine only being able to cook a hamburger on one brand of grill? But you can make something kinda similar in the toaster oven you can afford? I want to be productive on this comment… but the crypto/cuda nexus of GPU work is simply not rational. Why are we still here? You want to work in this field? Step 1. Buy an NVIDIA gpu. Step 2. CUDA. Step 3. Haha good luck, not available to purchase. This situation is…

Because innovating in the hardware space is just a lot more expensive and slow.

Also the vast majority of ML researchers and engineers are not system programmers. They don't care about vendor lock because they're not the ones writing the drivers.

Re: Show HN: New AI edits images based on text instructions

#143

Post by sfpotter »

sh4rks wrote: post #138
sfpotter wrote: post #129

These look awful! They are very displeasing aesthetically. They look like they were done by someone with absolutely no artistic ability. Clearly there is some technical interest here, but I just felt the need to point out the elephant in the room. They are very ugly .

I love the cognitive dissonance between "you're just stealing people's art and modifying them slightly!" versus "AI art sucks and has no artistic value"

I mean, the two are obviously not mutually exclusive.

Re: Show HN: New AI edits images based on text instructions

#144

Post by sfpotter »

aflag wrote: post #133
sfpotter wrote: post #129

These look awful! They are very displeasing aesthetically. They look like they were done by someone with absolutely no artistic ability. Clearly there is some technical interest here, but I just felt the need to point out the elephant in the room. They are very ugly .

I'm not an artist, but they look fine to me. I am not the kind of person who spends hours in a Gallery admiring the nuances of paintings or photos. However, at the level of detail I usually admire these things, the clown one looked interesting and the Monalisa one was funny. The strawberry seemed a bit weird, but I don't think I'd care for it even if it was perfect anyway. The wintery landscape I thought was pretty g…

"I'm not qualified to have a nuanced opinion about this, but let me confidently tell you what I think..."

Re: Show HN: New AI edits images based on text instructions

#145

Post by sandworm101 »

Fireworks. These AI tools seem very good at replacing textures, less so about inserting objects. They can all "add fireworks" to a picture. They know what fireworks look like and diligently insert them into "sky" part of pictures. But they don't know that fireworks are large objects far away rather than small objects up close (see the Father Ted bit on that one). So they add tiny fireworks into pictures that don't have a far away portion (portraits) or above distant mountain ridges as if they were stars. Also trees. The AI doesn't know how big trees are and so inserts monster trees under the Golden Gate bridge and tiny bonsais into portraits. Adding objects into complex images is totally hit and miss.

Re: Show HN: New AI edits images based on text instructions

#146

Post by xwdv »

social_quotient wrote: post #128
xwdv wrote: post #104

How about “fix the hands”?

The hands issue is going to be an awesome story for all of us in 10-20 years. The younger generation just won’t fathom how hard it was to get proper hands. I wonder what a parallel comparable now would be? Something the slightly technical general public just can’t wrap their head around why it was complicated “back then”. Maybe todays example is a smart voice assistant like Alexa.

Or maybe it will never be fixed, and in the future when they are trying to determine if someone is a human or an artificial replica, they will simply ask them to draw a set of human hands as a test.

Re: Show HN: New AI edits images based on text instructions

#147

Post by bryced »

Tenoke wrote: post #103
bryced wrote: post #84

Here is a colab you can try it in. It crashed for me the first time but worked the second time. https://colab.research.google.com/drive/1rOvQNs0Cmn_yU1bKWjC...

Huh, I'm trying it now and the results seem so weak compared to any other model I've seen since dall-e.

Does dalle do prompt based photo edits now?

But yeah sometimes it doesn't follow directions well. I haven't noticed a pattern yet for why that is.

Re: Show HN: New AI edits images based on text instructions

#148

Post by bryced »

sschueller wrote: post #110

I am not a fan of software such as this putting in an arbitrarily "safety" feature which can only be disabled via undocumented environment variable. At least make it a flag documented for people who don't have an issue with nudity. There isn't even an indication that there is a "safety" issue, you just get a blank image and are wondering if your GPU/model or install is corrupted. This isn't running on a website that…

The console output tells you what happened.

Re: Show HN: New AI edits images based on text instructions

#149

Post by bryced »

pfd1986 wrote: post #98

Super nice. Would this work if I have my own version of fine-tuned SD? Also, curious how / whether this is different from img2img released by SD. Thanks!

This is itself it's own finetuned version of SD so now it won't work with alternative versions. img2img works by just running normal stable diffusion img2img on a noised starting image. As such it destroys information at all parts of the image equally. This new model uses attention mechanisms to decide which parts of the image are important to modify. It can leave parts of the image untouched while making drastic changes to other parts.

Re: Show HN: New AI edits images based on text instructions

#150

Post by nullish_signal »

smcleod wrote: post #101
NavinF wrote: post #49

Earlier quoted context omitted.

You can get a used 2080Ti for under $300 on eBay

That's a lot of money for most people. It also means they have to have a PC to put it in.

Thank you for your sensical response... Very happy with my 6GB VRAM card and don't have $300 lying around to use on a git repo that will probably be slimmed down in a month or two
Post reply on HN