Live data from Hacker News

Remaking old computer graphics with AI image generation

jalammar.github.io

61–70 of 86 posts

Re: Remaking old computer graphics with AI image generation

#61

Is there a way to have current AI tools maintain consistency when generating multiple images of a specific creature or object? For example, if there are images of 'Dr. Venom' they need to look similar, or if there are images of the same space ship.

You can teach the AI a new item/character. https://www.youtube.com/watch?v=W4Mcuh38wyM

Re: Remaking old computer graphics with AI image generation

#64
post #40

Earlier quoted context omitted.

Yes, right now you have 3 options: - dreambooth, ~15-20 minutes finetuning but generally generates high quality and diverse outputs if trained properly, - textual inversion, you essentially find a new "word" in the embedding space that describes the object/person, this can generate good results, but generally less effective than dreambooth, - LORA finetuning[1], similar to dreambooth, but you're essentially finetunin…

> Is there a way to have current AI tools maintain consistency when generating multiple images of a specific creature or object? ...but, all of these can't maintain consistency. All they can do is generate the same 'concept'. For example, 'pictures of batman' will always generate pictures that are recognizably batman. However, good luck generating comic cells; there is nothing (that I'm aware of) that will let you ge…

consistency isn't really that difficult with more or less static images. I haven't tried to do "same outfit many poses" yet, because i don't really know what poses are called, and there's no guarantee that the humans that trained/tagged the input images knew, either. I've been messing around with "batch img2img" and i sort of like the jank; i am wondering if a more aggressive CLIP would help at all, but i think it boils down to there really isn't enough detailed tagging to make this worth messing with too much.

what i mean is, assuming this technology moves forward, and GPUs continue increasing VRAM as they have, and enough people are interested in doing extremely detailed tagging with small shapes, the sorts of issues you're talking about will go away over time. Or, alternatively, someone or a group could develop a way to scan hundreds of outputs and collate them according to similarity, allowing a human to use batches that are similar enough to do something like short comics or whatever. As it stands, when i do txt2img or img2img i will run off 20-40 images. I'm also wondering how much seed fiddling could be done - when i first got "Anything v3.0" every image was some person sitting at a dining table near a window with food in front of them, dozens in a row. I have no idea how it happened, but there was enough global cohesion between images i thought it was trained on just that for the first hour or so.

Each of the below images is a set of 4 images (i think generally called a grid in SD), so each image is a set of 4 "2 panel comic strips" - they aren't really intended to flow between the grid squares, but you'll notice that the clothing, hairstyles, etc between strips matches, even if they don't match between individual images. My personal favorite - and the one i used for something online, is the top left set in the first .png https://i.imgur.com/BWek3YI.png https://i.imgur.com/LHchsj5.png

P.S. if anyone knows what the source art could possibly be, let me know?

Re: Remaking old computer graphics with AI image generation

#65
Honestly, really disappointing, especially since the author forces you to watch the video to see the final image - which looks nothing like the shoulder-spiked, triple-forehead-eye'd villain of the game. Spoiler, the generated image is just a threatening looking green dude with two different coloured eyes.

It's a decent writeup on the process of trying to generate specific images using text prompts, I guess, with the conclusion that it's really hard, and in some cases basically impossible (hence the lack of the three forehead eyes).

Re: Remaking old computer graphics with AI image generation

#67

Is there a way to have current AI tools maintain consistency when generating multiple images of a specific creature or object? For example, if there are images of 'Dr. Venom' they need to look similar, or if there are images of the same space ship.

I would recommend looking into depth map of the source material then generating off of the resulting depth map. That will keep the structure the same so things don’t pop in and out. Then the suggestions of dreambooth or textual inversion to get the colors etc right.

Re: Remaking old computer graphics with AI image generation

#68
post #65

Honestly, really disappointing, especially since the author forces you to watch the video to see the final image - which looks nothing like the shoulder-spiked, triple-forehead-eye'd villain of the game. Spoiler, the generated image is just a threatening looking green dude with two different coloured eyes. It's a decent writeup on the process of trying to generate specific images using text prompts, I guess, with the…

[deleted]

Re: Remaking old computer graphics with AI image generation

#70
post #65

Honestly, really disappointing, especially since the author forces you to watch the video to see the final image - which looks nothing like the shoulder-spiked, triple-forehead-eye'd villain of the game. Spoiler, the generated image is just a threatening looking green dude with two different coloured eyes. It's a decent writeup on the process of trying to generate specific images using text prompts, I guess, with the…

Yeah, I don’t think this tech is ready for production use at all right now. Great tech demo, not actually useful currently.

In contrast, I’ve been using chatGPT multiple times daily

Post reply on HN