Live data from Hacker News

Remaking old computer graphics with AI image generation

jalammar.github.io

31–40 of 86 posts

Re: Remaking old computer graphics with AI image generation

#31

The title excited me - maybe someone succeeded making new art that looks like the old pre-renders, maybe a convincing imitation of the scanline render look. Instead it was a vapid article about tossing pixel art into img-2-img and getting some tenuously related junk.

He didn't even do that. He used text descriptions; the original pixel art wasn't involved.

Re: Remaking old computer graphics with AI image generation

#32

Is there a way to have current AI tools maintain consistency when generating multiple images of a specific creature or object? For example, if there are images of 'Dr. Venom' they need to look similar, or if there are images of the same space ship.

Yeah, look up textual inversion

Re: Remaking old computer graphics with AI image generation

#33

Is there a way to have current AI tools maintain consistency when generating multiple images of a specific creature or object? For example, if there are images of 'Dr. Venom' they need to look similar, or if there are images of the same space ship.

The concept of “similar” is AI-complete (ie, only you knows what seems acceptably similar to you), so basically, no. You can force a model to generate nearly the same actual pixels with DreamBooth, which can be interesting for putting people’s faces in a picture, but otherwise I’d call it overfitting.

Is AI-complete an actual complexity class? Genuinely curious, I’ve never heard of it.

Re: Remaking old computer graphics with AI image generation

#34
post #5

Earlier quoted context omitted.

Get out of my head! I literally just registered spritesheet.ai yesterday. and I've already had mild success training a model on spritesheet data.

Someone put out a really compelling one a couple months ago: https://www.reddit.com/r/StableDiffusion/comments/yj1kbi/ive...

Nice. Thanks!

Re: Remaking old computer graphics with AI image generation

#35

Earlier quoted context omitted.

The concept of “similar” is AI-complete (ie, only you knows what seems acceptably similar to you), so basically, no. You can force a model to generate nearly the same actual pixels with DreamBooth, which can be interesting for putting people’s faces in a picture, but otherwise I’d call it overfitting.

Is AI-complete an actual complexity class? Genuinely curious, I’ve never heard of it.

I think it's just an informal term for things that seem to require human-level AI.

Re: Remaking old computer graphics with AI image generation

#36

Earlier quoted context omitted.

Is AI-complete an actual complexity class? Genuinely curious, I’ve never heard of it.

I think it's just an informal term for things that seem to require human-level AI.

Ah, don’t care for it in that case. Seems like it’s cashing in on the formality associated with algorithms research.

Re: Remaking old computer graphics with AI image generation

#37
I was trying this recently with the Sierra Christmas Card from 1986![0] The images that I generated were[1], and I was trying to tweak the model parameters with different denoising and CFG scales. When you get the parameters just right you can preserve the composition of the input image very well while still adding a lot of detail. This isn't a completely automatic process though, with Stable Diffusion you have to provide the right prompt otherwise the generation process isn't guided correctly, so approach works better for aesthetics and style transfer than regular image super-resolution such as ESRGAN.

[0] https://archive.org/details/sierra-christmas-card-1986

[1] https://i.imgur.com/WxD05gX.jpeg

Re: Remaking old computer graphics with AI image generation

#38

Is there a way to have current AI tools maintain consistency when generating multiple images of a specific creature or object? For example, if there are images of 'Dr. Venom' they need to look similar, or if there are images of the same space ship.

This is the next frontier for AI art as it will let you build a series, graphic novel, or even video with consistent objects. There’s techniques like textual inversion that let you associate a label with an object, but they rely on having multiple images of that object already, so it won’t work for an image you just generated. To get around that, some people have tried using tools to generate multiple images of a synthetic object, eg Deep Nostalgia that can animate a static portrait photo.

So in theory you select one photo with the AI image generator, create variants of it with separate image tools, then build a fine-tuned model based on some cherry-picked variants.

I think this will get easier as AI image tools focus more on depth and 3D modelling.

The “aiactors” subreddit has some interesting experiments along these lines.

Re: Remaking old computer graphics with AI image generation

#39
post #31

The title excited me - maybe someone succeeded making new art that looks like the old pre-renders, maybe a convincing imitation of the scanline render look. Instead it was a vapid article about tossing pixel art into img-2-img and getting some tenuously related junk.

He didn't even do that. He used text descriptions; the original pixel art wasn't involved.

I guess that explains why the results were only vaguely related to the original pictures.

Re: Remaking old computer graphics with AI image generation

#40

Is there a way to have current AI tools maintain consistency when generating multiple images of a specific creature or object? For example, if there are images of 'Dr. Venom' they need to look similar, or if there are images of the same space ship.

Yes, right now you have 3 options:

- dreambooth, ~15-20 minutes finetuning but generally generates high quality and diverse outputs if trained properly,

- textual inversion, you essentially find a new "word" in the embedding space that describes the object/person, this can generate good results, but generally less effective than dreambooth,

- LORA finetuning[1], similar to dreambooth, but you're essentially finetuning the weight deltas to achieve the look, faster than dreambooth, much smaller output.

1: https://github.com/cloneofsimo/lora

Post reply on HN