Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Remaking old computer graphics with AI image generation

jalammar.github.io

Post reply on HN
Print view View original

51–60 of 86 posts

Re: Remaking old computer graphics with AI image generation

#51

Post by siraben »

Agentlien wrote: post #48
siraben wrote: post #37

I was trying this recently with the Sierra Christmas Card from 1986![0] The images that I generated were[1], and I was trying to tweak the model parameters with different denoising and CFG scales. When you get the parameters just right you can preserve the composition of the input image very well while still adding a lot of detail. This isn't a completely automatic process though, with Stable Diffusion you have to pr…

If you're using stable diffusion 2.0 or later you can use its depth-to-image mode[0] to create variations of an image which respect its composition without having to keep your parameters within a narrow range. [0] https://github.com/Stability-AI/stablediffusion#image-modifi...

I still struggle with SD 2.0 prompting because many of the tricks (greg, artstation) don't work anymore, have people had success with it or do I have to use custom models?

Re: Remaking old computer graphics with AI image generation

#55

Post by wokwokwok »

ftufek wrote: post #50
wokwokwok wrote: post #42

Earlier quoted context omitted.

> Is there a way to have current AI tools maintain consistency when generating multiple images of a specific creature or object? ...but, all of these can't maintain consistency. All they can do is generate the same 'concept'. For example, 'pictures of batman' will always generate pictures that are recognizably batman. However, good luck generating comic cells; there is nothing (that I'm aware of) that will let you ge…

From my experience playing around with dreambooth in the last few weeks generating images of a specific person or pet (not just a generic concept), it surprisingly works really well. But you have to make sure to feed it enough pictures, make sure to label the images properly, use smaller learning rate, use prior preservation loss and make sure to not overfit, etc. For the animation stuff where you need frame to frame…

> generating images of a specific person or pet (not just a generic concept)

There's no difference between those things. It's a specific label that directs the diffusion model. It doesn't matter if your label is 'dog' or 'betty' (ie. my personal dog). Anyway...

> it's highly likely that we'll get them within a few months.

Yep! It's not a technical limitation of the technology for sure; but the OP asked:

> Is there a way to have current AI tools ...

...and right now you can't do it with the current AI tools that are publicly available.

Re: Remaking old computer graphics with AI image generation

#56

Post by nineteen999 »

layer8 wrote: post #39
Jiro wrote: post #31

Earlier quoted context omitted.

He didn't even do that. He used text descriptions; the original pixel art wasn't involved.

I guess that explains why the results were only vaguely related to the original pictures.

I think the new images look jarring next to the original 8-bit Konami style font at the bottom, the look clashes in my mind. I would have pixelated the generated images and dithered them down to a smaller palette to look more retro. Or kept the hi-res images but subtituted the fonts to something more detailed and modern.

But that's just me.

Re: Remaking old computer graphics with AI image generation

#57

Post by speedgoose »

siraben wrote: post #51
Agentlien wrote: post #48

Earlier quoted context omitted.

If you're using stable diffusion 2.0 or later you can use its depth-to-image mode[0] to create variations of an image which respect its composition without having to keep your parameters within a narrow range. [0] https://github.com/Stability-AI/stablediffusion#image-modifi...

I still struggle with SD 2.0 prompting because many of the tricks (greg, artstation) don't work anymore, have people had success with it or do I have to use custom models?

You need other tricks and put a bit more thoughts in the negative prompt. The quality is then higher but you really need a good prompt. It’s a bit frustrating compared to midjourney or dall.e.

You should take a look at embeddings too. They are tiny files, no more than 128kB, that have a huge influence on the final output. You put the files in the embeddings folder and use the filename in your prompt. Ideally the filename is a unique word so it doesn’t interfere with the normal prompt logic.

You can find the best embeddings in the stable diffusion discord.

Re: Remaking old computer graphics with AI image generation

#58

Post by throwaway675309 »

modfreq wrote: post #5
xwdv wrote: post #2

It’s amazing that someday we’ll be able to pass in low fidelity pixel art sprite sheets to an AI and get back high definition hand drawn 2D graphics for use in games.

Get out of my head! I literally just registered spritesheet.ai yesterday. and I've already had mild success training a model on spritesheet data.

I've been sending emails to the creators of mid journey to scrape the entire archive over at spriters resource to create a custom model specifically to generate pixel sprite sheets.

https://www.spriters-resource.com

Fingers crossed.

Re: Remaking old computer graphics with AI image generation

#59

Post by [deleted] »

sublinear wrote: post #30

You'd have to scale the resolution on these waayyy down to not see the usual janky, smudgy, sometimes nightmare-inducing details. I seriously have never understood why what gets published in these blog posts isn't just lower res especially since this is precisely about old video game graphics.

[deleted]

Re: Remaking old computer graphics with AI image generation

#60

Post by [deleted] »

qbasic_forever wrote: post #8
xwdv wrote: post #2

It’s amazing that someday we’ll be able to pass in low fidelity pixel art sprite sheets to an AI and get back high definition hand drawn 2D graphics for use in games.

I don't see how animations would work with the current crop of image generation tools. If you feed in 5 frames of a character swinging a sword pixel art you'll get five wildly different renditions of the character, not one character with a smooth tweening of the sword swing.

[deleted]
Post reply on HN