Have you considered a high frame rate morph effect between images? That would increase the effective frame rate and probably would look pretty cool.
Even a simple crossfade.
Show HN: Wall-mounted diffusion mirror that turns reflections into paintings
11–20 of 126 posts
Re: Show HN: Wall-mounted diffusion mirror that turns reflections into paintings
#12> Art is ... mostly about surfacing the inner world, and only in part about skill.
I like the phrasing of the first part. But what art is "about" is very subjective.
For me, part of what I look for in art is intentionality - the notion that the artist has crafted each element toward a purpose, consciously or not. The less an artist contributes to the final piece, the less meaning I assign to it.
In this case: I would say that the individual pictures being displayed are not "art" - they have no meaning. But I think the device in whole is a piece of art. That is a creation that surfaces the creator's inner world, because they designed the device, wrote the code, crafted the prompts to achieve pieces that reflected their notion of beauty.
Re: Show HN: Wall-mounted diffusion mirror that turns reflections into paintings
#13> It’s unfortunate that art selects so strongly for skill. Can we decorrelate the two?
I really like this direction. I understand why some object to the genai approaches, but in practice sometimes I get an idea of something cool and don't have the skills to create it myself. I'm not going to invest months/years to create each of those ideas and they're not important enough to spend hundreds of dollars that a skilled artist would request. Now there's a way people can try generating the thing and may end up enjoying it - and that's great. (At least for personal use, it gets a bit complicated for commercial purposes)
Re: Show HN: Wall-mounted diffusion mirror that turns reflections into paintings
#14[deleted]
Re: Show HN: Wall-mounted diffusion mirror that turns reflections into paintings
#15This really does change the interaction with art. As a future expansion it might be neat to recognize images on camera that would make for interesting art (i.e. detection of people/animals or recognition of certain styles of composition) as well as being able to choose amongst different styles.
It seems sort of akin to some modern art that incorporated TV screens and video to make dynamic installations, like Nam June Paik.
Re: Show HN: Wall-mounted diffusion mirror that turns reflections into paintings
#16Is there any way to freeze some of the images?
I thought some of them would be awesome to keep (e.g. pfp or lockscreen photo).
Re: Show HN: Wall-mounted diffusion mirror that turns reflections into paintings
#17Have you considered a high frame rate morph effect between images? That would increase the effective frame rate and probably would look pretty cool.
That’s the technique I used on a piece that does inpainting across an image at a rate of about 1 image every 8 seconds - I ‘melt’ the results in for the duration until the next patch is ready:
https://hardwork.party/aws-epoch-optimizer/
Re: Show HN: Wall-mounted diffusion mirror that turns reflections into paintings
#18It's pretty neat, but I'd never have a webcam steaming everything in view to someone else's server on the internet. It'd be cool if the server ran on my own hardware, and ideally in the frame itself. The privacy policy at runpod.io wouldn't even display in my browsers. (their ToS loaded without an issue).
I wonder if you could do something like this with hardware acceleration (like google coral)
Re: Show HN: Wall-mounted diffusion mirror that turns reflections into paintings
#19> Art is ... mostly about surfacing the inner world, and only in part about skill. I like the phrasing of the first part. But what art is "about" is very subjective. For me, part of what I look for in art is intentionality - the notion that the artist has crafted each element toward a purpose, consciously or not. The less an artist contributes to the final piece, the less meaning I assign to it. In this case: I would…
I love this framing (pun unintended) of "art".
Besides what you articulated as the "intention", I often think of the "story" behind the art -- whether an idea in the creator's head was expressed via the piece (or not) makes me go "yes, this is Art" (or not).
By that token, when I see automated projects like this, I think of the "installation" as art, but the pixels or arrangements generated by the piece itself is less art-like IMO.
Re: Show HN: Wall-mounted diffusion mirror that turns reflections into paintings
#20Some optimization suggestions:
- cache the prompting somehow, unless you are doing dynamic stuff with the prompts, the language embeddings generated should be static (this depends on the architecture of the model that you are using, it's only possible with certain setups where the language processing is a separate part in the pipeline)
- consider fine-tuning an img to img model with your current outputs instead of using a language-coupled model. My intuition is that this is currently significantly over-engineered on the ML side.
- Play around with local hardware acceleration instead of sending everything to the cloud, you also probably don't need particularly high resolution for the images either.