Show HN: Infinity – Realistic AI characters that can speak • Hacker News Board

zach_miller wrote: post #137

Tried to make this meme [1] a reality and the source image was tough for it. Heads up, little bit of language in the audio. https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2... [1] https://i.redd.it/uisn2wx2ol0d1.jpeg

I see a lot of potential in animating memes and making them more fun to share with friends. Hopefully, we can do better on orcs soon!

Re: Show HN: Infinity – Realistic AI characters that can speak

#147

Post by lcolucci » Fri, Sep 06, 2024, 10:57 PM UTC

bufferoverflow wrote: post #136

It completely falls apart on longer videos for me, unusable over 10 seconds.

This is a good observation. Can you share the videos you’re seeing this with? For me, normal talking tends to work well even on long generations. But singing or expressive audio starts to devolve with more recursions (1 forward pass = 8 sec). We’re working on this.

Re: Show HN: Infinity – Realistic AI characters that can speak

#148

Post by [deleted] » Fri, Sep 06, 2024, 11:01 PM UTC

bufferoverflow wrote: post #136

It completely falls apart on longer videos for me, unusable over 10 seconds.

[deleted]

Re: Show HN: Infinity – Realistic AI characters that can speak

#149

Post by eth0up » Fri, Sep 06, 2024, 11:04 PM UTC

andrew-w wrote: post #143

eth0up wrote: post #141

Lemming overlords https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

I know what will be in my nightmares tonight...

One person's nightmare is another's sweet dream. I, for one.. and all that.

Re: Show HN: Infinity – Realistic AI characters that can speak

#150

Post by andrew-w » Fri, Sep 06, 2024, 11:04 PM UTC

ilaksh wrote: post #110

andrew-w wrote: post #49

Earlier quoted context omitted.

Yeah, it's about 5x slower than realtime with the current configuration. The good news is that diffusion models and transformers are constantly benefitting from new acceleration techniques. This was a big reason we wanted to take a bet on those architectures. Edit: If we generate videos at a lower resolution and with a fewer number of diffusion steps compared to what's used in the public configuration, we are able to…

Wowww.. can you buy more hardware and make a realtime websocket API?

It's something we're thinking about. Our main focus right now is to make the model as good as it can be. There are still many edge cases and failure modes.