Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Infinity – Realistic AI characters that can speak

news.ycombinator.com

Post reply on HN
Print view View original

71–80 of 320 posts

Re: Show HN: Infinity – Realistic AI characters that can speak

#71

Post by lcolucci »

nickfromseattle wrote: post #50

I need to create a bunch of 5-7 minute talking head videos. What's your timeline for capabilities that would help with this?

Our model can recursively extend video clips, so theoretically we could generate your 5-7min talking head videos today. In practice, however, error accumulates with each recursion and the video quality gets worse and worse over time. This is why we've currently limited generations to 30s.

We're actively working on improving stability and will hopefully increase the generation length soon.

Re: Show HN: Infinity – Realistic AI characters that can speak

#73

Post by mnahkies »

whyslothslow wrote: post #36
stevenpetryk wrote: post #12

Earlier quoted context omitted.

My happy millennial take is that browsers have made strides in performance and flexibility, and people are utilizing that to build more complex and dynamic websites. Simplicity and stillness can be beautiful, and so can animations. Enjoying smooth animations and colorful content isn’t brain rot imo.

It may be unpopular, but my opinion is that web pages must not have non-consensual movement. I’ll begrudgingly accept a default behavior of animations turned on, but I want the ability to stop them. I want to be able to look at something on a page without other parts of the page jumping around or changing form while I’m not giving the page any inputs. For some of us, it’s downright exhausting to ignore all the motion…

For sites that have paid enough attention to accessibility you might be able to configure our browser/OS such that this media query applies https://developer.mozilla.org/en-US/docs/Web/CSS/@media/pref... - it's designed to encourage offering low motion alternatives

Re: Show HN: Infinity – Realistic AI characters that can speak

#74

Post by ianbicking »

sidneyprimas wrote: post #41
ianbicking wrote: post #25

The actor list you have is so... cringe. I don't know what it is about AI startups that they seem to be pulled towards this kind of low brow overly online set of personalities. I get the benefit of using celebrities because it's possible to tell if you actually hit the mark, whereas if you pick some random person you can't know if it's correct or even stable. But jeez... Andrew Tate in the first row? And it doesn't g…

Thanks for the feedback! The good news is that the new V2 model will allow people to create their own actors very easily, and so we won't be restricted to the list. You can try that model out here: https://studio.infinity.ai/ The rest of our website still uses the V1 model. For the V1 model, we had to explicitly onboard actors (by fine-tuning our model for each new actor). So, the V1 actor list was just made based on…

Ah, I didn't realize I had happened upon a different model. Your actor list in the new model is much more reasonable.

I do hope more AI startups recognize that they are projecting an aesthetic whether they want to or not, and try to avoid the middle school boy or edgelord aesthetic, even if that makes up your first users.

Anyway, looking at V2 and seeing the female statue makes me think about what it would be like to take all the dialog from Galatea (https://ifdb.org/viewgame?id=urxrv27t7qtu52lb) and putting it through this. [time passes :)...] trying what I think is the actual statue from the story is not a great fit, it feels too worn by time (https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...). But with another statue I get something much better: https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

One issue I notice in that last clip, and some other clips, is the abrupt ending... it feels like it's supposed to keep going. I don't know if that's an artifact of the input audio or what. But I would really like it if it returned to a kind of resting position, instead of the sense that it will keep going but that the clip was cut off.

On a positive note, I really like the Failure Modes section in your launch page. Knowing where the boundaries are gives a much better sense of what it can actually do.

Re: Show HN: Infinity – Realistic AI characters that can speak

#75

Post by ricardobeat »

aaroninsf wrote: post #23
naveensky wrote: post #16

Is it similar to https://loopyavatar.github.io/ . I was reading about this today and even the videos are exactly the same. I am curious if you are anyway related to this team?

[flagged]

These papers are simply using each other's examples to make performance comparisons possible.

This is EMO from 6 months ago: https://humanaigc.github.io/emote-portrait-alive/

Re: Show HN: Infinity – Realistic AI characters that can speak

#77

Post by andrew-w »

billconan wrote: post #67

can this achieve real-time performance or how far are we from a real-time model?

The model configuration that is publicly available is about 5x slower than real-time (~6fps). At lower resolution and with a less conservative number of diffusion steps, we are able to generate the video at 20-23 fps, which is just about real-time. Here is an example: https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/fast...

We use rectified flow for denoising, which is a (relatively) recent advancement in diffusion models that allow them to run a lot faster. We also use a 3D VAE that compresses the video along both spatial and temporal dimensions. Temporal compression also improves speed.

Re: Show HN: Infinity – Realistic AI characters that can speak

#78

Post by lcolucci »

marginalia_nu wrote: post #76

Tried my hardest to push this into the uncanny valley. I did, but it was pretty hard. Seems robust. https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

Nice! Earlier checkpoints of our model would "gender swap" when you had a female face and male voice (or vice versa). It's more robust to that now, which is good, but we still need to improve the identity preservation

Re: Show HN: Infinity – Realistic AI characters that can speak

#79

Post by lcolucci »

Andrew_nenakhov wrote: post #54

i wonder how long would it take for this technology to advance to a point where nice people from /r/freefolk would be able to remake seasons 7 and 8 of Game of Thrones to have a nice proper ending? 5 years, 10?

I'd say the 5 year ballpark is about right, but it'll involve combining a bunch of different models and tools together. I follow a lot of great AI filmmakers on Twitter. They typically make ~1min long videos using 3-8 different tools... but even those 1min videos were not possible 9 months ago! Things are moving fast

Re: Show HN: Infinity – Realistic AI characters that can speak

#80

Post by ricardobeat »

aramndrt wrote: post #8

Quick tangent: Does anybody know why many new companies have this exact web design style? Is it some new UI framework or other recent tool? The design looks sleek, but they all appear so similar.

Designers today are largely driven by trends (just like engineering?). Being cool = jumping on the latest bandwagon, not being unique or better. The good news is this particular style is pretty much restricted to tech companies, I think it started with https://neon.tech a few years ago or a similar startup.

Incidentally, the same behaviour is seen in academia. These websites for papers are all copying this one from 2020: https://nerfies.github.io/

Post reply on HN