Live data from Hacker News

Show HN: Infinity – Realistic AI characters that can speak

news.ycombinator.com

111–120 of 320 posts

Re: Show HN: Infinity – Realistic AI characters that can speak

#111
post #27

The e2e diffusion transformer approach is super cool because it can do crazy emotions which make for great memes (like Joe Biden at Live Aid! https://youtu.be/Duw1COv9NGQ ) Edit: Duke Nukem flubs his line: https://youtu.be/mcLrA6bGOjY

I don't think we've seen laughing quite that expressive before. Good find!

Re: Show HN: Infinity – Realistic AI characters that can speak

#112

Earlier quoted context omitted.

This is exactly what we do today! It seems to work better the more you extend it, but extending it too much introduces other side effects (e.g. the avatar will start to open its mouth, as if it were preparing to talk).

Hmm, maybe adding white noise would work. -- OK, that's quite enough unsolicited suggestions from me up in the peanut gallery. Nice job on the website, it's impressive, thank you for not requiring a sign up.

All for suggestions! We've tried white noise as well, but it only works on plain talking samples (not music, for example). My guess is that the most robust solution will come from updating how it's trained.

Re: Show HN: Infinity – Realistic AI characters that can speak

#113

Amazing work! This technology is only going to improve. Soon there will be an infinite library of rich and dynamic games, films, podcasts, etc. - a totally unique and fascinating experience tailored to you that's only a prompt away. I've been working on something adjacent to this concept with Ragdoll ( https://github.com/bennyschmidt/ragdoll-studio ), but focused not just on creating characters but producing creative…

Very cool! If we release an API, you could use it across the different Ragdoll experiences you're creating. I agree personalized character experiences are going to be a huge thing. FYI we plan to allow users to save their own characters (an image + voice combo) soon

Re: Show HN: Infinity – Realistic AI characters that can speak

#115

Won't be long before it's real time. The first company to launch video calling with good AI avatars is going to take off.

Totally agree. We tweaked some settings after other commenters asked about speed, and got it up to 23fps generation (at the cost of lower resolution). Here is the example: https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/fast...

Re: Show HN: Infinity – Realistic AI characters that can speak

#116

Tried my hardest to push this into the uncanny valley. I did, but it was pretty hard. Seems robust. https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

Not robust enough to work against a sketch https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

though perhaps it rebelled against the message

Re: Show HN: Infinity – Realistic AI characters that can speak

#118
As soon as I saw the "Gnome" face option I gnew exactly what I gneeded to do: https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

EDIT: looks like the model doesn't like Duke Nukem: https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

Cropping out his pistol only made it worse lol: https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

A different image works a little bit better, though: https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

Re: Show HN: Infinity – Realistic AI characters that can speak

#120
Hi Lina, Andrew and Sidney, this is awesome.

My go-to for checking the edges of video and face identification LLMs are Personas right now -- they're rendered faces done in a painterly style, and can be really hard to parse.

Here's some output: https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

Source image from: https://personacollective.ai/persona/1610

Overall, crazy impressive compared to competing offerings. I don't know if the mouth size problems are related to the race of the portrait, the style, the model, or the positioning of the head, but I'm looking forward to further iterations of the model. This is already good enough for a bunch of creative work, which is rad.

Post reply on HN