Show HN: Infinity – Realistic AI characters that can speak • Hacker News Board

Re: Show HN: Infinity – Realistic AI characters that can speak

#291

Post by johnchristopher » Sat, Sep 07, 2024, 6:37 PM UTC

Well, I don't know what to think about this, I don't know where we are going. I should read some scifi from back then about conversational agents maybe ?

https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

Re: Show HN: Infinity – Realistic AI characters that can speak

#292

Post by jodrellblank » Sat, Sep 07, 2024, 6:58 PM UTC

sidneyprimas wrote: post #190

SlackingOff123 wrote: post #174

Oh, this is amazing! I've been having so much fun with it. One small issue I've encountered is that sometimes images remain completely static. Seems to happen when the audio is short - 3 to 5 seconds long.

Can you share an example of this happening? I am curious. We can get static videos if our model doesn't recognize it as a face (e.g. an Apple with a face, or sketches). Here is an example: https://toinfinityai.github.io/v2-launch-page/static/videos/... I would be curious if you are getting this with more normal images.

I got it with a more normal image which was two frames from a TV show[1]; with "crop face" on, your model finds the face and animates it[2] and with crop face off the picture was static... just tried to reproduce to show you and now instead it's animated both faces.

[1] https://i.pinimg.com/236x/ae/65/d5/ae65d51130d5196187624d52d...

[2] https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

[3] https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

But that image was one which both could find a face and gave a static image once.

Re: Show HN: Infinity – Realistic AI characters that can speak

#293

Post by aagha » Sat, Sep 07, 2024, 7:19 PM UTC

This is so impressive. Amazing job.

Re: Show HN: Infinity – Realistic AI characters that can speak

#294

Post by parkaboy » Sat, Sep 07, 2024, 8:44 PM UTC

Max headroom hack x hacker's manifesto! I'm impressed with the head movement dynamism on this one.

https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

Re: Show HN: Infinity – Realistic AI characters that can speak

#295

Post by [deleted] » Sat, Sep 07, 2024, 10:05 PM UTC

[deleted]

Re: Show HN: Infinity – Realistic AI characters that can speak

#296

Post by la64710 » Sat, Sep 07, 2024, 10:16 PM UTC

Nice

Re: Show HN: Infinity – Realistic AI characters that can speak

#297

Post by swyx » Sat, Sep 07, 2024, 11:08 PM UTC

lcolucci wrote: post #194

advael wrote: post #175

There is prior art here, e.g. Emo from alibaba research ( https://humanaigc.github.io/emote-portrait-alive/ ), but this is impressive and also actually has a demo people can try, so that's awesome and great work!

Yep for sure! EMO is a good one. VASA-1 (Microsoft) and Loopy Avatar (ByteDance) are two others from this year. And thanks!

seriously, kudos for having a publicly available demo (w/ no sign in!) you did what very very few ai founders dare do

Re: Show HN: Infinity – Realistic AI characters that can speak

#298

Post by swyx » Sat, Sep 07, 2024, 11:09 PM UTC

andrew-w wrote: post #94

drhodes wrote: post #92

Earlier quoted context omitted.

just an idea, but what if the appended audio clip was reversed to ensure continuity in the waveform? That is, if > <PILC.

This is exactly what we do today! It seems to work better the more you extend it, but extending it too much introduces other side effects (e.g. the avatar will start to open its mouth, as if it were preparing to talk).

hmm weird, i thought you criticise heygen for doing exactly that (mirroring the input)

Re: Show HN: Infinity – Realistic AI characters that can speak

#299

Post by swyx » Sat, Sep 07, 2024, 11:11 PM UTC

snickmy wrote: post #228

Out of curiosity, where are you training all this ? aka where do you find the money to support such training

its $500k, its not much in ai funding land

Re: Show HN: Infinity – Realistic AI characters that can speak

#300

Post by sidneyprimas » Sun, Sep 08, 2024, 12:08 AM UTC

johnchristopher wrote: post #291

Well, I don't know what to think about this, I don't know where we are going. I should read some scifi from back then about conversational agents maybe ? https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2... https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2... https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

Nice! These are really good. I wanted them to continue telling their story.