Live data from Hacker News

Show HN: Infinity – Realistic AI characters that can speak

news.ycombinator.com

91–100 of 320 posts

Re: Show HN: Infinity – Realistic AI characters that can speak

#92

I tried making this short clip [0] of Baron Vladimir Harkonnen announcing the beginning of the clone war, and it's almost fine, but the last frame somehow completely breaks. [0]: https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

This is a bug in the model we're aware of but haven't been able to fix yet. It happens at the end of some videos but not all. Our hypothesis is that the "breakdown" happens when there's a sudden change in audio levels (from audio to silence at the end). We extend the end of the audio clip and then cut it out the video to try to handle this, but it's not working well enough.

just an idea, but what if the appended audio clip was reversed to ensure continuity in the waveform? That is, if ><PILC.

Re: Show HN: Infinity – Realistic AI characters that can speak

#93

Tried my hardest to push this into the uncanny valley. I did, but it was pretty hard. Seems robust. https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

It even works on animals: https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

Re: Show HN: Infinity – Realistic AI characters that can speak

#94
post #92

Earlier quoted context omitted.

This is a bug in the model we're aware of but haven't been able to fix yet. It happens at the end of some videos but not all. Our hypothesis is that the "breakdown" happens when there's a sudden change in audio levels (from audio to silence at the end). We extend the end of the audio clip and then cut it out the video to try to handle this, but it's not working well enough.

just an idea, but what if the appended audio clip was reversed to ensure continuity in the waveform? That is, if > <PILC.

This is exactly what we do today! It seems to work better the more you extend it, but extending it too much introduces other side effects (e.g. the avatar will start to open its mouth, as if it were preparing to talk).

Re: Show HN: Infinity – Realistic AI characters that can speak

#95

Earlier quoted context omitted.

Thanks for the feedback! The good news is that the new V2 model will allow people to create their own actors very easily, and so we won't be restricted to the list. You can try that model out here: https://studio.infinity.ai/ The rest of our website still uses the V1 model. For the V1 model, we had to explicitly onboard actors (by fine-tuning our model for each new actor). So, the V1 actor list was just made based on…

Ah, I didn't realize I had happened upon a different model. Your actor list in the new model is much more reasonable. I do hope more AI startups recognize that they are projecting an aesthetic whether they want to or not, and try to avoid the middle school boy or edgelord aesthetic, even if that makes up your first users. Anyway, looking at V2 and seeing the female statue makes me think about what it would be like to…

Very creative use cases!

We are trying to better understand the model behavior at the very end of the video. We currently extend the audio a bit to mitigate other end-of-video artifacts (https://news.ycombinator.com/item?id=41468520), but this can sometimes cause uncanny behavior similar to what you are seeing.

Re: Show HN: Infinity – Realistic AI characters that can speak

#97
post #91

Quite impressive - I tried to confuse it with things it would not generally see and it avoided all the obvious confabulations https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

Thank you! It has learned a surprising amount of world knowledge.

Re: Show HN: Infinity – Realistic AI characters that can speak

#99
The website is pretty lightweight and easy-to-use. The service also holds up pretty well, specially if the source image is high-enough resolution. The tendency to "break" at the last frame happens with low resolution images it seems.

My generation: https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

Re: Show HN: Infinity – Realistic AI characters that can speak

#100
post #91

Quite impressive - I tried to confuse it with things it would not generally see and it avoided all the obvious confabulations https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2...

Wow this worked so well! Sometimes with long hair and paintings, it separates part of the hair from the head but not here
Post reply on HN