Folks. This is what innovation looks like. Well done chaps
Show HN: A real time AI video agent with under 1 second of latency
101–110 of 264 posts
Re: Show HN: A real time AI video agent with under 1 second of latency
#102Cool, I built a prototype of something very similar (face+voice cloning, no video analysis) using openly available models/APIs: https://bslsk0.appspot.com/ The video latency is definitely the biggest hurdle. With dedicated a100s I can get it down <2s, but it's pricy.
This looks awesome. Didn’t seem to hear me, but the video looks great. Can you share what models you are using? You say these are all open models.
Re: Show HN: A real time AI video agent with under 1 second of latency
#103This was pretty amazing.
Creepy but amazing.
Re: Show HN: A real time AI video agent with under 1 second of latency
#104Earlier quoted context omitted.
Right, so do you want to wait 45 minutes for a human, or get it resolved via AI in 2 minutes?
This presumes the AI has the same level of problem-solving agency of a real human, which I think is really asking for AGI. Until then I expect AI chatbots will mostly succeed at portraying care and gaslighting customers without actually finding solutions.
[dead]
Re: Show HN: A real time AI video agent with under 1 second of latency
#105Earlier quoted context omitted.
Right, so do you want to wait 45 minutes for a human, or get it resolved via AI in 2 minutes?
This presumes the AI has the same level of problem-solving agency of a real human, which I think is really asking for AGI. Until then I expect AI chatbots will mostly succeed at portraying care and gaslighting customers without actually finding solutions.
Yeah, could be. Most of the time when I contact customer service, there is no problem-solving necessary, and very little agency demonstrated. But I know call centers get a lot of complicated technical or billing questions that would be tough.
Re: Show HN: A real time AI video agent with under 1 second of latency
#1061) Your website, and the dialup sounds, might be my favorite thing about all of this. I also like the cowboy hat. 2) Maybe it's just degrading under load, but I didn't think either chat experience was very good. Both avatars interrupted themselves a lot, and the chat felt more like a jumbled mess of half-thoughts than anything. 3) The image recognition is pretty good though, when I could get one of the avatars to slo…
Glad you liked the website it was such fun project. Getting the hug of death from HN so that might be why you're getting a worse experience, please try again :)
Re: Show HN: A real time AI video agent with under 1 second of latency
#107If you're interested in low-latency, multi-modal AI, Tavus is sponsoring a hackathon Oct 19th-20th in SF. (I'm helping to organize it.) There will also be a remote track for people who aren't in SF, so feel free to sign up wherever you are in the world. https://x.com/kwindla/status/1839767364981920246
Sooo, are you scouting talent and good ideas with this, or is it the kind of hackathon where people give up rights to any IP they produce?
Not to be rude, but these days it's best to ask.
Re: Show HN: A real time AI video agent with under 1 second of latency
#108Earlier quoted context omitted.
That's actually a good question. For example, the technology is still currently at a level where the user can still cleary tell that it's a chatbot, but now with a face. Does this make their experience better? Or does it add a weird level of uncaninness to the experience?
It'll depend on the use case- but with customers that are using it today we're seeing higher engagement and satisfaction rates. It's a different interface to communicate that is more natural to humans (our bullish opinion).
Interesting! Guess I'll have to try this type of interface at some point. Up till now I've just been that silent programmer type who writes text to AI and gets text back so I'm not used to other alternatives.
Re: Show HN: A real time AI video agent with under 1 second of latency
#109Incredibly impressive on a technical level. The Carter avatar seems to swallow nervously a lot (LOL), and there's some weirdness with the mouth/teeth, but it's quite responsive. I've seen more lag on Zoom talking to people with bad wifi. Honestly this is the future of call centers. On the surface it might seem like the video/avatar is unnecessary, and that what really matters is the speech-to-speech loop. But once th…
Actually what really matters for a call center is having the problem I called in for resolved promptly.
I don't understand why call centers exist in the first place.
If you just exposed all the functionality as buttons on the website, or even as AI, I'd be able to fix the problems myself!
And I say that while working for a company making call centre AIs... double ironic!
Re: Show HN: A real time AI video agent with under 1 second of latency
#110Great experience, especially having in mind that hacker news must be crushing your servers right now.