Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: A real time AI video agent with under 1 second of latency

news.ycombinator.com

Post reply on HN
Print view View original

111–120 of 264 posts

Re: Show HN: A real time AI video agent with under 1 second of latency

#111

Post by 6510 »

turnsout wrote: post #105
causal wrote: post #96

Earlier quoted context omitted.

This presumes the AI has the same level of problem-solving agency of a real human, which I think is really asking for AGI. Until then I expect AI chatbots will mostly succeed at portraying care and gaslighting customers without actually finding solutions.

Yeah, could be. Most of the time when I contact customer service, there is no problem-solving necessary, and very little agency demonstrated. But I know call centers get a lot of complicated technical or billing questions that would be tough.

They work with different tiers usually? The first does the easy questions and they can write down the issue. If something happens regularly you can write a calling script for it. The question is if the ai can find the right script fast enough.

Helping the customer is not really the goal. They provide feedback that gives valuable insight into the dysfunctional part of the company so that things can improve. Maybe even generate an investor report from it.

Re: Show HN: A real time AI video agent with under 1 second of latency

#112

Post by aniviacat »

causal wrote: post #96
turnsout wrote: post #78

Earlier quoted context omitted.

Right, so do you want to wait 45 minutes for a human, or get it resolved via AI in 2 minutes?

This presumes the AI has the same level of problem-solving agency of a real human, which I think is really asking for AGI. Until then I expect AI chatbots will mostly succeed at portraying care and gaslighting customers without actually finding solutions.

That really depends on the type of call center we're talking about.

Many (most?) call centers won't do much more than telling you to turn it off and on again, even when you're talking to a real person. (And for many cutomers, that is really all they need.)

Re: Show HN: A real time AI video agent with under 1 second of latency

#113

Post by tstrimple »

whiplash451 wrote: post #64
karolist wrote: post #22

Felt like talking to a person, I couldn't bring myself to treat it like a piece of code, that's how real it felt. I wanted to be polite and diplomatic, caught myself thinking about "how I look to this person". This brought me thinking of the conscious effort we put in when we talk with people and how sloppy and relaxed we can be when interacting with algorithms. For a little example, when searching Google I default t…

I see it the other way around. I think our human-human interaction style will “leak” into the way we interact with humanoid AI agents. Movie-Her style.

Mine certainly has. I type to ChatGPT much more like a human than a search engine. It feels more natural for me as it's context aware than search engines ever were. I can ask follow up questions and ask for more details about a specific portion or ask for the analysis I just walked it through to get the results I want to apply to another data set.

"Now dump those results into a markdown table for me please."

Re: Show HN: A real time AI video agent with under 1 second of latency

#114

Post by earthnail »

Amazing demo. I will admit it didn’t quite feel like a real conversation; in some ways the voice felt a bit like trying too hard to be natural, which backfired - instead it felt like a scripted dialog in a game.

Still, really impressive stuff!!

Re: Show HN: A real time AI video agent with under 1 second of latency

#115

Post by kwindla »

heroprotagonist wrote: post #107
kwindla wrote: post #74

If you're interested in low-latency, multi-modal AI, Tavus is sponsoring a hackathon Oct 19th-20th in SF. (I'm helping to organize it.) There will also be a remote track for people who aren't in SF, so feel free to sign up wherever you are in the world. https://x.com/kwindla/status/1839767364981920246

Sooo, are you scouting talent and good ideas with this, or is it the kind of hackathon where people give up rights to any IP they produce? Not to be rude, but these days it's best to ask.

What? No. That’s crazy. (I believe you. I’ve just … never heard of giving up IP rights because you participated in a hackathon.)

This is about community and building fun things. I can’t speak for all the sponsors, but what I want is to show people the Open Source tooling we work on at Daily, and see/hear what other people interested in real-time AI are thinking about and working on.

Re: Show HN: A real time AI video agent with under 1 second of latency

#116

Post by myprotegeai »

turnsout wrote: post #15

Incredibly impressive on a technical level. The Carter avatar seems to swallow nervously a lot (LOL), and there's some weirdness with the mouth/teeth, but it's quite responsive. I've seen more lag on Zoom talking to people with bad wifi. Honestly this is the future of call centers. On the surface it might seem like the video/avatar is unnecessary, and that what really matters is the speech-to-speech loop. But once th…

>Honestly this is the future of call centers.

This feels like retro futurism, where we take old ideas and apply a futuristic twist. It feels much more likely that call centers will cease to be relevant, before this tech is ever integrated into them.

Re: Show HN: A real time AI video agent with under 1 second of latency

#117

Post by 93po »

pantulis wrote: post #26
iamleppert wrote: post #24

I would pay cold hard cash if I could easily create an AI avatar of myself that could attend teams meetings and do basic interaction, like give a status update when called on.

Last time I checked it was not possible through Teams API call for video conferences, although it is pretty easy to set up a chat bot in Teams with a custom Copilot. I'd say that it looked more feasible through a plugin for Google Meet but there are too many hoops. I'd expect that to be reserved either for the host platforms or for selected partners.

using OBS software you can create a virtual web cam of whatever you want

Re: Show HN: A real time AI video agent with under 1 second of latency

#118

Post by 6510 »

Those are funny conventions I never thought about. Humans try to guess what the other person says. I wonder what the interval is of that.

Besides the obvious (perceived complexity and potential cost/benefit of the topic) I think the pitch of someones voice is a good indicator if they want to continue their turn.

It depends a lot on the person of course. If someone continues their turn 2 seconds after the last sentence they are very likely to do that again.

The hardest part [i imagine] is to give the speaker a sense of someone listening to them.

Re: Show HN: A real time AI video agent with under 1 second of latency

#120

Post by username44 »

username44 wrote: post #9

It was pretty cool, I tried the Tavus demo. Seemed to nod way too much, like the entire time. The actual conversation was pretty clearly with a text model, because it has no concept of what it looks like, or even that it has a video avatar at all. It would say things like “I don’t have eyes” etc.

I came back to try the Hassaan one, it was much more realistic although he still denied wearing a hat. I think if you were able to run a still image of the character’s appearance through a multimodal LLM and have it generate a description for the conversation’s prompt it would work better.
Post reply on HN