Are you looking into speech to speech (no text) models?
Yeah we are! The issue we're seeing is with controllability and hallucinations in speech to speech models that we're trying to work through still
Show HN: A real time AI video agent with under 1 second of latency
11–20 of 264 posts
Re: Show HN: A real time AI video agent with under 1 second of latency
#12[dead]
Re: Show HN: A real time AI video agent with under 1 second of latency
#13This is really cool in terms of the tech, but what is this useful for as a consumer? I mean it's basically just a chatbot right? And nobody likes interacting with those. Forcing a conversational interaction seems like a step down in UX.
Re: Show HN: A real time AI video agent with under 1 second of latency
#14I like how it weaves in background elements into the conversation; it mentioned my cat walking around.
I'm having latency issues, right now it doesn't seem to respond to my utterances and then responds to 3-4 of them in a row.
It was also a bit weird that it didn't know it was at a "ranch". It didn't have any contextual awareness of how it was presenting.
Overall it felt very natural talking to a video agent.
Re: Show HN: A real time AI video agent with under 1 second of latency
#15Incredibly impressive on a technical level. The Carter avatar seems to swallow nervously a lot (LOL), and there's some weirdness with the mouth/teeth, but it's quite responsive. I've seen more lag on Zoom talking to people with bad wifi.
Honestly this is the future of call centers. On the surface it might seem like the video/avatar is unnecessary, and that what really matters is the speech-to-speech loop. But once the avatar is expressive enough, I bet the CSAT would be higher for video calls than voice-only.
Re: Show HN: A real time AI video agent with under 1 second of latency
#16The meeting has ended
Contact the meeting host if the meeting ended unexpectedly.
Re: Show HN: A real time AI video agent with under 1 second of latency
#17Amazing work technically, less than 1 second is very impressive. It quite scary though that I might FaceTime someone one day soon, and they’d won’t be real.
What do you think about the societal implications for this? Today we have a bit of a loneliness crisis due to a lack of human connection.
Re: Show HN: A real time AI video agent with under 1 second of latency
#18This is really cool in terms of the tech, but what is this useful for as a consumer? I mean it's basically just a chatbot right? And nobody likes interacting with those. Forcing a conversational interaction seems like a step down in UX.
That's actually a good question. For example, the technology is still currently at a level where the user can still cleary tell that it's a chatbot, but now with a face. Does this make their experience better? Or does it add a weird level of uncaninness to the experience?
Re: Show HN: A real time AI video agent with under 1 second of latency
#19Very cool! I think part of why this felt believable enough for me is the compressed / low-quality video presented in an interface we're all familiar with -- it helps gloss over visual artifacts that would otherwise set off alarm bells at higher resolution. Kinda reminds me of how Unreal Engine 5 / Unity 6 demos look really good at 1440p / 4k @ 40-60 fps on a decent monitor, but absolutely blast my brain into pieces at 480p @ very high fps on a CRT. Things just gloss over in the best ways at lower resolutions + analog and trick my mind into thinking they may as well be real.
Re: Show HN: A real time AI video agent with under 1 second of latency
#20Tried it, very impressive: digital Hassaan noticed record player at the background and asked some stuff about it, nice :) Had some latency issues though.