Live data from Hacker News

Show HN: A real time AI video agent with under 1 second of latency

news.ycombinator.com

91–100 of 264 posts

Re: Show HN: A real time AI video agent with under 1 second of latency

#91
post #76

That is technically impressive, Hassaan, and thanks for sharing. One recommendation: I wouldn't have the demo avatar saying things like "really cool setup you have there, and a great view out of your window". At that point, it feels intrusive. As for what I'd build... Mentors/instructors for learning. If you could hook up with a service like mathacademy, you'd win edtech. Maybe some creatures instead of human avatars…

There were some balloons coincidentally in the background of a colleague's camera view. The Carter volunteered "and can I just say, we need more positivity in the world, the balloons behind you give a good vibe." My colleague physically recoiled, pushed the camera away, and hung up. I think it was a combination of the intrusiveness and the notion of a machine 1) projecting (incorrect) assumptions about her attitudes/…

I think it's just not a super smart model. They had to make a slight compromise to keep the latency low. The naturalness of the conversation that they did achieve is a great technical accomplishment with these types of constraints though.

For me, it said "are you comfortable sharing what that mark is on your forehead?" Or something like that. I said basically "I don't know maybe a wrinkle?". Lol. Kind of confirms for me why I should continue to avoid video chats. I did look like crap on general, really tired for one thing. And I am 46, so I have some wrinkles, although didn't know they were that obvious.

But a little bit of prompt guidance to avoid commenting on the visuals unless relevant would help. It's possible they actually deliberately put something in the prompt to ask it to make a comment just to demonstrate that it can see, since this is an important feature that might not be obvious otherwise.

Re: Show HN: A real time AI video agent with under 1 second of latency

#94
post #76

That is technically impressive, Hassaan, and thanks for sharing. One recommendation: I wouldn't have the demo avatar saying things like "really cool setup you have there, and a great view out of your window". At that point, it feels intrusive. As for what I'd build... Mentors/instructors for learning. If you could hook up with a service like mathacademy, you'd win edtech. Maybe some creatures instead of human avatars…

There were some balloons coincidentally in the background of a colleague's camera view. The Carter volunteered "and can I just say, we need more positivity in the world, the balloons behind you give a good vibe." My colleague physically recoiled, pushed the camera away, and hung up. I think it was a combination of the intrusiveness and the notion of a machine 1) projecting (incorrect) assumptions about her attitudes/…

On the other hand it was able to talk about my background and that made it feel far more like a regular video call to me. Trying to forbid this stuff then leads to stilted conversations where they're explaining they're not allowed to talk about your surroundings.

Re: Show HN: A real time AI video agent with under 1 second of latency

#96

Earlier quoted context omitted.

Actually what really matters for a call center is having the problem I called in for resolved promptly.

Right, so do you want to wait 45 minutes for a human, or get it resolved via AI in 2 minutes?

This presumes the AI has the same level of problem-solving agency of a real human, which I think is really asking for AGI. Until then I expect AI chatbots will mostly succeed at portraying care and gaslighting customers without actually finding solutions.

Re: Show HN: A real time AI video agent with under 1 second of latency

#97
I had mixed results and was left ultimately disappointed. On a MacBook Pro m3 microphone, it would often cut me off and not understand what I was saying, or feel really unnatural overall.

This turned out to be quite funny, but I would be very sad to see something like this replace human attendants at things like tech support. These days whenever I'm wading through a support channel I'm just yearning for some human contact that can actually solve my issues.

Re: Show HN: A real time AI video agent with under 1 second of latency

#99

I really hope this technology becomes the future of political campaigning. The signage industry which prints billions of posters, plastic lawn signs, and banners for the post-election landfill needs to be disrupted. These days I get a daily dose of amazement at what a small engineering team is able to accomplish.

Oh my! How dystopian. “He promised me they wouldn’t support X” “He promised me they would support X” (Dynamically grab and show actions from the candidates past that feed into the individuals viewpoint) Further the disconnect between what the candidate says they do and what they do, meanwhile it will feel like they got your best interests in mind.

This is already quite common with deepfakes of a politician's voice. While I agree on the potentially dystopian implications of this, it seems like it would be a huge improvement for a politician to put campaign funds into burning a little GPU time on answering specific questions from constituents (i.e. the LLM is reading their stated policy positions and simply delivering a tailored response), rather than wastefully plastering their name all over town.

Re: Show HN: A real time AI video agent with under 1 second of latency

#100
1) Your website, and the dialup sounds, might be my favorite thing about all of this. I also like the cowboy hat.

2) Maybe it's just degrading under load, but I didn't think either chat experience was very good. Both avatars interrupted themselves a lot, and the chat felt more like a jumbled mess of half-thoughts than anything.

3) The image recognition is pretty good though, when I could get one of the avatars to slow down long enough to identify something I was holding.

Anyway great progress, and thanks for sharing so much detail about the specific hurdles you've faced. I'm sure it'll get much better.

Post reply on HN