Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: A real time AI video agent with under 1 second of latency

news.ycombinator.com

Post reply on HN
Print view View original

71–80 of 264 posts

Re: Show HN: A real time AI video agent with under 1 second of latency

#71

Post by nick3443 »

turnsout wrote: post #15

Incredibly impressive on a technical level. The Carter avatar seems to swallow nervously a lot (LOL), and there's some weirdness with the mouth/teeth, but it's quite responsive. I've seen more lag on Zoom talking to people with bad wifi. Honestly this is the future of call centers. On the surface it might seem like the video/avatar is unnecessary, and that what really matters is the speech-to-speech loop. But once th…

Actually what really matters for a call center is having the problem I called in for resolved promptly.

Re: Show HN: A real time AI video agent with under 1 second of latency

#72

Post by [deleted] »

altruios wrote: post #65

So at what point to we consider the morality of 'owning' such an entity/construct (should it prove itself sufficiently sentient...)? to extend this (to a hypothetical future situation): what morality does a company have of 'owning' a digitally uploaded brain? I worry about far future events... but since American law is based on precedence: we should be careful now how we define/categorize things. To be clear - I don'…

[deleted]

Re: Show HN: A real time AI video agent with under 1 second of latency

#74

Post by kwindla »

If you're interested in low-latency, multi-modal AI, Tavus is sponsoring a hackathon Oct 19th-20th in SF. (I'm helping to organize it.) There will also be a remote track for people who aren't in SF, so feel free to sign up wherever you are in the world.

https://x.com/kwindla/status/1839767364981920246

Re: Show HN: A real time AI video agent with under 1 second of latency

#75

Post by pantulis »

windexh8er wrote: post #42
hassaanr wrote: post #33

Earlier quoted context omitted.

Give us a few weeks and this will be possible!

It's mostly there today [0][1]. [0] https://arstechnica.com/information-technology/2024/08/new-a... [1] https://github.com/hacksider/Deep-Live-Cam

I didn't mean the video impersonation, I was referring to the possibility of making a synthetic bot automatically attend a conference call like a regular user without using a desktop camera simulation or stuff like that.

It's not a matter of AI, it's a matter of how Teams or Meet or Zoom allow programmatic access to the video and audio streams (the presence APIs for attending a meeting are mostly there, I think).

Re: Show HN: A real time AI video agent with under 1 second of latency

#76

Post by alwa »

davidvaughan wrote: post #50

That is technically impressive, Hassaan, and thanks for sharing. One recommendation: I wouldn't have the demo avatar saying things like "really cool setup you have there, and a great view out of your window". At that point, it feels intrusive. As for what I'd build... Mentors/instructors for learning. If you could hook up with a service like mathacademy, you'd win edtech. Maybe some creatures instead of human avatars…

There were some balloons coincidentally in the background of a colleague's camera view. The Carter volunteered "and can I just say, we need more positivity in the world, the balloons behind you give a good vibe." My colleague physically recoiled, pushed the camera away, and hung up.

I think it was a combination of the intrusiveness and the notion of a machine 1) projecting (incorrect) assumptions about her attitudes/intentions onto the environment's decor, and 2) passing judgment on her. That kind of comment would be kind of impolite between strangers, like the thing that only a bad boss would feel entitled say to an underling they didn't know very well.

Just an implementation detail, though, of course! I figure if you're able to evoke massive spookiness and subtle shades of social expectations like this, you must be onto something powerful.

Re: Show HN: A real time AI video agent with under 1 second of latency

#77

Post by shtack »

Cool, I built a prototype of something very similar (face+voice cloning, no video analysis) using openly available models/APIs: https://bslsk0.appspot.com/

The video latency is definitely the biggest hurdle. With dedicated a100s I can get it down <2s, but it's pricy.

Re: Show HN: A real time AI video agent with under 1 second of latency

#78

Post by turnsout »

nick3443 wrote: post #71
turnsout wrote: post #15

Incredibly impressive on a technical level. The Carter avatar seems to swallow nervously a lot (LOL), and there's some weirdness with the mouth/teeth, but it's quite responsive. I've seen more lag on Zoom talking to people with bad wifi. Honestly this is the future of call centers. On the surface it might seem like the video/avatar is unnecessary, and that what really matters is the speech-to-speech loop. But once th…

Actually what really matters for a call center is having the problem I called in for resolved promptly.

Right, so do you want to wait 45 minutes for a human, or get it resolved via AI in 2 minutes?

Re: Show HN: A real time AI video agent with under 1 second of latency

#79

Post by primitivesuave »

I really hope this technology becomes the future of political campaigning. The signage industry which prints billions of posters, plastic lawn signs, and banners for the post-election landfill needs to be disrupted.

These days I get a daily dose of amazement at what a small engineering team is able to accomplish.

Re: Show HN: A real time AI video agent with under 1 second of latency

#80

Post by qazxcvbnmlp »

primitivesuave wrote: post #79

I really hope this technology becomes the future of political campaigning. The signage industry which prints billions of posters, plastic lawn signs, and banners for the post-election landfill needs to be disrupted. These days I get a daily dose of amazement at what a small engineering team is able to accomplish.

Oh my! How dystopian.

“He promised me they wouldn’t support X” “He promised me they would support X”

(Dynamically grab and show actions from the candidates past that feed into the individuals viewpoint)

Further the disconnect between what the candidate says they do and what they do, meanwhile it will feel like they got your best interests in mind.

Post reply on HN