Live data from Hacker News

Show HN: A real time AI video agent with under 1 second of latency

news.ycombinator.com

171–180 of 264 posts

Re: Show HN: A real time AI video agent with under 1 second of latency

#171

I tried using https://www.tavus.io/ and it worked at first, but after 40 seconds the guy just kept blinking and twitching at me and became unresponsive to further questions lol. Pretty neat though.

Same thing happened haha. It was also weird for the virtual guy to constantly look me in the eye.

Sorry about that friends- we had a hug of death event. Hope you can try again!

Re: Show HN: A real time AI video agent with under 1 second of latency

#172

Have you considered giving your digital twin a jolly aspect? I've wondered if an AI video agent could be made to appear real time, despite a real processing latency, if the AI were to give a hearty laugh before all of its' responses. >So Carter, what did you do this weekend? >Hohoho, you know! I spent some time working on my pet AI projects! I wonder if some standard set of personable mannerisms could be used to brid…

I think I recall that Google did exactly this with their telephone bot (Google assistant?), sneaking in very natural sounding "um"s here and there to mask processing/network latency.

Re: Show HN: A real time AI video agent with under 1 second of latency

#173

Earlier quoted context omitted.

Sooo, are you scouting talent and good ideas with this, or is it the kind of hackathon where people give up rights to any IP they produce? Not to be rude, but these days it's best to ask.

What? No. That’s crazy. (I believe you. I’ve just … never heard of giving up IP rights because you participated in a hackathon.) This is about community and building fun things. I can’t speak for all the sponsors, but what I want is to show people the Open Source tooling we work on at Daily, and see/hear what other people interested in real-time AI are thinking about and working on.

+1, speaking for the sponsors, exactly what Kwindla said

Re: Show HN: A real time AI video agent with under 1 second of latency

#174
post #51

This is cool but if you're trying to cater to devs you need to have a simple on demand API model and no subscription. We need to be able to evaluate the cost on our side.

This is good feedback. We have a base subscription fee to cover ongoing costs of maintaining the models/replicas you create and other elements, otherwise it's all on-demand.

Re: Show HN: A real time AI video agent with under 1 second of latency

#175

Earlier quoted context omitted.

It'll depend on the use case- but with customers that are using it today we're seeing higher engagement and satisfaction rates. It's a different interface to communicate that is more natural to humans (our bullish opinion).

Interesting! Guess I'll have to try this type of interface at some point. Up till now I've just been that silent programmer type who writes text to AI and gets text back so I'm not used to other alternatives.

Totally- as programmers we're so used to communicating via text and meeting computers where they are- it's easy for us. However, we're the minority in the world! I think most people who are not us want to communicate like they do with others.

Re: Show HN: A real time AI video agent with under 1 second of latency

#176

Have you considered giving your digital twin a jolly aspect? I've wondered if an AI video agent could be made to appear real time, despite a real processing latency, if the AI were to give a hearty laugh before all of its' responses. >So Carter, what did you do this weekend? >Hohoho, you know! I spent some time working on my pet AI projects! I wonder if some standard set of personable mannerisms could be used to brid…

This is definitely a good idea! I think the hard part is making it contextual and relevant to the last question/response, in which case the LLM comes into the equation again. Something we're looking at though!

Re: Show HN: A real time AI video agent with under 1 second of latency

#178

Earlier quoted context omitted.

They clearly explain how you retain ownership of your own data and they allow you to monetize the data for your own behalf where they get a sub fraction percent on top of if they sell or use your data internally or externally you get a set value or scalable metric corresponding to usage? Right?

We might need to do a better job of explaining this- but this is true. You retain ownership of your data and we don't sell or use it (other than to train your specific clone that you can delete at any time). Personally, I think too many AI companies are playing fast and loose in this space, so I get the concern. We want to do it right.

I don't know what you mean by ownership, do you mean you don't store everything you need to clone my likeness?

Unless this data is never stored server side or else is client side encrypted then you are putting a target on your back for hackers to extract this data for nefarious purposes no matter what your terms of service says

Re: Show HN: A real time AI video agent with under 1 second of latency

#179
post #150
post #144

I didn't have a great experience. Perhaps load issues, or the HN hug of death? I found that the AI kept cutting me off, and not leaving time in the conversation to respond. It would cut off utternances before the end and then answer the questions it had asked to me as if it had asked them. I think it could have gone on talking indefinitely. Perhaps its audio was feeding back, but macs are pretty good with that. I'll…

they're trying to demo low-latency so they more-or-less have to be aggressive with cutting you off. that said, i think they're using filler to buy themselves a second or 2 - try a yes-or-no question

we dont use any fillers- we do some cool stuff with speculative responses though to drop a few milliseconds!

But yes- accuracy versus speed of interrupts is a tradeoff we're working on tuning. sorry to hear it was cutting you off. It could have been audio feedback or hug of death, but it shouldn't be talking over you.

Re: Show HN: A real time AI video agent with under 1 second of latency

#180
post #155

Is anyone else thinking that it might not be a good idea to give away your voice and face to a startup that is making digital clones of people?

This is a valid concern, but we’ve always been very serious about consent and privacy. Our models cannot be used without explicit verbal/visual consent and you hold the keys to your clone.

No snark intended...if you're making it much easier to make clones of people verbally and visually, why would I feel confident in you accepting a verbal/visual consent from "me"?
Post reply on HN