Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: A real time AI video agent with under 1 second of latency

news.ycombinator.com

Post reply on HN
Print view View original

161–170 of 264 posts

Re: Show HN: A real time AI video agent with under 1 second of latency

#161

Post by heroprotagonist »

gavmor wrote: post #149
heroprotagonist wrote: post #107

Earlier quoted context omitted.

Sooo, are you scouting talent and good ideas with this, or is it the kind of hackathon where people give up rights to any IP they produce? Not to be rude, but these days it's best to ask.

> the kind of hackathon where people give up rights to any IP they produce Wow, I have been attending public hackathons for over a decade, and I have never heard of something like this. That would be an outrage!

This happens in corporate hackathons. Especially internal ones dreamed up by mid-to-upper management types who wished they worked at a startup.

I had one employer years ago who did a 24 hour thing with a crappy prize. They invited employees to come and do their own idea or join a team, then grind with minimal sleep for a day straight. Starting on a Friday afternoon, of course, so a few hours were on the company dime while everyone else went home early.

If putting in that extra time and effort resulted in anything good, the company might even try to develop it! The employee who came up with it might even get put on that team!

....people actually attended.

Re: Show HN: A real time AI video agent with under 1 second of latency

#162

Post by hassaanr »

d2049 wrote: post #155

Is anyone else thinking that it might not be a good idea to give away your voice and face to a startup that is making digital clones of people?

This is a valid concern, but we’ve always been very serious about consent and privacy. Our models cannot be used without explicit verbal/visual consent and you hold the keys to your clone.

Re: Show HN: A real time AI video agent with under 1 second of latency

#163

Post by hassaanr »

username44 wrote: post #120
username44 wrote: post #9

It was pretty cool, I tried the Tavus demo. Seemed to nod way too much, like the entire time. The actual conversation was pretty clearly with a text model, because it has no concept of what it looks like, or even that it has a video avatar at all. It would say things like “I don’t have eyes” etc.

I came back to try the Hassaan one, it was much more realistic although he still denied wearing a hat. I think if you were able to run a still image of the character’s appearance through a multimodal LLM and have it generate a description for the conversation’s prompt it would work better.

This is a good suggestion, I’ll work on this!

Re: Show HN: A real time AI video agent with under 1 second of latency

#164

Post by hassaanr »

pryelluw wrote: post #154

Impressive demo. I’m working on the “brain” side of what I hope will back such real time agents. Any plans to provide hooks into these avatars so that i could potentially run my own logic?

You can already do this via the API! We let you peel back the layers and use your own LLM/logic, as well as other pieces of the pipeline (which we need to update the docs for)

Re: Show HN: A real time AI video agent with under 1 second of latency

#165

Post by portmanteur »

Have you considered giving your digital twin a jolly aspect? I've wondered if an AI video agent could be made to appear real time, despite a real processing latency, if the AI were to give a hearty laugh before all of its' responses. >So Carter, what did you do this weekend? >Hohoho, you know! I spent some time working on my pet AI projects!

I wonder if some standard set of personable mannerisms could be used to bridge the gap from 250ms to 1000ms. You don't need to think about what the user has said before you realize they've stopped talking. Make the AI Agent laugh or hum or just say "yes!" before beginning its' response.

Re: Show HN: A real time AI video agent with under 1 second of latency

#166

Post by hassaanr »

bozhark wrote: post #156
d2049 wrote: post #155

Is anyone else thinking that it might not be a good idea to give away your voice and face to a startup that is making digital clones of people?

They clearly explain how you retain ownership of your own data and they allow you to monetize the data for your own behalf where they get a sub fraction percent on top of if they sell or use your data internally or externally you get a set value or scalable metric corresponding to usage? Right?

We might need to do a better job of explaining this- but this is true. You retain ownership of your data and we don't sell or use it (other than to train your specific clone that you can delete at any time). Personally, I think too many AI companies are playing fast and loose in this space, so I get the concern. We want to do it right.

Re: Show HN: A real time AI video agent with under 1 second of latency

#167

Post by hassaanr »

dools wrote: post #158

Pretty cool, except Digital Hasaan has lots of trouble with my correcting the pronounciation of my name and looks and sounds like he is trying to seduce me.

Apologies about the seduction- I promise I'm not like that in real life.. Re: pronunciation, this is something we're working on improving!

Re: Show HN: A real time AI video agent with under 1 second of latency

#168

Post by hassaanr »

HorizonXP wrote: post #151

This was really good. The Hassan version was “better.” It picked up the background behind me and commented about how cool my models looked on the wall, and mentioned how great they looked to spruce up my workshop. We had a conversation about how they were actually LEGO, and we went on to talk about how cool some of the sets were.

Glad you had a good conversation :) The Hassaan version has a lot more background filled in- actually my entire website is it's context, so he has more interesting things to say!

Re: Show HN: A real time AI video agent with under 1 second of latency

#170

Post by hassaanr »

doctorpangloss wrote: post #122

It's really intriguing. What do you guys feel is next for you? Work for OpenAI? Sometimes, in the midst of this crazy bubble, I wonder if it makes more sense to go into academia for a couple years, do most of the same parts of the journey like a big tiresome programming grind, and join some PI getting millions of dollars, than trying to strike it out on your own for peanuts.

Haha great question- we're really passionate about the conversational video interface, and our goal is to make it /incredibly/ good, so we're going to continue to do research and release new models that accomplish this. There's so much to do in the pursuit of that.
Post reply on HN