I joined while in the bathroom where the camera was facing upwards looking up to the hanging towel on the wall…and it said “looks like you got a cozy bathroom here”
You have to be kidding me.
Show HN: A real time AI video agent with under 1 second of latency
121–130 of 264 posts
Re: Show HN: A real time AI video agent with under 1 second of latency
#122It's really intriguing. What do you guys feel is next for you? Work for OpenAI? Sometimes, in the midst of this crazy bubble, I wonder if it makes more sense to go into academia for a couple years, do most of the same parts of the journey like a big tiresome programming grind, and join some PI getting millions of dollars, than trying to strike it out on your own for peanuts.
Re: Show HN: A real time AI video agent with under 1 second of latency
#123If you're interested in low-latency, multi-modal AI, Tavus is sponsoring a hackathon Oct 19th-20th in SF. (I'm helping to organize it.) There will also be a remote track for people who aren't in SF, so feel free to sign up wherever you are in the world. https://x.com/kwindla/status/1839767364981920246
Sooo, are you scouting talent and good ideas with this, or is it the kind of hackathon where people give up rights to any IP they produce? Not to be rude, but these days it's best to ask.
As someone who's attended events run by Daily/Kwindla, I can guarantee that you’ll have fun and leave with your IP rights intact. :) (In fact, I don't even know that they're looking for talent and good ideas... the motivation for organizing these is usually to get people excited about what you're building and create a community you can share things with.)
Re: Show HN: A real time AI video agent with under 1 second of latency
#124So at what point to we consider the morality of 'owning' such an entity/construct (should it prove itself sufficiently sentient...)? to extend this (to a hypothetical future situation): what morality does a company have of 'owning' a digitally uploaded brain? I worry about far future events... but since American law is based on precedence: we should be careful now how we define/categorize things. To be clear - I don'…
You're over-anthropomorphizing. The ability of a thing to appear human says nothing of sentience.
like I said, I don't think this is relevant now.
We don't know what sentience IS exactly, as we have a hard time defining it. We assume other people are sentient because of the ways they act. We make a judgment based on behavior, not some internal state we can measure.
And if it walks like a duck, quacks like a duck... since we don't exactly know what the duck is in this case: maybe we should be asking these questions of 'duckhood' sooner rather than later.
So if it looks like a human, talks like a human... maybe we consider that question... and the moral consequences of owning such a thing-like-a-human sooner rather than later.
Re: Show HN: A real time AI video agent with under 1 second of latency
#125As someone not super familiar with deployment but enough to know that GPUs are difficult to work with due to being costly and sometimes hard to allocate: apart from optimizing the models themselves, what's the trick for handling cloud GPU resources at scale to serve something like this, supporting many realtime connections with low latency? Do you just allocate a GPU per websocket connection? Which would mean keeping…
(Not the author but I work in real-time voice.) WebSockets don't really translate to actual GPU load, since they spend a ton of time idling. So strictly speaking, you don't need a GPU per WebSocket assuming your GPU infra is sufficiently decoupled from your user-facing API code.
That said, a GPU per generation (for some operational definition of "generation") isn't uncommon, but there's a standard bag of tricks, like GPU partitioning and batching, that you can use to maximize throughput.
Re: Show HN: A real time AI video agent with under 1 second of latency
#126I tried using https://www.tavus.io/ and it worked at first, but after 40 seconds the guy just kept blinking and twitching at me and became unresponsive to further questions lol. Pretty neat though.
Same thing happened haha. It was also weird for the virtual guy to constantly look me in the eye.
Re: Show HN: A real time AI video agent with under 1 second of latency
#127have you checked https://www.simli.com ? its latency is <300ms
Hey, thanks for shouting us out!
Just to clarify, the audio-to-video part (which is the part we make) adds TLDR: Adding Simli to your voice interaction shouldn't add more than ~300ms latency.
Re: Show HN: A real time AI video agent with under 1 second of latency
#128If you're interested in low-latency, multi-modal AI, Tavus is sponsoring a hackathon Oct 19th-20th in SF. (I'm helping to organize it.) There will also be a remote track for people who aren't in SF, so feel free to sign up wherever you are in the world. https://x.com/kwindla/status/1839767364981920246
Can you say more about how developers will use this? Is the api going to be exposed to participants?
Re: Show HN: A real time AI video agent with under 1 second of latency
#129> The next worst offender was actually detecting when someone stopped speaking.
ChatGPT is terrible at this in my experience. Always cuts me off.
Re: Show HN: A real time AI video agent with under 1 second of latency
#130This is brilliant! Great work!