Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: LemonSlice – Upgrade your voice agents to real-time video

news.ycombinator.com

Post reply on HN
Print view View original

11–20 of 135 posts

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#12

Post by sid-the-kid »

buddycorp wrote: post #5

I'm curious if I can plug in my own OpenAI realtime voice agents into this.

Good question. When using the API, you can bring any voice agent (or LLM). Our API takes in what the agent will say, and then streams back the video of the agent saying it.

For the fully hosted version, we are currently partnered with ElevenLabs.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#13

Post by lcolucci »

dreamdeadline wrote: post #7

Cool! Do you plan to expose controls over the avatar’s movement, facial expressions, or emotional reactions so users can fine-tune interactions?

Yes we do! Within the web app, there's a "action text prompt" section that allows you to control the overall actions of the character (e.g. "a fox talking with lots of arm motions"). We'll soon expose this in the API so you can control the characters movements dynamically (e.g. "now wave your hand")

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#15

Post by sid-the-kid »

dreamdeadline wrote: post #7

Cool! Do you plan to expose controls over the avatar’s movement, facial expressions, or emotional reactions so users can fine-tune interactions?

Our text control is good, especially for emotions. For example, you can add the text prompt: "a person talking. they are angry", and agent will have an angry expression.

You can also control background motions (like ocean waves, or a waterfall or car driving).

We are actively training a model that has better text control over hand motions.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#16

Post by lcolucci »

jfaat wrote: post #10
buddycorp wrote: post #5

I'm curious if I can plug in my own OpenAI realtime voice agents into this.

I'm using an openAI realtime voice with livekit, and they said they have a livekit integration so it would probably be doable that way. I haven't used video in livekit though and I don't know how the plugins are setup for it

Yes this is exactly right. Using the LiveKit integration you can add LemonSlice as an avatar layer on top of any voice provider
Post reply on HN