Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: LemonSlice – Upgrade your voice agents to real-time video

news.ycombinator.com

Post reply on HN
Print view View original

111–120 of 135 posts

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#111

Post by Terretta »

sid-the-kid wrote: post #90
jonsoft wrote: post #81

I asked the Spanish tutor if he/it was familiar with the terms seseo[0] and ceceo[1] and he said it wasn't, which surprised me. Ideally it would be possible to choose which Spanish dialect to practise as mainland Spain pronunciation is very different to Latin America. In general it didn't convince me it was really hearing how I was pronouncing words, an important part of learning a language. I would say the tutor is…

ooof. You saw the Chinese text. Yup, that's super annoying. We are trying to squash that hallucination. Thanks for the feedback! That's helpful!

the chinese text happened last night in your main chat agent widget, the cartoon woman professing to be in a town in brazil with a lemon tree on her cupboard. she claimed it was a test of subtitling then admitted it wasn't.

btw, she gives helpful instructions like "/imagine" whatever but the instructions only seem to work about 50% of the time. meaning, try the same command or variants a few times, and it works about half of them. she never did shift out of aussie accent though.

she came up with a remarkably fanciful explanation why as a brazilian she sounded aussie and why imagining native accent like she said would work didn't...

i was shocked when /imagine face left turn to the side did actually work, the agent was in side profile and precisely as natural as the original front facing avatar

all in all, by far the best agent experience i've played with!

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#112

Post by andrew-w »

leetrout wrote: post #110

Quick feedback if you're still monitoring the thread: I did /imagine cheeseburger and /imagine a fire extinguisher and both were correctly generated but the agent has no context. when I ask what they are holding in both cases they ramble about not holding anything and referencing lemons and lemon trees. I expected it to retain the context as the chat continues. If I ask it what it imagined it just tells me I can use…

Not something we had thought to do tbh, but would definitely enhance the experience. And, should be reasonable to do. Thanks!

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#113

Post by andrew-w »

Terretta wrote: post #111
sid-the-kid wrote: post #90

Earlier quoted context omitted.

ooof. You saw the Chinese text. Yup, that's super annoying. We are trying to squash that hallucination. Thanks for the feedback! That's helpful!

the chinese text happened last night in your main chat agent widget, the cartoon woman professing to be in a town in brazil with a lemon tree on her cupboard. she claimed it was a test of subtitling then admitted it wasn't. btw, she gives helpful instructions like "/imagine" whatever but the instructions only seem to work about 50% of the time. meaning, try the same command or variants a few times, and it works about…

So glad you enjoyed it! We've been able to significantly reduce those text hallucinations with a few tricks, but it seems they haven't been fully squashed. The /imagine command only works with the image at the moment, but we'll think about ways to tie that into the personality and voice. Thanks for the feedback!

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#114

Post by lcolucci »

leetrout wrote: post #110

Quick feedback if you're still monitoring the thread: I did /imagine cheeseburger and /imagine a fire extinguisher and both were correctly generated but the agent has no context. when I ask what they are holding in both cases they ramble about not holding anything and referencing lemons and lemon trees. I expected it to retain the context as the chat continues. If I ask it what it imagined it just tells me I can use…

Good idea. We need to do that. I'm also excited to push the /imagine stuff further and have B-roll interspersed with the talking (like a documentary) or even follow the character around as they move (like a video game)

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#115

Post by lcolucci »

echelon wrote: post #105
anigbrowl wrote: post #100

Absolutely Do Not Want. EDIT: Tell us what characters you want to see in the comments and we can make them for you to talk to (e.g. Max Headroom) Sure, that kind of thing is great fun. But photorealistic avatars are gonna be abused to hell and back and everyone knows it. I would rather talk to a robot that looks like a robot, ie C-3PO. I would even chat with scary skeleton terminator. I do not want to talk with convi…

The dichotomy of AI haters and AI dreamers is wild. OP, I think this is the coolest thing ever. Keep going. Naysayers have some points, but nearly every major disruptive technology has had downsides that have been abused. (Cars can be used for armed robbery. Steak knives can be used to murder people. Computers can be used for hacking.) The upsides of tech typically far outweigh the downsides. If a tech is all downsid…

Well put - and thanks, we'll keep building. Still chasing this level of magic: https://youtu.be/gL5PgvFvi8A?si=I__VSDqkXBdBTVvB&t=173 Not to mention language tutors, training experiences, and more.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#116

Post by lcolucci »

armcat wrote: post #104

This is so awesome, well done LemonSlice team! Super interesting on the ASR->LLM->TTS pipeline, and I agree, you can make it super fast (I did something myself as a 2-hour hobby project: https://github.com/acatovic/ova ). I've been following full-duplex models as well and so far couldn't get even PersonaPlex to run properly (without choppiness/latency), but have you peeps tried Sesame, e.g. https://app.sesame.com/ ?…

This is good feedback thanks! The "not patient" feeling probably comes from our VAD being set to "eager mode" so that the latency is better. VAD (i.e. deciding when the human has actually stopped talking) is a tough problem in all of voice AI. It basically adds latency to whatever your pipeline's base latency is. Speech2Speech models are better at this.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#118

Post by lcolucci »

sbarre wrote: post #79
sid-the-kid wrote: post #39

Earlier quoted context omitted.

And, just like that, Max Headroom is back: https://lemonslice.com/try/agent_ccb102bdfc1fcb30

That.. is not Max Headroom.

Can you help us make him? What's the right voice? https://lemonslice.com/hn

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#119

Post by Escapado »

This was interesting. Had a 5 minute chat with the outsider from the dishonored series. Just a one sentence prompt and its phrasing was at least 60% there, but less cold and nicer in a sense than the video game counterpart. Still an interesting experiment. But I also know that maybe 12-24 months down the line, once this is available in real time on device there will be an ungodly amount of smut coming from this.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#120

Post by jamesdelaneyie »

andrew-w wrote: post #112
leetrout wrote: post #110

Quick feedback if you're still monitoring the thread: I did /imagine cheeseburger and /imagine a fire extinguisher and both were correctly generated but the agent has no context. when I ask what they are holding in both cases they ramble about not holding anything and referencing lemons and lemon trees. I expected it to retain the context as the chat continues. If I ask it what it imagined it just tells me I can use…

Not something we had thought to do tbh, but would definitely enhance the experience. And, should be reasonable to do. Thanks!

I didn't know /imagine could be followed by a prompt, but similarly I asked the avatar about it's appearance and stated it had none. Should probably give it the context of what it's appearance is like, same thing happened for questions like where are you? What are you holding? Who's that behind you? etc etc
Post reply on HN