Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: LemonSlice – Upgrade your voice agents to real-time video

news.ycombinator.com

Post reply on HN
Print view View original

71–80 of 135 posts

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#71

Post by andrew-w »

peddling-brink wrote: post #68

I got really excited when I saw that you were releasing your model. > Today we're releasing our new model* - Lemon Slice 2, a 20B-parameter diffusion transformer that generates infinite-length video at 20fps on a single GPU - and opening up our API. But after digging around for a while, searching for a huggingface link, I’m guessing this was just a unfortunate turn of phrase, and you are not in fact, releasing an ope…

Thanks! And sorry! I can see how our wording there could be misconstrued. With a real-time model, the streaming infrastructure matters almost as much as the weights themselves. It will be interesting to see how easily they can be commoditized in the future.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#72

Post by andrew-w »

thedangler wrote: post #69
lcolucci wrote: post #29

Earlier quoted context omitted.

Sorry about the confusion. Video Agents and Creative Studio are two entirely different products. Video Agents = interactive video. Creative Studio = make a video and download it. If you're interested in real-time video calls, then Video Agents is the only pricing and feature set you should look at.

What happens if I want to make the video on the fly and save that to reuse it when the same question or topic comes up. No need to render a video. Just play the existing one.

This isn't natively supported -- we are continuously streaming frames throughout the conversation session that are generated in real-time. If you were building your own conversational AI pipeline (e.g. using our LiveKit integration), I suppose it would be possible to route things like this with your own logic. But it would probably include jump cuts and not look as good.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#75

Post by jedwhite »

sid-the-kid wrote: post #61
jedwhite wrote: post #59

That's an interesting insight about "stacking tricks" together. I'm curious where you found that approach hit limits. And what gives you an advantage if anything against others copying it. Getting real-time streaming with a 20B parameter diffusion model and 20fps on a single GPU seems objectively impressive. It's hard to resist just saying "wow" looking at the demo, but I know that's not helpful here. It is clearly a…

Good question! Software gets democratized so fast that I am sure others will implement similar approaches soon. And, to be clear, some of our "speed upgrades" are pieced together from recent DiT papers. I do think getting everything running on a single GPU at this resolution and speed is totally new (as far as i have seen). I think people will just copy it, and we just need to continue moving as fast as we can. I do…

> I do think getting everything running on a single GPU at this resolution and speed is totally new

Thanks, it seemed to be the case that this was really something new, but HN tends to be circumspect so wanted to check. It's an interesting space and I try to stay current but everything is moving so fast. But I was pretty sure I hadn't seen anyone do that. Its a huge achievement to do it first and make it work for real like this! So well done!

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#76

Post by koakuma-chan »

sid-the-kid wrote: post #42
koakuma-chan wrote: post #35

Earlier quoted context omitted.

Low res and low fps. Not sure if lipsync is poor, or if low fps makes it look poor. Voice sounds low quality, as if recorded on a bad mic, and doesn't feel like it matches the avatar.

thanks for the feedback. that's helpful. Ya, some avatars have worse lip synch than others. It depends a little on how zoomed in you are. I am double checking now to make 100% sure we return the original audio (and not the encoded/decoded audio). We are working on high-res.

Good luck.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#78

Post by snowmaker »

I made a golden retriever you can talk to using Lemon Slice: https://lemonslice.com/hn/agent_5af522f5042ff0a8

Having a real-time video conversation with an AI is a trippy feeling. Talk about a "feel the AGI moment", it really does feel like the computer has come alive.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#79

Post by sbarre »

sid-the-kid wrote: post #39
wumms wrote: post #34

You could add a Max Headroom to the hn link. You might reach real time by interspersing freeze frames, duplicates, or static.

And, just like that, Max Headroom is back: https://lemonslice.com/try/agent_ccb102bdfc1fcb30

That.. is not Max Headroom.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#80

Post by givinguflac »

While the tech is impressive, from an end user interacting with this perspective, I want nothing to do with it, and I can’t support it. Neat as a one off but destructive imho.

It’s bad enough some companies are doing AI-only interviews. I could see this used to train employees, interview people, replace people at call centers… it’s the next step towards an absolute nightmare. Automated phone trees are bad enough.

There will likely be little human interaction in those and many other situations, and hallucinations will definitely disqualify some people from some jobs.

I’m not anti AI, I’m anti destructive innovation in AI leading to personal health and societal issues, just like modern social media has. I’m not saying this tool is that, I’m saying it’s a foundation for that.

People can choose to not work on things that lead to eventual negative outcomes, and that’s a personal choice for everyone. Of course hindsight is 20/20 but some things can certainly be foreseen.

Apologies for the seemingly negative rant, but this positivity echo chamber in this thread is crazy and I wanted to provide an alternative feedback view.

Post reply on HN