Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: LemonSlice – Upgrade your voice agents to real-time video

news.ycombinator.com

Post reply on HN
Print view View original

61–70 of 135 posts

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#61

Post by sid-the-kid »

jedwhite wrote: post #59

That's an interesting insight about "stacking tricks" together. I'm curious where you found that approach hit limits. And what gives you an advantage if anything against others copying it. Getting real-time streaming with a 20B parameter diffusion model and 20fps on a single GPU seems objectively impressive. It's hard to resist just saying "wow" looking at the demo, but I know that's not helpful here. It is clearly a…

Good question! Software gets democratized so fast that I am sure others will implement similar approaches soon. And, to be clear, some of our "speed upgrades" are pieced together from recent DiT papers. I do think getting everything running on a single GPU at this resolution and speed is totally new (as far as i have seen).

I think people will just copy it, and we just need to continue moving as fast as we can. I do think that a bit of a revolution is happening right now in real-time video diffusion models. There are so many great papers being published in that area in the last 6 months. My guess is that many DiT models will be real time within 1 year.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#62

Post by [deleted] »

jedwhite wrote: post #59

That's an interesting insight about "stacking tricks" together. I'm curious where you found that approach hit limits. And what gives you an advantage if anything against others copying it. Getting real-time streaming with a 20B parameter diffusion model and 20fps on a single GPU seems objectively impressive. It's hard to resist just saying "wow" looking at the demo, but I know that's not helpful here. It is clearly a…

[deleted]

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#63

Post by sid-the-kid »

sid-the-kid wrote: post #61
jedwhite wrote: post #59

That's an interesting insight about "stacking tricks" together. I'm curious where you found that approach hit limits. And what gives you an advantage if anything against others copying it. Getting real-time streaming with a 20B parameter diffusion model and 20fps on a single GPU seems objectively impressive. It's hard to resist just saying "wow" looking at the demo, but I know that's not helpful here. It is clearly a…

Good question! Software gets democratized so fast that I am sure others will implement similar approaches soon. And, to be clear, some of our "speed upgrades" are pieced together from recent DiT papers. I do think getting everything running on a single GPU at this resolution and speed is totally new (as far as i have seen). I think people will just copy it, and we just need to continue moving as fast as we can. I do…

One thing that is interesting: LLMs pipelines have been highly optimize for speed (since speed is directly related to cost for companies). That is just not true for real-time DiTs. So, there is still lots of low hanging fruit for how we (and others) can make things faster and better.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#64

Post by bzmrgonz »

zvonimirs wrote: post #2

We're launching a new AI assistant and I wanted to make it alive so I started to play around with LemonSlice and I loved it!! I wanted to make our assistant be like a coworker that can give it an ability to create Loom style videos. Here's what I created - https://drive.google.com/file/d/1nIpEvNkuXA0jeZVjHC8OjuJlT-3... Anyway, big thumbs up for the LemonSlice team, I'm excited to see it progress. I can definitely see…

How did your token spend add up? I'm hesitant with evil customers racking up ai charges just to shit and giggles. Even competitors might sponsor some runaway charges.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#65

Post by storystarling »

sid-the-kid wrote: post #61
jedwhite wrote: post #59

That's an interesting insight about "stacking tricks" together. I'm curious where you found that approach hit limits. And what gives you an advantage if anything against others copying it. Getting real-time streaming with a 20B parameter diffusion model and 20fps on a single GPU seems objectively impressive. It's hard to resist just saying "wow" looking at the demo, but I know that's not helpful here. It is clearly a…

Good question! Software gets democratized so fast that I am sure others will implement similar approaches soon. And, to be clear, some of our "speed upgrades" are pieced together from recent DiT papers. I do think getting everything running on a single GPU at this resolution and speed is totally new (as far as i have seen). I think people will just copy it, and we just need to continue moving as fast as we can. I do…

Curious about the memory bandwidth constraints here. 20B parameters at 20fps seems like it would saturate the bandwidth of a single GPU unless you are running int4. I assume this requires an H100?

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#66

Post by andrew-w »

storystarling wrote: post #65
sid-the-kid wrote: post #61

Earlier quoted context omitted.

Good question! Software gets democratized so fast that I am sure others will implement similar approaches soon. And, to be clear, some of our "speed upgrades" are pieced together from recent DiT papers. I do think getting everything running on a single GPU at this resolution and speed is totally new (as far as i have seen). I think people will just copy it, and we just need to continue moving as fast as we can. I do…

Curious about the memory bandwidth constraints here. 20B parameters at 20fps seems like it would saturate the bandwidth of a single GPU unless you are running int4. I assume this requires an H100?

Yep, the model is running on Hopper architecture. Anything less was not sufficient in our experiments.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#67

Post by lcolucci »

wumms wrote: post #44
sid-the-kid wrote: post #37

Earlier quoted context omitted.

1) yes on Max Headroom. we are on it. 2) it already is real time...?

Whoops! Mistook the "You're about to speak with an AI."-progress bar for processing delay.

I wonder if we should make the UI a more common interface (e.g. "the call is ringing") to avoid this confusion?

It's a normal mp4 video that's looping initially (the "welcome message") and then as soon as you send the bot a message, we connect you to a GPU and the call becomes interactive. Connecting to the GPU takes about 10s.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#68

Post by peddling-brink »

I got really excited when I saw that you were releasing your model.

> Today we're releasing our new model* - Lemon Slice 2, a 20B-parameter diffusion transformer that generates infinite-length video at 20fps on a single GPU - and opening up our API.

But after digging around for a while, searching for a huggingface link, I’m guessing this was just a unfortunate turn of phrase, and you are not in fact, releasing an open weights model that people can run themselves?

Oh well, this looks very cool regardless and congratulations on the release.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#69

Post by thedangler »

lcolucci wrote: post #29
r0fl wrote: post #23

Pricing is confusing Video Agents Unlimited agents Up to 3 concurrent calls Creative Studio 1min long videos Up to 3 concurrent generations Does that mean I can have a total of 1 minute of video calls? Or video calls can only be 1 minute long? Or does it mean I can have unlimited calls, 3 calls at a time all month long? Can I have different avatars or only the same avatar x 3? Can I record the avatar and make videos…

Sorry about the confusion. Video Agents and Creative Studio are two entirely different products. Video Agents = interactive video. Creative Studio = make a video and download it. If you're interested in real-time video calls, then Video Agents is the only pricing and feature set you should look at.

What happens if I want to make the video on the fly and save that to reuse it when the same question or topic comes up. No need to render a video. Just play the existing one.

Re: Show HN: LemonSlice – Upgrade your voice agents to real-time video

#70

Post by sid-the-kid »

peddling-brink wrote: post #68

I got really excited when I saw that you were releasing your model. > Today we're releasing our new model* - Lemon Slice 2, a 20B-parameter diffusion transformer that generates infinite-length video at 20fps on a single GPU - and opening up our API. But after digging around for a while, searching for a huggingface link, I’m guessing this was just a unfortunate turn of phrase, and you are not in fact, releasing an ope…

Thank you! We are considering to release an open-source version of the model. Somebody will do it soon. Might as well be us. We are mostly concerned with the additional overhead of releasing and then supporting it. So, TBD.
Post reply on HN