Lemonade by AMD: a fast and open source local LLM server using GPU and NPU

Wow this is super interesting. This creates a local “Gemini” front end and all. This is more or less a generative AI aggregator where it installs multiple services for different gen modes. I’m excited to try this out on my strix halo. The biggest issue I had is image and audio gen so this seems like a great option.

Re: Lemonade by AMD: a fast and open source local LLM server using GPU and NPU

#5

Post by iugtmkbdfil834 » Thu, Apr 02, 2026, 12:35 PM UTC

nijave wrote: post #2

Anyone compare to ollama? I had good success with latest ollama with ROCm 7.4 on 9070 XT a few days ago

Seconded. Currently on ollama for local inference, but I am curious how it compares.

Re: Lemonade by AMD: a fast and open source local LLM server using GPU and NPU

#6

Post by iugtmkbdfil834 » Thu, Apr 02, 2026, 12:39 PM UTC

9dc wrote: post #3

so... what does it do? i dont get it Lol

Initial read suggests it is a mini-swiss army knife, because it seems to be able to do a lot ( based on website claims anyway ). The app integration seems to suggest they want to be more of a control dashboard.

Re: Lemonade by AMD: a fast and open source local LLM server using GPU and NPU

#7

Post by jmillikin » Thu, Apr 02, 2026, 12:42 PM UTC

Surprising that the Linux setup instructions for the server component don't include Docker/Podman as an option, its Snap/PPA for Ubuntu and RPM for Fedora.

Maybe the assumption is that container-oriented users can build their own if given native packages?

Re: Lemonade by AMD: a fast and open source local LLM server using GPU and NPU

#8

Post by freedomben » Thu, Apr 02, 2026, 12:46 PM UTC

Neat, they have rpm, deb, and a companion AppImage desktop app[1]! Surprised I wasn't aware of this project before. Definitely going to give it a try.

[1]: https://github.com/lemonade-sdk/lemonade/releases/tag/v10.0....

Re: Lemonade by AMD: a fast and open source local LLM server using GPU and NPU

#9

Post by JSR_FDED » Thu, Apr 02, 2026, 12:47 PM UTC

I’ve read the website and the news announcement, and I still don’t understand what it is. An alternative to LM Studio? Does it support MLX or metal on Macs? I’m assuming it will optimize things for AMD, but are you at a disadvantage using other GPUs?

Re: Lemonade by AMD: a fast and open source local LLM server using GPU and NPU

#10

Post by zozbot234 » Thu, Apr 02, 2026, 12:47 PM UTC

Note that the NPU models/kernels this uses are proprietary and not available as open source. It would be nice to develop more open support for this hardware.