Forget all the vibe coded slop or Ollama. Lemonade is the real deal and very good, been using about a year now.
AMD are doing gods work here
Lemonade by AMD: a fast and open source local LLM server using GPU and NPU
71–80 of 133 posts
Re: Lemonade by AMD: a fast and open source local LLM server using GPU and NPU
#72I’ve read the website and the news announcement, and I still don’t understand what it is. An alternative to LM Studio? Does it support MLX or metal on Macs? I’m assuming it will optimize things for AMD, but are you at a disadvantage using other GPUs?
It's alternative to LM Studio in a way that it's an abstraction over multiple runtimes. AMD part is that it supports FastFlowML runtime which is the only way to utilize NPU on Ryzen AI CPUs on linux.
Re: Lemonade by AMD: a fast and open source local LLM server using GPU and NPU
#73Re: Lemonade by AMD: a fast and open source local LLM server using GPU and NPU
#74Re: Lemonade by AMD: a fast and open source local LLM server using GPU and NPU
#75[deleted]
Re: Lemonade by AMD: a fast and open source local LLM server using GPU and NPU
#76[dead]
Re: Lemonade by AMD: a fast and open source local LLM server using GPU and NPU
#77I have been using lemonade for nearly a year already. On Strix Halo I am using nothing else - although kyuz0's toolboxes are also nice ( https://kyuz0.github.io/amd-strix-halo-toolboxes/ ) Nowadays you get TTS, STT, text & image generation and image editing should also be possible. Besides being able to run via rocm, vulkan or on CPU, GPU and NPU. Quite a lot of options. They have a quite good and pragmatic pace in d…
Have you used it with any agents or claw? If so, which model do you run?
As another data point.
Running Qwen3.5 122B at 35t/s as a daily driver using Vulcan llama.cpp on kernel 7.0.0rc5 on a Framework Desktop board (Strix Halo 128).
Also a pair of AMD AI Pro r9700 cards as my workhorses for zimageturbo, qwen tts/asr and other accessory functions and experiments.
Finally have a Radeon 6900 XT running qwen3.5 32B at 60+t/s for a fast all arounder.
If I buy anything nvidia it will be only for compatibility testing. AMD hardware is 100% the best option now for cost, freedom, and security for home users.
Re: Lemonade by AMD: a fast and open source local LLM server using GPU and NPU
#78[flagged]
I have had way better perf with Vulcan than ROCm on kernel 7.0.0. They made some major improvements. 20%+ speedups for me.
Re: Lemonade by AMD: a fast and open source local LLM server using GPU and NPU
#79Earlier quoted context omitted.
In my experience using llama.cpp (which ollama uses internally) on a Strix Halo, whether ROCm or Vulkan performs better really depends on the model and it's usually within 10%. I have access to an RX 7900 XT I should compare to though.
Perhaps I should just google it, but I'm under the impression that ollama uses llama.cpp internally, not the other way around. Thanks for that data point I should experiment with ROCm
From what I understand, ROCm is a lot buggier and has some performance regressions on a lot of GPUs in the 7.x series. Vulkan performance for LLMs is apparently not far behind ROCm and is far more stable and predictable at this time.
Re: Lemonade by AMD: a fast and open source local LLM server using GPU and NPU
#80Is... is this named because they have a lemon they're trying to make the most of?
I exclusively buy AMD hardware for local inference. For open drivers, power efficiency, and cost AMD beats Nvidia easily for consumers.