Viewing profile — robbru

Opus 5 loves to stop working "for safety reasons" and shuts down the session! I avoid it at all costs now. Opus 4.8 has been my default as well.

Very interesting, will give it a demo.

1 minute for a second of footage, that is awesome! Thanks for sharing.

I've been using Enclave ever since, they have been the best App Store option for a long time.

Shout out to LM Studio being featured in one of the product shots!

Freaking wow.

Grok makes it especially easy to do so.

Sprinters vans are the GOAT. My wife drives a 2009 Ford Ranger, love that damn truck. When it goes, the Sprinter it is.

Of course I love this. DOOM forever.

Good question! It was not that I didn’t understand prompt influence. It’s that I underestimated its persistence over a long time horizon.

https://imgur.com/a/Y7UrqWu

This happened to me when I built a version of Vending-Bench ( https://arxiv.org/html/2502.15840v1 ) using Claude, Gemini, and OpenAI. After a long runtime, with a vending machine c…

Solid snake approved.

Excited to try this out, thanks for sharing.

I've been using the Google Gemma QAT models in 4B, 12B, and 27B with LM Studio with my M1 Max. https://huggingface.co/lmstudio-community/gemma-3-12B-it-qat...

This is the message that got me with 4o! "It won't take long about 3 minutes. I'll update you when ready"

I think people are sleeping on MLX and directing their attention to the "Apple Intelligence" marketing atm.

Interesting benchmarks, thanks for sharing! If you're optimizing for lower power draw + higher throughput on Mac (especially in MLX), definitely keep an eye on the Desloth LLMs tha…

Very cool insight, Simonw! I will check out the audio mlx stuff soon. I think that is kinda new still. Prince Canuma is the GOAT.

Hey Nico, Very cool to hear your perspective in how you are using the small LLMs! I’ve been experimenting extensively with local LLM stacks on: • M1 Max (MLX native) • LM Studio (G…

TinyLLM is very cool to see! I will def tinker with it. I've been using MLX format for local LLMs as of late. Kinda amazing to see these models become cheaper and faster. Check out…