Earlier quoted context omitted.
> I'm going to download it with Safari Oof you were NOT joking
Safari to download LM Studio. LM Studio to download models. Models to download Firefox.
The modern ninite
MCP in LM Studio
41–50 of 156 posts
Re: MCP in LM Studio
#42What models are you using on LM Studio for what task and with how much memory? I have a 48GB macbook pro and Gemma3 (one of the abliterated ones) fits my non-code use case perfectly (generating crime stories which the reader tries to guess the killer). For code, I still call Google to use Gemini.
I've been using the Google Gemma QAT models in 4B, 12B, and 27B with LM Studio with my M1 Max. https://huggingface.co/lmstudio-community/gemma-3-12B-it-qat...
Re: MCP in LM Studio
#43Just ordered a $12k mac studio w/ 512GB of integrated RAM. Can't wait for it to arrive and crank up LM Studio. It's literally the first install. I'm going to download it with safari. LM Studio is newish, and it's not a perfect interface yet, but it's fantastic at what it does which is bring local LLMs to the masses w/o them having to know much. There is another project that people should be aware of: https://github.c…
I've been using openwebui and am pretty happy with it. Why do you like lm studio more?
i recently tried openwebui but it was so painful to get it to run with local model.
that "first run experience" of lm studio is pretty fire in comparison. can't really talk about actually working with it though, still waiting for the 8GB download
Re: MCP in LM Studio
#44Earlier quoted context omitted.
I already got one of these. I’m spoiled by Claude 4 Opus; local LLMs are slower and lower quality. I haven’t been using it much. All it has on it is LM Studio, Ollama, and Stats.app. > Can't wait for it to arrive and crank up LM Studio. It's literally the first install. I'm going to download it with safari. lol, yup. same.
Yup, I'm spoiled by Claude 3.7 Sonnet right now. I had to stop using opus for plan mode in my Agent because it is just so expensive. I'm using Gemini 2.5 pro for that now. I'm considering ordering one of these today: https://www.newegg.com/p/N82E16816139451?Item=N82E1681613945... It looks like it will hold 5 GPUs with a single slot open for infiniband Then local models might be lower quality, but it won't be slow! :)
I was using Claude 3.7 exclusively for coding, but it sure seems like it got worse suddenly about 2–3 weeks back. It went from writing pretty solid code I had to make only minor changes to, to being completely off its rails, altering files unrelated to my prompt, undoing fixes from the same conversation, reinventing db access and ignoring existing coding 'standards' established in the existing codebase. Became so untrustworthy I finally gave OpenAi O3 a try and honestly, I was pretty surprised how solid it has been. I've been using o3 since, and I find it generally does exactly what I ask, esp if you have a well established project with plenty of code for it to reference.
Just wondering if Claude 3.7 has seemed differently lately for anyone else? Was my go to for several months, and I'm no fan of OpenAI, but o3 has been rock solid.
Re: MCP in LM Studio
#45I wish LM Studio had a pure daemon mode. It's better than ollama in a lot of ways but I'd rather be able to use BoltAI as the UI, as well as use it from Zed and VSCode and aider. What I like about ollama is that it provides a self-hosted AI provider that can be used by a variety of things. LM Studio has that too, but you have to have the whole big chonky Electron UI running. Its UI is powerful but a lot less nice tha…
There's a "headless" checkbox in settings->developer
Still, you need to install and run the AppImage at least once to enable the "lms" cli which can later be used. Would be nice with a completely GUI-less installation/use method too.
Re: MCP in LM Studio
#46Earlier quoted context omitted.
tl;dr the current hype around it is a solution looking for a problem and at a high level, it's just a rebrand of the Tools paradigm.
It's "Tools as a service", so it's really trying to make tool calling easier to use.
Near as I can tell it's supposed to make calling other people's tools easier. But I don't want to spin up an entire server to invoke a calculator. So far it seems to make building my own local tools harder, unless there's some guidebook I'm missing.
Re: MCP in LM Studio
#47LM Studio has quickly become the best way to run local LLMs on an Apple Silicon Mac: no offense to vllm/ollama and other terminal-based approaches, but LLMs have many levers for tweaking output and sometimes you need a UI to manage it. Now that LM Studio supports MLX models, it's one of the most efficient too. I'm not bullish on MCP, but at the least this approach gives a good way to experiment with it for free.
Ollama doesn’t even have a way to customize the context size per model and persist it. LM studio does :)
This isn't true. You can `ollama run {model}`, `/set parameter num_ctx {ctx}` and then `/save`. Recommended to `/save {model}:{ctx}` to persist on model update
Re: MCP in LM Studio
#48I wish LM Studio had a pure daemon mode. It's better than ollama in a lot of ways but I'd rather be able to use BoltAI as the UI, as well as use it from Zed and VSCode and aider. What I like about ollama is that it provides a self-hosted AI provider that can be used by a variety of things. LM Studio has that too, but you have to have the whole big chonky Electron UI running. Its UI is powerful but a lot less nice tha…
Oh, that horrible Electron UI. Under Windows it pegs a core on my CPU at all times!
If you're just working as a single user via the OpenAI protocol, you might want to consider koboldcpp. It bundles a GUI launcher, then starts in text-only mode. You can also tell it to just run a saved configuration, bypassing the GUI; I've successfully run it as a system service on Windows using nssm.
https://github.com/LostRuins/koboldcpp/releases
Though there are a lot of roleplay-centric gimmicks in its feature set, its context-shifting feature is singular. It caches the intermediate state used by your last query, extending it to build the next one. As a result you save on generation time with large contexts, and also any conversation that has been pushed out of the context window still indirectly influences the current exchange.
Re: MCP in LM Studio
#49[deleted]
Re: MCP in LM Studio
#50Closed source - wont touch.