Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MCP in LM Studio

lmstudio.ai

Post reply on HN
Print view View original

111–120 of 156 posts

Re: MCP in LM Studio

#111

Post by diggan »

kreetx wrote: post #106
sixhobbits wrote: post #90

Earlier quoted context omitted.

So it is, I stand corrected. I googled mcp host and the lmstudio link was the first result. Some more discussion on the confusion here https://github.com/modelcontextprotocol/modelcontextprotocol... where they acknowledge that most people call it a client and that that's ok unless the distinction is important. I think host is a bad term for it though as it makes more intuitive sense for the host to host the server an…

I'm with you on the confusion, it makes no sense at all to call it a host. MCP host should host the MCP server (yes, I know - that is yet a separate term). The MCP standard seems a mess, e.g take this paragraph from here[1] > In the Streamable HTTP transport, the server operates as an independent process that can handle multiple client connections. Yes, obviously, that is what servers do. Also, what is "Streamable HT…

> But it does seem that it isn't written by engineers

As far as I can tell, unsurprisingly, the MCP specification was written with the help of LLMs, and seemingly hasn't been carefully reviewed because as you say, a bunch of the terms have straight up wrong definitions.

Re: MCP in LM Studio

#112

Post by zackify »

Anaphylaxis wrote: post #47
zackify wrote: post #37

Earlier quoted context omitted.

Ollama doesn’t even have a way to customize the context size per model and persist it. LM studio does :)

This isn't true. You can `ollama run {model}`, `/set parameter num_ctx {ctx}` and then `/save`. Recommended to `/save {model}:{ctx}` to persist on model update

As of 2 weeks back if I did this, it would reset back the moment cline made an api call. But lm studio would work correctly. I’ll have to try again. Even confirmed cline was not overriding num context

Re: MCP in LM Studio

#113

Post by diggan »

rhet0rica wrote: post #48
api wrote: post #18

I wish LM Studio had a pure daemon mode. It's better than ollama in a lot of ways but I'd rather be able to use BoltAI as the UI, as well as use it from Zed and VSCode and aider. What I like about ollama is that it provides a self-hosted AI provider that can be used by a variety of things. LM Studio has that too, but you have to have the whole big chonky Electron UI running. Its UI is powerful but a lot less nice tha…

Oh, that horrible Electron UI. Under Windows it pegs a core on my CPU at all times! If you're just working as a single user via the OpenAI protocol, you might want to consider koboldcpp. It bundles a GUI launcher, then starts in text-only mode. You can also tell it to just run a saved configuration, bypassing the GUI; I've successfully run it as a system service on Windows using nssm. https://github.com/LostRuins/kob…

> Oh, that horrible Electron UI. Under Windows it pegs a core on my CPU at all times!

Worse I'd say, considering what people use LM Studio for, is the VRAM it occupies up even when the UI and everything is idle. Somehow, it's using 500MB VRAM while doing nothing, while Firefox with ~60 active tabs is using 480MB. gnome-shell itself also sits around 450MB and is responsible for quite a bit more than LM Studio.

Still, LM Studio is probably the best all-in-one GUI around for local LLM usage, unless you go terminal usage.

Re: MCP in LM Studio

#114

Post by Thews »

politelemon wrote: post #39

The initial experience with LMStudio and MCP doesn't seem to be great, I think their docs could do with a happy path demo for newcomers. Upon installing the first model offered is google/gemma-3-12b - which in fairness is pretty decent compared to others. It's not obvious how to show the right sidebar they're talking about, it's the flask icon which turns into a collapse icon when you click it. I set the MCP up with…

Others mentioned qwen3, but which works fine with HN stories for me, but the comments still trip it up and it'll start thinking the comments are part of the original question after a while.

I also tried the recent deepseek 8b distill, but it was much worse for tool calling than qwen3 8b.

Re: MCP in LM Studio

#115

Post by phren0logy »

storus wrote: post #103
chisleu wrote: post #2

Just ordered a $12k mac studio w/ 512GB of integrated RAM. Can't wait for it to arrive and crank up LM Studio. It's literally the first install. I'm going to download it with safari. LM Studio is newish, and it's not a perfect interface yet, but it's fantastic at what it does which is bring local LLMs to the masses w/o them having to know much. There is another project that people should be aware of: https://github.c…

If the rumors about splitting CPU/GPU in new Macs are true, your MacStudio will be the last one capable of running DeepSeek R1 671B Q4. It looks like Apple had an accidental winner that will go away with the end of unified RAM.

I have not heard this rumor. Source?

Re: MCP in LM Studio

#116

Post by smcleod »

I really like LM Studio but their license / terms of use are very hostile. You're in breach if you use it for anything work related - so just be careful folks!

Re: MCP in LM Studio

#117

Post by smcleod »

zackify wrote: post #36
chisleu wrote: post #2

Just ordered a $12k mac studio w/ 512GB of integrated RAM. Can't wait for it to arrive and crank up LM Studio. It's literally the first install. I'm going to download it with safari. LM Studio is newish, and it's not a perfect interface yet, but it's fantastic at what it does which is bring local LLMs to the masses w/o them having to know much. There is another project that people should be aware of: https://github.c…

I love LM studio but I’d never waste 12k like that. The memory bandwidth is too low trust me. Get the RTX Pro 6000 for 8.5k with double the bandwidth. It will be way better

RTX is nice, but it's memory limited and requires to have a full desktop machine to run it in. I'd take slower inference (as long as it's not less than 15tk/s) for more memory any day!

Re: MCP in LM Studio

#118

Post by redman25 »

t1amat wrote: post #61
patates wrote: post #13

What models are you using on LM Studio for what task and with how much memory? I have a 48GB macbook pro and Gemma3 (one of the abliterated ones) fits my non-code use case perfectly (generating crime stories which the reader tries to guess the killer). For code, I still call Google to use Gemini.

I would recommend Qwen3 30B A3B for you. The MLX 4bit DWQ quants are fantastic.

Qwen is great but for creative writing I think Gemma is a good choice. It has better EQ than Qwen IMO.

Re: MCP in LM Studio

#119

Post by whatevsmate »

chisleu wrote: post #2

Just ordered a $12k mac studio w/ 512GB of integrated RAM. Can't wait for it to arrive and crank up LM Studio. It's literally the first install. I'm going to download it with safari. LM Studio is newish, and it's not a perfect interface yet, but it's fantastic at what it does which is bring local LLMs to the masses w/o them having to know much. There is another project that people should be aware of: https://github.c…

I did this a month ago and don't regret it one bit. I had a long laundry list of ML "stuff" I wanted to play with or questions to answer. There's no world in which I'm paying by the request, or token, or whatever, for hacking on fun projects. Keeping an eye on the meter is the opposite of having fun and I have absolutely nowhere I can put a loud, hot GPU (that probably has "gamer" lighting no less) in my fam's small apartment.

Re: MCP in LM Studio

#120

Post by prophesi »

phren0logy wrote: post #115
storus wrote: post #103

Earlier quoted context omitted.

If the rumors about splitting CPU/GPU in new Macs are true, your MacStudio will be the last one capable of running DeepSeek R1 671B Q4. It looks like Apple had an accidental winner that will go away with the end of unified RAM.

I have not heard this rumor. Source?

I believe they're talking about the rumors by an Apple supply chain analyst, Ming-Chi Kuo.

https://www.techspot.com/news/106159-apple-m5-silicon-rumore...

Post reply on HN