Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MCP in LM Studio

lmstudio.ai

Post reply on HN
Print view View original

31–40 of 156 posts

Re: MCP in LM Studio

#31

Post by imranq »

chisleu wrote: post #2

Just ordered a $12k mac studio w/ 512GB of integrated RAM. Can't wait for it to arrive and crank up LM Studio. It's literally the first install. I'm going to download it with safari. LM Studio is newish, and it's not a perfect interface yet, but it's fantastic at what it does which is bring local LLMs to the masses w/o them having to know much. There is another project that people should be aware of: https://github.c…

I'd love to host my own LLMs but I keep getting held back from the quality and affordability of Cloud LLMs. Why go local unless there's private data involved?

Re: MCP in LM Studio

#32

Post by noman-land »

incognito124 wrote: post #12
chisleu wrote: post #2

Just ordered a $12k mac studio w/ 512GB of integrated RAM. Can't wait for it to arrive and crank up LM Studio. It's literally the first install. I'm going to download it with safari. LM Studio is newish, and it's not a perfect interface yet, but it's fantastic at what it does which is bring local LLMs to the masses w/o them having to know much. There is another project that people should be aware of: https://github.c…

> I'm going to download it with Safari Oof you were NOT joking

Safari to download LM Studio. LM Studio to download models. Models to download Firefox.

Re: MCP in LM Studio

#33

Post by mhast »

minimaxir wrote: post #27
chisleu wrote: post #20

Earlier quoted context omitted.

> I'm not bullish on MCP You gotta help me out. What do you see holding it back?

tl;dr the current hype around it is a solution looking for a problem and at a high level, it's just a rebrand of the Tools paradigm.

It's "Tools as a service", so it's really trying to make tool calling easier to use.

Re: MCP in LM Studio

#34

Post by kristopolous »

chisleu wrote: post #23
sneak wrote: post #15

Earlier quoted context omitted.

I already got one of these. I’m spoiled by Claude 4 Opus; local LLMs are slower and lower quality. I haven’t been using it much. All it has on it is LM Studio, Ollama, and Stats.app. > Can't wait for it to arrive and crank up LM Studio. It's literally the first install. I'm going to download it with safari. lol, yup. same.

Yup, I'm spoiled by Claude 3.7 Sonnet right now. I had to stop using opus for plan mode in my Agent because it is just so expensive. I'm using Gemini 2.5 pro for that now. I'm considering ordering one of these today: https://www.newegg.com/p/N82E16816139451?Item=N82E1681613945... It looks like it will hold 5 GPUs with a single slot open for infiniband Then local models might be lower quality, but it won't be slow! :)

The GPUs are the hard things to find unless you want to pay like 50% markup

Re: MCP in LM Studio

#35

Post by [deleted] »

chisleu wrote: post #2

Just ordered a $12k mac studio w/ 512GB of integrated RAM. Can't wait for it to arrive and crank up LM Studio. It's literally the first install. I'm going to download it with safari. LM Studio is newish, and it's not a perfect interface yet, but it's fantastic at what it does which is bring local LLMs to the masses w/o them having to know much. There is another project that people should be aware of: https://github.c…

[deleted]

Re: MCP in LM Studio

#36

Post by zackify »

chisleu wrote: post #2

Just ordered a $12k mac studio w/ 512GB of integrated RAM. Can't wait for it to arrive and crank up LM Studio. It's literally the first install. I'm going to download it with safari. LM Studio is newish, and it's not a perfect interface yet, but it's fantastic at what it does which is bring local LLMs to the masses w/o them having to know much. There is another project that people should be aware of: https://github.c…

I love LM studio but I’d never waste 12k like that. The memory bandwidth is too low trust me.

Get the RTX Pro 6000 for 8.5k with double the bandwidth. It will be way better

Re: MCP in LM Studio

#37

Post by zackify »

minimaxir wrote: post #3

LM Studio has quickly become the best way to run local LLMs on an Apple Silicon Mac: no offense to vllm/ollama and other terminal-based approaches, but LLMs have many levers for tweaking output and sometimes you need a UI to manage it. Now that LM Studio supports MLX models, it's one of the most efficient too. I'm not bullish on MCP, but at the least this approach gives a good way to experiment with it for free.

Ollama doesn’t even have a way to customize the context size per model and persist it. LM studio does :)

Re: MCP in LM Studio

#38

Post by tt726259 »

chisleu wrote: post #2

Just ordered a $12k mac studio w/ 512GB of integrated RAM. Can't wait for it to arrive and crank up LM Studio. It's literally the first install. I'm going to download it with safari. LM Studio is newish, and it's not a perfect interface yet, but it's fantastic at what it does which is bring local LLMs to the masses w/o them having to know much. There is another project that people should be aware of: https://github.c…

[dead]

Re: MCP in LM Studio

#39

Post by politelemon »

The initial experience with LMStudio and MCP doesn't seem to be great, I think their docs could do with a happy path demo for newcomers.

Upon installing the first model offered is google/gemma-3-12b - which in fairness is pretty decent compared to others.

It's not obvious how to show the right sidebar they're talking about, it's the flask icon which turns into a collapse icon when you click it.

I set the MCP up with playwright, asked it to read the top headline from HN and it got stuck on an infinite loop of navigating to Hacker News, but doing nothing with the output.

I wanted to try it out with a few other models, but figuring out how to download new models isn't obvious either, it turned out to be the search icon. Anyway other models didn't fare much better either, some outright ignored the tools despite having the capacity for 'tool use'.

Post reply on HN