Live data from Hacker News

MCP in LM Studio

lmstudio.ai

131–140 of 156 posts

Re: MCP in LM Studio

#131
post #84

Earlier quoted context omitted.

If you are assuming that your Hainan airlines flight has wifi that isn't behind the GFW, even outside of cattle class, I have some news for you...

Getting around the GFW is trivially easy.

ya ya, just buy a VPN, pay the yearly subscription, and then have them disappear the week after you paid. Super trivially frustrating.

Re: MCP in LM Studio

#132
I wonder how LM Studio and AnythingLLM contrasts especially in upcoming months... I like AnythingLLM's workflow editor. I'd like something to grow into for my doc-heavy job. Don't want to be installing and trying both.

Re: MCP in LM Studio

#133
post #111
post #106

Earlier quoted context omitted.

I'm with you on the confusion, it makes no sense at all to call it a host. MCP host should host the MCP server (yes, I know - that is yet a separate term). The MCP standard seems a mess, e.g take this paragraph from here[1] > In the Streamable HTTP transport, the server operates as an independent process that can handle multiple client connections. Yes, obviously, that is what servers do. Also, what is "Streamable HT…

> But it does seem that it isn't written by engineers As far as I can tell, unsurprisingly, the MCP specification was written with the help of LLMs, and seemingly hasn't been carefully reviewed because as you say, a bunch of the terms have straight up wrong definitions.

Using LLMs is entirely fine, but poor review for a protocol definition is ..degenerate. Aren't protocols supposed to be precise?

Re: MCP in LM Studio

#134
post #121

Earlier quoted context omitted.

care to elaborate? i have rtx 4070 12gb vram + 64gb ram, i wonder what models I can run with it. Anything useful?

LM Studio's model search is pretty good at showing what models will fit in your VRAM. For my 16gb of VRAM, those models do not include anything that's good at coding, even when I provide the API documents via PDF upload (another thing that LM Studio makes easy). So, not really, but LM Studio at least makes it easier to find that out.

ok, ty for the reply!

Re: MCP in LM Studio

#135
post #133
post #111

Earlier quoted context omitted.

> But it does seem that it isn't written by engineers As far as I can tell, unsurprisingly, the MCP specification was written with the help of LLMs, and seemingly hasn't been carefully reviewed because as you say, a bunch of the terms have straight up wrong definitions.

Using LLMs is entirely fine, but poor review for a protocol definition is ..degenerate. Aren't protocols supposed to be precise?

It was written by one vendor for their own use. It is miles away from an RFC or "standard"

Re: MCP in LM Studio

#136
post #109
post #71

Earlier quoted context omitted.

I concur. I just upgraded from m1 air with 8gb to m4 with 24gb. Excited to run bigger models.

> m4 with 24gb Wow, that is probably analogous to 48GB on other systems then, if we were to ask an Apple VP?

Not sure what Apple VPs have to do with the tech but yeah, pretty much any core engineer you ask at Apple will tell you this.

Here is a nice article with some info about what memory compression is and how it works: https://arstechnica.com/gadgets/2013/10/os-x-10-9/#page-17

It's been a hard technical problem but is pretty much solved by now since its first debut in 2012-2013.

Re: MCP in LM Studio

#137
post #84

Earlier quoted context omitted.

Getting around the GFW is trivially easy.

ya ya, just buy a VPN, pay the yearly subscription, and then have them disappear the week after you paid. Super trivially frustrating.

VPN providers are first and foremost trust businesses. Why would you choose and pay one that is not well established and trusted? Mine have been there for more than a decade by now.

Alternatively, you could just set up your own (cheaper?) VPN relay on the tiniest VPS you can rent on AWS or IBM Cloud, right?

Re: MCP in LM Studio

#138
post #2

Just ordered a $12k mac studio w/ 512GB of integrated RAM. Can't wait for it to arrive and crank up LM Studio. It's literally the first install. I'm going to download it with safari. LM Studio is newish, and it's not a perfect interface yet, but it's fantastic at what it does which is bring local LLMs to the masses w/o them having to know much. There is another project that people should be aware of: https://github.c…

I genuinely cannot wrap my head around spending this much money on hardware that is dramatically inferior to hardware that costs half the price. MacOS is not even great anymore, they stopped improving their UX like a decade ago.

Re: MCP in LM Studio

#139
post #137

Earlier quoted context omitted.

ya ya, just buy a VPN, pay the yearly subscription, and then have them disappear the week after you paid. Super trivially frustrating.

VPN providers are first and foremost trust businesses. Why would you choose and pay one that is not well established and trusted? Mine have been there for more than a decade by now. Alternatively, you could just set up your own (cheaper?) VPN relay on the tiniest VPS you can rent on AWS or IBM Cloud, right?

The VPN providers that get you to jump the cloud in China are Chinese, and China is not yet a high trust society, just like how they’ll take your payment for one year of gym fees and then disappear the next week (sigh). If AWS or IBM cloud find out you are using them as a VPN to jump the GFW, they will ban you for life, Microsoft, IBM, Amazon, aren’t interested in having their whole cloud added to the GFW block list. Many people have tried this (including Microsfties in China with free Azure credits) and they’ve all been dealt with harshly by the cloud providers.

Re: MCP in LM Studio

#140

Earlier quoted context omitted.

If I can afford a seat above economy with room to actually, comfortably work on a laptop, I can afford the couple bucks for wifi for the flight.

Woah there Mr Money, slow down with these assumptions. A computer is worth the investment. But paying a cent extra to airlines? Unacceptable.

The $3000 that a MBP M3 Max with 64GB of RAM costs might cover a round trip business class ticket for a trans pacific…if it is on sale (a Chinese carrier probably with GFW internet).
Post reply on HN