81–90 of 156 posts
Earlier quoted context omitted.
Nothing like playing around with LLMs on an airplane without an internet connection.
If I can afford a seat above economy with room to actually, comfortably work on a laptop, I can afford the couple bucks for wifi for the flight.
[flagged]
That's clearly your own product (it links to Koroworld in the footer and you've posted about that on Hacker News in the past). Are you sharing any of your revenue from that $79 license fee with the https://ollama.com/ project that your app builds on top of?
> "MCP Host": applications (like LM Studio or Claude Desktop) that can connect to MCP servers, and make their resources available to models.
I think everyone else is calling this an "MCP Client", so I'm not sure why they would want to call themselves a host - makes it sound like they are hosting MCP servers (definitely something that people are doing, even though often the server is run on the same machine as the client), when in fact they are just a client? Or am I confused?
Earlier quoted context omitted.
If I can afford a seat above economy with room to actually, comfortably work on a laptop, I can afford the couple bucks for wifi for the flight.
If you are assuming that your Hainan airlines flight has wifi that isn't behind the GFW, even outside of cattle class, I have some news for you...
MCP terminology is already super confusing, but this seems to just introduce "MCP Host" randomly in a way that makes no sense to me at all. > "MCP Host": applications (like LM Studio or Claude Desktop) that can connect to MCP servers, and make their resources available to models. I think everyone else is calling this an "MCP Client", so I'm not sure why they would want to call themselves a host - makes it sound like…
Earlier quoted context omitted.
I already got one of these. I’m spoiled by Claude 4 Opus; local LLMs are slower and lower quality. I haven’t been using it much. All it has on it is LM Studio, Ollama, and Stats.app. > Can't wait for it to arrive and crank up LM Studio. It's literally the first install. I'm going to download it with safari. lol, yup. same.
Yup, I'm spoiled by Claude 3.7 Sonnet right now. I had to stop using opus for plan mode in my Agent because it is just so expensive. I'm using Gemini 2.5 pro for that now. I'm considering ordering one of these today: https://www.newegg.com/p/N82E16816139451?Item=N82E1681613945... It looks like it will hold 5 GPUs with a single slot open for infiniband Then local models might be lower quality, but it won't be slow! :)
What cards are you gonna put in that chassis?
Earlier quoted context omitted.
Yup, I'm spoiled by Claude 3.7 Sonnet right now. I had to stop using opus for plan mode in my Agent because it is just so expensive. I'm using Gemini 2.5 pro for that now. I'm considering ordering one of these today: https://www.newegg.com/p/N82E16816139451?Item=N82E1681613945... It looks like it will hold 5 GPUs with a single slot open for infiniband Then local models might be lower quality, but it won't be slow! :)
I was using Claude 3.7 exclusively for coding, but it sure seems like it got worse suddenly about 2–3 weeks back. It went from writing pretty solid code I had to make only minor changes to, to being completely off its rails, altering files unrelated to my prompt, undoing fixes from the same conversation, reinventing db access and ignoring existing coding 'standards' established in the existing codebase. Became so unt…
Earlier quoted context omitted.
Yup, I'm spoiled by Claude 3.7 Sonnet right now. I had to stop using opus for plan mode in my Agent because it is just so expensive. I'm using Gemini 2.5 pro for that now. I'm considering ordering one of these today: https://www.newegg.com/p/N82E16816139451?Item=N82E1681613945... It looks like it will hold 5 GPUs with a single slot open for infiniband Then local models might be lower quality, but it won't be slow! :)
The GPUs are the hard things to find unless you want to pay like 50% markup
Earlier quoted context omitted.
Why would they pay 2/3 of the price for something with 1/5 of ram? The whole point of spending that much money for them is to run massive models, like the full R1, which the Pro 6000 cant
Because waiting forever for initial prompt processing with realistic number of MCP tools enabled on a prompt is going to suck without the most bandwidth possible And you are never going to sit around waiting for anything larger than the 96+gb of ram that the RTX pro has. If you’re using it for background tasks and not coding it’s a different story
MCP terminology is already super confusing, but this seems to just introduce "MCP Host" randomly in a way that makes no sense to me at all. > "MCP Host": applications (like LM Studio or Claude Desktop) that can connect to MCP servers, and make their resources available to models. I think everyone else is calling this an "MCP Client", so I'm not sure why they would want to call themselves a host - makes it sound like…
MCP Host is terminology from the spec. It's the software that makes llm calls, build prompts, interprets tool call requests and performs them etc.
Some more discussion on the confusion here https://github.com/modelcontextprotocol/modelcontextprotocol... where they acknowledge that most people call it a client and that that's ok unless the distinction is important.
I think host is a bad term for it though as it makes more intuitive sense for the host to host the server and the client to connect to it, especially for remote MCP servers which are probably going to become the default way of using them.