21–30 of 134 posts
edit: disregard, new version did not respect old version's developer mode setting
woah dude, take it easy. There are no missing features, there are more feature. You might just not be finding them where they were before. Remember this is still 0.x, why would the devs be stuck and not be able to improve the UI just because of past decisions?
What’s the main use-case for this? I get that I can run local models, but all the paid for (remote) models are superior. So is the use-case just for people who don’t want to use big tech’s models? Is this just for privacy conscious people? Or is this just for “adult” chats, ie porn bots? Not being cynical here, just wanting to understand the genuine reasons people are using it.
I was hoping for the /v1/messages endpoint to use with Claude Code without any extra proxies :(
On your inference machine:
you@yourbox:~/Downloads/llama.cpp/bin$ ./llama-server -m --alias --jinja --ctx-size 32768 --host 0.0.0.0 --port 8080 -fa on
Then, on the system you're running Claude Code on:
export ANTHROPIC_BASE_URL=http://:
export ANTHROPIC_AUTH_TOKEN="whatever"
export CLAUDE_CODE_DISABLE_NONESSENTIAL_TRAFFIC=1
claude --model [optionally: --system "your system prompt here"]
Earlier quoted context omitted.
To justify investing a trillion dollars like everything else LLM-related. The local models are pretty good. Like I ran a test on R1 (the smallest version) vs Perplexity Pro and shockingly got better answers running on base spec Mac Mini M4. It's simply not true that there is a huge difference. Mostly it's hardcoded overoptimalization. In general these models aren't really becoming better.
I agree with this comment here. For me the main BIG deal is that cloud models have online search embedded etc, while this one doesn't. However, if you don't need that (e.g., translate, summarize text, writing code) probably is good enough.
https://github.com/lmstudio-ai/lmstudio-bug-tracker/issues/1...
this is not open source
this is not open source
Earlier quoted context omitted.
I agree with this comment here. For me the main BIG deal is that cloud models have online search embedded etc, while this one doesn't. However, if you don't need that (e.g., translate, summarize text, writing code) probably is good enough.
So long as the local model supports tool-use, I haven't had issues with them using web search etc in open-webui. Frontier models will just be smarter in knowing when to use tools.
Personally, I would not run LM Studio anywhere outside of my local network as it still doesn't support adding an SSL cert. I guess you can just layer a proxy server on top of it, but if it's meant to be easy to set up, it seems like a quick win that I don't see any reason not to build support for. https://github.com/lmstudio-ai/lmstudio-bug-tracker/issues/1...