Is the GUI still unable to connect to an instance of lm-studio running elsewhere?
LM Studio 0.4
71–80 of 134 posts
Re: LM Studio 0.4
#72I’m really excited for lmster and to try it out. It’s essentially what I want from ollama. Ollama has deviated so much from their original core principles. Ollama has been broken and slow to update model support. There’s this “vendor sync” I’ve been waiting (essentially update ggml) for weeks.
What was the original core principle of ollama? I had used oobabooga back in the day and found ollama unnecessary.
>What was the original core principle of ollama?
Nothing, it was always going to be a rug pull. They leached off llama.cpp.
Re: LM Studio 0.4
#73What’s the main use-case for this? I get that I can run local models, but all the paid for (remote) models are superior. So is the use-case just for people who don’t want to use big tech’s models? Is this just for privacy conscious people? Or is this just for “adult” chats, ie porn bots? Not being cynical here, just wanting to understand the genuine reasons people are using it.
There are some surprisingly useful "small" use cases for general-purpose LLMs that don't necessarily require broad knowledge – image transcription plus some light post-processing is one I use a lot.
Re: LM Studio 0.4
#74What’s the main use-case for this? I get that I can run local models, but all the paid for (remote) models are superior. So is the use-case just for people who don’t want to use big tech’s models? Is this just for privacy conscious people? Or is this just for “adult” chats, ie porn bots? Not being cynical here, just wanting to understand the genuine reasons people are using it.
For some projects, you do not want your code or documents leaving the LAN. Many companies have explicit constraints on using external SaaS. It does not mean they restrict to everything 'on prem'. 'Self hosted' can include running an open weights model on multiple rented B200's.
So yes, the tradeoff is security vs capability. The former always comes at a cost.
Re: LM Studio 0.4
#75Earlier quoted context omitted.
Yes, frontier models from the labs are a step ahead and likely will always be, but we've already crossed levels of "good enough for X" with local models. This is analogous to the fact that my iPhone 17 is technically superior to my iPhone 8, but my outcomes for text messaging are no better. I've invested heavily in local inference. For me, it's a mixture privacy, control, stability, cognitive security. Privacy - my a…
I just "invested heavily" (relatively modest, but heavy for me) in a PC for local inference. The RAM was painful . Anyway, for my focused programming tasks the 30B models are plenty good enough.
I am extremely fortunate having bought 64GB of CL30 DDR5 Ram for ~200 USD just 4 months ago!
My computer is now worth more than when I bought it
Re: LM Studio 0.4
#76man they really butchered the user interface, the "dark" mode now isn't even dark, it's just grey, and it's looking more like a whitespacemaxxed children's toy than a tool for professionals
Yeah the theming options are lacking and I could never hack one up to work.
Re: LM Studio 0.4
#77How does LM Studio differ from Ollama?
Why would I use one rather than the other?
The impression I get is that LM Studio is basically an Ollama-type of solution but with an IDE included -- is that a fair approximation?
Things change so fast in the AI space that I really cannot keep up :(
Re: LM Studio 0.4
#78How does LM Studio differ from Ollama? Why would I use one rather than the other? The impression I get is that LM Studio is basically an Ollama-type of solution but with an IDE included -- is that a fair approximation? Things change so fast in the AI space that I really cannot keep up :(
It offers a GUI for easier configuration and management of models, and it allows you to store/load models as .gguf something ollama doesn't do (it stores the models across multiple files - and yes, I know you can load a .gguf in ollama but it still makes a copy in its weird format so now I need to either have a duplicate on my drive or delete my original .gguf)
Re: LM Studio 0.4
#79How does LM Studio differ from Ollama? Why would I use one rather than the other? The impression I get is that LM Studio is basically an Ollama-type of solution but with an IDE included -- is that a fair approximation? Things change so fast in the AI space that I really cannot keep up :(
It offers a GUI for easier configuration and management of models, and it allows you to store/load models as .gguf something ollama doesn't do (it stores the models across multiple files - and yes, I know you can load a .gguf in ollama but it still makes a copy in its weird format so now I need to either have a duplicate on my drive or delete my original .gguf)
Thanks for the insights. I'm not familiar with .gguf. What's the advantage of that format?
Re: LM Studio 0.4
#80How does LM Studio differ from Ollama? Why would I use one rather than the other? The impression I get is that LM Studio is basically an Ollama-type of solution but with an IDE included -- is that a fair approximation? Things change so fast in the AI space that I really cannot keep up :(
Ollama is CLI/API "first". LM studio is a proper full blown gui with chat features etc. It's far easier to use than Ollama at least for non technical users (though they are increasingly merging in functionality, with LM studio adding CLI/API features and Ollama adding more UI).