RIP Intel users
LM Studio – Discover, download, and run local LLMs
31–40 of 157 posts
Re: LM Studio – Discover, download, and run local LLMs
#32So if you suspect I am using this for business related purposes you may take any action you want to spy on me? Such Terms. Very Use.
Sorry I haven’t used this product yet - Do the chat messages get uploaded to a server ?
Re: LM Studio – Discover, download, and run local LLMs
#33LMStudio is great to run local LLMs, also support OpenAI-compatible API. In the case you need more advance UI/UX, you can use LMStudio with MindMac(https://mindmac.app), just check this video for details https://www.youtube.com/watch?v=3KcVp5QQ1Ak.
Re: LM Studio – Discover, download, and run local LLMs
#34This works, but I've noticed that my CPU use goes up to about 30 percent, all in kernel time (windows), after installing and opening this, even when it's not doing anything, on two separate machines... I also hear the fan spinning fast on my laptop.
Killed the LM studio process and re-opened it and the ghost background usage is down to about 5%.
Re: LM Studio – Discover, download, and run local LLMs
#35Re: LM Studio – Discover, download, and run local LLMs
#36For those looking for an open source alternative with Mac, Windows, Linux support check out GPT4All.io
Re: LM Studio – Discover, download, and run local LLMs
#37Earlier quoted context omitted.
It's a standard clause for most apps. If a breach of the terms of conditions (such as using it for commercial purposes, like selling the software), they are allowed to launch an investigation. No where does this mention "spying" on modifying the app for such use.
Maybe the app is already modified for such use and just needs to be given a "start spying" command.
Maybe, personally I don't trust closed source apps like these for that reason.
And when I do try them, it's with Little Snitch blocking outgoing connections.
Re: LM Studio – Discover, download, and run local LLMs
#38This looks great!
If you're looking to do the same with open source code, you could likely run Ollama and a UI.
https://github.com/jmorganca/ollama + https://github.com/ollama-webui/ollama-webui
Re: LM Studio – Discover, download, and run local LLMs
#39For my experiments with new self-hostable models on Linux, I've been using a script to download GGUF-models from TheBloke on HuggingFace (currently, TheBloke's repository has 657 models in the GGUF format) which I feed to a simple program I wrote which invokes llama.cpp compiled with GPU support. The GGUF format and TheBloke are a blessing, because I'm able to check out new models basically on the day of their releas…
I'd like to build myself a headless server to run models, that could be queried from various clients locally on my LAN, but am usure where to start and what the hardware requirements would be. Software can always be changed later but I'd rather buy the hardware parts only once. Do you have recommendations about this? or blog posts to get started? What would be a decent hardware configuration?
LM Studio can start a local server with the APIs matching OpenAI. You can’t do concurrent requests, but that should get you started.
Re: LM Studio – Discover, download, and run local LLMs
#40I really like LM Studio and had it open when I came across this post. LM Studio is an interesting mixture of:
- A local model runtime
- A model catalog
- A UI to chat with the models easily
- An openAI compatible API
And it has several plugins such as for RAG (using ChromaDB) and others.
Personally I think the positioning is very interesting. They're well positioned to take advantage of new capabilities in the OS ecosystem.
It's still unfortunate that it is not itself open-source.