Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

LM Studio – Discover, download, and run local LLMs

lmstudio.ai

Post reply on HN
Print view View original

151–157 of 157 posts

Re: LM Studio – Discover, download, and run local LLMs

#151

Post by [deleted] »

PeterStuer wrote: post #132
0xEF wrote: post #79

Earlier quoted context omitted.

Honest question from someone new to exploring and using these models; why do you need uncensored? What are the use-cases that would call for it? Again, not questioning your motives or anything, just straight up curious. To use your example, any of us can find bomb building info online fairly easily, and has been a point of social contention since the Anarchist's cookbook. Nobody needs an uncensored LLM for that, of c…

Most people wanting 'uncensored' are not looking for anything illegal. They just don't want to be forced into some Californian/SV idea of 'morality'.

[deleted]

Re: LM Studio – Discover, download, and run local LLMs

#152

Post by RecycledEle »

MuffinFlavored wrote: post #117

1. Mistral 2. Llama 2 3. Code Llama 4. Orca Mini 5. Vicuna What can I do with any of these models that won't result in 50% hallucinations/it recommending code with APIs that don't exist/it recommending basically regurgitated StackOverflow historical out of date answers (that it was trained on) for libraries that have had their versions/APIs change, etc? Can somebody share one real use case they are using any of these…

> What can I do with any of these models that won't result in 50% hallucinations

There are many times when I am searching for a solution to a problem, and I would be perfectly happy with a possible answer I could test that has a 50% chance of being correct.

Humans should test the output of all AIs.

Humans should test the validity of everything we hear, see, and read.

Re: LM Studio – Discover, download, and run local LLMs

#153

Post by RecycledEle »

MuffinFlavored wrote: post #119
shironandonon_ wrote: post #118

Earlier quoted context omitted.

Why don’t you wrap it with a verification system (eg: web scraper) and auto-regenerate / jailbreak any things you don’t like?

Because I pay $20/mo for GPT-4 and don't understand why anybody would run a "less-good" version locally that you can trust less/that has less functionality. That's why I wanted to try to understand, what am I missing about local-toy LLMs. How are they not just noise/nonsense generators?

> I pay $20/mo for GPT-4 and don't understand why anybody would run a "less-good" version locally that you can trust less/that has less functionality.

Local might still be there after an online service is no longer available.

Re: LM Studio – Discover, download, and run local LLMs

#155

Post by RecycledEle »

apstls wrote: post #108
isilofi wrote: post #9

Disappointing, no proper Linux support. Just "ask on discord".

from a pinned message on their discord: https://s3.amazonaws.com/releases.lmstudio.ai/prerelease/LM+...

The link above starts downloading a file. It's not a link to a web page.

Re: LM Studio – Discover, download, and run local LLMs

#156

Post by 3abiton »

andy99 wrote: post #17

I don't mean this as a criticism, I'm just curious because I work in this space too: who is this for? What is the niche of people savvy enough to use this who can't run one of the many open source local llm software? It looks in the screenshot like it's exposing much of the complexity of configuration anyway. Is the value in the interface and management of conversation and models? It would be nice to see info or even…

It looks like civitai but for LLMs
Post reply on HN