LM Studio – Discover, download, and run local LLMs

Post by vGPU » Thu, Nov 23, 2023, 3:50 PM UTC

0xEF wrote: post #79

pentagrama wrote: post #41

Curious about this and I just download it. Want to try uncensored models. I have a question, looking for the most popular "uncensored" model I just find "TheBloke/Luna-AI-Llama2-Uncensored-GGML", but it has 14 files to download between 2 to 7 GB, I just download the first one: https://imgur.com/a/DE2byOB I try the model and it works: https://imgur.com/a/2vtPcui I should download all the 14 files to get better results…

Honest question from someone new to exploring and using these models; why do you need uncensored? What are the use-cases that would call for it? Again, not questioning your motives or anything, just straight up curious. To use your example, any of us can find bomb building info online fairly easily, and has been a point of social contention since the Anarchist's cookbook. Nobody needs an uncensored LLM for that, of c…

Post by ParetoOptimal » Thu, Nov 23, 2023, 8:47 PM UTC

MuffinFlavored wrote: post #119

shironandonon_ wrote: post #118

Earlier quoted context omitted.

Why don’t you wrap it with a verification system (eg: web scraper) and auto-regenerate / jailbreak any things you don’t like?

Because I pay $20/mo for GPT-4 and don't understand why anybody would run a "less-good" version locally that you can trust less/that has less functionality. That's why I wanted to try to understand, what am I missing about local-toy LLMs. How are they not just noise/nonsense generators?

Post by frankacter » Fri, Nov 24, 2023, 12:23 AM UTC

ParetoOptimal wrote: post #144

MuffinFlavored wrote: post #119

Earlier quoted context omitted.

Because I pay $20/mo for GPT-4 and don't understand why anybody would run a "less-good" version locally that you can trust less/that has less functionality. That's why I wanted to try to understand, what am I missing about local-toy LLMs. How are they not just noise/nonsense generators?

> don't understand why anybody would run a "less-good" version locally Privacy. If you use llm's on private documents you don't want others to see, you'll likely prefer local models strongly.

Post by froggit » Sat, Nov 25, 2023, 1:57 AM UTC

OJFord wrote: post #111

0xEF wrote: post #79

Earlier quoted context omitted.

Honest question from someone new to exploring and using these models; why do you need uncensored? What are the use-cases that would call for it? Again, not questioning your motives or anything, just straight up curious. To use your example, any of us can find bomb building info online fairly easily, and has been a point of social contention since the Anarchist's cookbook. Nobody needs an uncensored LLM for that, of c…

Where do you typically have the 'safe search' setting when you web search? Personally I have it 'off' ('moderate' when I worked in an office I think) even though I'm not looking for anything that ought to be filtered by it. I'm not using models censored or otherwise, but I imagine I'd feel the same way there - I won't be offended, so don't try to be too clever, just give me the unfiltered results and let me decide wh…

Post by AlexeyBelov » Sat, Nov 25, 2023, 7:08 AM UTC

vGPU wrote: post #142

0xEF wrote: post #79

Earlier quoted context omitted.

Honest question from someone new to exploring and using these models; why do you need uncensored? What are the use-cases that would call for it? Again, not questioning your motives or anything, just straight up curious. To use your example, any of us can find bomb building info online fairly easily, and has been a point of social contention since the Anarchist's cookbook. Nobody needs an uncensored LLM for that, of c…

Because I don’t appreciate it when a model has blatant democrat/anti-republican bias, for example. The fact that chatGPT, Bard, etc are heavily and purposefully biased on certain topics is well documented[1]. [1] https://www.brookings.edu/articles/the-politics-of-ai-chatgp...