Run Llama 2 uncensored locally
ollama.ai
Run Llama 2 uncensored locally
1–10 of 225 posts
Re: Run Llama 2 uncensored locally
#2Eric’s blog is a great read on how to create the uncensored models - link to the original blog here: https://erichartford.com/uncensored-models
Re: Run Llama 2 uncensored locally
#3[deleted]
Re: Run Llama 2 uncensored locally
#4Nice! I've been trying out both models for coding (using Ollama + http://github.com/continuedev/continue - disclaimer, author of Continue), and I have to say, it feels like "alignment tax" is real. Uncensored seems to perform slightly better.
Re: Run Llama 2 uncensored locally
#5Original HN discussion for Eric Hartford's post on Uncensored Models: https://news.ycombinator.com/item?id=35946060.
The article gives a great background on uncensored models, why they should exist and how to train/fine-tuned one.
Re: Run Llama 2 uncensored locally
#6I have downloaded and run ollama successfully on my Mac in the past, but when I try to run one of these commands, it doesn't work (connection refused). What am I doing wrong?
Re: Run Llama 2 uncensored locally
#7Modelfile cool. Just use JSON or YAML, not custom format
please!
edit: Adapter support would be really cool. Multiple adapter even better i want somebody to make MoE of adapters.
Re: Run Llama 2 uncensored locally
#8I have downloaded and run ollama successfully on my Mac in the past, but when I try to run one of these commands, it doesn't work (connection refused). What am I doing wrong?
This is usually because the Ollama server isn't running. To solve it either:
- Start the Ollama app (which will run the Ollama server)
- Open terminal: `ollama serve` to start the server.
We'll fix this in the upcoming release
Re: Run Llama 2 uncensored locally
#9Modelfile cool. Just use JSON or YAML, not custom format please! edit: Adapter support would be really cool. Multiple adapter even better i want somebody to make MoE of adapters.
It's modeled after Dockerfiles and is pretty easy to understand due to that. I don't know what advantage a more complex format would bring.
Re: Run Llama 2 uncensored locally
#10Which graphics card would you recommend to run Llamma 2 locally? I'm about to buy a laptop and considering choosing a model with a good Nvidia GPU.