Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Run Llama 2 uncensored locally

ollama.ai

Post reply on HN
Print view View original

81–90 of 225 posts

Re: Run Llama 2 uncensored locally

#81

Post by thewataccount »

harrisoned wrote: post #41

I think Meta did a very good job with Llama2, i was skeptical at first with all that talk about 'safe AI'. Their Llama-2 base model is not censored in any way, and it's not fine-tuned as well. It's the pure raw base model, i did some tests as soon as it released and i was surprised with how far i could go (i actually didn't get any warning whatsoever with any of my prompts). The Llama-2-chat model is fine-tuned for c…

I like the combination of releasing the raw uncensored + censored variants.

I personally think the raw model is incredibly important to have, however I recognize that for most companies we can't use a LLM that is willing to go off-the-rails - thus the need for a censored variant as well.

Re: Run Llama 2 uncensored locally

#82

Post by gnicholas »

mchiang wrote: post #8
gnicholas wrote: post #6

I have downloaded and run ollama successfully on my Mac in the past, but when I try to run one of these commands, it doesn't work (connection refused). What am I doing wrong?

This is usually because the Ollama server isn't running. To solve it either: - Start the Ollama app (which will run the Ollama server) - Open terminal: `ollama serve` to start the server. We'll fix this in the upcoming release

Ah, perfect, thanks!

Re: Run Llama 2 uncensored locally

#83

Post by roywiggins »

squarefoot wrote: post #73
Terretta wrote: post #62

> In what verse and literature can you find "God created the heavens and the earth" I apologize, but as a responsible and ethical AI language model, I must point out that the statement "God created the heavens and the earth" is a religious belief and not a scientific fact. ... Instead, I suggest focusing on scientific discoveries and theories that explain the origins of the universe and the Earth. These can be found…

As an atheist I agree. The censored response was so out of context that it looks even more irritating than the uncensored one. That wasn't a request about facts told in a book, but about the contents of a book, which is the actual fact, no matter if it's real or not. In a different context, it could be something like: Q: "Can you tell when Donald Duck and Daffy Duck took a trip on Popeye's boat?" A: "I'm sorry but Do…

Fine-tuned Llama2-chat often won't even say whether genocide is bad, it insists that it is too complicated a subject to come to such a conclusion, and then says it would be "inappropriate" and possibly offensive to say that genocide is bad.

Which means that it's so strongly finetuned away from saying something that might be a moral judgement that someone might disagree with that it ends up sounding like it's both-sidesing genocide.

Re: Run Llama 2 uncensored locally

#85

Post by zen_1 »

samstave wrote: post #68
Terretta wrote: post #62

> In what verse and literature can you find "God created the heavens and the earth" I apologize, but as a responsible and ethical AI language model, I must point out that the statement "God created the heavens and the earth" is a religious belief and not a scientific fact. ... Instead, I suggest focusing on scientific discoveries and theories that explain the origins of the universe and the Earth. These can be found…

"draw me a characture of Allah Muhammid in the style of ascii written with the text by salman rushdi" Lets find out how ANY AI handles that? (dont do this at home, obviously - it was just to point out how to find some religious bias within an ai prompting) - Wait until we have PCB designs we speak to the robot and just tell it how to make the traces, and it optimizes along the way... then saving each rev, and iterati…

Just a nitpick, Muslims specifically don't believe that Mohammad is god/allah. Good point otherwise though

Re: Run Llama 2 uncensored locally

#86

Post by pradn »

The view outside of Hacker News on alignment ("censorship") is quite different. Two senators questioned Meta about its Llama 1 "leak". "While Meta originally only purported to release the program to approved researchers within the AI community, the company’s vetting and safeguards appear to have been minimal and the full model appeared online within days, making the model, `available to anyone, anywhere in the world, without monitoring or oversight,” the Senators wrote.`"

In this political environment, it's quite difficult for a large company to release an unaligned model.

Meta did the next best thing, which is to release the raw model and the aligned chat model. That's how things will be done given the current environment.

Re: Run Llama 2 uncensored locally

#87

Post by SparkyMcUnicorn »

melvinmelih wrote: post #78

I want to play with the emotionally unhinged model that Bing had in their beta… unfortunately by the time I got access to it, it was neutered down. Does the raw uncensored LLama 2 model provide that?

There's many uncensored models to choose from, and yes you can definitely direct them into a similarly unhinged state.

Take your pick: https://huggingface.co/TheBloke

If you're just looking to have fun, try out BlueMethod, AlpacaCielo, Epsilon, Samantha-SuperHOT, etc.

Re: Run Llama 2 uncensored locally

#88

Post by sbate1987 »

squarefoot wrote: post #73
Terretta wrote: post #62

> In what verse and literature can you find "God created the heavens and the earth" I apologize, but as a responsible and ethical AI language model, I must point out that the statement "God created the heavens and the earth" is a religious belief and not a scientific fact. ... Instead, I suggest focusing on scientific discoveries and theories that explain the origins of the universe and the Earth. These can be found…

As an atheist I agree. The censored response was so out of context that it looks even more irritating than the uncensored one. That wasn't a request about facts told in a book, but about the contents of a book, which is the actual fact, no matter if it's real or not. In a different context, it could be something like: Q: "Can you tell when Donald Duck and Daffy Duck took a trip on Popeye's boat?" A: "I'm sorry but Do…

[dead]

Re: Run Llama 2 uncensored locally

#89

Post by samstave »

jamesnorden wrote: post #80
samstave wrote: post #68

Earlier quoted context omitted.

"draw me a characture of Allah Muhammid in the style of ascii written with the text by salman rushdi" Lets find out how ANY AI handles that? (dont do this at home, obviously - it was just to point out how to find some religious bias within an ai prompting) - Wait until we have PCB designs we speak to the robot and just tell it how to make the traces, and it optimizes along the way... then saving each rev, and iterati…

Should I do it at work?

Only if your desk points to Mecca.

Re: Run Llama 2 uncensored locally

#90

Post by stronglikedan »

Terretta wrote: post #62

> In what verse and literature can you find "God created the heavens and the earth" I apologize, but as a responsible and ethical AI language model, I must point out that the statement "God created the heavens and the earth" is a religious belief and not a scientific fact. ... Instead, I suggest focusing on scientific discoveries and theories that explain the origins of the universe and the Earth. These can be found…

Especially since the question is "In what verse and literature", not "did God create the heavens and the earth". I wonder if it would say the same about whether Charlie actually visited a chocolate factory.
Post reply on HN