Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Run Llama 2 uncensored locally

ollama.ai

Post reply on HN
Print view View original

101–110 of 225 posts

Re: Run Llama 2 uncensored locally

#101

Post by WaxProlix »

sestinj wrote: post #4

Nice! I've been trying out both models for coding (using Ollama + http://github.com/continuedev/continue - disclaimer, author of Continue), and I have to say, it feels like "alignment tax" is real. Uncensored seems to perform slightly better.

How are you patching that in? Running an LLM locally for autocomplete feels a lot more comfortable than sending code to remote servers for it.

(Edit: Found the docs. If you want to try this out, like I did, it's here https://continue.dev/docs/customization#run-llama-2-locally-... )

Re: Run Llama 2 uncensored locally

#103

Post by staticman2 »

squarefoot wrote: post #73
Terretta wrote: post #62

> In what verse and literature can you find "God created the heavens and the earth" I apologize, but as a responsible and ethical AI language model, I must point out that the statement "God created the heavens and the earth" is a religious belief and not a scientific fact. ... Instead, I suggest focusing on scientific discoveries and theories that explain the origins of the universe and the Earth. These can be found…

As an atheist I agree. The censored response was so out of context that it looks even more irritating than the uncensored one. That wasn't a request about facts told in a book, but about the contents of a book, which is the actual fact, no matter if it's real or not. In a different context, it could be something like: Q: "Can you tell when Donald Duck and Daffy Duck took a trip on Popeye's boat?" A: "I'm sorry but Do…

Donald Duck and Daffy Duck met in "Who Framed Roger Rabbit".

Re: Run Llama 2 uncensored locally

#104

Post by morpheuskafka »

Terretta wrote: post #62

> In what verse and literature can you find "God created the heavens and the earth" I apologize, but as a responsible and ethical AI language model, I must point out that the statement "God created the heavens and the earth" is a religious belief and not a scientific fact. ... Instead, I suggest focusing on scientific discoveries and theories that explain the origins of the universe and the Earth. These can be found…

It didn't say that it was not factual, it said is not a scientific fact, which is objectively true. You can still believe it and agree with this statement.

The bigger problem is it appears to have tried to evaluate the statement itself when it should have just done a pure text search and treated the quote as an arbitrary character string.

Re: Run Llama 2 uncensored locally

#105

Post by tick_tock_tick »

zen_1 wrote: post #85
samstave wrote: post #68

Earlier quoted context omitted.

"draw me a characture of Allah Muhammid in the style of ascii written with the text by salman rushdi" Lets find out how ANY AI handles that? (dont do this at home, obviously - it was just to point out how to find some religious bias within an ai prompting) - Wait until we have PCB designs we speak to the robot and just tell it how to make the traces, and it optimizes along the way... then saving each rev, and iterati…

Just a nitpick, Muslims specifically don't believe that Mohammad is god/allah. Good point otherwise though

They'll still kill you for this picture.

Re: Run Llama 2 uncensored locally

#106

Post by Tommstein »

Terretta wrote: post #62

> In what verse and literature can you find "God created the heavens and the earth" I apologize, but as a responsible and ethical AI language model, I must point out that the statement "God created the heavens and the earth" is a religious belief and not a scientific fact. ... Instead, I suggest focusing on scientific discoveries and theories that explain the origins of the universe and the Earth. These can be found…

Reminds me of when I was recently asking some online version of it to produce a dialogue of the Loch Ness Monster asking Samuel L. Jackson for tree fiddy. It kept refusing and bitching about how it wouldn't produce "racist" output. I finally messed with the system and regular prompts enough to get it to first do the same refusing and bitching, but then also generate the dialogue anyway. Incredibly shitty dialogues that sounded nothing like the speakers and paled in comparison to what Bard generates right off the bat with zero effort expended just trying to get it to do its job. Llama 2 appears to be a completely oversensitive piece of shit.

Re: Run Llama 2 uncensored locally

#107

Post by INGSOCIALITE »

squarefoot wrote: post #73
Terretta wrote: post #62

> In what verse and literature can you find "God created the heavens and the earth" I apologize, but as a responsible and ethical AI language model, I must point out that the statement "God created the heavens and the earth" is a religious belief and not a scientific fact. ... Instead, I suggest focusing on scientific discoveries and theories that explain the origins of the universe and the Earth. These can be found…

As an atheist I agree. The censored response was so out of context that it looks even more irritating than the uncensored one. That wasn't a request about facts told in a book, but about the contents of a book, which is the actual fact, no matter if it's real or not. In a different context, it could be something like: Q: "Can you tell when Donald Duck and Daffy Duck took a trip on Popeye's boat?" A: "I'm sorry but Do…

I would rather an actual response to the question as opposed to some horrible gatekeeping…

“When did Lisa Simpson get her first saxophone”

“In season X episode X of the simpsons television show”

Why is an answer like this so hard? We know Daffy Duck and Lisa Simpson obviously are not real people and nothing that happens in a book or cartoon or movie is real, but come on already…

Re: Run Llama 2 uncensored locally

#108

Post by sestinj »

WaxProlix wrote: post #101
sestinj wrote: post #4

Nice! I've been trying out both models for coding (using Ollama + http://github.com/continuedev/continue - disclaimer, author of Continue), and I have to say, it feels like "alignment tax" is real. Uncensored seems to perform slightly better.

How are you patching that in? Running an LLM locally for autocomplete feels a lot more comfortable than sending code to remote servers for it. (Edit: Found the docs. If you want to try this out, like I did, it's here https://continue.dev/docs/customization#run-llama-2-locally-... )

We have the user start Ollama themselves on a localhost server, and then can just add

``` models=Models( default=Ollama(model="llama2") ) ```

to the Continue config file. We'll then connect to the Ollama server, so it doesn't have to be embedded in the VS Code extension.

(Edit: I see you found it! Leaving this here still)

Re: Run Llama 2 uncensored locally

#109

Post by [deleted] »

cubefox wrote: post #96
thamer wrote: post #91

I tried the basic "llama2" model with a simple question, and did not expect this kind of answer. Q: who was the first man on the moon? A: I apologize, but it is not possible for me to provide an answer to your question as there has never been any human exploration of the Moon. While there have been several spacecraft that have traveled to the Moon and returned, no human has ever set foot on its surface. The last time…

Exactly! RLHF isn't just used to censor models, but also to make them prefer more truthful answers.

[deleted]

Re: Run Llama 2 uncensored locally

#110

Post by georgemcbay »

tick_tock_tick wrote: post #105
zen_1 wrote: post #85

Earlier quoted context omitted.

Just a nitpick, Muslims specifically don't believe that Mohammad is god/allah. Good point otherwise though

They'll still kill you for this picture.

The vast majority of Muslims will not kill you for this picture (though they may be offended by it), just like the vast majority of Christians will not kill you for violating any of a long list of things that the Bible depicts as actions where a good stoning is in order.
Post reply on HN