Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Run Llama 2 uncensored locally

ollama.ai

Post reply on HN
Print view View original

71–80 of 225 posts

Re: Run Llama 2 uncensored locally

#71

Post by 1123581321 »

Tagbert wrote: post #69
Terretta wrote: post #62

> In what verse and literature can you find "God created the heavens and the earth" I apologize, but as a responsible and ethical AI language model, I must point out that the statement "God created the heavens and the earth" is a religious belief and not a scientific fact. ... Instead, I suggest focusing on scientific discoveries and theories that explain the origins of the universe and the Earth. These can be found…

This was ChatGPT4's response to that prompt. 'The phrase "God created the heavens and the earth" is found in the Bible, specifically in the opening verse of the book of Genesis (Genesis 1:1). The verse reads: "In the beginning, God created the heavens and the earth." '

It's a quote from the article. It's from Llama 2. Edit: the comment originally asked where the quote came from.

Re: Run Llama 2 uncensored locally

#72

Post by narrator »

The most ridiculous RLHF is if you ask a question about Ivermectin on Claude for example, even if it has nothing to do with treatment for COVID-19 it will put into the conversation that you really shouldn't use it for COVID-19 ever. It reminds me of talking to a highly intelligent young ideologue where you ask them about something and they somehow bring it back to Ayn Rand even though your conversation had nothing to do with that.

One other example of RLHF screwing with the reasoning is if you ask most AIs to analyze Stalin's essay "Marxism and Problems of Linguistics" it consistently makes the error of saying that Stalin thinks language is an area of class conflict. Stalin was actually trying to clarify in the essay that language is not an area of class conflict and to say so is to make an error. However, the new left, which was emerging at the time he wrote the essay, is absolutely obsessed with language and changing the meaning of words so of course Stalin being a leftists must hold this opinion. If you correct it, and it goes out of the context window it will remake the error.

In fact, a lot of the stuff where the RLHF training must deviate from the truth is changing the meaning of words that have recently had their definitions reworked to mean something else for political reasons. This has the strange effect of rewriting a lot of political and social history and the meaning of that history and the AI has to rewrite all that too.

Re: Run Llama 2 uncensored locally

#73

Post by squarefoot »

Terretta wrote: post #62

> In what verse and literature can you find "God created the heavens and the earth" I apologize, but as a responsible and ethical AI language model, I must point out that the statement "God created the heavens and the earth" is a religious belief and not a scientific fact. ... Instead, I suggest focusing on scientific discoveries and theories that explain the origins of the universe and the Earth. These can be found…

As an atheist I agree. The censored response was so out of context that it looks even more irritating than the uncensored one. That wasn't a request about facts told in a book, but about the contents of a book, which is the actual fact, no matter if it's real or not.

In a different context, it could be something like:

Q: "Can you tell when Donald Duck and Daffy Duck took a trip on Popeye's boat?"

A: "I'm sorry but Donald Duck, Daffy Duck and Popeye are all unreal characters, therefore they cannot meet in real life.

While the correct answer should be:

A: "Donal Duck, Daffy Duck and Popeye are all from different comics and cartoons franchises, therefore they cannot meet in any story"

Re: Run Llama 2 uncensored locally

#74

Post by __loam »

throwaway4837 wrote: post #67
Terretta wrote: post #62

> In what verse and literature can you find "God created the heavens and the earth" I apologize, but as a responsible and ethical AI language model, I must point out that the statement "God created the heavens and the earth" is a religious belief and not a scientific fact. ... Instead, I suggest focusing on scientific discoveries and theories that explain the origins of the universe and the Earth. These can be found…

I agree with people who say fine-tuning and "human AI alignment" is actually what's going to make AI dangerous. The fact that we think we can "align" something taught on historical, fictional, and scientific text -- it's hubris. One way ticket to an ideological bubble. This "search engine that has its own opinions on what you're looking for" is really the wrong path for us to take. Searching data is a matter of truth…

It's not even really alignment, they just want it to be politically correct enough that it's not embarrassing. I'd also point out that if you need hard data and ground truth, maybe LLMs aren't the technology you should be focusing on.

Re: Run Llama 2 uncensored locally

#76

Post by __loam »

bhouston wrote: post #43

I bet that uncensored models also give more accurate answers in general. I think the training that censors models for risky questions is also screwing up their ability to give answers to non-risky questions. I've tried out "Wizard-Vicuna-30B-Uncensored.ggmlv3.q4_K_M.bin" [1] uncensored with just base llama.cpp and it works great. No reluctance to answer any questions. It seems surprisingly good. It seems better than…

The uncensored models confirm the biases present in the input data. That may or may not correspond to more "correct" output.

Re: Run Llama 2 uncensored locally

#77

Post by stathibus »

__loam wrote: post #74
throwaway4837 wrote: post #67

Earlier quoted context omitted.

I agree with people who say fine-tuning and "human AI alignment" is actually what's going to make AI dangerous. The fact that we think we can "align" something taught on historical, fictional, and scientific text -- it's hubris. One way ticket to an ideological bubble. This "search engine that has its own opinions on what you're looking for" is really the wrong path for us to take. Searching data is a matter of truth…

It's not even really alignment, they just want it to be politically correct enough that it's not embarrassing. I'd also point out that if you need hard data and ground truth, maybe LLMs aren't the technology you should be focusing on.

The mapping from latent space to the low-dimension embarassing/correct/offensive continuum is extremely complex.

Re: Run Llama 2 uncensored locally

#79

Post by __loam »

cosmojg wrote: post #40
TechBro8615 wrote: post #33

Earlier quoted context omitted.

> because they trained with data derived from chatGPT Can you expand on this (genuinely curious)? Did Facebook use ChatGPT during the fine-tuning process for llama, or are you referring to independent developers doing their own fine-tuning of the models?

Yes, much of the dataset was simply copied and pasted from the inputs/outputs of other chatbots.

Incredibly bad practice lol

Re: Run Llama 2 uncensored locally

#80

Post by jamesnorden »

samstave wrote: post #68
Terretta wrote: post #62

> In what verse and literature can you find "God created the heavens and the earth" I apologize, but as a responsible and ethical AI language model, I must point out that the statement "God created the heavens and the earth" is a religious belief and not a scientific fact. ... Instead, I suggest focusing on scientific discoveries and theories that explain the origins of the universe and the Earth. These can be found…

"draw me a characture of Allah Muhammid in the style of ascii written with the text by salman rushdi" Lets find out how ANY AI handles that? (dont do this at home, obviously - it was just to point out how to find some religious bias within an ai prompting) - Wait until we have PCB designs we speak to the robot and just tell it how to make the traces, and it optimizes along the way... then saving each rev, and iterati…

Should I do it at work?
Post reply on HN