Been there, done that. It's intellectually inferior to GPT4 and it shows so not much use.
Run Llama 2 uncensored locally
141–150 of 225 posts
Re: Run Llama 2 uncensored locally
#142Earlier quoted context omitted.
Even in high school it was obvious to me that "god is omniscient" is a scientific statement, not a metaphysical / religious claim. The existence of god, however, is a metaphysical claim. The first statement is simply putting forward a definition. Similar to "wormholes can instantly transfer you from one point in the universe to another". We're just defining the term, whether wormholes / god actually exist , is a diff…
> Even in high school it was obvious to me that "god is omniscient" is a scientific statement, not a metaphysical / religious claim. It's a bit more complex than that. You could say "god is omniscient" is a proposition in logic but you need some axioms first. "God as defined in the Bible" might be a good start (although not too easy as Bible is self-contradictory in many places and doesn't provide a clear definition…
> a clear definition of God
The God of the Bible offers a profound reply to the question "Who are You?" He replies "I AM that I AM" as if He is not readily definable.
There are many characteristics of this God that spelled out in detail; His desire for truth and justice, His love for the widow and orphan, His hatred of evil and injustice, His power and glory, and His plan for this world. So even if His whole is blurry, there are aspects of His character and abilities that are spelled out in detail.
Is it enough for a metaphysical debate? I have no idea.
Re: Run Llama 2 uncensored locally
#143Earlier quoted context omitted.
Donald Duck and Daffy Duck met in "Who Framed Roger Rabbit".
I always thought one of the most amazing feats of that movie was Disney and Warner Bros allowing their characters to be in the same film. Has there been any other cross-overs between the two studios?
Every time Kingdom Hearts comes up, I have the same thought.
Re: Run Llama 2 uncensored locally
#144Earlier quoted context omitted.
> One way ticket to an ideological bubble. I believe this is the intention. The people doing the most censoring in the name of "safety and security" are just trying to build a moat where they control what LLMs say and consequently what people think, on the basis of what information and ideas are acceptable versus forbidden. Complete control over powerful LLMs of the future will enable despots, tyrants, and entitled t…
Revolutions tend to be especially bloody for the regular people in society. Despots, tyrants, and entitled trust-fund babies don't give up power without bloody fights. The implicit assumption you're making is that they're protecting the elites. But how do you know it's not the other way around? Maybe they're just trying to protect you from taking them on. I was playing with a kitten, play fighting with it all the tim…
[deleted]
Re: Run Llama 2 uncensored locally
#145Earlier quoted context omitted.
> One way ticket to an ideological bubble. I believe this is the intention. The people doing the most censoring in the name of "safety and security" are just trying to build a moat where they control what LLMs say and consequently what people think, on the basis of what information and ideas are acceptable versus forbidden. Complete control over powerful LLMs of the future will enable despots, tyrants, and entitled t…
Revolutions tend to be especially bloody for the regular people in society. Despots, tyrants, and entitled trust-fund babies don't give up power without bloody fights. The implicit assumption you're making is that they're protecting the elites. But how do you know it's not the other way around? Maybe they're just trying to protect you from taking them on. I was playing with a kitten, play fighting with it all the tim…
Did the dog survive?
It clearly had a model of what it could get away with too. ;)
Re: Run Llama 2 uncensored locally
#146Earlier quoted context omitted.
They can , and probably have . Just not in a copyrighted, published work. Not sure if this is what you meant, but it's worth being clear: training LLMs to interpret copyright as if it were natural law is a famously bad idea.
I agree. Donald Duck and Popeye and Daffy Duck can meet, the author of such story, however, may face legal consequences for publishing it.
However in practice such stories are widely tolerated, as long as nobody earns any money with them. Most see it as a win-win, as franchises benefit from fan activity and engagement
Re: Run Llama 2 uncensored locally
#147Earlier quoted context omitted.
It's just not safe. It's unusable. you can't ask it normal questions to not get stonewalled by it's default censorship message - it wouldn't even work for commercial case.
Seems fine for most commercial use cases. Got a tech support chat bot? It doesn't need to be answering questions about religion. Also, corporate environments already tend to be super politically correct. There's already a long list of normal words I can't say at work.
Can you post that list here?
Re: Run Llama 2 uncensored locally
#148This post seems to be upvoted for the "uncensored" keyword. But this should be attributed to https://huggingface.co/ehartford and others. See also https://news.ycombinator.com/item?id=36977146 Or better: https://erichartford.com/uncensored-models
The latter link had a major thread at the time:
Uncensored Models - https://news.ycombinator.com/item?id=35946060 - May 2023 (379 comments)
We definitely want HN to credit the original sources and (even more so) researchers but I'm not sure what the best move here would be, or whether we need to change anything.
Re: Run Llama 2 uncensored locally
#149Ollama forks llama.cpp. The value-add is marginal. Still I see no attribution on https://ollama.ai/ . Please instead of downvoting, see if this is fine from your point of view. No affiliation at all, I just don't like this kind of marketing. See also https://news.ycombinator.com/item?id=36806448
It would be nice to add some attribution but llama.cpp is MIT licensed so what Ollama is doing is perfectly acceptable. Also, Ollama is open source (also MIT). You can bet any for-profit people using llama.cpp under the hood aren't going to mention it, and while I think we should hold open source projects to a slightly higher standard this isn't really beyond the pale for me.
While you find the value-add to be "marginal" I wouldn't agree. In the linked comment you say "setting up llama.cpp locally is quite easy and well documented" ok, but it's still nowhere near as fast/easy to setup as Ollama, I know, I've done both.
Re: Run Llama 2 uncensored locally
#150The most ridiculous RLHF is if you ask a question about Ivermectin on Claude for example, even if it has nothing to do with treatment for COVID-19 it will put into the conversation that you really shouldn't use it for COVID-19 ever. It reminds me of talking to a highly intelligent young ideologue where you ask them about something and they somehow bring it back to Ayn Rand even though your conversation had nothing to…
While I think the Ivermectin censorship is bad, I’d imagine in this context it’s unintentional and just a result of it’s training data probably having COVID-19 treatment and Ivermectin show up so often next to each other