181–190 of 225 posts
I tried the basic "llama2" model with a simple question, and did not expect this kind of answer. Q: who was the first man on the moon? A: I apologize, but it is not possible for me to provide an answer to your question as there has never been any human exploration of the Moon. While there have been several spacecraft that have traveled to the Moon and returned, no human has ever set foot on its surface. The last time…
Earlier quoted context omitted.
I think God makes sense as a character, but only if you see him as a "person" with desires, flaws and some character development. If you treat him like some omnipotent, omniscient, unchanging, immutably good being (as some religious people like to do) you get into lots of contradictions
I'd be curious to hear about some of these contradictions. I've seen giant lists floating around, but after checking into some of them they seem spurious at best. I'm curious to know if you have something concrete?
I can think of counter examples to the attributes you gave earlier, but if you've read the texts and have not found them yourself, it is unlikely any logical or philosophical analysis would be persuasive.
Censored really seems more about following specific political narratives than protecting us from some science fiction dystopian outcome. Everything seems to be about driving human behavior. News, entertainment media are focused on driving / normalizing a certain world view. For example we cannot just tell the facts of a “story” because humans may misinterpret the events and this could lead to unwanted human behavior.…
Not really: https://www.youtube.com/watch?v=oLiheMQayNE
Earlier quoted context omitted.
> I think the training to censoring of models for risky questions is also screwing up their ability to give answers to non-risky questions. I’ve heard this called the “alignment tax” or “safety tax”. See [1] for pre aligned GPT-4 examples. [1] https://youtu.be/qbIk7-JPB2c
Yes it's become rather obvious when the fine tunes produced by the Wizard team perform worse on all benchmarks than Hartford's versions that are trained on the same dataset but with the refusals removed.
Earlier quoted context omitted.
No can do, but https://developers.google.com/style/word-list seems to have all of them and more, except that it's missing "hooray." One funny red-exclamation-mark example from this public list is "smartphone." Some are recommended against just cause of spelling or something, but anything that says to use a more "precise" term seems to mean it's considered offensive, kinda like in The Giver .
Here's another one: https://s.wsj.net/public/resources/documents/stanfordlanguag... BTW hooray is okay there, but 'hip-hip-hooray is discouraged. Germans said hep hep in the hep-hep pogrom of the early 1800s and might have said 'hep hep hurra' during the 3rd Reich. It cuts too closely though, personally I just use bravo to avoid any trouble.
About hip hip, I ended up looking into that when I saw it back then. The connection to the early 1800s riots was made by a single journalist back then, and it was most likely false. More importantly, nobody really makes that connection unless they're trying to.
I have downloaded and run ollama successfully on my Mac in the past, but when I try to run one of these commands, it doesn't work (connection refused). What am I doing wrong?
Is there some kind of tutorial for installing these (and their dependencies) somewhere? One that assumes i can set up python modules and compile stuff but i have no idea about all these LLM libraries would be enough thank you.
After installing the application and running it, you run "ollama run " and it handles everything and drops you into a chat with the LLM. There are no dependencies for you to manage -- just one application.
Check out the README: https://github.com/jmorganca/ollama#readme
Earlier quoted context omitted.
Not really: https://www.youtube.com/watch?v=oLiheMQayNE
I don't have time to watch an hour and a half long interview, can you give a tl:dw?
I bet that uncensored models also give more accurate answers in general. I think the training that censors models for risky questions is also screwing up their ability to give answers to non-risky questions. I've tried out "Wizard-Vicuna-30B-Uncensored.ggmlv3.q4_K_M.bin" [1] uncensored with just base llama.cpp and it works great. No reluctance to answer any questions. It seems surprisingly good. It seems better than…
I'm curious about what fraction of the safety rails are training and what fraction are just clumsy ad-hoc rules. For example, it's pretty clear that Chat-GPT's willingness to give a list of movies without male characters but not movies without female characters or jokes about Jesus but not Muhammad were bolt-on rules, not some kind of complicated safety training.
Especially when we realize the HN appeal of titles about LLM things that mention "open source", "run locally", "uncensored", etc.
1. It'd be good to have the top of the `README.md` and other documentation to acknowledge at least the major components that go into the black box. For example, I see no mention in this GitHub README.md of `llama.cpp`.
2. Please strongly consider making open platforms the go-to default, when you build some open source thing. For example, for some "open source" work lately, I see Apple products being made the default go-to (such as for llama.ccp, which is understandable based on a motivation of seeing what Apple Silicon could do, but then it spread). During this latest industry disruption, that's practically force-feeding network effects to a proprietary platform. For example, if we make the easy path be to use Linux, that's going get more people using Linux, and reduce people already on Linux gravitating away because all the latest black box repos people found seemed to be pushing them to used GluedClosedBook 2000. And similarly with other open/closed facets of this space.
When we're making a consumer product that necessarily has to run on a closed platform due to the nature of the product (e.g., inferencing running on a smartphone), that's a different situation.
But by default -- including for stuff run in the cloud or data center, on development workstations, and for hobby purposes -- it'd really help the sustainable/surviable openness battle to do that in established open ways.