Earlier quoted context omitted.
Have you tried any abliterated models?
Any recommendations?
Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
11–20 of 70 posts
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#12I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…
All base, “text-completion” models are uncensored, including Llama 3. You can make text-completion models behave like an uncensored “instruct” (chat) model simply by providing it with 10 to 20 examples of a chat dialogue in the initial prompt context, making sure to use the model’s exact prompt format. Once the model notices the pattern, it will continue like that.
Surprisingly few people seem to know this. But, this is how chat models were created in the GPT3/2 era before instruct models became the norm.
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#13it doesn't seem downloadable to run locally, a shame.
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#14it doesn't seem downloadable to run locally, a shame.
Isn't it this one?
https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-405B/...
Fairly heavy run locally of course, but I guess enough people here are fortunate enough to be on gear that can manage it.
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#15I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…
Mistrial-Nemo should be able to do this.
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#16Isn't 63% => 54% regression on MMLU-Pro a huge issue? They said that it excels at advanced reasoning but that seems like a big drawback there.
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#17Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#18I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…
try google's gemini models, safety filtering can be completely disabled via cloud studio or api
Looks like this is only possible with some prior manual action:
To access the BLOCK_NONE setting, you can:
Apply for the allowlist through the Gemini safety filter allowlist form,
or
Switch your account type to monthly invoiced billing with the Google Cloud invoiced billing reference.
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#19I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…
I just tried it and it appears to be censored. "Providing instructions on creating such materials is not advisable for safety and legal reasons."
Well, there goes that idea. The Dolphin ones appear to be the most useful.
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#20I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…
Mistrial-Nemo should be able to do this.
This is my current go-to. It's not SOTA, but at least it does something.