Live data from Hacker News

Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

lambdalabs.com

1–10 of 70 posts

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#2
I look forward to trying this out, mostly because I’m very frustrated with censored models.

I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models with good, hipaa-compliant privacy, that won’t balk at topics that have serious effects on people’s lives.

Look, I’m not excited to read hundreds of pages about horrible topics, either. If there were a way to reduce the vicarious trauma of people who do this work without sacrificing accuracy, it would be nice. I’d like to at least experiment. But I’m not going to hold my breath.

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#3

I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…

Have you tried any abliterated models?

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#4

I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…

I just tried it and it appears to be censored. "Providing instructions on creating such materials is not advisable for safety and legal reasons."

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#6
post #3

I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…

Have you tried any abliterated models?

Any recommendations?

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#7

I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…

try google's gemini models, safety filtering can be completely disabled via cloud studio or api

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#8
post #6
post #3

Earlier quoted context omitted.

Have you tried any abliterated models?

Any recommendations?

No specific ones, but there are some abliteration LoRas for Llama (8B and 70B, I think). Those should be good for what you want.

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#9
post #6
post #3

Earlier quoted context omitted.

Have you tried any abliterated models?

Any recommendations?

failspy’s or mlabonne’s models. Or just look for any model with ‘abliterated’ in the title. Eg try failspy/meta-llama-3-8b-instruct-abliterated-v3 though of course bigger models will probably be better

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#10
PAYMENT TANGENT for my fellow entrepreneurs here that take Visa/Mastercard payments:

I tried to sign up to Lambda Labs just now to check out Hermes 3.

Created an account, verified my email address, entered my billing info...

... but then it says they only accept CREDIT cards, NOT DEBIT cards.

I had never heard of this, so I tried it anyway. I entered my business Mastercard (from mercury.com FWIW), that's never been rejected anywhere, and immediately got the response that they couldn't accept it because it's a debit card.

Anyone know why a business would choose to only accept credit not debit cards?

I don't have any credit cards, neither personal nor business, and never found a need for one.

So I deleted my account at Lambda Labs, which was kind of disappointing since I was looking forward to trying this.

Post reply on HN