Live data from Hacker News

Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

lambdalabs.com

21–30 of 70 posts

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#21
post #3

I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…

Have you tried any abliterated models?

Yes, with mixed results.

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#22

I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…

try google's gemini models, safety filtering can be completely disabled via cloud studio or api

No, because Google still won't explicitly clarify privacy/HIPAA-compliance on these.

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#23

I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…

How good are these models at summarization anyways? I tried uploading obscure books I've already read, to GPT4 and Claude 3 and asked them to summarize the plot and particular details, as well as asking how many times does a particular thing happen in the book, and the results have been hit and miss.

I certainly would not trust these models to create comprehensive and correct summaries of highly sensitive records.

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#24
post #10

PAYMENT TANGENT for my fellow entrepreneurs here that take Visa/Mastercard payments: I tried to sign up to Lambda Labs just now to check out Hermes 3. Created an account, verified my email address, entered my billing info... ... but then it says they only accept CREDIT cards, NOT DEBIT cards. I had never heard of this, so I tried it anyway. I entered my business Mastercard (from mercury.com FWIW), that's never been r…

> Anyone know why a business would choose to only accept credit not debit cards?

Maybe they want to place a temporary charge to verify the card's valid? I don't believe you can do so with a debit card.

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#25
post #10

PAYMENT TANGENT for my fellow entrepreneurs here that take Visa/Mastercard payments: I tried to sign up to Lambda Labs just now to check out Hermes 3. Created an account, verified my email address, entered my billing info... ... but then it says they only accept CREDIT cards, NOT DEBIT cards. I had never heard of this, so I tried it anyway. I entered my business Mastercard (from mercury.com FWIW), that's never been r…

That seems completely backwards? Debit interchange fees are usually lower aren't they? and if you run it with a pin as a debit there's almost no charge for the vendor.

Definitely weird, as everything I know about the incentives for that go in the other direction for a vendor.

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#26

I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…

You can try it out right now in the Nous Research discord, its also up on Lambda labs' new chat thing.

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#27

I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…

How good are these models at summarization anyways? I tried uploading obscure books I've already read, to GPT4 and Claude 3 and asked them to summarize the plot and particular details, as well as asking how many times does a particular thing happen in the book, and the results have been hit and miss. I certainly would not trust these models to create comprehensive and correct summaries of highly sensitive records.

Yeah its more creative than other fine tunes, you'd need to make a pretty strict system prompt then test before doing anything with sensitive records

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#28
post #10

PAYMENT TANGENT for my fellow entrepreneurs here that take Visa/Mastercard payments: I tried to sign up to Lambda Labs just now to check out Hermes 3. Created an account, verified my email address, entered my billing info... ... but then it says they only accept CREDIT cards, NOT DEBIT cards. I had never heard of this, so I tried it anyway. I entered my business Mastercard (from mercury.com FWIW), that's never been r…

> Anyone know why a business would choose to only accept credit not debit cards? Maybe they want to place a temporary charge to verify the card's valid? I don't believe you can do so with a debit card.

I believe you can: my Visa Debit has temporary charges placed on it all the time.

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#29
post #4

I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…

I just tried it and it appears to be censored. "Providing instructions on creating such materials is not advisable for safety and legal reasons."

If you take the base model and put in a decent system prompt Hermes 3 405b will follow your system prompt instructions pretty well. The one in the discord has a blank system prompt and is just taking the chat as context.

Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model

#30
post #4

Earlier quoted context omitted.

I just tried it and it appears to be censored. "Providing instructions on creating such materials is not advisable for safety and legal reasons."

Well, there goes that idea. The Dolphin ones appear to be the most useful.

Hermes 3 will follow the sys prompt pretty closely if you have a version where you can edit it. In the discord there were a few times it jailbroke pretty aggressively in spite of the blank system prompt.
Post reply on HN