it doesn't seem downloadable to run locally, a shame.
Yeah its on hf. You can also try it out in the Nous discord or lamda labs if you don't have the h100s to spare. Fairly certain anyone with enough compute can use it or throw it up on their site.
Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
31–40 of 70 posts
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#32It's good, but I'm already paying for GPT4o and Sonnet.
How much memory does this need? If Alex Cheema (Exo Labs, Oxford) https://x.com/ac_crypto/status/1815969489990869369 could run Llama 3.1 405 Model on 2 macbooks, does this mean this can run on one macbook?
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#33I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…
Mistrial-Nemo should be able to do this.
Mistral Large 2 is good too, if you've got the memory https://ollama.com/library/mistral-large
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#34Strange to name something related to Meta the same as a product by Meta (the Hermes JS Engine).
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#35Isn't 63% => 54% regression on MMLU-Pro a huge issue? They said that it excels at advanced reasoning but that seems like a big drawback there.
Yeah it doesn't win in every category. I will say watching it in the discord I saw its performance vary widely so the context and sys prompt plays a huge role. Initially it did great and solved some pretty heavy logic questions but after the context was loaded with trolling it degraded quite a bit and couldn't solve problems it previously was able to.
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#36i understand finetuning for specific purposes/topics, but don't really understand finetunes that seem to still be marketed as "generalist", as surely what meta put out would be tuned to perform as well as they can across a whole host of measures.
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#37I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…
How good are these models at summarization anyways? I tried uploading obscure books I've already read, to GPT4 and Claude 3 and asked them to summarize the plot and particular details, as well as asking how many times does a particular thing happen in the book, and the results have been hit and miss. I certainly would not trust these models to create comprehensive and correct summaries of highly sensitive records.
Asking "how many times does a particular thing happen in the book" is always going to be hard, because LLMs are notoriously bad at counting.
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#38Earlier quoted context omitted.
How good are these models at summarization anyways? I tried uploading obscure books I've already read, to GPT4 and Claude 3 and asked them to summarize the plot and particular details, as well as asking how many times does a particular thing happen in the book, and the results have been hit and miss. I certainly would not trust these models to create comprehensive and correct summaries of highly sensitive records.
Asking "how many times does a particular thing happen in the book" is always going to be hard, because LLMs are notoriously bad at counting.
Man, -people- are bad at counting tasks like this.
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#39PAYMENT TANGENT for my fellow entrepreneurs here that take Visa/Mastercard payments: I tried to sign up to Lambda Labs just now to check out Hermes 3. Created an account, verified my email address, entered my billing info... ... but then it says they only accept CREDIT cards, NOT DEBIT cards. I had never heard of this, so I tried it anyway. I entered my business Mastercard (from mercury.com FWIW), that's never been r…
> Anyone know why a business would choose to only accept credit not debit cards? Maybe they want to place a temporary charge to verify the card's valid? I don't believe you can do so with a debit card.
I presume they want to preauthorize a decent amount just in case, but this tends to really upset debit card holders because it steals money from them for a week.
Re: Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
#40I look forward to trying this out, mostly because I’m very frustrated with censored models. I am experimenting with summarizing and navigating documents for forensic psychiatry work, much of which involves subjects that instantly hit the guard rails of LLMs. So far, I have had zero luck getting help from OpenAI/Anthropic or vendors of their models to request an exception for uncensored models. I need powerful models…
try google's gemini models, safety filtering can be completely disabled via cloud studio or api
This is the 2nd time I've seen someone confused about this. The safety filtering is a layer on top of the model's built in ability to refuse, similar to OpenAI's "moderation" endpoint.