Live data from Hacker News

OpenAI GPT-4 vs. Groq Mistral-8x7B

serpapi.com

1–10 of 139 posts

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#2
Sorry to be nit-picky but thats the essence of these benchmarks - Mistral putting "N/A" for not available is weird - N/A is not applicable, in every use I have ever seen, and they DONT mean the same thing. I would expect null for not available and N/A for not applicable

Impressive inference speed difference though

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#5
post #3

There are so many applications for LLMs where having a perfect score is much more important than speed, because getting it wrong is so expensive, damaging, or time consuming to resolve for an organisation.

Yeah I agree - just an hour ago I was dealing with an LLM that was missing a "not" thus inverting the meaning of a rather important simulation parameter!

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#6
post #2

Sorry to be nit-picky but thats the essence of these benchmarks - Mistral putting "N/A" for not available is weird - N/A is not applicable, in every use I have ever seen, and they DONT mean the same thing. I would expect null for not available and N/A for not applicable Impressive inference speed difference though

I have always known N/A as not available.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#8
post #2

Sorry to be nit-picky but thats the essence of these benchmarks - Mistral putting "N/A" for not available is weird - N/A is not applicable, in every use I have ever seen, and they DONT mean the same thing. I would expect null for not available and N/A for not applicable Impressive inference speed difference though

I have always known N/A as not available.

Curious, where are you from? If I Google N/A every single hit on the first page is explaining it means "Not applicable"

are you from a non-english country? Maybe its cultural?

Post reply on HN