Live data from Hacker News

OpenAI GPT-4 vs. Groq Mistral-8x7B

serpapi.com

11–20 of 139 posts

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#11
post #8

Earlier quoted context omitted.

I have always known N/A as not available.

Curious, where are you from? If I Google N/A every single hit on the first page is explaining it means "Not applicable" are you from a non-english country? Maybe its cultural?

The first entry on Google is Wikipedia [1] for me:

> N/A (or sometimes n/a or N.A.) is a common abbreviation in tables and lists for the phrase not applicable, not available, not assessed, or no answer.

[1] https://en.wikipedia.org/wiki/N/A

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#12

A bit off-topic but maybe not? Any words on GPT-5? Is that coming? Or is OpenAI just focusing on the Sora model?

There's no reason for OpenAI to release the model. They have close to 100% market anyways and releasing GPT-5 likely won't increase the total market as it is a incremental leap. And it's a open secret that most other models used GPT-4 synthetic data for training to come close to it.

They would likely wait till any model performs better than GPT 4 for the same price

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#13
post #3

There are so many applications for LLMs where having a perfect score is much more important than speed, because getting it wrong is so expensive, damaging, or time consuming to resolve for an organisation.

If you have speed you can generate multiple answers and have another model pick the best one.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#14
post #11
post #8

Earlier quoted context omitted.

Curious, where are you from? If I Google N/A every single hit on the first page is explaining it means "Not applicable" are you from a non-english country? Maybe its cultural?

The first entry on Google is Wikipedia [1] for me: > N/A (or sometimes n/a or N.A.) is a common abbreviation in tables and lists for the phrase not applicable, not available, not assessed, or no answer. [1] https://en.wikipedia.org/wiki/N/A

Thats interesting, wikipedia is not on the first page for me, my first hit is Cambridge dict: (and then a bunch of other dicts) - Im flying right now but IP geolocation puts me in the US

Meaning of n/a in English written abbreviation for not applicable: used on a form to show that you are not giving the information asked for because the question is not intended for you or your situation: If a question does not apply to you, please put N/A in the box provided. COMMERCE.

TIL

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#16
post #3

There are so many applications for LLMs where having a perfect score is much more important than speed, because getting it wrong is so expensive, damaging, or time consuming to resolve for an organisation.

I've tried to apply it to parsing HTML as this article into a pretty long pipeline. I'm using DeepInfra with Mistral 8x7B and I'm still unsure if I'm going to use for production.

The problem I'm finding is that the time I wanted to save mantaining selectors and the like is time that I'm spending writing wrapper code and dealing with the mistakes it makes. Some are OK and can deal with them, others are pretty annoying because It's difficult to deal with them in a deterministic manner.

I've also tried with GPT-4 but it's way more expensive, and despite what this guy got, it also makes mistakes.

I don't really care about inference speed, but I do care about price and correctness.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#17

Finally, something more offensive than parsing HTML with regular expressions: parsing HTML with LLMs.

I for one am glad I can offload all the regex to LLMs. Powerful? Yes. Human readable for beginners? No.

Why tough? To me, it seems more prone to issues (hallucinations, prompt injections etc). It is also slower and more expensive at the same time. I also think it is harder to implement properly, and you need to add way more tests in order to be confident it works.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#18

Finally, something more offensive than parsing HTML with regular expressions: parsing HTML with LLMs.

I for one am glad I can offload all the regex to LLMs. Powerful? Yes. Human readable for beginners? No.

Deterministic? No.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#19
post #3

There are so many applications for LLMs where having a perfect score is much more important than speed, because getting it wrong is so expensive, damaging, or time consuming to resolve for an organisation.

If you need a perfect score, don't use LLMs. This seems obvious to me, even given the state of the art LLMs. I am a heavy user of GPT4 and I wouldn't bet $1000 bucks on it being 100% reliable for any non-trivial task.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#20
post #2

Sorry to be nit-picky but thats the essence of these benchmarks - Mistral putting "N/A" for not available is weird - N/A is not applicable, in every use I have ever seen, and they DONT mean the same thing. I would expect null for not available and N/A for not applicable Impressive inference speed difference though

It means all of these.
Post reply on HN