Live data from Hacker News

OpenAI GPT-4 vs. Groq Mistral-8x7B

serpapi.com

21–30 of 139 posts

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#21
post #15

A bit off-topic but maybe not? Any words on GPT-5? Is that coming? Or is OpenAI just focusing on the Sora model?

I hear it should be dropped this summer

According to Sam Altman in a podcast with Lex Fridman this week, there is no real indication that it will be dropped this year. They will release a new model, but it might not be GPT-5

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#22
post #13
post #3

There are so many applications for LLMs where having a perfect score is much more important than speed, because getting it wrong is so expensive, damaging, or time consuming to resolve for an organisation.

If you have speed you can generate multiple answers and have another model pick the best one.

If I ask an LLM a very complex and specific question 500 times, if it just doesn't know the facts you'll still get the wrong answer 500 times.

That's understandable. The real problem is when the AI lies/hallucinates another answer with confidence instead of saying "I don't know".

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#23
post #3

There are so many applications for LLMs where having a perfect score is much more important than speed, because getting it wrong is so expensive, damaging, or time consuming to resolve for an organisation.

If you need a perfect score, don't use LLMs. This seems obvious to me, even given the state of the art LLMs. I am a heavy user of GPT4 and I wouldn't bet $1000 bucks on it being 100% reliable for any non-trivial task.

They'll get better. Humans are far from perfect, and I have no doubt that LLMs will eventually outperform them for non-trivial tasks consistently.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#24

Earlier quoted context omitted.

If you need a perfect score, don't use LLMs. This seems obvious to me, even given the state of the art LLMs. I am a heavy user of GPT4 and I wouldn't bet $1000 bucks on it being 100% reliable for any non-trivial task.

They'll get better. Humans are far from perfect, and I have no doubt that LLMs will eventually outperform them for non-trivial tasks consistently.

They already have superhuman image classification performance.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#26

Finally, something more offensive than parsing HTML with regular expressions: parsing HTML with LLMs.

I for one am glad I can offload all the regex to LLMs. Powerful? Yes. Human readable for beginners? No.

Personally when I am parsing structured data I prefer to use parsers that won't hallucinate data but that's just me.

Also, don't parse HTML with regular expressions.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#27
I initially thought the blog post is about scraping using screenshots and multi-modal llms.

Scraping is quite complex by now (front-end JS, deep and irregular nesting, obfuscated html, …).

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#28
post #3

There are so many applications for LLMs where having a perfect score is much more important than speed, because getting it wrong is so expensive, damaging, or time consuming to resolve for an organisation.

It makes much more sense to me to have the LLM infer the correct query for extracting data on the page. Much faster and reliable and it wouldn't really be a problem to have a human in the loop every now and then.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#29

Can somebody explain why this Grok is more performant than Microsoft infrastructure ? LPU better than TPU/GPU ?

The Mistral Mixed Expert model has way fewer parameters active during inference and Groq has special purpose hardware (and probably less concurrent demand).
Post reply on HN