Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI GPT-4 vs. Groq Mistral-8x7B

serpapi.com

Post reply on HN
Print view View original

131–139 of 139 posts

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#131

Post by samus »

samlinnfer wrote: post #80
dns_snek wrote: post #56

For all the posturing and crypto hate on HN, we're entering a world where it's socially acceptable to use 1000W of computing power and 5 seconds of inference time to parse a tiny HTML fragment which would take microseconds with traditional methods - and people are cheering about it. Time for some self-reflection? That's not very green.

Any amount of energy spent useful work is vastly superior than whatever “POW” crypto burn does. >For all the posturing and forest fire hate on HN, it’s now socially acceptable to run a toy steam engine to power a model car? Not very green of you.

While you are not wrong, crypto is not what this is being compared with.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#132

Post by imaurer »

Groq will soon support function calling. At that point, you would want to describe your data specification and use function calling to do extraction. Tools such as Pydantic and Instructor are good starting points.

I am collecting these approaches and tools here: https://github.com/imaurer/awesome-llm-json

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#133

Post by Jensson »

retrac98 wrote: post #23
nathan_compton wrote: post #19

Earlier quoted context omitted.

If you need a perfect score, don't use LLMs. This seems obvious to me, even given the state of the art LLMs. I am a heavy user of GPT4 and I wouldn't bet $1000 bucks on it being 100% reliable for any non-trivial task.

They'll get better. Humans are far from perfect, and I have no doubt that LLMs will eventually outperform them for non-trivial tasks consistently.

> Humans are far from perfect

Humans running multishot with mixture of experts is close to perfect. You can't compare a multishot mixture of expert AI to a single human, humans doesn't work in isolation.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#134

Post by mewpmewp2 »

malux85 wrote: post #8
mewpmewp2 wrote: post #6

Earlier quoted context omitted.

I have always known N/A as not available.

Curious, where are you from? If I Google N/A every single hit on the first page is explaining it means "Not applicable" are you from a non-english country? Maybe its cultural?

I'm from North Europe, so not a native English speaker, but still it seems like based on my experience in life it seems as the first idea is that it's Not Available.

If I was to code something and for whatever reason some data wasn't available I would use N/A.

"Not applicable" doesn't feel right to me about N/A.

For instance if there is a table of comparison and for whatever reason there is data missing for some entity, while there should be, I would use N/A. So not applicable feels wrong for me for that reason alone.

This all is coming from intuition though.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#135

Post by osigurdson »

londons_explore wrote: post #119
osigurdson wrote: post #101

Earlier quoted context omitted.

It is a nice idea in principle but ends up being a political tool and a tariff on goods and services of your own country. A global and corruption free carbon tax might work but that is impossible to achieve.

The only way it's gonna work is if a bunch of countries get together, agree a carbon cap/tax, and then tell other countries that they need to join the scheme if they want to trade goods with the group. One way to combat corruption is to ask an international panel of experts to assess how many extra emissions came from non-official sources in each country and reduce next years cap by that amount. Then countries have a…

I don't know. Corruption gets easier with increased centralization. I think a far better approach is to innovate our way out of it. If carbon free energy sources are less expensive then the problem will solve itself essentially. A global carbon tax will enviably extract some portion of global GDP from corruption. That money would likely be better spent in other ways.

Basically, carbon tax is the accountant's solution, innovation is the engineer's.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#136

Post by varjag »

samus wrote: post #130
varjag wrote: post #85

Earlier quoted context omitted.

I wouldn't call the early McCulloch & Pitts work quite "full-fledged". Also backpropagation, essential for multi level perceptrons was not a thing until 1980s.

Backprop is just applied calculus. People simply didn't think about using it for neuronal networks yet.

It was thought of as early as in 1960s by Rosenblatt but he did not come up with a practical implementation at the time. Lotsa things look obvious in hindsight.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#137

Post by londons_explore »

osigurdson wrote: post #135
londons_explore wrote: post #119

Earlier quoted context omitted.

The only way it's gonna work is if a bunch of countries get together, agree a carbon cap/tax, and then tell other countries that they need to join the scheme if they want to trade goods with the group. One way to combat corruption is to ask an international panel of experts to assess how many extra emissions came from non-official sources in each country and reduce next years cap by that amount. Then countries have a…

I don't know. Corruption gets easier with increased centralization. I think a far better approach is to innovate our way out of it. If carbon free energy sources are less expensive then the problem will solve itself essentially. A global carbon tax will enviably extract some portion of global GDP from corruption. That money would likely be better spent in other ways. Basically, carbon tax is the accountant's solution…

carbon-free will take a really long time to be cheaper.

As soon as demand for oil starts to drop, so will oil prices, and I suspect they could go down by a factor of 10 or more and oil-rich nations would still think it worthwhile to exploit at least some reserves.

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#138

Post by jodleif »

wenebego wrote: post #78
jodleif wrote: post #73

Earlier quoted context omitted.

How does faster mean less energy? Thats only true if you’re running faster on the same hardware…

I think they are talking about the case where, hypothetically, there is a 10x increase in speed but only 2x increase in power consumption

I’m just pointing out that this is not a given…

Re: OpenAI GPT-4 vs. Groq Mistral-8x7B

#139

Post by ilyazub »

infecto wrote: post #96
wruza wrote: post #60

The prompt, for those interested. I find it pretty underspecified, but maybe that's the point. For example, "Business operating hours" could be expanded a little, because "Closed - Opens at XX" is still non-processable in both cases. You are an expert in Web Scraping, so you are capable to find the information in HTML and label them accordingly. Please return the final result in JSON. Data to scrape: title: Name of t…

This should be higher up. This whole blog post is mostly worthless because the way they are extracting data is less than optimal. Lower end models do not have the attention to complete tasks like this, GPT4Turbo will generally have the capability. But to have an optimal pipeline you should really be splitting up these tasks into individual units. You extract each attribute you want independently and then combine it b…

> I have high confidence that I could accomplish this task using a lower end model with a high degree of accuracy.

Cool, cool. I'm super interested. Please share the process and the results.

Post reply on HN