In my experience GPT-4o has much weaker reasoning than GPT-4. It is a lot faster, however. What have your experiences been?
Ask HN: Is GPT-4o overall worse than GPT-4 for you?
1–10 of 25 posts
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#2[deleted]
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#3Their claim hasn't been that 4o is better than 4. Just that it's faster and cheaper. So it's better than 3.5-turbo but not as good as 4, atleast from the examples I've tried out for summarization, code gen etc.
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#4Small anecdote but I asked an SQL query and GPT4o got it wrong. It didn't work when I ran it. Pasted the same question into GPT4 and it got it right.
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#5Their claim hasn't been that 4o is better than 4. Just that it's faster and cheaper. So it's better than 3.5-turbo but not as good as 4, atleast from the examples I've tried out for summarization, code gen etc.
No, their site literally says "our most powerful model" as the description for GPT4o, and it scores slightly higher than GPT-4 in their benchmarks: https://openai.com/index/hello-gpt-4o/
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#6Yeah, it's much worse for me, worse than 3.5 even. Almost at the level of GPT-3 curie at worst.
I suspect it could be related to whatever it's using as language detection, because many others don't experience this. It glitches hard on language, often responding in the wrong one.
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#7maybe someone else is delighted with this, but for me it’s all still the stone age
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#8I find it better overall, it's my default.
It's also what people think in blind tests: https://arena.lmsys.org
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#9I noticed this too, I find 4.0 is still better for giving me what I ask for.
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#10Sorry for a tangent, but also is gpt-4 better for you than 8x7b?
When I return to 8x7b from gpt-4 it feels like I just shook off an unbearably boring guy and met a normal one, both very similar in knowledge (and unable to perform complex tasks).