I've found it is a lot worse in general. I use GPT-4 90% of the time now, and 4o when I need something answered quickly that has a very simple answer.
Ask HN: Is GPT-4o overall worse than GPT-4 for you?
11–20 of 25 posts
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#12I find it better overall, it's my default. It's also what people think in blind tests: https://arena.lmsys.org
Take those results with a large grain of salt. It's dead simple to figure out which response is the new model purely by the speed at which the result is returned, and as such, this is incredibly easy to bot in an effort to manipulate the rankings.
They should really be streaming the content at the same time, based on the slowest responder.
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#13Their claim hasn't been that 4o is better than 4. Just that it's faster and cheaper. So it's better than 3.5-turbo but not as good as 4, atleast from the examples I've tried out for summarization, code gen etc.
Why would they give free access to GPT4 when it's more expensive than 4o?
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#14I find it better overall, it's my default. It's also what people think in blind tests: https://arena.lmsys.org
Take those results with a large grain of salt. It's dead simple to figure out which response is the new model purely by the speed at which the result is returned, and as such, this is incredibly easy to bot in an effort to manipulate the rankings. They should really be streaming the content at the same time, based on the slowest responder.
Who would manipulate the rankings to make OpenAI look better? Are you sure you can tell the difference between a small llama3 8b or a fast gemini?
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#15That's not my experience at all.
I was using Claude Opus to code before and now I'm back to ChatGPT. GPT-4o is faster, doesn't generate placeholders and works way better for me because of the larger context.
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#16In my experience GPT-4o is better in coding. I tested it with old C and Go. Both gave me better results.
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#17I find 4o better than 4 in my experiences. Mostly doing code generation/correction in Python/JS, and asking science, business, finance, management, and other non-creative questions.
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#18No issues so far. Quality seems to be similar as 4 but way faster
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#19Half say 4o is better, others say it's worse. I'd wager it's probably about as good as 4T on average then.
Re: Ask HN: Is GPT-4o overall worse than GPT-4 for you?
#20It's worse.