GTP Blind Voting: GPT-5 vs. 4o • Hacker News Board

Re: GTP Blind Voting: GPT-5 vs. 4o

#51

Post by swagmoney1606 » Sun, Aug 10, 2025, 5:45 PM UTC

energy123 wrote: post #22

mrtksn wrote: post #10

My understanding was that with GPT-5 you don't actually get the high quality stuff unless the system decides that you need it. So, for simple questions you end up getting the subpar response. A bit like not getting hot water until you increase the flow enough to trigger the boiler to start the heating. Lately I enjoy Grok the most for simple questions, even if it isn't necessarily about a recent event. Then I like Op…

I'm back on ChatGPT today. The UI is so fast. I didn't realize how the buggy and slow Gemini UI was contributing to my stress levels. AIStudio is also quite slow compared to the ChatGPT app. Is it that hard to make it so that when you paste text into a box and press enter, your computer doesn't slow down and get noisy? Is it really that difficult of an engineering problem?

I HATE how you can't re-write a previous response in gemini, only the most recent response.

Re: GTP Blind Voting: GPT-5 vs. 4o

#52

Post by afro88 » Mon, Aug 11, 2025, 9:49 AM UTC

the_mitsuhiko wrote: post #32

afro88 wrote: post #27

Does anyone ever get answers this short? What's the system prompt here? That may bias things a little. Also it's GPT not GTP

> Does anyone ever get answers this short? If you converse with it, yes > What's the system prompt here? You don't need a specific one. If you talk to it, it turns into that.

First question: https://chatgpt.com/s/t_6899bc7881e88191bb3d2146eac718d7

If you meant, after you converse with it for a while: what was the conversation leading up to this point?

Re: GTP Blind Voting: GPT-5 vs. 4o

#53

Post by the_mitsuhiko » Mon, Aug 11, 2025, 10:45 AM UTC

afro88 wrote: post #52

the_mitsuhiko wrote: post #32

Earlier quoted context omitted.

> Does anyone ever get answers this short? If you converse with it, yes > What's the system prompt here? You don't need a specific one. If you talk to it, it turns into that.

First question: https://chatgpt.com/s/t_6899bc7881e88191bb3d2146eac718d7 If you meant, after you converse with it for a while: what was the conversation leading up to this point?

I cannot access your link so I have no idea what this points into.

> If you meant, after you converse with it for a while: what was the conversation leading up to this point?

If you have a conversational style with chatgpt you end up with much shorter back and forths (at least on o4) than you do if you give it a long prompt.

Re: GTP Blind Voting: GPT-5 vs. 4o

#54

Post by wrcwill » Mon, Aug 11, 2025, 6:25 PM UTC

energy123 wrote: post #36

wrcwill wrote: post #33

Earlier quoted context omitted.

definitely 1! it seems to truncate your prompt even under the "maximum message length" and yeah around 55k is where it starts to happen. extremely annoying. o1 pro worked up until 115k or so. both o3 and gpt5 have the issue. (it happens on all models for me not just the pro variations) with the new 400k context length in api i would expect atleast 128k message lengths and maybe 200k context in chat.

Do you have a workaround? I'm putting the highest quality context into the 50k tokens, and attaching the rest for RAG. But maybe there is a better way.

i split the context and give it in two messages :/