Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

news.ycombinator.com

Post reply on HN
Print view View original

51–60 of 817 posts

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#51

Post by AndyNemmity »

okdood64 wrote: post #35
bbotond wrote: post #14

Yes. Before the update, when its avatar was still black, it solved pretty complex coding problems effortlessly and gave very nuanced, thoughtful answers to non-programming questions. Now it struggles with just changing two lines in a 10-line block of CSS and printing this modified 10-line block again. Some lines are missing, others are completely different for no reason. I'm sure scaling the model is hard, but they l…

Try out Bard, it's coding is much improved in the last 2 weeks. I've unfortunately switched over for the time being.

I just tried Bard based on this comment, and it's really, really bad.

Can you please help me with how you are prompting it?

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#52

Post by joegibbs »

bitcurious wrote: post #16

For a while, if you asked the iPhone version what it was it claimed to be GPT3.0. Not sure if it still is that, but I noticed the iPhone version was a bit worse. Maybe they rolled that out more broadly?

That would have to be a bug - GPT3 was terrible in comparison even to 3.5. It would definitely be very noticeable if it was.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#53

Post by lynx23 »

Let me guess: the "woke fine-tuning" deteriorates quality of the model. Seriously, this lecturing style of GPT is totally useless. You ask it something vaguely unwoke, it lectures you about your style, you explain what it didn't understand about your request, it appologizes and does vaguely what you originally requested. This sort of deture is totally useless and a waste of my time.

To stay with the terminology, if I had an assistant that went out of their way to tell me the supposed errors of my way, I'd fire that person and get a new one. Same for GPTs: Once there is a good-quality non-woke GPT instance anywhere, I will cancel my OpenAI account immediately and move.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#54

Post by Vanit »

lynx23 wrote: post #53

Let me guess: the "woke fine-tuning" deteriorates quality of the model. Seriously, this lecturing style of GPT is totally useless. You ask it something vaguely unwoke, it lectures you about your style, you explain what it didn't understand about your request, it appologizes and does vaguely what you originally requested. This sort of deture is totally useless and a waste of my time. To stay with the terminology, if I…

Genuinely asking, what's an "unwoke" prompt?

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#55

Post by lynx23 »

Vanit wrote: post #54
lynx23 wrote: post #53

Let me guess: the "woke fine-tuning" deteriorates quality of the model. Seriously, this lecturing style of GPT is totally useless. You ask it something vaguely unwoke, it lectures you about your style, you explain what it didn't understand about your request, it appologizes and does vaguely what you originally requested. This sort of deture is totally useless and a waste of my time. To stay with the terminology, if I…

Genuinely asking, what's an "unwoke" prompt?

Something that follows my actual requests, without trying to lecture me about feminism and other U.S. Democrats topics.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#56

Post by bbotond »

corgihamlet wrote: post #48
sintezcs wrote: post #45

Earlier quoted context omitted.

Same for me, I’m in Estonia :(

You can use a VPN to use an American connection, it doesn't matter where your Google account is registered.

Thanks, I’ll try it! (I’m in Hungary)

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#57

Post by qwepjn2oi3j »

okdood64 wrote: post #35
bbotond wrote: post #14

Yes. Before the update, when its avatar was still black, it solved pretty complex coding problems effortlessly and gave very nuanced, thoughtful answers to non-programming questions. Now it struggles with just changing two lines in a 10-line block of CSS and printing this modified 10-line block again. Some lines are missing, others are completely different for no reason. I'm sure scaling the model is hard, but they l…

Try out Bard, it's coding is much improved in the last 2 weeks. I've unfortunately switched over for the time being.

No thanks! I have better things to do than feeding that advertising behemoth. What I like about ChatGPT is that I don't see any ads at all!

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#58

Post by bugglebeetle »

tmikaeld wrote: post #25

There's no doubt that it's gotten a lot worse on coding, I've been using this benchmark on each new version of GPT-4 "Write a tiptap extension that toggles classes" and so far it's gotten it right every time, but not any more, now it hallucinates a simplified solution that don't even use the tiptap api any more. It's also 200% more verbose in explaining it's reasoning, even if that reasoning makes no sense whatsoever…

It was a great ride while it lasted. My assumption is that efficacy at coding tasks is such a small percent of users, they’ve just sacrificed it on the altar of efficiency and/or scale. That, or they’ve cut some back room deal with Microsoft to make Copilot have access to the only version of the model that can actually code.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#59

Post by courseofaction »

kleene_op wrote: post #49

This is the normal workflow for drug dealers too. The first fix is free. The second one will cost you money. The third one will be laced with fillers and have degraded quality.

the fourth one will refer you to their sponsors

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#60

Post by anovikov »

Naturally, people feed it shit in order to bend results for others for their gain. Everyone who was in crypto manipulations, now rushed in this field, and they are extremely smart and extremely ruthless people, and they have no legal limits being anonymous, and almost unlimited funding they made in crypto. It reduces results quality, and also invokes countermeasures on their side to limit damage, that further reduces quality. Same road as Google has taken, remember how it was an almost magic tool that could find an answer to any question, 15 years ago, before SEO became a thing that promised easy money to anyone smartass enough.
Post reply on HN