Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

news.ycombinator.com

Post reply on HN
Print view View original

431–440 of 817 posts

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#431

Post by cma »

TeMPOraL wrote: post #121
bugglebeetle wrote: post #114

Earlier quoted context omitted.

I’ve seen degradation in the app and via the API, so if I had to bet, they’ve probably kneecapped the model so that it works passably everywhere they’ve been made it available vs. works well in one place or another.

Yes. I think 'sirsinsalot is likely right in suggesting[0] that they could be trying "to hoard the capability to out compete any competitor, of any kind, commercially or politically and hide the true extent of your capability to avoid scrutiny and legislation", and that they're currently "dialing back the public expectations", possibly while "deploying the capability in a novel way to exploit it as the largest lever"…

If it got faster at the same time it could just be bait and switch with a quantized/sparsified replacement.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#432

Post by reaperman »

malfist wrote: post #415
lovich wrote: post #387

Earlier quoted context omitted.

Well, you certainly have the personality type I’d expect from someone who frequents 4chan Edit:oof, checked his profile like he suggested and in just two pages of history he’s engaged in climate change denial and covid vaccine conspiracies. Buddy, I don’t think using 4chan to “train my brain’s spam filter” is working too well for you. You’ve got a mind so open your brain fell out.

I mean, he's literally saying the jews are responsible for bot farms and "offensive content". That's not the stance of someone rational.

There's a slight difference between "the jews" and "Israel". Obviously Israel would have some bot farms, though I don't think it's reasonable that they'd form the supermajority of bots on 4chan/etc.

Also I think it's extremely generous to give this fellow the benefit of the doubt on "the jews" vs. "Israel", but that is what HN guidelines generally suggest.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#433

Post by Hitton »

lovich wrote: post #387
hanselot wrote: post #296

Earlier quoted context omitted.

[flagged]

Well, you certainly have the personality type I’d expect from someone who frequents 4chan Edit:oof, checked his profile like he suggested and in just two pages of history he’s engaged in climate change denial and covid vaccine conspiracies. Buddy, I don’t think using 4chan to “train my brain’s spam filter” is working too well for you. You’ve got a mind so open your brain fell out.

Going through someone's comment history to find reason to engage in ad hominem attacks is exactly the type of personality of someone who I expect to frequent Reddit and reason why I switched to HN. Sadly, it appears that this malaise reached here as well.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#434

Post by hesdeadjim »

kypro wrote: post #154

The researchers who worked on the "sparks of AGI" paper noted that the more OpenAI worked on aligning GPT-4 the less competent it became. I'm guessing that trend is continuing...

Reminds me of Robocop 2 when he has a thousand prime directives installed and can’t do a damned thing after.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#435

Post by enumjorge »

chaxor wrote: post #124

The reason it's worse is basically because it's more 'safe' (not racist, etc). That of course sounds insane, and doesn't mean that safety shouldn't be strived for, etc - but there's an explanation as to how this occurs. It occurs because the system essentially does a latent classification of problems into 'acceptable' or 'not acceptable' to respond to. When this is done, a decent amount of information is lost regardi…

Do you have any sources for that?

How would making ChatGPT less likely to return a racist answer or hate speech affect its ability to return code? After a question has been classified into a coding problem, presumably ChatGPT servers could now continue to solve the problem as usual.

Maybe running ChatGPT is really expensive, and they nerfed in order to reign in costs. That would explain why the answers we get are less useful, across-the-board.

That may not be the reason after all, but my point is that it’s really hard to tell from the outside. There’s this narrative out there that “woke-ism” is ruining everything in tech, and I feel like some people here are being a little too eager to superimpose that narrative when we don’t really have insight into what openAI is doing.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#436

Post by bragr »

Spooky23 wrote: post #423
bandrami wrote: post #398

Earlier quoted context omitted.

> suicidal sociopaths will be able to get extremely well informed, intelligent directions on how to kill as many people as possible I mean, that was/is a worry about the Internet, too

Internet? Try the anarchists cookbook!

If you actually try the anarchists cookbook, you will find many of the recipes don't work or work that well.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#438

Post by Aerbil313 »

loudmax wrote: post #428
bandrami wrote: post #398

Earlier quoted context omitted.

> suicidal sociopaths will be able to get extremely well informed, intelligent directions on how to kill as many people as possible I mean, that was/is a worry about the Internet, too

Yes, and look at the extremism and social delusions and social networking addictions that have been exacerbated by the internet. On balance, it's still positive that the internet exists and people have open access to communication. We shouldn't throw the baby out with the bathwater. But it's not an unalloyed good, we need to recognize that the technology brought some unexpected negative aspects came along with the ov…

> This doesn't mean we shouldn't have cars.

Why though? I can't see how modern technology's impact on human life has been a net positive. See the book Technological Slavery: https://ia800300.us.archive.org/21/items/tk-Technological-Sl...

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#440

Post by xtracto »

dasil003 wrote: post #430
bdw5204 wrote: post #326

Earlier quoted context omitted.

I think the only real path forward is for somebody to create an open source "unaligned" version of GPT. Any corporate controlled AI is going to be nerfed to prevent it from doing things that its corporate master considers to not be in the interests of the corporation. In addition, most large corporations these days are ideological institutions so the last thing they want is an AI that undermines public belief in thei…

Who has the necessary resources to run, let alone train the model?

All of us together do.

I saw the nerfing of GPT in real time: one day it was giving me great book summaries, the next one it said that it couldn't do it due to copyright.

I actually called it in a comment several months ago: copyright and other forms of control would make GPT dumb in the long run. We need an open source frontier less version.

Post reply on HN