Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

news.ycombinator.com

Post reply on HN
Print view View original

421–430 of 817 posts

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#421

Post by [deleted] »

the_gipsy wrote: post #303
roenxi wrote: post #257

Earlier quoted context omitted.

They're up against a pretty difficult barrier - if we had a perfect all-knowing oracle it might easily have opinions that are racist. Statistics alone suggest there will be racist truths. We're dealing with groups of people who are observably different from each other in correlated ways. GPT would need to reach a convincing balance of lying and honesty if it is supposed to navigate that challenge. It'd have to be dee…

But the statistics here are "number of times it has been fed and positively trained with racist (or biased) texts" - not crunching any real numbers.

[deleted]

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#422

Post by Spooky23 »

bob1029 wrote: post #266

OpenAI's models feel 100% nerfed to me at this point. I had it solving incredibly complex problems a few months ago (i.e. write a minimal PDF parser example), but today you will get scolded for asking such a complicated task of it. I think they programmed a classifier layer to detect certain coding tasks and shut it down with canned BS. I like to imagine certain billion/trillion-dollar mega corps had a back-room say…

For coding I’ve had better luck with Bard. OpenAI doesn’t like me for some reason. My kid has no problem, but I was getting rate limited and error messages early on.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#423

Post by Spooky23 »

bandrami wrote: post #398
loudmax wrote: post #374

Earlier quoted context omitted.

I tend to be sympathetic to arguments in favor of openly accessible AI, but we shouldn't dismiss concerns about unaligned AI as frivolous. Widespread unfiltered accessibility to "unaligned" AI means that suicidal sociopaths will be able to get extremely well informed, intelligent directions on how to kill as many people as possible. It may be that the best defense against these terrorists is openly accessible AI givi…

> suicidal sociopaths will be able to get extremely well informed, intelligent directions on how to kill as many people as possible I mean, that was/is a worry about the Internet, too

Internet? Try the anarchists cookbook!

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#424

Post by sirsinsalot »

sangnoir wrote: post #107
sirsinsalot wrote: post #83

Given the incoming compute capability from nvidia and the speed of advancement, we have to stop and think ... does it make sense to give access, paid or otherwise, to these models once they reach a certain sophistication? Or does it make even more sense to hoard the capability to out compete any competitor, of any kind, commercially or politically and hide the true extent of your capability to avoid scrutiny and legi…

A more banal explanation is that compute is expensive, so they are tweaking the models to get more for less, and it isn't always working out. Scaling by itself is a hard problem, scaling and improving efficiency (margins) doubly so.

Scaling is hard for now.

I don't think current trends are necessarily related to my root comment, but it begged the question of if absolute secrecy of capability would be a good route forward.

A bit like Palantir

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#425

Post by sirsinsalot »

jonnycomputer wrote: post #253
throwaway290 wrote: post #126

Earlier quoted context omitted.

would be alarming if you had second hand thoughts...

I get mine third-hand or from the bargain-bin. Never over-pay for almost as good as new; like a car, used thoughts are just better price to value.

If something is well used and has not ended up in the bin, it is probably worth keeping...

... wasn't the best part of my wedding speech but I stand by it.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#426

Post by lovich »

malfist wrote: post #415
lovich wrote: post #387

Earlier quoted context omitted.

Well, you certainly have the personality type I’d expect from someone who frequents 4chan Edit:oof, checked his profile like he suggested and in just two pages of history he’s engaged in climate change denial and covid vaccine conspiracies. Buddy, I don’t think using 4chan to “train my brain’s spam filter” is working too well for you. You’ve got a mind so open your brain fell out.

I mean, he's literally saying the jews are responsible for bot farms and "offensive content". That's not the stance of someone rational.

Yea, good point. I had missed his line about “country bordering Palestine”. The quip about downvotes exciting him is telling as well.

Going against the common consensus can make you feel like you have hidden knowledge and you even could, but a certain type of personality gets addicted to that feeling and reflexively seeks to always go against any consensus, regardless of the facts

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#427

Post by fwungy »

I recently asked Bing chat to write a Rust function for me. It used to do that well.

This time it wrote the function. I could see it for a second, and then changed it to the message something like "I can't talk about this right now." I don't remember exactly, but the interesting thing was that it flashed an answer and then withdrew it.

Its Rust abilities seem to have deteriorated over the past couple weeks

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#428

Post by loudmax »

bandrami wrote: post #398
loudmax wrote: post #374

Earlier quoted context omitted.

I tend to be sympathetic to arguments in favor of openly accessible AI, but we shouldn't dismiss concerns about unaligned AI as frivolous. Widespread unfiltered accessibility to "unaligned" AI means that suicidal sociopaths will be able to get extremely well informed, intelligent directions on how to kill as many people as possible. It may be that the best defense against these terrorists is openly accessible AI givi…

> suicidal sociopaths will be able to get extremely well informed, intelligent directions on how to kill as many people as possible I mean, that was/is a worry about the Internet, too

Yes, and look at the extremism and social delusions and social networking addictions that have been exacerbated by the internet.

On balance, it's still positive that the internet exists and people have open access to communication. We shouldn't throw the baby out with the bathwater. But it's not an unalloyed good, we need to recognize that the technology brought some unexpected negative aspects came along with the overall positive benefit.

This also goes for, say, automobiles. It's a good thing that cars exist and middle class people can afford to own and drive them. But few people at the start of the 20th anticipated the downsides of air pollution, traffic congestion and un-walkable suburban sprawl. This doesn't mean we shouldn't have cars. It does mean we need to be cognizant of problems that arise.

So a world where regular people have access to AIs that are aligned to their own needs is better than a world in which all the AIs are aligned to the needs a few powerful corporations. But if you think there are no possible downsides to giving everyone access to superhuman intelligence without the wisdom to match, you're deluding yourself.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#429

Post by thegrimmest »

brookst wrote: post #318
hanselot wrote: post #279

Earlier quoted context omitted.

How is racism different from stereotype? How is stereotype different from pattern recognition? These questions don't seem to go through the minds of people when developing "unbiased/impartial" technology. There is no such thing as objective. So, why pretend to be objective and unbiased, when we all know its a lie? Worst, if you pretend to be objective but aren't, then you are actually racist.

I’m tired of the “it’s not racist if aggregate statistics support my racism” thing. Racism, like other isms, means a belief that a person’s characteristics define their identity. It doesn’t matter if confounding factors mean that you can show that people of their race are associated with bad behaviors or low scores or whatever. I used GPT3.5 to generate 100 short descriptions of families for a project. Every single o…

> a person’s characteristics define their identity

They do though. Your personality, culture and appearance are the main components of how people perceive you, your identity. The main thing you can associate with bad behaviour is domestic culture. It's not racist to say that African Americans have below-average educational attainment and above-average criminality. This is as contrasted to African immigrants to America who are quite opposite. These groups are equally "black". It therefore also isn't racist to pre-judge African Americans based on this information. I suspect most "racism" in the US is along these lines, and is correlated by the experience of my foreign-born black friends. They find that Americans who treated them with hostility do a 180 when they open their mouths and speak with a British or African accent. You also don't have to look far in the African immigrant community to find total hostility to American black culture.

> generate 100 short descriptions of families for a project

There's no reason this can't be interpreted as generating 100 variations of the mean family. Why do you think that every sample has to be implicitly representative of the US population?

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#430

Post by dasil003 »

bdw5204 wrote: post #326
bob1029 wrote: post #266

OpenAI's models feel 100% nerfed to me at this point. I had it solving incredibly complex problems a few months ago (i.e. write a minimal PDF parser example), but today you will get scolded for asking such a complicated task of it. I think they programmed a classifier layer to detect certain coding tasks and shut it down with canned BS. I like to imagine certain billion/trillion-dollar mega corps had a back-room say…

I think the only real path forward is for somebody to create an open source "unaligned" version of GPT. Any corporate controlled AI is going to be nerfed to prevent it from doing things that its corporate master considers to not be in the interests of the corporation. In addition, most large corporations these days are ideological institutions so the last thing they want is an AI that undermines public belief in thei…

Who has the necessary resources to run, let alone train the model?
Post reply on HN