Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

news.ycombinator.com

Post reply on HN
Print view View original

331–340 of 817 posts

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#331

Post by fnordpiglet »

bbotond wrote: post #14

Yes. Before the update, when its avatar was still black, it solved pretty complex coding problems effortlessly and gave very nuanced, thoughtful answers to non-programming questions. Now it struggles with just changing two lines in a 10-line block of CSS and printing this modified 10-line block again. Some lines are missing, others are completely different for no reason. I'm sure scaling the model is hard, but they l…

This is for your protection from an extinction level event. Without nerfing the current model they couldn’t charge enterprise level fee structures for access to the superior models, thus ensuring the children are safe from scary AI. Tell your congress person we need to grant Microsoft and Google exclusive monopolies on AI research to protect us from open source and competitor AI models that might erode their margins and lead to the death of all life without their corporate stewardship. Click accept for your safety.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#333

Post by taf2 »

bob1029 wrote: post #266

OpenAI's models feel 100% nerfed to me at this point. I had it solving incredibly complex problems a few months ago (i.e. write a minimal PDF parser example), but today you will get scolded for asking such a complicated task of it. I think they programmed a classifier layer to detect certain coding tasks and shut it down with canned BS. I like to imagine certain billion/trillion-dollar mega corps had a back-room say…

Do you think a lot of that is scaling pain... like what if they're making cuts to the more expensive reasoning layers to gain more scale. Seems more plausible to me that the teams keeping the lights on have been doing optimization work to save cost and improve speed. The result during those optimizations might not be immediately obvious to the team and then they push deploy and only through anecdotal evidence such as yours can they determine the result of their clever optimization resulted in a deteriorated user experience... I mean think about doing a UI update that improves site performance but has the side effect of making the site appear to load slower because the transition effects are removed... Just my 2 cents trying to think more like their are humans supporting that thing that grew at a crazy speed to 100 million users.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#334

Post by cowpig »

windex wrote: post #160

This is why having opensourced models is important. This is also why a lot of the lobbying around wanting regulation is happening. Imagine this, the plebs get the neutered AI, the people at the top get raw Open AI GPT4+

I'm so tired of this "regulations bad" trope.

Most of the time, regulations do good. When I was young the Hudson River was a toxic cesspool of chemical filth. Now the river is slowly becoming a habitat again. The EPA does a whole lot of good.

If you're afraid of Microsoft reaching its tendrils into OpenAI and corrupting its original purpose, as you probably should be, then maybe you should consider supporting regulations that democratize access to models, for example.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#335

Post by brookst »

hanselot wrote: post #325
brookst wrote: post #318

Earlier quoted context omitted.

I’m tired of the “it’s not racist if aggregate statistics support my racism” thing. Racism, like other isms, means a belief that a person’s characteristics define their identity. It doesn’t matter if confounding factors mean that you can show that people of their race are associated with bad behaviors or low scores or whatever. I used GPT3.5 to generate 100 short descriptions of families for a project. Every single o…

>I used GPT3.5 to generate 100 short descriptions of families for a project. Every single one, without exception, was a straight couple with two to four kids. Ok, statistically unlikely, but not wildly so, right? Well, did any of your 100 examples specify these families should be representative of American modern society? I don't want to alarm you, but America is not the only country generating data. Included in coun…

I’d reply in depth but I’m hung up on your suggestion that there was any time anywhere where 100% of families were two parents and two to four kids.

Any data for that? No women dead in childbirth, no large numbers of children for social / economic / religious reasons, no married but waiting for kids, no variation whatsoever?

I’d be very surprised if you could find one time period for one society that was so uniform, let alone any evidence that this was somehow universal until recently.

You claim to value facts above all else, but this sure looks like a fabricated claim.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#336

Post by JimtheCoder »

ipaddr wrote: post #317
simse wrote: post #103

Earlier quoted context omitted.

It's blocked in the EU because they don't want to/can't comply with GDPR.

What's the excuse for Canada being omitted

We're small and no one cares about us...

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#338

Post by askin4it »

Loocid wrote: post #258
lynx23 wrote: post #131

Earlier quoted context omitted.

Explaining it to you will not fix my problems with OpenAI's instance. Let it suffice that I am a user of ChatGPT who really dislikes the lecturing style of woke-fine-tuning. If a human would lecture me in that style, I'd dumb them and avoid contact.

Why not share you gripes with the system so they get more exposure? I'm curious to know the pitfalls.

NMJ

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#339

Post by Spivak »

LoganDark wrote: post #298
hanselot wrote: post #296

Earlier quoted context omitted.

[flagged]

> I personally don't get offended by words, but I guess if you are born after the 2000's perhaps you should avoid it. Ouch

Which is just a way of saying he not part of any of the demographics where going to 4chan to see people froth at the mouth dehumanizing and belittling people like you is self-harm.

Wow an edgy white man not offended at seeing racism and transphobia, so brave.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#340

Post by sclarisse »

krapp wrote: post #300
arthurofbabylon wrote: post #289

Reading the comments in this thread, with the rightful distrust of OpenAI and criticism of the model, it occurs to me that the underlying problem we’re facing here comes down to stakeholders and incentive structures. Ai will not be a technical problem (nor a solution!), rather our civilization will continue to be bottlenecked by problems of culture. OpenAI will succeed/fail for cultural reasons, not technical ones. H…

> it occurs to me that the underlying problem we’re facing here comes down to stakeholders and incentive structures. >(...) our civilization will continue to be bottlenecked by problems of culture. OpenAI will succeed/fail for cultural reasons, not technical ones. Humanity will benefit from or be harmed by ai for cultural reasons, not technical ones. It's capitalism. You can say it, it's OK. Warren Buffet isn't going…

[flagged]
Post reply on HN