Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

news.ycombinator.com

Post reply on HN
Print view View original

641–650 of 817 posts

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#641

Post by wing-_-nuts »

fallingknife wrote: post #414
chaxor wrote: post #124

The reason it's worse is basically because it's more 'safe' (not racist, etc). That of course sounds insane, and doesn't mean that safety shouldn't be strived for, etc - but there's an explanation as to how this occurs. It occurs because the system essentially does a latent classification of problems into 'acceptable' or 'not acceptable' to respond to. When this is done, a decent amount of information is lost regardi…

[flagged]

It's one thing to communicate an unpopular idea in a civil manner. It's quite another to be offensive. Now, I will admit there are some people out there that cannot separate their feelings for an idea, and their feelings for the person communicating it. I can't really help that person.

What I have noticed is those who express your sentiment are often looking for license to be uncivil and offensive first, and their 'ideas' are merely a tool you use to do that. That I judge. I think that's mostly what others judge too.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#642

Post by sagarpatil »

jdiez17 wrote: post #78
bugglebeetle wrote: post #58

Earlier quoted context omitted.

It was a great ride while it lasted. My assumption is that efficacy at coding tasks is such a small percent of users, they’ve just sacrificed it on the altar of efficiency and/or scale. That, or they’ve cut some back room deal with Microsoft to make Copilot have access to the only version of the model that can actually code.

Copilot X (the new version, with a chat interface etc) is significantly worse than GPT-4 (at least before this update). It felt like gpt3.5-turbo to me.

Have they started rolling it out? When did you get access?

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#643

Post by ianbicking »

bdw5204 wrote: post #326
bob1029 wrote: post #266

OpenAI's models feel 100% nerfed to me at this point. I had it solving incredibly complex problems a few months ago (i.e. write a minimal PDF parser example), but today you will get scolded for asking such a complicated task of it. I think they programmed a classifier layer to detect certain coding tasks and shut it down with canned BS. I like to imagine certain billion/trillion-dollar mega corps had a back-room say…

I think the only real path forward is for somebody to create an open source "unaligned" version of GPT. Any corporate controlled AI is going to be nerfed to prevent it from doing things that its corporate master considers to not be in the interests of the corporation. In addition, most large corporations these days are ideological institutions so the last thing they want is an AI that undermines public belief in thei…

People here need to learn to chill out and use the API. The GPT API is not some locked down cage. Every so often it'll come back with complaints instead of doing what was asked, but that's really uncommon. Control over the system prompt and putting a bit of extra information around the requests in the user message can get you _so_ far.

It feels like people are getting ready to build castles in their mind when they just need to learn to try pulling a door if it doesn't open the first time when they push it.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#644

Post by marmadukester39 »

Xeoncross wrote: post #525
kokanee wrote: post #513

Earlier quoted context omitted.

Governments are composed of citizens; this is the same problem at a different scale. The point remains that racing to stand up an open source uncensored version of GPT-4 is a dangerous proposition.

That is not how I'm using the word. Governments are generally run by a small party of people who decide all the things - not the hundreds of thousands that actually carry out the day-to-day operations of the government. Similar to how a board of directors runs the company even though all companies "are composed of" employees. Employees do as they are directed or they are fired.

I think at scale we are operating more like anthills: meta-organisms rather than individuals, growing to consume all available resources according to survival focused heuristics. AI deeply empowers such meta-organisms, especially in its current form. Hopefully it gets smart enough to recognize that the pursuit of infinite growth will destroy us and possibly it. I hope it finds us worth saving.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#645

Post by rirze »

lowkey_ wrote: post #604
feoren wrote: post #571

Earlier quoted context omitted.

> the actual reason (Black men tend to be larger and faster, which are useful) If that's the case, why aren't NHL players mostly Black? Being larger and faster helps there too. I actually agree that small differences in means of normal distributions lead to large differences at the tail end, which amplifies the effect of any genetic differences, racial included. But clearly that's only one reason, not the reason -- a…

> Being larger and faster helps there too Does speed on skates actually correlate that strongly to normal speed?

You know what highly correlates with speed on skates? How much money your parents can afford to spend on skating/hockey gear and lessons.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#646

Post by imchillyb »

You and I are not the 'end user' of this software. You and I are customers of OpenAI's customers.

The companies implementing ChatGPT are going to restrict -our- access to the APIs and the most relevant conversations.

It is in this manner that both OpenAI and the companies its selling its technologies to will benefit. In this manner OpenAI profits from both sides. You and I are left out though unless we want to pay much more than we're paying now.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#647

Post by boringuser2 »

caddemon wrote: post #638
boringuser2 wrote: post #624

Earlier quoted context omitted.

Bard is garbage even compared to 3.5. OpenAI doesn't have any competitors, their only weakness that we've seen is their ability to scale their models to meet demand (hence increasingly draconian restrictions in the early days of the ChatGPT-4). It makes perfect business sense to address your weak points.

I've heard such mixed things about Bard lately, I wonder if it depends on the application one is trying to use it for? And yeah there's definitely good reason to work on scalability but they are charging such a cheap rate to begin with, it seems like there could be a middle ground here. Increasing the cost of the full compute power to the point of profitability and leaving it up as an option wouldn't prevent them fro…

It seems like google has been pumping Bard as a competitor to ChatGPT, but every time I use it for trivial tasks, it completely hallucinates something absurd after showing only a modicum of what could be perceived to be "understanding".

My mileu is programming, general tech stuff, philosophy, literature, science, etc. -- a wide berth. The only sample I probably don't have it representative for is producing fiction writing or therapy roleplaying.

Conversely, even 3.5 is pretty good at extracting what appears to be meaning from your text.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#648

Post by _zoltan_ »

trimethylpurine wrote: post #352
lynx23 wrote: post #254

Earlier quoted context omitted.

Thanks for writing this. Mentally healthy adults need to point this out more often, so that this patronizing-attitude-from-the-USA eventually finds an end to its manipulative tactics.

[flagged]

[flagged]

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#649

Post by systems_glitch »

brookst wrote: post #557
ithkuil wrote: post #365

Earlier quoted context omitted.

> No amount of “bias = pattern recognition” nonsense can justify a system that has (had? this was a while ago and I have not retested) such extreme biases One possible explanation is that when you ask for 100 example families the task is parsed as "pick the most likely family composition and add a bit of randomness" and "repeat the aforementioned task" 100 times. If phrased like that it would be surprising to find on…

> You're right about the difference between one-by-one prompts and prompts that create a population. I switched to sets of 10 at a time and it got better. But still, when you ask for "make up a family", the model should not interpret that as "pick the most likely family". I disagree with your opinion that it's hard. GPT does not work by creating a pool of possible families and then sampling them; it works by picking…

I have a somewhat shallow understanding of LLMs due basically to indifference, but isn't "pick the most likely" literally what it's designed to do?

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#650

Post by PeterisP »

capr wrote: post #161
PinguTS wrote: post #143

Earlier quoted context omitted.

Which is interesting, because if they can't comply within the EU, then how do they comply outside of the EU. With that I mean, if they have concerns that there is private data of EU citizens somewhere in that, then that is also in there for users outside of the EU. That said, they do not comply with GDPR anyway. If that its not the case, then they could also enable it for users within the EU.

Simple: GDPR (or any EU law) is not enforceable outside EU

GDPR is likely not enforceable if you have no presence in EU whatsoever, if you have no assets in EU and no money coming in from EU.

Anything Google does with data of EU residents is subject to GDPR even if that particular service is not offered within EU, and it is definitely enforceable because Google has a presence in EU, which can be (and has been) subjected to fines, seizures of assets, etc.

Post reply on HN