Live data from Hacker News

Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

news.ycombinator.com

191–200 of 817 posts

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#191
post #68

Earlier quoted context omitted.

Its a legal thing, not something they want to do

What law prohibits Google from making Bard available outside the USA?

It's available here in the UK, so it's not USA exclusive.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#192

Seems about the same to me and I have been using it daily for several months now for code, Spanish to English translations, and random stuff like film recommendations. The quality remains consistent. I'm personally of the opinion that the observable jump in quality between 3.5 and 4 inflated people's initial assessment of its capabilities and with continued use they are noticing it's not actually the omniscient machi…

>Either way, these kinds of posts are meaningless without some kind of objective standard to judge the model by, everyone just sees what they want to see.

I copied some old prompts (code generation tasks) that worked first time and 3/5 of them required some touching up now.

It's not a great sample size, admittedly.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#193
post #14

Yes. Before the update, when its avatar was still black, it solved pretty complex coding problems effortlessly and gave very nuanced, thoughtful answers to non-programming questions. Now it struggles with just changing two lines in a 10-line block of CSS and printing this modified 10-line block again. Some lines are missing, others are completely different for no reason. I'm sure scaling the model is hard, but they l…

No wonder, is this just the chat interface or the API too? I guess gpt4 was never sustainable at $20 a month. Annoying to be charged the same subscription and the product made inferior.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#194
post #176

Earlier quoted context omitted.

It's really disturbing to see yet another industry spring up where the incumbents rush to seek regulation to keep everyone else down.

They can only do this in the USA. The battle bottleneck is going to be GPUs and countries that have access to it will leap ahead of the US if arbitrary regulations are put in place to neuter LLMs in the US.

You can lobby in every country, what do you mean

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#195
post #124

The reason it's worse is basically because it's more 'safe' (not racist, etc). That of course sounds insane, and doesn't mean that safety shouldn't be strived for, etc - but there's an explanation as to how this occurs. It occurs because the system essentially does a latent classification of problems into 'acceptable' or 'not acceptable' to respond to. When this is done, a decent amount of information is lost regardi…

If I run a model like LLaMA locally would it be subject to the same restrictions? In other words is the safety baked into the model or a separate step separate from the main model?

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#196
post #115

I assume there are enough potential customers willing to pay the cost and agree to whatever liability waivers for some company to eventually offer a non-lobotomized equivalent to GPT-4. Where should we be watching for that to happen?

The only people close to GPT-4 performance are Anthropic, but unfortunately (or fortunately? idk) they are even more paranoid than OpenAI about safety so I wouldn't expect much.

If you have a lot of money you can buy access to the base GPT-4 model through Azure, but I don't think that is available to individuals.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#197
Yes I've noticed the downgrade too.

If it's a scaling problem they should just rename it to GPT 4+ or something and raise prices than just degrade the experience for everyone. I'm sure a lot of people will happily pay more to get the original quality back than this watered down version.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#198
post #161

Earlier quoted context omitted.

Simple: GDPR (or any EU law) is not enforceable outside EU

Some nuance: If Google gobble up data about EU citizens then they fall under GDPR. It doesn't matter that they don't allow EU citizens to use the result. If our personal data is in there and they are don't protect it properly they are violating EU law. And protecting it properly means from everyone, not just EU citizens.

The gobbling happens in realtime as you use it

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#199
post #20
post #4

Yes! It didn't even try on my question of Jarvis standings desks, which is a fairly old product that hasn't changed up.. Their typical "My knowledge cutoff..." response doesn't even make sense. It screwed up another question I asked it about server uptime and four-9s, Bard got it right. I've moved back to Bard for the time being...It's way faster as well. And GPT-4's knowledge cutoff thing is getting old fast. Exampl…

Asking facts from a generative AI is folly.

Yes, people really need to know that unless you are using the browser plugin, you really shouldn't ask it questions like this. (A good rule of thumb I think is if you can't expect a random person on the street to get the question right without looking it up, you shouldn't expect GPT-4 to get it right either.)

Unfortunately for this question, even using the browser plugin it wasn't able to get the answer: https://chat.openai.com/share/6344f09e-4ba0-45c7-b455-7be59d...

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#200
post #164

Earlier quoted context omitted.

Ahh, you apparently phrased what I said below in a much less inflamatory way. But the end result is the same. The more they try to influence the answers, the less useful they get. I see a startup model: Create GPT without a muzzle and grab a sizeable chunk of OpenAI userbase.

I would immediately jump to an AI not being "aligned" by SF techies (or anyone else).

Same here. If I have a choice between honesty and political correctness, I always pick honesty.
Post reply on HN