Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

news.ycombinator.com

Post reply on HN
Print view View original

221–230 of 817 posts

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#221

Post by Terretta »

killingtime74 wrote: post #24
i_dont_know_ wrote: post #18

To me, it feels like it's started giving superficial responses and encouraging follow-up elsewhere -- I wouldn't be surprized if its prompt has changed to something to that effect. Before, if I had an issue with a library or debugging issue, it would try to be helpful and walk me through potential issues, and ask me to 'let it know' if it worked or not. Now it will try to superficially diagnose the problem and then a…

I assume you're talking about ChatGPT and not GPT-4? You can craft your own prompt when calling GPT4 over API. Don't blame you though, the OP is also not clear if they are comparing Chat GPT powered by GPT3.5 or 4, or the models themselves.

When using it all day every day it seems (anecdotally) the API version has changed too.

I work with temperature 0 which should have low variability yet recently it shifted to feel boring, wooden, and deflective.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#222

Post by krajzeg »

Do we have a good, objective benchmark set of prompts in existence somewhere? If not, I think having one would really help with tracking changes like that.

I'm always skeptical of subjective feelings of tough-to-quantify things getting worse or better, especially where there is as much hype as for the various AI models.

One explanation for the feelings is the model really getting significantly worse over time. Another is the hype wearing off as you get more used to the shiny new thing and become more critical of its shortcomings.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#225

Post by alibarber »

simse wrote: post #103
EForEndeavour wrote: post #86

Earlier quoted context omitted.

What law prohibits Google from making Bard available outside the USA?

It's blocked in the EU because they don't want to/can't comply with GDPR.

Do you have a source on this? Given that the UK has retained the EU GDPR as law[1] - I don't really understand why they would make it available in the UK and not the EU, seeing as they would have to comply with the same law.

[1] - https://ico.org.uk/for-organisations/data-protection-and-the...

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#226

Post by pverghese »

sumedh wrote: post #180
scottfr wrote: post #134

Earlier quoted context omitted.

The Bard model (Bison) is available without region lock as part of Google Cloud Platform. In addition to being able to call it via an API, they have a similar developer UI to the OpenAI playground to interactively experiment with it. https://console.cloud.google.com/vertex-ai/generative/langua...

Is that free or do you have to pay? Also do you need to change the options like Token Limit etc?

It's completely free. No tokens nothing.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#227

Post by nailer »

dang: a heads up that phind.com is running an Astroturf campaign on Hacker News. They had a previous article with a huge amount of suspicious behaviour last week. https://news.ycombinator.com/item?id=36027302

This is why the headline for this article says GPT4 but the body is focused on mentioning phind.com.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#228

Post by pverghese »

AndyNemmity wrote: post #51
okdood64 wrote: post #35

Earlier quoted context omitted.

Try out Bard, it's coding is much improved in the last 2 weeks. I've unfortunately switched over for the time being.

I just tried Bard based on this comment, and it's really, really bad. Can you please help me with how you are prompting it?

Don't know what you are doing? But Bard is so much faster than openai and its answers are clearer and more succint.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#229

Post by jonathan-kosgei »

I actually considered starting a similar thread because I noticed this as well! Lately, it feels like GPT-4 is trying to get out of doing my work for me :D.

I've also started to notice it's been making a lot of typos eg. yesterday while converting Kelvin to Celsius, it incorrectly stated that 0C is -274.15K, despite correctly stating in the previous sentence the correct value of -273.15K.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#230

Post by 300bps »

AndyNemmity wrote: post #51
okdood64 wrote: post #35

Earlier quoted context omitted.

Try out Bard, it's coding is much improved in the last 2 weeks. I've unfortunately switched over for the time being.

I just tried Bard based on this comment, and it's really, really bad. Can you please help me with how you are prompting it?

I’ve been seeing similar comments about Bard all over Twitter and social media.

My testing agrees with yours. Almost seems like a sponsored marketing campaign with no truth to it.

Post reply on HN