Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

news.ycombinator.com

Post reply on HN
Print view View original

361–370 of 817 posts

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#361

Post by workaccount23 »

Spivak wrote: post #339
LoganDark wrote: post #298

Earlier quoted context omitted.

> I personally don't get offended by words, but I guess if you are born after the 2000's perhaps you should avoid it. Ouch

Which is just a way of saying he not part of any of the demographics where going to 4chan to see people froth at the mouth dehumanizing and belittling people like you is self-harm. Wow an edgy white man not offended at seeing racism and transphobia, so brave.

shoutout mentaloutlaw, the best /g/ poster https://www.youtube.com/@MentalOutlaw/videos

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#362

Post by nemo44x »

laratied wrote: post #210
opportune wrote: post #12

Is it consistently worse or just sometimes/often worse than before? Any extreme power users or GPT-whisperers here? If it’s only noticeably worse X% of the time my bet would be experimentation. One of my least favorite patterns that tech companies do is use “Experimentation” overzealously or prematurely. Mainly, my problem is they’re not transparent about it, and it creates an inconsistent product experience that jus…

It is not worse for me. I do notice the novelty has worn off. Asking chatGPT4 about why people would think this on here I think it nails it with the novelty effect lol: "Indeed, the performance of an AI model like ChatGPT doesn't deteriorate over time. However, human perception of its performance can change due to a variety of psychological factors: Expectation Bias: As users become more familiar with AI capabilities…

These are my thoughts too. As I’ve used it more I’ve begun to scrutinize it more and I have a larger and larger history of when it doesn’t work like magic. Although it works like magic often as well.

We’ve also had time to find its limits and verify of falsify early assumptions, which were very likely positive.

The hype cycle is real.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#363

Post by londons_explore »

velox_neb wrote: post #328
londons_explore wrote: post #203

You can still run the original gpt-4-0314 model (March 14th) on the API playground: https://platform.openai.com/playground?mode=chat&model=gpt-4... Costs $0.12 per thousand tokens (~words), and I find even fairly heavy use rarely exceeds a dollar a day.

I get "The model: `gpt-4-0314` does not exist".

You probably don't have access. I'm not sure what the exact access requirements are - I think you either have to be a GPT Plus subscriber, have contributed code to an OpenAI repo on github, or be on one of their lists of researchers.

Try gpt-3.5-turbo-0301 - I think everyone has access to that.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#365

Post by ithkuil »

brookst wrote: post #318
hanselot wrote: post #279

Earlier quoted context omitted.

How is racism different from stereotype? How is stereotype different from pattern recognition? These questions don't seem to go through the minds of people when developing "unbiased/impartial" technology. There is no such thing as objective. So, why pretend to be objective and unbiased, when we all know its a lie? Worst, if you pretend to be objective but aren't, then you are actually racist.

I’m tired of the “it’s not racist if aggregate statistics support my racism” thing. Racism, like other isms, means a belief that a person’s characteristics define their identity. It doesn’t matter if confounding factors mean that you can show that people of their race are associated with bad behaviors or low scores or whatever. I used GPT3.5 to generate 100 short descriptions of families for a project. Every single o…

> No amount of “bias = pattern recognition” nonsense can justify a system that has (had? this was a while ago and I have not retested) such extreme biases

One possible explanation is that when you ask for 100 example families the task is parsed as "pick the most likely family composition and add a bit of randomness" and "repeat the aforementioned task" 100 times.

If phrased like that it would be surprising to find one single example of a family a single dad or with two moms. Sure these things do happen but they are not the most likely family composition by all means.

So what you want is not just the model to include an unbiased sample generator, but you also want it to understand ambiguous task assignments / questions well enough to choose the right sampling mechanism to choose. That's doable but it's hard.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#367

Post by local_crmdgeon »

technics256 wrote: post #269
scottfr wrote: post #134

Earlier quoted context omitted.

The Bard model (Bison) is available without region lock as part of Google Cloud Platform. In addition to being able to call it via an API, they have a similar developer UI to the OpenAI playground to interactively experiment with it. https://console.cloud.google.com/vertex-ai/generative/langua...

it's also really, really bad and fails compared to even open source models right now.

God, what happened to Google. What a fall from grace.

Alpaca is pretty good though.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#368

Post by SamoyedFurFluff »

Levitz wrote: post #354
Spivak wrote: post #339

Earlier quoted context omitted.

Which is just a way of saying he not part of any of the demographics where going to 4chan to see people froth at the mouth dehumanizing and belittling people like you is self-harm. Wow an edgy white man not offended at seeing racism and transphobia, so brave.

No, not at all. I've received more slurs than you can imagine for being Spanish. I just don't care. Sorry if it comes as blunt but I find no better way of saying it, you just don't understand the culture of the site, which is meant to filter people like you. They are just words on a screen from an anonymous person somewhere. Easily thrown, easily dismissed. It makes no sense to be offended because some guy I don't kn…

I’m actually unsure, hasn’t 4chan been involved in some seriously heinous shit, way more than words on a screen? I remember when “mods asleep post child porn” was a running joke. I feel that normalizing stuff like child porn as jokes is more than “words on a screen”; you have to re-learn how to engage with people outside of such a community because of its behavior.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#369

Post by robnado »

formerly_proven wrote: post #353
bob1029 wrote: post #266

OpenAI's models feel 100% nerfed to me at this point. I had it solving incredibly complex problems a few months ago (i.e. write a minimal PDF parser example), but today you will get scolded for asking such a complicated task of it. I think they programmed a classifier layer to detect certain coding tasks and shut it down with canned BS. I like to imagine certain billion/trillion-dollar mega corps had a back-room say…

> Microsoft is a big stakeholder and they might not want to get sued... Liability could explain a lot of it. Microsoft is also responsible for Copilot (based around a “it’s unconditionally fair use if you use a mirror” legal theory) so this doesn’t track.

Perhaps Microsoft would rather you pay for both ChatGPT and Copilot.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#370

Post by Spivak »

Levitz wrote: post #354
Spivak wrote: post #339

Earlier quoted context omitted.

Which is just a way of saying he not part of any of the demographics where going to 4chan to see people froth at the mouth dehumanizing and belittling people like you is self-harm. Wow an edgy white man not offended at seeing racism and transphobia, so brave.

No, not at all. I've received more slurs than you can imagine for being Spanish. I just don't care. Sorry if it comes as blunt but I find no better way of saying it, you just don't understand the culture of the site, which is meant to filter people like you. They are just words on a screen from an anonymous person somewhere. Easily thrown, easily dismissed. It makes no sense to be offended because some guy I don't kn…

But that's the thing, I do understand the culture. I spent the better part of my teens browsing and shitposting with the best of them. It just gets exhausting and stops being words on a screen when the hate you see there is reflected in the real world.

It seems on the surface that you are all there as equals bashing one another but that's not exactly true, there's a hierarchy you find out the moment you say something actually cutting about white guys and you experience the fury of a 1000 sons.

Post reply on HN