Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

news.ycombinator.com

Post reply on HN
Print view View original

511–520 of 817 posts

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#511

Post by hersko »

Hitton wrote: post #433
lovich wrote: post #387

Earlier quoted context omitted.

Well, you certainly have the personality type I’d expect from someone who frequents 4chan Edit:oof, checked his profile like he suggested and in just two pages of history he’s engaged in climate change denial and covid vaccine conspiracies. Buddy, I don’t think using 4chan to “train my brain’s spam filter” is working too well for you. You’ve got a mind so open your brain fell out.

Going through someone's comment history to find reason to engage in ad hominem attacks is exactly the type of personality of someone who I expect to frequent Reddit and reason why I switched to HN. Sadly, it appears that this malaise reached here as well.

He literally said to check his history...

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#512

Post by shantnutiwari »

cowpig wrote: post #334
windex wrote: post #160

This is why having opensourced models is important. This is also why a lot of the lobbying around wanting regulation is happening. Imagine this, the plebs get the neutered AI, the people at the top get raw Open AI GPT4+

I'm so tired of this "regulations bad" trope. Most of the time, regulations do good. When I was young the Hudson River was a toxic cesspool of chemical filth. Now the river is slowly becoming a habitat again. The EPA does a whole lot of good. If you're afraid of Microsoft reaching its tendrils into OpenAI and corrupting its original purpose, as you probably should be, then maybe you should consider supporting regulat…

>>I'm so tired of this "regulations bad" trope.

Yeah. Back in India, around 20 years ago, a factory owner near my house used to keep weak hyrdochloric acid in the fridge with water bottles. To save money, he would use... you guessed it, old water bottles (since the acid was very diluted).

Guess what happened one day when a worker confused the 2?

The owner son boasted to me how his father had paid the medical expenses of the worker, how nice he was etc etc.

And today I think, what would have happened if this had happened in the US/UK? The business owner would no longer be in business.

There is a reason these regulations are so hard ass; because they've had to cope with shit like this. Now sure, sometimes the regulations go overboard and end up harming the industry, but thats not an argument for "Muh, regulations bad ".

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#513

Post by kokanee »

Xeoncross wrote: post #444
loudmax wrote: post #374

Earlier quoted context omitted.

I tend to be sympathetic to arguments in favor of openly accessible AI, but we shouldn't dismiss concerns about unaligned AI as frivolous. Widespread unfiltered accessibility to "unaligned" AI means that suicidal sociopaths will be able to get extremely well informed, intelligent directions on how to kill as many people as possible. It may be that the best defense against these terrorists is openly accessible AI givi…

> suicidal sociopaths will be able to get extremely well informed, intelligent directions on how to kill as many people as possible Citizens killing other citizens is the least of humanities issues. It's the governments who are the suicidal sociopaths historically who can get the un-nerfed version that is the bigger issue. Over a billion people murdered by governments/factions and their wars in the last 120 years alo…

Governments are composed of citizens; this is the same problem at a different scale. The point remains that racing to stand up an open source uncensored version of GPT-4 is a dangerous proposition.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#514

Post by minihat »

pverghese wrote: post #228
AndyNemmity wrote: post #51

Earlier quoted context omitted.

I just tried Bard based on this comment, and it's really, really bad. Can you please help me with how you are prompting it?

Don't know what you are doing? But Bard is so much faster than openai and its answers are clearer and more succint.

This is just... false. Bard is not just a little worse than gpt-4 for coding, it's more like several orders of magnitude worse. I can't imagine how you are getting superior outputs from Bard.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#515

Post by twobitshifter »

kypro wrote: post #154

The researchers who worked on the "sparks of AGI" paper noted that the more OpenAI worked on aligning GPT-4 the less competent it became. I'm guessing that trend is continuing...

That's what my gut says. Making something dynamic and alive is counter to imposing specific constraints on outputs. They're asking the ai to do its own self censoring, which in general is anti-productive even for people.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#516

Post by tomp »

mrtranscendence wrote: post #455
local_crmdgeon wrote: post #357

Earlier quoted context omitted.

[flagged]

Caucasian men (in the US) are on average are both taller and heavier than black men

Why would averages matter when talking about extreme outliers?

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#517

Post by aws_ls »

PeterStuer wrote: post #91
bevenky wrote: post #84

Earlier quoted context omitted.

I have some first hand thoughts. I think overall the quality is significantly poorer on GPT4 with plugins and bing browsing enabled. If you disable those, I am able to get the same quality as before. The outputs are dramatically different. Would love to hear what everyone else sees when they try the same.

No, while I have no hard data, the experienced quality of the default GPT-4 model feels like it has gone down tremendously for me as well. Plugins and Bing browsing have so far for me almost never worked at all. I retry these just once a week but there always seem to be technical issues.

Same for me. Kayak and BizToc plugin never work. One 'Ambition' plugin I tried, worked.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#518

Post by bee_rider »

hanselot wrote: post #325
brookst wrote: post #318

Earlier quoted context omitted.

I’m tired of the “it’s not racist if aggregate statistics support my racism” thing. Racism, like other isms, means a belief that a person’s characteristics define their identity. It doesn’t matter if confounding factors mean that you can show that people of their race are associated with bad behaviors or low scores or whatever. I used GPT3.5 to generate 100 short descriptions of families for a project. Every single o…

>I used GPT3.5 to generate 100 short descriptions of families for a project. Every single one, without exception, was a straight couple with two to four kids. Ok, statistically unlikely, but not wildly so, right? Well, did any of your 100 examples specify these families should be representative of American modern society? I don't want to alarm you, but America is not the only country generating data. Included in coun…

Is there a country where around 35% of the married women are nurses?

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#519

Post by code_lettuce »

What are some examples of a nerfed response? I just asked Gpt4 to help me write a python program to analyze the sentiment and determine if biases are present in mathematical research papers in a PDF format.

Sure, it needs some love and there were some abstractions. For instance it assumed we had a labeled dataset for the text and the associated sentiment, but beyond that it worked fine.

Post reply on HN