Earlier quoted context omitted.
[flagged]
Caucasian men (in the US) are on average are both taller and heavier than black men
Average people don't play in the NFL
Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
521–530 of 817 posts
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#522Earlier quoted context omitted.
I'd love to play with a version of GPT 4 fine-tuned with every science textbook written in the last few decades, every published science paper (not just preprints from ArXiV), and everything generated by every large research institute. Think NASA, CERN, etc... Or one tuned with every fiction novel ever written, along with every screenplay.
So a model fine-tuned on libgen?
Why not?
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#523OpenAI's models feel 100% nerfed to me at this point. I had it solving incredibly complex problems a few months ago (i.e. write a minimal PDF parser example), but today you will get scolded for asking such a complicated task of it. I think they programmed a classifier layer to detect certain coding tasks and shut it down with canned BS. I like to imagine certain billion/trillion-dollar mega corps had a back-room say…
> I like to imagine certain billion/trillion-dollar mega corps had a back-room say regarding things that they would really prefer OpenAI's models not be able to emit.
What a weird conspiracy theory.
Why would Microsoft have anything against your pdf-parser?
More likely it just costs them insane amounts of money running their most capable models, and therefore they're "nerfing" them to reduce costs .
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#524Earlier quoted context omitted.
I think a lot of people are unaware that these models have an enormous human training component performed through companies such as Amazon Mechanical Truk and dataannotation.tech. Called Human Intelligence Tasks, a large number of people have been working in this area for close to a decade. Dataannotation Tech claims to have over 100k workers. From Cloud Research, "How Many Amazon Mechanical Turk Workers Are There in…
Here's an account of a person in Africa that helped train (wading thru gnarly explicit content in the process): https://www.bigtechnology.com/p/he-helped-train-chatgpt-it-t...
This reads like lawsuit bait.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#525Earlier quoted context omitted.
> suicidal sociopaths will be able to get extremely well informed, intelligent directions on how to kill as many people as possible Citizens killing other citizens is the least of humanities issues. It's the governments who are the suicidal sociopaths historically who can get the un-nerfed version that is the bigger issue. Over a billion people murdered by governments/factions and their wars in the last 120 years alo…
Governments are composed of citizens; this is the same problem at a different scale. The point remains that racing to stand up an open source uncensored version of GPT-4 is a dangerous proposition.
That is not how I'm using the word. Governments are generally run by a small party of people who decide all the things - not the hundreds of thousands that actually carry out the day-to-day operations of the government.
Similar to how a board of directors runs the company even though all companies "are composed of" employees. Employees do as they are directed or they are fired.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#526I don't think it's any worse at all. I think what most people are expressing here is reaching the limits of the technology and realizing that it's not magic.
No, OpenAI 100% pushed an update recently that is very noticeable where they basically "nerfed" the responses. I'm sure it was a business decision (either costing them too much to give away the kitchen sink for free or they want to turn around and charge more for the "really good, old" version of GPT-4 ) but you can visually see where the bot used to try to answer complex tasks, now it has an extra layer where it say…
I guess you're entitled to an opinion. I've had the same (error-prone, often unhelpful) experience since gpt-4 was released. It's a little faster now which is nice.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#527Earlier quoted context omitted.
I just tried Bard based on this comment, and it's really, really bad. Can you please help me with how you are prompting it?
Don't know what you are doing? But Bard is so much faster than openai and its answers are clearer and more succint.
Can you give an example of a prompt and the output for each that you find Bard to be better for?
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#528OpenAI's models feel 100% nerfed to me at this point. I had it solving incredibly complex problems a few months ago (i.e. write a minimal PDF parser example), but today you will get scolded for asking such a complicated task of it. I think they programmed a classifier layer to detect certain coding tasks and shut it down with canned BS. I like to imagine certain billion/trillion-dollar mega corps had a back-room say…
> I like to imagine certain billion/trillion-dollar mega corps had a back-room say regarding things that they would really prefer OpenAI's models not be able to emit. What a weird conspiracy theory. Why would Microsoft have anything against your pdf-parser? More likely it just costs them insane amounts of money running their most capable models, and therefore they're "nerfing" them to reduce costs .
github copilot won't pay for itself.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#529Earlier quoted context omitted.
Caucasian men (in the US) are on average are both taller and heavier than black men
Why would averages matter when talking about extreme outliers?
I was responding to this:
> Black men tend to be larger and faster
Which I do not believe is true. As to whether it's reasonable to think that black men evolved to express greater physical prowess some very small proportion of the time, and whites did not, I can't say, though I doubt it enough I would expect the other party to give evidence for it.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#530What are some examples of a nerfed response? I just asked Gpt4 to help me write a python program to analyze the sentiment and determine if biases are present in mathematical research papers in a PDF format. Sure, it needs some love and there were some abstractions. For instance it assumed we had a labeled dataset for the text and the associated sentiment, but beyond that it worked fine.
You're doing trivial coding tasks with a known solution space.