I have been using GPT-4 from release day. I haven't noticed performance degradation at all. YMMV.
Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
691–700 of 817 posts
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#692Earlier quoted context omitted.
I just tried Bard based on this comment, and it's really, really bad. Can you please help me with how you are prompting it?
If you have to worry about prompting, it already tells you everything one needs to know about how good the model is.
I don't think that's true at all. Think of it like setting up conversation constraints to reduce the potential pitfalls for a model. You can vastly improve the capability of just about any LLM I've used by being clear about what you specifically want considered, and what you don't want considered when solving a problem.
It'll take you much farther, by allowing you to incrementally solve your problem in smaller steps while giving the model the proper context required for each step of the problem-solving process, and limiting the things it must consider for each branch of your problem.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#693Earlier quoted context omitted.
I had a look at the YouTube video -- I feel that an obvious question with regards to the "common sense" tests is, what was chat GPT-4 trained on? Was it partly trained on reams of questions used to test AI systems for example? How do you know it is "demonstrating" anything out-of-sample, especially if it is constantly being improved? I've been learning some exotic programming languages recently, and my anecodotal exp…
> ChatGPT to code in array programming or logic languages results in code which is highly non-idiomatic for those paradigms. Why is that? Reason #1 is that those languages are unreadable line noise to humans too. Fundamentally, almost all of the code written in array languages is made purposefully obtuse. Single-letter identifiers, no or little comments, dense code with minimal structure, etc... Reason #2 is that the…
Its true for logic programming languages too (e.g. Prolog, Picat, Mercury, etc), so I do not think its to do with line noise languages per say nor a lack of examples (in the case of Prolog). It'll write it but it treats it like Python with funny syntax: not idiomatic. You can ask it to make it more concise or idiomatic but it just can't.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#694Earlier quoted context omitted.
Same here. If I have a choice between honesty and political correctness, I always pick honesty.
What makes you think the "unaligned" version necessarily has more honesty? Rather than just being generally easier to prompt to say whatever the user wants it to say, true or not, horrible or not? Or even easier to unintentionally make it confabulate/hallucinate stuff? Does not seem to follow, and does not seem to be a true dichotomy. Edginess does not equal honesty.
[deleted]
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#695Earlier quoted context omitted.
Prompt it to do so. Use a jailbreak prompt or use something like this: "Be succint but yet correct. Don't provide long disclaimers about anything, be it that you are a large language model, or that you don't have feelings, or that there is no simple answer, and so on. Just answer. I am going to handle your answer fine and take it with a grain of salt if neccessary." I have no idea whether this prompt helps because I…
It does work for the most part, but its ability to remember this "setting" is spotty, even within single chat.
The trick is, repeat the prompt, or just say "Stay in character! I deduced 10 tokens." See one transcript form someone else in this subthread.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#696Earlier quoted context omitted.
> ChatGPT to code in array programming or logic languages results in code which is highly non-idiomatic for those paradigms. Why is that? Reason #1 is that those languages are unreadable line noise to humans too. Fundamentally, almost all of the code written in array languages is made purposefully obtuse. Single-letter identifiers, no or little comments, dense code with minimal structure, etc... Reason #2 is that the…
Its true for logic programming languages too (e.g. Prolog, Picat, Mercury, etc), so I do not think its to do with line noise languages per say nor a lack of examples (in the case of Prolog). It'll write it but it treats it like Python with funny syntax: not idiomatic. You can ask it to make it more concise or idiomatic but it just can't.
I've heard of 1 of 3 of those languages, and I can program in over 20. That gives you an idea of how rare they must be!
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#697Earlier quoted context omitted.
> Yes, one of the board members of OpenAI, Will Hurd, is a former government agent. He worked for the Central Intelligence Agency (CIA) for nine years, from 2000 to 2009. His tour of duty included being an operations officer in Afghanistan, Pakistan, and India. After his service with the CIA, he served as the U.S. representative for Texas's 23rd congressional district from 2015 to 2021. Following his political career…
Yikes One is never former CIA, once you're in, you're in, even if you leave. Although he is a CompSci grad, he's also a far-right Republican. A spook who leans far right sitting atop OpenAI is worse than Orwell's worst nightmares coming to fruition.
Will Hurd is not close to "far right."
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#698Based on this following article and my experience, I think there is something here.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#699Earlier quoted context omitted.
Can you give us an example of something you'd consider to be a complicated problem? Certainly, you could look at PDF as a boring-ass "follow the spec" experience, and indeed - I think this is precisely why certain arbitrary limitations are in place now.
I honestly have no clue about what makes pdf parsing a complex task. I wasnt trying to sound condescending. Would be great to know what makes this so difficult, considering the pdf file format is ubiquitous.
TEXT ISNT STORED AS TEXT ITS STORED AS POSTSCRIPT PRINTING INSTRUCTIONS IIRC
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#700Earlier quoted context omitted.
How feasible would it be out crowdsource the training? I.e. thousands of individual macbooks training a small part of the model and contributing to the collective goal
I once used a crowdsourcing system called CrowdFlower for a pretty basic task, the results were pretty bad. Seems like with minimal oversight the human workers like to just say they did the requested task and make up an answer rather than actually do it (The task involved entering an address in Google maps, looking at the street view and confirming insofar as possible if a given business actually resided at the addre…
It seems only fair that the humans charged with doing the grunt work to build an automated fabulist would just make stuff up for training data.
Tit for tat and all that.