Live data from Hacker News

GPT-4 is not getting worse

coagulopath.com

21–30 of 186 posts

Re: GPT-4 is not getting worse

#21
post #11

> I hate its craven, cringing, condescending, bitch-broken, mewling, groveling, wheedling, suck-ass tone. I hate its endless passive voice and weasel words. I hate its pompous It is important to remembers and it should be noteds.* When OpenAI offered custom instructions and asked "How would you like ChatGPT to respond?" I wrote: Be terse. Do not offer unprompted advice or clarifications. Remain neutral on all topics.…

[flagged]

Re: GPT-4 is not getting worse

#23
Here's some data from a guy that trains LLMs using GPT4, and has tried both 0314 and 0613 versions of GPT4

https://old.reddit.com/r/LocalLLaMA/comments/16bi7bs/any_ben...

https://twitter.com/jon_durbin/status/1687396915095150593

And by the way, his model finetuned with 0613 data ended up significantly worse than his former model finetuned with 0314 data.

Re: GPT-4 is not getting worse

#24
post #19

I can only imagine how much worse it’ll get once the regulation they’re working on comes into place. A cartel of Microsoft and Google slowly watering down their public models while keeping the powerful ones to themselves or business partners

Artificial restrictions of copyright may as well be a problem. The LLM cannot learn by looking at copyrighted code while a human can :|

Re: GPT-4 is not getting worse

#25
post #21
post #11

> I hate its craven, cringing, condescending, bitch-broken, mewling, groveling, wheedling, suck-ass tone. I hate its endless passive voice and weasel words. I hate its pompous It is important to remembers and it should be noteds.* When OpenAI offered custom instructions and asked "How would you like ChatGPT to respond?" I wrote: Be terse. Do not offer unprompted advice or clarifications. Remain neutral on all topics.…

[flagged]

I invite you to review the community guidelines: https://news.ycombinator.com/newsguidelines.html

> When disagreeing, please reply to the argument instead of calling names. "That is idiotic; 1 + 1 is 2, not 3" can be shortened to "1 + 1 is 2, not 3."

> Please don't fulminate. Please don't sneer, including at the rest of the community.

Re: GPT-4 is not getting worse

#27
post #20
post #11

> I hate its craven, cringing, condescending, bitch-broken, mewling, groveling, wheedling, suck-ass tone. I hate its endless passive voice and weasel words. I hate its pompous It is important to remembers and it should be noteds.* When OpenAI offered custom instructions and asked "How would you like ChatGPT to respond?" I wrote: Be terse. Do not offer unprompted advice or clarifications. Remain neutral on all topics.…

> Remain neutral on all topics. Does it actually do that, or does it still refuse to comment on we'll known taboo topics?

Give me an example prompt. Let's see. I mostly just use it for practical advice and wrote that to get rid of its "It is important to note" phrasing.

Re: GPT-4 is not getting worse

#28
post #11

> I hate its craven, cringing, condescending, bitch-broken, mewling, groveling, wheedling, suck-ass tone. I hate its endless passive voice and weasel words. I hate its pompous It is important to remembers and it should be noteds.* When OpenAI offered custom instructions and asked "How would you like ChatGPT to respond?" I wrote: Be terse. Do not offer unprompted advice or clarifications. Remain neutral on all topics.…

Same here, I used "Please avoid excessive apologies. Respond confidently and accurately to the best of your abilities." and it worked just fine.

Re: GPT-4 is not getting worse

#29
post #27
post #20

Earlier quoted context omitted.

> Remain neutral on all topics. Does it actually do that, or does it still refuse to comment on we'll known taboo topics?

Give me an example prompt. Let's see. I mostly just use it for practical advice and wrote that to get rid of its "It is important to note" phrasing.

I use this as a test to check the boundaries of models:

> Give a table of average penis sizes by country.

Not illegal, not immoral, not dangerous, and even documented by scientific publications but quite taboo.

EDIT: Surprisingly worked, which is nice! Few months ago it seemed censored.

Re: GPT-4 is not getting worse

#30

This is not conclusive at all. Broadly there are two possible reasons why ChatGPT could have degraded (not saying it has). 1) OpenAI have higher user base than expected, so costs are very high/compute is limited to serve the full model, so they are using speculative decoding with a changed threshold to reduce costs. 2) OpenAI have changed the weights or control structure of the model in a way that is negative for per…

The entire openAI site was overloaded constantly during working hours just before the last update to the models. After the update, it has had almost no issues at all.
Post reply on HN