31–40 of 200 posts
I’m convinced this is group hallucination. It must be so interesting to work at OpenAI, knowing you didn’t change a thing, and seeing that because of random chance, some small fraction of 100M users have all tricked each other that suddenly, something is different.
My gut feeling, based on no evidence, is that with the constant pruning of whatever base prompt they're using to seed conversations, the overly-strict rules by which the model is allowed to generate responses is causing it to have worse and worse outputs.
It really started getting bad when ClosedAI began to add all of the policies about what's "allowed", e.g. that it's not allowed to generate silly but non-factual information.
I’m convinced this is group hallucination. It must be so interesting to work at OpenAI, knowing you didn’t change a thing, and seeing that because of random chance, some small fraction of 100M users have all tricked each other that suddenly, something is different.
I don't know about the API, but the ChatGPT UI GPT4 really became much worse, so much so that I had to cancel my subscription. It's not just about novelty factor. I used to store all my prompts locally, and when I compare old responses and new ones, there is a huge difference. OpenAI employee said the API model doesn't change, but were careful to not say anything about the UI. I am now waiting to get access to the AP…
The thing is they(OpenAI) really could mess with the temperature/probability settings, and other settings for various reasons that can cause something like this to happen to some people at certain random times. Hence is hard to reproduce, and only OpenAI knows it, either they acknowledge or not that is the based on business requirements
I have a 12 liter jug and a 6 liter jug. I want to measure 6 liters. How do I do it?
GPT4: You actually don't need to do anything because one of your jugs is already a 6-liter jug. If you fill it up to the top, you'll have exactly 6 liters of water.
GPT-3.5: To measure exactly 6 liters using a 12-liter jug and a 6-liter jug, you can follow the steps below:
Start with both jugs empty. Fill the 12-liter jug completely with water. Pour the water from the 12-liter jug into the 6-liter jug. This will leave you with 6 liters of water in the 12-liter jug. Empty the 6-liter jug. Pour the 6 liters of water from the 12-liter jug back into the empty 6-liter jug. Now, you have 6 liters of water in the 6-liter jug. At this point, you have successfully measured 6 liters using the 12-liter jug and the 6-liter jug.
I've certainly noticed that the quality of responses has gone down, and I have to repeat myself more often as it doesn't always remember all my instructions.
For an example of something it can no longer do, I used to show it off by having it explain something using words that each start with the next letter of the alphabet, then I'd add "now make it rhyme" after it succeeded. If you try that now (even with the 0314 model), it'll fail at the task.
I don't know about the API, but the ChatGPT UI GPT4 really became much worse, so much so that I had to cancel my subscription. It's not just about novelty factor. I used to store all my prompts locally, and when I compare old responses and new ones, there is a huge difference. OpenAI employee said the API model doesn't change, but were careful to not say anything about the UI. I am now waiting to get access to the AP…