And once again this thread exposes the great problem with LLMs today, it's working like a black box thats impossible to debug in any way by the operator.
What Is Happening with ChatGPT?
91–100 of 104 posts
Re: What Is Happening with ChatGPT?
#92[flagged]
Re: What Is Happening with ChatGPT?
#93"we are not changing the models behind the scenes" And then quality goes suddenly down the drain
OpenAI's API models don't change behind the scenes.
OpenAI's ChatGPT model changes regularly: https://help.openai.com/en/articles/6825453-chatgpt-release-...
Re: What Is Happening with ChatGPT?
#94ChatGPT went crazy on me today on more than one occasion. Has this been happening to anyone else?
Do you have a custom instruction by chance? Maybe one that makes it go crazy after saying some certain word?
no, this was a clean chat. i found someone here who hit the same thing : https://news.ycombinator.com/item?id=37054241
Re: What Is Happening with ChatGPT?
#95Earlier quoted context omitted.
i keep seeing people say this stuff but i think it's just confirmation bias over prolonged usage. i pumped out a full stack webapp with chatgpt 4 in the last week in languages i had little experience with and routinely use it to learn about new topics with great success. i think it's incredible.
I’m so tired of hearing this confirmation bias reply. It CLEARLY is worse, and not from this post which looks like a glitch. Unless you are completely and utterly oblivious beyond words, it’s extremely obvious. I can’t even get it to print 1-2 lines of Ruby without errors of some kind when it used to write entire complex controllers flawlessly. This is 1 of 100 examples I’ve seen with my own eyes.
well, as i mentioned i have had it print several thousand lines of code very recently without these kinds of issues, so perhaps this reflects some calivinistic fate on your part
Re: What Is Happening with ChatGPT?
#96Earlier quoted context omitted.
Man imagine what would you have thought buying an Altair for 400 in 1975 and getting a box with switches and flashing lights. 20 dollars a month for instant access to this is a steal.
You're missing the point. $20 is a steal, but the price is irrelevant. No matter what the price is, it's bad business practice to say "Here's a demo of what you're getting for $X" but then deliver something different that only works as advertised some of the time. It's like presenting an Altair at a conference and letting people play with it. But when they buy it, they get something different, or realize that the Alt…
I made the analogy because they were also swamped with orders and underdelivered on promises, but it's still a big deal and worth it despite that.
Re: What Is Happening with ChatGPT?
#97I've noticed a substantial drop in the performance and usefulness of Chat GTP 4. It makes me think that OpenAI created Chat GTP almost by accident because they do not seem capable of refining and improving their model.
I see it differently. They built the best they could, but it was expensive. Now it feels to me that they are "optimizing" it for performance by seeing if they can lower the quality but still give people just enough value to pay for it. Makes me think they are trying to find a sweet spot between performance and cost. I am seeing this drop in quality, but mostly when it comes to the model remembering things you've told it in the past, and a much bigger dependence on custom instructions for prompts.
I still get value, but I have to give it the documentation I want it to focus on during the prompt, instead of referencing it earlier in the conversation.
This makes me think they are lowering it's ability to store context so that the calls don't cost as much to make.
Re: What Is Happening with ChatGPT?
#98I've noticed a substantial drop in the performance and usefulness of Chat GTP 4. It makes me think that OpenAI created Chat GTP almost by accident because they do not seem capable of refining and improving their model.
Pure speculation: most likely quantizing models to 8bit to make them more efficient (and cheaper to run), and losing some accuracy on the way. I still use it, but I have found it to be less useful for coding than it was earlier. So, something is up.
I agree, this is exactly my experience as well. My earlier requests for code were more thorough then they are now. I can still use it if I give it the documentation in the prompt, but it has trouble remembering context across prompts.
Re: What Is Happening with ChatGPT?
#99Maybe we'll find that there is a mathematical constant that when used as the temperature parameter leads to unfalsifiable sentience.
Re: What Is Happening with ChatGPT?
#100.....uh that was way more than 5 letters....