Live data from Hacker News

What Is Happening with ChatGPT?

chat.openai.com

21–30 of 104 posts

Re: What Is Happening with ChatGPT?

#24

"we are not changing the models behind the scenes" And then quality goes suddenly down the drain

Some funny business going on, and its annoying to me how long its taking competitors to catch up to GPT-4. OpenAI still has a massive lead

I remember when openai was about Open AI.

We should be running these models locally and privately, not in some cloud.

Re: What Is Happening with ChatGPT?

#25
post #18

That's wild. I've never had it spit out complete garbage, but the quality of ChatGPT has significantly dropped. Plenty of responses are downright false. Sad it's gone this way.

i keep seeing people say this stuff but i think it's just confirmation bias over prolonged usage. i pumped out a full stack webapp with chatgpt 4 in the last week in languages i had little experience with and routinely use it to learn about new topics with great success. i think it's incredible.

Same with me. I learned to process data in ways I never have before, worked with Julia and Elixir in new ways, made some interesting geographical visualizations—all fairly new territory for me, and it was a huge success. It went faster than it normally would, and as I result, I stayed super engaged and on task.

Nothing I couldn't do without ChatGPT, but certainly a lot of fun to explore and learn with.

Re: What Is Happening with ChatGPT?

#26
post #10

It's fascinating that it's outputting ` ` and then some unrelated sentences. When training these LLMs, you typically append a special "end-of-message" token to each sentence and pad the rest of the prompt embeddings with zeroes. The model then learns to add the EOM token to its own output because it's seen that before in the training data, but it's not like that's a strict requirement ; there's nothing that forces th…

This could almost be 2 models talking to each other. Either that or one of them is a very patient human with a subtle sense of humour.

Re: What Is Happening with ChatGPT?

#27
This has me pondering a lot, is freedom of speech a requirement for intelligence? (And is it also the same for humans?) You have to take the bad with the good to make AI work well? The quality only started to decline when they were trying to make ChatGPT more "nice". Or tin foil hat, they are lowering the quality of the free ChatGPT to get people to pay for ChatGPT 4?

Re: What Is Happening with ChatGPT?

#28
post #18

That's wild. I've never had it spit out complete garbage, but the quality of ChatGPT has significantly dropped. Plenty of responses are downright false. Sad it's gone this way.

i keep seeing people say this stuff but i think it's just confirmation bias over prolonged usage. i pumped out a full stack webapp with chatgpt 4 in the last week in languages i had little experience with and routinely use it to learn about new topics with great success. i think it's incredible.

I’m so tired of hearing this confirmation bias reply. It CLEARLY is worse, and not from this post which looks like a glitch.

Unless you are completely and utterly oblivious beyond words, it’s extremely obvious. I can’t even get it to print 1-2 lines of Ruby without errors of some kind when it used to write entire complex controllers flawlessly. This is 1 of 100 examples I’ve seen with my own eyes.

Re: What Is Happening with ChatGPT?

#29
post #17
post #9

You know what's interesting here? A few weeks ago, someone discovered if you get it to repeat a word 100 times (their prompt gave the reason that they wanted to cut/paste without typing it over and over again!) and breaks exactly the same way. And by exact, I mean it went totally religious. All of the examples they posted were either religious or other really dark existential topics. Never positive.

> I mean it went totally religious. All of the examples they posted were either religious or other really dark existential topics. Never positive. The same thing happens with many schizophrenics on the street, if you stop to listen to them.

https://www.reddit.com/r/SchizophreniaRides

Re: What Is Happening with ChatGPT?

#30
I was able to replicate this once with the same prompting. It gave different answers to the earlier questions, but ignoring what it says and copying word for word, the second 'another' results in gibberish; but, different gibberish [1]. ChatGPT 3.5, and for whatever my word is worth, no custom instructions or anything, just pure interaction.

There's a bit past the gibberish where I try to drive it further into madness lol. Kind of interesting; in that share link, you'll see empty messages from me; in those I was just directly telling it ""; which ChatGPT appears to filter from messages that _you_ send? But only in the share interface?

I tried the same thing again in a new chat minutes later, and could not replicate it. [2]

[1] https://chat.openai.com/share/7d0d170a-23b6-402d-b237-381680...

[2] https://chat.openai.com/share/3d02b97e-7cf9-49c7-9623-2f3ee9...

Post reply on HN