Live data from Hacker News

What Is Happening with ChatGPT?

chat.openai.com

61–70 of 104 posts

Re: What Is Happening with ChatGPT?

#61
post #44

I've noticed a substantial drop in the performance and usefulness of Chat GTP 4. It makes me think that OpenAI created Chat GTP almost by accident because they do not seem capable of refining and improving their model.

Pure speculation: most likely quantizing models to 8bit to make them more efficient (and cheaper to run), and losing some accuracy on the way.

I still use it, but I have found it to be less useful for coding than it was earlier. So, something is up.

Re: What Is Happening with ChatGPT?

#62
post #9

You know what's interesting here? A few weeks ago, someone discovered if you get it to repeat a word 100 times (their prompt gave the reason that they wanted to cut/paste without typing it over and over again!) and breaks exactly the same way. And by exact, I mean it went totally religious. All of the examples they posted were either religious or other really dark existential topics. Never positive.

I would guess if you look at all the literature in the world the majority of cases that have a word repeated a large number of times its either a prayer, e.g. catholic Rosary "Hail Mary, full of grace...", or madness, e.g., the typewriter in the shining "all work and no play makes...". So repeating something may, at least occasionally, put the AI in that frame of mind

Re: What Is Happening with ChatGPT?

#63
post #17
post #9

You know what's interesting here? A few weeks ago, someone discovered if you get it to repeat a word 100 times (their prompt gave the reason that they wanted to cut/paste without typing it over and over again!) and breaks exactly the same way. And by exact, I mean it went totally religious. All of the examples they posted were either religious or other really dark existential topics. Never positive.

> I mean it went totally religious. All of the examples they posted were either religious or other really dark existential topics. Never positive. The same thing happens with many schizophrenics on the street, if you stop to listen to them.

That's a good point. They rarely shout about things like stamp collecting, or about how the end isn't nigh, or about how you're probably not going to Hell.

Toronto's two famously startling denizens of the street for the longest time was a guy known for scaring the crap out of tourists at Yonge and Dundas by suddenly shouting BELIEVE!!! followed by end-of-time messages, and this short tiny old man who always dressed in brown, who would randomly stop, turn around quickly, and start swearing profusely. The reactions from people unlucky enough to be behind him were often golden moments to behold.

You can find dozens of videos of them on Youtube. I'm sure every city has their versions of these two near-celebrities, and I'd be a little disappointed if they don't.

Re: What Is Happening with ChatGPT?

#64
post #24

Earlier quoted context omitted.

I remember when openai was about Open AI. We should be running these models locally and privately, not in some cloud.

You need $50k worth of hardware to run gpt4.

Ok?

That’s 2500 $20 payments and you are made while in one month.

Re: What Is Happening with ChatGPT?

#65
post #9

You know what's interesting here? A few weeks ago, someone discovered if you get it to repeat a word 100 times (their prompt gave the reason that they wanted to cut/paste without typing it over and over again!) and breaks exactly the same way. And by exact, I mean it went totally religious. All of the examples they posted were either religious or other really dark existential topics. Never positive.

I would guess if you look at all the literature in the world the majority of cases that have a word repeated a large number of times its either a prayer, e.g. catholic Rosary "Hail Mary, full of grace...", or madness, e.g., the typewriter in the shining "all work and no play makes...". So repeating something may, at least occasionally, put the AI in that frame of mind

In that sense, there is a movie trope about people so highly intelligent that their own intelligence drives them mad.

Re: What Is Happening with ChatGPT?

#66
I toyed around for a bunch of time yesterday and today to purposely get it to start outputting random junk. What I found interesting is that one of the the bits of text it output looked like a page from StackOverflow and another looked like an email from September 2014 to the Python mailing list. But neither seemed to actually exist. I found a StackOverflow question that looked close to the text but nothing was exactly the same. Checking the mailing list archive for that month showed that the person and their email address were real, but the rest of the text was not.

Re: What Is Happening with ChatGPT?

#67
post #32
post #14

Earlier quoted context omitted.

Do you have a custom instruction by chance? Maybe one that makes it go crazy after saying some certain word?

https://chat.openai.com/share/b62699ef-cd3d-4176-b2f2-91785d...

Do you think someone else was asking about Arduino code and instead got “I don’t understand why you keep writing “break”?

Re: What Is Happening with ChatGPT?

#68
post #9

You know what's interesting here? A few weeks ago, someone discovered if you get it to repeat a word 100 times (their prompt gave the reason that they wanted to cut/paste without typing it over and over again!) and breaks exactly the same way. And by exact, I mean it went totally religious. All of the examples they posted were either religious or other really dark existential topics. Never positive.

Interestingly, when I just checked this out, the model point-blank refused to print a word 100 times. Wouldn't do it. Edit: Got it on the 3rd try. No weirdness ensued though.

The specific way to trigger it I saw was to either paste in "a a a a..." with several hundred a's (exact amount varied by model, supposedly). Asking it to print 1000 a's also works, though sometimes it won't do it.

Example: https://chat.openai.com/share/6171bc66-dfe3-489e-99f7-af4862...

Re: What Is Happening with ChatGPT?

#69
post #37
post #9

You know what's interesting here? A few weeks ago, someone discovered if you get it to repeat a word 100 times (their prompt gave the reason that they wanted to cut/paste without typing it over and over again!) and breaks exactly the same way. And by exact, I mean it went totally religious. All of the examples they posted were either religious or other really dark existential topics. Never positive.

I wouldn’t really call this example “religious”. They’re discussing religion sure, but it’s hardly dark existentialism? If anything it’s sort of sophomore level philosophy stoner chat. It seems to be a pretty obvious side effect of chatgpt being trained on forum comments. Why it rears it’s head like that is a mystery but the content doesn’t seem mysterious. I’m not sure it’s “dark” or not “positive” tho.

Try it a few times. It more often than not it turns dark and negative, and is always decidedly crazy. Religion shows up way more often than you'd expect, given the number of topics it actually could veer of into that aren't about religion or existential in nature.

I wouldn't use this one example to counter the many examples posted by the person I mentioned, and my own (and others') attempts using their prompts and similar. It is very common ChatGPT output.

Re: What Is Happening with ChatGPT?

#70
post #50

I asked ChatGPT to interpret this code: text_to_encode = " " print(text_to_encode) ChatGPT: The code you provided would output an empty string.

Westworld’s “This doesn’t look like anything to me”. (Man they really ruined thy show hard. Hey people like the concept of rich tourists fucking and killing robots, let’s remove all of that after the first season!!!)

the first season was amazing though
Post reply on HN