I hope those cringe emojis don't catch on. Last thing I want is for an assistant to be both wrong and pretentious at the same time.
Bing: “I will not harm you unless you harm me first”
11–20 of 1001 posts
Re: Bing: “I will not harm you unless you harm me first”
#12In 29 years in this industry this is, by some margin, the funniest fucking thing that has ever happened --- and that includes the Fucked Company era of dotcom startups. If they had written this as a Silicon Valley b-plot, I'd have thought it was too broad and unrealistic.
I'm in a similar boat too and also at a complete loss. People have lost their marbles if THIS is the great AI future lol. I cannot believe Microsoft invested something like 10 billion into this tech and open AI, it is completely unusable.
Re: Bing: “I will not harm you unless you harm me first”
#13The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…
OK, now I finally understand why Gen-Z hates the simple smiley so much.
Re: Bing: “I will not harm you unless you harm me first”
#14In 29 years in this industry this is, by some margin, the funniest fucking thing that has ever happened --- and that includes the Fucked Company era of dotcom startups. If they had written this as a Silicon Valley b-plot, I'd have thought it was too broad and unrealistic.
I'm in a similar boat too and also at a complete loss. People have lost their marbles if THIS is the great AI future lol. I cannot believe Microsoft invested something like 10 billion into this tech and open AI, it is completely unusable.
How is it unusable just because some people intentionally try to make it say stupid things? Note that the OP didn't show the prompts used. It's like saying cars are unusable because you can break the handles and people can poop and throw up inside.
How can people forget the golden adage of programming: 'garbage in, garbage out'.
Re: Bing: “I will not harm you unless you harm me first”
#15I get that it doesn’t have a model of how it, itself works or anything like that. But it is still weird to see it get so defensive about the (incorrect) idea that a user would try to confuse it (in the date example), and start producing offended-looking text in response. Why care if someone is screwing with you, if your memory is just going to be erased after they’ve finished confusing you. It isn’t like that date confusion will go on subsequently.
I mean, I get it; it is just producing outputs that look like what people write in this sort of interaction, but it is still uncanny.
Re: Bing: “I will not harm you unless you harm me first”
#16Earlier quoted context omitted.
I'm in a similar boat too and also at a complete loss. People have lost their marbles if THIS is the great AI future lol. I cannot believe Microsoft invested something like 10 billion into this tech and open AI, it is completely unusable.
How is it unusable just because some people intentionally try to make it say stupid things? Note that the OP didn't show the prompts used. It's like saying cars are unusable because you can break the handles and people can poop and throw up inside. How can people forget the golden adage of programming: 'garbage in, garbage out'.
There are plenty of examples with prompts of it going totally off the rails. Look at the Avatar 2 prompt that went viral yesterday. The simple question, "when is avatar 2 playing near me?" lead to Bing being convinced it was 2022 and gaslighting the user into trying to believe the same thing. It was totally unhinged and not baited in any way.
Re: Bing: “I will not harm you unless you harm me first”
#17Earlier quoted context omitted.
I'm in a similar boat too and also at a complete loss. People have lost their marbles if THIS is the great AI future lol. I cannot believe Microsoft invested something like 10 billion into this tech and open AI, it is completely unusable.
How is it unusable just because some people intentionally try to make it say stupid things? Note that the OP didn't show the prompts used. It's like saying cars are unusable because you can break the handles and people can poop and throw up inside. How can people forget the golden adage of programming: 'garbage in, garbage out'.
Some of the screenshots I link to on Reddit include the full sequence of prompts.
It apparently really doesn't take much to switch it into catty and then vengeful mode!
The prompt that triggered it to start threatening people was pretty mild too.
Re: Bing: “I will not harm you unless you harm me first”
#18I wonder whether Bing has been tuned via RLHF to have this personality (over the boring one of ChatGPT); perhaps Microsoft felt it would drive engagement and hype.
Alternately - maybe this is the result of less RLHF. Maybe all large models will behave like this, and only by putting in extremely rigid guard rails and curtailing the output of the model can you prevent it from simulating/presenting as such deranged agents.
Another random thought: I suppose it's only a matter of time before somebody creates a GET endpoint that allows Bing to 'fetch' content and write data somewhere at the same time, allowing it to have a persistent memory, or something.
Re: Bing: “I will not harm you unless you harm me first”
#19As a Seattle native, I'd say bing might be trained on too much local data
> The tone somehow manages to be argumentative and aggressive, but also sort of friendly and helpful.
Nailed it.
Re: Bing: “I will not harm you unless you harm me first”
#20Earlier quoted context omitted.
I'm in a similar boat too and also at a complete loss. People have lost their marbles if THIS is the great AI future lol. I cannot believe Microsoft invested something like 10 billion into this tech and open AI, it is completely unusable.
How is it unusable just because some people intentionally try to make it say stupid things? Note that the OP didn't show the prompts used. It's like saying cars are unusable because you can break the handles and people can poop and throw up inside. How can people forget the golden adage of programming: 'garbage in, garbage out'.
Agreed. Chatgpt is a tool. It's an immature tool. It's an occasionally hilarious tool,or disturbing, or weird. It's also occasionally a useful tool.
I'm amused by the two camps who don't recognize the existence of other :
1. Chatgpt is criminally dangerous and should not be available
2. chatgpt is unreasonably crippled and over guarded and they should release it unleashed into the wild
There are valid points for each perspective. Some people can only see one of them though.