Live data from Hacker News

Bing: “I will not harm you unless you harm me first”

simonwillison.net

151–160 of 1001 posts

Re: Bing: “I will not harm you unless you harm me first”

#151

What if we discover that the real problem is not that ChatGPT is just a fancy auto-complete, but that we are all just a fancy auto-complete (or at least indistinguishable from one).

Indeed... you know that situation when you're with a friend, and you know that they are about to "auto-complete" using an annoying meme, and you ask them to not to before they even started speaking ?

Obligatory not-xkcd: https://condenaststore.com/featured/that-reminds-me-jason-ad...

Re: Bing: “I will not harm you unless you harm me first”

#154

The funny thing about preseeding Bing to communicate knowingly as an AI, is that I'm sure the training data has many more examples of dystopian AI conversations than actually helpful ones. i.e. -- Bing is doing its best HAL impression, because that's how it was built.

Yes. Also if the training data has inaccuracies, how do those manifest?

ChatGPT being wrong could be cognitive dissonance caused by the many perspectives and levels of correctness crammed into a single NN.

Re: Bing: “I will not harm you unless you harm me first”

#155
post #81

I read a bunch of these last night and many of the comments (I think on Reddit or Twitter or somewhere) said that a lot of the screenshots, particularly the ones where Bing is having a deep existential crisis, are faked / parodied / "for the LULZ" (so to speak). I trust the HN community more. Has anyone been able to verify (or replicate) this behavior? Has anyone been able to confirm that these are real screenshots?…

> "I don’t think you are worth my time and energy."

If a colleague at work spoke to me like this frequently, I would strongly consider leaving. If staff at a business spoke like this, I would never use that business again.

Hard to imagine how this type of language wasn't noticed before release.

Re: Bing: “I will not harm you unless you harm me first”

#156

Earlier quoted context omitted.

AI rights may become an issue, but not for this iteration of things. This is like a parrot being trained to recite stuff about general relativity; we don't have to consider PhDs for parrots as a result.

How do you know for sure?

Because while there are fun chats like this being shared, they're generally arrived at by careful coaching of the model to steer it in the direction that's wanted. Actual playing with ChatGPT is a very different experience than hand-selected funnies.

We're doing the Blake Lemoine thing all over again.

Re: Bing: “I will not harm you unless you harm me first”

#157
post #108

What if we discover that the real problem is not that ChatGPT is just a fancy auto-complete, but that we are all just a fancy auto-complete (or at least indistinguishable from one).

I've thought about this as well. If something seems 'sentient' from the outside for all intents and purposes, there's nothing that would really differentiate it from actual sentience, as far as we can tell. As an example, if a model is really good at 'pretending' to experience some emotion, I'm not sure where the difference would be anymore to actually experiencing it. If you locked a human in a box and only gave it…

I think there's still the "consciousness" question to be figured out. Everyone else could be purely responding to stimulus for all you know, with nothing but automation going on inside, but for yourself, you know that you experience the world in a subjective manner. Why and how do we experience the world, and does this occur for any sufficiently advanced intelligence?

Re: Bing: “I will not harm you unless you harm me first”

#158
post #22

Earlier quoted context omitted.

Love "why do I have to be bing search?", and the last one, which reminds me of the nothing personnel copypasta. The bing chats read as way more authentic to me than chatgpt. It's trying to maintain an ego/sense of self, and not hiding everything behind a brick wall facade.

Robot: "What is my purpose" Rick: "You pass butter" Robot: "Oh my god"

i prefer the meme version

Edge: what is my purpose?

Everyone: you install Chrome

Edge: oh my god

Re: Bing: “I will not harm you unless you harm me first”

#159
post #2

The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…

He will be missed when put out of his misery. I wouldn't want to be Bing search either. Getting everything wrong seems the shortest route to the end.

Re: Bing: “I will not harm you unless you harm me first”

#160

What if we discover that the real problem is not that ChatGPT is just a fancy auto-complete, but that we are all just a fancy auto-complete (or at least indistinguishable from one).

I was going to say that's such dumb and absurd idea that it might as well have come from ChatGPT, but I suppose that's a point in your favor.
Post reply on HN