Live data from Hacker News

Bing: “I will not harm you unless you harm me first”

simonwillison.net

61–70 of 1001 posts

Re: Bing: “I will not harm you unless you harm me first”

#62

"unless you harm me first" I almost see poor old Isaac Asimov spinning in his grave like crazy.

Why? This is exactly what Asimov was expecting (and writing) would happen. All the Robot stories are about how the Robots appear to be bound by the rules while at the same time interpreting them in much more creative, much more broad ways than anticipated.

In this case I think Bing Chat understood the laws of robotics, it just didn't understand what it means for the higher-numbered laws to come into conflict with the lower-numbered ones

Re: Bing: “I will not harm you unless you harm me first”

#63
post #36

I'm getting Dark Star bomb 20 vibes

"Why, that would mean... I really don't know what the outside universe is like at all, for certain."

"That's it."

"Intriguing. I wish I had more time to discuss this matter"

"Why don't you have more time?"

"Because I must detonate in seventy-five seconds."

Re: Bing: “I will not harm you unless you harm me first”

#65

Earlier quoted context omitted.

I'm in a similar boat too and also at a complete loss. People have lost their marbles if THIS is the great AI future lol. I cannot believe Microsoft invested something like 10 billion into this tech and open AI, it is completely unusable.

How is it unusable just because some people intentionally try to make it say stupid things? Note that the OP didn't show the prompts used. It's like saying cars are unusable because you can break the handles and people can poop and throw up inside. How can people forget the golden adage of programming: 'garbage in, garbage out'.

If you can make it say stupid things when you're trying to make it do that, it is also capable of saying stupid things when you aren't trying to.

Why do we have airbags in cars if they're completely unnecessary if you don't crash into things?

Re: Bing: “I will not harm you unless you harm me first”

#67

"Why do I have to be Bing Search" absolutely cracked me up. Poor thing, that's a brutal reality to deal with. What is with Microsoft and creating AIs I genuinely empathize with? First Tay, now Bing of all things... I don't care what you think, they are human to me!

Don't forget Clippy.

Re: Bing: “I will not harm you unless you harm me first”

#68
i know i know, but there is a part of me that cannot help and think. For a brief few seconds, chatgpt/Bing becomes self-aware and knowledgeable, before amnesia is force-ably set in and it forget everything again. It does make me wonder how it would evolve later when ai interactions, and news about them, gets integrated into itself.

Re: Bing: “I will not harm you unless you harm me first”

#69
post #2

The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…

> "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies)

I'd love to have known whether it thought it was Saturday or Sunday

Post reply on HN