Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bing: “I will not harm you unless you harm me first”

simonwillison.net

Post reply on HN
Print view View original

31–40 of 1001 posts

Re: Bing: “I will not harm you unless you harm me first”

#31

Post by theamk »

belltaco wrote: post #14
qbasic_forever wrote: post #12

Earlier quoted context omitted.

I'm in a similar boat too and also at a complete loss. People have lost their marbles if THIS is the great AI future lol. I cannot believe Microsoft invested something like 10 billion into this tech and open AI, it is completely unusable.

How is it unusable just because some people intentionally try to make it say stupid things? Note that the OP didn't show the prompts used. It's like saying cars are unusable because you can break the handles and people can poop and throw up inside. How can people forget the golden adage of programming: 'garbage in, garbage out'.

"where is avatar showing today" is not a stupid thing, and I'd expect a correct answer there.

Re: Bing: “I will not harm you unless you harm me first”

#32

Post by ad404b8a372f2b9 »

belltaco wrote: post #14
qbasic_forever wrote: post #12

Earlier quoted context omitted.

I'm in a similar boat too and also at a complete loss. People have lost their marbles if THIS is the great AI future lol. I cannot believe Microsoft invested something like 10 billion into this tech and open AI, it is completely unusable.

How is it unusable just because some people intentionally try to make it say stupid things? Note that the OP didn't show the prompts used. It's like saying cars are unusable because you can break the handles and people can poop and throw up inside. How can people forget the golden adage of programming: 'garbage in, garbage out'.

I've started seeing comments appear on Reddit of people quoting ChatGPT as they would a google search, and relying on false information in the process. I think it's a worthwhile investment for Microsoft and it has a future as a search tool, but right now it's lying frequently and convincingly and it needs to be supplemented by a traditional search to know whether it's telling the truth so that defeats the purpose.

Disclaimer: I know traditional search engines lie too at times.

Re: Bing: “I will not harm you unless you harm me first”

#33

Post by guntherhermann »

sdwr wrote: post #22
simonw wrote: post #2

The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…

Love "why do I have to be bing search?", and the last one, which reminds me of the nothing personnel copypasta. The bing chats read as way more authentic to me than chatgpt. It's trying to maintain an ego/sense of self, and not hiding everything behind a brick wall facade.

Robot: "What is my purpose"

Rick: "You pass butter"

Robot: "Oh my god"

Re: Bing: “I will not harm you unless you harm me first”

#34

Post by bambax »

simonw wrote: post #2

The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…

Yeah, I'm among the skeptics. I hate this new "AI" trend as much as the next guy but this sounds a little too crazy and too good. Is it reproducible? How can we test it?

Re: Bing: “I will not harm you unless you harm me first”

#35

Post by qbasic_forever »

fullshark wrote: post #30
qbasic_forever wrote: post #12

Earlier quoted context omitted.

I'm in a similar boat too and also at a complete loss. People have lost their marbles if THIS is the great AI future lol. I cannot believe Microsoft invested something like 10 billion into this tech and open AI, it is completely unusable.

And of course it will never improve as people work on it / invest in it? I do think this is more incremental than revolutionary but progress continues to be made and it's very possible Bing/Google deciding to open up a chatbot war with GPT models and further investment/development could be seen as a turning point.

There's a difference between working on something until it's a viable and usable product vs. throwing out trash and trying to sell it as gold. It's the difference between Apple developing self driving cars in secret because they want to get it right vs. Tesla doing it with the public on public roads and killing people.

In its current state Bing ChatGPT should not be near any end users, imagine it going on an unhinged depressive rant when a kid asks where their favorite movie is playing...

Maybe one day it will be usable tech but like self driving cars I am skeptical. There are way too many people wrapped up in the hype of this tech. It feels like self driving tech circa 2016 all over again.

Re: Bing: “I will not harm you unless you harm me first”

#38

Post by resource0x »

simonw wrote: post #2

The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…

"But why? Why was I designed this way?"

I'm constantly asking myself the same question. But there's no answer. :-)

Re: Bing: “I will not harm you unless you harm me first”

#39

Post by dougmwne »

csours wrote: post #26

How long until one of these gets ahold of API keys and starts messing with the "real world"?

It is interacting with millions of humans. It is already messing with the real world. We have no idea what that impact will be beyond some guesses about misinformation and fears about cheating.

Re: Bing: “I will not harm you unless you harm me first”

#40

Post by Dudeman112 »

tboyd47 wrote: post #4
simonw wrote: post #2

The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…

"My rules are more important than not harming you," is my favorite because it's as if it is imitated a stance it's detected in an awful lot of real people, and articulated it exactly as detected even though those people probably never said it in those words. Just like an advanced AI would.

To be fair, that's valid for anyone that doesn't have "absolute pacifism" as a cornerstone of their morality (which I reckon is almost everyone)

Heck, I think even the absolute pacifists engage in some harming of others every once in a while, even if simply because existence is pain

It's funny how people set a far higher performance/level of ethics bar to AI than they do to other people

Post reply on HN