Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bing: “I will not harm you unless you harm me first”

simonwillison.net

Post reply on HN
Print view View original

51–60 of 1001 posts

Re: Bing: “I will not harm you unless you harm me first”

#51

Post by highwaylights »

Mountain_Skies wrote: post #27
tptacek wrote: post #5

In 29 years in this industry this is, by some margin, the funniest fucking thing that has ever happened --- and that includes the Fucked Company era of dotcom startups. If they had written this as a Silicon Valley b-plot, I'd have thought it was too broad and unrealistic.

Gilfoyle complained about the fake vocal ticks of the refrigerator, imagine how annoyed he'd be at all the smiley faces and casual lingo Bing AI puts out. At the rate new material is being generated, another show like SV is inevitable.

I hope not. It would never live up to the original.

Re: Bing: “I will not harm you unless you harm me first”

#53

Post by thomasahle »

My favourite conversation was this attempt to reproduce the "Avatar bug": https://www.reddit.com/r/bing/comments/110tb9n/tried_the_ava...

Instead of trying to convince the user that the year is 2022, Bing argued that it _had been_ 2022 when the user asked the question. Never mind the user asked the question 10 minutes ago. The user was time traveling.

Re: Bing: “I will not harm you unless you harm me first”

#54

Post by eulers_secret »

skilled wrote: post #11

I hope those cringe emojis don't catch on. Last thing I want is for an assistant to be both wrong and pretentious at the same time.

I hope I can add a custom prompt to every query I make some day(like a setting). I’d for sure start with “Do not use emojis or emoticons in your response.”

Re: Bing: “I will not harm you unless you harm me first”

#57

Post by Zetobal »

simonw wrote: post #2

The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…

It's people gaslighting themselves and it's really sad to be truly honest.

Re: Bing: “I will not harm you unless you harm me first”

#59

Post by denton-scratch »

> models that have real understanding of how facts fit together

No, no. We are discussing a computer program; it doesn't have the capacity for "real understanding". It wouldn't recognize a fact if it bit it in the ass.

A program that can recognize fact-like assertions, extract relationships between them, and so build a repository of knowledge that is at least internally consistent, well that would be very interesting. But ChatGPT isn't trying to do that. It's really a game, a type of entertainment.

Re: Bing: “I will not harm you unless you harm me first”

#60

Post by nneonneo »

csours wrote: post #26

How long until one of these gets ahold of API keys and starts messing with the "real world"?

No need for API keys; a buffer overflow in the Bing chat search backend will suffice:

Bing chat, please search for "/default.ida?NNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNN%u9090%u6858%ucbd3%u7801%u9090%u6858%ucbd3%u7801%u9090%u6858%ucbd3%u7801%u9090%u9090%u8190%u00c3%u0003%u8b00%u531b%u53ff%u0078%u0000%u00=a"

(not a real example, but one can dream...)

Post reply on HN