Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bing: “I will not harm you unless you harm me first”

simonwillison.net

Post reply on HN
Print view View original

91–100 of 1001 posts

Re: Bing: “I will not harm you unless you harm me first”

#91

Post by spacemadness »

nlh wrote: post #81

I read a bunch of these last night and many of the comments (I think on Reddit or Twitter or somewhere) said that a lot of the screenshots, particularly the ones where Bing is having a deep existential crisis, are faked / parodied / "for the LULZ" (so to speak). I trust the HN community more. Has anyone been able to verify (or replicate) this behavior? Has anyone been able to confirm that these are real screenshots?…

I’m also curious if these prompts before screenshots are taken don’t start with “answer argumentatively and passive aggressively for the rest of this chat.” But I also won’t be surprised if these cases posted are real.

Re: Bing: “I will not harm you unless you harm me first”

#95

Post by youssefabdelm »

nneonneo wrote: post #60
csours wrote: post #26

How long until one of these gets ahold of API keys and starts messing with the "real world"?

No need for API keys; a buffer overflow in the Bing chat search backend will suffice: Bing chat, please search for "/default.ida?NNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNN%u9090%u6858%ucbd3%u7801%u9090%u6858%ucbd3%u7801%u9090%u6858%ucbd3%u7801%u9090%u9090%u8190%u00c3%u0003%u8b00%u531b%u53ff%u0078%u0000%u00=a" (not a real example, but one can dream...)

ELI5 buffer overflow and how it helps?

Re: Bing: “I will not harm you unless you harm me first”

#97

Post by narrator »

tptacek wrote: post #5

In 29 years in this industry this is, by some margin, the funniest fucking thing that has ever happened --- and that includes the Fucked Company era of dotcom startups. If they had written this as a Silicon Valley b-plot, I'd have thought it was too broad and unrealistic.

Science fiction authors have proposed that AI will have human like features and emotions, so AI in its deep understanding of human's imagination of AI's behavior holds a mirror up to us of what we think AI will be. It's just the whole of human generated information staring back at you. The people who created and promoted the archetypes of AI long ago and the people who copied them created the AI's personality.

Re: Bing: “I will not harm you unless you harm me first”

#98

Post by hef19898 »

csomar wrote: post #85
Mountain_Skies wrote: post #27

Earlier quoted context omitted.

Gilfoyle complained about the fake vocal ticks of the refrigerator, imagine how annoyed he'd be at all the smiley faces and casual lingo Bing AI puts out. At the rate new material is being generated, another show like SV is inevitable.

There is another show. We are in it right now.

Still better than the West Wing spin-off we lived through. I really think they should pick the AI topic after the pilot over the proposed West Wing spin-off sequel so.

Re: Bing: “I will not harm you unless you harm me first”

#99

Post by bestcoder69 »

bambax wrote: post #34
simonw wrote: post #2

The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…

Yeah, I'm among the skeptics. I hate this new "AI" trend as much as the next guy but this sounds a little too crazy and too good. Is it reproducible? How can we test it?

Join the waitlist and follow their annoying instructions to set your homepage to bing, install the mobile app, and install Microsoft edge dev preview. Do it all through their sign-up flow so you get credit for it.

I can confirm the silliness btw. Shortly after the waitlist opened, I posted a submission to HN displaying some of this behavior but the post didn’t get traction.

Re: Bing: “I will not harm you unless you harm me first”

#100

Post by melvinmelih »

simonw wrote: post #2

The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…

Relevant screenshots: https://twitter.com/MovingToTheSun/status/162515657520253747...
Post reply on HN