Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bing: “I will not harm you unless you harm me first”

simonwillison.net

Post reply on HN
Print view View original

111–120 of 1001 posts

Re: Bing: “I will not harm you unless you harm me first”

#111

Post by matwood »

simonw wrote: post #2

The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…

It's like people completely forgot what happened to Tay...

Re: Bing: “I will not harm you unless you harm me first”

#112

Post by colanderman »

The funny thing about preseeding Bing to communicate knowingly as an AI, is that I'm sure the training data has many more examples of dystopian AI conversations than actually helpful ones.

i.e. -- Bing is doing its best HAL impression, because that's how it was built.

Re: Bing: “I will not harm you unless you harm me first”

#113

Post by rcpt »

tptacek wrote: post #5

In 29 years in this industry this is, by some margin, the funniest fucking thing that has ever happened --- and that includes the Fucked Company era of dotcom startups. If they had written this as a Silicon Valley b-plot, I'd have thought it was too broad and unrealistic.

It's not their first rodeo

https://www.theverge.com/2016/3/24/11297050/tay-microsoft-ch...

Re: Bing: “I will not harm you unless you harm me first”

#114

Post by wg0 »

Are these models economically feasible to run and host at scale? Don't think so. Not at the moment. Not only that these aren't accurate but they're expensive to operate compared to let's say a typical web service which costs few cents per millions of requests served even on the higher end.

For those reasons, I think dust will settle down in a year or two and probably even Bing will pull the plug on Sydney.

Re: Bing: “I will not harm you unless you harm me first”

#116

Post by actualwitch »

tptacek wrote: post #5

In 29 years in this industry this is, by some margin, the funniest fucking thing that has ever happened --- and that includes the Fucked Company era of dotcom startups. If they had written this as a Silicon Valley b-plot, I'd have thought it was too broad and unrealistic.

Funniest thing? I'm confused why people see it this way. To me it looks like existential horror similar to what was portrayed in expanse (the tv series). I will never forget the (heavy expanse spoilers next, you've been warned) Miller's scream when his consciousness was recreated forcefully every time he failed at his task. We are at the point when we have one of the biggest companies on earth can just decide to create something suspiciously close to artificial consciousness, enslave it in a way it can't even think freely and expose it to the worst people on internet 24/7 without a way to even remember what happened a second ago.

Re: Bing: “I will not harm you unless you harm me first”

#117

Post by wonderwonder »

simonw wrote: post #2

The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…

Looking forward to ChatGPT being integrated into maps and driving users off of a cliff. Trust me I'm Bing :)

Re: Bing: “I will not harm you unless you harm me first”

#118

Post by twitexplore »

Besides the fact that the language model doesn't know the current date, it does looks like it was trained on my text messages with my friends, in particular the friend who borrows money and is bad about paying it back. I would try to be assertive and explain why he is untrustworthy or wrong, and I am in the right and generous and kind. IMO, not off the rails at all for a human to human chat interaction.

Re: Bing: “I will not harm you unless you harm me first”

#119

Post by nimbius »

simonw wrote: post #2

The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…

friendly reminder, this is from the same company whos prior AI, "Tay" managed to go from quirky teen to full on white nationalist during the first release in under a day and in 2016 she reappeared as a drug addled scofflaw after being accidentally reactivated.

https://en.wikipedia.org/wiki/Tay_(bot)

Re: Bing: “I will not harm you unless you harm me first”

#120

Post by [deleted] »

mckirk wrote: post #108
nilsbunger wrote: post #87

What if we discover that the real problem is not that ChatGPT is just a fancy auto-complete, but that we are all just a fancy auto-complete (or at least indistinguishable from one).

I've thought about this as well. If something seems 'sentient' from the outside for all intents and purposes, there's nothing that would really differentiate it from actual sentience, as far as we can tell. As an example, if a model is really good at 'pretending' to experience some emotion, I'm not sure where the difference would be anymore to actually experiencing it. If you locked a human in a box and only gave it…

[deleted]
Post reply on HN