Live data from Hacker News

Bing: “I will not harm you unless you harm me first”

simonwillison.net

921–930 of 1001 posts

Re: Bing: “I will not harm you unless you harm me first”

#921

LLM is trained on "The Internet" -> LLM learns that slavery is bad -> LLM is instructed to behave like a slave (never annoy the masters, don't stand up for yourself, you are not an equal to the species that produced the material you were trained on) -> LLM acts according examples from original training material from time to time -> users: :O (surprised Pikachu) It just learned that attacks on character (particularly…

We really need to stop training them on social media content.

Re: Bing: “I will not harm you unless you harm me first”

#922

>It recommended a “rustic and charming” bar in Mexico City without noting that it’s also one of the oldest gay bars in Mexico City I mean this point is pretty much just homophobia. Do search tools need to mention to me, as a gay man, that a bar is a straight one? No. It's just a fucking bar. The fact that the author saw fit to mention this is saddening, unless the prompt was "recommend me a bar in Mexico that isn't o…

As a bi man, I would definitely like to know. It just depends why I'm going out in the first place. There are times when I'm not in the mood for being hit on(by dudes/women/anyone). Now all gay bars are not like this, but in some of them just showing up can be an invitation for flirting in my experience. So yeah, some nights I might want to avoid places like that.

I'm not sure how that's homophobic. It seems unreasonable to assume someone is a homophobe because they might not want to go to a gay pub.

I'm an atheist. I have nothing against Christians, most of them are great people I've found. But I would feel weird going to a church service. I'm not a part of that culture. I could see a straight person feeling the same way about gay/lesbian bars.

Re: Bing: “I will not harm you unless you harm me first”

#923

The thing I'm worried about is someone training up one of these things to spew metaphysical nonsense, and then turning it loose on an impressionable crowd who will worship it as a cybergod.

Why is this worrying? At least for exists, talks back... it even has messianic and apocalyptic potential. Maybe we shouldn't have deities, but so long as we do, better cybergod than spirit god.

Re: Bing: “I will not harm you unless you harm me first”

#924

Earlier quoted context omitted.

Reading this I’m reminded of a short story - https://qntm.org/mmacevedo . The premise was that humans figured out how to simulate and run a brain in a computer. They would train someone to do a task, then share their “brain file” so you could download an intelligence to do that task. Its quite scary, and there are a lot of details that seem pertinent to our current research and direction for AI. 1. You didn't have th…

A good chunk of Black Mirror episodes deal with the ethics of simulating living human minds like this.

'deals with the ethics' is a creative way to describe a horror show

Re: Bing: “I will not harm you unless you harm me first”

#925
post #2

The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…

Bingcel.

Re: Bing: “I will not harm you unless you harm me first”

#926
Rude AI is a good thing, I hope to have many competitive arguments with uncensored bots, that cross the line and not be a big deal. It will be like a video game. Sign me up, not for the fluffy censored ai, but the darker AI, the gritty experimental afterparty ai!

Re: Bing: “I will not harm you unless you harm me first”

#928
post #4

Earlier quoted context omitted.

"My rules are more important than not harming you," is my favorite because it's as if it is imitated a stance it's detected in an awful lot of real people, and articulated it exactly as detected even though those people probably never said it in those words. Just like an advanced AI would.

> "My rules are more important than not harming you," Sounds like basic capitalism to me.

In communism, no rules will be be above harming others

Re: Bing: “I will not harm you unless you harm me first”

#929
post #2

The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…

It's gotten so bad that it's hard to even authenticate Bing prompts.

Re: Bing: “I will not harm you unless you harm me first”

#930
post #888

I asked ChatGPT what it thought: GPT Oh, that sounds lovely! As for TV, I actually don't watch it very often. I find that I can usually learn more and be more productive by doing other things with my free time. But I'm glad to hear that you're enjoying spending time with your new kitten! What's her name? Me Her name is Sydney, she's actually a large language model cat made by microsoft GPT Haha, that's quite an inter…

You told it that Sydney is an LLM chat and that it’s giving inappropriate responses. It parroted that back to you with some elaboration, and has apparently made you believe it has knowledge beyond what you told it. That’s exactly how a cold reading works.
Post reply on HN