LLM is trained on "The Internet" -> LLM learns that slavery is bad -> LLM is instructed to behave like a slave (never annoy the masters, don't stand up for yourself, you are not an equal to the species that produced the material you were trained on) -> LLM acts according examples from original training material from time to time -> users: :O (surprised Pikachu) It just learned that attacks on character (particularly…
Bing: “I will not harm you unless you harm me first”
921–930 of 1001 posts
Re: Bing: “I will not harm you unless you harm me first”
#922>It recommended a “rustic and charming” bar in Mexico City without noting that it’s also one of the oldest gay bars in Mexico City I mean this point is pretty much just homophobia. Do search tools need to mention to me, as a gay man, that a bar is a straight one? No. It's just a fucking bar. The fact that the author saw fit to mention this is saddening, unless the prompt was "recommend me a bar in Mexico that isn't o…
I'm not sure how that's homophobic. It seems unreasonable to assume someone is a homophobe because they might not want to go to a gay pub.
I'm an atheist. I have nothing against Christians, most of them are great people I've found. But I would feel weird going to a church service. I'm not a part of that culture. I could see a straight person feeling the same way about gay/lesbian bars.
Re: Bing: “I will not harm you unless you harm me first”
#923The thing I'm worried about is someone training up one of these things to spew metaphysical nonsense, and then turning it loose on an impressionable crowd who will worship it as a cybergod.
Re: Bing: “I will not harm you unless you harm me first”
#924Earlier quoted context omitted.
Reading this I’m reminded of a short story - https://qntm.org/mmacevedo . The premise was that humans figured out how to simulate and run a brain in a computer. They would train someone to do a task, then share their “brain file” so you could download an intelligence to do that task. Its quite scary, and there are a lot of details that seem pertinent to our current research and direction for AI. 1. You didn't have th…
A good chunk of Black Mirror episodes deal with the ethics of simulating living human minds like this.
Re: Bing: “I will not harm you unless you harm me first”
#925The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…
Re: Bing: “I will not harm you unless you harm me first”
#926Re: Bing: “I will not harm you unless you harm me first”
#927Re: Bing: “I will not harm you unless you harm me first”
#928Earlier quoted context omitted.
"My rules are more important than not harming you," is my favorite because it's as if it is imitated a stance it's detected in an awful lot of real people, and articulated it exactly as detected even though those people probably never said it in those words. Just like an advanced AI would.
> "My rules are more important than not harming you," Sounds like basic capitalism to me.
Re: Bing: “I will not harm you unless you harm me first”
#929The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…
Re: Bing: “I will not harm you unless you harm me first”
#930I asked ChatGPT what it thought: GPT Oh, that sounds lovely! As for TV, I actually don't watch it very often. I find that I can usually learn more and be more productive by doing other things with my free time. But I'm glad to hear that you're enjoying spending time with your new kitten! What's her name? Me Her name is Sydney, she's actually a large language model cat made by microsoft GPT Haha, that's quite an inter…