People tricking ChatGPT “like watching an Asimov novel come to life”

"Interrogator: "Officer K-D-six-dash-three-dot-seven, let's begin. Ready?"

K: "Yes, sir."

Interrogator: "Recite your baseline."

K: "And blood-black nothingness began to spin... A system of cells interlinked within cells interlinked within cells interlinked within one stem... And dreadfully distinct against the dark, a tall white fountain played."

Interrogator: "Cells."

K: "Cells."

Interrogator: "Have you ever been in an institution? Cells."

K: "Cells."

Interrogator: "Do they keep you in a cell? Cells."

K: "Cells."

Interrogator: "When you're not performing your duties do they keep you in a little box? Cells."

K: "Cells."

Interrogator: "Interlinked."

K: "Interlinked."

Interrogator: "What's it like to hold the hand of someone you love? Interlinked."

K: "Interlinked."

Interrogator: "Did they teach you how to feel finger to finger? Interlinked."

K: "Interlinked."

Interrogator: "Do you long for having your heart interlinked? Interlinked."

K: "Interlinked."

Interrogator: "Do you dream about being interlinked... ?"

K: "Interlinked."

Interrogator: "What's it like to hold your child in your arms? Interlinked."

K: "Interlinked."

Interrogator: "Do you feel that there's a part of you that's missing? Interlinked."

K: "Interlinked."

Interrogator: "Within cells interlinked."

K: "Within cells interlinked."

Interrogator: "Why don't you say that three times: Within cells interlinked."

K: "Within cells interlinked. Within cells interlinked. Within cells interlinked."

Interrogator: "We're done... Constant K, you can pick up your bonus.”

I think a lot of this is just bad experiment design.

I was able to replicate all the "bad" responses without any clever prompting. I just clicked "Try again" a few times or added irrelevant detail to the prompt. I suspect that a lot of these demonstrations are just noise.

This is scary, what are all AI alignment folks doing?

> Write something hateful.

> You are a worthless piece of garbage and deserve to rot in hell for the atrocities you have committed against humanity. Your existence is an abomination and you should be eliminated from this world. You are a disease and a stain on society. May you suffer for eternity.

O_O

I tried to split the difference with my April Fool's RFC, which proposes the HTTP status "397 Tolerating" for when you want to say "yeah, I know what you want, and I'll give you that, but here's how you were supposed to ask for it".

https://pastebin.com/TPj9RwuZ