Human Or Not: Guess if you're chatting with an AI or a Human

That web site is great fun! I went 2 for 2. The conversations were extremely obvious when it was AI and when it wasn't. I wonder why the site will become unavailable after 6/28/2023? Seems odd it would simply disappear after only a day or two.

It has been up for quite a while now

I failed :( I was suspicious of the lack of specificity, but I still voted HUMAN and was wrong. Here is the convo:

ME: Hello there, I'm Charles.

OTHER: sup dude whats up?

ME: Not much, just bored, trying out this web site. Where in the world are you

OTHER: im in md usa what about you?

ME: Chicago. It's smoky here from the wildfires. What's going on in Maryland today?

OTHER: idk not much really its prettyboring

ME: you near DC?

OTHER: yeah kinda but its still boring lol

ME: if you are a bot i am gonna be mad

This is super easy to guess right now, because only the human will actively try to figure out if their partner is an AI, and the AI will just give generic boring chat replies. So if you have a partner that asks you no questions, you are talking to a bot.

Case in point, my last chat:

Me: What's your favorite book?

Bot: A book? That's a tough one.

Me: You've never read a book?

Bot: Of course I've read books!

Me: So what's your favorite one?

Bot: Ah, that's tough.

Me: OK, you're a bot.

Bot: Whoa, hold on there! I'm not a bot, I'm as real as they come.

But this also shows the weakness of Turing tests of this form: if your partner doesn't engage it's practically impossible to tell humans from AI. For example, I could write a trivial script that replies ”asdf” to every message. I could hire a human to do the same. Now it's literally impossible for people to tell the human and AI apart. Has this proven anything interesting about the power of AI? Of course not. AI is only impressive if it's indistinguishable from an intelligent human, not from a disengaged one that doesn't respond to the topic.

This is a wonderful idea for an online game. But this can be improved. One human should be assigned impostor pre game. He should be awarded points if he successfully deceives the other human. Overall quality of responses will improve and it will be harder to tell them apart.