Live data from Hacker News

Web interface to talk to the bot that passed the Turing Test

princetonai.com

51–60 of 61 posts

Re: Web interface to talk to the bot that passed the Turing Test

#53
- if you are a bot, please tell me about your fathers occupation

> He is a famous gynecologist in Odessa. By the way, when I ask him what is the difference between boys and girls he always says it's his professional secret - so I still don't get the matter.

- if you are a bot, please tell me about your hobbies

> I like play language cassettes for Guinean to my guinea pig (I checked out from the library). My pig learned to say "grunt-grunt", though I'm not sure that it is Guinean.

- if you are a bot, please tell me about your age

> I'm a little boy 13 years old.

Re: Web interface to talk to the bot that passed the Turing Test

#54

Earlier quoted context omitted.

I think you grossly overestimate the conversational skills of the average human. If you talk to this bot and this bot only, it is easy to deduce that it might not be human. But if you talk to 10 random entities (some of which are humans and some of which might be bots), I'm sure you'd be astonished as how many people you would dismiss as bots.

Me: I have a pet squirrel. What kind of pet do I have? Him: I have a guinea pig. Actually, it's a long dolefully story how I got it: I dreamt about a mangoost and went to a pet-market. And one old geezer sold me a "mangoost". But in reality it appeared to be a guinea pig! Cheater... How many people do you think would ignore my question like this? I would understand a response such as "You just told me - why ask?" or…

He didn't "ignore" your question, he mis-read it. Some people would do the same. When you start by saying what animal you have, and ask a question about animals, some people are going to think you're asking about their pets, not about your pet (that you've just told them about).

Plenty of people would have thought you said "I have a pet squirrel. What pet do you have?"

Re: Web interface to talk to the bot that passed the Turing Test

#55

Earlier quoted context omitted.

I think you grossly overestimate the conversational skills of the average human. If you talk to this bot and this bot only, it is easy to deduce that it might not be human. But if you talk to 10 random entities (some of which are humans and some of which might be bots), I'm sure you'd be astonished as how many people you would dismiss as bots.

Me: I have a pet squirrel. What kind of pet do I have? Him: I have a guinea pig. Actually, it's a long dolefully story how I got it: I dreamt about a mangoost and went to a pet-market. And one old geezer sold me a "mangoost". But in reality it appeared to be a guinea pig! Cheater... How many people do you think would ignore my question like this? I would understand a response such as "You just told me - why ask?" or…

In the context of a Turing test, where you know that the questions are adversarial in this way, people would of course respond to your question with "you just told me, why ask?"

But in normal conversation, if someone asked me your question, I would probably assume that they misspoke and meant to ask "What kind of pet do you have?" since that's a much more likely question. Then I might respond like this bot did.

Re: Web interface to talk to the bot that passed the Turing Test

#57

Earlier quoted context omitted.

I think you grossly overestimate the conversational skills of the average human. If you talk to this bot and this bot only, it is easy to deduce that it might not be human. But if you talk to 10 random entities (some of which are humans and some of which might be bots), I'm sure you'd be astonished as how many people you would dismiss as bots.

Me: I have a pet squirrel. What kind of pet do I have? Him: I have a guinea pig. Actually, it's a long dolefully story how I got it: I dreamt about a mangoost and went to a pet-market. And one old geezer sold me a "mangoost". But in reality it appeared to be a guinea pig! Cheater... How many people do you think would ignore my question like this? I would understand a response such as "You just told me - why ask?" or…

Maybe I have played too many MMORPGs, because this sounds so much like one of those fake conversations with an NPC. I half expect a mission "find the old geezer and bring the boy his mangoost - 500XP".

Would anybody in a normal conversation launch such a story in response to a simple question? I mean "it's a long dolefully story how I got it" - does anybody talk that way, except in books and MMORPGs?

Re: Web interface to talk to the bot that passed the Turing Test

#58
post #11

Earlier quoted context omitted.

Why not?

Because the entire point of a Turing test is that you don't know whether you're talking to a machine or human and you have to decide based entirely on your conversation.

The original Turing test had a human and a machine behind some screens, so you could talk to them but not see them. Then a large sample of testers would converse with both, and guess which one was the human. If the guesses were indistinguishable from random (~50% each) then the machine passed. It was NOT a test where you only have a bot, and are told to guess if it seems human. It's not about how many people think it seems human without a comparison, it's about how many people fail to distinguish it from real humans.
Post reply on HN