I would like to see the Turing Test turned on its head ... the human has to convince the computer it is talking to another computer.
My Conversation with “Eugene Goostman”
21–30 of 81 posts
Re: My Conversation with “Eugene Goostman”
#22I had an actual conversation with Eugene Goostman as if I was meeting a 13 year old from the Ukraine. And Eugene nailed it. He introduced himself, ask me polite questions, I asked him polite questions, and we developed a slightly broken conversation, but yes, a conversation. The idea of this is not "try to break the robot", the idea is "if you ran into this robot in real life and it was masquerading as a human, would…
Re: My Conversation with “Eugene Goostman”
#23I would also add, that the real prove must include a topic that the artificial person was not programmed for. (not like a Bayesian filter that "develops" by "learning" new facts about a fixed topic).
Learning, developing, evolving, that are the real marks of living and of intelligence (since, I would not part between intelligence and living).
Re: My Conversation with “Eugene Goostman”
#24I had an actual conversation with Eugene Goostman as if I was meeting a 13 year old from the Ukraine. And Eugene nailed it. He introduced himself, ask me polite questions, I asked him polite questions, and we developed a slightly broken conversation, but yes, a conversation. The idea of this is not "try to break the robot", the idea is "if you ran into this robot in real life and it was masquerading as a human, would…
Re: My Conversation with “Eugene Goostman”
#25Drop in 19 people and 1 AI into a chatroom, and then try to determine who is the AI. A lot of these adversarial questions may come off looking more like an aggressive AI than a human.
Re: My Conversation with “Eugene Goostman”
#26I would like to see the Turing Test turned on its head ... the human has to convince the computer it is talking to another computer.
I would get tired of typing "Invalid syntax."
Good point, but put yourself in the computer's shoes. If I were an artificial computer, talking to a human would drive me insane.
Re: My Conversation with “Eugene Goostman”
#27I had an actual conversation with Eugene Goostman as if I was meeting a 13 year old from the Ukraine. And Eugene nailed it. He introduced himself, ask me polite questions, I asked him polite questions, and we developed a slightly broken conversation, but yes, a conversation. The idea of this is not "try to break the robot", the idea is "if you ran into this robot in real life and it was masquerading as a human, would…
Think of it this way. If you want to learn what constitutes strong chess play, will you learn best from playing a) yourself or b) a much stronger player?
Having a "collaborative" exchange with a chatbot is of the same strength as playing chess with yourself, for the purposes of investigating what "thinking" consists of.
The Turing Test is useful precisely when we are trying to "break the bot" as you put it; in fact, when the bot is pitted against a real human, who in that contest plays the role of the chess master.
Saying that Eugene Goostman "passed the Turing Test" is like crowning me World Chess Champion, based on the amazing record of beating 70% of a random sample of six year olds.
> "if you ran into this robot in real life
You wouldn't ever "run into" Eugene Goostman in real life, because it lacks the kind of generalist problem solving ability that would allow it to insert itself into any "real life" situation - an ability that even six year olds possess. It literally couldn't even get out the gate.
Re: My Conversation with “Eugene Goostman”
#28The comments below the blog post also demonstrate much better conversation than the chatbot, and answer some questions that I had as a reader when I had only read the blog post itself. Friendly groups of human beings (as here on Hacker News) still provide much better conversation than chatbots. Accept no substitutes.
Re: My Conversation with “Eugene Goostman”
#29A twist on the Turing Test that would be fun. Drop in 19 people and 1 AI into a chatroom, and then try to determine who is the AI. A lot of these adversarial questions may come off looking more like an aggressive AI than a human.
For example, one person says "everyone repeat your username", so everyone does. Of course, the one who said this could be the bot, so another person would then have to put forth a different challenge (something similar -- repeat your username backwards, or something).