Live data from Hacker News

My Conversation with “Eugene Goostman”

scottaaronson.com

21–30 of 81 posts

Re: My Conversation with “Eugene Goostman”

#22

I had an actual conversation with Eugene Goostman as if I was meeting a 13 year old from the Ukraine. And Eugene nailed it. He introduced himself, ask me polite questions, I asked him polite questions, and we developed a slightly broken conversation, but yes, a conversation. The idea of this is not "try to break the robot", the idea is "if you ran into this robot in real life and it was masquerading as a human, would…

Will he pass the Voigt-Kampff?

Re: My Conversation with “Eugene Goostman”

#23
A real test of (Artificial) intelligence would be, must include that it is real capable of learning new things and developing and not trying to convince others that it has learned something (what in this case in my opinion is wrong, since it is just knowledge that is programmed into it -- meaning, not its own knowledge, but borrowed knowledge of the programmers).

I would also add, that the real prove must include a topic that the artificial person was not programmed for. (not like a Bayesian filter that "develops" by "learning" new facts about a fixed topic).

Learning, developing, evolving, that are the real marks of living and of intelligence (since, I would not part between intelligence and living).

Re: My Conversation with “Eugene Goostman”

#24

I had an actual conversation with Eugene Goostman as if I was meeting a 13 year old from the Ukraine. And Eugene nailed it. He introduced himself, ask me polite questions, I asked him polite questions, and we developed a slightly broken conversation, but yes, a conversation. The idea of this is not "try to break the robot", the idea is "if you ran into this robot in real life and it was masquerading as a human, would…

If I lived in a world where robots were masquerading as humans, I would probably be very suspicious of strangers.

Re: My Conversation with “Eugene Goostman”

#26
post #21
post #20

I would like to see the Turing Test turned on its head ... the human has to convince the computer it is talking to another computer.

I would get tired of typing "Invalid syntax."

> I would get tired of typing "Invalid syntax."

Good point, but put yourself in the computer's shoes. If I were an artificial computer, talking to a human would drive me insane.

Re: My Conversation with “Eugene Goostman”

#27

I had an actual conversation with Eugene Goostman as if I was meeting a 13 year old from the Ukraine. And Eugene nailed it. He introduced himself, ask me polite questions, I asked him polite questions, and we developed a slightly broken conversation, but yes, a conversation. The idea of this is not "try to break the robot", the idea is "if you ran into this robot in real life and it was masquerading as a human, would…

> The idea of this is not "try to break the robot"

Think of it this way. If you want to learn what constitutes strong chess play, will you learn best from playing a) yourself or b) a much stronger player?

Having a "collaborative" exchange with a chatbot is of the same strength as playing chess with yourself, for the purposes of investigating what "thinking" consists of.

The Turing Test is useful precisely when we are trying to "break the bot" as you put it; in fact, when the bot is pitted against a real human, who in that contest plays the role of the chess master.

Saying that Eugene Goostman "passed the Turing Test" is like crowning me World Chess Champion, based on the amazing record of beating 70% of a random sample of six year olds.

> "if you ran into this robot in real life

You wouldn't ever "run into" Eugene Goostman in real life, because it lacks the kind of generalist problem solving ability that would allow it to insert itself into any "real life" situation - an ability that even six year olds possess. It literally couldn't even get out the gate.

Re: My Conversation with “Eugene Goostman”

#28
Scott Aaronson here makes plain by example that human beings still have a big lead over chatbots in combining thoughtful examination of deep issues with humorous tone and sparkling language. I'll recommend to all of my friends that they read this submission.

The comments below the blog post also demonstrate much better conversation than the chatbot, and answer some questions that I had as a reader when I had only read the blog post itself. Friendly groups of human beings (as here on Hacker News) still provide much better conversation than chatbots. Accept no substitutes.

Re: My Conversation with “Eugene Goostman”

#29

A twist on the Turing Test that would be fun. Drop in 19 people and 1 AI into a chatroom, and then try to determine who is the AI. A lot of these adversarial questions may come off looking more like an aggressive AI than a human.

I do like the idea, but all it would require is at least 2 people putting forward group strategies.

For example, one person says "everyone repeat your username", so everyone does. Of course, the one who said this could be the bot, so another person would then have to put forth a different challenge (something similar -- repeat your username backwards, or something).

Post reply on HN