Live data from Hacker News

My Conversation with “Eugene Goostman”

scottaaronson.com

11–20 of 81 posts

Re: My Conversation with “Eugene Goostman”

#11
Based on this article, if 33% of the judges were fooled maybe some better judges are in order.

It seems there are two ways to beat the Turing test. Come up with very clever algorithms or (probably easier) get some less discerning judges.

The whole thing reminds me of this: http://www.cleverbot.com/

Not Turing convincing, but I found it fun.

Re: My Conversation with “Eugene Goostman”

#12
post #11

Based on this article, if 33% of the judges were fooled maybe some better judges are in order. It seems there are two ways to beat the Turing test. Come up with very clever algorithms or (probably easier) get some less discerning judges. The whole thing reminds me of this: http://www.cleverbot.com/ Not Turing convincing, but I found it fun.

Yeah the Onion article writes itself:

"Turing test proves that 30% of judges are actually computers."

A recent Turing test at Reading University backfired after it was discovered that nearly a third of the apparently human judges were discovered to be less intelligent than a ZX Spectrum. Suspicions were raised when they were unable to carry on sophisticated conversations with the programs being tested and instead nattered on about banal topics such as their job, popular music, and another thing.

Ok I'm done. I don't write for free!

Anyway, Onion writers, make it happen.

Re: My Conversation with “Eugene Goostman”

#13

There is nothing about Eugene that is useful to the advancement of actual AI, to our understanding of intelligence. Advanced chatbots are a parlor trick, the same way that rabbit and hat tricks do not help us develop actual teleportation systems, however clever and convincing they might seem to credulous people. The difference between a trick and a technology, of course, is usefulness. Can your software do something…

Could you explain why advances in chatbots aren't helpful for advances in artificial intelligence?

Completely lay perspective but couldn't applying machine learning to a very large number of conversations (top down analysis) with a large library of base content (bottoms up) using AIML or another language start to create something useful for many sectors?

Like customer support, education, entertainment, information retrieval navigating sites and apps...etc.

I don't know much about the space but have been intrigued by chatbots since I was a kid.

Re: My Conversation with “Eugene Goostman”

#14
I think it's important to acknowledge the distinction between chatting to a bot and not being convinced that it's a human, and having two conversations simultaneously, one of which is with a human, one with a computer, and figuring out which is which. Humans too can be surprisingly obtuse, go off at tangents, ignore your points, be boring and repeat themselves.

As for the questions around the utility - automating support functions for various non-critical services seems like an obvious potential application (think of all those "click here to chat to a live representative" dialogs on various websites).

Re: My Conversation with “Eugene Goostman”

#16
post #11

Based on this article, if 33% of the judges were fooled maybe some better judges are in order. It seems there are two ways to beat the Turing test. Come up with very clever algorithms or (probably easier) get some less discerning judges. The whole thing reminds me of this: http://www.cleverbot.com/ Not Turing convincing, but I found it fun.

Getting better judges would spoil the point of this event, namely to drum up some free publicity for the organizers. Alan Turing would probably be depressed at having his name associated with all these silly events.

Re: My Conversation with “Eugene Goostman”

#17

There is nothing about Eugene that is useful to the advancement of actual AI, to our understanding of intelligence. Advanced chatbots are a parlor trick, the same way that rabbit and hat tricks do not help us develop actual teleportation systems, however clever and convincing they might seem to credulous people. The difference between a trick and a technology, of course, is usefulness. Can your software do something…

Could you explain why advances in chatbots aren't helpful for advances in artificial intelligence? Completely lay perspective but couldn't applying machine learning to a very large number of conversations (top down analysis) with a large library of base content (bottoms up) using AIML or another language start to create something useful for many sectors? Like customer support, education, entertainment, information re…

For instance, that is the aim of IBM's Watson project. Certainly, if you create a program capable of answering useful questions (a "deep QA" system), then that is a praise-worthy effort. But that is not the aim of chatbots, which are not QA systems or automated support systems.

In fact, advanced QA systems will probably never be convincingly human, as they are designed to be useful rather than to trick people. Watson is a good example of this.

Re: My Conversation with “Eugene Goostman”

#18

Lmao that people are still taking AI seriously.

What exactly are you suggesting with the implication that people shouldn't take AI seriously? That AI research is a waste of time and money? That "strong AI," however it's defined, will never happen?

Re: My Conversation with “Eugene Goostman”

#19
I had an actual conversation with Eugene Goostman as if I was meeting a 13 year old from the Ukraine.

And Eugene nailed it. He introduced himself, ask me polite questions, I asked him polite questions, and we developed a slightly broken conversation, but yes, a conversation.

The idea of this is not "try to break the robot", the idea is "if you ran into this robot in real life and it was masquerading as a human, would you be tricked?"

That's the REAL question.

Post reply on HN