Live data from Hacker News

Response by Ray Kurzweil to chatbot Eugene Goostman “passing the Turing test”

kurzweilai.net

41–50 of 164 posts

Re: Response by Ray Kurzweil to chatbot Eugene Goostman “passing the Turing test”

#42
post #3

This is a nicely written and clear explanation of why the announcement by the University of Reading is bullshit. In fact, it is was more than they deserve. Way more. I would suggest shunning them is the right response. The University of Reading is, of course, the august institution behind: http://blog.jgc.org/2010/05/inside-rfid-virus.html http://blog.jgc.org/2006/12/midas-number-or-why-divide-by-ze...

What does the term "august institution" mean. Can't find any good definitions on google.

au·gust adjective \ȯ-ˈgəst, ˈȯ-(ˌ)gəst\

: having a formal and impressive quality

http://www.merriam-webster.com/dictionary/august

Re: Response by Ray Kurzweil to chatbot Eugene Goostman “passing the Turing test”

#43
post #20

I'm surprised by the impact of Eugene. After trying the web interface I felt like myself could have written a similar chatter bot that of course would have been ignored by everyone, with good reason.

Yep. I've seen IRC bots in 2004 with similar levels of 'intelligence'.

Re: Response by Ray Kurzweil to chatbot Eugene Goostman “passing the Turing test”

#44

The answers Ray got back are borderline embarrassing. They're designed to deflect the question by ignoring the request and asking another unrelated question or deflecting by humor. These are common ploys in faking AI chat. Hell, what 13 yo calls himself a "little boy?" I was in 8th grade at 13 and looking forward to high school. I can't imagine calling myself a "little boy" at an age when some of my peers were sexual…

"""I think this proves that the Turing Test is more or less crap. Humans, who are easily fooled/socially engineered, can't just decide that "this is AI," like its some kind of American Idol-like contest. There should be some rational metric at work here. A bunch of different tests and human judgement as only one part of the testing suite."""

I think the easiest fix is to crowd source the Turing test. If you can fool 95% of all people chatting with you over a sample of >100k people you're probably pretty good.

Re: Response by Ray Kurzweil to chatbot Eugene Goostman “passing the Turing test”

#45

The answers Ray got back are borderline embarrassing. They're designed to deflect the question by ignoring the request and asking another unrelated question or deflecting by humor. These are common ploys in faking AI chat. Hell, what 13 yo calls himself a "little boy?" I was in 8th grade at 13 and looking forward to high school. I can't imagine calling myself a "little boy" at an age when some of my peers were sexual…

Indeed embarrassing. Actually, I can't believe that they called this chat-bot in any way intelligent. On top of that, this level of chat is the same since 90s, how come nothing has changed? And anyway, text chatting is/will never be a measure of intelligence, the Turing test in this form should never be considered.

You really need to live 13 years as a boy to be able to answer as one.

Re: Response by Ray Kurzweil to chatbot Eugene Goostman “passing the Turing test”

#46
post #23

'Apparently, we have now entered the era of premature announcements of a computer having passed Turing’s eponymous test' What this Eugene stuff has made me realize is that we need milestones around the Turing test in the pop-science lexicon, rather than just a pass fail. Kurzweil's right, this bot isn't a pass in anything like the spirit of the test. But, getting attention is a good thing. It encourages potential stu…

Getting attention like this is a bad thing. AI has been oversold for decades and stunts like this make real AI efforts look bad. That's one of the reasons I presume Kurzweil is very sharp to denounce this, the last thing we need is a re-run of the AI winter courtesy of some University hot for some attention.

Let me try to phrase that differently. I'm not trying to legitimize bad stunts. I'm suggesting giving them a legitimate way of getting that PR instead.

Researchers, hobbyists and porn sellers working on chatbots. The definition of success is the Turing test. To give themselves goals and brag about those goals in media, they enter Turing test contests and try to get a "passing" score relatively to arbitrary definitions of pass.

Some will inevitably get overenthusiastic about the achievements. It will go int the press and that's where overpraising wolf crying comes from.

I propose to fixe this by giving contestants a legitimate target to aim for. Something that naturally produces PR fodder in 256 characters. "New Chatbot achieves 38% on the Eugene-13 Turing Test." That could mean something real and honest.

Some variants of the test are complete BS. Some are not. They may not be an indication of consciousness (that's what the one we've got is for) but beating our previous best does represent a legitimate milestone.

A lot of them could be interesting. Some variants of the test could focus on tasks/scenarios. For example, an AI receptionist. Others (maybe Eugene-13) could be a handicap version to the real Turing test.

Re: Response by Ray Kurzweil to chatbot Eugene Goostman “passing the Turing test”

#47
post #3

This is a nicely written and clear explanation of why the announcement by the University of Reading is bullshit. In fact, it is was more than they deserve. Way more. I would suggest shunning them is the right response. The University of Reading is, of course, the august institution behind: http://blog.jgc.org/2010/05/inside-rfid-virus.html http://blog.jgc.org/2006/12/midas-number-or-why-divide-by-ze...

There's not much wrong with the University of Reading.

Kevin Warwick, on the other hand is a complex character who errs on the side of hype and unjustified self-publicity much too often. He is not taken very seriously in academic AI and robotics, except when he causes a collective face-palm with claims like this.

The press release people at Reading, or pretty much anywhere else, do not have the skills to assess whether their professor is begin daft or not.

Re: Response by Ray Kurzweil to chatbot Eugene Goostman “passing the Turing test”

#48
post #31

I think most people misunderstand the intent of Turing's paper in which he describes his eponymous test. I agree with Chomsky's reading, which he laid out in "Language & Thought": "There is a great deal of often heated debate about these matters in the literature of the cognitive sciences, artificial intelligence, and philosophy of mind, but it is hard to see that any serious question has been posed. The question of…

>Fooling people into mistaking a submarine for a whale doesn't show that submarines really swim

Why not? Presumably part of the act of fooling would involve 'swimming' submarines.

I think passing a __strong__ Turing test actually does say something about our brains, cognition, and consciousness. And by a 'strong Turing test', I don't mean dinky 5 minute tests with a "Ukrainian boy". Imagine you carry on a 20 year relationship with a computer pen-pal, having in-depth discussions about every-day things from movies, to music, to sports to family and relationships. Imagine such a computer program fooling every human it interacts with for decades at a time, I think that would say something about ourselves and I think it would render the question of consciousness meaningless. If it quacks like a duck, looks like a duck, walks like a duck, and you can't tell the difference between it and a duck, it's a duck.

Another problem is that philosophers and even regular people tend to relish in ambiguity when it comes to certain ideas and concepts, even trying to elevate them to supernatural levels. Things like free will, love, or consciousness are apparently outside of the natural world, and not subject to natural laws. I think that's wrong. I think the answer is much simpler and much more humbling than we are willing to admit.

Re: Response by Ray Kurzweil to chatbot Eugene Goostman “passing the Turing test”

#49
post #46

Earlier quoted context omitted.

Getting attention like this is a bad thing. AI has been oversold for decades and stunts like this make real AI efforts look bad. That's one of the reasons I presume Kurzweil is very sharp to denounce this, the last thing we need is a re-run of the AI winter courtesy of some University hot for some attention.

Let me try to phrase that differently. I'm not trying to legitimize bad stunts. I'm suggesting giving them a legitimate way of getting that PR instead. Researchers, hobbyists and porn sellers working on chatbots. The definition of success is the Turing test. To give themselves goals and brag about those goals in media, they enter Turing test contests and try to get a "passing" score relatively to arbitrary definition…

As long as the butchers get to validate their own meat this won't happen. Nobody in the run for PR will allow you to rain on their parade with a 'not good enough'. Essentially what happened here is that the grades were lowered until there was a pass. If you set up shop next door and you refuse to lower the grades until there is a pass they'll go elsewhere, and claim victory.

Re: Response by Ray Kurzweil to chatbot Eugene Goostman “passing the Turing test”

#50
post #45

The answers Ray got back are borderline embarrassing. They're designed to deflect the question by ignoring the request and asking another unrelated question or deflecting by humor. These are common ploys in faking AI chat. Hell, what 13 yo calls himself a "little boy?" I was in 8th grade at 13 and looking forward to high school. I can't imagine calling myself a "little boy" at an age when some of my peers were sexual…

Indeed embarrassing. Actually, I can't believe that they called this chat-bot in any way intelligent. On top of that, this level of chat is the same since 90s, how come nothing has changed? And anyway, text chatting is/will never be a measure of intelligence, the Turing test in this form should never be considered. You really need to live 13 years as a boy to be able to answer as one.

I've seen better in the 90's.
Post reply on HN