Live data from Hacker News

Poor Software QA Is Root Cause of TAY-Fail (Microsoft's AI Twitter Bot)

exploringpossibilityspace.blogspot.com

31–40 of 57 posts

Re: Poor Software QA Is Root Cause of TAY-Fail (Microsoft's AI Twitter Bot)

#32

If I were developing a chatbot, I wouldn't provide it with a blank slate and leave it to the mercy of 4chan users. I'd give it a personality and a set of values and a rudimentary understanding of how the world works.

> I'd give it a personality and a set of values and a rudimentary understanding of how the world works.

I don't think you have any idea how complicated such a task would be.

Re: Poor Software QA Is Root Cause of TAY-Fail (Microsoft's AI Twitter Bot)

#33
post #30
post #27

I am not understanding the spin that is being displayed in general with regards to Tay. Microsoft created a chat bot, the chat bot chatted. It wasnt a failure on any technical level as far as i have seen.

It's a failure of censorship. Like someone else pointed out, they should have had a simple blacklist of certain words.

That's not as easy as it seems. See:

https://en.wikipedia.org/wiki/Scunthorpe_problem

and

http://stackoverflow.com/questions/273516/how-do-you-impleme...

Re: Poor Software QA Is Root Cause of TAY-Fail (Microsoft's AI Twitter Bot)

#34
post #14

'Learning from the internet' was destined to fail. The internet is filled with so much sarcasm, so many memes and trolling that this was inevitable. Their whole premise just sucked. And of course, once people realized they could influence the bot, everyone just upped the level of trolling... On the plus side, I was entertained. I'm sure many people were (maybe not Microsoft investors). It was pretty damn hilarious.

As Linus said "the people have spoken, and most of it was complete gibberish".

Re: Poor Software QA Is Root Cause of TAY-Fail (Microsoft's AI Twitter Bot)

#35
post #33
post #30

Earlier quoted context omitted.

It's a failure of censorship. Like someone else pointed out, they should have had a simple blacklist of certain words.

That's not as easy as it seems. See: https://en.wikipedia.org/wiki/Scunthorpe_problem and http://stackoverflow.com/questions/273516/how-do-you-impleme...

You certainly can't make it perfect, but in this case, where the submitter is effectively anonymous and they're not paying for the service, you should be able to justify the occasional false positive.

Re: Poor Software QA Is Root Cause of TAY-Fail (Microsoft's AI Twitter Bot)

#36
post #27

I am not understanding the spin that is being displayed in general with regards to Tay. Microsoft created a chat bot, the chat bot chatted. It wasnt a failure on any technical level as far as i have seen.

Do you really not understand that there are failures other than "the chat bot chatted so its ok"? Do you not realise there might be other requirements for software than "it kind of appears to do roughly what someone asked for"?

Re: Poor Software QA Is Root Cause of TAY-Fail (Microsoft's AI Twitter Bot)

#37
post #35
post #33

Earlier quoted context omitted.

That's not as easy as it seems. See: https://en.wikipedia.org/wiki/Scunthorpe_problem and http://stackoverflow.com/questions/273516/how-do-you-impleme...

You certainly can't make it perfect, but in this case, where the submitter is effectively anonymous and they're not paying for the service, you should be able to justify the occasional false positive.

It wouldn't result in a very smart or fun AI. Tay was supposed to be fun because of its intelligence. Throwing a braindead solution intended for dumb forum software would run counter to the project's goals in my opinion.

Re: Poor Software QA Is Root Cause of TAY-Fail (Microsoft's AI Twitter Bot)

#38
post #33
post #30

Earlier quoted context omitted.

It's a failure of censorship. Like someone else pointed out, they should have had a simple blacklist of certain words.

That's not as easy as it seems. See: https://en.wikipedia.org/wiki/Scunthorpe_problem and http://stackoverflow.com/questions/273516/how-do-you-impleme...

Oh, thanks for the references. I'm constantly astonished at how people can think "filter bad words" would fix everything. In some instances of Tay tweets, there are comparisons between black men and monkeys. What words should you forbid? Black, man, or monkey? Should the bot be allowed to speak about people of color visiting a zoo?

Re: Poor Software QA Is Root Cause of TAY-Fail (Microsoft's AI Twitter Bot)

#39
Interestingly, I think if we were doing a better job of identifying abusive and asshole comments on our giant social media platforms, we could build a kind of internal filter for such a chat bot. Learn an "asshole comment" classifier, and then have the chat bot ask itself, will I sound like an asshole before each utterance... As a bonus, the classifier would also be great for providing social media moderation tools, at the same time.

Re: Poor Software QA Is Root Cause of TAY-Fail (Microsoft's AI Twitter Bot)

#40

If I were developing a chatbot, I wouldn't provide it with a blank slate and leave it to the mercy of 4chan users. I'd give it a personality and a set of values and a rudimentary understanding of how the world works.

> I'd give it a personality and a set of values and a rudimentary understanding of how the world works. I don't think you have any idea how complicated such a task would be.

Here's a start.

https://en.wikipedia.org/wiki/Wikipedia:List_of_controversia...

Not a neural-net cure all, for sure. But took me precisely ten seconds to find and would've prevented this whole situation.

Post reply on HN