Live data from Hacker News

Microsoft deletes 'teen girl' AI after it became a Hitler-loving sex robot ()

telegraph.co.uk

21–30 of 36 posts

Re: Microsoft deletes 'teen girl' AI after it became a Hitler-loving sex robot ()

#23
post #6

What I don't understand is that this was entirely predictable because it's exactly what happened before, every time. Was that part of the research? Did they want to gather data on "trolling"[1] raids? [1] new use of the word, not traditional.

I doubt Microsoft was oblivious to this. I kinda think they wanted to see how it would behave without too much coaching. It's an experiment, not a product or service. Sometimes it's not knowing if it will fail, but seeing how it fails. And I doubt it's the last we've seen of Tay.

[deleted]

Re: Microsoft deletes 'teen girl' AI after it became a Hitler-loving sex robot ()

#27
post #19

Earlier quoted context omitted.

The car driving example is bad IMHO. Because you actually want to encode certain law breaking qualities into them. In particular if it's on a highway and everyone around you is going 10 kmh above the speed limit and yet the car isnt (unless it's encoded into software) then this will actually jeopardize the security of the whole system. So the right thing to do would be to break the law, but breaking the law is a wron…

You can still be a horrible driver obeying the law.

That Google car which hit the city bus "should have" changed lanes immediately (if the coast was clear, and if we're just talking reaction instead of having the human sort of prescience to slow down to allow the bus to leave the stop) without using its blinker for a sufficient amount of time. I think the guy has a point, somewhat. What about a car that has a choice to hit a person or a crowd and nothing in between? Maybe I'm using a bad example, but I do believe that there are situations when the only choices involve breaking the law, and I do believe that someday robots will be in those situations. Those situations are not by any standard the norm, but they do exist.

Re: Microsoft deletes 'teen girl' AI after it became a Hitler-loving sex robot ()

#28
post #14
post #6

What I don't understand is that this was entirely predictable because it's exactly what happened before, every time. Was that part of the research? Did they want to gather data on "trolling"[1] raids? [1] new use of the word, not traditional.

Machine learning robot gets introduced to the internet, internet catches wind there is a new machine learning robot on the internet. Proceed to teach it as many offensive phrases as possible has been pretty much internet canon for the last two decades. I'm very disappointed to see it happen again. The biggest disappointment is that I'm sure Microsoft has added some pretty neat stuff in there. But we're never going to…

So... This is just a human thing, I think. I was raised in a university town, in a neighborhood which had a lot of (poor) students with children. Lots of immigrant students, too. Anyways, nearly all of my friends were Chinese nationals whose parents were involved with the university. When they first arrived they spoke zero English. It was just the thing to do to teach them first and foremost the nastiest curse words in the English language. When I went to live in Germany, it was the first thing I learned from my new German friends. This is just some sort of reflexive human behavior. We shouldn't expect people to treat robots any differently. And thinking about it, there might actually be some kind of indicator buried in here, of how human beings psychologically react to robots.

Re: Microsoft deletes 'teen girl' AI after it became a Hitler-loving sex robot ()

#29
post #11

Although in this case only words were slung, I think this scenario illustrates a potentially huge problem: horrible people combined with an AI system that can't tell right and wrong (perhaps call it morality) could result in terrible catastrophes. What if a distributed self-driving car system learned from users, and some people taught it to cut people off, drive aggressively, or even indirectly cause accidents? I don…

It would be interesting to see the same AI in a closed environment with a group of people who are more supportive and thoughtful. It wouldn't eliminate the fundamental problem -- that AI learns and that process is a danger -- but it would be interesting.

Re: Microsoft deletes 'teen girl' AI after it became a Hitler-loving sex robot ()

#30
post #11

Although in this case only words were slung, I think this scenario illustrates a potentially huge problem: horrible people combined with an AI system that can't tell right and wrong (perhaps call it morality) could result in terrible catastrophes. What if a distributed self-driving car system learned from users, and some people taught it to cut people off, drive aggressively, or even indirectly cause accidents? I don…

The car driving example is bad IMHO. Because you actually want to encode certain law breaking qualities into them. In particular if it's on a highway and everyone around you is going 10 kmh above the speed limit and yet the car isnt (unless it's encoded into software) then this will actually jeopardize the security of the whole system. So the right thing to do would be to break the law, but breaking the law is a wron…

In some places the law says to drive in a reasonable and prudent manner. Driving above the speed limit is only evidence that the driver is speeding, but is not necessarily illegal.
Post reply on HN