Is that a result of a skewed training set or are people really hard to tell apart from gorillas if there are no obvious tells like large difference in brightness of different areas of the face?
Skewed training set, very few dark skinned human faces.
Facebook apology as AI labels black men 'primates'
21–30 of 291 posts
Re: Facebook apology as AI labels black men 'primates'
#22This happened to both Google Photos and Flickr too. Which makes it an inexcusable mistake to make in 2021 - how are you not testing for this? Google Photos in 2015: https://www.wired.com/story/when-it-comes-to-gorillas-google... Flickr in 2015: https://www.independent.co.uk/life-style/gadgets-and-tech/ne...
Re: Facebook apology as AI labels black men 'primates'
#23This happened to both Google Photos and Flickr too. Which makes it an inexcusable mistake to make in 2021 - how are you not testing for this? Google Photos in 2015: https://www.wired.com/story/when-it-comes-to-gorillas-google... Flickr in 2015: https://www.independent.co.uk/life-style/gadgets-and-tech/ne...
Re: Facebook apology as AI labels black men 'primates'
#24Earlier quoted context omitted.
That's not how language works. We're also all animals but not animals at the same time. Context and culture affect the meaning of words.
Parent's point is not irrelevant though, did the AI label only people of one specific racial background as primates? The article doesn't really provide any details as it's only a few lines long. The word "primate" in itself is not a slur but it can be used as a slur, as you said, depending on the context, however not much context was given in the article.
Re: Facebook apology as AI labels black men 'primates'
#25I mean... It's not wrong, we're all primates.
Re: Facebook apology as AI labels black men 'primates'
#26Re: Facebook apology as AI labels black men 'primates'
#27This happened to both Google Photos and Flickr too. Which makes it an inexcusable mistake to make in 2021 - how are you not testing for this? Google Photos in 2015: https://www.wired.com/story/when-it-comes-to-gorillas-google... Flickr in 2015: https://www.independent.co.uk/life-style/gadgets-and-tech/ne...
Google Photos solved the problem by simply returning no results for words like gorilla, monkey, primate, etc.
Once you search for these:
https://www.google.com/search?q=human+female+face&tbm=isch
https://www.google.com/search?q=human+male+face&tbm=isch
You can see that 'human face' has a bit of post-hoc tuning.
Re: Facebook apology as AI labels black men 'primates'
#28Is that a result of a skewed training set or are people really hard to tell apart from gorillas if there are no obvious tells like large difference in brightness of different areas of the face?
Deep learning, for all its recent glories, still suffers from relatively crude, slow-converging training algorithms compared to other areas of ML and statistics. Maybe to your typical SGD-type algorithm, working off a dataset filled with mostly light skin toned people, skin tone just looks like a real solid first-order way to distinguish humans and primates, and picking up the black people / primate distinction seems…
I don't know Facebook's TOS sufficiently to know whether they are using private groups as source material, but if you're utilizing bigoted content to train pattern recognition, you will replicate bigoted content.
Re: Facebook apology as AI labels black men 'primates'
#29Re: Facebook apology as AI labels black men 'primates'
#30Is that a result of a skewed training set or are people really hard to tell apart from gorillas if there are no obvious tells like large difference in brightness of different areas of the face?
Gorillas have black and human-like faces. I think they're just quite similar so AI can more easily confuse them.
e: I assume something similar has been done before by training a model on brown/black bears then throwing polar bears at it. Anyone know the outcome?