Live data from Hacker News

Facebook apology as AI labels black men 'primates'

bbc.com

21–30 of 291 posts

Re: Facebook apology as AI labels black men 'primates'

#21
post #11
post #5

Is that a result of a skewed training set or are people really hard to tell apart from gorillas if there are no obvious tells like large difference in brightness of different areas of the face?

Skewed training set, very few dark skinned human faces.

Got a source for that?

Re: Facebook apology as AI labels black men 'primates'

#22
post #15

This happened to both Google Photos and Flickr too. Which makes it an inexcusable mistake to make in 2021 - how are you not testing for this? Google Photos in 2015: https://www.wired.com/story/when-it-comes-to-gorillas-google... Flickr in 2015: https://www.independent.co.uk/life-style/gadgets-and-tech/ne...

Google Photos solved the problem by simply returning no results for words like gorilla, monkey, primate, etc.

Re: Facebook apology as AI labels black men 'primates'

#23
post #15

This happened to both Google Photos and Flickr too. Which makes it an inexcusable mistake to make in 2021 - how are you not testing for this? Google Photos in 2015: https://www.wired.com/story/when-it-comes-to-gorillas-google... Flickr in 2015: https://www.independent.co.uk/life-style/gadgets-and-tech/ne...

Why are you so sure they aren't testing for it? Bias finds a way.

Re: Facebook apology as AI labels black men 'primates'

#24
post #20

Earlier quoted context omitted.

That's not how language works. We're also all animals but not animals at the same time. Context and culture affect the meaning of words.

Parent's point is not irrelevant though, did the AI label only people of one specific racial background as primates? The article doesn't really provide any details as it's only a few lines long. The word "primate" in itself is not a slur but it can be used as a slur, as you said, depending on the context, however not much context was given in the article.

That's interesting. It may have done the same with white people the same amount but nobody called the BBC to whine, or the BBC didn't care about that.

Re: Facebook apology as AI labels black men 'primates'

#27
post #15

This happened to both Google Photos and Flickr too. Which makes it an inexcusable mistake to make in 2021 - how are you not testing for this? Google Photos in 2015: https://www.wired.com/story/when-it-comes-to-gorillas-google... Flickr in 2015: https://www.independent.co.uk/life-style/gadgets-and-tech/ne...

Google Photos solved the problem by simply returning no results for words like gorilla, monkey, primate, etc.

I was just thinking about that. Unfortunately it just makes the bias harder to detect.

Once you search for these:

https://www.google.com/search?q=human+female+face&tbm=isch

https://www.google.com/search?q=human+male+face&tbm=isch

You can see that 'human face' has a bit of post-hoc tuning.

https://www.google.com/search?q=human+face&tbm=isch

Re: Facebook apology as AI labels black men 'primates'

#28
post #5

Is that a result of a skewed training set or are people really hard to tell apart from gorillas if there are no obvious tells like large difference in brightness of different areas of the face?

Deep learning, for all its recent glories, still suffers from relatively crude, slow-converging training algorithms compared to other areas of ML and statistics. Maybe to your typical SGD-type algorithm, working off a dataset filled with mostly light skin toned people, skin tone just looks like a real solid first-order way to distinguish humans and primates, and picking up the black people / primate distinction seems…

Consider too what they are likely using for inputs: photos with associated comments.

I don't know Facebook's TOS sufficiently to know whether they are using private groups as source material, but if you're utilizing bigoted content to train pattern recognition, you will replicate bigoted content.

Re: Facebook apology as AI labels black men 'primates'

#30
post #5

Is that a result of a skewed training set or are people really hard to tell apart from gorillas if there are no obvious tells like large difference in brightness of different areas of the face?

Gorillas have black and human-like faces. I think they're just quite similar so AI can more easily confuse them.

Now you've made me wonder what it thinks about albino gorillas.

e: I assume something similar has been done before by training a model on brown/black bears then throwing polar bears at it. Anyone know the outcome?

Post reply on HN