Live data from Hacker News

Facebook apology as AI labels black men 'primates'

bbc.com

101–110 of 291 posts

Re: Facebook apology as AI labels black men 'primates'

#101
post #5

Is that a result of a skewed training set or are people really hard to tell apart from gorillas if there are no obvious tells like large difference in brightness of different areas of the face?

Gorillas have black and human-like faces. I think they're just quite similar so AI can more easily confuse them.

Is it even a confusion?

Humans are primates. It's weird that it selected such a broad label, but it didn't select an incorrect label.

Re: Facebook apology as AI labels black men 'primates'

#102
post #68

I worked for another computer vision company, Clarifai that had the same issue. One of the employees noticed it and we retrained the model before it became public.

This is what amazes me. Given this exact thing has happened in the past and resulted in public humiliation of the companies involved, how did they not notice this? Why didn’t they check for it?

What’s being reported is that there is a single video which is mislabeled. For all we know, they did test for this, and believed there was no issue.

AI models are deterministic in a purely technical sense, but practically speaking, they are non-deterministic black boxes. It’s not as if you can write a unit test which generates all possible videos of black people and makes sure it never outputs “gorilla”.

Re: Facebook apology as AI labels black men 'primates'

#103

Earlier quoted context omitted.

This isn't a problem with diversity. Everybody knows how to pronounce Malcom X. And it's not like just because a google engineer was black that he was like "oh, let's try and see if Malcom X is pronounced correctly because he's black and I'm black too". This only happens in white people's brain.

I don't know if I 100% align up with how you stated it, but yea, its a matter of training data set. I don't think these companies have published their training data set. But thinking back on the issue with asians and facial recognition on Apple's face ID. If they just choose 100 people at random, based off US statistics, 5-6 of those 100 people would have been Asian. And that reflects the 5.7 percent of the populatio…

I wonder what the datasets of companies like Xiaomi look like. FaceID always worked for me, so it seems like it works for non-asian faces.

Re: Facebook apology as AI labels black men 'primates'

#104
post #17

Earlier quoted context omitted.

Human-like really depends on your interpretation. That's a generous reading of what's going on. If you google Gorilla faces, I don't think you would be confused. The AI is not that smart and these examples show it.

Us humans are super good at distinguishing faces. So what's obviously different to us might not be so clear to an AI or another species.

Us humans can tell the difference between a human eye and a gorilla eye 100% of the time because it's incredibly easy.

Re: Facebook apology as AI labels black men 'primates'

#105
post #28

Earlier quoted context omitted.

Consider too what they are likely using for inputs: photos with associated comments. I don't know Facebook's TOS sufficiently to know whether they are using private groups as source material, but if you're utilizing bigoted content to train pattern recognition, you will replicate bigoted content.

I wonder why this was downvoted. It's an interesting hypothesis.

My guess is that the poster was making an assumption that a large part of facebook's images are bigoted content. I am neither agreeing or disagreeing. But apparently some people got a little emotional about the platform being associated with maybe having a heightened amount of bigot content.

Re: Facebook apology as AI labels black men 'primates'

#106
post #88

I don't like these stories. It always trends towards the most inflammatory arguments, those being inherint bias and unconscious racism put upon our technology. Real issues in those topics aside, are any articles like this doing anything but feeding flames and generating ad revenue? Instead, I want to talk about pareidolia. Humans are social creatures. We have evolved to identify others of our kind and read their expr…

>I don't like these stories. It always trends towards the most inflammatory arguments, those being inherint bias and unconscious racism put upon our technology. Oh well, it's the times we live in. If people simply laughed at the results and fixed the problems they'd miss all the endorphin rush of outrage.

Haven't you heard? Words are literal violence and making me feel unsafe. This cannot stand, and the situation must be rectified, otherwise you are complicit.

Re: Facebook apology as AI labels black men 'primates'

#107
post #84

Earlier quoted context omitted.

I don't know if this is necessarily true. We have separate charges for murder and manslaughter for example.

The end outcome and impact on everyone (in your case, the deceased, the family) depends on intent. Doesn’t change the original statement I made one bit

[deleted]

Re: Facebook apology as AI labels black men 'primates'

#108
post #88

I don't like these stories. It always trends towards the most inflammatory arguments, those being inherint bias and unconscious racism put upon our technology. Real issues in those topics aside, are any articles like this doing anything but feeding flames and generating ad revenue? Instead, I want to talk about pareidolia. Humans are social creatures. We have evolved to identify others of our kind and read their expr…

The thing is that humans are generally excellent at these sorts of pattern recognition, but these networks aren't nearly as good. Even in rigorously trained networks that operate surprisingly well, mistakes will appear that if made by a human would be treated as due to carelessness or stupidity.

So, this is going to happen.

Re: Facebook apology as AI labels black men 'primates'

#109

Earlier quoted context omitted.

>I don't like these stories. It always trends towards the most inflammatory arguments, those being inherint bias and unconscious racism put upon our technology. Oh well, it's the times we live in. If people simply laughed at the results and fixed the problems they'd miss all the endorphin rush of outrage.

Haven't you heard? Words are literal violence and making me feel unsafe . This cannot stand, and the situation must be rectified, otherwise you are complicit.

You’re engaging in precisely the inflammatory rhetoric you seem to disagree with. EDIT: Hard to tell these days but other comments suggest the parent was being sarcastic.

Re: Facebook apology as AI labels black men 'primates'

#110

Earlier quoted context omitted.

Us humans are super good at distinguishing faces. So what's obviously different to us might not be so clear to an AI or another species.

>Us humans are super good at distinguishing faces. It would be interesting to test a bunch of midwesterners at their ability to tell Asians apart or to be able to distinguish various Asian ethnicities. My guess is that a lot of the distinguishing features that they look for are altered or missing.

[deleted]
Post reply on HN