Live data from Hacker News

Facebook apology as AI labels black men 'primates'

bbc.com

211–220 of 291 posts

Re: Facebook apology as AI labels black men 'primates'

#211
post #84

Earlier quoted context omitted.

I don't know if this is necessarily true. We have separate charges for murder and manslaughter for example.

The end outcome and impact on everyone (in your case, the deceased, the family) depends on intent. Doesn’t change the original statement I made one bit

If you misinterpret someone's intent and the only outcome is a subjective emotion, that's all on you. So yes, intent matters.

https://www.youtube.com/watch?v=3Lyex2tSUyA

Re: Facebook apology as AI labels black men 'primates'

#212
post #208

Earlier quoted context omitted.

> sorry it seems discussion about solutions to racial issues isn't welcome here Oddly it seems like you are the person who doesn't want to have a discussion. You stated " As an ML engineer I can tell you confidently here's how you fix these systems " and people critiqued your solution. Is that not being open to discussion?

Critiques and debates are fine, but downvotes don't encourage discussion, they scream "shut up" and disincentivize speaking about the issue ever again, and downrank a viewpoint instead of leaving it up for fair discussion. Because presumably, if it works like many other systems, if you get downvoted enough, you probably get banned, so it means I should be scared to say what I said again. If people were interested in…

Okay. Why did you make an engineering discussion into a discussion about race?

Re: Facebook apology as AI labels black men 'primates'

#213

This happens because there are no black people of consequence in the ML pipeline. In my previous company Everytime we built a new model, a bunch of us would test it. Being the only black person in the company, I often found some very odd things and we would correct it before shipping. I understand that fb is a much bigger scale, but all the reason to have a much more diverse set of eyes to test their models before th…

It's not obvious to me what black people would have done to fix this specific problem. Would they have said "oh we should make sure to test the algorithm on blurry images of people in a forest and make sure it doesn't get confused"?

Re: Facebook apology as AI labels black men 'primates'

#214
post #88

I don't like these stories. It always trends towards the most inflammatory arguments, those being inherint bias and unconscious racism put upon our technology. Real issues in those topics aside, are any articles like this doing anything but feeding flames and generating ad revenue? Instead, I want to talk about pareidolia. Humans are social creatures. We have evolved to identify others of our kind and read their expr…

I think your comment is a bit dismissive. Facebook is not the first to encounter this, it happened 6/7 years ago and they should have known better. Secondly, if the Data Scientist working on this were all black, this would not have happened, just like the automatic soap dispensers in bathrooms.

Why would that be true? I don't understand the argument that black people would have avoided this.

From what I can tell the only fix here is a hardcoded workaround outside the net, or a substantially more powerful architecture.

Re: Facebook apology as AI labels black men 'primates'

#215
post #137

Earlier quoted context omitted.

Is that a real question? Of course it will happen. In this particular case there was a single misclassified video reported in the article.

Yes it's a real question, since there's nothing that says that a particular misclassification must happen. Watching cars go by on the road, one might suspect that at least one is driven by an alligator, but nothing says that it must be, per se, even the law of large numbers.

Nobody said this particular misclassification must occur. But there will be misclassifications, which is what your original question asked. Since you know the answer, why ask the question? That's why I asked you if what you asked was a real question.

Re: Facebook apology as AI labels black men 'primates'

#216
post #204

Earlier quoted context omitted.

"(name) (Roman numeral)" is a much more commong occurence than "(name) (Single letter spelled out)". So to answer your question, this one. This universe. And no, nobody "programmed this". I don't know how anyone of decent technical competence can think that. The workaround has likely been hardcoded in some way, if anything. How can you possibly think that someone at google decided it would be funny to program, on pur…

> "(name) (Roman numeral)" is a much more commong occurence than "(name) (Single letter spelled out)" > So to answer your question, this one. This universe. But this is true in this universe only in some countries and places. There are many countries and places where an initial would follow the name and it is the legal name. This is precisely the problem with the data/algorithm as well as your argument. They’re not w…

Cultural sensitivity, you mean. If it mispronounced a random non-icon's name everyone would chuckle and forget about it.

Pattern matchers don't understand culture, so this is gonna be a hard-coded workaround or intentional distortion of dataset to try and achieve the hard-coded workaround.

Re: Facebook apology as AI labels black men 'primates'

#217

This happens because there are no black people of consequence in the ML pipeline. In my previous company Everytime we built a new model, a bunch of us would test it. Being the only black person in the company, I often found some very odd things and we would correct it before shipping. I understand that fb is a much bigger scale, but all the reason to have a much more diverse set of eyes to test their models before th…

It's not obvious to me what black people would have done to fix this specific problem. Would they have said "oh we should make sure to test the algorithm on blurry images of people in a forest and make sure it doesn't get confused"?

"I uploaded my picture and it says I'm a monkey"

"Oh, maybe we should look into that"

Re: Facebook apology as AI labels black men 'primates'

#218

nothing important in the world should RELY on a AI/nn/ml.

This feature was not of any importance. It just asks the viewer if they want to see more or less of a certain kind of video.

yes, and now imagine if the feature was important. like sorting job applications, or medical diagnosis, or (dramatic pause) driving. Lots of organizations are looking at ways of completely removing humans from their decision making processes. 99% certainty rates would be fantastic unless you are in the 1% false positive/negative group

Re: Facebook apology as AI labels black men 'primates'

#219

Earlier quoted context omitted.

> it looks racist even though it really isn't It absolutely is racist. Racist outcomes are still racist regardless of whether there's a guy in Klansmen robes at the steering wheel or not.

How is it a racist outcome? This has nothing to do with the belief that one "race" is inherently better than another. It's a simple categorization error due to insufficient training data.

It's a racist outcome because racists have a long history of comparing black people to primates, and because this results in a service that's actively worse and less useful for black people than those of other ethnicities.

Also, a 'simple error' performed by company with absurd amounts of money and several extremely public examples from its peer companies as to what not to do is, at that point, more negligence than anything.

Re: Facebook apology as AI labels black men 'primates'

#220
post #204

Earlier quoted context omitted.

"(name) (Roman numeral)" is a much more commong occurence than "(name) (Single letter spelled out)". So to answer your question, this one. This universe. And no, nobody "programmed this". I don't know how anyone of decent technical competence can think that. The workaround has likely been hardcoded in some way, if anything. How can you possibly think that someone at google decided it would be funny to program, on pur…

> "(name) (Roman numeral)" is a much more commong occurence than "(name) (Single letter spelled out)" > So to answer your question, this one. This universe. But this is true in this universe only in some countries and places. There are many countries and places where an initial would follow the name and it is the legal name. This is precisely the problem with the data/algorithm as well as your argument. They’re not w…

The comment i was replying to straight up claimed this was done with intent.

I agree with you, the algorithm needs to have more context sensitivity as you say. But nobody at google is getting their rocks off making the AI mispronounce things on purpose.

Especially since, as anyone who used Google Maps in multilingual areas will attest, the algorithm is awful at dealing with context in general. It mispronounces tons of things. In Belgium it will switch between dutch and french names for streets randomly.

Google Maps canonicalizes my address in Dutch, so whenever i input it on a website i have to deal with it "helpfully" "correcting" it to dutch. Which makes things difficult when I have to deal with French speakers...

Google Maps has a lot of problems that are causing real harm to non-us cultures, which would likely get fixed with diversity. But i would never claim these things are done on purpose.

Post reply on HN