Live data from Hacker News

Google Photos AI still can't label gorillas after racist errors

theregister.com

61–70 of 74 posts

Re: Google Photos AI still can't label gorillas after racist errors

#61
post #49

Earlier quoted context omitted.

It classified 80 photos of the same black person as 'gorilla', I have not heard of that happening with white people.

I saw lots of examples of white children being classified as seals

Have a link to an example or two? I can't find any after a few minutes of searching.

Re: Google Photos AI still can't label gorillas after racist errors

#62
post #54

Both gorillas and black people have dark skin and reasonably flat features. The lack of contrast can make things hard the evaluate, especially if you're dealing with SDR content in a format that struggles to accurately encode darker colours. It's not racism, it's a lack of information to the evaluator and a failure of communication by the company. If they actually put out a statement regarding the technical issues ar…

Also a lot of the training set for “human” is on weird mutant albino humans who are over represented in images for historical reasons. It’s not offensive to look more like our relatives than the weird mutant albino alien looking creatures do, is it?

Re: Google Photos AI still can't label gorillas after racist errors

#63
post #20

I agree that blocking the feature is the smartest thing to do if people are going to get offended. It's idiotic to call it "racist", it's a shitty classifier, and it's incredibly irresponsible (and probably racist) as well as dismissive of actual racism to pretend that's racist. At the same time, I'm surprised they can't get this classifier to work. It doesn't seem like a very challenging problem (I'd consider myself…

Comically, the most potentially racist aspect (and I agree that having a bad classifier classify people as gorillas isn’t racist) is that Google hasn’t prioritized it enough in 8 years to fix. And this seems to fall into the sad, overly pervasive racism of people not caring vs the more explicit “a human calling someone a gorilla is racist” category. But also, it’s not like there’s many people who need to classify gor…

> is that Google hasn’t prioritized it enough in 8 years to fix.

I understand that there's nothing to fix. It doesn't label anything as gorillas anymore.

Why waste effort in bringing it back, when another mislabeled photo will only serve for people to scream "racism" on social media? Better to not poke that particular beehive, I reckon.

Re: Google Photos AI still can't label gorillas after racist errors

#64
post #21

Earlier quoted context omitted.

How is that racist? Because you’re projecting a racist comment onto it, a classifier? That does not make sense to me

The racism comes from the fact non-white people were not properly considered when the model was developed and trained. This comes up time and time again in AI, ranging from face ID that only works on white people, to porn classifiers that associate black people with NSFW images.

> The racism comes from the fact non-white people were not properly considered

Is this the case? Do we even know for a fact that only non-white people were mislabeled as anything else?

Or are we just, you know, throwing out baseless speculation as fact?

Re: Google Photos AI still can't label gorillas after racist errors

#65

Earlier quoted context omitted.

I saw lots of examples of white children being classified as seals

Have a link to an example or two? I can't find any after a few minutes of searching.

i was working at google at the time so the examples i saw were all in internal documents

Re: Google Photos AI still can't label gorillas after racist errors

#66

I agree that blocking the feature is the smartest thing to do if people are going to get offended. It's idiotic to call it "racist", it's a shitty classifier, and it's incredibly irresponsible (and probably racist) as well as dismissive of actual racism to pretend that's racist. At the same time, I'm surprised they can't get this classifier to work. It doesn't seem like a very challenging problem (I'd consider myself…

It's idiotic to call it "racist", it's a shitty classifier

This is sort of like telling residents of a historically black neighborhood which just so happens to have been exposed to drinking water with dangerously high levels of lead since time immemorial (despite decades of complaints) that it's just "shitty pipes", and that it's "idiotic" for anyone to think this state of affairs could possibly have something to do with racism.

I agree that the matter is quite nuanced, and there was no racist intent. However it's far from "idiotic" to address these issues directly. If anything it seems a bit obtuse not to address them.

Where there's smoke, after all, there's usually some form of fire.

Re: Google Photos AI still can't label gorillas after racist errors

#67

Earlier quoted context omitted.

Have a link to an example or two? I can't find any after a few minutes of searching.

i was working at google at the time so the examples i saw were all in internal documents

Of course.

Re: Google Photos AI still can't label gorillas after racist errors

#68
post #20

Earlier quoted context omitted.

Comically, the most potentially racist aspect (and I agree that having a bad classifier classify people as gorillas isn’t racist) is that Google hasn’t prioritized it enough in 8 years to fix. And this seems to fall into the sad, overly pervasive racism of people not caring vs the more explicit “a human calling someone a gorilla is racist” category. But also, it’s not like there’s many people who need to classify gor…

> is that Google hasn’t prioritized it enough in 8 years to fix. I understand that there's nothing to fix. It doesn't label anything as gorillas anymore. Why waste effort in bringing it back, when another mislabeled photo will only serve for people to scream "racism" on social media? Better to not poke that particular beehive, I reckon.

The bug is in the classifier in that I would want a high accuracy in classifying. I doubt this is the only error it makes, just the most visible. So google isn’t prioritizing accurately classifying black people, just they hard coded to never classify gorillas. Presumably because their classifier is still wrong enough that it would think black people are not people.

If they cared about this problem rather than just thinking it’s a “beehive” to be avoided rather than a real problem, then they would fix it. But they don’t actually care about accuracy in classifying people of some races, so they just avoid it.

Not super racist, but definitely shows they don’t care about this type of bug in that the affected populations aren’t important to them. I understand not caring about gorillas, but I would expect they should be very interested in accurately classifying black people.

Re: Google Photos AI still can't label gorillas after racist errors

#69
post #52

I agree that blocking the feature is the smartest thing to do if people are going to get offended. It's idiotic to call it "racist", it's a shitty classifier, and it's incredibly irresponsible (and probably racist) as well as dismissive of actual racism to pretend that's racist. At the same time, I'm surprised they can't get this classifier to work. It doesn't seem like a very challenging problem (I'd consider myself…

I think it's idiotic and racist to dismiss people offense of being labeled as an animal with a long history of being used as derogatory racial insult

[deleted]

Re: Google Photos AI still can't label gorillas after racist errors

#70
post #68

Earlier quoted context omitted.

> is that Google hasn’t prioritized it enough in 8 years to fix. I understand that there's nothing to fix. It doesn't label anything as gorillas anymore. Why waste effort in bringing it back, when another mislabeled photo will only serve for people to scream "racism" on social media? Better to not poke that particular beehive, I reckon.

The bug is in the classifier in that I would want a high accuracy in classifying. I doubt this is the only error it makes, just the most visible. So google isn’t prioritizing accurately classifying black people, just they hard coded to never classify gorillas. Presumably because their classifier is still wrong enough that it would think black people are not people. If they cared about this problem rather than just th…

Let's say the classified gets it right 999,999 times out of a million. It's about as fixed as it will ever be. Why would Google bring it back when there will be dozens of instances of them getting it wrong a year? It is mostly downside with very little upside.

You can actually find things the Google probably thinks are gorillas and monkeys by searching for "zoo".

Post reply on HN