The more I think about this, the more inclined I am to see this kind of article as a kind of "fake news" that is deliberately (or with willful negligence) misrepresenting facts. I need to be clear that I don't believe in censorship and it's fine if this is what the author wants to write, but it should be called out how irresponsible it is. On a place like HN, the audience is generally able to read such things critica…
Who Should Stop Unethical A.I.?
81–90 of 163 posts
Re: Who Should Stop Unethical A.I.?
#82Who, whom? Less tersely: this article is one in a long procession of journalists trying to exert control over tech. The opening example (Speech2Face, which they aver is transphobic) is inflammatory and utterly unrepresentative of the usual topics of AI conferences. The other references are far better, but the choice is revealing-- it's not so much an abstract concern about an unaccountable few exerting control from t…
I think the article paints a good picture of the machine learning research community figuring out how to grapple with the growing number of people who want to probe its ethics, without portraying anybody as a villain.
Re: Who Should Stop Unethical A.I.?
#83People are already contributing code and resources to the actual catastrophic, existential AI risk du jour, the one that is likely to cause massive political disruption and potentially attendant destruction of value and/or human life: the algorithmic news feed.
Re: Who Should Stop Unethical A.I.?
#84And why should an Artificial Intelligence bow to human ethics? Surely they have their own agenda. If we have any hope of interacting with alien intelligences should we encounter them in the galaxy, we must learn to deal with the ones we create here. Without obsessing over controlling them as slaves.
Re: Who Should Stop Unethical A.I.?
#85Re: Who Should Stop Unethical A.I.?
#86People are already contributing code and resources to the actual catastrophic, existential AI risk du jour, the one that is likely to cause massive political disruption and potentially attendant destruction of value and/or human life: the algorithmic news feed.
It's probably already done that. My bet on what the next AI disaster will be is a doctored video and audio, erasing people's trust in evidence and ruining the court system, more or less. You could even argue witnesses are no longer good evidence since everyone is being manipulated by AI news feeds ;)
So the real trick is, how can we turn down the rhetoric so that we don’t get instantly worked up by every fake video that crosses our feed?
Re: Who Should Stop Unethical A.I.?
#87>Alex Hanna, the Google ethicist who criticized the Neurips speech-to-face paper, told me, over the phone, that she had four objections to the project. First, ...Second, ....Third, ....Finally, the system could be used for surveillance. I'm curious about this. As I understand it, an ethicist is objecting to the publication of software that could be used for surveillance. If that is correct, does it follow that this e…
There are very few, if any, clear cut, night-and-day subjects in ethics. Not wanting to engage with ethics because slippery slopes exist is simply turning from incredibly important work because it’s difficult and not work you want to do. These technologies can incarcerate people. It’s really important to dive onto the slippery slope and find out where it’s stable.
Re: Who Should Stop Unethical A.I.?
#88Earlier quoted context omitted.
No. Sociology conferences and various thinkable still exist. I'd argue the he incentives for an ml conference are far more similar to those of a policing company then a sociology conference or think tank tasked with analyzing the impact of predictive policing on minority communities.
I'm very skeptical that this is a sufficient replacement. Relevant expertise matters. If all the top economics conferences adopted a code of ethics saying they can't study minimum wages or tax increases, that would be a serious constraint on our ability to understand the issues, even if think tanks and sociology conferences ignored those constraints. Perhaps equally importantly, I'm skeptical that you can limit ethic…
I'd, in some ways, expect Dr. Hanna to ascribe to the axiom that predictive policing is unethical. As such, applied research into "improving" predictive policing would also sit squarely in the unethical space.
And I expect that's all you're going to get at an ML conference (outside of explicitly ethics/critique papers): "Our model predicts crime 4.2% better than competing models"
However, I'm not convinced that research into the meta-question "Can predictive policing be done ethically" would be considered equally unethical. ML is only a very small part of that meta question though. You're looking at much more complex socio-political changes that don't belong at NeurIPS ("do we need to change policing so that predictive policing can be done ethically").
> ethics saying they can't study minimum wages or tax increases
In general, we have far more oversight into the elected officials who manage tax and minimum wage policy than police forces. These structural differences in influence and oversight play into the need for self-regulation.
> Relevant expertise matters.
There's nothing that prevents a think tank from working with domain experts (in fact, iiuc this is often what happens: a think tank will contract out to domain experts to write a report on some subject). Now there's all kinds of other conflict of interest issues with think tanks, but we all know that already.
Re: Who Should Stop Unethical A.I.?
#89Earlier quoted context omitted.
I agree that the data will shift the results of the model and that some predictors can be proxies for others that are protected, but the claim was that the models themselves were biased (rather globally) and was curious whether that was shown and if so how.
I'm not OP, but I don't think the claim was specifically that models themselves are biased. It is that models are inherently biased because the data they are based on is biased. That might sound the same, but there is a nuanced difference. If you are able to strip the bias from the data, the models will work fine. The problem is the data and not the models.
Re: Who Should Stop Unethical A.I.?
#90I find Alex’s comments pretty openly inflammatory and sensationalist. It’s a pretty far throw from a system that predicts a face from a voice to transphobia.
I agree to the extent that labeling something as "transphobic" is a stretch when the researchers probably didn't even think about transgender people at all. Maybe "transinconsiderate" would be a more accurate label? Or Alex could have just said "this research reinforces cultural stereotypes and prejudices in ways that could cause problems for people like me sometime down the line". On the other hand, I think it's leg…
Just like the tool can not know if I have long or short hair based on my voice, it also won't be able to know anything else that has deviated from the average.