Ok, so basically she is a bullshit social engineer, masquerading as an 'AI ethics researcher' "Gebru’s draft paper points out that the sheer resources required to build and sustain such large AI models means they tend to benefit wealthy organizations, while climate change hits marginalized communities hardest. “It is past time for researchers to prioritize energy efficiency and cost to reduce negative environmental i…
We read the paper that forced Timnit Gebru out of Google
281–290 of 683 posts
Re: We read the paper that forced Timnit Gebru out of Google
#282Earlier quoted context omitted.
We haven't read her paper, just an article about it. We can't read it, because google won't let us. That you don't see that as a problem is a little concerning.
The article we are using as reference is a summary of her paper and is literally titled “we read [her] paper” from MIT Technology Review. What do you suggest might the article be getting wrong about her paper? Or are you suggesting that the information contained about the paper in the article is inherently invalid and should be ignored altogether?
Re: We read the paper that forced Timnit Gebru out of Google
#283Ok, so basically she is a bullshit social engineer, masquerading as an 'AI ethics researcher' "Gebru’s draft paper points out that the sheer resources required to build and sustain such large AI models means they tend to benefit wealthy organizations, while climate change hits marginalized communities hardest. “It is past time for researchers to prioritize energy efficiency and cost to reduce negative environmental i…
Re: We read the paper that forced Timnit Gebru out of Google
#284Reading Jeff's email plus her comments on twitter doesn't give the full story. It seems like 1. She did not give them the time required to vet through the paper or followed the processes, plus her email to everyone to stop work on other projects. 2. Google fired her immediately, which might have been different if she wasn't a POC. This
Re: We read the paper that forced Timnit Gebru out of Google
#285Ok, so basically she is a bullshit social engineer, masquerading as an 'AI ethics researcher' "Gebru’s draft paper points out that the sheer resources required to build and sustain such large AI models means they tend to benefit wealthy organizations, while climate change hits marginalized communities hardest. “It is past time for researchers to prioritize energy efficiency and cost to reduce negative environmental i…
Please take a look at (Wieringa, R., Maiden, N., Mead, N., & Rolland, C. (2005). Requirements engineering paper classification and evaluation criteria: A proposal and a discussion. Requirements Engineering, 11(1), 102–107) available here: http://www.cse.chalmers.se/~feldt/advice/wieringa_2006_re_pa... Specifically read the section 3 (which is on p. 4). There you will find that research in software engineering can be broadly grouped into the following categories: Evaluation research, Proposal of solution, Validation research, Philosophical papers, Opinion papers, Personal experience papers.
While I agree that the usual way to deal with the criticism of the work is to redo the work with better evaluation (and thus, more strongly supported arguments), I think that in any ethics research you'd need more than just publications that fall under Evaluation research (which is what you are likely referring to as "true AI research").
Re: We read the paper that forced Timnit Gebru out of Google
#286Earlier quoted context omitted.
The paper referenced ("Gender shades: Intersectional accuracy disparities in commercial gender classification") has been cited 1000+ times per her Google Scholar page ( https://scholar.google.com/citations?user=lemnAcwAAAAJ ). For a 2-year old paper, this is easily a top 1% most cited paper. Take for example a retrospective look at 2017 NeurIPS papers done in 2019 ( https://archive.is/wip/77YrB ). You can disagree wi…
Are you really making the argument that people with money can’t be leftists? Do you know liberals are on average richer? https://www.cnbc.com/2019/09/19/economic-divide-in-the-us-is... Most executives of tech and news companies would bend over backwards just to show how leftist they are in 2020. (I’m only replying to the part of your comment that answers mine)
Even someone like Ben Shapiro recognizes a difference between liberals and leftists (https://twitter.com/benshapiro/status/966081078166421504).
Silicon Valley types would hardly be described as leftists. Numerous studies have been done on the attitudes of Silicon Valley founders and execs (https://www.vox.com/2015/9/29/9411117/silicon-valley-politic...). The distinctions are dramatic.
We see that on average, tech founders are less likely to support vs. even Democrats generally (not just progressives):
* Banning the Keystone XL pipeline (60% vs 78%)
* The individual healthcare mandate (59% vs 70%)
* Labor unions being good (29% vs 73%)
This is to say, the average Silicon Valley type, particularly the C-suite exec or founder, tends not to be on the left wing of the Democratic party.
During the 2020 Democratic primary, even the Silicon Valley billionaires who are openly Democratic-leaning donated to candidates who were not to the left of the field (i.e. Elizabeth Warren and Bernie Sanders) (https://www.cnbc.com/2019/08/13/2020-democratic-presidential...):
* Eric Schmidt -> Cory Booker and Joe Biden
* Reed Hastings -> Pete Buttigieg
* Marc Benioff -> Cory Booker, Kamala Harris, and Jay Inslee
* Reid Hoffman -> Cory Booker, Kirsten Gillibrand, Amy Klobuchar
* Jack Dorsey -> Andrew Yang, Tulsi Gabbard
* Ben Silbermann -> Pete Buttigieg
I'm engaging with you in good faith, and because I was intrigued that in a previous comment you mentioned that you live in Spain (though who's to say you're not a US ex-pat). But calling US tech companies "leftist" is a stretch at best.
Re: We read the paper that forced Timnit Gebru out of Google
#287The problem I find with this has much to do with character. I will not comment on the research (because I do not know the field) but rather comment on why character matters and why motivation is important. Having read her email and tweets; it is quite clear that she is as much a political activist for a far-left “woke” interpretation of the world that I view as of immediate threat to our way of living, democracy and…
But maybe you think that we still need to debate whether or not we need to hire more women?
And even if you argue that we do NOT need to take action now to bring more gender equality into tech - who is stopping you from making that argument?
Judging by all the comments on the HN threads it seems there are plenty of voices expressing opinions.
I assume that this chorus is mostly men - 86% perhaps?
Re: We read the paper that forced Timnit Gebru out of Google
#288Wow. The pro-google push is really visible in this thread
The point is, I'm not a Google shill.
Still, on this case, on a factual level, the only real dispute is whether this exchange:
"Do X or I quit" "Ok, your final paycheck is in the mail and IT will be in touch to organise equipment returns, effective now"
Is "accepting a resignation" or "firing". Neither side is disputing that this is how it went down.
On an ethical level, again, I'm no fan of Google but Timnit Cebru's previous public actions don't paint her in a good light while Jeff Dean's doesn't have any notable enough to sway my opinion one way or another on his ethical trustworthiness.
So based on that, I (and many others) do end up siding with Google. is that a pro-Google push? is someone co-ordinating this? If they are, they haven't contacted me. Don't mistake the fact that Google is often unpopular here with the idea that no Google action can be supported here without interference
Re: We read the paper that forced Timnit Gebru out of Google
#289Earlier quoted context omitted.
I'm saying that saying her paper was "light in technical substance" when we haven't read it is problematic. Any article such as this is going to be light on technical substance in comparison to the paper itself.
The article states her paper focused on the dangers of large language models: “Environmental and financial costs,” “Massive data, inscrutable models,” and “Research opportunity costs.” The dangers of large language models is an interesting topic but it’s not AI research and it doesn’t advance the state of the art of AI. When it comes to technical substance in the field of AI, her paper is indeed lacking in that unles…
Re: We read the paper that forced Timnit Gebru out of Google
#290Earlier quoted context omitted.
> I think this sort of veiled personal attack resorting to baseless extrapolation is not a productive line of public discourse. I thought that my comment was fitting to the tone of the text I replied too, but fair enough, maybe I shouldn't have included that paragraph. > You should take a step back and think about a) the field of study, b) how the main argument completely ignores the basis of said technical field and…
> I thought that my comment was fitting to the tone of the text (...) Yes, that was one of the problems. > It is unclear to me what this means, is it arguing that studying bias in AI and specifically deep learning is not germane? Let me make it clear for you so that a) we are able to talk about things objectively, b) your options to continue using veiled personal attacks is curtailed. Either your goal is to model rea…
> If you pick option #2 then your model does not reflect real life.
These deep learning models built by corporations are not scientific models, they are engineering solutions, built to solve problems. Reflecting the real world is only useful if it furthers what the company wants to solve. If they for example remove swear words from their training set, that will make them a less accurate model of the world, but make them more useful for building solutions. But it is probably a trade of they would be happy with. We've also seen example of risk scoring application for felons that seem to end up doing racial profiling, because that is what the data seem to indicate makes sense. But that's deeply problematic and runs counter to laws in some places and seem ethically problematic (https://www.theverge.com/2020/6/24/21301465/ai-machine-learn...).
> Bias is by definition the way the model returns results that don't match the real world and real life, in frequency and in proportion.
Getting a good data set without bias is hard, even if you crawl the whole internet like Google does. Not everything is on the internet and there are systematic drivers that make some part of the human condition over represented (English, science, the views of the affluent and educated), and some under presented (small languages, the discourse of people behind the Chinese great firewall, the poor). So just getting a ginormous data set does not fix bias.
> If your goal is to use your model to manipulate and control society based on your own personal criteria, by manipulating it to return results that distort the real world and real life, then call it something else, because bias is not it.
Positive bias is absolutely something that we use, and while it might seem sinister it does not have to be. The example I'm most familiar with a facial recognition technology. Most groups building that ends up with a model that is better at some groups than others. Asian research groups often end up with models that does well with asians and worse with whites, while European groups usually end up with the reverse. In some sense these results do reflect the reality of these groups, most people in Europe is white and most people Asian is asians, so that you training sets ends up like that is not surprising. But no one is happy with these kind of results, and everyone wants to fix that.
To bring it back to speech and text models, let's say you are building a customer service solutions incorporating a deep learning model, the reality might be that you current customer service representatives treat blacks (or people who use "black" dialects), worse than people who sound white. An accurate model built on this data set will then also do that. But is that acceptable? I hope most companies would want to fix that, and be fine with adding some positive bias in their solution.