> Timnit responded with an email requiring that a number of conditions be met in order for her to continue working at Google, including revealing the identities of every person who Megan and I had spoken to and consulted as part of the review of the paper and the exact feedback It always amazes how blatantly authoritarian these "woke" types are. I would not be surprised if the sole reason she wanted the identities of…
About Google's approach to research publication – Jeff Dean
31–40 of 607 posts
Re: About Google's approach to research publication – Jeff Dean
#32My researcher acquaintances at industry labs at IBM, Microsoft, HP, Xerox, ATT, Bell, DEC, Compaq, etc. never have had to have their papers reviewed internally before submitting them to conferences or journals. What's up with Google?
Re: About Google's approach to research publication – Jeff Dean
#33Maybe different teams are different, but on my previous team within Google AI, we thought the goal of google's pubapproval process was to ensure that internal company IP (eg. details about datasets, details about google compute infra) does not leak to the public, and maybe to shield Google from liability. Nothing more. In all of my time at Google AI, I never heard of pubapproval being used for peer review or to criti…
Re: About Google's approach to research publication – Jeff Dean
#34Maybe different teams are different, but on my previous team within Google AI, we thought the goal of google's pubapproval process was to ensure that internal company IP (eg. details about datasets, details about google compute infra) does not leak to the public, and maybe to shield Google from liability. Nothing more. In all of my time at Google AI, I never heard of pubapproval being used for peer review or to criti…
They might have enough of a PR budget to make the Google version of the story stick. But, its concerning that, if what you say is true, they are hoping to make that work by leveraging the public's ignorance of how the Google specific process works. Its also not the smartest move, since Google is important enough and public goodwill towards tech is low enough that journalists will have a field day looking for evidence…
Re: About Google's approach to research publication – Jeff Dean
#35> Timnit responded with an email requiring that a number of conditions be met in order for her to continue working at Google, including revealing the identities of every person who Megan and I had spoken to and consulted as part of the review of the paper and the exact feedback It always amazes how blatantly authoritarian these "woke" types are. I would not be surprised if the sole reason she wanted the identities of…
If your entire career is built around solving a problem, then actually solving it is against your personal best interest.
Re: About Google's approach to research publication – Jeff Dean
#36> Unfortunately, this particular paper was only shared with a day’s notice before its deadline — we require two weeks for this sort of review — and then instead of awaiting reviewer feedback, it was approved for submission and submitted. A cross functional team then reviewed the paper as part of our regular process and the authors were informed that it didn’t meet our bar for publication and were given feedback about why. [...] We acknowledge that the authors were extremely disappointed with the decision that Megan and I ultimately made, especially as they’d already submitted the paper.
When it was "approved for submission," was that approval final and actionable, or some kind of conditional approval? Is demanding a retraction after an approval the normal way it works at Google, or was this an unusual occurrence that Gebru was right to question?
Re: About Google's approach to research publication – Jeff Dean
#37It's frankly unprofessional for Jeff Dean to post only his email in this document without providing more context. The news media has in cases provided balanced coverage that included the email from Timnit that prompted Google's action: https://www.platformer.news/p/the-withering-email-that-got-a... This post from Jeff Dean simply underscores that he has failed to balance the need for diplomacy with the research thesi…
Re: About Google's approach to research publication – Jeff Dean
#38High level research (and engineering) will involve egos and you should expect this kind of push back when you stop someone from publishing. Nothing here justifies how he handled it
Of course, I think many of us have seen this reaction before, maybe even done it ourselves. It’s bad for everyone, don’t do it Jeff!
Re: About Google's approach to research publication – Jeff Dean
#39Re: About Google's approach to research publication – Jeff Dean
#40Timnit responded with an email requiring that a number of conditions be met in order for her to continue working at Google, including revealing the identities of every person who Megan and I had spoken to and consulted as part of the review of the paper and the exact feedback. Timnit wrote that if we didn’t meet these demands, she would leave Google and work on an end date. We accept and respect her decision to resig…