Live data from Hacker News

About Google's approach to research publication – Jeff Dean

docs.google.com

271–280 of 607 posts

Re: About Google's approach to research publication – Jeff Dean

#271

Earlier quoted context omitted.

Her manager said "effective today".[1] [1] https://twitter.com/timnitGebru/status/1334364736457240577

I don't know what that means. It could mean her employment status is off today. Or it could mean she can't access any corp material but her status is on. It's fairly standard to let the employee leave the building immediately but still on payroll for 2 more weeks. Again, I think it's a non-issue. Both wants to part way. Either party can singlehandedly make that date earlier. It seems one side brings up this point bec…

You brought it up.

"Effective today" has legal meaning. It's an issue because it shows Google acting in bad faith.

Re: About Google's approach to research publication – Jeff Dean

#272
post #11
post #6

My researcher acquaintances at industry labs at IBM, Microsoft, HP, Xerox, ATT, Bell, DEC, Compaq, etc. never have had to have their papers reviewed internally before submitting them to conferences or journals. What's up with Google?

I wonder how consistently these standards are applied, even zeroing in on Google. If it turns out that most people within the company don’t face a barrier from this process in the same way then that sounds like a really problematic symptom.

Apparently not very consistently, at least if you're Google Brain CA

https://twitter.com/le_roux_nicolas/status/13346019609729064...

Re: About Google's approach to research publication – Jeff Dean

#273

Had Gebru not raised an ultimatum, what would have been the consequence of the paper not passing internal review be? It sounds like she submitted the paper anyway, would there have been consequences to those actions?

Copyright infringement? She doesn't own the paper, even though she signed it.

Re: About Google's approach to research publication – Jeff Dean

#275

This topic, over the past couple of days, seems to me to have become fraught, polarised and argued to distraction and faction. It's not a stretch to say that the world has a problem with discrimination, or that big personalities can rock the boat when they go against the grain. Or that corporates have interests to defend. I'd like in this case, though - not to say that all the other factors aren't worthy of examinati…

it's absurd to want to wave away stuff like "race/gender politics" when the impact of that "politics" is overwhelmingly obvious in the field.

Re: About Google's approach to research publication – Jeff Dean

#276
post #122

Earlier quoted context omitted.

Of course he was vague. This just happened, tensions are high, and no doubt Timnit is talking to an employment lawyer to find out what both parties' right and obligations are, and I'm sure Google's lawyers are also getting all their ducks in a row. This is spin at best, gaslighting at worst. We'll never get the full story (and should we? it is an internal company matter made public, after all)..

>We'll never get the full story (and should we? it is an internal company matter made public, after all)) Not really sure what the point of an 'ethical AI' department is when there's no transparency or accountability facing the public because if it can be cancelled internally at any point if it threatens the company you've basically recreated some kind of Soviet ministry for truth

The point is to do foundational research, and to help Google ensure that its AI development complies with its own ethics. Google did try to set up an AI ethics board for accountability to the public, but it fell apart, because many segments of the public have ethical views which were seen as unacceptable. (https://www.cnbc.com/2019/04/04/google-cancels-controversial...)

Re: About Google's approach to research publication – Jeff Dean

#277
post #258
post #241

Earlier quoted context omitted.

But presumably you understand that your opponent may call you. The relevant MW definition is "a false threat or claim intended to deter or deceive someone." So in this context, it's a claim you won't really leave if you don't get your way. But the other party may decide to get rid of you anyway based on the bluff. (Thinking about it, it's probably reasonable to call it a bluff but that doesn't mean there aren't conse…

I suppose there is an ambiguity regarding whether the "bluff" was that she wasn't actually prepared to leave or whether it was that she actually was.

Yep. You don't really know the ranking of stay with conditions granted, leave without conditions granted, and leave without conditions granted rank. (Well #1 is obvious but the others less so.)

Re: About Google's approach to research publication – Jeff Dean

#278

I don't know Jeff Dean. I have read some of his work, watched some of his presentations. He seems a credible bloke. This, though, looks and feels like thinly-veiled retroactive and pretty unconvincing PR. It's short on detail and appears somewhat at odds with several points from Timnit Gebru's resignation note [0]: - Dean says the paper was reviewed by a "cross-functional team". Gebru says she received the feedback t…

>Dean says the paper was reviewed by a "cross-functional team". Gebru says she received the feedback through a "privileged and confidential document to HR"

I don't think these two takes are at odds with each other at all. It sounds like a cross-functional team reviewed the paper and produced that "privileged and confidential document" but Gebru didn't find that document sufficiently detailed.

Re: About Google's approach to research publication – Jeff Dean

#279
post #12
post #3

> Our aim is to rival peer-reviewed journals in terms of the rigor and thoughtfulness in how we review research before publication. I can see how this might be frustrating for academics working within Google. The field already has systems in place for peer-review. While I admire the idea of Google holding their research to a certain standard, it also provides a mechanism for dismissing research that paints Google (th…

I think this is the crux, in that google is not academia; so naturally a band-gap would arise if your expectations were that it should behave like an academic institution. From their perspective, what requirement is there to publish work that is not well aligned with their goals (optics, financial, etc)?

The problem is also that Google's AI labs are treated more or less as academia, that's one of the big selling points for recruiting.

I'm in industry and am not allowed to even talk about the projects I work on, much less publish papers, it kills recruiting conversations with maybe 10% of the people at conferences.

Re: About Google's approach to research publication – Jeff Dean

#280
post #2

Maybe different teams are different, but on my previous team within Google AI, we thought the goal of google's pubapproval process was to ensure that internal company IP (eg. details about datasets, details about google compute infra) does not leak to the public, and maybe to shield Google from liability. Nothing more. In all of my time at Google AI, I never heard of pubapproval being used for peer review or to criti…

Every paper we submitted went through a technical review as well as legal and IP reviews. They were along the lines of cite this, cite that, run these experiments etc.

What's different in her case is that you don't see the names of the people reviewing. Being the devil's advocate, she MIGHT have a pattern of aggressively attacking people who reviewed their work before. So they might have made the reviewers anonymous this time.

Post reply on HN