Live data from Hacker News

About Google's approach to research publication – Jeff Dean

docs.google.com

261–270 of 607 posts

Re: About Google's approach to research publication – Jeff Dean

#261
post #50

Timnit responded with an email requiring that a number of conditions be met in order for her to continue working at Google, including revealing the identities of every person who Megan and I had spoken to and consulted as part of the review of the paper and the exact feedback. Timnit wrote that if we didn’t meet these demands, she would leave Google and work on an end date. We accept and respect her decision to resig…

Not really. People bluff in negotiations all the time. A normal response would have been, “I can’t do that. Are you still committed to leaving?” Instead Google went all scorched earth and it’s still unclear why. It also indicates that they don’t particularly value her in progress work in the lab since normally you want the 2 weeks or whatever to squeeze some wrap up work out of folks.

> People bluff in negotiations all the time. A normal response would have been, “I can’t do that. Are you still committed to leaving?” Instead Google went all scorched earth and it’s still unclear why. It also indicates that they don’t particularly value her in progress work in the lab since normally you want the 2 weeks or whatever to squeeze some wrap up work out of folks.

I strongly encourage people to read some books on negotiations - as well as read up on legal ramifications to some negotiations.

Pretty much all books/courses on negotiations say: Ultimatums have their place, but are a minefield (i.e. they can blow up on you), and should be used as a last resort. From a negotiations standpoint, the response was adequate - which is why they all caution against using such an approach.

As for the 2 week thing, this is a convention, but not a requirement. In my company, it's not unusual for someone to be shown the door the same day they announce they plan to leave to another company (it's not the norm, but not at all unusual). The manager/company always ponders whether there are risks in keeping the employee for a few more weeks vs the gains, and this is the question Jeff pondered - that he did this is quite normal. Will the employee provide anything useful to us in those two weeks (e.g. handoff work to others, etc)? Could he/she cause problems (bad mouth people to fellow employees, steal IP, etc). If it's a disgruntled employee, they are usually shown the door the same day. In Timnit's case, it's unlikely there was any value in letting her stay for 2 more weeks.

I once intended to leave the company I was working for. The night before, I took out everything of (personal) value from my cubicle, as well as from my work machine. Only then did I have the discussion with my manager.

Having seen how she communicates and handles difficult situations, I think she really should read those kinds of books. Sometimes her behaviors are textbook examples of what not to do.

(Hint: If you're trying to influence someone, or a whole industry, you are negotiating, whether you choose to think of it that way or not).

Re: About Google's approach to research publication – Jeff Dean

#262
post #224

Earlier quoted context omitted.

If your work is suddenly and unexpected roadblocked at the last second by internal review, the only way to make changes that prevent that from happening in the future is to clearly understand the situations and criticisms that led to the roadblock. This is why understanding who raised these concerns is important. Anonymous feedback blowing up a project at the final moments is sure to frustrate anybody. If what she ha…

As a manager, if someone gives an ultimatum, you basically have to fire them. There's no real option; Ben Horowitz covered it somewhere, but the bottom line is that if you yield, you've given up all control.

> but the bottom line is that if you yield, you've given up all control.

This doesn't seem logical to me. I don't doubt there are indeed scenarios where this is true, but as an absolute, this doesn't resemble my real world experience at all. It seems like kind of the opposite of how human interaction should work.

Re: About Google's approach to research publication – Jeff Dean

#263
post #165
post #86

Earlier quoted context omitted.

"Do X or I'll quit" is a childish way to negotiate, its akin to a child throwing a tantrum if they don't get their way. It's extremely unprofessional and not something a team player would do. I think its clear why they took her up on her offer.

> "Do X or I'll quit" is a childish way to negotiate I disagree with this. It's really the only way to negotiate, pretty common. The wording is important here. If you word it as "Do X or I'll quit" it sounds childish, if you word it as "I believe the company should X, otherwise I can't see myself working here comfortably and will have to consider my resignation" it sounds professional, but the idea is the exact same.

> the idea is the exact same

Yes, in that they are both childish. Your version just added more weasel words. The second you bring up the "R" word as a threat you have played your hand; everything else is window dressing.

Re: About Google's approach to research publication – Jeff Dean

#264

Earlier quoted context omitted.

> they strike me as the sort of thing that is routinely addressed in the camera-ready version of papers by adding a few lines to the related work section What I don't understand is why in the discussion nobody proposed amending the paper rather than withdrawing it. If Dean's issue was it didn't cite papers X,Y and Z, rather than demand a withdrawal, why didn't he just demand "I want you to amend the paper to add cite…

Gebru complained about not being told what the criticisms were. That implies she was willing to consider feedback.

More specifically, she stated in her original email [0]:

>Have you ever heard of someone getting “feedback” on a paper through a privileged and confidential document to HR? Does that sound like a standard procedure to you or does it just happen to people like me who are constantly dehumanized?

So she did get feedback of some kind, though my reading is that it was probably vague legalese that she reasonably deemed insufficient.

[0] https://www.platformer.news/p/the-withering-email-that-got-a...

Re: About Google's approach to research publication – Jeff Dean

#265
This topic, over the past couple of days, seems to me to have become fraught, polarised and argued to distraction and faction.

It's not a stretch to say that the world has a problem with discrimination, or that big personalities can rock the boat when they go against the grain. Or that corporates have interests to defend.

I'd like in this case, though - not to say that all the other factors aren't worthy of examination as subjects in their own right - to see this paper. The authors/collaborators are leaders in the field. There are legitimate concerns about AI/ML; the validity/reliability of data from which, nowadays, consequential outcomes are derived.

Please, let's ignore - at least for now - the corporate politics, the heat of the race/gender politics, the PR machines weighing in (look at all the news outlets grabbing this atm), and take a look at what the paper says. The right people (those in the field and qualified/able to do so) should be listened to.

As for the politics of this, and the posturing and politicising and agenda-building on all sides: that doesn't help.

AI and ML affect us all now. This is a trend. Let's at least expose the findings of acknowledged leaders in the field - let's see this study - before we descend into the sideshows of politics and factionalism. Please.

Edit to clarify: tl;dr - I've not seen/read this contested paper. Whatever its contents, I want to see them, and imo that is more important than the current controversy blizzard etc.

Re: About Google's approach to research publication – Jeff Dean

#266

Earlier quoted context omitted.

> academic journal peer review process Fro my understanding, this paper had already passed peer review and been accepted. Google management then decided to block the publication using the IP review process.

it got approved without the review from what i understand

By peer review, I mean review by fellow academics, not Google management.

Re: About Google's approach to research publication – Jeff Dean

#267

Earlier quoted context omitted.

It's more nicely worded to be sure, and definitely less aggressive, but it still says the same thing, which is "I'm gonna be an unhappy employee if I can't find out who reviewed my work". If they aren't willing to tell her who reviewed her work (which they may or may not have valid reasons for doing, but clearly they don't want to do), then they are dealing with someone who is going to be an unhappy employee since th…

I vehemently disagree with just your first paragraph. (Your second and arguably more important paragraph I’m sympathetic to.) People state their feelings toward things all the time and none of it should ever be considered permanent. I’ve told my boss many times something of similar ilk, “if you’re going to have me and my team do this last minute demo when it was fully in your capacity to plan better, I’m going to be…

(grandparent here, different throwaway)

> Maybe it’s because Google doesn’t actually have a desire to work with her, in which case, the ultimatum (or whatever it truly was) is just a convenient out.

There's almost no question about that in my mind. Maybe google didn't see her work as useful. Maybe she was just an asshole and they didn't like working with her. I have no idea. But if you are already on thin ice (or your company even feels just neutral about you) and you give an ultimatum, prepare for them to use it against you.

Re: About Google's approach to research publication – Jeff Dean

#268
post #165
post #86

Earlier quoted context omitted.

"Do X or I'll quit" is a childish way to negotiate, its akin to a child throwing a tantrum if they don't get their way. It's extremely unprofessional and not something a team player would do. I think its clear why they took her up on her offer.

> "Do X or I'll quit" is a childish way to negotiate I disagree with this. It's really the only way to negotiate, pretty common. The wording is important here. If you word it as "Do X or I'll quit" it sounds childish, if you word it as "I believe the company should X, otherwise I can't see myself working here comfortably and will have to consider my resignation" it sounds professional, but the idea is the exact same.

> It's really the only way to negotiate, pretty common.

As I point out in another comment[1], not only is this not true, negotiation experts universally criticize this as a way to negotiate.

[1] https://news.ycombinator.com/item?id=25309003

Re: About Google's approach to research publication – Jeff Dean

#269
post #68

I would be absolutely furious if a manager blocked my work from being published. Even a manager who has worked as a researcher, in my experience, significantly lacks the expertise to be making such judgments. A research manager’s job is to be familiar with work across an entire portfolio, so they will be necessarily less knowledgeable than individual senior researchers. Presumably Google generally also feels this way…

Then you probably have to get hired at a corporation that never puts its own well being above the rest.

Re: About Google's approach to research publication – Jeff Dean

#270

Earlier quoted context omitted.

Isn't the academic journal peer review process generally an anonymous feedback mechanism? Why does this need to be different?

> academic journal peer review process Fro my understanding, this paper had already passed peer review and been accepted. Google management then decided to block the publication using the IP review process.

Please go read the link first. Jeff clearly states that Google has a review protocol for journal submission which requires a two weeks internal review period.

Timnit shared the paper a day before the publication deadline, ie, no time for internal review, and someone with a fat finger apparently approved it for submission without the required review.

Post reply on HN