Earlier quoted context omitted.
As a manager, if someone gives an ultimatum, you basically have to fire them. There's no real option; Ben Horowitz covered it somewhere, but the bottom line is that if you yield, you've given up all control.
That is a psychotic reaction that assumes the world is just a Hobbesian nightmare of domination or death.
About Google's approach to research publication – Jeff Dean
341–350 of 607 posts
Re: About Google's approach to research publication – Jeff Dean
#342Re: About Google's approach to research publication – Jeff Dean
#343Earlier quoted context omitted.
If your work is suddenly and unexpected roadblocked at the last second by internal review, the only way to make changes that prevent that from happening in the future is to clearly understand the situations and criticisms that led to the roadblock. This is why understanding who raised these concerns is important. Anonymous feedback blowing up a project at the final moments is sure to frustrate anybody. If what she ha…
As a manager, if someone gives an ultimatum, you basically have to fire them. There's no real option; Ben Horowitz covered it somewhere, but the bottom line is that if you yield, you've given up all control.
Re: About Google's approach to research publication – Jeff Dean
#344Earlier quoted context omitted.
If your work is suddenly and unexpected roadblocked at the last second by internal review, the only way to make changes that prevent that from happening in the future is to clearly understand the situations and criticisms that led to the roadblock. This is why understanding who raised these concerns is important. Anonymous feedback blowing up a project at the final moments is sure to frustrate anybody. If what she ha…
As a manager, if someone gives an ultimatum, you basically have to fire them. There's no real option; Ben Horowitz covered it somewhere, but the bottom line is that if you yield, you've given up all control.
Re: About Google's approach to research publication – Jeff Dean
#345Earlier quoted context omitted.
As a manager, if someone gives an ultimatum, you basically have to fire them. There's no real option; Ben Horowitz covered it somewhere, but the bottom line is that if you yield, you've given up all control.
As a manager, it's your job not to push people to a corner where they need to make an ultimatim. If your company is ethical, you should be able to navigate this.
Re: About Google's approach to research publication – Jeff Dean
#346Earlier quoted context omitted.
> But this review process had never been used for introducing comments of this sort to a paper ever before How do you know that?
"My submissions were always checked for disclosure of sensitive material, never for the quality of the literature review."[1] "In all of my time at Google AI, I never heard of pubapproval being used for peer review or to critique the scientific rigor of the work. It was never used as a journal, it was an afterthought that folks on my team would usually clear only hours before important deadlines. We like to leave pee…
Re: About Google's approach to research publication – Jeff Dean
#347Earlier quoted context omitted.
And the examples of issues flagged in review that Jeff keeps highlighting—like Timnit’s alleged failure to mention recent work to reduce the environmental impact of large models—are themselves a bit worrisome. Jeff gives the impression that they demanded retraction (!) because they wanted Timnit and her coauthors to soften their critique. The more I read about this, the worse it looks.
Yeah, put more simply, they pushed out someone in their Ethical AI department because they did not soften critiques against AI enough. They couch these in terms of rigour, but the substance of the problem has to do with her criticisms against AI. Ultimately it makes the whole Ethical AI department look more like a rubber stamp for Google.
Re: About Google's approach to research publication – Jeff Dean
#348Earlier quoted context omitted.
I understand some of the reasons why some managers think that way, but you can't have such simplistic rules. An ultimatum like this is an opportunity for a responsible manager to talk and rethink, but it seems like Google jumped at the opportunity to double-down on their mistake and then send out cowardly emails claiming the employee had actually resigned. If I were to apply a simplistic rule here, I would actually i…
The problem with accepting anti-social behavior is that you encourage it. This individual or another will use the same strategy against you in the future, and it will create antagonism and toxicity. No, an ultimatum is a choice between two options; she offered Google a choice, and they selected. Expecting them to try to carve out a 'third way' is just unrealistic. I agree that you can frame this many ways; she could…
But you're claiming that for a company there shouldn't be a choice, it should just lead to termination.
Re: About Google's approach to research publication – Jeff Dean
#349Earlier quoted context omitted.
Not really. People bluff in negotiations all the time. A normal response would have been, “I can’t do that. Are you still committed to leaving?” Instead Google went all scorched earth and it’s still unclear why. It also indicates that they don’t particularly value her in progress work in the lab since normally you want the 2 weeks or whatever to squeeze some wrap up work out of folks.
> People bluff in negotiations all the time. A normal response would have been, “I can’t do that. Are you still committed to leaving?” Instead Google went all scorched earth and it’s still unclear why. It also indicates that they don’t particularly value her in progress work in the lab since normally you want the 2 weeks or whatever to squeeze some wrap up work out of folks. I strongly encourage people to read some b…
Re: About Google's approach to research publication – Jeff Dean
#350Maybe different teams are different, but on my previous team within Google AI, we thought the goal of google's pubapproval process was to ensure that internal company IP (eg. details about datasets, details about google compute infra) does not leak to the public, and maybe to shield Google from liability. Nothing more. In all of my time at Google AI, I never heard of pubapproval being used for peer review or to criti…
But in this scenario, shielding Google from liability is actually a primary concern given that Timnit is discussing ethics/bias. A paper on say novel transformer architecture, the lottery ticket hypothesis in a new setting, a new RL benchmark suite, etc is not going to expose Google to legal risk the way ethical AI research often can.