Earlier quoted context omitted.
> People bluff but you generally have to be prepared to walk if your bluff is called. Then you aren't bluffing.
How do you figure that? If I hold 27 off suit then I still have to be prepared to show my hand if you call me. Doesn't mean my all-in raise wasn't bluffing.
About Google's approach to research publication – Jeff Dean
241–250 of 607 posts
Re: About Google's approach to research publication – Jeff Dean
#242Maybe different teams are different, but on my previous team within Google AI, we thought the goal of google's pubapproval process was to ensure that internal company IP (eg. details about datasets, details about google compute infra) does not leak to the public, and maybe to shield Google from liability. Nothing more. In all of my time at Google AI, I never heard of pubapproval being used for peer review or to criti…
And the examples of issues flagged in review that Jeff keeps highlighting—like Timnit’s alleged failure to mention recent work to reduce the environmental impact of large models—are themselves a bit worrisome. Jeff gives the impression that they demanded retraction (!) because they wanted Timnit and her coauthors to soften their critique. The more I read about this, the worse it looks.
Representing a more truthful reality is not 'softening'.
It's only 'softening' for those who have an already accepted, extremist view, and for whom any evidence to the contrary doesn't help their arguments.
While initially sympathetic to the author - the more I read - the more I have completely the opposite view.
Re: About Google's approach to research publication – Jeff Dean
#243Re: About Google's approach to research publication – Jeff Dean
#244Earlier quoted context omitted.
Thank you. I’m not sure what to think. It seemed absurd to submit a paper for internal academic review one day prior to a major deadline. Yet today we’re hearing that it’s common (I can believe that; standard big company stuff) and that Google hasn’t been doing academic reviews at all until very recently / possibly this incident. So it feels like, suddenly, the cornerstones of the arguments against her are vaporizing…
> It seemed absurd to submit a paper for internal academic review one day prior to a major deadline I think that there isn't internal academic review of the sort implied by Jeff at Google. Timnit seems pretty clearly in the right here. As an AI researcher at a competitor, this impacts my desire to join Google in the future. I imagine these sort of PR disasters hurt their standing in the academic labor market.
Why do you think that?
Re: About Google's approach to research publication – Jeff Dean
#245Earlier quoted context omitted.
> AI ethics department placing a check on their leading edge research that reminds how in USSR each non-miniscule factory, organization, etc. had "the department #1" - it was an ideological check and control department which at sufficiently large/important organizations even included KGB officers.
You have identified a similarity between two situations, but it is not a similarity that matters. The distinction that matters is one of normativity, and on that measure there is clearly no equivalence to be drawn here.
Re: About Google's approach to research publication – Jeff Dean
#246Earlier quoted context omitted.
Isn't the academic journal peer review process generally an anonymous feedback mechanism? Why does this need to be different?
> academic journal peer review process Fro my understanding, this paper had already passed peer review and been accepted. Google management then decided to block the publication using the IP review process.
Re: About Google's approach to research publication – Jeff Dean
#247Earlier quoted context omitted.
He was also extremely vague, perhaps intentionally, about what the issue actually was. His sentence about when the paper was submitted and approved and all that is impossible to parse and make sense of who did what and when.
Of course he was vague. This just happened, tensions are high, and no doubt Timnit is talking to an employment lawyer to find out what both parties' right and obligations are, and I'm sure Google's lawyers are also getting all their ducks in a row. This is spin at best, gaslighting at worst. We'll never get the full story (and should we? it is an internal company matter made public, after all)..
Not really sure what the point of an 'ethical AI' department is when there's no transparency or accountability facing the public because if it can be cancelled internally at any point if it threatens the company you've basically recreated some kind of Soviet ministry for truth
Re: About Google's approach to research publication – Jeff Dean
#248Earlier quoted context omitted.
Her manager said "effective today".[1] [1] https://twitter.com/timnitGebru/status/1334364736457240577
I don't know what that means. It could mean her employment status is off today. Or it could mean she can't access any corp material but her status is on. It's fairly standard to let the employee leave the building immediately but still on payroll for 2 more weeks. Again, I think it's a non-issue. Both wants to part way. Either party can singlehandedly make that date earlier. It seems one side brings up this point bec…
Re: About Google's approach to research publication – Jeff Dean
#249It seems disparaging your own company while ignoring research that counters yours is Google’s limit, but we’ll have to wait to see the research paper if it leaks.
Re: About Google's approach to research publication – Jeff Dean
#250This reads to me like Google felt that the paper painted some of their other technologies in a poor light, and wanted to insert language that made them look better. The way he describes their objections, they strike me as the sort of thing that is routinely addressed in the camera-ready version of papers by adding a few lines to the related work section. Not the sort of thing that a conference reviewer or an internal…
> they strike me as the sort of thing that is routinely addressed in the camera-ready version of papers by adding a few lines to the related work section What I don't understand is why in the discussion nobody proposed amending the paper rather than withdrawing it. If Dean's issue was it didn't cite papers X,Y and Z, rather than demand a withdrawal, why didn't he just demand "I want you to amend the paper to add cite…
Unless corporate tells you to kill the paper and you need something that resembles legal cover.