>> The average number of failures for those who failed at least once before success was 2.03 for NIH, 1.5 for startups and 3.90 for terrorist groups. Regarding counter-terrorism, that would suggest that rather than more surveillance we instead need better reporting of and responding to failed terrorist incidents/attacks.
There was once a mathematician who got caught at the airport with a bomb. They took him in for questioning. When asked why he had a bomb in his suitcase he stated "the odds of there being a bomb on your airplane are less than one in ten million. So I figured what are the odds of there being two bombs on my flight?" Do you see why this is similar? When an outcome (terrorism) becomes an input to its own predictor (past…
Scientists use big data to understand what separates winners from losers
21–22 of 22 posts
Re: Scientists use big data to understand what separates winners from losers
#22My sense is that a grant, like an academic paper, is often basically well-received or not. So prior to going into it, if you're familiar with the details of the particular grant, you can get some sense of interest or not. The grant may have even been solicited in a certain sense by a program officer or something, so it's quasi-invited.
Those grants that are quasi-invited, or well-received, will basically involve polishing on subsequent revisions. Those that are totally unsolicited and not well-received it doesn't matter how much polishing you do often, it will not go anywhere.
I think where this becomes relevant to the paper is that this often has very little to do with the process of the grant revisions. It says little about "how someone responds to failure", and everything about connections with the grant agency, program officers, and luck. All that stuff that happens before the grant is even submitted plays into it, and this paper kind of ignores that.
You could say that it does speak to learning, in that you could ask "why doesn't the other scientist adjust their strategy?" To which I'd say, there are enormous pressures to submit anyway, and for someone who doesn't get good mentoring about what to target, or what agency to target, or whose research doesn't jive with the priorities of the division head at that time, or whatever, they might just not get it, and it might easily be over the 5 year period of the study.
Basically, at least with NIH grants I think this study is really misleading and potentially harmful, because it kind of suggests failed applicants just aren't learning, when I think what's really happening is that you have a mixture of two groups, one of which can learn something, and the other of whom it just doesn't matter if they learn or not, because the outcome has kind of been preordained.
That is, the process they predict from is an indicator of which mixture class the applicant belongs in, not the cause of the outcome.