Live data from Hacker News

Cracking down on research fraud

undark.org

171–180 of 227 posts

Re: Cracking down on research fraud

#171

These issues of research fraud come up often, but the root of the problem is a bit more subtle. In North America at least, biomedical research labs operate largely as fiefdoms of the individual principal investigators (PIs). The actual research work falls almost entirely on the backs of grad students and postdoctoral fellows. The grad students need to generate "good" data in order to graduate, the postdocs need the s…

I agree with the subtle point behind the fraud crisis: misaligned incentives.

However, that doesn't excuse the individuals doing it. "Because jobs" is a terrible ethical excuse.

Nevertheless, you have an interesting point there.

Re: Cracking down on research fraud

#172
post #151

Earlier quoted context omitted.

This entire thread is really frustrating for me to read. A lot of these ideas are one-liners from people who have had very little experience with different parts of academia, except maybe being a student. Every single idea here are debated to death by academics already (not just university academics, but funding agencies, academic societies, award panels, journal editors and conference organizers), with changes happe…

Not sure who downvoted this, but this is 100% on the money in my experience. People here are writing comments like that funding should be tied to "how systematic, logical, and well-documented the research is" as though these things are correlated to the existing criteria at all. Much of the criticism here is like someone who knows how to build roads criticising agile software development because it makes it look like…

Yeah I have no idea how it got to -2, but maybe it was my tone. I was even trying to not call out any specific post or debate any single issue.

The thing about academia is it's full of people who love talking about ways to make it better, and rotate into positions of power where they can change things after a few years.

The solutions are complex, require convincing many different stakeholders (even if they're amenable to the change), nailing lots of detail to make it work right. Because peoples lives and careers are on the line. Reputations of entire fields, the way medical discoveries happen, billions of dollars of taxpayer money, major institutions, etc. are not things you want to hack and discover that whoops, you just incentivized the wrong thing and set back cancer research for a decade.

Re: Cracking down on research fraud

#173

Earlier quoted context omitted.

What do you suggest as an alternative?

This entire thread is really frustrating for me to read. A lot of these ideas are one-liners from people who have had very little experience with different parts of academia, except maybe being a student. Every single idea here are debated to death by academics already (not just university academics, but funding agencies, academic societies, award panels, journal editors and conference organizers), with changes happe…

So, what's the best proposal or line of thinking coming from all this deep thought about how to solve it?

Because you can't possibly be saying that the current system is the best we can do, or that the problem is intractable.

(I agree with most of your proposals about software engineering btw. We should do more of this).

Re: Cracking down on research fraud

#174

Earlier quoted context omitted.

That’s the fault of the person falsifying data, not the person reporting the fraud.

Yeah but it still happens, and to people you care about who didn't deserve it.

That's true. Several people will probably lose their jobs.

But that is the kind of thinking that condemns whistleblowing for the wrong reasons. To put it differently, people rather prefer to keep on pretending if that keeps their jobs than to do the right thing. And that makes everyone a fraudster.

Re: Cracking down on research fraud

#175
post #136

Earlier quoted context omitted.

He specifically mentions comments like yours are not helpful. This is the researcher fraud that is the problem in science that we are talking about, issues at hand are ignored or twisted so the paper mill can continue. The concept is all mice in the USA come from one laboratory and have a common attribute that's different from wild mice and European suppliers. And it's spelt out how in theory this different attribute…

I've heard everything he said. I'm well aware of the concept. Again, everyone knows that all mice come from the same place (because it's written in the papers), and that they are very different to wild mice or mice from elsewhere. I also didn't say we don't have proof that it is a problem. Again, all models are imperfect, but some are useful. I am telling you what I see as the significance of Weinstein's findings as…

I usually do this exercise with my students when they tell me they understood what I just explained: I ask them to explain it back to all the class.

Could you do that for us here? Explain to us what problem Weinstein detected, to what it relates to, and its consequences.

Re: Cracking down on research fraud

#176

Earlier quoted context omitted.

1) I think the idea of funding "people, not projects" (the Howard Hughes Research Institute's byline; I'm not affiliated with them in any way) is a great one. It would probably involve changing the structure of research programs in other fundamental ways, such as by 2) Limiting the number of graduate students. The current relatively-low barrier of entry into grad school provides cheap, motivated labor for PIs who are…

> Limiting the number of graduate students. Isn't a lot of the graduate school product providing a way for people to immigrate to the United States? The economy around it is pretty complicated and definitely there's way more pressure to supply more, not fewer, spots.

[deleted]

Re: Cracking down on research fraud

#177

These issues of research fraud come up often, but the root of the problem is a bit more subtle. In North America at least, biomedical research labs operate largely as fiefdoms of the individual principal investigators (PIs). The actual research work falls almost entirely on the backs of grad students and postdoctoral fellows. The grad students need to generate "good" data in order to graduate, the postdocs need the s…

>labs operate largely as fiefdoms of the individual principal investigators To add to the injury, you wouldn't believe the extent of the actions to which some PIs become engaged in order to attain/preserve their 'power'. Illegal, unethical and pathetic. The core problem is that PIs are human, and humans are flawed. The solution (if there is one) should take this into account, and somehow try to reduce it systematical…

> The core problem is that PIs are human

Actually, the problematic behaviours you describe are encouraged at the institutional level, because institutions also get more funding if they output more/better research. The fact that postdocs don't want to commit scientific suicide for the sake of morals in that context should surprise no one.

The ground truth is that scientific research has been turned into a poorly regulated industry, and we are all poorer for it.

There's a very simple solution to alleviate this pain: be much more selective starting at the undergrad level. But that generates less money, so baaaaad...

Re: Cracking down on research fraud

#178

So, some years ago, Temple Grandin wrote a set of standards and McDonald's adopted it and they buy so much beef that it became the de facto new standard for the beef industry. And it's a set of standards that helps beef producers succeed rather than a "gotcha" trying to find who is guilty. And that's the way you make the world a better place. Not by looking for new and creative ways to nail "bad guys" to the wall aft…

The McDonald's story reminds me of the Brussels effect [0] where legislation in the EU is extending (not by law but in its effect) to other parts of the world because it is easier or cheaper to comply with it for all customers than to treat EU costumers and others differently.

[0] https://en.wikipedia.org/wiki/Brussels_effect

Re: Cracking down on research fraud

#179

Earlier quoted context omitted.

Part of the point is that the gap in the middle often doesn't matter. I've hung around the Stanford crowd and as I enter my thirties I am awestruck by the opportunities they have regardless of what they have done since graduation. The credential is almost all that matters, as long as they dont mess up massively. A common path is: Graduate Stanford => Work at Mckinsey => Get hired into VC. Graduate Stanford => Raise 1…

Of every 2,000 graduating seniors at Stanford every year, far less than 1% end up in top consulting companies. Even fewer raise a Series A 2-3 years out of school. I am personally not so shocked that these individuals end up succeeding at other social games. They have a track record of doing so.

What about GSB? I think 20% of their students hail from MBB, same as with HBS.

I'd imagine that these to-be MBA-holders will seek positions at less grind-y places. Would not surprise me if a lot of them went to join VC firms, or product manager jobs at larger firms, before VC.

Re: Cracking down on research fraud

#180

So, some years ago, Temple Grandin wrote a set of standards and McDonald's adopted it and they buy so much beef that it became the de facto new standard for the beef industry. And it's a set of standards that helps beef producers succeed rather than a "gotcha" trying to find who is guilty. And that's the way you make the world a better place. Not by looking for new and creative ways to nail "bad guys" to the wall aft…

The McDonald's story reminds me of the Brussels effect [0] where legislation in the EU is extending (not by law but in its effect) to other parts of the world because it is easier or cheaper to comply with it for all customers than to treat EU costumers and others differently. [0] https://en.wikipedia.org/wiki/Brussels_effect

[deleted]
Post reply on HN