Live data from Hacker News

Fraud, so much fraud

science.org

61–70 of 868 posts

Re: Fraud, so much fraud

#62
These sorts of articles raise so many thoughts and emotions in me. I was trained as a computational biologist with a little lab work and ran gels from time to time. Personally, I hated gels- they're finicky, messy, ugly, and don't really tell you very much. But molecular biology as a field runs on gels- it's the priimary source of results for almost everything in molbio. I have seen more talks and papers that rested entirely a single image of a gel which is really just some dark bands.

At the same time, I was a failed scientist: my gels weren't as interesting, or convincing compared to the ones done by the folks who went on to be more successful. At the time (20+ years ago) it didn't occur to me that anybody would intentionally modify images of gels to promote the results they claimed, although I did assume that folks didn't do a good job of organizing their data, and occasionally published papers that were wrong simply because they confused two images.

Would I have been more successful if fewer people (and I now believe this is a common occurrence) published fraudulent images of gels? Maybe, maybe not. But the more important thing is that everybody just went along with this. I participated in many journal clubs where folks would just flip to Figure 3, assume the gel was what the authors claimed, and proceed to agree with (or disagree with) the results and conclusions uncritically. Whereas I would spend a lot of time trying to understand what experiment was actually run, and what th e data showed.

Re: Fraud, so much fraud

#63
post #41
post #11

I'm the furthest thing from a scientist unless you count 3,000 hours of PBS spacetime, but I love science and so science/academia fraud to me, feels kinda like the worst kinda fraud you can commit. Financial fraud can cause suicides and ruin in lives, sure, but I feel like academic fraud just sets the whole of humanity back? I also feel that through my life I've (maybe wrongly) placed a great deal of respect and trus…

Pick up an old engineering book at some point, something from mid 1800's or early 1900's and you'll quickly realize that the trust people put on science isn't what it should be. The scientific method works over a long period of time, but to blindly trust a peer review study that just came out, any study, is almost as much faith as religion, specially if you're not a high level researcher in the same field and have sp…

Going to need some citations here since the texts that I'm familiar with from that time period are "A Treatise on Electricity and Magnetism" by Maxwell (mid-late 1800s) and "A History of the Theories of Aether and Electricity" by E. T. Whittaker, neither of which mentions anything of the sort. I suspect you are choosing from texts that at the time likely would not have been considered academic or standard.

Re: Fraud, so much fraud

#64
post #44

This sort of behavior is only going to worsen in the coming decades as academics become more desperate. It's a prisoner's dilemma: if everyone is exaggerating their results you have to as well or you will be fired. It's even more dire for the thousands of visa students. The situation is similar to the "Market for lemons" in cars: if the market is polluted with lemons (fake papers), you are disincentivized to publish…

My recommendation is for journals to place at least equal importance to publishing replications as for the original studies. Studies that have not been replicated should be published clearly marked as preliminary results. And then other scientists can pick those up and try to replicate them. And institutions need to give near equal weight to replications as to original research when deciding on promotions. Should be…

The problem with putting the onus on the journals is there is no incentive for them to reward replications. Journals don't make money on replicated results. Customers don't buy the replication paper they just read the abstract to see if it worked or not.

I do like the idea of institutions giving tenure to people with results that have stood the test of time, but again, there is no incentive to do so. Institutions want superstar faculty, they care less about whether the results are true.

The only real incentive that I think can be targeted is still grant money, but I would love to be proved wrong.

Re: Fraud, so much fraud

#65
Everyone seems to acknowledge this is a problem, but refuse to believe it actually affects anything when it comes time to "trust the science". Yes, science is corrupted, but all the results can be trusted, and the correct answer is always reached in the end. So, is it really a problem? Or not?

Re: Fraud, so much fraud

#66

Is there no liability for the author? There are billions of dollars wasted in drug trials and research that can be tied to this fraud. Surely they can face some legal issues due to this?

Like all things in life that have risks of fraud, negligence or potential failure, insurance could be the answer.

Want to publish in a peer reviewed paper? Well then your institution or you should take out a bond or insurance policy that guarantees your work is accurate. The insurance amount would fluctuate based on how big of impact this study could have. Is it a drug that will be consumed by millions? Big insurance policy. Is it a behavioral study without much risk... small insurance policy.

Is a a person in an institution found caught committing fraud, well now then all papers from that institution now have higher premiums.

Did you sign off on a peer reviewed paper that was fraud? Well now your premiums are going up also.

Insurance costs too high to publish? Well then keep doing research until the underwriters are satisfied that your work isn't fraud and adjust the premiums down.

It adds a direct near-term economic incentive to publish honestly and punishes those that abuse the system.

Re: Fraud, so much fraud

#67
post #41
post #11

I'm the furthest thing from a scientist unless you count 3,000 hours of PBS spacetime, but I love science and so science/academia fraud to me, feels kinda like the worst kinda fraud you can commit. Financial fraud can cause suicides and ruin in lives, sure, but I feel like academic fraud just sets the whole of humanity back? I also feel that through my life I've (maybe wrongly) placed a great deal of respect and trus…

Pick up an old engineering book at some point, something from mid 1800's or early 1900's and you'll quickly realize that the trust people put on science isn't what it should be. The scientific method works over a long period of time, but to blindly trust a peer review study that just came out, any study, is almost as much faith as religion, specially if you're not a high level researcher in the same field and have sp…

We use EM radiation for illnesses and doctors apply them. It's one of the most important diagnostic and treatment options we have. I think what you're referring to is invalid therapies ("woo" or snake oil or just plain ignorance/greed) but it's hard to distinguish those from legitimate therapies at times.

Re: Fraud, so much fraud

#68
post #53

For all the complaints about AI generated content showing up in scientific journals, I'm exited for the flip side, where an LLM can review massive quantities of scientific publications for inaccuracies/fraud. Ex: Finding when the exact same image appears in multiple publications, but with different captions/conclusions. The evidence in this case came from one individual willing to volunteer hundreds of hours producin…

LLMs might find some specific indications of possible fraud, but then fraudsters would just learn to avoid those. LLMs won’t be able to detect when a study or experiment isn’t reproducible.

Of course, but increasing the difficulty of committing fraud is still good. Fraudsters learn to bypass captchas as well, but they still block a ton of bad traffic.

Re: Fraud, so much fraud

#69
post #44

This sort of behavior is only going to worsen in the coming decades as academics become more desperate. It's a prisoner's dilemma: if everyone is exaggerating their results you have to as well or you will be fired. It's even more dire for the thousands of visa students. The situation is similar to the "Market for lemons" in cars: if the market is polluted with lemons (fake papers), you are disincentivized to publish…

My recommendation is for journals to place at least equal importance to publishing replications as for the original studies. Studies that have not been replicated should be published clearly marked as preliminary results. And then other scientists can pick those up and try to replicate them. And institutions need to give near equal weight to replications as to original research when deciding on promotions. Should be…

You should be able to build an entire career out of replications: hired at the best universities, published in the top journals, social prestige and respect. To the point where every novel study is replicated and published at least once. Until we get to that point, there will be far fewer replications than needed for a healthy scientific system.

Re: Fraud, so much fraud

#70

Earlier quoted context omitted.

From personal experience, it is all I've seen. Could anyone be in a position to extrapolate to all of academia without speaking from personal experience? I'm not speaking of all academics (hence 'most'). It's a statement similar to "Hollywood has a drug problem" or something of that sort. My advice to anyone going into Hollywood would be to stay away from drugs; my advice to anyone going into academia is to treat eve…

I work in Hollywood. I am not sure it has more of a drug problem more than say tech or finance. Maybe it does-- I don't know. The point is when a celebrity is a drug addict you hear about it. When a banker or a lawyer is you don't. Our experience of things has a lot of bias toward what we want to hear. Generalization plays into sterotypes and ideology.

I believe that tech and finance also have a drug problem. Those that sell expensive drugs like cocaine go after rich clients. You work in Hollywood, but have you been attending wild private parties? I've worked in academia and I was in the thick of it, I've experienced first hand the fraud I'm talking about, and it was a large part of my experience, not some side note. Perhaps it's an uncomfortable truth that academia is in the state it is in, but again, it is of utmost importance to warn younger people to its perils. (Act as if you're at a poker table at all times.) In any case, how do you know that it isn't your biases that prevent you from considering what I describe? What is so surprising with the claim that people who are very incentivized to steal and commit fraud do so if they are not punished for it?

edit: and it's not things I've heard, instead it is direct experiences, i.e. people stole my work, and things like that. As a graduate student to watch professors come to you with problem X, take what you've said (an actual solution) and publish a paper without attribute, that sort of thing; to report it and have nothing be done about it, et cetera, and on it goes, it's just instance after instance of such behavior, or the million ways in which they are careful to trick you into working on their problems without receiving attribute. One such trick for example, that again happened to me, is that after a conference talk I got into an e-mail discussion where I explained my approach; I was told that "they already have these results" (the trick here was to divulge less in the talk than what was currently known in order to be able to avoid "significant progress by another person" in the case another person does share new progress that they have already established, and hence not having to share attribution.) It turned out that our discussion was enough for them to go from n=3,4 to a general formula involving primes, because I pointed out a certain property they had not noticed. This is just a single example of the sorts of tricks, aside from total fraud, that happen, and one of the milder incidents I had happen to me.

Post reply on HN