Fraud, so much fraud
61–70 of 868 posts
Re: Fraud, so much fraud
#62At the same time, I was a failed scientist: my gels weren't as interesting, or convincing compared to the ones done by the folks who went on to be more successful. At the time (20+ years ago) it didn't occur to me that anybody would intentionally modify images of gels to promote the results they claimed, although I did assume that folks didn't do a good job of organizing their data, and occasionally published papers that were wrong simply because they confused two images.
Would I have been more successful if fewer people (and I now believe this is a common occurrence) published fraudulent images of gels? Maybe, maybe not. But the more important thing is that everybody just went along with this. I participated in many journal clubs where folks would just flip to Figure 3, assume the gel was what the authors claimed, and proceed to agree with (or disagree with) the results and conclusions uncritically. Whereas I would spend a lot of time trying to understand what experiment was actually run, and what th e data showed.
Re: Fraud, so much fraud
#63I'm the furthest thing from a scientist unless you count 3,000 hours of PBS spacetime, but I love science and so science/academia fraud to me, feels kinda like the worst kinda fraud you can commit. Financial fraud can cause suicides and ruin in lives, sure, but I feel like academic fraud just sets the whole of humanity back? I also feel that through my life I've (maybe wrongly) placed a great deal of respect and trus…
Pick up an old engineering book at some point, something from mid 1800's or early 1900's and you'll quickly realize that the trust people put on science isn't what it should be. The scientific method works over a long period of time, but to blindly trust a peer review study that just came out, any study, is almost as much faith as religion, specially if you're not a high level researcher in the same field and have sp…
Re: Fraud, so much fraud
#64This sort of behavior is only going to worsen in the coming decades as academics become more desperate. It's a prisoner's dilemma: if everyone is exaggerating their results you have to as well or you will be fired. It's even more dire for the thousands of visa students. The situation is similar to the "Market for lemons" in cars: if the market is polluted with lemons (fake papers), you are disincentivized to publish…
My recommendation is for journals to place at least equal importance to publishing replications as for the original studies. Studies that have not been replicated should be published clearly marked as preliminary results. And then other scientists can pick those up and try to replicate them. And institutions need to give near equal weight to replications as to original research when deciding on promotions. Should be…
I do like the idea of institutions giving tenure to people with results that have stood the test of time, but again, there is no incentive to do so. Institutions want superstar faculty, they care less about whether the results are true.
The only real incentive that I think can be targeted is still grant money, but I would love to be proved wrong.
Re: Fraud, so much fraud
#65Re: Fraud, so much fraud
#66Is there no liability for the author? There are billions of dollars wasted in drug trials and research that can be tied to this fraud. Surely they can face some legal issues due to this?
Want to publish in a peer reviewed paper? Well then your institution or you should take out a bond or insurance policy that guarantees your work is accurate. The insurance amount would fluctuate based on how big of impact this study could have. Is it a drug that will be consumed by millions? Big insurance policy. Is it a behavioral study without much risk... small insurance policy.
Is a a person in an institution found caught committing fraud, well now then all papers from that institution now have higher premiums.
Did you sign off on a peer reviewed paper that was fraud? Well now your premiums are going up also.
Insurance costs too high to publish? Well then keep doing research until the underwriters are satisfied that your work isn't fraud and adjust the premiums down.
It adds a direct near-term economic incentive to publish honestly and punishes those that abuse the system.
Re: Fraud, so much fraud
#67I'm the furthest thing from a scientist unless you count 3,000 hours of PBS spacetime, but I love science and so science/academia fraud to me, feels kinda like the worst kinda fraud you can commit. Financial fraud can cause suicides and ruin in lives, sure, but I feel like academic fraud just sets the whole of humanity back? I also feel that through my life I've (maybe wrongly) placed a great deal of respect and trus…
Pick up an old engineering book at some point, something from mid 1800's or early 1900's and you'll quickly realize that the trust people put on science isn't what it should be. The scientific method works over a long period of time, but to blindly trust a peer review study that just came out, any study, is almost as much faith as religion, specially if you're not a high level researcher in the same field and have sp…
Re: Fraud, so much fraud
#68For all the complaints about AI generated content showing up in scientific journals, I'm exited for the flip side, where an LLM can review massive quantities of scientific publications for inaccuracies/fraud. Ex: Finding when the exact same image appears in multiple publications, but with different captions/conclusions. The evidence in this case came from one individual willing to volunteer hundreds of hours producin…
LLMs might find some specific indications of possible fraud, but then fraudsters would just learn to avoid those. LLMs won’t be able to detect when a study or experiment isn’t reproducible.
Re: Fraud, so much fraud
#69This sort of behavior is only going to worsen in the coming decades as academics become more desperate. It's a prisoner's dilemma: if everyone is exaggerating their results you have to as well or you will be fired. It's even more dire for the thousands of visa students. The situation is similar to the "Market for lemons" in cars: if the market is polluted with lemons (fake papers), you are disincentivized to publish…
My recommendation is for journals to place at least equal importance to publishing replications as for the original studies. Studies that have not been replicated should be published clearly marked as preliminary results. And then other scientists can pick those up and try to replicate them. And institutions need to give near equal weight to replications as to original research when deciding on promotions. Should be…
Re: Fraud, so much fraud
#70Earlier quoted context omitted.
From personal experience, it is all I've seen. Could anyone be in a position to extrapolate to all of academia without speaking from personal experience? I'm not speaking of all academics (hence 'most'). It's a statement similar to "Hollywood has a drug problem" or something of that sort. My advice to anyone going into Hollywood would be to stay away from drugs; my advice to anyone going into academia is to treat eve…
I work in Hollywood. I am not sure it has more of a drug problem more than say tech or finance. Maybe it does-- I don't know. The point is when a celebrity is a drug addict you hear about it. When a banker or a lawyer is you don't. Our experience of things has a lot of bias toward what we want to hear. Generalization plays into sterotypes and ideology.
edit: and it's not things I've heard, instead it is direct experiences, i.e. people stole my work, and things like that. As a graduate student to watch professors come to you with problem X, take what you've said (an actual solution) and publish a paper without attribute, that sort of thing; to report it and have nothing be done about it, et cetera, and on it goes, it's just instance after instance of such behavior, or the million ways in which they are careful to trick you into working on their problems without receiving attribute. One such trick for example, that again happened to me, is that after a conference talk I got into an e-mail discussion where I explained my approach; I was told that "they already have these results" (the trick here was to divulge less in the talk than what was currently known in order to be able to avoid "significant progress by another person" in the case another person does share new progress that they have already established, and hence not having to share attribution.) It turned out that our discussion was enough for them to go from n=3,4 to a general formula involving primes, because I pointed out a certain property they had not noticed. This is just a single example of the sorts of tricks, aside from total fraud, that happen, and one of the milder incidents I had happen to me.