Live data from Hacker News

How many medical studies are faked or flawed?

web.archive.org

21–30 of 257 posts

Re: How many medical studies are faked or flawed?

#21
post #14

Earlier quoted context omitted.

At least I get eggs from a neighbor and not “big egg”; I keep thinking about getting my own chickens but that’s not the way I want to feed Mr. Fox who lives in my neighborhood too.

Well, your free range chickens aren't truly free range if they don't have to fend off the occasional (and free range) fox! Nothing is more natural and free range than the occasional murder between animals.

I like where this thread is going.

Re: How many medical studies are faked or flawed?

#22
We all know it is super-easy to cheat in science, but not much can be done about it. Short of requiring replication for every result published which isn't feasible if the study was costly to produce. And the problem isn't confined to medicine either. How many studies in hpc of the type "we setup this benchmark and our novel algorithm/implementation won!" aren't also faked or flawed?

Re: How many medical studies are faked or flawed?

#23

"For more than 150 trials, Carlisle got access to anonymized individual participant data (IPD). By studying the IPD spreadsheets, he judged that 44% of these trials contained at least some flawed data: impossible statistics, incorrect calculations or duplicated numbers or figures, for instance. And in 26% of the papers had problems that were so widespread that the trial was impossible to trust, he judged — either bec…

You don't need "big pharma" for this. Researchers at universities also do these kinds of things because it helps them advance their careers.

Re: How many medical studies are faked or flawed?

#24

Earlier quoted context omitted.

Both of those are substances that should be harmful based on the effects of the major ingredients: e.g. caffeine is addictive and when I am deprived of it my schizotypy flares up and I have paranoid episodes (I yell at my wife “why the hell are you always standing where I want to go next?”) I have had two doctors tell me three other reasons why I should quit. Look in the medical literature and it seems outright spamm…

Furan content in coffee too. Very low amount but still. Coffee prevents headaches for me so I'll always drink it. And no it's not related to physical dependence although at this point the withdrawal will guarantee a headache.

I can relate. I never drank anything with caffeine and would get headaches fairly often. Headaches were never too bad or too often to need medical attention but was just normal part of life. I started drinking coffee on road trips and drives over 3 hours long and noticed that my headache coming on would go away right after. Now i drink coffee twice daily and i'll get a headache once a month at most.

Re: How many medical studies are faked or flawed?

#25

I often chuckle that same people who vehemently defend vaccine safety studies also decry studies that show processed seed oils, glyphosate, aspartame, and hundreds of other molecules or compounds are unsafe over time. That's the beauty of medical studies! Whether they're good or bad, your own biases mean you can simply ignore the ones that don't align with your opinions. Oh, before I forget! Red meat and saturated fa…

Hmm -- in usual fashion I haven't read the original post here, but I'm guessing it didn't find that RCT trials that big pharma do are quite as useless as most 'medical studies' generally.

Do you think well-funded RCTs (like those that support vaccine safety) are just as weak as any old observational study?

Re: How many medical studies are faked or flawed?

#26

While we're on the subject, how many studies period are faked or flawed to the point of being useless? It seems to me that the scientific community's reaction to the replication crisis has been to ignore it.

> It seems to me that the scientific community's reaction to the replication crisis has been to ignore it.

They've always known so there hasn't actually been any new information from which to spur action. In the academic circles I've run in there has always been a strong mistrust of reported results and procedures based on past difficulties with internal efforts replicating results. Basically a right of passage for a grad student to be tasked with replicating work from an impossible paper.

Re: How many medical studies are faked or flawed?

#27

"For more than 150 trials, Carlisle got access to anonymized individual participant data (IPD). By studying the IPD spreadsheets, he judged that 44% of these trials contained at least some flawed data: impossible statistics, incorrect calculations or duplicated numbers or figures, for instance. And in 26% of the papers had problems that were so widespread that the trial was impossible to trust, he judged — either bec…

You don't need "big pharma" for this. Researchers at universities also do these kinds of things because it helps them advance their careers.

>helps them advance their careers

... into the multi-billion dollar companies GP is talking about.

Re: How many medical studies are faked or flawed?

#28

While we're on the subject, how many studies period are faked or flawed to the point of being useless? It seems to me that the scientific community's reaction to the replication crisis has been to ignore it.

PIs may not be able to raise money for replication studies. Some of this is a consequence of guidelines for federal funds to prevent waste on duplication of effort.

Re: How many medical studies are faked or flawed?

#29
post #10

Those are two wildly different things. Most things are flawed. Deliberately fabricating results is anathema to advancing science.

Yes I work with these IPD spreadsheets every day and they all have typos often in the time/date column (issues with midnight and new years are very common) this can result in an erroneous reporting of something like average drug exposure or clearance if 1 or 2 subjects have uncaught errors in the reported data I would expect 26% or more studies have these flaws but faked data is a different thing entirely and 26% fak…

How many studies are faked and how many just have a 'selective outcome'? Almost every nutritional study I read is at some point sponsored by a group that would benefit from a positive (or negative) outcome. I imagine several studies are run and only the one where the conditions led to a desired outcome are actually published. The researchers may know the results are inconsistent and there is an error somewhere, but it's not in their best interest to find the error and correct it.

Re: How many medical studies are faked or flawed?

#30
post #14

Earlier quoted context omitted.

At least I get eggs from a neighbor and not “big egg”; I keep thinking about getting my own chickens but that’s not the way I want to feed Mr. Fox who lives in my neighborhood too.

Well, your free range chickens aren't truly free range if they don't have to fend off the occasional (and free range) fox! Nothing is more natural and free range than the occasional murder between animals.

My free range chickens are protected by free range fox predators that are communal with them. Sometimes they will eat a chicken or two, but mostly they let the chickens be because they keep the free range parasites in check.
Post reply on HN