Live data from Hacker News

Time to assume that health research is fraudulent until proven otherwise?

blogs.bmj.com

471–480 of 491 posts

Re: Time to assume that health research is fraudulent until proven otherwise?

#471

Earlier quoted context omitted.

> They do, and all energy needs can be met with solar, wind and grid energy storage. Not true. Not even close. Particularly if you move away from optimal solar regions. In addition to that, manufacturing the grid energy storage capacity required to service planetary scale requirements will result in unspeakable consumption of natural resources (mining), pollution and environmental challenges. Not to speak of the amou…

A lot to parse here, so I just feel like picking a couple of points. There exist lubricants for which non-fossil crude oil production sources are possible such as PAG and others. Likewise, there exist many plastics and synthetic rubber that are not petro based, however ethylene, which is a petrochemical byproduct, is still required for a lot of plastic uses. This doesn't matter much, it is totally possible to produce…

> There exist lubricants for which non-fossil crude oil production sources are possible such as PAG and others. Likewise, there exist many plastics and synthetic rubber that are not petro based, however ethylene, which is a petrochemical byproduct, is still required for a lot of plastic uses. This doesn't matter much, it is totally possible to produce these things without vast ghg production.

Sure. However, the problem with this idea is that it is easy to pick a few things here and there that can be done without petroleum. However, once you take in the entirety of industry, the range and scale of products we derive from petroleum or products that very much directly depend on petroleum and derivatives it truly massive. The world would come to a grinding halt if we stopped using petroleum.

This stands to reason. In an effort to extract more and more value out of the stuff we have become very creative and efficient at using as much of that black goo as possible for all kinds of things. We are talking about hundreds of years of research and technological evolution. It is only reasonable that, given that, humanity is as dependent as can be on the oil ecosystem.

This is what I talk about when I say that we need to stop this business of reducing reality to single variables. The consequences of reacting to a single variable while ignoring the dependency tree could result in far worse outcomes than anyone could possibly imagine.

Re: Time to assume that health research is fraudulent until proven otherwise?

#472

Earlier quoted context omitted.

This is one of the problems I have with the absolute freak show that climate science/global-warming/saving-the-planet has become. It is, at a minimum, a triangle of bad actors with one corner being politicians --fear-based vote harvesting--, the second being business --jump on the bandwagon and print money...facilitated by politicians who want votes in exchange for fear mongering-- and, finally, religious-based detra…

Have you considered the flipside, which has much more evidence for it, that denialism is being promoted by institutions and speakers who are by proxy funded by the fossil fuel industry, which is one of the largest industries on earth? I really reccomend, if you want a level headed, conservative, independent look at the issue that you check out some of these videos by Potholer54, a retired geologist and science report…

It is almost guaranteed this is actually happening. What should this be a surprise?

Re: Time to assume that health research is fraudulent until proven otherwise?

#473

Earlier quoted context omitted.

> They do, and all energy needs can be met with solar, wind and grid energy storage. Not true. Not even close. Particularly if you move away from optimal solar regions. In addition to that, manufacturing the grid energy storage capacity required to service planetary scale requirements will result in unspeakable consumption of natural resources (mining), pollution and environmental challenges. Not to speak of the amou…

> Not true. Not even close. Particularly if you move away from optimal solar regions. Convenient that you just skipped over one of the options that doesn't require "optimal" solar regions. > In addition to that, manufacturing the grid energy storage capacity required to service planetary scale requirements will result in unspeakable consumption of natural resources (mining), pollution and environmental challenges. No…

> No, what I'm doing is telling you that there is a benefit there. Our current grid design is frankly terrible, speaking as an electrical engineer.

Then please, pretty please, with sugar on top: You have the scientific and mathematical training to actually understand that what you are being told is complete bullshit. However, you have to be willing to apply some of that critical thinking, engage in some simple research, do a little math and try to understand. However, you have to be willing to leave this single variable view of the world behind during the process.

Grid storage = good?

Current grid design = terrible?

Well, grid storage today means batteries. It does not mean Star Trek dilithium crystals, hydroelectric plants, compressed underground air, spinning masses or the myriad interesting-but-unrealizable ideas people have floated. In the US, in particular, it would take a hundred years to build just one new hydroelectric plant, much less a couple of hundred of them.

Everything sounds great until you start considering scale. A town of 30K people, in an optimal solar region, full solar with batteries at every home? Sure.

I have a 13 kW system at my home that I built myself. I might add batteries at some point in the future, when and if it makes sense. Would I recommend everyone in my neighborhood do the same? No. It's crazy. This was likely the single worse investment I have ever made.

Scale IS a problem. Most definitely.

Scale means that for everyone to have what I have (or will have, if I ever install batteries) you have to be willing to do things like destroy thousands of miles of marine ecosystem to mine the very materials we need to make something like this happen at scale.

Scale is the problem. You have the background to be able to explore and understand this.

Electric vehicles. Calculate the energy we deliver into gas tanks every day through gasoline. Now calculate what that means in terms of total energy delivery EVERY DAY across the US. Make an accounting of our current energy generation capacity. Which, BTW, does not happen to have been built to support a 100% or 200% demand increase. Now translate the total energy delta demanded by a fleet of, say, 300 million electric vehicles, into, say, 1 GW nuclear power plants. The conclusion, if I remember correctly, is that we need somewhere in the order of 100 new 1 GW class nuclear power plants spread across the nation in order to support a full shift into electric vehicles.

The other problem is POWER rather than energy. In other words, you have to be able to deliver a certain amount of energy per unit time simultaneously across geographic areas. If you have 100K or a million cars charging simultaneously you are going to have to build additional POWER delivery capacity in order to service that demand, something that today (in terms of energy) we deliver using a liquid fuel.

When you start considering scale and get beyond single variable reduction of reality, things look very different. Coincidentally, the Los Angeles Times published an article about the mess we are walking into due to our drive to move into electric cars:

https://www.latimes.com/politics/story/2021-07-21/california...

From the article:

"A mining permit pushed through in the last week of the Trump administration allows the Canadian company Lithium Americas Corp. to produce enough lithium carbonate annually to supply nearly a million electric car batteries. The mine pit alone would disrupt more than 1,100 acres, and the whole operation — on land leased from the federal government — would cover roughly six times that. Up to 5,800 tons of sulfuric acid would be used daily to leach lithium from the earth dug out of a 300-foot deep mine pit."

Seriously?

And this is for JUST a million batteries per year. I assume they mean cells rather than the full car battery. Whatever the case may be, at scale, this is horrific. Yes, I said "at scale" because a million per year is not scale. We need many times that, thousands of times that amount if we are going to electrify the global transportation fleet. If we also want to use the same materials for grid energy storage the problem, again, at scale, quickly reaches apocalyptic proportions.

All I am asking you to do is to invest the time to really get into the details of the issue and use the math and science you understand to develop a true sense of proportion.

My guess is that the current path to electric energy storage is, at scale, a seriously flawed idea. I am not a chemist, so I can't propose an alternative that would be more benign at scale other than to say two things:

First, we need to be very careful and not allow politicians and various interests to lead us by the nose into causing a global disaster of unimaginable proportions.

Second, I have a sense --and the hope-- that a bright young scientist might just discover a path to store and deliver energy in liquid form in a way that will not have us resort to such things as strip mining the oceans and dumping millions of tons of sulfuric acid into mines to leach lithium out of them.

I don't have the answers. I just know we are probably being led down a path that could be far uglier than pumping petroleum out of the ground. We are making dumb decisions, like cancelling the XL pipeline...which means oil will have to be trucked...which will burn millions of gallons of refined diesel fuel to move petroleum at a horrific loss in efficiency. In the meantime, we have no problem dumping thousands of tons of sulfuric acid into mines to get lithium for "clean" electric cars and storage.

Does this really make sense to you? At scale?

I hope not.

Re: Time to assume that health research is fraudulent until proven otherwise?

#474

Earlier quoted context omitted.

> I haven't, but I'm unclear why it's relevant given that you don't seem to really be disagreeing! It's relevant because you are criticizing the process but you don't seem to understand how it actually works. Your original characterization was that grant money is "this firehose of tax money being sprayed everywhere without even the slightest bit of accountability in how it's used." The reality is, when I get grant mo…

I think we are 80% in agreement but still using words differently. > when I get grant money I need to account for how every dollar is spent Yes I know, but that's not what I mean by accountability. Again: nobody is upset with academics because of expenses scandals or taking too many expensive flights. Well, except maybe for climatologists who supposedly take more flights than the average academic, but that's due to t…

I'll try not to do another wall of text since we're mostly in agreement, but I will make a couple final comments:

> Your argument about who it would or wouldn't be good for seems a bit contradictory and I struggled to follow it. You're arguing it would be both bad for Google and Microsoft yet also make them stronger.

What I meant is, if e.g. Page and Brin in 1998 had no access to government funding and research because it was privatized by e.g. AOL, there wouldn't be a Google today. But if we were to privatize all research, Google of today would certainly like that insofar as it strengthens their market position (jut like the AOL of 1998 would like the situation), but it also means they have to start funding more research because now they can't get any from the public.

> - The web was very briefly funded - What government funded tech was Microsoft built on? - Neural networks were a backwater

But the point is that it all started with government funding, so we need to be very careful about the consequences of privatizing it all. Today, ideas start out funded by the government, they gain legs in academia, move out into corporations, and are productized and disseminated to the public in the form of consumer goods. This is the progress pipeline, and it's proven extremely effective and enduring at driving innovation.

You want to cut out the beginning of the process because you think corporations can handle that part, but I don't think you've really demonstrated that. Can you point to any tech product out there that is exclusively built on in-house, private research? I certainly can't think of one.

For example, you bring up the origin of Page & Brin. Yes, they never finished their Ph.D., but the fact is they did meet in grad school while they were doing NSF funded work. Brin was at Stanford on an NSF fellowship. They built the first prototype of Google on an NSF grant. They were mentored by academics who also were funded by the NSF as professors and graduate students themselves. You take that funding away, and maybe these two people never meet, maybe they never learn what they need to get that spark of insight. So I agree with you that the next Google will come from the same place the previous one did - a government-funded research lab in Silicon Valley. The garage is where they moved their operation only after they had already used a lot of NSF money to get their start.

> 1. DARPA is military research and therefore structured differently to how the NSF does things. The very structure of it as a Grand Challenge is a clue here: the output of the programme was cars (not) going round a track, not papers and citations.

The processes of getting grants from NSF and DARPA are very similar, and in most cases the deliverable is a paper. The Grand Challenges are the exception of DARPA funding, not the rule.

> Military R&D is different, governments can fund that semi-effectively because they actually use the outputs.

Yes and no. DARPA would like to use the fruits of its funded research, but it funds projects on a very long timescale, so what it funds may or may not be used in the long term. Sometimes the research is not to strengthen the military per se, but to strengthen American interests though creating domestic tech sectors. e.g. I'm sure the military would like to use autonomous vehicles, but what's even better is for America to have its own domestic autonomous car sector that can produce those vehicles.

> most academic output is useless and has no impact.

You've tried to make the case that we should optimize toward useful research, and companies are better at identifying useful research because they have a profit motive, but I still think it's difficult to say today what research will be important 30-40 years down the line. DARPA recognizes that it's very hard to tell how useful research will be ahead of time, and that corporations don't like to engage in foundational research when there is no obvious short-term path to profit. This was the entire point of the Grand Challenge series, and it worked out well -- they wanted to bootstrap the autonomous car industry, so they paid researchers to get them rolling and now look where we are. If the government hadn't gotten involved, there probably wouldn't be an autonomous car sector in the US today.

There are plenty of cases in our history where some technology seemed useless initially turned out to be bigger than anyone could have imagined. We need to be careful not squelch those ideas too quickly because they don't return an immediate profit. Things like the Internet and neural networks come to mind. A lot of people, particularly large corporations, thought the Internet was a toy when it first was introduced. Neural networks seemed like a dead end and then found new life. But the fact is they started in academia. The Deepmind arcade paper and essentially the entire deep reinforcement learning field today is based on decades-old research funded by the UK government. What if that research was locked away in a UK corporation? Would Deepmind even exist? That research was a toy for 30 years, until it wasn't.

The whole point of DARPA and other government funding agencies is that they don't know what the winners are ahead of time, and I don't think corporations can know this either. (if they could, why didn't they do more to fund RL research 30 years ago?). Therefore we shouldn't try to optimize for obvious winners because we'll miss out on non-obvious winners, which bring the biggest upsides. This means we have to fund losers and research that ends up not being useful, and we should be okay with that, because things have turned out pretty well over all.

> 2. I'm not arguing for prosecution of researchers who end up with null results!

Sorry I thought you were with this:

  We will therefore prosecute you for research fraud and failure to meet the terms of your contract.
I guess you mean failing to meet the terms of your contract and fraudulently representing that. But it still doesn't address the incentive to commit fraud because if you fail to meet your objectives, you're still not going to get published and therefore won't get the next grant, so your career is still derailed. It just means people will try to hide the fraud better.

After I typed all this I realized I failed at my pledge to not give you a wall of text. Oops!

Re: Time to assume that health research is fraudulent until proven otherwise?

#475

Earlier quoted context omitted.

For what possible reason are you asking that question of anyone?

Well, maybe you own a waxing salon that does Brazilian waxes and you're Muslim and don't believe you should see or be in contact with male genitalia besides that of your husband. https://en.m.wikipedia.org/wiki/Jessica_Yaniv > In 2018, Yaniv filed discrimination complaints with the British Columbia Human Rights Tribunal against multiple waxing salons alleging that they refused to provide genital waxing to her because…

Before anyone jumps in this thread saying "WOKE CULTURE IS DESTROYING THE WORLD", she also lost all of her lawsuits.

> In October 2019, the Tribunal ruled against Yaniv and ordered her to pay $6,000 in restitution... The ruling was critical of Yaniv... stating that she "targeted small businesses, manufactured the conditions for a human rights complaint, and then leveraged that complaint to pursue a financial settlement from parties who were unsophisticated and unlikely to mount a proper defence."

This is a person who deliberately does all sorts of weird shit for the sole purpose of using her trans identity to sue people when they react negatively to it.

For example, she apparently called her local fire department "dozens of times" for "help getting out of the bath" (when in reality she needed no assistance) and "subjected Fire Department staff to "inappropriate and lewd conduct"".

Re: Time to assume that health research is fraudulent until proven otherwise?

#476

Earlier quoted context omitted.

A lot to parse here, so I just feel like picking a couple of points. There exist lubricants for which non-fossil crude oil production sources are possible such as PAG and others. Likewise, there exist many plastics and synthetic rubber that are not petro based, however ethylene, which is a petrochemical byproduct, is still required for a lot of plastic uses. This doesn't matter much, it is totally possible to produce…

> There exist lubricants for which non-fossil crude oil production sources are possible such as PAG and others. Likewise, there exist many plastics and synthetic rubber that are not petro based, however ethylene, which is a petrochemical byproduct, is still required for a lot of plastic uses. This doesn't matter much, it is totally possible to produce these things without vast ghg production. Sure. However, the probl…

What you mentioned here is for sure true, but mainly the pertinent data revolves around burning the stuff. All the petrochemicals aren't doing this, its the ghg, mostly from combustion.

Sorry to quote in this way, it isn't meant to editorialize, only to organize my response:

> [...]the problem with this idea is that it is easy to pick a few things here and there that can be done without petroleum. [...] The world would come to a grinding halt if we stopped using petroleum.

Its super useful and there's no reason to quit using it entirely. We don't even have to, there are many other means of doing what we need to do without it releasing ancient carbon stores into the atmosphere.

Everything bound up in the petro supply chain is clearly beyond the scope of my comment here and education in general, but the only way to approach reasoning about this issue is with single examples. Its too easy for somebody to gish gallop about the huge scale of industry involved, and quickly lose the fact that CO2 has to be the target. NMOG and Methane and nitrogen oxides as well, but mainly CO2.

Nobody will clear the table with a single "we can just X" or "we can't because we'll lose X". Its definitely much more involved, just as you say. One thing I strongly agree with you about is that nuclear energy is likely a critical help to this endeavor.

The largest global sources are, unsurprisingly, electricity/energy, transportation, and manufacturing, but also consider the global hegemony that for the most part turns on controlling and using this strategic resource, ever since WWI. That is all about burning it in large part.

Maybe we need a "Breton Woods" for carbon, as triggering and possibly unpopular as that may be. I'm certainly not betting on that turn of events, but we may just end up resorting to a different type of nuclear power if we just keep the blinders on ...

Re: Time to assume that health research is fraudulent until proven otherwise?

#478
post #456

Earlier quoted context omitted.

Zero data of the effects after three years . Plenty of data about the effects after one. It's not “reasoning without data”; it's reasoning without as much data as one would have liked. Are you doing this on purpose?

The commenter did not say the results of one year were under consideration. They described a state of recommendation without information. Besides, March to July isn’t even half a year for phase 3 trials. https://www.clinicaltrials.gov/ct2/show/NCT04811664

I did mention inferences.

You seem to be concerned that I don't maintain a state of complete agnosticism in any matter which I lack data for, but it's really hard to do so in practice in a world of distinct choices. Most everybody will either get vaccinated or not get vaccinated and at least have made an implicit prediction about the future. Since I was pressured into making that choice it seems hardly surprising that I'm willing to opine on this issue where I lack data.

Re: Time to assume that health research is fraudulent until proven otherwise?

#479

Earlier quoted context omitted.

I think we are 80% in agreement but still using words differently. > when I get grant money I need to account for how every dollar is spent Yes I know, but that's not what I mean by accountability. Again: nobody is upset with academics because of expenses scandals or taking too many expensive flights. Well, except maybe for climatologists who supposedly take more flights than the average academic, but that's due to t…

I'll try not to do another wall of text since we're mostly in agreement, but I will make a couple final comments: > Your argument about who it would or wouldn't be good for seems a bit contradictory and I struggled to follow it. You're arguing it would be both bad for Google and Microsoft yet also make them stronger. What I meant is, if e.g. Page and Brin in 1998 had no access to government funding and research becau…

That's OK :) Better walls of text than not!

What I mean by prosecution is that if a research body signs a contract with a scientist to do research, then those contracts would need to specify what research actually is, and that is the first step towards penalizing people who aren't really doing it. Indeed the process of flushing more research into the private sector would automatically eliminate a lot of the grey-area fraud that is so prevalent, because it would force a lot more people to write down what precisely they mean by "doing research", as well as continually evaluate that definition via normal management techniques. For example, is a simple modelling exercise "research"? It's often treated as such by e.g. banks, but the big tech labs we're talking about don't engage in a much of that, unless you count AI, but I think that's sufficiently beyond the sort of modelling you find in most science that it's best to treat it separately.

At the moment governments fund science but have no working definition of what science is, which breeds a lot of cynicism of the type I display above w.r.t. sociology. Is gender studies "science"? Most people would say no, but the government says yes. A more subtle example is epidemiology. A close examination of their papers will reveal that it's just plugging public CSV files into a bunch of very over-simplified simulations, and publishing the outputs. Is that science? If it is, can I get paid to play Cities: Skylines all day as long as I write a paper at the end? It sounds like a stupid suggestion but actually yes I can:

https://www.mdpi.com/2220-9964/9/2/118

In my view this type of thing is not science, but my guess is at this point the science-y ness of epidemiology or urban planning would split 50/50 or most people would just go with the government's definition of "they receive grants and call themselves scientists, therefore they're scientists".

Would Google exist without the NSF? The specific company maybe not, but there were plenty of search engines around before Google, and Page in particular was already keen on creating a tech company when he was very young so would likely have ended up a startup founder sooner or later. An example competitor was Inktomi, which had already started doing pay-per-click ads. It's all forgotten now but Google nearly didn't survive its early years because they got sued over 'stealing' the PPC ad concept. They were able to argue that their own elaborations on the idea were sufficiently different that it wasn't infringement. It's very plausible that one of these other firms would have struck upon the idea of PageRank; they were certainly incentivized to do so especially once Inktomi had realised that PPC ads were a way to monetize search engines.

"The Deepmind arcade paper and essentially the entire deep reinforcement learning field today is based on decades-old research funded by the UK government. What if that research was locked away in a UK corporation? Would Deepmind even exist?"

Well DeepMind is a difficult example to debate here for both of us because of course DeepMind is or was a UK corporation and they do the exact opposite of locking up their research, if anything they're famously publicity and paper hungry. Google/DeepMind are actually a strong counterpoint to the idea we need academia for long range research: DeepMind is nothing but long range research (of unclear utility!) and of course self driving cars have been driven by Google for the last decade, pun totally intended.

If I were arguing in your shoes I'd be trying to argue Google is the exception that proves the rule and/or trying to distract attention from it, because it shows that companies can and will do long range research. Microsoft Research is another example, although it's less "pure" because it's more or less a little recreation of academia inside of Microsoft. I prefer the Google approach where science and technology are fully integrated.

Now the wider issue of governments needing to fund long range research is one I used to fully agree with. It sounds right and it's easy to find examples where you can sort of link them to government funded research. But as you can see, I changed my mind over time and no longer find myself in that camp, because:

1. Government funded basic research isn't free. We have to weigh up costs and benefits. How much of a contribution does government grant money make to the technological successes we take for granted today? For examples like PageRank, self-driving or DeepMind the initial contribution was quite small and mostly in the form of logistics (grand challenges) or theory work (which is cheap). And how much of a cost does it impose?

2. The costs are not just financial. I guess this is what mostly changed my mind. I concluded a big part of the "cost" of government funded research is actually in terms of intellectual pollution of the literature. If you have to wade through 50 useless, deceptive or outright fraudulent papers to find 1 good one because governments aren't paying attention to what they fund, then that poses an externalized cost on everyone who wants to benefit from research. Moreover this work has to be endlessly duplicated because journals are loathe to retract anything, so everyone who wants to push technology forward in a certain area has to do this work within their own small group because there's no coordination mechanism ... or just give up and ignore the literature entirely (this is what eventually happened to me).

I think a stronger argument for government funded research than the "it would never have happened" approach is that government funded science is usually un-patented and freely accessible. But even this argument is kind of weak because universities do patent the results of tax funded science, maybe not in computer science but it happens a lot in other fields, and also because the results of the research are often behind paywalls too! Although that's been getting better with time and is usually not a problem in CS (which IMHO is definitely one of the better fields).

But overall, to me it's just not clear that the benefits of buying papers en-masse outweighs the costs, both in dollar terms, time terms and of course, the inevitable costs when people put bogus research into production and things go wrong.

Re: Time to assume that health research is fraudulent until proven otherwise?

#480
From the end of TFA:

> Research authorities insisted that fraud was rare, didn’t matter because science was self-correcting, and that no patients had suffered because of scientific fraud.

Thus aiding and abetting murderers like Paolo Macchiarini.

> All those reasons for not taking research fraud seriously have proved to be false, and, 40 years on from Lock’s concerns, we are realising that the problem is huge, the system encourages fraud, and we have no adequate way to respond.

As his patients could attest... If they weren't dead.

https://en.wikipedia.org/wiki/Paolo_Macchiarini

Post reply on HN