I'm all for installing air filters in classrooms for a number of reasons, but I also think the extreme results from this study aren't going to hold up to further research. From the paper: > To do so, I leverage a unique setting arising from the largest gas leak in United States history, whereby the offending gas company installed air filters in every classroom, office and common area for all schools within five miles…
Based on your comment, the effect could be larger as well as smaller. All research is met on HN by people who know better and will tell you why it's flawed. There isn't a greater collection of expertise in the history of the world than on HN. Edit: I meant to add: What value can we find in this research? It wasn't published as scripture, the perfect answer to all our problems. It's one study of some interesting event…
The reality of any underpowered study could always be “larger as well as smaller”. This statement doesn’t add anything to the conversation.
The mistake is pivoting around poorly structured and underpowered research.
> All research is met on HN by people who know better and will tell you why it's flawed.
This is a misunderstanding. People who know how to read studies will always be aware of the limitations.
There’s a difference between saying “everything is flawed” and pointing out the limitations. Most early research comes with significant limitations like small sample sizes or large cofounders. You have to understand these in conjunction with the results to know how to interpret it.
There’s a cynical approach where people see discussion of limitations, don’t understand it, and instead go into a mode where they think it’s smarter to ignore all criticisms equally because every paper attracts criticisms.
This is just lazy cynicism, though. There are different degrees of criticisms and you have to be able to see the difference between something like a slightly underpowered study, and something like this paper where the authors threw a lot of regressions at a lot of numbers and kind of sort of claimed to have found a trend.