Live data from Hacker News

Ask HN: How do you critically evaluate scientific papers?

news.ycombinator.com

61–63 of 63 posts

Re: Ask HN: How do you critically evaluate scientific papers?

#61
post #60

I want to pass forward words given to me during my masters (by a prof Michel Bouvier if interested) that has stuck with me forever, on how to read a paper: 1. Read the abstract super carefully. Typically nothing in a paper that’s not in the abstract should be considered as absolutely confirmed by that paper. 2. If you’re new to the field, you can read the introduction. Ideally you shouldn’t need to. 3. Directly skip…

I can't help but think this is sometimes an excuse to not read the actual article. If one doesn't have the time to read it, that's understandable. But the best response would be to recuse yourself from the review rather than avoiding reading it. If it's unclear after reading it, it's fine to reject it but I think we owe it to the authors to at least read it in its entirety. It's not uncommon to have to explain this t…

Uhm, I’m only talking about reading papers that are published. No way would I condone a reviewer doing this to a paper they are reviewing lol.

Also I emphasized that this is more true in biology. When there’s no math or software, there’s often nothing to gain from the text of the results. The evidence is supposed to be in the figures.

Re: Ask HN: How do you critically evaluate scientific papers?

#62
post #60

Earlier quoted context omitted.

I can't help but think this is sometimes an excuse to not read the actual article. If one doesn't have the time to read it, that's understandable. But the best response would be to recuse yourself from the review rather than avoiding reading it. If it's unclear after reading it, it's fine to reject it but I think we owe it to the authors to at least read it in its entirety. It's not uncommon to have to explain this t…

Uhm, I’m only talking about reading papers that are published. No way would I condone a reviewer doing this to a paper they are reviewing lol. Also I emphasized that this is more true in biology. When there’s no math or software, there’s often nothing to gain from the text of the results. The evidence is supposed to be in the figures.

Oops, sorry for the misinterpretation but thank you for clarifying.

Re: Ask HN: How do you critically evaluate scientific papers?

#63
My first post ever here but this is such an important topic. If this crowd of above average readers and thinkers cannot come to a consensus, how on Earth would lay people? Science journalism attempts to simplify academic papers for lay audiences, despite some people believing they ought not do so. If not them, then who? There exists an extremely low level of literacy about knowledge formation and especially about how consensuses are derived about even salient subjects, such as man made climate change where the stakes are very high and the impact touches every living organism--yet, there is very little education for the public about how we know what we know. And then there is the additional problem of how to referee between experts, especially in soft 'sciences' such as economics, or even health care. How does the public distinguish who is correct when both sides of an argument are Nobel Prize winners in economics, or when one well-known medical journal say X is bad for your health, and another well-regarded medical journal says the opposite? There must be a way to cut through the haze of competing claims. Your references and links to help solve this problem will be appreciated.
Post reply on HN