Live data from Hacker News

How to (seriously) read a scientific paper (2016)

science.org

11–20 of 66 posts

Re: How to (seriously) read a scientific paper (2016)

#11
post #2

Still waiting for an open discussion forum for scientific papers. Like StackOverflow, but every post is a paper. And there are experts of various gradations that help with questions.

I’m playing around with something similar here https://thetrecs.com/ . But no experts yet. Even though I do science, I have a hard time understanding abstracts from adjacent fields so I’m using llms to make the abstracts easier for me and my friends to understand

Re: How to (seriously) read a scientific paper (2016)

#12
post #2

Still waiting for an open discussion forum for scientific papers. Like StackOverflow, but every post is a paper. And there are experts of various gradations that help with questions.

It would be quickly overwhelmed, especially for complicated math papers

Re: How to (seriously) read a scientific paper (2016)

#13
post #2

Still waiting for an open discussion forum for scientific papers. Like StackOverflow, but every post is a paper. And there are experts of various gradations that help with questions.

Better yet (IMHO), like HN. In my field, I know where to find papers, etc. I'm interested in other fields, and not every paper; just rank them by a HN-like algorithm.

I said a few days ago, in my dream HN would be mostly papers. That's where the richest, most accurate, most intellectually curious information is - far beyond most things on HN.

Re: How to (seriously) read a scientific paper (2016)

#14

This misses the best skimming trick I learned from an advisor: After you read the abstract, read the last couple lines/paragraphs of the introduction. That's where you'll find the authors best summary of the paper's contributions and novelty. For instance, the first paper that popped up with some random search terms [0]: The present paper attempts to provide a structured and comprehensive overview of state-of-the-art…

Maybe I'm misunderstanding what you mean, but I don't think your trick was missed at all?

The second paragraph says:

>I start by reading the abstract. Then, I skim the introduction [...]

A few paragraphs down, another quote says:

>I always start with title and abstract. [...] I then read the introduction [...]

Another:

>I nearly always read the abstract first [...] I generally skim the introduction, reading its last paragraph

Is there something significantly different about what you are suggesting?

Re: How to (seriously) read a scientific paper (2016)

#15

This misses the best skimming trick I learned from an advisor: After you read the abstract, read the last couple lines/paragraphs of the introduction. That's where you'll find the authors best summary of the paper's contributions and novelty. For instance, the first paper that popped up with some random search terms [0]: The present paper attempts to provide a structured and comprehensive overview of state-of-the-art…

Maybe it depends on the literature. I almost never read the introduction, unless I am unclear on the motivation for the work from the abstract.

The fundamental problem with abstracts and introductions is that they're sales content. You can't trust them. The only thing you can do is decide if you wish to read further, and see if the paper says what they claim it says. For that, an abstract is sufficient about 99% of the time. Spending lots (or...any amount) of time on the intro before you read the data tables is basically asking to have time stolen from you.

For what it's worth, the proportion of papers where the body doesn't support the claims in the abstract is...high. Like way above 50%, in my experience (approaching nearly 100% for any random paper you find on HN or X.)

My algorithm is:

* read abstract. decide to continue.

* formulate my own version of the experiment in my head -- how would I go about answering this question?

* read all data tables, including supplemental materials. see if anything stands out as weird.

* look at all figures, including supplemental materials. see if anything stands out as weird.

* do I understand the data? if not, search for table/figure references from results, until I do (generally I end up reading most of the results, out-of-order).

* is this paper consistent with the way I'd have approached the problem? If not, is that important? what are the possible methodological flaws? what would they look like in the data?

* re-examine data to look for signs of flaws.

* does the data support the conclusion? if not, why not? what would I do differently or as a follow-up?

* finally, decide if the paper worth reading in detail.

Re: How to (seriously) read a scientific paper (2016)

#16
post #5
post #2

Still waiting for an open discussion forum for scientific papers. Like StackOverflow, but every post is a paper. And there are experts of various gradations that help with questions.

Individual subreddits have usually been my go-to place to discuss and understand the nuances of academic papers. Love LocalLLama for discussions on generative AI papers.

[deleted]

Re: How to (seriously) read a scientific paper (2016)

#17
> As editor-in-chief of Science....Generally, I start with the corresponding editors' summaries, which are meant for someone like me: a science generalist who is interested in everything but dives deeply only into one field. Next, I check to see if someone wrote a News article on the paper. Third, I check to see if there is a Perspective by another scientist.

This says so much about the volume of absolute crap that gets published in Science. No competent editor-in-chief should be looking to the news media to give background on a research topic.

Re: How to (seriously) read a scientific paper (2016)

#18
post #15

This misses the best skimming trick I learned from an advisor: After you read the abstract, read the last couple lines/paragraphs of the introduction. That's where you'll find the authors best summary of the paper's contributions and novelty. For instance, the first paper that popped up with some random search terms [0]: The present paper attempts to provide a structured and comprehensive overview of state-of-the-art…

Maybe it depends on the literature. I almost never read the introduction, unless I am unclear on the motivation for the work from the abstract. The fundamental problem with abstracts and introductions is that they're sales content . You can't trust them. The only thing you can do is decide if you wish to read further, and see if the paper says what they claim it says. For that, an abstract is sufficient about 99% of…

In the literature I spend the most time with (archaeology/anthropology), the abstract is often focused on the broad applicability of the research to the field, which I either don't care about or already know (often both). The last line/paragraph of the introduction contains the specific contributions/findings of the paper. If and only if that's reasonable might it be worth investing the time to read further. I only rarely touch the data tables (assuming they even exist), because I don't want to spend an hour trying to understand whatever software nightmare the probably-not-computer-literate author(s) used and miss the details hidden outside the data in the explanatory text (e.g. samples were processed by throwing away all bits we couldn't identify!) that make the time spent useless.

Re: How to (seriously) read a scientific paper (2016)

#19
post #17

> As editor-in-chief of Science....Generally, I start with the corresponding editors' summaries, which are meant for someone like me: a science generalist who is interested in everything but dives deeply only into one field. Next, I check to see if someone wrote a News article on the paper. Third, I check to see if there is a Perspective by another scientist. This says so much about the volume of absolute crap that g…

I wouldn't rule it out entirely - a good news article can add context (e.g. via interviews with authors) that is otherwise not generally part of the paper itself

Re: How to (seriously) read a scientific paper (2016)

#20
post #14

This misses the best skimming trick I learned from an advisor: After you read the abstract, read the last couple lines/paragraphs of the introduction. That's where you'll find the authors best summary of the paper's contributions and novelty. For instance, the first paper that popped up with some random search terms [0]: The present paper attempts to provide a structured and comprehensive overview of state-of-the-art…

Maybe I'm misunderstanding what you mean, but I don't think your trick was missed at all? The second paragraph says: > I start by reading the abstract. Then, I skim the introduction [...] A few paragraphs down, another quote says: > I always start with title and abstract. [...] I then read the introduction [...] Another: > I nearly always read the abstract first [...] I generally skim the introduction, reading its la…

What I'm saying is similar to the third quote, where you start after the abstract by reading the last 1-5 lines of the introduction. Only if you want to proceed further do you dedicate the time to read or skim the entire intro, which can span multiple pages. You save tens of seconds and a lot of thinking this way, plus it helps frame things by giving a concise statement you can reference as you ask "how does what I'm reading build towards the paper's goals?"
Post reply on HN