Live data from Hacker News

Getting a paper accepted

maxwellforbes.com

41–50 of 135 posts

Re: Getting a paper accepted

#41
post #38

Academics seem to have this fixation on "ideas": > And it’s not just a pace thing, there’s a threshold of clarity that divides learned nothing from got at least one new idea. But these days, ideas are quite cheap: in my experience, most researchers have more ideas than students to work on them. Many papers can fit their "core idea" in a tweet or two, and in many cases someone has already tweeted the idea in one form…

This whole take is embarrassingly ignorant and no one with the credentials has the time to check you. We need people to do real thinking and they need to ignore you.

I think the take is reasonable.

In particular, the lines between science and some industry is blurring.

Eg. Machine learning where universities appear almost lazy compared to their industrial counter parts.

Re: Getting a paper accepted

#42
I'm a bit afraid that some people will read this article or skim it and say "The fact that you have to do all of this 'branding' is just further proof that science is riddled with irredeemable incentive issues." However, this isn't the author's point. In fact, early the the post, the author writes:

>The tweaks that get the paper accepted—unexpectedly, happily—also improve the actual science contribution. >The main point is that your paper’s value should be obvious, not that is must be enormous.

This is slightly oversimplified, but from the outside, science may look like researchers are constantly publishing papers sort of for the sake of it. However, the papers are the codified ways in which we attempt to influence the thinking of other researchers. All of us who engage in scientific research aim to be on the literal cutting edge of the research conversation. Therefore it's imperative to communicate how our work can be valuable to specific readers.

Let's take a look at the two abstracts:

  (Version 1, Rejected): Given two distinct stimuli, humans can compare and contrast them using natural language. The comparative language that arises is grounded in structural commonalities of the subjects. We study the task of generating comparative language in a visual setting, where two images provide the context for the description. This setting offers a new approach for aiding humans in fine grained recognition, where a model explains the semantics of a visual space by describing the difference between two stimuli. We collect a dataset of paragraphs comparing pairs of bird photographs, proposing a sampling algorithm that leverages both taxonomic and visual metrics of similarity. We present a novel model architecture for generating comparative language given two images as input, and validate its performance both on automatic metrics and visa human comprehension.
Here, the first two sentences a) make a really obvious claim and could equally be at home in a philosophy journal, a linguistic journal, a cognitive science journal, a psychology journal, a neuroscience journal, even something about optometry. Moreover, some readers may look at this abstract and think "well, that's nice, but I'm not sure I need to read this."

  (Version 2, Accepted): We introduce the new Birds-to-Words dataset of 41k sentences describing fine-grained differences between photographs of birds. The language collected is highly detailed, while remaining understandable to the everyday observer (e.g., “heart-shaped face,” “squat body”). Paragraph-length descriptions naturally adapt to varying levels of taxonomic and visual distance—drawn from a novel stratified sampling approach—with the appropriate level of detail. We propose a new model called Neural Naturalist that uses a joint image encoding and comparative module to generate comparative language, and evaluate the results with humans who must use the descriptions to distinguish real images. Our results indicate promising potential for neural models to explain differences in visual embedding space using natural language, as well as a concrete path for machine learning to aid citizen scientists in their effort to preserve biodiversity.
Compared to V1, the V2 abstract does a much better job of communicating a) how this project might be valuable to people who want to understand and use neural-network models "to explain differences in visual embedding space using natural language." Or to put it another way, if you want to understand this, it's in your interest to read the paper!

Re: Getting a paper accepted

#43

Academics seem to have this fixation on "ideas": > And it’s not just a pace thing, there’s a threshold of clarity that divides learned nothing from got at least one new idea. But these days, ideas are quite cheap: in my experience, most researchers have more ideas than students to work on them. Many papers can fit their "core idea" in a tweet or two, and in many cases someone has already tweeted the idea in one form…

I think in some ways science has been co-opted by careerists who try to minmax output to accelerate their careers. Being idea obsessed is part of this. It’s much easier to get a paper published that’s on the hype train as opposed to a paper that challenges some idea. Publications justify grant money, grant money justifies more people and more power, more power justifies promotions. And if you talk with early career scientists they all will say they are only doing it until they get a permanent position. Then they will become more curious. Maybe they do, maybe they don’t, I have many older colleagues who are quite curious compared to their younger counterparts. but I believe rewarding ambition at the expense of curiosity is somewhat anti intellectual. It’s sad because I think science should reorganise as the current structure of departments into disciplines may be dated and restructuring could help alleviate this a lot since interdisciplinary work may leverage curiousity over ambition as curiosity will be rewarded with high impact work. But who knows. I can arm chair my way into anything.

Re: Getting a paper accepted

#45
Ot was a fun read, but, how do you know these changes made your paper better? Your assumption is that reviewers approach the reviewing process with the same knowledge and goals, or are quite objective, but that's mot the case in all my publication history. So how can you prove causal effects with 1 sample?

Re: Getting a paper accepted

#46
There is saying in english that people "eat with their eyes".

When it comes to papers, I always reminded myself and others that people also _read_ with their eyes.

It is easy to be cynical about this (with some justification!), but if the findings are more clearly and quickly communicated by a pretty-looking paper, then the paper has objectively improved.

Re: Getting a paper accepted

#47
post #7

I think the professional sciences has, for a long time, been a social game of building ones career but it does feel like it's metastasized into something that's swallowed academia. From the first article in the series [0]: > Insiders ... understand that a research paper serves ... in increasing importance ... Currency, An advertisement, Brand marketing ... in contrast to what outsiders .. believe, which is ... to sha…

A secondary and less visible consequence of this is that many people don’t go into academia in the first place because they are put off by the publishing system. And so many people that would otherwise be contributing to human knowledge are working in an office somewhere helping a random company sell more widgets.

Figuring out how to improve industrial processes also contributes to human knowledge.

Re: Getting a paper accepted

#48
post #23

Earlier quoted context omitted.

> This is an article about ML research, and the emphasis on branding and marketing your paper wouldn't fly in any of the fields people think of as scientific The number of accepted papers is absolutely currency and measure of worth in academia.

Interestingly, one of the pieces of advice, about having a punchy title, is a double edged sword. There's some data suggesting papers with "clever" titles have an easier time getting published, but accumulate fewer lifetime citations. Both of which are currency.

I suspect there's a selection bias here.

Silly example: if I ever find out a prove saying that "P=NP", that will also be the title of my paper. No cleverness required to grab attention.

If I have a more pedestrian result, I'll think up some clever title.

Re: Getting a paper accepted

#49
I work in academia and have over 70 papers published. I Agree with most ideas in the article. Another dimension not covered is what I called “author engineering”. Many times it is very difficult to “get into” a new field if you don’t have an author known by the editors. I work in applied math (very transversal) and happen to me often to be rejected because “I don’t belong to the area”. PhD students usually don’t suffer from this as the supervisor is already a member of the community. But if not, try to bring a collaborator that is known in the area. This is usually done in conferences by chatting with people.

Re: Getting a paper accepted

#50

Academics seem to have this fixation on "ideas": > And it’s not just a pace thing, there’s a threshold of clarity that divides learned nothing from got at least one new idea. But these days, ideas are quite cheap: in my experience, most researchers have more ideas than students to work on them. Many papers can fit their "core idea" in a tweet or two, and in many cases someone has already tweeted the idea in one form…

Clarity is and should be absolutely crucial, though. As an academic I need to be up to date in my discipline, which means skimming hundreds of titles, dozens of abstracts and papers, and thoroughly reading several papers a week, in the context of a job that needs many other things done. Papers that require 5x the time to read because they're unnecessarily unclear and I need to jump around deciphering what the authors…

Clarity is relative. You can be super clear, but if it goes against what the reviewer thinks they know, it will be perceived as unclear. You can also point to references that clear up any remaining doubt about how something is meant, but of course the reviewer will never check out these references.

In the end, getting a paper accepted is a purely social game, and has not much to do with how clear your science is described, especially for truly novel research.

Post reply on HN