Live data from Hacker News

Ask HN: What's the best paper you've read in 2020?

news.ycombinator.com

21–30 of 197 posts

Re: Ask HN: What's the best paper you've read in 2020?

#21
Measuring the predictability of life outcomes with a scientific mass collaboration.

http://www.pnas.org/lookup/doi/10.1073/pnas.1915006117

You might think that it's possible to use machine learning to predict whether people will be successful using established socio-demographic, psychological, and educational metrics. It turns out that it's very hard and simple regression models outperform the fanciest machine learning ideas for this problem.

The way this study was done is also interesting and paves the way for new kinds of collaborative scientific projects that take on big questions. It draws on communities like Kaggle, but applies it to scientific questions not just pure prediction problems.

Re: Ask HN: What's the best paper you've read in 2020?

#23
I'm a big fan of the various "gradual" approaches so this paper really caught my eye.

Gradualizing the Calculus of Inductive Constructions (https://hal.archives-ouvertes.fr/hal-02896776/)

I'm not sure if this is precisely the direction things should go in order to improve the utilisation of specification within software development but it's a very important contribution. As yet my favourite development style has been with F-star but F-star also leaves me a bit in a lurch when the automatic system isn't able to find the answer. Too much hinting in the case of hard proofs.

Eventually there will be a system that lets you turn the crank up on specification late in the game, allows lots of the assertions to be discharged automatically, and then finally saddles you with the remaining proof obligations in a powerful proof assistant.

Re: Ask HN: What's the best paper you've read in 2020?

#25
post #12

The pair of these papers: (Don't read them in full.) 1.Attention is not explanation ( https://arxiv.org/abs/1902.10186 ) 2.Attention is not not Explanation ( https://arxiv.org/abs/1908.04626 ) Goes to show the complete lack of agreement between researchers in the explainability space. Most popular packages (allen NLP, google LIT, Captum) use saliency based methods (Integrated gradients) or Attention. The community ha…

As a laymen, I don't understand how "attention" and "explanation" are used here. Would you be able to summarize the terms and the contention?

Re: Ask HN: What's the best paper you've read in 2020?

#27
One of my favorites is definitely A Unified Framework for Dopamine Signals across Timescales (https://doi.org/10.1016/j.cell.2020.11.013), simply because of its experimental design. They 'teleported' rats in VR to see how their dopamine neurons responded, to determine whether TD learning explains dopamine signals on both short and long timescales. Short answer: it does.

Re: Ask HN: What's the best paper you've read in 2020?

#28

One of my favorites is definitely A Unified Framework for Dopamine Signals across Timescales ( https://doi.org/10.1016/j.cell.2020.11.013 ), simply because of its experimental design. They 'teleported' rats in VR to see how their dopamine neurons responded, to determine whether TD learning explains dopamine signals on both short and long timescales. Short answer: it does.

fyi, TD = Temporal Difference

"Temporal difference (TD) error is a powerful teaching signal in machine learning"

Re: Ask HN: What's the best paper you've read in 2020?

#29
Here's a wonderful one I read a little over a year ago:

"Estimating the number of unseen species: A bird in the hand is worth log(n) in the bush" https://arxiv.org/abs/1511.07428 https://www.pnas.org/content/113/47/13283

It deals with the classic, and wonderful, question of "If I go and catch 100 birds, and they're from 20 different species, how many species are left uncaught?" There's more one can say about that than it might first appear and it has plenty of applications. But mostly I just love the name. Apparently PNAS had them change it for the final publication, sadly.

Re: Ask HN: What's the best paper you've read in 2020?

#30
post #12

The pair of these papers: (Don't read them in full.) 1.Attention is not explanation ( https://arxiv.org/abs/1902.10186 ) 2.Attention is not not Explanation ( https://arxiv.org/abs/1908.04626 ) Goes to show the complete lack of agreement between researchers in the explainability space. Most popular packages (allen NLP, google LIT, Captum) use saliency based methods (Integrated gradients) or Attention. The community ha…

As a laymen, I don't understand how "attention" and "explanation" are used here. Would you be able to summarize the terms and the contention?

recently, a lot of neural network models, especially those in NLP (like GPT-3, BERT, etc.) use "attention" which basically is a way for neural networks to focus on certain subset of the input (the neural network can focus its "attention" to a particular part of the input). Explanations just refers to ways for explaining the predictions of the neural networks.
Post reply on HN