31–40 of 197 posts
One of my favorites is definitely A Unified Framework for Dopamine Signals across Timescales ( https://doi.org/10.1016/j.cell.2020.11.013 ), simply because of its experimental design. They 'teleported' rats in VR to see how their dopamine neurons responded, to determine whether TD learning explains dopamine signals on both short and long timescales. Short answer: it does.
The pair of these papers: (Don't read them in full.) 1.Attention is not explanation ( https://arxiv.org/abs/1902.10186 ) 2.Attention is not not Explanation ( https://arxiv.org/abs/1908.04626 ) Goes to show the complete lack of agreement between researchers in the explainability space. Most popular packages (allen NLP, google LIT, Captum) use saliency based methods (Integrated gradients) or Attention. The community ha…
As a laymen, I don't understand how "attention" and "explanation" are used here. Would you be able to summarize the terms and the contention?
Explanation: why the model (the deep neural net, that is) is doing what it's doing.
Attention: a particular technique used in certain deep net models, invented a few years ago, that originally showed remarkable performance improvements in NLP (natural language processing) tasks, but has recently been applied in vision and elsewhere.
No one knows what attention is (https://link.springer.com/article/10.3758/s13414-019-01846-w)
https://groups.csail.mit.edu/genesis/papers/radul%202009.pdf
An interesting (no pun intended) paper on what makes papers (or anything in general) interesting.
For me, it was "Erasure Coding in Windows Azure Storage" from Microsoft Research (2016) [0] The idea that you can achieve the same practical effect of a 3x replication factor in a distributed system, but only increasing the cost of data storage by 1.6x, by leveraging some clever information theory tricks is mind bending to me. If you're operating a large Ceph cluster, or you're Google/Amazon/Microsoft and you're runn…
Which is actually great because it gives me something to read on subjects im not familar with.
https://arxiv.org/pdf/1703.01192.pdf
https://www.nationalgeographic.com/science/2020/04/first-spi...