Viewing profile — rkp8000

https://rkp.science

I love Markdown. I'm a bit surprised, though, that you still can't open a .md file by default in most web browsers. It seems like it should be quite trivial to have the browser aut…

Computing entropies of high-dimensional random vectors for a theoretical neuroscience study. The journey is mostly a repetition of (1) almost giving up because it's completely hope…

A notable and interesting point of this article is that convolutions and correlations (convolutions without flipping the filter) are quite a bit more subtle on the sphere than on C…

A (non-exhaustive) list of some notable papers: Maass 2002, Real-time computing without stable states: https://pubmed.ncbi.nlm.nih.gov/12433288/ Sussillo & Abbott 2009, Generating …

Thanks for the link to your article! If you don't mind my asking, how much does the role of mutual information in linking logical and thermodynamic reversibility depend on consider…

A great pedagogical article on thermodynamic vs logical reversibility, for those interested: https://arxiv.org/abs/1311.1886 (Sagawa 2014).

There are a few folks working on this in neuroscience, e.g. training transformers to "decode" neural activity ( https://arxiv.org/abs/2310.16046 ). It's still pretty new and a bit …

This is just to say: the poem at the end is a play on William Carlos William's poem, entitled "This is just to say".

This reminds me of a project I worked on during my PhD, where you create a network of scientific documents and notes/threads via Markdown, with a similarly structured "rabbit-hole"…

MSR has a very clear and accessible tutorial on quantum computing for anyone interested in getting up to speed with the fundamentals: https://www.youtube.com/watch?v=F_Riqjdh2oM .

Yep! This relationship is well known in statistical mechanics. I was just surprised that in many years of intersecting with information theory in other fields (computational neuros…

Here is a link to the press conference with Hopfield at Princeton University: https://www.youtube.com/watch?v=Uk3Ok1D1xR8

Connectome-adjacent neuroscientist here. Definitely not a dead end! But also definitely not the whole picture. One of the main open questions in neuroscience right now is how netwo…

I love that Ridge Regression is introduced in the context of multicollinearity. It seems almost everyone these days learns about it as a regularization technique to prevent overfit…

I had the same thought. If a were constant I believe the solution would just be a convolution of b_t with an exponential filter. I think this is different because a_t depends on ti…