Live data from Hacker News

Computational Model Reveals How the Brain Manages Short-Term Memories

neurosciencenews.com

1–10 of 30 posts

Re: Computational Model Reveals How the Brain Manages Short-Term Memories

#3
> Kim and Sejnowski found that good working memory required both that long-timescale neurons be prevalent, and that connections between inhibitory neurons–which suppress brain activity–be strong. When they altered the strength of connections between these inhibitory neurons in their model, the researchers could change how well the model performed on the working memory test as well as the timescale of the pertinent neurons.

Neuroscience is so laughably primitive. Imagine saying you were close to understanding computers because you know which capacitors you really can’t cut out. It’s just absurd how little actual knowledge of the mind we have, as opposed to anatomical facts or behavioral generalizations.

Re: Computational Model Reveals How the Brain Manages Short-Term Memories

#4
post #2

What do these inhibitory neurons do to manage short-term memories?

Optimistic guess: This information can be found in the paywall'ed article at [1]

> Dissecting our recurrent neural network model revealed strong inhibitory-to-inhibitory connections underlying a disinhibitory microcircuit as a critical component for long neuronal timescales and WM maintenance

If the article is worth the money, i would expect it to go into detail on it.

[1] https://www.nature.com/articles/s41593-020-00753-w

Re: Computational Model Reveals How the Brain Manages Short-Term Memories

#5
post #4
post #2

What do these inhibitory neurons do to manage short-term memories?

Optimistic guess: This information can be found in the paywall'ed article at [1] > Dissecting our recurrent neural network model revealed strong inhibitory-to-inhibitory connections underlying a disinhibitory microcircuit as a critical component for long neuronal timescales and WM maintenance If the article is worth the money, i would expect it to go into detail on it. [1] https://www.nature.com/articles/s41593-020-0…

https://sci-hub.se/https://www.nature.com/articles/s41593-02...

Re: Computational Model Reveals How the Brain Manages Short-Term Memories

#7
here's a free version https://scihubtw.tw/https://www.nature.com/articles/s41593-0...

Looks like another paper on how everything in the brain can be tied to RNN or GPT2 or some other trendy ML model. 'Cure cancer with deep learning' style.

Before something like RNN can be used in a model of biological memory it has to respect the constraints of biological memory. Taking an arbitrary model and twisting the arm of data to fit it makes for some hard sale.

Claiming the findings somehow elucidate memory impairments in schizophrenia and autism (which are not even close to being understood), makes it even more look like bad science.

Re: Computational Model Reveals How the Brain Manages Short-Term Memories

#8
post #2

What do these inhibitory neurons do to manage short-term memories?

This is explained in the Nature article (summary on page 133) and shown as a diagrams in figure 6...

> In summary, these findings imply that robust inhibition of oppositely tuned inhibitory subpopulations is critical for memory maintenance in our RNN model. For example, a positive cue stimulus activates the inhibitory and excitatory subgroups selective for that stimulus and deactivates the negative stimulus subgroups. During the delay period, the inhibition strength between these two inhibitory subgroups dictates the stability of the cue-specific activity patterns generated during the stimulus window. The positive feedback provided by the similarly tuned excitatory neurons sustains the stimulus-specific activity of the inhibitory subgroups.

Re: Computational Model Reveals How the Brain Manages Short-Term Memories

#9
post #7

here's a free version https://scihubtw.tw/https://www.nature.com/articles/s41593-0... Looks like another paper on how everything in the brain can be tied to RNN or GPT2 or some other trendy ML model. 'Cure cancer with deep learning' style. Before something like RNN can be used in a model of biological memory it has to respect the constraints of biological memory. Taking an arbitrary model and twisting the arm of data…

I agree with this sentiment. To be fair though, the authors did attempt to generate a biologically plausible RNN, which they published in a previous article...

https://www.pnas.org/content/pnas/116/45/22811.full.pdf

I'm not fully sold on this model, but the article is fairly dense and I dont fully understand it. (Sejnowski, the senior author, was on my dissertation committee; he fell asleep during my defense lol)

Re: Computational Model Reveals How the Brain Manages Short-Term Memories

#10
post #7

here's a free version https://scihubtw.tw/https://www.nature.com/articles/s41593-0... Looks like another paper on how everything in the brain can be tied to RNN or GPT2 or some other trendy ML model. 'Cure cancer with deep learning' style. Before something like RNN can be used in a model of biological memory it has to respect the constraints of biological memory. Taking an arbitrary model and twisting the arm of data…

Here's the GitHub with their code for "Working Memory Spiking RNN Model" (This repository provides the code for the model and analyses presented in the paper): https://github.com/rkim35/wmRNN
Post reply on HN