The circuit that lets your brain think and see
engineering.columbia.edu
The circuit that lets your brain think and see
1–10 of 27 posts
Re: The circuit that lets your brain think and see
#2Reverse engineering how algorithms in the brain work is a really promising path towards making genuine AI systems which would make the current crop of LLMs obsolete.
Re: The circuit that lets your brain think and see
#3Independent of the research itself, the article makes it seem as if neuroscientist are just discovering the deep recursion all the way back to V1. The idea that this was a one way stream of information processing was discarded a long time ago. Those back projections probably serve lots of functions, but we can be pretty sure they are there to let current context bias the weights for quicker recognition and reaction...e.g. if your context includes snakes, your visual system will attune to recognizing snakes even faster.
Re: The circuit that lets your brain think and see
#4Paper title: Disinhibitory signaling enables flexible coding of top-down information in cortical networks
(should be qualified as in-silico visual systems)
Method: replicate fMRI findings of visual abstraction using simple networks to model what's essential
Gist: in tasks 'Inhibitory neurons that suppress other inhibitory neurons seem to pass key information from the “thinking” part of the system to the “sensing” component of the system'
I've heard the same for motor control: it's not that the cortex aims for one action; it aims for a bunch, but most are inhibited. (You see this in chaotic movement when inhibition fails).
So it's not really "think and see" but "what you see when you're doing a task".
(There's some analogy in there wrt (AI) exuberance effacing selectivity in investment decisions...)
Re: The circuit that lets your brain think and see
#5Reverse engineering how algorithms in the brain work is a really promising path towards making genuine AI systems which would make the current crop of LLMs obsolete.
It’s not algorithms.
Re: The circuit that lets your brain think and see
#6[dead]
Re: The circuit that lets your brain think and see
#7Paper title: Disinhibitory signaling enables flexible coding of top-down information in cortical networks (should be qualified as in-silico visual systems) Method: replicate fMRI findings of visual abstraction using simple networks to model what's essential Gist: in tasks 'Inhibitory neurons that suppress other inhibitory neurons seem to pass key information from the “thinking” part of the system to the “sensing” com…
"inhibition fails" reminded me of this passage from Fear and Loathing.
"Ah, devil ether. It makes you behave like the village drunkard in some early Irish novel... total loss of all basic motor skills. Blurred vision, no balance, numb tongue. The mind recoils in horror, unable to communicate with the spinal column."
Re: The circuit that lets your brain think and see
#8Why are they using neural nets to model observed behavior (different parts activated) and then applying them to biological neurons that work completely differently? Real neurons communicate using precisely timed spikes and each neuron does a bunch of local computation as well.
Re: The circuit that lets your brain think and see
#9Why are they using neural nets to model observed behavior (different parts activated) and then applying them to biological neurons that work completely differently? Real neurons communicate using precisely timed spikes and each neuron does a bunch of local computation as well.
There’s debate over how much timing actually matters vs the rate of firing. Some people do believe in precise spike timing but I would say the general consensus is that spiking rate is a better measure of the current state of a system. There’s significant noise (as far as we can tell) in a neuron’s timing and it’s best modeled with a poisson process so we tend to think of it as rate coding which we can at least hand wave as viewing an RNN with a ReLU approximating.
Generally you can take a geometric view of this where certain features in a stimulus covary with neural activations in the same way they will with RNN “activations” which is at the real core of why people model things this way. The general idea being a dot product in an RNN can tell you something about what features are relevant for a task and we can look for hints of the same information being encoded in neural data. Certainly not everyone is in agreement on this though.
Re: The circuit that lets your brain think and see
#10Paper title: Disinhibitory signaling enables flexible coding of top-down information in cortical networks (should be qualified as in-silico visual systems) Method: replicate fMRI findings of visual abstraction using simple networks to model what's essential Gist: in tasks 'Inhibitory neurons that suppress other inhibitory neurons seem to pass key information from the “thinking” part of the system to the “sensing” com…
I'm very curious about inhibition failures in brain areas, especially between visual perception and motor control. I'm no neurologist but your brain seems to generate a lot of imaginary interpretation when sensing the visual field, but sometimes there are short circuit like failure that leak those potential imaginary futures with you current real self (leading to strange uncoordinated or overlapping motor control signals)