Ask HN: What data structure does our brain use?
21–30 of 81 posts
Re: Ask HN: What data structure does our brain use?
#22The question is fundamentally flawed, in that "data structure" is a concept used by programmers to communicate with computers (or between programmers). A comparable question would be wondering whether the computer you are using right now, at this point in time, is inside a for loop, or a while loop, or it's just using tail recursion. Sure some cognitive scientist can make my point more explicit, sorry that all I can…
But we don't make extensive use of (say) analog computers, or computers with data buses having several million sub-channels. Hand us a machine employing such principles and it's back to square one. (Except for the lucky pure mathematician or two who got there first but whose work remains obscure right now, the way George Boole's work used to be obscure.)
And my stupid examples are just examples - I have no idea if the brain, or any bit of it, is best conceived of as an analog computer. Nobody knows what kind of computer the brain is like, except that it is almost entirely unlike the silicon-based digital computers that we build in the von Neumann tradition. And, presumably, when it comes time to discuss brain-based data structures they will turn out almost entirely unlike the structures in our digital-computer-data-structures textbooks.
Re: Ask HN: What data structure does our brain use?
#23Re: Ask HN: What data structure does our brain use?
#24Short answer: A graph. All data structures are simplified graphs. The state of the physical universe is a massive graph in which interconnected objects are themselves massive assemblies of graphs of atoms and the atoms are graphs of subatomic particles. It's graphs all the way down. The properties of all systems - physical, chemical, economic, biological - emerge from the interactions between simple connected element…
Re: Ask HN: What data structure does our brain use?
#25Geoffrey Hinton "Next Generation Neural Networks" http://www.youtube.com/watch?v=AyzOUbkUf3M -It is more biologically plausible then any other NN algorithm I've seen -It results in creativity (in the video he has the computer "imagine the number 2") -It pretty much explains why we need to sleep/dream. The network has to be run both forward (accepting sensory input) and backwards (generating simulated sensory input) i…
-can fill-in details as a result of noisy or missing input -can sometimes "see" patterns in random noise
Re: Ask HN: What data structure does our brain use?
#26There are multiple. I suppose long-term memory is a hashtable and working memory is a stack ;)
For example, if I looked at a door and wanted to remember what that door was for, I could "see" a vast 2 or 3 dimensional array of hundreds of doors that I had seen before, arranged so that similar doors were near each other, and then I was aware of some kind of focusing in on the region of door-space where doors similar to the target door resided, and then I was aware of some kind of comparison of each of the doors in that region serially with the door I was looking at to find a match, and then the data for the best match was made available to my normal consciousness.
During another part of that trip I was aware of audio processing. I'd hear someone talking and first hear it as unintelligible sound, then I'd be aware of the sounds being broken down into separate sound units, and then recognized as English words, and then the relationships between the words being recognized, and then I'd become aware of the meaning of what I'd heard.
I also had a time during that trip where I was watching visual processing. I'd be aware of how my mind was noticing things in the scene I was looking at, recognizing objects and remembering what they were, and combining that to build an understanding of the scene.
Now I have no way of knowing how much of this was just hallucinations shaped by my knowledge of computers, and how much really was the LSD actually letting me observe consciously mental processes that normally operate as black boxes to the conscious.
It's too bad research using LSD was greatly curtailed when the drug was banned. My suspicion is that what I perceived on that trip was a mix of reality and hallucinations driven by my computer knowledge. With enough experimentation, with people with different backgrounds observing and reporting, we could probably get some real insights into what is really going on in there.
Re: Ask HN: What data structure does our brain use?
#27That it isn't just a question of pure storage and retrieval. There's quite a bit of varied experience on the same root(& their storage) happening multiple times and layers within.
Content that gets shared/liked more, gets replicated, re-iterated on, transformed, re-tagged. As time progresses, you'll find more content similar to the parent, being generated -- re-experienced via dreams and the subconscious.
Eventually, when its necessary to dig out the piece of content using tags or searches, it'll end up finding the most 'linked-to' piece. Possibly one that was associated with a explosion of favorable chemicals.
-----
There's some evidence to suggest that the same experience, isn't stored as a single piece of memory. During the process of consolidation [when a long term memory gets etched], the 'experience' being transcribed goes through iterations. With variations being stored as well, some of them decaying almost instantly.
It's possible the brain applies 'instagram' like filters while etching these memories. (a process that happens over weeks)
It'll be interesting if in the future, we could modify/augment these 'filter' processes. Both at the storage and retrieval stages.
[http://pubs.acs.org/cen/coverstory/85/8536cover.html] [http://en.wikipedia.org/wiki/Engram_(neuropsychology)]
Re: Ask HN: What data structure does our brain use?
#28Working backwards from this, could we build (today) a graph-based (or whatever-structure) recording device that will store data in much the same way we build memories? Such would obviously require a greater understanding of the interconnection of neurons and the storage of memory, as discussed elsewhere in this topic. [Small edit: Knowing the data structure is nice; being able to use it is golden.]
I personally believe the next great "hack" our species should embark upon is the brain and the body. We need to be more robust if we are ever to escape this rock. (And the dreamer in me wishes we could keep our consciousnesses and/or memories around eternally, but that introduces entirely different problems, and is probably an unrealistic ideal.)
Re: Ask HN: What data structure does our brain use?
#29I wrote on this elsewhere:
http://blog.memrise.com/2011/05/how-is-memory-stored-in-brai...
http://blog.memrise.com/2011/05/how-are-brains-different-fro...
For instance:
- Storage and parallel computation in the brain are very expansive and cheap, so the brain prefers to store rather than compute where it can.
- Above all, the brain's storage is highly content-addressable. Similar things in the world are stored with similar representations, so that the brain can generalize, and see commonalities. This is not a graph - graphs are discretized - this is much more flexible.
- Even the acts of storage and retrieval are themselves a kind of computation, a transformation, a compression and a learning experience.
- Memories are not clean silos. Storing a new memory can subtly (and not so subtly) affect other nearby or related memories
- Different parts of the brain use different storage parameters. For instance, the hippocampus is like a hash table, storing each memory relatively cleanly and in isolation, but can only be accessed with exactly the cue. In contrast, the cortex stores memories in a much more content-addressable, overlapping way that's invariant to many small differences (e.g. we can recognize a face whether it's rotated, sunny, tanned, close up, obscured).
Re: Ask HN: What data structure does our brain use?
#30There are so many differences that one's standard intuitions as a computer scientist can be very misleading... I wrote on this elsewhere: http://blog.memrise.com/2011/05/how-is-memory-stored-in-brai... http://blog.memrise.com/2011/05/how-are-brains-different-fro... For instance: - Storage and parallel computation in the brain are very expansive and cheap, so the brain prefers to store rather than compute where it can…
This captures a little of the nature of semantic representations (storage of meanings and concepts). But of course, semantic representations differ hugely from, say, representations of a tennis serve, or the phone number you're repeating under your breath while you key it in...