Live data from Hacker News

Ask HN: What data structure does our brain use?

news.ycombinator.com

21–30 of 81 posts

Re: Ask HN: What data structure does our brain use?

#22
post #13

The question is fundamentally flawed, in that "data structure" is a concept used by programmers to communicate with computers (or between programmers). A comparable question would be wondering whether the computer you are using right now, at this point in time, is inside a for loop, or a while loop, or it's just using tail recursion. Sure some cognitive scientist can make my point more explicit, sorry that all I can…

Yes, isn't our conception of data structures bound up fairly tightly with the available storage media and data buses? We have thought a lot about how to organize and retrieve data on tapes, and spinning disks, and random-access memories composed of discrete little bins, each storing a bit and addressed in rows and columns.

But we don't make extensive use of (say) analog computers, or computers with data buses having several million sub-channels. Hand us a machine employing such principles and it's back to square one. (Except for the lucky pure mathematician or two who got there first but whose work remains obscure right now, the way George Boole's work used to be obscure.)

And my stupid examples are just examples - I have no idea if the brain, or any bit of it, is best conceived of as an analog computer. Nobody knows what kind of computer the brain is like, except that it is almost entirely unlike the silicon-based digital computers that we build in the von Neumann tradition. And, presumably, when it comes time to discuss brain-based data structures they will turn out almost entirely unlike the structures in our digital-computer-data-structures textbooks.

Re: Ask HN: What data structure does our brain use?

#24
post #14

Short answer: A graph. All data structures are simplified graphs. The state of the physical universe is a massive graph in which interconnected objects are themselves massive assemblies of graphs of atoms and the atoms are graphs of subatomic particles. It's graphs all the way down. The properties of all systems - physical, chemical, economic, biological - emerge from the interactions between simple connected element…

And a graph is a relation, and a relation is a function, etc. Just because you can model everything with graphs doesn't make them special. You can model everything with lots of things.

Re: Ask HN: What data structure does our brain use?

#25
post #11

Geoffrey Hinton "Next Generation Neural Networks" http://www.youtube.com/watch?v=AyzOUbkUf3M -It is more biologically plausible then any other NN algorithm I've seen -It results in creativity (in the video he has the computer "imagine the number 2") -It pretty much explains why we need to sleep/dream. The network has to be run both forward (accepting sensory input) and backwards (generating simulated sensory input) i…

I agree. Hopfield networks, of which Hinton's Boltzmann machines are substantial elaborations, have many human-like properties:

-can fill-in details as a result of noisy or missing input -can sometimes "see" patterns in random noise

Re: Ask HN: What data structure does our brain use?

#26

There are multiple. I suppose long-term memory is a hashtable and working memory is a stack ;)

I think long term memory is more organized than a hash table. I base this on observation of my own brain during a bad LSD trip, where I seemed to be aware of how I was reaching decisions.

For example, if I looked at a door and wanted to remember what that door was for, I could "see" a vast 2 or 3 dimensional array of hundreds of doors that I had seen before, arranged so that similar doors were near each other, and then I was aware of some kind of focusing in on the region of door-space where doors similar to the target door resided, and then I was aware of some kind of comparison of each of the doors in that region serially with the door I was looking at to find a match, and then the data for the best match was made available to my normal consciousness.

During another part of that trip I was aware of audio processing. I'd hear someone talking and first hear it as unintelligible sound, then I'd be aware of the sounds being broken down into separate sound units, and then recognized as English words, and then the relationships between the words being recognized, and then I'd become aware of the meaning of what I'd heard.

I also had a time during that trip where I was watching visual processing. I'd be aware of how my mind was noticing things in the scene I was looking at, recognizing objects and remembering what they were, and combining that to build an understanding of the scene.

Now I have no way of knowing how much of this was just hallucinations shaped by my knowledge of computers, and how much really was the LSD actually letting me observe consciously mental processes that normally operate as black boxes to the conscious.

It's too bad research using LSD was greatly curtailed when the drug was banned. My suspicion is that what I perceived on that trip was a mix of reality and hallucinations driven by my computer knowledge. With enough experimentation, with people with different backgrounds observing and reporting, we could probably get some real insights into what is really going on in there.

Re: Ask HN: What data structure does our brain use?

#27
I'd like to imagine the brain is a lot like the 'world wide web' as a data structure, than a pure graph.

That it isn't just a question of pure storage and retrieval. There's quite a bit of varied experience on the same root(& their storage) happening multiple times and layers within.

Content that gets shared/liked more, gets replicated, re-iterated on, transformed, re-tagged. As time progresses, you'll find more content similar to the parent, being generated -- re-experienced via dreams and the subconscious.

Eventually, when its necessary to dig out the piece of content using tags or searches, it'll end up finding the most 'linked-to' piece. Possibly one that was associated with a explosion of favorable chemicals.

-----

There's some evidence to suggest that the same experience, isn't stored as a single piece of memory. During the process of consolidation [when a long term memory gets etched], the 'experience' being transcribed goes through iterations. With variations being stored as well, some of them decaying almost instantly.

It's possible the brain applies 'instagram' like filters while etching these memories. (a process that happens over weeks)

It'll be interesting if in the future, we could modify/augment these 'filter' processes. Both at the storage and retrieval stages.

[http://pubs.acs.org/cen/coverstory/85/8536cover.html] [http://en.wikipedia.org/wiki/Engram_(neuropsychology)]

Re: Ask HN: What data structure does our brain use?

#28
Along a similar subject, should we someday be able to replace sets of neurons in our brains with nanomachines (built to replicate neurons), would we be able to replicate these data structures? Or are they something intrinsic to our organic brain? Similarly, if we could build even a larger scale version of such external to the brain, could we interface it with our existing consciousness? (Could we then 'share' memories?)

Working backwards from this, could we build (today) a graph-based (or whatever-structure) recording device that will store data in much the same way we build memories? Such would obviously require a greater understanding of the interconnection of neurons and the storage of memory, as discussed elsewhere in this topic. [Small edit: Knowing the data structure is nice; being able to use it is golden.]

I personally believe the next great "hack" our species should embark upon is the brain and the body. We need to be more robust if we are ever to escape this rock. (And the dreamer in me wishes we could keep our consciousnesses and/or memories around eternally, but that introduces entirely different problems, and is probably an unrealistic ideal.)

Re: Ask HN: What data structure does our brain use?

#29
There are so many differences that one's standard intuitions as a computer scientist can be very misleading...

I wrote on this elsewhere:

http://blog.memrise.com/2011/05/how-is-memory-stored-in-brai...

http://blog.memrise.com/2011/05/how-are-brains-different-fro...

For instance:

- Storage and parallel computation in the brain are very expansive and cheap, so the brain prefers to store rather than compute where it can.

- Above all, the brain's storage is highly content-addressable. Similar things in the world are stored with similar representations, so that the brain can generalize, and see commonalities. This is not a graph - graphs are discretized - this is much more flexible.

- Even the acts of storage and retrieval are themselves a kind of computation, a transformation, a compression and a learning experience.

- Memories are not clean silos. Storing a new memory can subtly (and not so subtly) affect other nearby or related memories

- Different parts of the brain use different storage parameters. For instance, the hippocampus is like a hash table, storing each memory relatively cleanly and in isolation, but can only be accessed with exactly the cue. In contrast, the cortex stores memories in a much more content-addressable, overlapping way that's invariant to many small differences (e.g. we can recognize a face whether it's rotated, sunny, tanned, close up, obscured).

Re: Ask HN: What data structure does our brain use?

#30

There are so many differences that one's standard intuitions as a computer scientist can be very misleading... I wrote on this elsewhere: http://blog.memrise.com/2011/05/how-is-memory-stored-in-brai... http://blog.memrise.com/2011/05/how-are-brains-different-fro... For instance: - Storage and parallel computation in the brain are very expansive and cheap, so the brain prefers to store rather than compute where it can…

It's also very, very high-dimensional. Imagine a gigantic space, where similar thoughts could be placed next to one another. Thinking would be moving around this space. Free association would be taking a step or two in a random direction. Comparison would be a vector.

This captures a little of the nature of semantic representations (storage of meanings and concepts). But of course, semantic representations differ hugely from, say, representations of a tennis serve, or the phone number you're repeating under your breath while you key it in...

Post reply on HN