Compression is a component of general intelligence. A few years ago I was very sceptical of machine learning ever leading to general intelligence. I've since changed my mind. There are a lot of parallels to this work and the concept of "embeddings" in machine learning. Intelligence requires the ability to generalize. A prerequisite for generalization is the ability to take something high-dimensional and reduce it to…
Human brain compresses working memories into low-res ‘summaries’
51–60 of 349 posts
Re: Human brain compresses working memories into low-res ‘summaries’
#52In my experience this plays out on multiple timescales. When you get older you start to have entire decades of life boiled down to the factual knowledge you gained plus a handful of episodic memories. It's a good reminder to write shit down and take lots of mundane pictures. You don't realize until it's too late though.
When you're younger, those models are less complete and larger parts of your waking moments are needed to build the foundations of these models, so you feel like time is slower since so much more of your time is kept "fresh".
I'm probably butchering his take on it, but I blame my own mental models for compressing away the finer details!
Re: Human brain compresses working memories into low-res ‘summaries’
#53It all works this way (though a certain female family member would disagree, claiming to remember conversations word-for-word years later). But my memory works this way. A summary "party at so-and-so's house, weather was nice, overall vibe was ___". The rest is context. You know what the house/backyard is like, you know the general feel of that time of year, you know the crowd that usually comes, you can easily synth…
Ditto on the "certain female family member who insists that she remembers things word-for-word". When she recounts her meeting with a friend it is needlessly tedious (I try to be a good listener of course). Complains that my recollections are too vague and she wants to know what really happened and is frustrated I won't give her details. I think a large part of it is just that you store what is important to you. To m…
Re: Human brain compresses working memories into low-res ‘summaries’
#54As someone suffering from Aphantasia [0] (I don't have mental imagery at all) and I've been telling people for the longest time that this is how I relate to the world. I summarize things. Even my mother's face. A post by a Facebook engineer [1] felt like a good way to understand it. [0] https://en.wikipedia.org/wiki/Aphantasia [1] https://medicine.exeter.ac.uk/media/universityofexeter/medic...
Allthough there are some disadvantages, of course. I admire people that are able to draw and paint based on their inner vision.
Much more important for me was the realization that I can evoke images, scenes, etc. in other people that trigger feelings in them. Which in turn can trigger actions or omissions. Fear, joy, hate, love, disgust, lust. Which they can't do to me, at least not just by invoking visual images in my mind through words. Manipulative, but not manipulatable in this regard. With time, that came in handy.
By the way, I am friends with a handful of people who suffer from schizophrenia. They say they envy me a little because in their worst phases they wished they didn't have this movie in their head. It repeats itself, over and over again.
And aphantasia is a spectrum, I have known people who describe rather dull, colorless inner visions and others who can sustain them only for short periods of time. On the other hand, I met an artist who seemed to live in his own private vibrating Van Gogh painting. Judging by his descriptions. And of course, without DMT.
Re: Human brain compresses working memories into low-res ‘summaries’
#55Compression is a component of general intelligence. A few years ago I was very sceptical of machine learning ever leading to general intelligence. I've since changed my mind. There are a lot of parallels to this work and the concept of "embeddings" in machine learning. Intelligence requires the ability to generalize. A prerequisite for generalization is the ability to take something high-dimensional and reduce it to…
In the incredible story "Funes the Memorious" the eponymous Funes has an absolutely perfect memory, but is functionally mentally handicapped. He can't even abstract to the existence of "trees" because he can recall and diff all of the details of every tree he's ever seen. He can't even identify that he's seen a particular tree before, because he can diff how different it looked in a particular configuration of leaves…
Re: Human brain compresses working memories into low-res ‘summaries’
#56So, not PNG but JPEG
Re: Human brain compresses working memories into low-res ‘summaries’
#57As someone suffering from Aphantasia [0] (I don't have mental imagery at all) and I've been telling people for the longest time that this is how I relate to the world. I summarize things. Even my mother's face. A post by a Facebook engineer [1] felt like a good way to understand it. [0] https://en.wikipedia.org/wiki/Aphantasia [1] https://medicine.exeter.ac.uk/media/universityofexeter/medic...
I am very interested in the topic, and have been looking into it for ages. I think most people vastly exaggerate their ability to visualize anything. Most people can't really hold a square or a sphere in their mind, rotate it, or change colors. The only people who truly can are really good artists. My point - you may be mis-diagnosing yourself, especially since aphantasia doesn't seem to have clear tests or definitio…
To be honest, it doesn't feel like such a handicap to my life that I would start submitting myself to clinical trials. If the worst to come out of my mis-diagnosis is this post, I can live with it.
Re: Human brain compresses working memories into low-res ‘summaries’
#58Earlier quoted context omitted.
I realized some time ago when I learned of Aphantasia that it is a spectrum. From 0 to 10, 10 being perfect photographic memory and zero being total Aphantasia, I feel like I'm somewhere in the middle. I can recall images, sounds, memes, faces, but in terrible quality, with very little color or focus, more similar to fast paced dreams than photographs.
I wonder if that's something that can be practiced and improved upon.
Re: Human brain compresses working memories into low-res ‘summaries’
#59Compression is a component of general intelligence. A few years ago I was very sceptical of machine learning ever leading to general intelligence. I've since changed my mind. There are a lot of parallels to this work and the concept of "embeddings" in machine learning. Intelligence requires the ability to generalize. A prerequisite for generalization is the ability to take something high-dimensional and reduce it to…
The human brain also forgets, something that may be a feature instead of a bug. Also, beyond compression––brains are simulation machines: imagining new scenarios. Curios to understand if ML provides anything analogous to simulation that isn't rote interpolation.
Re: Human brain compresses working memories into low-res ‘summaries’
#60It all works this way (though a certain female family member would disagree, claiming to remember conversations word-for-word years later). But my memory works this way. A summary "party at so-and-so's house, weather was nice, overall vibe was ___". The rest is context. You know what the house/backyard is like, you know the general feel of that time of year, you know the crowd that usually comes, you can easily synth…
Surely many people do. Otherwise you wouldn't have all these biographies and non-fiction books packed with conversations people have managed to recall in a level of detail enough to not get sued. I can barely remember a line of conversation from this week, let alone important ones from years ago, so I always assumed most/many people can remember conversations to some reasonable level in a way that I cannot.