Very cool work. Can something similar be done for audio?
MindEye2: Shared-Subject Models Enable fMRI-to-Image with 1 Hour of Data
21–30 of 31 posts
Re: MindEye2: Shared-Subject Models Enable fMRI-to-Image with 1 Hour of Data
#22So here is a question: what would happen if this process faced a person who was specifically hostile to it? Could you "trick" the process by intensely thinking of, for instance, a yellow ball while viewing a cat picture, as one example?
From the article:
> fMRI is extremely sensitive to movement and requires subjects to comply with the task: decoding is easily resisted by slightly moving one’s head or thinking about unrelated information (Tang et al., 2023)
Re: MindEye2: Shared-Subject Models Enable fMRI-to-Image with 1 Hour of Data
#23So here is a question: what would happen if this process faced a person who was specifically hostile to it? Could you "trick" the process by intensely thinking of, for instance, a yellow ball while viewing a cat picture, as one example?
From the article: > fMRI is extremely sensitive to movement and requires subjects to comply with the task: decoding is easily resisted by slightly moving one’s head or thinking about unrelated information (Tang et al., 2023)
So maybe that's why magicians are so good at illusion: as we think about what we expect to see, we don't process information of our eyes correctly...
Re: MindEye2: Shared-Subject Models Enable fMRI-to-Image with 1 Hour of Data
#24What about doing the opposite: get an image and stimulate the brain to perceive it ?
Re: MindEye2: Shared-Subject Models Enable fMRI-to-Image with 1 Hour of Data
#25As someone with damage to my visual cortex with a very specific effect I’m very curious what this would come up with for me. Not something useful on its own, but more understanding means more possibilities for treatments.
aphantasia?
Re: MindEye2: Shared-Subject Models Enable fMRI-to-Image with 1 Hour of Data
#26While decoding dreams, as some here suggested, would certainly be an intriguing venue of research, I believe, decoding the minds eye of people who lack the minds eye would be an even more interesting topic. How accurate are their "view", for a lack of a better word? Would there even be an image to capture?
Re: MindEye2: Shared-Subject Models Enable fMRI-to-Image with 1 Hour of Data
#27Earlier quoted context omitted.
I’d be fine living in a world where nobody bothered to invent non-consensual mind reading tech. Or, if that’s too much to ask, where we invent everything else that needs inventing first.
It's not more dangerous than non-consensual body killing tech.
Not sure about that.
Re: MindEye2: Shared-Subject Models Enable fMRI-to-Image with 1 Hour of Data
#28While decoding dreams, as some here suggested, would certainly be an intriguing venue of research, I believe, decoding the minds eye of people who lack the minds eye would be an even more interesting topic. How accurate are their "view", for a lack of a better word? Would there even be an image to capture?
It's an interesting set of questions to explore. Having thought about this for many years now (since Blake Ross' post on Aphantasia) my hypothesis is that there wouldn't be any decoding because there is no attention on a visual based internal mind object. As a comparative, if we could decode audio from a person's mind and then you took someone who didn't do echoic recall, then you would expect to "hear" static. The percentage of the population who doesn't do echoic recall is, in some references, estimated to be about 60%.
Re: MindEye2: Shared-Subject Models Enable fMRI-to-Image with 1 Hour of Data
#29As someone with damage to my visual cortex with a very specific effect I’m very curious what this would come up with for me. Not something useful on its own, but more understanding means more possibilities for treatments.
aphantasia?
In discussions about neurological diversity and the potential for treatments or adaptations, recognizing and respecting individual experiences while avoiding overgeneralization is key. Conversations around aphantasia, brain injuries, and visual processing offer opportunities for learning and exploration but should be navigated with care to ensure they are inclusive and sensitive to all involved.
Aphantasia is the term attributed to the inability to willfully create internal visual objects in the mind that can be perceived consciously. So, that leaves an open unconscious "will" still being able to create them. Studies, and personal experience, shows people considered to have this "condition" called Aphantasia, are able to see hypnogogic images during transition to sleep. And most of us have dreams too.
Drawing a conclusion of that term applied to someone who clearly states they have damage to a certain part of their brain and then correlating that an estimated 1-2% of the population is a bit of an insensitive thing, maybe.
Then again, I saw a lot of this while exploring the topic a few years back, so it's understandable that people who visualize think it's some sort of "problem" instead of a super power (which it is).
Re: MindEye2: Shared-Subject Models Enable fMRI-to-Image with 1 Hour of Data
#30What about doing the opposite: get an image and stimulate the brain to perceive it ?
For that you’ll need a first class airline ticket with Tom Hardy and Leo.