Fascinating work but far from what some might hope from reading only the title. The translation is restricted to a vocabulary of 30 to 50 unique sentences.
Machine translation of cortical activity to text with encoder–decoder framework
31–40 of 93 posts
Re: Machine translation of cortical activity to text with encoder–decoder framework
#32Really cool to see progress made here but this won't be available for public use any time soon (likely decades). One of the biggest challenges with decoding brain signals is getting a large number sensors that detect voltages from a very localized region of the brain. This study was done with ECoG (Eletro-Cortico-Gram) which involves implanting small electrodes directly on the surface of the brain. Nearly all consume…
Re: Machine translation of cortical activity to text with encoder–decoder framework
#33Really cool to see progress made here but this won't be available for public use any time soon (likely decades). One of the biggest challenges with decoding brain signals is getting a large number sensors that detect voltages from a very localized region of the brain. This study was done with ECoG (Eletro-Cortico-Gram) which involves implanting small electrodes directly on the surface of the brain. Nearly all consume…
No, actually high density electrode implants are right around the corner. Watch the neuralink press event.
Yeah, you're not putting that in my brain.
Re: Machine translation of cortical activity to text with encoder–decoder framework
#34Really cool to see progress made here but this won't be available for public use any time soon (likely decades). One of the biggest challenges with decoding brain signals is getting a large number sensors that detect voltages from a very localized region of the brain. This study was done with ECoG (Eletro-Cortico-Gram) which involves implanting small electrodes directly on the surface of the brain. Nearly all consume…
There's been a forty-year evolution in these techniques. The cheap, noisy technique might prevail if scientists keep refining the craft by tiny improvements.
Re: Machine translation of cortical activity to text with encoder–decoder framework
#35Really cool to see progress made here but this won't be available for public use any time soon (likely decades). One of the biggest challenges with decoding brain signals is getting a large number sensors that detect voltages from a very localized region of the brain. This study was done with ECoG (Eletro-Cortico-Gram) which involves implanting small electrodes directly on the surface of the brain. Nearly all consume…
Has there been any work to use a neural network to generate/simulate ECoG signal output from an EEG signal input? (My Google-fu only gives definitions and distinctions for ECoG and EEG). Almost sounds similar in concept to deep learning super sampling (DLSS), i.e., taking a low resolution image/signal (EEG) and using a neural network to generate/simulate a high resolution image/signal (ECoG).
DLSS kinda works because we "know" what is what thing in a photo.
EEG to ECOG would be trying to figure out a painting (that could be anything, from any painter) from a significant distance behind a frosted glass
Re: Machine translation of cortical activity to text with encoder–decoder framework
#36Really cool to see progress made here but this won't be available for public use any time soon (likely decades). One of the biggest challenges with decoding brain signals is getting a large number sensors that detect voltages from a very localized region of the brain. This study was done with ECoG (Eletro-Cortico-Gram) which involves implanting small electrodes directly on the surface of the brain. Nearly all consume…
No, actually high density electrode implants are right around the corner. Watch the neuralink press event.
Re: Machine translation of cortical activity to text with encoder–decoder framework
#37Earlier quoted context omitted.
What's your opinion on Neuralink?
I think they're a cool company and I even thought about applying. However the limiting factor here isn't the implant technology. Lots of groups have been building really great stuff for years (groups around the world have been recording from neurons in living animals for decades). The issue is there are ethical implications for performing such an invasive brain surgery on a healthy person. Right now the limit factor…
That sounds like a limitation of the implant technology to me. The reason there are ethical problems with performing invasive brain surgery on a healthy person is because the risks and downsides of currently available implant technology are significant. If getting a brain implant were as cheap, easy, and safe as getting a tattoo, the ethical problem would be largely solved.
Re: Machine translation of cortical activity to text with encoder–decoder framework
#38Earlier quoted context omitted.
How do you place electrodes without metal filaments? It’s been validated in monkeys.
Is that true? There was a throwaway comment about that at a press conference and lots of rumors (positive and negative), but the white paper only mentions “monkey” once—-and in a reference to another group’s paper.
Re: Machine translation of cortical activity to text with encoder–decoder framework
#39Re: Machine translation of cortical activity to text with encoder–decoder framework
#40Earlier quoted context omitted.
No, actually high density electrode implants are right around the corner. Watch the neuralink press event.
> One engineering challenge is that the brain's chemical environment can cause many plastics to gradually deteriorate. Another challenge to chronic electrode implants is the inflammatory reaction to brain implants. Transmission of chemical messengers via neurons is impeded by a barrier-forming glial scar that occurs within weeks after insertion followed by progressive neurodegeneration, attenuating signal sensitivity…