Live data from Hacker News

Paralyzed Woman Controls Robotic Arm With Her Mind

wired.com

11–20 of 35 posts

Re: Paralyzed Woman Controls Robotic Arm With Her Mind

#11
This is extremely impressive, what a beautiful piece of work.

The smile on that lady's face says more than any number of facebook 'likes' or google +1's could ever do for me, that's a real and measurable quality of life improvement for a single person, this really makes a difference.

The engineering on that arm is pretty heavy duty, I wonder what it weighs and how fast it could move and what kind of safeguards are built in to avoid the operator injuring themselves due to glitches in the system. If you look at the way the arm moves it is actually quite comparable to the arm of a baby that moves an object to its mouth the first couple of times.

With one big difference, a baby may get it wrong but it is not strong enough to do too much damage, even if it pokes itself in the eye every now and then it is usually with very little force. This arm however looks engineered to be strong enough and fast enough that it could do real damage to the operator or its environment. If that's servo driven there has to be a whole slew of safety systems in case a driver decides to hook a motor to V+ or V- because of a blown FET.

In any real-world machinery situation where the machinery is under software control and has the capability of doing real harm (for instance: machine shops with CNC gear) there are normally countless interlock systems that you'd have to bypass before you could get yourself in contact with a piece of it moving under control of the computer. In this case the operator is extremely exposed and I cringed when the arm sped up towards her face with the bottle. I also found myself sort of 'willing the bottle' in the right direction, they way some movies will have you react to something on the screen. Hard to describe.

This is not a soft hand moving either, it looks like it is made of pretty strong aluminum and fairly heavy.

Re: Paralyzed Woman Controls Robotic Arm With Her Mind

#12

what is she thinks dirty?

The only person in this thread that thinks dirty is you. Really, someone is capable of some level of direct control over her environment for the first time in years and that's the only thing you can think of? Look at the video and watch that lady smile at the end and then ask yourself what your comment said about you instead of about her.

Re: Paralyzed Woman Controls Robotic Arm With Her Mind

#13

This is extremely impressive, what a beautiful piece of work. The smile on that lady's face says more than any number of facebook 'likes' or google +1's could ever do for me, that's a real and measurable quality of life improvement for a single person, this really makes a difference. The engineering on that arm is pretty heavy duty, I wonder what it weighs and how fast it could move and what kind of safeguards are bu…

The full video shows that it will cut out on an unanticipated contact along its length.

EDIT: the full video (or at least, the one I saw) is here: http://www.youtube.com/watch?feature=player_embedded&v=o...

Re: Paralyzed Woman Controls Robotic Arm With Her Mind

#14

what is she thinks dirty?

The only person in this thread that thinks dirty is you. Really, someone is capable of some level of direct control over her environment for the first time in years and that's the only thing you can think of? Look at the video and watch that lady smile at the end and then ask yourself what your comment said about you instead of about her.

I think grantgrant has a point. I wonder what it's like to use an arm like that - she seems to be focusing hard on thinking "up" "down" "left" "twist" but as this stuff gets more powerful, how do you separate the signal from the noise? I have many thoughts bouncing around my head, but somehow my brain knows not to act on them.

Re: Paralyzed Woman Controls Robotic Arm With Her Mind

#16

Earlier quoted context omitted.

The only person in this thread that thinks dirty is you. Really, someone is capable of some level of direct control over her environment for the first time in years and that's the only thing you can think of? Look at the video and watch that lady smile at the end and then ask yourself what your comment said about you instead of about her.

I think grantgrant has a point. I wonder what it's like to use an arm like that - she seems to be focusing hard on thinking "up" "down" "left" "twist" but as this stuff gets more powerful, how do you separate the signal from the noise? I have many thoughts bouncing around my head, but somehow my brain knows not to act on them.

The same way everything else works: practice!

Your muscles respond to your thoughts not because they pick out some random thought from all of them and decide to act on it. That wouldn't work at all. Your muscles are controlled by your brain in a feedback loop where your desire to make a particular movement gets compared with the actual movement you are making and then that movement is corrected. For something new or exceptionally delicate that is a full-time conscious job.

For something that you've done a hundred times before you more than likely have abstracted it away and have it 'on call' to the extent that it can be done as a subconscious task.

I don't know if you have a driving license or not but because driving is a skill that many people learn only well after they've become conscious of their environment it is my favorite example of this sort of abstraction. When you first learn to drive it is difficult and each and every movement is something that your conscious is fully engaged with. If you learn to drive in a stick-shift car it is not rare to have an instructor operate the clutch and the brake for the first couple of lessons because there is already so much for you to pay attention to.

Fast forward a decade or so and you're listening to your favorite tune and possibly working out some problem in your head while driving on the highway at a 90 miles per hour.

That's the power of how your brain is organized, it has an automated process for abstracting skills on board that allows you to build on top of things you've previously acquired but still allows you to focus on those same things long after they've become abstracted away if required.

Re: Paralyzed Woman Controls Robotic Arm With Her Mind

#17
I also work in a similar lab as a phd student. Kevinalexbrown's points are spot on. Currently, the main challenges for implementing this clinically are

1) stability of the electrode array over long timescales.

2) increasing the number of degrees of freedom of robust control that we can decode from the neural data. Activity in the motor cortex inherently lives in a (very) roughly 10 dimensional space, which is a bit of a mystery since we use thy activity to control hundreds of muscles independently. What this means, is that when you record from 96 electrodes simultaneously, many of the neurons picked up by the array are correlated, such that the resulting dimensionality is much lower than the number of neurons

3) An important step forward will be to develope optogenetic (or other) sensory write in, using pulses of light to activate neutrons in specific patterns that mimic priprioceptive signals from your limbs. This will increase the speed and robustness of movent via faster closed loop feedback.

4) Processing power. Currently it's typical to run decoders on real-time PC's. Creating an embedded processor capable of sufficiently low power operation with enough processing power to run the decode is non-trivial, especially if you want to implant this in the brain.

It is very unlikely, as suggested elsewhere, that current web tech will impact BMI research at all. The primary interesting tech is in the decode algorithm, which is a modified form of the Kalman filter. There is, however, a lot of room for hackers in research. I recently made the switch from working in defense, building robots and designing sensor fusion algorithms, to a phd in neuroscience. Probably won't pay as well long term, but it's far more rewarding and interesting! I'm surrounded by scientists that need better (software and hardware) tools and analysis methods. Also, an infusion of ideas and values aligned with open access publishing (or changing the scientific publishing model altogether), open source software, data and code sharing, etc. would generally benefit all and accelerate scientific research, but that's another topic worthy of more discussion elsewhere.

Re: Paralyzed Woman Controls Robotic Arm With Her Mind

#18
post #4

I know I know, it's not good etiquette here to make short, emotional comments, but - By thinking about moving her own paralyzed arm, one woman in the experiment used an artificial limb to serve herself coffee for the first time in 15 years. Seeing her smile at the end of that video just made my otherwise terrible day rather special. And it's such great validation for the team that's working on this technology, I hope…

Its just so wonderful to see what could otherwise be a frustrating, debilitating experience become something incredibly empowering .

Finally, a decent use of the word "empowering". Shame I can only up vote you once :)

Re: Paralyzed Woman Controls Robotic Arm With Her Mind

#19

Disclaimer: I work in a similar lab (my adviser was advised by the senior author on the paper, who runs the lab) on a brain-machine interface project funded by DARPA. What makes this awesome from a scientific point of view: 1) 2-dimensional decoders, where an individual controls a mouse with their mind, have existed for a while. What makes this really cool is that there are actually quite a few degrees of freedom in…

Ah man, I sorry, but I have to rip in to you now...

How the hell is this area of science NOT sexy? Are you kidding me? IMHO, this is the ultimate in science, interfacing the human being directly with technology. That is a "sexy" as it gets, its right up there with CERN and spacey stuff. Stockings and suspenders couldn't make this more sexy.

And if that aint good enough for "us" then I merely have this to say, "think Russian".

Not sexy, pah!!!!

Not being in this field is possibly the only professional regret I have. I bow to you and your colleagues. Keep up the SEXY work.

Re: Paralyzed Woman Controls Robotic Arm With Her Mind

#20

Earlier quoted context omitted.

The only person in this thread that thinks dirty is you. Really, someone is capable of some level of direct control over her environment for the first time in years and that's the only thing you can think of? Look at the video and watch that lady smile at the end and then ask yourself what your comment said about you instead of about her.

I think grantgrant has a point. I wonder what it's like to use an arm like that - she seems to be focusing hard on thinking "up" "down" "left" "twist" but as this stuff gets more powerful, how do you separate the signal from the noise? I have many thoughts bouncing around my head, but somehow my brain knows not to act on them.

The brain is a "parallel processor" in that distinct regions are responsible for different tasks. These arrays are recording from the primary motor area (M1) which directly controls output muscles. While this does require conscious control right now, it's not the case that irrelevant thoughts are likely to significantly alter the control signals sent to the arm.
Post reply on HN