Onscreen cursor controlled by brain - Computers

USA Today (Society for the Advancement of Education), June, 2003

It is the stuff of science fiction: Researchers at Brown University, Providence, R.I., have used a tiny array of electrodes to record, interpret, and reconstruct the brain activity that controls hand movement, and they have demonstrated that thoughts alone can move a cursor across a computer screen to hit a target. The research was conducted using a primate model. Three Rhesus monkeys received brain implants similar to those used in treating certain human Parkinson's patients.

"We substituted thought control for hand control," explains John Donoghue, chair of the Department of Neuroscience and the project's senior researcher. "A monkey's brain--not its hand--moved the cursor. Use of a reconstructed signal to allow the brain to accomplish immediate, complex goal-directed behavior has not been done before. We showed we could build a signal that works right away, in real time. And we can do it recording from as few as six neurons."

This work is a step toward enabling paralyzed humans to use thoughts to control a cursor that would allow them to read e-mail, surf the World Wide Web, or perform other functions through a computer interface. Eventually, the technology may help individuals who have a spinal cord injury, Lou Gehrig's disease, or muscular dystrophy, the researchers indicate. They hope to apply the technology to restore some movement control in paralyzed patients. That step would entail seeking approval from the U.S. Food and Drug Administration, which has yet to sign off on this "instant-control brain cursor" technique for human use.

"This implant is potentially one that is very suitable for humans," notes graduate student Mijail Serruya, lead author of the study. "It shows enough promise that we think it could ultimately be hooked up via a computer to a paralyzed patient to restore that individual's interaction with the environment. Our goal is to make sense of how the brain plans to move a hand through space and to use that information as a control signal for someone who is paralyzed. We want to provide some freedom to this individual:'

The device "would work for anything you can do or you can imagine doing by pointing and clicking," Donoghue notes. "This includes reading e-mail. Or imagine an onscreen keyboard that someone can use to type sentences or issue commands by pointing and clicking. We would be extraordinarily pleased if this system could allow a patient to become somewhat autonomous, it would restore some independence to [those] paralyzed patients who are cognitively normal people unable to carry out their movement intentions."

The research involves use of thin electrodes to record the activity of a few neurons in the brain's motor cortex. This area contains the cells that fire when a hand moves. Activity of the neurons is first recorded while a cursor on a computer screen is moved to hit a target using a mouse-like handle. The scientists built a series of mathematical formulas, called linear filters, to create a model that related the firing of neurons to a cursor's target position. These linear filters then allowed the researchers to reconstruct hand trajectory from any new neural signals.

The electrode array was connected to a computer by thin cables. While the subject played a simple pinball video game, the hand control was turned off and the reconstructed signal was substituted for it. While the primate continued to move its hand as if playing the game, cursor motion actually was controlled solely by brain signals associated with moving the hand. The subject then used its thoughts to move the cursor to different targets for periods averaging two minutes in length. While this instant-control brain cursor was active, the real-time signals allowed the animal to correct wayward cursor movements "on the fly" in order to strike the target. This entire processing took place nearly as fast as the hand responds to the brain's movement commands.