A wearable sensor to help ALS patients communicate

October 22, 2020

CAMBRIDGE, MA -- People with amyotrophic lateral sclerosis (ALS) suffer from a gradual decline in their ability to control their muscles. As a result, they often lose the ability to speak, making it difficult to communicate with others.

A team of MIT researchers has now designed a stretchable, skin-like device that can be attached to a patient's face and can measure small movements such as a twitch or a smile. Using this approach, patients could communicate a variety of sentiments, such as "I love you" or "I'm hungry," with small movements that are measured and interpreted by the device.

The researchers hope that their new device would allow patients to communicate in a more natural way, without having to deal with bulky equipment. The wearable sensor is thin and can be camouflaged with makeup to match any skin tone, making it unobtrusive.

"Not only are our devices malleable, soft, disposable, and light, they're also visually invisible," says Canan Dagdeviren, the LG Electronics Career Development Assistant Professor of Media Arts and Sciences at MIT and the leader of the research team. "You can camouflage it and nobody would think that you have something on your skin."

The researchers tested the initial version of their device in two ALS patients (one female and one male, for gender balance) and showed that it could accurately distinguish three different facial expressions -- smile, open mouth, and pursed lips.

MIT graduate student Farita Tasnim and former research scientist Tao Sun are the lead authors of the study, which appears today in Nature Biomedical Engineering. Other MIT authors are undergraduate Rachel McIntosh, postdoc Dana Solav, and research scientist Lin Zhang. Yuandong Gu of the A*STAR Institute of Microelectronics in Singapore and Nikta Amiri, Mostafa Tavakkoli Anbarani, and M. Amin Karami of the University of Buffalo are also authors.

A skin-like sensor

Dagdeviren's lab, the Conformable Decoders group, specializes in developing conformable (flexible and stretchable) electronic devices that can adhere to the body for a variety of medical applications. She became interested in working on ways to help patients with neuromuscular disorders communicate after meeting Stephen Hawking in 2016, when the world-renowned physicist visited Harvard University and Dagdeviren was a junior fellow in Harvard's Society of Fellows.

Hawking, who passed away in 2018, suffered from a slow-progressing form of ALS. He was able to communicate using an infrared sensor that could detect twitches of his cheek, which moved a cursor across rows and columns of letters. While effective, this process could be time-consuming and required bulky equipment.

Other ALS patients use similar devices that measure the electrical activity of the nerves that control the facial muscles. However, this approach also requires cumbersome equipment, and it is not always accurate.

"These devices are very hard, planar, and boxy, and reliability is a big issue. You may not get consistent results, even from the same patients within the same day," Dagdeviren says.

Most ALS patients also eventually lose the ability to control their limbs, so typing is not a viable strategy to help them communicate. The MIT team set out to design a wearable interface that patients could use to communicate in a more natural way, without the bulky equipment required by current technologies.

The device they created consists of four piezoelectric sensors embedded in a thin silicone film. The sensors, which are made of aluminum nitride, can detect mechanical deformation of the skin and convert it into an electric voltage that can be easily measured. All of these components are easy to mass-produce, so the researchers estimate that each device would cost around $10.

The researchers used a process called digital imaging correlation on healthy volunteers to help them select the most useful locations to place the sensor. They painted a random black-and-white speckle pattern on the face and then took many images of the area with multiple cameras as the subjects performed facial motions such as smiling, twitching the cheek, or mouthing the shape of certain letters. The images were processed by software that analyzes how the small dots move in relation to each other, to determine the amount of strain experienced in a single area.

"We had subjects doing different motions, and we created strain maps of each part of the face," McIntosh says. "Then we looked at our strain maps and determined where on the face we were seeing a correct strain level for our device, and determined that that was an appropriate place to put the device for our trials."

The researchers also used the measurements of skin deformations to train a machine-learning algorithm to distinguish between a smile, open mouth, and pursed lips. Using this algorithm, they tested the devices with two ALS patients, and were able to achieve about 75 percent accuracy in distinguishing between these different movements. The accuracy rate in healthy subjects was 87 percent.

Enhanced communication

Based on these detectable facial movements, a library of phrases or words could be created to correspond to different combinations of movements, the researchers say.

"We can create customizable messages based on the movements that you can do," Dagdeviren says. "You can technically create thousands of messages that right now no other technology is available to do. It all depends on your library configuration, which can be designed for a particular patient or group of patients."

The information from the sensor is sent to a handheld processing unit, which analyzes it using the algorithm that the researchers trained to distinguish between facial movements. In the current prototype, this unit is wired to the sensor, but the connection could also be made wireless for easier use, the researchers say.

The researchers have filed for a patent on this technology and they now plan to test it with additional patients. In addition to helping patients communicate, the device could also be used to track the progression of a patient's disease, or to measure whether treatments they are receiving are having any effect, the researchers say.

"There are a lot of clinical trials that are testing whether or not a particular treatment is effective for reversing ALS," Tasnim says. "Instead of just relying on the patients to report that they feel better or they feel stronger, this device could give a quantitative measure to track the effectiveness."
The research was funded by the MIT Media Lab Consortium, the National Science Foundation, and the National Institute of Biomedical Imaging and Bioengineering.

Massachusetts Institute of Technology

Related Amyotrophic Lateral Sclerosis Articles from Brightsurf:

Converting lateral scanning into axial focusing to speed up 3D microscopy
In optical microscopy, high-speed volumetric imaging is limited by either the slow axial scanning rate or aberrations introduced by the z-scanning mechanism.

Ammonium triggers formation of lateral roots
Despite the importance of changes in root architecture to exploit local nutrient patches, mechanisms integrating external nutrient signals into the root developmental program remain poorly understood.

'Reelin' in a new treatment for multiple sclerosis
In an animal model of multiple sclerosis (MS), decreasing the amount of a protein made in the liver significantly protected against development of the disease's characteristic symptoms and promoted recovery in symptomatic animals, UTSW scientists report.

Adjustable lordotic expandable vs static lateral lumbar interbody fusion devices
The objective of this study is to compare the clinical and radiographic outcomes between patients treated with static and expandable interbody spacers with adjustable lordosis for MIS LLIF.

Chirality-assisted lateral momentum transfer for bidirectional enantioselective separation
Chiral nanoparticles which twist the light were theoretically predicted to experience lateral forces perpendicular to light vector but lacks experimental verification.

Not all multiple sclerosis-like diseases are alike
Scientists say some myelin-damaging disorders have a distinctive pathology that groups them into a unique disease entity.

Researchers delay onset of amyotrophic lateral sclerosis (ALS) in laboratory models
Scientists have delayed the onset of amyotrophic lateral sclerosis (ALS) in laboratory models, leaving them cautiously optimistic that the result, combined with other clinical advances, points to a potential treatment for ALS in humans.

Emerging role of adenosine in brain disorders and amyotrophic lateral sclerosis
The role of adenosine in neurodegeneration and neuroregeneration has led to growing attention on adenosine receptors as potential drug targets in a range of brain disorders, including neuroregenerative therapy and treatment for amyotrophyic lateral sclerosis (ALS).

New clues about the origins of familial forms of Amyotrophic lateral sclerosis
A Brazilian study made important progress in understanding the accumulation of one of the proteins involved in amyotrophic lateral sclerosis (ALS).

Recrutement of a lateral root developmental pathway into root nodule formation of legumes
Peas and other legumes develop spherical or cylindrical structures -- called nodules -- in their roots to establish a mutually beneficial relationship with bacteria that convert atmospheric nitrogen into a useable nutrient for the legume plant.

Read More: Amyotrophic Lateral Sclerosis News and Amyotrophic Lateral Sclerosis Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.