Nav: Home

Machine learning, meet human emotions: How to help a computer monitor your mental state

August 19, 2020

Researchers from Skoltech, INRIA and the RIKEN Advanced Intelligence Project have considered several state-of-the-art machine learning algorithms for the challenging tasks of determining the mental workload and affective states of a human brain. Their software can help design smarter brain-computer interfaces for applications in medicine and beyond. The paper was published in the IEEE Systems, Man, and Cybernetics Magazine.

A brain-computer interface, or BCI, is a link between a human brain and a machine that can allow users to control various devices, such as robot arms or a wheelchair, by brain activity only (these are called active BCIs) or can monitor the mental state or emotions of a user and categorize them (these are passive BCIs). Brain signals in a BCI are usually measured by electroencephalography, a typically noninvasive method of recording electrical activity of the brain.

But there is quite a long way from raw continuous EEG signals to digitally processed signals or patterns that would have the ability to correctly identify a user's mental workload or affective states, something that passive BCIs need to be functional. Existing experiments have shown that the accuracy of these measurements, even for simple tasks of, say, discriminating low from high workload, is insufficient for reliable practical applications.

"The low accuracy is due to extremely high complexity of a human brain. The brain is like a huge orchestra with thousands of musical instruments from which we wish to extract specific sounds of each individual instrument using a limited number of microphones or other sensors," Andrzej Cichocki, professor at the Skoltech Center for Computational and Data-Intensive Science and Engineering (CDISE) and a coauthor of the paper, notes.

Thus, more robust and accurate EEG classification and recognition of various brain patterns algorithms are badly needed. Cichocki and his colleagues looked at two groups of machine learning algorithms, Riemannian geometry based classifiers (RGC) and convolutional neural networks (CNN), which have been doing quite well on the active side of BCIs. The researchers wondered whether these algorithms can work not just with so-called motor imaginary tasks, where a subject imagines some movements of limbs without any real movement, but for workload and affective states estimation.

They ran a competition of sorts among seven algorithms, two of which the scientists designed themselves by further improving well-performing Riemannian methods. The algorithms were tested in two studies, one with a typical arrangement for BCIs where algorithms were trained on data from a specific subject and later tested on that same subject, and one that was subject-independent -- a much more challenging setup, since our brain waves could be quite different. Real EEG data was taken from earlier experiments done by Fabien Lotte, a coauthor of the paper, and his colleagues, as well as from DEAP, an existing database for emotion analysis.

The scientists found, for instance, that an artificial deep neural network outperformed all its competitors quite significantly in the workload estimation task but did poorly in emotion classification. And the two modified Riemannian algorithms did quite well in both tasks. Overall, as the paper concludes, using passive BCIs for affective state classification is much harder than for workload estimation, and subject-independent calibration leads, at least for now, to much lower accuracies.

"In the next steps, we plan to use more sophisticated artificial intelligence (AI) methods, especially deep learning, which allow us to detect very tiny changes in brain signals or brain patterns. Deep neural networks can be trained on the basis of a large set of data for many subjects in different scenarios and under different conditions. AI is a real revolution and is also potentially useful for BCI and recognition of human emotions," Cichocki said.
-end-


Skolkovo Institute of Science and Technology (Skoltech)

Related Brain Articles:

Human brain size gene triggers bigger brain in monkeys
Dresden and Japanese researchers show that a human-specific gene causes a larger neocortex in the common marmoset, a non-human primate.
Unique insight into development of the human brain: Model of the early embryonic brain
Stem cell researchers from the University of Copenhagen have designed a model of an early embryonic brain.
An optical brain-to-brain interface supports information exchange for locomotion control
Chinese researchers established an optical BtBI that supports rapid information transmission for precise locomotion control, thus providing a proof-of-principle demonstration of fast BtBI for real-time behavioral control.
Transplanting human nerve cells into a mouse brain reveals how they wire into brain circuits
A team of researchers led by Pierre Vanderhaeghen and Vincent Bonin (VIB-KU Leuven, Université libre de Bruxelles and NERF) showed how human nerve cells can develop at their own pace, and form highly precise connections with the surrounding mouse brain cells.
Brain scans reveal how the human brain compensates when one hemisphere is removed
Researchers studying six adults who had one of their brain hemispheres removed during childhood to reduce epileptic seizures found that the remaining half of the brain formed unusually strong connections between different functional brain networks, which potentially help the body to function as if the brain were intact.
Alcohol byproduct contributes to brain chemistry changes in specific brain regions
Study of mouse models provides clear implications for new targets to treat alcohol use disorder and fetal alcohol syndrome.
Scientists predict the areas of the brain to stimulate transitions between different brain states
Using a computer model of the brain, Gustavo Deco, director of the Center for Brain and Cognition, and Josephine Cruzat, a member of his team, together with a group of international collaborators, have developed an innovative method published in Proceedings of the National Academy of Sciences on Sept.
BRAIN Initiative tool may transform how scientists study brain structure and function
Researchers have developed a high-tech support system that can keep a large mammalian brain from rapidly decomposing in the hours after death, enabling study of certain molecular and cellular functions.
Wiring diagram of the brain provides a clearer picture of brain scan data
In a study published today in the journal BRAIN, neuroscientists led by Michael D.
Blue Brain Project releases first-ever digital 3D brain cell atlas
The Blue Brain Cell Atlas is like ''going from hand-drawn maps to Google Earth'' -- providing previously unavailable information on major cell types, numbers and positions in all 737 brain regions.
More Brain News and Brain Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Listen Again: The Power Of Spaces
How do spaces shape the human experience? In what ways do our rooms, homes, and buildings give us meaning and purpose? This hour, TED speakers explore the power of the spaces we make and inhabit. Guests include architect Michael Murphy, musician David Byrne, artist Es Devlin, and architect Siamak Hariri.
Now Playing: Science for the People

#576 Science Communication in Creative Places
When you think of science communication, you might think of TED talks or museum talks or video talks, or... people giving lectures. It's a lot of people talking. But there's more to sci comm than that. This week host Bethany Brookshire talks to three people who have looked at science communication in places you might not expect it. We'll speak with Mauna Dasari, a graduate student at Notre Dame, about making mammals into a March Madness match. We'll talk with Sarah Garner, director of the Pathologists Assistant Program at Tulane University School of Medicine, who takes pathology instruction out of...
Now Playing: Radiolab

What If?
There's plenty of speculation about what Donald Trump might do in the wake of the election. Would he dispute the results if he loses? Would he simply refuse to leave office, or even try to use the military to maintain control? Last summer, Rosa Brooks got together a team of experts and political operatives from both sides of the aisle to ask a slightly different question. Rather than arguing about whether he'd do those things, they dug into what exactly would happen if he did. Part war game part choose your own adventure, Rosa's Transition Integrity Project doesn't give us any predictions, and it isn't a referendum on Trump. Instead, it's a deeply illuminating stress test on our laws, our institutions, and on the commitment to democracy written into the constitution. This episode was reported by Bethel Habte, with help from Tracie Hunte, and produced by Bethel Habte. Jeremy Bloom provided original music. Support Radiolab by becoming a member today at Radiolab.org/donate.     You can read The Transition Integrity Project's report here.