Nav: Home

How we see others' emotions depends on our pre-conceived beliefs

July 23, 2018

How we see emotions on another person's face depends on our pre-conceived views of how we understand these emotions, researchers at New York University have found. Their study, which appears in the journal Nature Human Behaviour, makes new insights into how we recognize facial expressions of emotion, which is critical for successful interactions in business, diplomacy, and everyday social exchange.

"Perceiving other people's facial emotion expressions often feels as if we are directly reading them out from a face, but these visual perceptions may differ across people depending on the unique conceptual beliefs we bring to the table," explains Jonathan Freeman, the paper's senior author and an associate professor in NYU's Department of Psychology and Center for Neural Science. "Our findings suggest that people vary in the specific facial cues they utilize for perceiving facial emotion expressions."

The study, conducted with Jeffrey Brooks, an NYU doctoral student, involved a series of experiments in which subjects were asked about their conceptualizations of different emotions. This was used to estimate how closely related different emotions were in a subject's mind. For instance, some people might think anger and sadness are more similar emotions if they conceptually associate both these emotions with actions such as crying and slamming your fist on a table; other people might think they're entirely different emotions because they associate the two emotions as feeling completely different and resulting in different actions.

Specifically, subjects were assessed in how similarly they held different pairs of the following emotions in their mind: Anger, Disgust, Happiness, Fear, Sadness, and Surprise. These six emotions have long been argued by some scientists to be universal across cultures and genetically hard-wired in humans.

Freeman and Brooks then set out to test whether the different ways subjects conceptually held the six emotions in their mind may warp how subjects visually perceive these emotions on others' faces.

The subjects viewed a series of images of human facial expressions of the emotions and made judgments about the emotion these faces were expressing. To gauge subjects' perceptions, the researchers deployed an innovative mouse-tracking technology, developed by Freeman, that uses an individual's hand movements to reveal unconscious cognitive processes--in this case, which emotion categories became activated in subjects' minds during their visual perception of a facial expression. Unlike surveys, in which subjects can consciously alter their responses, this technique requires them to make split-second decisions, thereby uncovering less conscious tendencies through their hand-motion trajectory.

Overall, the experiments showed that when individuals believed any two emotions were conceptually more similar, faces they saw from those categories of emotions were visually perceived with a corresponding similarity.

Specifically, when subjects held any two emotions, such as anger and disgust, as conceptually more similar, their hand attempted to simultaneously indicate that they saw both "anger" and "disgust" when viewing one of those facial expressions--even though presumably each expression only depicted a single emotion at a time.

In a final experiment, a technique known as 'reverse correlation' was used to visualize the six different emotions in the mind's eye of a subject. The researchers started with a single neutral face and created hundreds of different versions of this face that were overlaid with different patterns of random noise. The noise patterns create random variations in the face's cues; for example, one version might look more like it is smiling rather than frowning. On each trial of the experiment, subjects were presented with two different versions of this face and decided which of the two appeared more like a specific emotion (e.g., anger)--even though in reality it was only the noise pattern creating any difference in the two versions' appearance. On the basis of the noise patterns a subject chose, an average facial "prototype" for each of the six emotions could be visualized--serving as a kind of window into the mind's eye of a subject.

Converging with the mouse-tracking results, when any two emotions were conceptually more similar in a subject's mind, the images of those two visualized facial prototypes physically resembled one another to a greater extent. For instance, if a subject viewed anger and disgust to be conceptually more similar, the visualized images of what an angry face and a disgusted face look like to that subject had a greater physical resemblance.

"The findings suggest that how we perceive facial expressions may not just reflect what's in the face itself, but also our own conceptual understanding of what the emotion means," explains Freeman, who notes interest in facial expressions has intrigued scientists dating back to Charles Darwin in the 19th century. "For any given pair of emotions, such as fear and anger, the more a subject believes these emotions are more similar, the more these two emotions visually resemble one another on a person's face. The results suggest that we may all slightly differ in the facial cues we use to understand others' emotions, because they depend on how we conceptually understand these emotions."

The authors note that the study's results contrast with classic scientific theories of emotion that assume each emotion has its own specific facial expression that humans universally recognize. Based on this view, the same exact facial expression, such as a scowling face for anger, should always elicit a perception of anger, and our personally-held beliefs about what constitutes "anger" should not affect the process.

The findings, Freeman observes, may have implications for artificial intelligence and machine learning. Automated algorithms for facial emotion recognition, and other computer-vision and security applications, are geared to spot emotions, which could potentially be enhanced by incorporating conceptual processes.
-end-
The research was supported, in part, by a grant from the National Institutes of Health (R01-MH112640).

New York University

Related Emotions Articles:

Do ER caregivers' on-the-job emotions affect patient care?
Doctors and nurses in emergency departments at four academic centers and four community hospitals in the Northeast reported a wide range of emotions triggered by patients, hospital resources and societal factors, according to a qualitative study led by a University of Massachusetts Amherst social psychologist.
The 'place' of emotions
The entire set of our emotions is mapped in a small region of the brain, a 3 centimeters area of the cortex, according to a study conducted at the IMT School for Advanced Studies Lucca, Italy.
Faking emotions at work does more harm than good
Faking your emotions at work to appear more positive likely does more harm than good, according to a University of Arizona researcher.
Students do better in school when they can understand, manage emotions
Students who are better able to understand and manage their emotions effectively, a skill known as emotional intelligence, do better at school than their less skilled peers, as measured by grades and standardized test scores, according to research published by the American Psychological Association.
How people want to feel determines whether others can influence their emotions
New Stanford research on emotions shows that people's motivations are a driving factor behind how much they allow others to influence their feelings, such as anger.
Moral emotions, a diagnotic tool for frontotemporal dementia?
A study conducted by Marc Teichmann and Carole Azuar at the Brain and Spine Institute in Paris (France) and at the Pitié-Salpêtrière Hospital shows a particularly marked impairment of moral emotions in patients with frontotemporal dementia (FTD).
Emotions from touch
Touching different types of surfaces may incur certain emotions. This was the conclusion made by the psychologists from the Higher School of Economics in a recent empirical study.
Negative emotions can reduce our capacity to trust
It is no secret that a bad mood can negatively affect how we treat others.
Study examines how sensitivity to emotions changes across the lifespan
Why do we become more positive as we grow older?
Face it. Our faces don't always reveal our true emotions
When it comes to reading a person's state of mind, visual context -- as in background and action -- is just as important as facial expressions and body language, according to a new study from the University of California, Berkeley.
More Emotions News and Emotions Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Listen Again: Reinvention
Change is hard, but it's also an opportunity to discover and reimagine what you thought you knew. From our economy, to music, to even ourselves–this hour TED speakers explore the power of reinvention. Guests include OK Go lead singer Damian Kulash Jr., former college gymnastics coach Valorie Kondos Field, Stockton Mayor Michael Tubbs, and entrepreneur Nick Hanauer.
Now Playing: Science for the People

#562 Superbug to Bedside
By now we're all good and scared about antibiotic resistance, one of the many things coming to get us all. But there's good news, sort of. News antibiotics are coming out! How do they get tested? What does that kind of a trial look like and how does it happen? Host Bethany Brookeshire talks with Matt McCarthy, author of "Superbugs: The Race to Stop an Epidemic", about the ins and outs of testing a new antibiotic in the hospital.
Now Playing: Radiolab

Dispatch 6: Strange Times
Covid has disrupted the most basic routines of our days and nights. But in the middle of a conversation about how to fight the virus, we find a place impervious to the stalled plans and frenetic demands of the outside world. It's a very different kind of front line, where urgent work means moving slow, and time is marked out in tiny pre-planned steps. Then, on a walk through the woods, we consider how the tempo of our lives affects our minds and discover how the beats of biology shape our bodies. This episode was produced with help from Molly Webster and Tracie Hunte. Support Radiolab today at Radiolab.org/donate.