"Smiling eyes" may not signify true happiness after all

January 20, 2021

PITTSBURGH--A smile that lifts the cheeks and crinkles the eyes is thought by many to be truly genuine. But new research at Carnegie Mellon University casts doubt on whether this joyful facial expression necessarily tells others how a person really feels inside.

In fact, these "smiling eye" smiles, called Duchenne smiles, seem to be related to smile intensity, rather than acting as an indicator of whether a person is happy or not, said Jeffrey Girard, a former post-doctoral researcher at CMU's Language Technologies Institute.

"I do think it's possible that we might be able detect how strongly somebody feels positive emotions based on their smile," said Girard, who joined the psychology faculty at the University of Kansas this past fall. "But it's going to be a bit more complicated than just asking, 'Did their eyes move?'"

Whether it's possible to gauge a person's emotions based on their behavior is a topic of some debate within the disciplines of psychology and computer science, particularly as researchers develop automated systems for monitoring facial movements, gestures, voice inflections and word choice.

Duchenne smiles might not be as popularly known as Mona Lisa smiles or Bette Davis eyes, but there is a camp within psychology that believes they are a useful rule of thumb for gauging happiness. But another camp is skeptical. Girard, who studies facial behavior and worked with CMU's Louis-Phillippe Morency to develop a multimodal approach for monitoring behavior, said that some research seems to support the Duchenne smile hypothesis, while other studies demonstrate how it fails.

So Girard and Morency, along with Jeffrey Cohn of the University of Pittsburgh and Lijun Yin of Binghamton University, set out to better understand the phenomenon. They enlisted 136 volunteers who agreed to have their facial expressions recorded as they completed lab tasks designed to make them feel amusement, embarrassment, fear or physical pain. After each task, the volunteers rated how strongly they felt various emotions.

Finally, the team made videos of the smiles occurring during these tasks and showed them to new participants (i.e., judges), who tried to guess how much positive emotion the volunteers felt while smiling.

A report on their findings has been published online by the journal Affective Science.

Unlike most previous studies of Duchenne smiles, this work sought spontaneous expressions, rather than posed smiles, and the researchers recorded videos of the facial expressions from beginning to end rather than taking still photos. They also took painstaking measurements of smile intensity and other facial behaviors.

Although Duchenne smiles made up 90% of those that occurred when positive emotion was reported, they also made up 80% of the smiles that occurred when no positive emotion was reported. Concluding that a Duchenne smile must mean positive emotion would thus often be a mistake. On the other hand, the human judges found smiling eyes compelling and tended to guess that volunteers showing Duchenne smiles felt more positive emotion.

"It is really important to look at how people actually move their faces in addition to how people rate images and videos of faces, because sometimes our intuitions are wrong," Girard said.

"These results emphasize the need to model the subtleties of human emotions and facial expressions," said Morency, associate professor in the LTI and director of the MultiComp Lab. "We need to go beyond prototypical expression and take into account the context in which the expression happened."

It's possible, for instance, for someone to display the same behavior at a wedding as at a funeral, yet the person's emotions would be very different.

Automated methods for monitoring facial expression make it possible to examine behavior in much finer detail. Just two facial muscles are involved in Duchenne smiles, but new systems make it possible to look at 30 different muscle movements simultaneously.

Multimodal systems such as the ones being developed in Morency's lab hold the promise of giving physicians a new tool for assessing mental disorders, and for monitoring and quantifying the results of psychological therapy over time.

"Could we ever have an algorithm or a computer that is as good as humans at gauging emotions? I think so," Girard said. "I don't think people have any extrasensory stuff that a computer couldn't be given somewhere down the road. We're just not there yet. It's also important to remember that humans aren't always so good at this either!"
The National Science Foundation and the National Institutes of Health supported this research.

Carnegie Mellon University

Related Science Articles from Brightsurf:

75 science societies urge the education department to base Title IX sexual harassment regulations on evidence and science
The American Educational Research Association (AERA) and the American Association for the Advancement of Science (AAAS) today led 75 scientific societies in submitting comments on the US Department of Education's proposed changes to Title IX regulations.

Science/Science Careers' survey ranks top biotech, biopharma, and pharma employers
The Science and Science Careers' 2018 annual Top Employers Survey polled employees in the biotechnology, biopharmaceutical, pharmaceutical, and related industries to determine the 20 best employers in these industries as well as their driving characteristics.

Science in the palm of your hand: How citizen science transforms passive learners
Citizen science projects can engage even children who previously were not interested in science.

Applied science may yield more translational research publications than basic science
While translational research can happen at any stage of the research process, a recent investigation of behavioral and social science research awards granted by the NIH between 2008 and 2014 revealed that applied science yielded a higher volume of translational research publications than basic science, according to a study published May 9, 2018 in the open-access journal PLOS ONE by Xueying Han from the Science and Technology Policy Institute, USA, and colleagues.

Prominent academics, including Salk's Thomas Albright, call for more science in forensic science
Six scientists who recently served on the National Commission on Forensic Science are calling on the scientific community at large to advocate for increased research and financial support of forensic science as well as the introduction of empirical testing requirements to ensure the validity of outcomes.

World Science Forum 2017 Jordan issues Science for Peace Declaration
On behalf of the coordinating organizations responsible for delivering the World Science Forum Jordan, the concluding Science for Peace Declaration issued at the Dead Sea represents a global call for action to science and society to build a future that promises greater equality, security and opportunity for all, and in which science plays an increasingly prominent role as an enabler of fair and sustainable development.

PETA science group promotes animal-free science at society of toxicology conference
The PETA International Science Consortium Ltd. is presenting two posters on animal-free methods for testing inhalation toxicity at the 56th annual Society of Toxicology (SOT) meeting March 12 to 16, 2017, in Baltimore, Maryland.

Citizen Science in the Digital Age: Rhetoric, Science and Public Engagement
James Wynn's timely investigation highlights scientific studies grounded in publicly gathered data and probes the rhetoric these studies employ.

Science/Science Careers' survey ranks top biotech, pharma, and biopharma employers
The Science and Science Careers' 2016 annual Top Employers Survey polled employees in the biotechnology, biopharmaceutical, pharmaceutical, and related industries to determine the 20 best employers in these industries as well as their driving characteristics.

Three natural science professors win TJ Park Science Fellowship
Professor Jung-Min Kee (Department of Chemistry, UNIST), Professor Kyudong Choi (Department of Mathematical Sciences, UNIST), and Professor Kwanpyo Kim (Department of Physics, UNIST) are the recipients of the Cheong-Am (TJ Park) Science Fellowship of the year 2016.

Read More: Science News and Science Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.