From age 8 we spontaneously link vocal to facial emotion

June 30, 2020

Do children have to wait until age 8 to recognise - spontaneously and without instructions - the same emotion of happiness or anger depending on whether it is expressed by a voice or on a face? A team of scientists from the University of Geneva (UNIGE) and the Swiss Centre for Affective Sciences (CISA) has provided an initial response to this question. They compared the ability of children age 5, 8 and 10 years and adults to make a spontaneous link between a heard voice (expressing happiness or anger) and the corresponding emotional expression on a natural or virtual face (also expressing happiness or anger). The results, published in the journal Emotion, demonstrate that children from 8 years look at a happy face for longer if they have previously heard a happy voice. These visual preferences for congruent emotion reflect a child's ability for the spontaneous amodal coding of emotions, i.e. independent of perceptual modality (auditory or visual).

Emotions are an integral part of our lives and influence our behaviour, perceptions and day-to-day decisions. The spontaneous amodal coding of emotions - i.e. independently of perceptual modalities and, therefore, the physical characteristics of faces or voices - is easy for adults, but how does the same capacity develop in children?

In an attempt to answer this question, researchers from the Faculty of Psychology and Educational Sciences - together with members of the Swiss Centre for Affective Sciences - led by Professor Edouard Gentaz, studied the development of the capacity to establish links between vocal emotion and the emotion conveyed by a natural or artificial face in children age 5, 8 and 10 years, as well as in adults. Unlike more usual studies that include instructions (generally verbal in nature), this research did not call on the language skills of children. It is a promising new method that could be used to assess capacities in children with disabilities or with language and communication disorders.

Exposed for 10 seconds to two emotional faces

The research team employed an experimental paradigm originally designed for use with babies, a task known as emotional intermodal transfer. The children were exposed to emotional voices and faces expressing happiness and anger. In the first phase, devoted to hearing familiarisation, each participant sat facing a black screen and listened to three voices - neutral, happy and angry - for 20 seconds. In the second, visual discrimination phase, which lasted 10 seconds, the same individual was exposed to two emotional faces, one expressing happiness and the other anger, one with a facial expression corresponding to the voice and the other with a facial expression that was different to the voice.

The scientists used eye-tracking technology to measure precisely the eye movements of 80 participants. They were then able to determine whether the time spent looking at one or other of the emotional faces - or particular areas of the natural or virtual face (the mouth or eyes) - varied according to the voice heard. The use of a virtual face, produced with CISA's FACSGen software, gave greater control over the emotional characteristics compared to a natural face. «If the participants made the connection between the emotion in the voice they heard and the emotion expressed by the face they saw, we can assume that they recognise and code the emotion in an amodal manner, i.e. independently of perceptive modalities», explains Amaya Palama, a researcher in the Laboratory of Sensorimotor, Affective and Social Development in the Faculty of Psychology and Educational Sciences at UNIGE.

The results show that after a control phase (without a voice or a neutral voice), there is no difference in the visual preference between the happy and angry faces. So, after the emotional voices (happiness or anger), participants looked at the face (natural or virtual) congruent with the voice for longer. More specifically, the results showed a spontaneous transfer of the emotional voice of joy, with a preference for the congruent face of joy from the age of 8 and a spontaneous transfer of the emotional voice of anger, with a preference for the congruent face of anger from the age of 10.

Revealing unsuspected abilities

These results suggest a spontaneous amodal coding of emotions. The research was part of a project designed to study the development of emotional discrimination capacities in childhood funded by the Swiss National Science Foundation (SNSF) obtained by Professor Gentaz. Current and future research is trying to validate whether this task is suitable for revealing unsuspected abilities to understand emotions in children with multiple disabilities, who are unable to understand verbal instructions or produce verbal responses

Université de Genève

Related Happiness Articles from Brightsurf:

Happiness and the evolution of brain size
Serotonin can act as a growth factor for the stem cells in the fetal human brain that determine brain size.

The key to happiness: Friends or family?
Think spending time with your kids and spouse is the key to your happiness?

Hedonism leads to happiness
Relaxing on the sofa or savoring a delicious meal: Enjoying short-term pleasurable activities that don't lead to long-term goals contributes at least as much to a happy life as self-control, according to new research from the University of Zurich and Radboud University in the Netherlands.

When it comes to happiness, what's love got to do with it?
Researchers from Michigan State University conducted one of the first studies of its kind to quantify the happiness of married, formerly married and single people at the end of their lives to find out just how much love and marriage played into overall well-being.

Health and happiness depend on each other, Psychological Science says
New research adds to the growing body of evidence that happiness not only feels good, it is good for your physical health, too.

Happiness might protect you from gastrointestinal distress
Serotonin, a chemical known for its role in producing feelings of well-being and happiness in the brain, can reduce the ability of some intestinal pathogens to cause deadly infections, new research by UT Southwestern scientists suggests.

Spending on experiences versus possessions advances more immediate happiness
Consumers are happier when they spend their money on experiential purchases versus material ones, according to research from the McCombs School of Business at the University of Texas at Austin.

Braces won't always bring happiness
Research undertaken at the University of Adelaide overturns the belief that turning your crooked teeth into a beautiful smile will automatically boost your self-confidence.

In China, a link between happiness and air quality
In a paper published in the journal Nature Human Behaviour, a research team led by Siqi Zheng, the Samuel Tak Lee Associate Professor in MIT's Department of Urban Studies and Planning and Center for Real Estate, and the Faculty Director of MIT China Future City Lab, reveals that higher levels of pollution are associated with a decrease in people's happiness levels.

The 17 different ways your face conveys happiness
Human beings can configure their faces in thousands and thousands of ways to convey emotion, but only 35 expressions actually get the job done across cultures, a new study has found.

Read More: Happiness News and Happiness Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to