Nav: Home

Artificial intelligence can make personality judgments based on our photographs

May 22, 2020

Russian researchers from HSE University and Open University for the Humanities and Economics have demonstrated that artificial intelligence is able to infer people's personality from 'selfie' photographs better than human raters do. Conscientiousness emerged to be more easily recognizable than the other four traits. Personality predictions based on female faces appeared to be more reliable than those for male faces. The technology can be used to find the 'best matches' in customer service, dating or online tutoring.

The article 'Assessing the Big Five personality traits using real-life static facial images' will be published on May 22 in Scientific Reports.

Physiognomists from Ancient Greece to Cesare Lombroso have tried to link facial appearance to personality, but the majority of their ideas failed to withstand the scrutiny by modern science. The few established associations of specific facial features, such as facial width-to-height ratio, with personality traits are quite weak. Studies asking human raters to make personality judgments based on photographs have produced inconsistent results, suggesting that our judgments are too unreliable to be of any practical importance.

Nevertheless, there are strong theoretical and evolutionary arguments to suggest that some information about personality characteristics, particularly, those essential for social communication, might be conveyed by the human face. After all, face and behaviour are both shaped by genes and hormones, and social experiences resulting from one's appearance may affect one's personality development. However, the recent evidence from neuroscience suggests that instead of looking at specific facial features, the human brain processes images of faces in a holistic manner.

Researchers from two Moscow universities, HSE University (Higher School of Economics) and Open University for the Humanities and Economics, have teamed up with a Russian-British business start-up BestFitMe to train a cascade of artificial neural networks to make reliable personality judgments based on photographs of human faces. The performance of the resulting model was above that discovered in previous studies which used machine learning or human raters. The artificial intelligence was able to make above-chance judgments about conscientiousness, neuroticism, extraversion, agreeableness, and openness based on 'selfies' the volunteers uploaded online. The resulting personality judgments were consistent across different photographs of the same individuals.

The study was done in a sample of 12 thousand volunteers who completed a self-report questionnaire measuring personality traits based on the "Big Five" model and uploaded a total of 31 thousand 'selfies'. The respondents were randomly split into a training and a test group. A series of neural networks were used to preprocess the images to ensure consistent quality and characteristics, and exclude faces with emotional expressions, as well as pictures of celebrities and cats. Next, an image classification neural network was trained to decompose each image into 128 invariant features, followed by a multi-layer perceptron that used image invariants to predict personality traits.

The average effect size of r = .24 indicates that AI can make a correct guess about the relative standing of two randomly chosen individuals on a personality dimension in 58% of cases as opposed to the 50% expected by chance. In comparison with the meta-analytic estimates of correlations between self-reported and observer ratings of personality traits, this indicates that an artificial neural network relying on static facial images outperforms an average human rater who meets the target in person without prior acquaintance. Conscientiousness emerged to be more easily recognizable than the other four traits. Personality predictions based on female faces appeared to be more reliable than those for male faces.

There are a vast number of potential applications to be explored. The recognition of personality from real-life photos can complement the traditional approaches to personality assessment in situations where high speed and low cost are more important than high accuracy. Artificial intelligence can be used to propose products that are the best fit for the customer's personality or to select the possible 'best matches' for individuals in dyadic interactions, such as customer service, dating or online tutoring.
-end-
Paper (to appear on May 22, 2020):

Kachur, A., Osin, E., Davydov, D., Shutilov, K., & Novokshonov, A. (2020). Assessing the Big Five personality traits using real-life static facial images. Scientific Reports. doi: 10.1038/s41598-020-65358-6

National Research University Higher School of Economics

Related Personality Articles:

Infant temperament predicts personality more than 20 years later
Researchers investigating how temperament shapes adult life-course outcomes have found that behavioral inhibition in infancy predicts a reserved, introverted personality at age 26.
State of mind: The end of personality as we know it
In a study published today researchers propose that changing states of mind are holistic in that they exert all-encompassing and coordinated effects simultaneously on our perception, attention, thought, affect, and behavior.
Want to change your personality? It may not be easy to do alone
Most people want to change an aspect of their personality, but left to their own devices, they may not be successful in changing, research shows.
How personality predicts seeing others as sex objects
Several personality traits related to psychopathy -- especially being openly antagonistic -- predict a tendency to view others as merely sex objects, finds a study by psychologists at Emory University.
Scientists say you can change your personality
A review of recent research in personality science points to the possibility that personality traits can change through persistent intervention and major life events.
Personality traits affect retirement spending
How quickly you spend your savings in retirement may have as much or more to do with your personality than whether you have a lot of debt or want to leave an inheritance.
For the first time: A method for measuring animal personality
A study on mice shows animal research may need to take into account the connection between genes, behavior and personality.
Your spending data may reveal aspects of your personality
How you spend your money can signal aspects of your personality, according to research published in Psychological Science, a journal of the Association for Psychological Science.
The sun may have a dual personality, simulations suggest
A deep dive into the sun's interior provides new clues to the forces that govern that star's internal clock.
A personality test for ads
People leave digital footprints online, and this information could helps marketers personalize ads based on individual personality types.
More Personality News and Personality Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Listen Again: IRL Online
Original broadcast date: March 20, 2020. Our online lives are now entirely interwoven with our real lives. But the laws that govern real life don't apply online. This hour, TED speakers explore rules to navigate this vast virtual space.
Now Playing: Science for the People

#574 State of the Heart
This week we focus on heart disease, heart failure, what blood pressure is and why it's bad when it's high. Host Rachelle Saunders talks with physician, clinical researcher, and writer Haider Warraich about his book "State of the Heart: Exploring the History, Science, and Future of Cardiac Disease" and the ails of our hearts.
Now Playing: Radiolab

Falling
There are so many ways to fall–in love, asleep, even flat on your face. This hour, Radiolab dives into stories of great falls.  We jump into a black hole, take a trip over Niagara Falls, upend some myths about falling cats, and plunge into our favorite songs about falling. Support Radiolab by becoming a member today at Radiolab.org/donate.