Neural network taught to detect age and gender by video almost 20 percent more accurately

December 20, 2018

Researchers from the Higher School of Economics have created a technology to help neural networks identify certain people on video, detecting their age and gender more quickly and accurately. The development has already become the basis for offline detection systems in Android mobile apps. The results of the study were published in an article entitled 'Video-based age and gender recognition in mobile applications'.

Modern neural networks detect gender on videos with a 90% accuracy. The situation with age prediction is much more complicated. Traditional neural networks consider discrete values of age, e.g., range between 1 and 100 years. In each of the video frames, the network estimates the probability of the person in the image being of a certain age. For example, if in 30% of the frames the top prediction of the network is a person's age as 21 years, and in 10% as 60 years, its conclusion will be as follows: with a probability of 30% this person is 21, and with a probability of 10%, he or she is 60. Due to various conditions of observations or even slight head rotation, prediction of the same person's age in different video frames varies in the range of 5 years, plus or minus.

A team of HSE experts in computer vision headed by Professor Andrey Savchenko has found a way to optimize neural networks' operations. Experiments on several video datasets have proven that their technology allows for implementation of today's most accurate algorithms of gender and age recognition on video as compared to such popular convolutional neural networks as VGGFace, VGGFace2, Light CNN, DEX, and age_net/gender_net.

Researchers have implemented a novel method to aggregate confidence levels produced by the neural network for each frame based on mathematical statistics and Dempster-Shafer theory. The software systems of facial recognition analysis usually include several separate neural networks. One of them identifies the person, another one determines the gender, etc. An effective neural network with several outputs has been developed. It solves several tasks at a time: predicts age and gender, and produces a set of 1,000 numbers (attribute vector) that uniquely attribute each person and allows them to be distinguished from other people. According to researchers, this solution will work even on low-performance smartphones.

As of today, the researchers have scaled the solutions for Android mobile apps. The neural network collects information on a user's circle of acquaintanceship, family composition, and the age and gender of their closest contacts. The system works offline, processing photos and videos from teh gallery on the user's device. This is what distinguishes it from similar developments that analyse social media profiles and comments, such as on Instagram.

These data may be used by the smartphone manufacturer to create various recommendation systems. For example, if a user has a considerable amount of content with a toddler, he or she would be offered an advertisement for a children's store. If they have a lot of friends in photos taken on certain days, the smartphone will suggest a restaurant for a party. This technology has already attracted interest of the biggest smartphone manufacturer.

'A gadget is a short-distance sprinter, since its battery quickly depletes. That is why it is important to make sure the smartphone with this app works quickly and consumes less power. To avoid wasting time and battery charge, we use our efficient convolutional neural network to analyse the images, explains Professor Savchenko. We also pay a lot of attention to privacy: processing is done only on the user's smartphone in offline mode. The phone does not send the photos and videos to a remote server, and the data can't be seen and analysed by third parties. The server does not receive the images, but a ready-made profile with demographic and social data. For example, most often, your photos feature four women and two men, and you also like going to McDonald's. This helps in delivering advertisements that are of greatest interest to users.'

National Research University Higher School of Economics

Related Smartphone Articles from Brightsurf:

Mobile smartphone technology is associated with better clinical outcomes for OHCA
Mobile smartphone technology can accelerate first responder dispatch and may be instrumental to improving out?of?hospital cardiac arrest (OCHA) survival.

New tool can diagnose strokes with a smartphone
A new tool created by researchers at Penn State and Houston Methodist Hospital could diagnose a stroke based on abnormalities in a patient's speech ability and facial muscular movements, and with the accuracy of an emergency room physician -- all within minutes from an interaction with a smartphone.

App analyzes coronavirus genome on a smartphone
A team led by Garvan's Dr Ira Deveson developed the app 'Genopo' that can analyse the coronavirus genome on a portable Android device.

Smartphone accelerometers could help in resistance workouts and rehabilitation protocols
Smartphone accelerometers are effective tools to measure key time-under-tension indicators of muscle training -- and could help in resistance-based workouts and rehabilitation protocols.

Parents' smartphone use does not harm parent/child relationships
Contrary to popular views, parental smartphone use is rarely associated with poor parenting, and more often than not, tends to be associated with warm and attached parenting.

The effects of smartphone use on parenting
Parents may worry that spending time on their smartphones has a negative impact on their relationships with their children.

Inexpensive retinal diagnostics via smartphone
Retinal damage due to diabetes is now considered the most common cause of blindness in working-age adults.

Nanosensor can alert a smartphone when plants are stressed
MIT engineers can closely track how plants respond to stresses such as injury, infection, and light damage using sensors made of carbon nanotubes.

Smartphone apps not accurate enough to spot all skin cancers
Smartphone apps that assess the risk of suspicious moles cannot be relied upon to detect all cases of skin cancer, finds a review of the evidence published by The BMJ today.

Detecting mental and physical stress via smartphone
The team led by Professor Enrico Caiani of the Department of Electronics, Information and Bioengineering at Politecnico di Milano, Italy, has shown that it is possible to use our smartphones without any other peripherals or wearables to accurately extract vital parameters, such as heart beat rate and stress level.

Read More: Smartphone News and Smartphone Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to