Nav: Home

Scientists teach the neural network to carry out video facial recognition -- using a single photo

July 05, 2018

Researchers at the Higher School of Economics have proposed a new method of recognizing people on video with the help of a deep neural network. The approach does not require a large number of photographs and it has a significantly higher recognition accuracy compared to already existing methods - even if only one photo of a person is available. The results of the work have been published in the articles 'Fuzzy Analysis and Deep Convolution Neural Networks in Still-to-Video Recognition' and 'Unconstrained Face Identification Using Maximum Likelihood of Distances Between Deep Off- the-shelf Features,'

Facial recognition technologies have been developing rapidly over the past few years. These technologies, for the verification and identification of individuals, are used in a variety of areas, from law enforcement agencies in the fight against terrorism to social networks and mobile applications. Research groups at international corporations and leading world universities are continuously experimenting with data and the instruments themselves in order to increase recognition accuracy.

Recognition can take place in many ways, but the best results have recently been achieved with the help of high-precision neural networks. The more training images are presented to the neural network, the better this process will work. The network extracts key facial features and then uses this knowledge when recognizing unknown images.

Now, there is easy access to more and more datasets of photos and these are used to train the neural network. For constraint environment of observation (photos with the same face orientation, illumination, etc.), the accuracy of the algorithms has long since reached the human level of ability to recognize faces. However, achieving high accuracy when recognizing video data that is collected under unconstrained conditions with variable illumination, rotation and size, is much more of a challenge for researchers.

'The network can recognize a well-known actor with 100% accuracy, becausethe number of available images of the actor is estimated to be in the millions). However, this does not mean that, with the transfer of knowledge accumulated in a neural network, it can adapt and recognize a person of whom only single photo is available as a training sample,' explains Professor Savchenko from the Department of Information Systems and Technologies, HSE University, Nizhny Novgorod.

In order to solve this problem, researchers from the Higher School of Economics (HSE) used the theory of fuzzy sets and probability theory to develop a video recognition algorithm. This algorithm significantly improves the accuracy (by 2-6% compared to earlier experiments) of identifying faces by video in real time with a small number of images for several well-known neural network architectures, such as VGGFace, VGGFace2, ResFace and LightCNN.

As a test database, researchers from the HSE used traditional datasets to evaluate facial recognition methods on video: IJB-A (IARPA Janus Benchmark A) and YTF (YouTube Faces). These sets include freely available images of famous people (actors, politicians, public figures), gathered from open sources in unconstrained environment at different times. In the most complex experiment, the developed algorithm was used to recognize people on video from YouTube using several photographs of the same people from another LFW (Labeled Faces in the Wild) dataset, which used a higher resolution. The photos themselves were taken in different places at various times (from the 1970s to the 2010s).

The essence of this new approach is to use information on how the reference photos are related, namely how close or far apart they are. The connection (that is, the distance in the mathematical model) between similar individuals is smaller, and between dissimilar individuals - greater. Knowing to what degree people differ from each other enables the system to correct errors in the process of recognizing video frames.

'The algorithm estimates to what degree one frame is closer to one person, and to what degree the other frame is closer to the next person. Then it compares how similar the training still photos of these two people are to each other. It then adds the third person to the mix and evaluates to whom they are more similar - the first or second. It then corrects recognition errors,' explains Professor Savchenko.

This algorithm is already implemented in Python for stationary computers, which enables the user to find and group the faces of different people in photo/video albums and to estimate a person's year of birth, gender and other parameters. An Android application prototype has also been developed which determines the age and gender of people in photos and videos. Analysis of the photo gallery enables the automatic assessment of the degree of social activity of the user and identifies the user's close friends and relatives. For modern smartphones, the application prototype processes 15 frames per second. According to researchers, thanks to their approach, facial recognition can be carried out with higher accuracy.

National Research University Higher School of Economics

Related Facial Recognition Articles:

Facial recognition technique could improve hail forecasts
The same artificial intelligence technique typically used in facial recognition systems could help improve prediction of hailstorms and their severity, according to a new study from the National Center for Atmospheric Research (NCAR).
Using facial recognition technology to continuously monitor patient safety in the ICU
A team of Japanese scientists has used facial recognition technology to develop an automated system that can predict when patients in the intensive care unit (ICU) are at high risk of unsafe behaviour such as accidentally removing their breathing tube, with moderate (75%) accuracy.
Half a face enough for recognition technology
Facial recognition technology works even when only half a face is visible, researchers from the University of Bradford have found.
Bacteria use their enemy -- phage -- for 'self-recognition'
Scientists discovered that cells can distinguish themselves from closely related competitors through the use of a virus, and the harboring of phage in bacterial genomes benefits host cells when facing competitors in the environment.
Facial recognition software to identify Civil War soldiers
Photo Sleuth may help uncover the mysteries of nearly 4 million photographs of Civil War-era images.
New legislation needed to regulate police facial recognition technology
Facial recognition technology, being trialled by two major police forces in Britain, should be subjected to more rigorous testing and transparency, according to new research from the University of East Anglia (UEA) and Monash University.
Facial Asymmetry Increases with Age
Asymmetry between the two sides of the face increases steadily with aging -- a finding with important implications for facial rejuvenation and reconstructive procedures, reports a study in the November issue of Plastic and Reconstructive Surgery®, the official medical journal of the American Society of Plastic Surgeons (ASPS). 
Cosmetically smoothing over visible facial scars
A novel cosmetic product, designed to fill small to moderate facial scars, has shown promise in covering such deformities in a small group of patients.
Scientists teach the neural network to carry out video facial recognition -- using a single photo
Researchers at the Higher School of Economics have proposed a new method of recognizing people on video with the help of a deep neural network.
The language of facial expressions
University of Miami Psychology Professor Daniel Messinger collaborated with researchers at Western University in Canada to show that our brains are pre-wired to perceive wrinkles around the eyes as conveying more intense and sincere emotions.
More Facial Recognition News and Facial Recognition Current Events

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Rethinking Anger
Anger is universal and complex: it can be quiet, festering, justified, vengeful, and destructive. This hour, TED speakers explore the many sides of anger, why we need it, and who's allowed to feel it. Guests include psychologists Ryan Martin and Russell Kolts, writer Soraya Chemaly, former talk radio host Lisa Fritsch, and business professor Dan Moshavi.
Now Playing: Science for the People

#538 Nobels and Astrophysics
This week we start with this year's physics Nobel Prize awarded to Jim Peebles, Michel Mayor, and Didier Queloz and finish with a discussion of the Nobel Prizes as a way to award and highlight important science. Are they still relevant? When science breakthroughs are built on the backs of hundreds -- and sometimes thousands -- of people's hard work, how do you pick just three to highlight? Join host Rachelle Saunders and astrophysicist, author, and science communicator Ethan Siegel for their chat about astrophysics and Nobel Prizes.