Nav: Home

About faces: geometric style of portrait artwork

June 05, 2019

A team of computer scientists at the Interdisciplinary Center in Israel have developed an innovative method to automatically analyze artistic portraiture, capturing a high level of detail and accuracy of the portraits as well as the artists' individual style. Focused on devising a computational method to detect facial features in artwork, or facial landmarks such as eye corners or mouth corners, the researchers have successfully extended work done in photographs of natural face images to the artistic portraiture field.

"Because there is no training data of portrait paintings that contain facial landmarks, our key idea was to create such data using what we call 'artistic augmentation,'" says Professor Ariel Shamir, lead author of the study and dean of the Efi Arazi School of Computer Science at the Interdisciplinary Center Herzliya. "We transform photographic face data to be more similar to artistic portraits and use it to train new models for neural networks that work better for artistic inputs. By using our models, we not only gained better precision on portraits, but we also did not lose much accuracy on natural faces."

Shamir, along with his students Jordan Yaniv and Yael Newman, are set to present their work at SIGGRAPH 2019, held 28 July-1 August in Los Angeles. This annual gathering showcases the world's leading professionals, academics, and creative minds at the forefront of computer graphics and interactive techniques.

Landmark Points Guide the Style

The key differences between artistic portraits and natural facial images are twofold: texture appearance differences and geometric differences. Past work in this research area primarily focused on capturing the appearance style of art, and not the geometric style. With artistic portraits, geometric style is imperative, note the authors of the study, but challenging to capture since every artist has their own creative, distinct style.

"For example, the Italian painter Clemente Modigliani is known for painting elongated faces, and the American painter Margaret Keane is known for painting faces with very big, exaggerated eyes," says Shamir. "Our work allows computers and algorithms to reveal this information and recognize this aspect of geometric style in portrait paintings."

To capture geometric styles in portraits, there is a need to recognize the facial features and the structure of the face in the painting. To this end, the researchers' method concentrates on detecting facial features in the artwork, using landmark points on the face. Depending on the artist's style, these features can be diverse in shape and exaggerated, not resembling real human faces. To overcome this challenge, they apply a known method called "augmentation" of natural face images, transforming photographs of natural facial images to be more similar to "artistic" portraits, and train neural networks to detect the landmark points.

The researchers evaluated their landmark detection method by creating a dataset of artistic faces containing 160 artistic portraits by 16 different artists of various genres and styles, with large variations in both geometry and texture. In the paper outlining their work, they also demonstrate several applications for artistic facial feature detection and geometric style analysis. These include understanding the style of specific artists, comparing styles of different artists, and following possible trends of artistic styles. Another popular application is style-transfer: where one can transform a given input picture of a face to a painting in the style of a given artist in both texture and geometry.

In future work, the team hopes to use the geometric style signature to build classifiers that can recognize a specific artist and expand the definition of geometric style beyond faces - a current challenge in computer graphics and art.
-end-
To read the team's full paper, "The Face of Art: Landmark Detection and Geometric Style in Portraits," and for more details, visit http://www.faculty.idc.ac.il/arik/site/faceofArt.asp.

About ACM, ACM SIGGRAPH, and SIGGRAPH 2019

ACM, the Association for Computing Machinery, is the world's largest educational and scientific computing society, uniting educators, researchers, and professionals to inspire dialogue, share resources, and address the field's challenges. ACM SIGGRAPH is a special interest group within ACM that serves as an interdisciplinary community where researchers, artists, and technologists collide to progress applications in computer graphics and interactive techniques. The SIGGRAPH conference is the world's leading annual interdisciplinary educational experience for inspiring transformative advancements across the disciplines of computer graphics and interactive techniques. SIGGRAPH 2019, the 46th annual conference hosted by ACM SIGGRAPH, will take place from 28 July-1 August at the Los Angeles Convention Center.

To register for SIGGRAPH 2019 and hear from the authors themselves, visit s2019.siggraph.org/register.

Association for Computing Machinery

Related Neural Networks Articles:

Kazan University chemists teach neural networks to predict properties of compounds
The international team works on a computational model able to predict the properties of new molecules based on the analysis of fundamental chemical laws.
All-optical diffractive neural networks process broadband light
Developed by researchers at UCLA, diffractive optical networks provide a low power, low latency and highly-scalable machine learning platform that can find numerous applications in robotics, autonomous vehicles, defense industry, among many others.
Neural compass
Harvard Medical School neuroscientists have decoded how visual cues can rapidly reorganize the activity of compass neurons in fruit flies to maintain an accurate sense of direction.
Deep neural networks speed up weather and climate models
A team of environmental and computation scientists at the US Department of Energy's (DOE) Argonne National Laboratory are collaborating to use deep neural networks, a type of machine learning, to replace the parameterizations of certain physical schemes in the Weather Research and Forecasting Model, an extremely comprehensive model that simulates the evolution of many aspects of the physical world around us.
Deep neural networks uncover what the brain likes to see
Researchers built deep artificial neural networks that can accurately predict the neural responses produced by a biological brain to arbitrary visual stimuli.
Agriculture of the future: Neural networks have learned to predict plant growth
Scientists from Skoltech have trained neural networks to evaluate and predict the plant growth pattern taking into account the main influencing factors and propose the optimal ratio between the nutrient requirements and other growth-driving parameters.
Researchers make neural networks successfully detect DNA damage caused by UV radiation
Researchers of Tomsk Polytechnic University jointly with the University of Chemistry and Technology (Prague) conducted a series of experiments, which proved that artificial neural networks can accurately identify DNA damages caused by UV radiation.
All-optical diffractive neural network closes performance gap with electronic neural networks
A new paper in Advanced Photonics, an open-access journal co-published by SPIE, the international society for optics and photonics, and Chinese Laser Press (CLP), demonstrates distinct improvements to the inference and generalization performance of diffractive optical neural networks.
Neural networks will help manufacture carbon nanotubes
A team of scientists from Skoltech's Laboratory of Nanomaterials proposed a neural-network-based method for monitoring the growth of carbon nanotubes, preparing the ground for a new generation of sophisticated electronic devices.
Simulating quantum systems with neural networks
A new computational method, based on neural networks, can simulate open quantum systems with unprecedented versatility.
More Neural Networks News and Neural Networks Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Uncharted
There's so much we've yet to explore–from outer space to the deep ocean to our own brains. This hour, Manoush goes on a journey through those uncharted places, led by TED Science Curator David Biello.
Now Playing: Science for the People

#556 The Power of Friendship
It's 2020 and times are tough. Maybe some of us are learning about social distancing the hard way. Maybe we just are all a little anxious. No matter what, we could probably use a friend. But what is a friend, exactly? And why do we need them so much? This week host Bethany Brookshire speaks with Lydia Denworth, author of the new book "Friendship: The Evolution, Biology, and Extraordinary Power of Life's Fundamental Bond". This episode is hosted by Bethany Brookshire, science writer from Science News.
Now Playing: Radiolab

Dispatch 1: Numbers
In a recent Radiolab group huddle, with coronavirus unraveling around us, the team found themselves grappling with all the numbers connected to COVID-19. Our new found 6 foot bubbles of personal space. Three percent mortality rate (or 1, or 2, or 4). 7,000 cases (now, much much more). So in the wake of that meeting, we reflect on the onslaught of numbers - what they reveal, and what they hide.  Support Radiolab today at Radiolab.org/donate.