Wrinkles and all: Hi-res eyelid reconstruction makes digital doubles look more realistic

August 05, 2015

Little details, such as the wrinkling or twitching of an eyelid, can have a big impact on whether a digitally rendered face looks real in a film or videogame. Now scientists at Disney Research have devised the first method to capture these subtleties of the eyelids in detail.

Their method, to be presented at ACM SIGGRAPH 2015, the International Conference on Computer Graphics and Interactive Techniques, in Los Angeles Aug. 9-13, captures detailed, dynamic skin features and creates plausible folding and stretching in areas that aren't directly captured during data collection.

Artists have always recognized that the eyes are a key feature for conveying emotion and even their subtle motions can contribute to the realism of a face. But despite tremendous progress in facial scanning, performance capture and skin rendering in recent years, creating photorealistic actors for films has required highly skilled artists to manually recreate eyelid movements.

"The eyelids are extremely challenging for digital scanning and reconstruction," said Thabo Beeler, a research scientist at Disney Research. "The skin rolls and folds inward when the eye opens and stretches over the eyeball when the eye is shut," he explained. Eyelashes can block large segments of the eyelids or cast shadows. "Even worse, in many facial expressions, a significant part of the eyelid is folded in and not visible at all."

Beeler, along with Amit Bermano, Yeara Kozlov, Derek Bradley, Bernd Bickel and Markus Gross, tackled the problem by first creating a geometric deformation model of the eyelid. Based on the physiological behavior of the eye-skin interface, this model provides plausible motions for the inevitable instances when eyelids are not fully visible on the original human actor.

This model is then personalized with image-based data. The team observed that wrinkles, in particular, can greatly change the folding of the eyelids - resulting in differences not only from person to person, but also between the left and the right eyelids.

"Eyelids are extremely unique and can produce extremely different wrinkles," Bermano noted. Their method therefore focuses on accurately determining the location of wrinkles from images and then predicting how the location and shape of the wrinkles will change based not only on the current state of the eye region, but also its history.

The method can be used with a variety of motion capture techniques, including the Medusa Performance Capture System developed by Disney Research, the researchers said.

"The ability to accurately capture eyelids can be a great addition to Medusa, which already has been used to create realistic digital doubles for several feature films," Bradley said.
For more information and a video, visit the project webpage at http://www.disneyresearch.com/publication/eyelidreconstruction/.

About Disney Research

Disney Research is a network of research laboratories supporting The Walt Disney Company. Its purpose is to pursue scientific and technological innovation to advance the company's broad media and entertainment efforts. Vice Presidents Jessica Hodgins and Markus Gross manage Disney Research facilities in Los Angeles, Pittsburgh, Zürich, and Boston and work closely with the Pixar and ILM research groups in the San Francisco Bay Area. Research topics include computer graphics, animation, video processing, computer vision, robotics, wireless & mobile computing, human-computer interaction, displays, behavioral economics, and machine learning.

Disney Research

Related Wrinkles Articles from Brightsurf:

The benefits of slowness
Wrinkles, furrows, spots: a person's aging process is accompanied by tell-tale signs on their face.

Scientists iron out the physics of wrinkling
In a paper recently published in Applied Physics Letters, researchers from the Okinawa Institute of Science and Technology Graduate University (OIST) have shown how wrinkles can be increased or reduced by altering the curvature at the edge of a material.

Study shows biocell collagen ingestion reduced signs of UVB-induced photoaging
New research finds BioCell Collagen Ingestion to reduce signs of UVB-Induced photoaging, which accounts for a significant amount of visible skin damage.

Mechanical forces shape bacterial biofilms' puzzling patterns
Belying their slimy natures, the sticky patches of bacteria called biofilms often form intricate, starburst-like patterns as they grow.

Express yourself: Dermal fillers restore youthful facial movement, don't just fill wrinkles
Used for facial rejuvenation, dermal fillers do more than just fill in wrinkles.

WSU genetic discovery holds implications for better immunity, longer life
Wrinkles on the skin of a microscopic worm might provide the key to a longer, healthier life for humans.

New silk materials can wrinkle into detailed patterns, then unwrinkle to be 'reprinted'
Tufts engineers have developed silk materials that can wrinkle into highly detailed patterns -- including words, textures and images as intricate as a QR code or a fingerprint.

Smoothing wrinkles in mice -- without needles
In the quest for a more youthful appearance, many people slather ointments on their skin or undergo injections of dermal fillers.

Study shows BioCell collagen can visibly reduce common signs of skin aging within 12 weeks
In one of the most substantial studies of a skin health supplement, BioCell Collagen®, was found to visibly reduce common signs of skin aging, including lines and wrinkles, within 12 weeks of daily use.

Puzzling shapes: Unlocking the mysteries of plant cell morphology
The discovery of the mechanics and molecular mechanism that dictate cell shape formation in plants by a team of McGill researchers offers new clues about the fundamental processes governing tissue formation in multicellular organisms.

Read More: Wrinkles News and Wrinkles Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.