Nav: Home

Disney Research's algorithm finds best places to put cameras for 3-D reconstructions

September 28, 2015

An online algorithm devised by Disney Research enables filmmakers to determine the optimal number and location of cameras for capturing a given scene, enabling them to amass the data that they increasingly want and need during post-production.

With sufficient information about the billions of light rays emanating from a scene, for instance, filmmakers can use computational techniques to relight the set virtually, to generate new viewpoints and to digitally recover the detailed 3-D shapes and layout of a scene, or even of an actor's face.

But knowing where to place cameras can be tricky, said Changil Kim, a Ph.D. student in computer graphics at Disney Research and ETH Zurich. If cameras are few and far between, the chances that a location will be blocked by an object in the foreground are increased. And if cameras are too close together, the differences in successive views can become too tiny to provide any value or useful information.

"To solve this, we focused on the problem of automatic online view-sampling, where each new view results in the best possible additional shape reconstruction incrementally," Kim said. At each iteration, the algorithm he and his colleagues developed adds a camera view and calculates a depth map of a scene; this process continues until the last camera view added results in a negligible improvement.

If there is a limit on the number of cameras available, the algorithm can stop at that number, providing an optimal spacing and placement of that number of cameras.

The Disney researchers presented their findings at the International Conference on Image Processing (ICIP 2015) in Quebec City. Conference organizers have recognized their report as among the top 10 percent of papers being presented this year.

The researchers compared their new method with regular sampling on both synthetic and real scenes and showed they could recover high quality detail with fewer than half the number of cameras required for regular sampling.

"Our online sampling analysis considers the statistics of the very scene being captured and thus results in a significant win over dense, arbitrarily or regularly placed cameras," said Kenny Mitchell, a senior research scientist at Disney Research.
-end-
In addition to Kim and Mitchell, the research team included Alexander Sorkine-Hornung and Markus Gross of Disney Research and Kartic Subr of Heriot-Watt University in Edinburgh, Scotland. For more information about the project, visit the project page at: http://www.disneyresearch.com/publication/online-view-sampling/

This research is part of a collaborative project including teams from Industrial Light and Magic in London and Vicon Motion Systems in Oxford and is partly supported by Innovate UK. The project, Real-Time Digital Acting, seeks to improve the competitiveness of the United Kingdom's computer graphics industry by revolutionizing production pipelines for films and video games.

About Disney Research


Disney Research is a network of research laboratories supporting The Walt Disney Company. Its purpose is to pursue scientific and technological innovation to advance the company's broad media and entertainment efforts. Vice Presidents Jessica Hodgins and Markus Gross manage Disney Research facilities in Los Angeles, Pittsburgh, Zürich, and Boston and work closely with the Pixar and ILM research groups in the San Francisco Bay Area. Research topics include computer graphics, animation, video processing, computer vision, robotics, wireless & mobile computing, human-computer interaction, displays, behavioral economics, and machine learning.

Disney Research

Related Algorithm Articles:

Scientists use algorithm to peer through opaque brains
A new algorithm helps scientists record the activity of individual neurons within a volume of brain tissue.
Algorithm generates origami folding patterns for any shape
A new algorithm generates practical paper-folding patterns to produce any 3-D structure.
New algorithm tracks neurons in bendy brain of freely crawling worm
Scientists at Princeton University have developed a new algorithm to track neurons in the brain of the worm Caenorhabditis elegans while it crawls.
Does my algorithm work? There's no shortcut for community detection
Community detection is an important tool for scientists studying networks, but a new paper published in Science Advances calls into question the common practice of using metadata for ground truth validation.
'Cyclops' algorithm spots daily rhythms in cells
Humans, like virtually all other complex organisms on Earth, have adapted to their planet's 24-hour cycle of sunlight and darkness.
An algorithm that knows when you'll get bored with your favorite mobile game
Researchers from the Tokyo-based company Silicon Studio, led by Spanish data scientist África Periáñez, have developed a new algorithm that predicts when a user will leave a mobile game.
Algorithm identified Trump as 'not-married'
Scientists from Russia and Singapore created an algorithm that predicts user marital status with 86% precision using data from three social networks instead of one.
A novel positioning algorithm based on self-adaptive algorithm
Much attention has been paid to the Taylor series expansion (TSE) method these years, which has been extensively used for solving nonlinear equations for its good robustness and accuracy of positioning.
Algorithm can create a bridge between Clinton and Trump supporters
The article that received the best student-paper award in the Tenth International Conference on Web Search and Data Mining (WSDM 2017) builds algorithmic techniques to mitigate the rising polarization by connecting people with opposing views -- and evaluates them on Twitter.
Deep learning algorithm does as well as dermatologists in identifying skin cancer
In hopes of creating better access to medical care, Stanford researchers have trained an algorithm to diagnose skin cancer.

Related Algorithm Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Setbacks
Failure can feel lonely and final. But can we learn from failure, even reframe it, to feel more like a temporary setback? This hour, TED speakers on changing a crushing defeat into a stepping stone. Guests include entrepreneur Leticia Gasca, psychology professor Alison Ledgerwood, astronomer Phil Plait, former professional athlete Charly Haversat, and UPS training manager Jon Bowers.
Now Playing: Science for the People

#524 The Human Network
What does a network of humans look like and how does it work? How does information spread? How do decisions and opinions spread? What gets distorted as it moves through the network and why? This week we dig into the ins and outs of human networks with Matthew Jackson, Professor of Economics at Stanford University and author of the book "The Human Network: How Your Social Position Determines Your Power, Beliefs, and Behaviours".