Nav: Home

Disney Research's algorithm finds best places to put cameras for 3-D reconstructions

September 28, 2015

An online algorithm devised by Disney Research enables filmmakers to determine the optimal number and location of cameras for capturing a given scene, enabling them to amass the data that they increasingly want and need during post-production.

With sufficient information about the billions of light rays emanating from a scene, for instance, filmmakers can use computational techniques to relight the set virtually, to generate new viewpoints and to digitally recover the detailed 3-D shapes and layout of a scene, or even of an actor's face.

But knowing where to place cameras can be tricky, said Changil Kim, a Ph.D. student in computer graphics at Disney Research and ETH Zurich. If cameras are few and far between, the chances that a location will be blocked by an object in the foreground are increased. And if cameras are too close together, the differences in successive views can become too tiny to provide any value or useful information.

"To solve this, we focused on the problem of automatic online view-sampling, where each new view results in the best possible additional shape reconstruction incrementally," Kim said. At each iteration, the algorithm he and his colleagues developed adds a camera view and calculates a depth map of a scene; this process continues until the last camera view added results in a negligible improvement.

If there is a limit on the number of cameras available, the algorithm can stop at that number, providing an optimal spacing and placement of that number of cameras.

The Disney researchers presented their findings at the International Conference on Image Processing (ICIP 2015) in Quebec City. Conference organizers have recognized their report as among the top 10 percent of papers being presented this year.

The researchers compared their new method with regular sampling on both synthetic and real scenes and showed they could recover high quality detail with fewer than half the number of cameras required for regular sampling.

"Our online sampling analysis considers the statistics of the very scene being captured and thus results in a significant win over dense, arbitrarily or regularly placed cameras," said Kenny Mitchell, a senior research scientist at Disney Research.
-end-
In addition to Kim and Mitchell, the research team included Alexander Sorkine-Hornung and Markus Gross of Disney Research and Kartic Subr of Heriot-Watt University in Edinburgh, Scotland. For more information about the project, visit the project page at: http://www.disneyresearch.com/publication/online-view-sampling/

This research is part of a collaborative project including teams from Industrial Light and Magic in London and Vicon Motion Systems in Oxford and is partly supported by Innovate UK. The project, Real-Time Digital Acting, seeks to improve the competitiveness of the United Kingdom's computer graphics industry by revolutionizing production pipelines for films and video games.

About Disney Research


Disney Research is a network of research laboratories supporting The Walt Disney Company. Its purpose is to pursue scientific and technological innovation to advance the company's broad media and entertainment efforts. Vice Presidents Jessica Hodgins and Markus Gross manage Disney Research facilities in Los Angeles, Pittsburgh, Zürich, and Boston and work closely with the Pixar and ILM research groups in the San Francisco Bay Area. Research topics include computer graphics, animation, video processing, computer vision, robotics, wireless & mobile computing, human-computer interaction, displays, behavioral economics, and machine learning.

Disney Research

Related Algorithm Articles:

Algorithm personalizes which cancer mutations are best targets for immunotherapy
As tumor cells multiply, they often spawn tens of thousands of genetic mutations.
Universal algorithm set to boost microscopes
EPFL scientists have developed an algorithm that can determine whether a super-resolution microscope is operating at maximum resolution based on a single image.
Algorithm designed to map universe, solve mysteries
Cornell University researchers have developed an algorithm designed to visualize models of the universe in order to solve some of physics' greatest mysteries.
Algorithm tells robots where nearby humans are headed
A new tool for predicting a person's movement trajectory may help humans and robots work together in close proximity.
Algorithm to transform investment banking with higher returns
A University of Bath researcher has created an algorithm which aims to remove the elements of chance, bias or emotion from investment banking decisions, a development which has the potential to reduce errors in financial decision making and improve financial returns in global markets.
Algorithm provides customized caffeine strategy for alertness
A web-based caffeine optimization tool successfully designs effective strategies to maximize alertness while avoiding excessive caffeine consumption, according to preliminary results from a new study.
New algorithm optimizes quantum computing problem-solving
Tohoku University researchers have developed an algorithm that enhances the ability of a Canadian-designed quantum computer to more efficiently find the best solution for complicated problems, according to a study published in the journal Scientific Reports.
Machine learning algorithm helps in the search for new drugs
Researchers have designed a machine learning algorithm for drug discovery which has been shown to be twice as efficient as the industry standard, which could accelerate the process of developing new treatments for disease.
Researchers create algorithm to predict PEDV outbreaks
Researchers from North Carolina State University have developed an algorithm that could give pig farms advance notice of porcine epidemic diarrhea virus (PEDV) outbreaks.
New algorithm provides a more detailed look at urban heat islands
Urban areas are warmer than the adjacent undeveloped land, a phenomenon known as the urban heat island effect.
More Algorithm News and Algorithm Current Events

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Rethinking Anger
Anger is universal and complex: it can be quiet, festering, justified, vengeful, and destructive. This hour, TED speakers explore the many sides of anger, why we need it, and who's allowed to feel it. Guests include psychologists Ryan Martin and Russell Kolts, writer Soraya Chemaly, former talk radio host Lisa Fritsch, and business professor Dan Moshavi.
Now Playing: Science for the People

#538 Nobels and Astrophysics
This week we start with this year's physics Nobel Prize awarded to Jim Peebles, Michel Mayor, and Didier Queloz and finish with a discussion of the Nobel Prizes as a way to award and highlight important science. Are they still relevant? When science breakthroughs are built on the backs of hundreds -- and sometimes thousands -- of people's hard work, how do you pick just three to highlight? Join host Rachelle Saunders and astrophysicist, author, and science communicator Ethan Siegel for their chat about astrophysics and Nobel Prizes.