Creating animated characters outdoors

February 24, 2014

So far, film studios have had to put in huge amounts of effort to set monsters, superheroes, fairies or other virtual characters into real feature film scenes. Within the so-called motion capturing process, real actors wear skintight suits with markers on them. These suits reflect infrared light that is emitted and captured by special cameras. Subsequent to this, the movements of the actors are rendered with the aid of software into animated characters. The most popular example of this is "Gollum" from the film Lord of the Rings, played by Andy Serkis.

Nils Hasler and Carsten Stoll, two researchers from the Max Planck Institute for Informatics in Saarbruecken, developed a method that works without markers. It immediately transfers actors' movements to the virtual characters in near real-time. They presented their technology for the first time at the Cebit in 2013. The researchers used the last few months to improve their technology. "We made it more user-friendly", explains Nils Hasler. "Now it is possible to film the movie scenes outdoors and not only in the studio." For example, movie scenes like those from Lord of the Rings, where Gollum has to wander through the mountainous landscape of Middle Earth, wouldn't need to be produced in the studio any longer, but could actually get filmed in the landscape where the scene takes place.

Moreover, the researchers dealt with the task of transferring the movements of two actors at the same time into two animated characters. "But the software needs a little bit more computing time to deal with two persons", explains Carsten Stoll. Moreover, the technique makes it possible to imitate entire tracking shots. The movements of one character can thus be more easily captured from every angle.

Together with Christian Theobalt, leader of the research group "Graphics, Vision & Video" at the Max Planck Institute for Informatics, they could solve another problem: with their method, they can display people in full even if they had been partly obscured by other characters in a movie scene. This novel approach is not only interesting for the film and gaming industry. Sports journalists could better comment on movement sequences during a live boxing match or judo coaches could use it to analyze the fighting techniques of their athletes immediately. "Company doctors and physiotherapists could also use the technique to prevent, for example, back pain issues for company staff, or to optimize work processes".

To commercialize their technology, Hasler and colleagues founded the company "The Captury" in last June. At the same, they are already working on first requests from industry. The researchers also won the main award within the IKT founder competition that is announced yearly by the Federal Ministry of Economy and Energy and includes the prize of 30,000 Euro.
The researcher will present their approach from the 12th through the 14th of March at the computer fair trade Cebit in Hanover at the booth of the Federal Ministry of Economy (hall 9, booth E24).

Technical background:

For their method, the computer scientists use relatively cheap technology. Eight small video cameras (each 3 cm in height, width and depth) are necessary. With the aid of their software, they create a 3D model of the captured actor from a movement skeleton with 58 joints. To capture the movements, the algorithm works in such a way that the two-dimensional image from the video camera and the 3D model should overlap each other precisely. The computer scientists managed to solve the necessary comparisons in an efficient and quick way through a mathematical approach. In doing so, they are able to capture the filmed movements and present them within milliseconds as if done by a virtual character.

Background information about the computer science research at Saarland University in Saarbruecken

The Department of Computer Science is at the center of the computer science research in Saarbruecken. Seven other worldwide renowned research institutes are close by: The Max Planck Institutes for Informatics and for Software Systems, the German Research Center for Artificial Intelligence (DFKI), the Center for Bioinformatics, the Intel Visual Computing Institute, the Center for IT Security, Privacy and Accountability (CISPA) and the Cluster of Excellence "Multimodal Computing and Interaction".

Press pictures are available here:

More information:

A short video is available here:

Questions can be addressed to:

Dr. Nils Hasler
Graphics, Vision & Video
Max Planck Institute for Informatics
Phone: +49 (0)681 / 9325-4044
Email: hasler(at)

Dr. Carsten Stoll
Graphics, Vision & Video
Max Planck Institute for Informatics
Phone: +49 (0)681 / 9325-4044
Email: stoll(at)


Gordon Bolduan
Science Communication
Competence Center Computer Science Saarland
Email: bolduan(at)
Tel: +49 (0)681 302 70741

Saarland University

Related Technology Articles from Brightsurf:

December issue SLAS Technology features 'advances in technology to address COVID-19'
The December issue of SLAS Technology is a special collection featuring the cover article, ''Advances in Technology to Address COVID-19'' by editors Edward Kai-Hua Chow, Ph.D., (National University of Singapore), Pak Kin Wong, Ph.D., (The Pennsylvania State University, PA, USA) and Xianting Ding, Ph.D., (Shanghai Jiao Tong University, Shanghai, China).

October issue SLAS Technology now available
The October issue of SLAS Technology features the cover article, 'Role of Digital Microfl-uidics in Enabling Access to Laboratory Automation and Making Biology Programmable' by Varun B.

Robot technology for everyone or only for the average person?
Robot technology is being used more and more in health rehabilitation and in working life.

Novel biomarker technology for cancer diagnostics
A new way of identifying cancer biomarkers has been developed by researchers at Lund University in Sweden.

Technology innovation for neurology
TU Graz researcher Francesco Greco has developed ultra-light tattoo electrodes that are hardly noticeable on the skin and make long-term measurements of brain activity cheaper and easier.

April's SLAS Technology is now available
April's Edition of SLAS Technology Features Cover Article, 'CURATE.AI: Optimizing Personalized Medicine with Artificial Intelligence'.

Technology in higher education: learning with it instead of from it
Technology has shifted the way that professors teach students in higher education.

Post-lithium technology
Next-generation batteries will probably see the replacement of lithium ions by more abundant and environmentally benign alkali metal or multivalent ions.

Rethinking the role of technology in the classroom
Introducing tablets and laptops to the classroom has certain educational virtues, according to Annahita Ball, an assistant professor in the University at Buffalo School of Social Work, but her research suggests that tech has its limitations as well.

The science and technology of FAST
The Five hundred-meter Aperture Spherical radio Telescope (FAST), located in a radio quiet zone, with the targets (e.g., radio pulsars and neutron stars, galactic and extragalactic 21-cm HI emission).

Read More: Technology News and Technology Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to