Using mobile devices to augment reality can enhance creative play and exploration

November 09, 2015

A child need not choose between the immersive, but often passive world of digital media or the physical interaction of real-world games and activities. Scientists at Disney Research say augmented reality with mobile devices serves as the perfect bridge between the two and can enhance creativity in the process.

To demonstrate their concept, called Augmented Creativity, Disney researchers have developed several prototype apps that add computer-generated animation, sound and visuals to such activities as coloring books, scavenger hunts and team games that require physical interaction.

"Exploring the world and new activities is what childhood is all about," said Markus Gross, vice president at Disney Research. "Our research brings the seamless fusion of the real and virtual world together with an intelligent and creative gameplay. We believe that these concepts offer exciting virtual enhancements over real-world interactions."

The researchers presented their Augmented Creativity concept and related apps at the Symposium on Mobile Graphics and Interactive Applications.

"We have been able to use the power and popularity of mobile devices to direct renewed emphasis on traditional activities of creative play," said Robert W. Sumner, principal research scientist. "One of our most compelling prototypes is an augmented-reality musical arrangement app that provides a tangible way for children to explore different music styles and arrangements by adding, removing, and re-arranging physical cards that represent different instruments and styles."

Another app, based on coloring, allows children to customize 3-D animated characters simply by coloring them as they normally would in a coloring book."

In a prototype for a multi-player game, players each use a mobile tablet to track a virtual object as they move around and talk with each other to cooperatively frustrate an invading alien force. They also developed a city-wide gaming framework, enabling the development of games such as scavenger hunts that get players outdoors, searching for interactive elements superimposed on buildings, parks and roads.

But Augmented Creativity isn't just about play. The researchers created a framework to help users write interactive narratives - a trickier task than standard storytelling because it requires the user to define and implement all possible interactions that someone might experience within the narrative. Another app helps children grasp the concept of programming robots; the child can program the robot to perform certain behaviors and then use augmented reality to see not just how the robot behaves, but exactly how the program is being executed.

"Augmented reality can help children develop a deeper understanding of programming by making the dynamics of program execution visible," Sumner said. "And it opens up new opportunities in gaming, by making it possible to create new classes of games that include user-programmed characters."

In addition to Gross and Sumner, the research team included Fabio Zünd of ETH Zurich, Mattia Ryffel, Stéphane Magnenat, Alessia Marra, Maurizio Nitti, Gioacchino Noris and Kenny Mitchell of Disney Research, and Mubbasir Kapadia of Rutgers University. For more information, including a video, please visit the project web site at http://www.disneyresearch.com/publication/augmented-creativity/.
-end-
About Disney Research

Disney Research is a network of research laboratories supporting The Walt Disney Company. Its purpose is to pursue scientific and technological innovation to advance the company's broad media and entertainment efforts. Vice Presidents Jessica Hodgins and Markus Gross manage Disney Research facilities in Los Angeles, Pittsburgh, Zürich, and Boston and work closely with the Pixar and ILM research groups in the San Francisco Bay Area. Research topics include computer graphics, animation, video processing, computer vision, robotics, wireless & mobile computing, human-computer interaction, displays, behavioral economics, and machine learning.

Disney Research

Related Mobile Devices Articles from Brightsurf:

How mobile apps grab our attention
Aalto University researchers alongside international collaborators have done the first empirical study on how users pay visual attention to mobile app designs.

No association found between exposure to mobile devices and brain volume alterations in adolescents
New study of 2,500 Dutch children is the first to explore the relationship between brain volume and different doses of radiofrequency electromagnetic fields

Mobile devices blur work and personal privacy raising cyber risks, says QUT researcher
Organisations aren't moving quickly enough on cyber security threats linked to the drive toward using personal mobile devices in the workplace, warns a QUT privacy researcher.

Multi-mobile (M2) computing system makes android & iOS apps sharable on multiple devices
Computer scientists at Columbia Engineering have developed a new computing system that enables current, unmodified mobile apps to combine and share multiple devices, including cameras, displays, speakers, microphones, sensors, and GPS, across multiple smartphones and tablets.

The use of mobile phone and the development of new pathologies
Professor Raquel Cantero of the University of Malaga (UMA) has identified a generational change in the use of this finger due to the influence of new technologies.

Mobile devices don't reduce shared family time, study finds
The first study of the impact of digital mobile devices on different aspects of family time in the UK has found that children are spending more time at home with their parents rather than less -- but not in shared activities such as watching TV and eating.

Mobile, instant diagnosis of viruses
In a first for plant virology, a team from CIRAD recently used nanopore technology to sequence the entire genomes of two yam RNA viruses.

Wearable devices and mobile health technology: one step towards better health
With increasing efforts being made to address the current global obesity epidemic, wearable devices and mobile health ('mHealth') technology have emerged as promising tools for promoting physical activity.

Mobile health devices diagnose hidden heart condition in at-risk populations
New research shows wearable mobile health devices improved the rate of diagnosis of a dangerous heart condition called atrial fibrillation.

Ultrasound-firewall for mobile phones
Mobile phones and tablets through so-called audio tracking, can be used by means of ultrasound to unnoticeably track the behaviour of their users: for example, viewing certain videos or staying in specific rooms and places.

Read More: Mobile Devices News and Mobile Devices Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.