Carnegie Mellon researchers build time machine to visually explore space and time
April 22, 2011
Time-lapse GigaPans provide new way to access big data
PITTSBURGH-Researchers at Carnegie Mellon University's Robotics Institute have leveraged the latest browser technology to create GigaPan Time Machine, a system that enables viewers to explore gigapixel-scale, high-resolution videos and image sequences by panning or zooming in and out of the images while simultaneously moving back and forth through time.
Viewers, for instance, can use the system to focus in on the details of a booth within a panorama of a carnival midway, but also reverse time to see how the booth was constructed. Or they can watch a group of plants sprout, grow and flower, shifting perspective to watch some plants move wildly as they grow while others get eaten by caterpillars. Or, they can view a computer simulation of the early universe, watching as gravity works across 600 million light-years to condense matter into filaments and finally into stars that can be seen by zooming in for a close up.
"With GigaPan Time Machine, you can simultaneously explore space and time at extremely high resolutions," said Illah Nourbakhsh, associate professor of robotics and head of the CREATE Lab. "Science has always been about narrowing your point of view - selecting a particular experiment or observation that you think might provide insight. But this system enables what we call exhaustive science, capturing huge amounts of data that can then be explored in amazing ways."
The system is an extension of the GigaPan technology developed by the CREATE Lab and NASA, which can capture a mosaic of hundreds or thousands of digital pictures and stitch those frames into a panorama that be interactively explored via computer. To extend GigaPan into the time dimension, image mosaics are repeatedly captured at set intervals, and then stitched across both space and time to create a video in which each frame can be hundreds of millions, or even billions of pixels.
An enabling technology for time-lapse GigaPans is a feature of the HTML5 language that has been incorporated into such browsers as Google's Chrome and Apple's Safari. HTML5, the latest revision of the HyperText Markup Language (HTML) standard that is at the core of the Internet, makes browsers capable of presenting video content without use of plug-ins such as Adobe Flash or Quicktime.
Using HTML5, CREATE Lab computer scientists Randy Sargent, Chris Bartley and Paul Dille developed algorithms and software architecture that make it possible to shift seamlessly from one video portion to another as viewers zoom in and out of Time Machine imagery. To keep bandwidth manageable, the GigaPan site streams only those video fragments that pertain to the segment and/or time frame being viewed.
"We were crashing the browsers early on," Sargent recalled. "We're really pushing the browser technology to the limits."
Guidelines on how individuals can capture time-lapse images using GigaPan cameras are included on the site created for hosting the new imagery's large data files, http://timemachine.gigapan.org.
Sargent explained the CREATE Lab is eager to work with people who want to capture Time Machine imagery with GigaPan, or use the visualization technology for other applications.
Once a Time Machine GigaPan has been created, viewers can annotate and save their explorations of it in the form of video "Time Warps."
Though the time-lapse mode is an extension of the original GigaPan concept, scientists already are applying the visualization techniques to other types of Big Data. Carnegie Mellon's Bruce and Astrid McWilliams Center for Cosmology, for instance, has used it to visualize a simulation of the early universe performed at the Pittsburgh Supercomputing Center by Tiziana Di Matteo, associate professor of physics.
"Simulations are a huge bunch of numbers, ugly numbers," Di Matteo said. "Visualizing even a portion of a simulation requires a huge amount of computing itself." Visualization of these large data sets is crucial to the science, however. "Discoveries often come from just looking at it," she explained.
Rupert Croft, associate professor of physics, said cosmological simulations are so massive that only a segment can be visualized at a time using usual techniques. Yet whatever is happening within that segment is being affected by forces elsewhere in the simulation that cannot be readily accessed. By converting the entire simulation into a time-lapse GigaPan, however, Croft and his Ph.D. student, Yu Feng, were able to create an image that provided both the big picture of what was happening in the early universe and the ability to look in detail at any region of interest.
Using a conventional GigaPan camera, Janet Steven, an assistant professor of biology at Sweet Briar College in Virginia, has created time-lapse imagery of rapid-growing brassicas, known as Wisconsin Fast Plants. "This is such an incredible tool for plant biology," she said. "It gives you the advantage of observing individual plants, groups of plants and parts of plants, all at once."
Steven, who has received GigaPan training through the Fine Outreach for Science program, said time-lapse photography has long been used in biology, but the GigaPan technology makes it possible to observe a number of plants in detail without having separate cameras for each plant. Even as one plant is studied in detail, it's possible to also see what neighboring plants are doing and how that might affect the subject plant, she added.
Steven said creating time-lapse GigaPans of entire landscapes could be a powerful tool for studying seasonal change in plants and ecosystems, an area of increasing interest for understanding climate change. Time-lapse GigaPan imagery of biological experiments also could be an educational tool, allowing students to make independent observations and develop their own hypotheses.
Carnegie Mellon University
Related High-resolution Video Current Events and High-resolution Video News ArticlesNASA Releases IRIS Footage of X-class Flare
On Sept. 10, 2014, NASA's newest solar observatory, the Interface Region Imaging Spectrograph, or IRIS, mission joined other telescopes to witness an X-class flare - an example of one of the strongest solar flares -- on the sun. NASA's RXTE Satellite Decodes the Rhythm of an Unusual Black Hole
Astronomers have uncovered rhythmic pulsations from a rare type of black hole 12 million light-years away by sifting through archival data from NASA's Rossi X-ray Timing Explorer (RXTE) satellite.New Study Reveals the Biomechanics of How Marine Snail Larvae Swim
Equipped with high-speed, high-resolution video, scientists have discovered important new information on how marine snail larvae swim, a key behavior that determines individual dispersal and ultimately, survival.Nanocables light way to the future
Cables made of carbon nanotubes are inching toward electrical conductivities seen in metal wires, and that may light up interest among a range of industries, according to Rice University researchers.Speed installation of system to monitor vital signs of global ocean, scientists urge
The ocean surface is 30 percent more acidic today than it was in 1800, much of that increase occurring in the last 50 years - a rising trend that could both harm coral reefs and profoundly impact tiny shelled plankton at the base of the ocean food web, scientists warn.Brown University-led team discovers how bats avoid collisions
For years, Brown University neuroscientist James Simmons has filmed bats as they flew in packs or individually chased prey in thick foliage. All the while, he asked himself why the bats never collided with objects in their paths or with each other.NYU physicists find way to explore microscopic systems through holographic video
Physicists at New York University have developed a technique to record three-dimensional movies of microscopic systems, such as biological molecules, through holographic video.Seamounts may serve as refuges for deep-sea animals that struggle to survive elsewhere
Over the last two decades, marine biologists have discovered lush forests of deep-sea corals and sponges growing on seamounts (underwater mountains) offshore of the California coast. It has generally been assumed that many of these animals live only on seamounts, and are found nowhere else.
More High-resolution Video Current Events and High-resolution Video News Articles
High-Quality Visual Experience: Creation, Processing and Interactivity of High-Resolution and High-Dimensional Video Signals (Signals and Communication Technology)|
by Marta Mrak (Editor), Mislav Grgic (Editor), Murat Kunt (Editor)
Last few years have seen rapid acceptance of high-definition television (HDTV) technology around the world. This technology has been hugely successful in delivering more realistic television experience at home and accurate imaging for professional applications. Adoption of high definition continues to grow as consumers demand enhanced features and greater quality of content. Following this trend, natural evolution of visualisation technologies will be in the direction of fully realistic visual experience and highly precise imaging. However, using the content of even higher resolution and quality is not straightforward as such videos require significantly higher access bandwidth and more processing power. Therefore, methods for radical reduction of video bandwidth are crucial for...
The Kaguya Lunar Atlas: The Moon in High Resolution|
by Motomaro Shirao (Author), Charles A. Wood (Author)
In late 2007, the Japanese Space Exploration Agency (JAXA) placed the Kaguya/ Selene spacecraft in orbit around the Moon to probe the Moon’s surface and interior. But unlike previous lunar orbiters, Kaguya carries a high definition television camera (HDTV) sent beyond Earth orbit. Sponsored by the Japanese NHK TV network, the HDTV has amazed both scientists and the public with its magnificent views of the lunar surface. What makes these images so much more engaging than standard vertical view lunar photography is that they are taken looking obliquely along the flight path. Thus, they show the Moon as it would be seen by an astronaut looking through a porthole window while orbiting only 100 km above the lunar surface. This is the view we all would wish to have but are never likely to,...
Video Marketing: How To Produce Viral Films And Leverage Facebook, YouTube, Instagram And Twitter To Build A Massive Audience (Content Strategy, Video Marketing, Viral Marketing)|
The Eight-Step Process To Create Viral Films & Leverage Facebook, YouTube, Instagram And Twitter To Build A Massive Audience
Right now, you may have the secret to changing the way people look at your business. If you are looking for new ways to drive traffic to your business, this is the book for you. It may be you want an understanding on how the video marketplace works, and how to improve your current business processes. This book will reveal many great ways to make your business better, and to expand your viewership in short order. Even if all you want to do is develop a working vocabulary of the Viral Video business, this book will meet your needs and expectations.
Inside You Will Learn:
• 8 Simple Steps to creating dynamic video content
• Five best...
High Efficiency Video Coding (HEVC): Algorithms and Architectures (Integrated Circuits and Systems)|
by Vivienne Sze (Editor), Madhukar Budagavi (Editor), Gary J. Sullivan (Editor)
This book provides developers, engineers, researchers and students with detailed knowledge about the High Efficiency Video Coding (HEVC) standard. HEVC is the successor to the widely successful H.264/AVC video compression standard, and it provides around twice as much compression as H.264/AVC for the same level of quality. The applications for HEVC will not only cover the space of the well-known current uses and capabilities of digital video – they will also include the deployment of new services and the delivery of enhanced video quality, such as ultra-high-definition television (UHDTV) and video with higher dynamic range, wider range of representable color, and greater representation precision than what is typically found today. HEVC is the next major generation of video coding design...
Master Handbook of Video Production|
by Jerry Whitaker (Author)
FROM THE EDITOR OF THE STANDARD HANDBOOK OF VIDEO AND TELEVISION ENGINEERING THE ALL-MEDIA GUIDE TO PROFESSIONAL VIDEO PRODUCTION You don't need an engineering degree to succeed in video production. In this book, video expert Jerry Whitaker shows you production from the inside out, from studio lighting to creating post-production special effects. The Art of Video Production Perfect for anyone who wants to build skills in the fast-growing field of digital video production, and produce video for TV, HDTV, movies, the Internet, or any other application, Master Handbook of Video Production shows you how to-
* Select, install, and work with digital equipment
* Understand MPEG video compression
* Design video production centers
* Master standard-definition and...
Video Basics 7|
by Herbert Zettl (Author)
Herbert Zettl draws on his expertise and field experience to bring you the seventh edition of VIDEO BASICS, the handiest and most authoritative, current, and technically accurate student guide to video production available. Meeting the need for a briefer book, this text distills comprehensive video instruction so that it can be covered in a single semester. The book moves students from video concepts and processes to production tools and techniques and, finally, to the production environment (studio and field, inside and outside) and its effects. A more conceptual framework leads students from the idea (what to create) to the image (how to create) on video.
The Knot Ultimate Wedding Planner & Organizer [binder edition]: Worksheets, Checklists, Etiquette, Calendars, and Answers to Frequently Asked Questions|
by Carley Roney (Author)
For the first time, the go-to wedding website, The Knot, has compiled all their essential planning tools—and dozens of new ideas—into this beautiful wedding organizer. Inside you will find:
Detailed timelines and worksheets for scheduling and budgeting
Planning and money-saving tips on everything from the dress to the music to the reception decor
8 tabbed dividers packed with visual inspiration, including more than 100 color photos of centerpieces, table settings, favors, and more
A perforated color swatch page for mixing and matching your own wedding palette
Extensive information on choosing your vendors, including checklists of key questions to ask
Ideas for the twenty-first-century bride, including how to use online tools and...
iTunes Music: Mastering High Resolution Audio Delivery: Produce Great Sounding Music with Mastered for iTunes|
by Bob Katz (Author)
Apple’s exciting new Mastered for iTunes (MFiT) initiative, introduced in early 2012, introduces new possibilities for delivering high-quality audio. For the first time, record labels and program producers are encouraged to deliver audio materials to iTunes in a high resolution format, which can produce better-sounding masters. In iTunes Music, author and world-class mastering engineer Bob Katz starts out with the basics, surveys the recent past, and brings you quickly up to the present―where the current state of digital audio is bleak. Katz explains the evolution of standards for dynamic range through the present and with implications for the future. He details the new methods that Apple is developing to accept high resolution audio and shows step by step how audio engineers and...
High Resolution Video Graphics (Jay Ranade Workstation Series)|
by Julio Sanchez (Author), Maria P. Canton (Author)
For 386, 386SX, and 486 PC power users, this book/disk combination offers detailed programming examples that enhance IBM's XGA graphics capability. It offers a technical tutorial on programming the XGA system using Adapter Interface (AI) software. The 3.5" disk is usable from C, Pascal, BASIC, and Assembler language. Detailed discussions of XGA features and characteristics, including a technical description of XGA architecture and components, are included. Also highlighted are the importance and usefulness of the XGA graphics coprocessor and its advantages in programming the XGA system. Other features include: direct access to XGA hardware; animation techniques; bitblt and sprite operations; a value-added diskette that contains not only code samples, but also an extensive XGA programming...
Jurassic Park: A Novel|
by Michael Crichton (Author)
From the author of Timeline, Sphere, and Congo, this is the classic thriller of science run amok that took the world by storm.
#1 NEW YORK TIMES BESTSELLER
“Wonderful . . . powerful.”—The Washington Post Book World
An astonishing technique for recovering and cloning dinosaur DNA has been discovered. Now humankind’s most thrilling fantasies have come true. Creatures extinct for eons roam Jurassic Park with their awesome presence and profound mystery, and all the world can visit them—for a price.
Until something goes wrong. . . .
In Jurassic Park, Michael Crichton taps all his mesmerizing talent and scientific brilliance to create his most electrifying technothriller.
“Frighteningly real . . . compelling . . ....