Carnegie Mellon researchers build time machine to visually explore space and time
April 22, 2011
Time-lapse GigaPans provide new way to access big data
PITTSBURGH-Researchers at Carnegie Mellon University's Robotics Institute have leveraged the latest browser technology to create GigaPan Time Machine, a system that enables viewers to explore gigapixel-scale, high-resolution videos and image sequences by panning or zooming in and out of the images while simultaneously moving back and forth through time.
Viewers, for instance, can use the system to focus in on the details of a booth within a panorama of a carnival midway, but also reverse time to see how the booth was constructed. Or they can watch a group of plants sprout, grow and flower, shifting perspective to watch some plants move wildly as they grow while others get eaten by caterpillars. Or, they can view a computer simulation of the early universe, watching as gravity works across 600 million light-years to condense matter into filaments and finally into stars that can be seen by zooming in for a close up.
"With GigaPan Time Machine, you can simultaneously explore space and time at extremely high resolutions," said Illah Nourbakhsh, associate professor of robotics and head of the CREATE Lab. "Science has always been about narrowing your point of view - selecting a particular experiment or observation that you think might provide insight. But this system enables what we call exhaustive science, capturing huge amounts of data that can then be explored in amazing ways."
The system is an extension of the GigaPan technology developed by the CREATE Lab and NASA, which can capture a mosaic of hundreds or thousands of digital pictures and stitch those frames into a panorama that be interactively explored via computer. To extend GigaPan into the time dimension, image mosaics are repeatedly captured at set intervals, and then stitched across both space and time to create a video in which each frame can be hundreds of millions, or even billions of pixels.
An enabling technology for time-lapse GigaPans is a feature of the HTML5 language that has been incorporated into such browsers as Google's Chrome and Apple's Safari. HTML5, the latest revision of the HyperText Markup Language (HTML) standard that is at the core of the Internet, makes browsers capable of presenting video content without use of plug-ins such as Adobe Flash or Quicktime.
Using HTML5, CREATE Lab computer scientists Randy Sargent, Chris Bartley and Paul Dille developed algorithms and software architecture that make it possible to shift seamlessly from one video portion to another as viewers zoom in and out of Time Machine imagery. To keep bandwidth manageable, the GigaPan site streams only those video fragments that pertain to the segment and/or time frame being viewed.
"We were crashing the browsers early on," Sargent recalled. "We're really pushing the browser technology to the limits."
Guidelines on how individuals can capture time-lapse images using GigaPan cameras are included on the site created for hosting the new imagery's large data files, http://timemachine.gigapan.org.
Sargent explained the CREATE Lab is eager to work with people who want to capture Time Machine imagery with GigaPan, or use the visualization technology for other applications.
Once a Time Machine GigaPan has been created, viewers can annotate and save their explorations of it in the form of video "Time Warps."
Though the time-lapse mode is an extension of the original GigaPan concept, scientists already are applying the visualization techniques to other types of Big Data. Carnegie Mellon's Bruce and Astrid McWilliams Center for Cosmology, for instance, has used it to visualize a simulation of the early universe performed at the Pittsburgh Supercomputing Center by Tiziana Di Matteo, associate professor of physics.
"Simulations are a huge bunch of numbers, ugly numbers," Di Matteo said. "Visualizing even a portion of a simulation requires a huge amount of computing itself." Visualization of these large data sets is crucial to the science, however. "Discoveries often come from just looking at it," she explained.
Rupert Croft, associate professor of physics, said cosmological simulations are so massive that only a segment can be visualized at a time using usual techniques. Yet whatever is happening within that segment is being affected by forces elsewhere in the simulation that cannot be readily accessed. By converting the entire simulation into a time-lapse GigaPan, however, Croft and his Ph.D. student, Yu Feng, were able to create an image that provided both the big picture of what was happening in the early universe and the ability to look in detail at any region of interest.
Using a conventional GigaPan camera, Janet Steven, an assistant professor of biology at Sweet Briar College in Virginia, has created time-lapse imagery of rapid-growing brassicas, known as Wisconsin Fast Plants. "This is such an incredible tool for plant biology," she said. "It gives you the advantage of observing individual plants, groups of plants and parts of plants, all at once."
Steven, who has received GigaPan training through the Fine Outreach for Science program, said time-lapse photography has long been used in biology, but the GigaPan technology makes it possible to observe a number of plants in detail without having separate cameras for each plant. Even as one plant is studied in detail, it's possible to also see what neighboring plants are doing and how that might affect the subject plant, she added.
Steven said creating time-lapse GigaPans of entire landscapes could be a powerful tool for studying seasonal change in plants and ecosystems, an area of increasing interest for understanding climate change. Time-lapse GigaPan imagery of biological experiments also could be an educational tool, allowing students to make independent observations and develop their own hypotheses.
Carnegie Mellon University
Related High-resolution Video Current Events and High-resolution Video News ArticlesNASA Releases IRIS Footage of X-class Flare
On Sept. 10, 2014, NASA's newest solar observatory, the Interface Region Imaging Spectrograph, or IRIS, mission joined other telescopes to witness an X-class flare - an example of one of the strongest solar flares -- on the sun. NASA's RXTE Satellite Decodes the Rhythm of an Unusual Black Hole
Astronomers have uncovered rhythmic pulsations from a rare type of black hole 12 million light-years away by sifting through archival data from NASA's Rossi X-ray Timing Explorer (RXTE) satellite.New Study Reveals the Biomechanics of How Marine Snail Larvae Swim
Equipped with high-speed, high-resolution video, scientists have discovered important new information on how marine snail larvae swim, a key behavior that determines individual dispersal and ultimately, survival.Nanocables light way to the future
Cables made of carbon nanotubes are inching toward electrical conductivities seen in metal wires, and that may light up interest among a range of industries, according to Rice University researchers.Speed installation of system to monitor vital signs of global ocean, scientists urge
The ocean surface is 30 percent more acidic today than it was in 1800, much of that increase occurring in the last 50 years - a rising trend that could both harm coral reefs and profoundly impact tiny shelled plankton at the base of the ocean food web, scientists warn.Brown University-led team discovers how bats avoid collisions
For years, Brown University neuroscientist James Simmons has filmed bats as they flew in packs or individually chased prey in thick foliage. All the while, he asked himself why the bats never collided with objects in their paths or with each other.NYU physicists find way to explore microscopic systems through holographic video
Physicists at New York University have developed a technique to record three-dimensional movies of microscopic systems, such as biological molecules, through holographic video.Seamounts may serve as refuges for deep-sea animals that struggle to survive elsewhere
Over the last two decades, marine biologists have discovered lush forests of deep-sea corals and sponges growing on seamounts (underwater mountains) offshore of the California coast. It has generally been assumed that many of these animals live only on seamounts, and are found nowhere else.
More High-resolution Video Current Events and High-resolution Video News Articles
The Kaguya Lunar Atlas: The Moon in High Resolution|
by Motomaro Shirao (Author), Charles A. Wood (Author)
In late 2007, the Japanese Space Exploration Agency (JAXA) placed the Kaguya/ Selene spacecraft in orbit around the Moon to probe the Moon’s surface and interior. But unlike previous lunar orbiters, Kaguya carries a high definition television camera (HDTV) sent beyond Earth orbit. Sponsored by the Japanese NHK TV network, the HDTV has amazed both scientists and the public with its magnificent views of the lunar surface. What makes these images so much more engaging than standard vertical view lunar photography is that they are taken looking obliquely along the flight path. Thus, they show the Moon as it would be seen by an astronaut looking through a porthole window while orbiting only 100 km above the lunar surface. This is the view we all would wish to have but are never likely to,...
High-Quality Visual Experience: Creation, Processing and Interactivity of High-Resolution and High-Dimensional Video Signals (Signals and Communication Technology)|
by Marta Mrak (Editor), Mislav Grgic (Editor), Murat Kunt (Editor)
Last few years have seen rapid acceptance of high-definition television (HDTV) technology around the world. This technology has been hugely successful in delivering more realistic television experience at home and accurate imaging for professional applications. Adoption of high definition continues to grow as consumers demand enhanced features and greater quality of content. Following this trend, natural evolution of visualisation technologies will be in the direction of fully realistic visual experience and highly precise imaging. However, using the content of even higher resolution and quality is not straightforward as such videos require significantly higher access bandwidth and more processing power. Therefore, methods for radical reduction of video bandwidth are crucial for...
by Neal Stephenson (Author)
Five thousand years later after a catastropic event rendered the Earth a ticking time bomb, the progeny of a handful of outer space explorers--seven distinct races now three billion strong--embark on yet another audacious journey into the unknown ... to an alien world utterly transformed by cataclysm and time: Earth.
Video Marketing: How To Produce Viral Films And Leverage Facebook, YouTube, Instagram And Twitter To Build A Massive Audience (Content Strategy, Video Marketing, Viral Marketing)|
The Eight-Step Process To Create Viral Films & Leverage Facebook, YouTube, Instagram And Twitter To Build A Massive Audience
Right now, you may have the secret to changing the way people look at your business. If you are looking for new ways to drive traffic to your business, this is the book for you. It may be you want an understanding on how the video marketplace works, and how to improve your current business processes. This book will reveal many great ways to make your business better, and to expand your viewership in short order. Even if all you want to do is develop a working vocabulary of the Viral Video business, this book will meet your needs and expectations.
Inside You Will Learn:
• 8 Simple Steps to creating dynamic video content
• Five best...
Master Handbook of Video Production|
by Jerry Whitaker (Author)
FROM THE EDITOR OF THE STANDARD HANDBOOK OF VIDEO AND TELEVISION ENGINEERING THE ALL-MEDIA GUIDE TO PROFESSIONAL VIDEO PRODUCTION You don't need an engineering degree to succeed in video production. In this book, video expert Jerry Whitaker shows you production from the inside out, from studio lighting to creating post-production special effects. The Art of Video Production Perfect for anyone who wants to build skills in the fast-growing field of digital video production, and produce video for TV, HDTV, movies, the Internet, or any other application, Master Handbook of Video Production shows you how to-
* Select, install, and work with digital equipment
* Understand MPEG video compression
* Design video production centers
* Master standard-definition and...
The Age of Em: Work, Love and Life when Robots Rule the Earth|
by Robin Hanson (Author)
Robots may one day rule the world, but what is a robot-ruled Earth like?
Many think the first truly smart robots will be brain emulations or "ems." Scan a human brain, then run a model with the same connections on a fast computer, and you have a robot brain, but recognizably human.
Train an em to do some job and copy it a million times: an army of workers is at your disposal. When they can be made cheaply, within perhaps a century, ems will displace humans in most jobs. In this new economic era, the world economy may double in size every few weeks.
Some say we can't know the future, especially following such a disruptive new technology, but Professor Robin Hanson sets out to prove them wrong. Applying decades of expertise in physics, computer science, and economics,...
Masterclips 101,000 Premium Image Collection CD 9 Pack (Clip Art, True Type Fonts, Color Photos, Web Images, Sound Clips, Animation and Video Clips, and More!)|
by IMSI (Author)
Includes 9 CDs. a leading developer and publisher of quality productivity software for the small business and home markets, announced today that it plans to ship the MasterClips 101,000 Premium Image Collection on August 26, 1996 at a targeted street price of $59.95. MasterClips 101,000 is the next release in IMSI's Master line of desktop publishing desktop publishing, system for producing printed materials that consists of a personal computer or computer workstation, a high-resolution printer (usually a laser printer), and a computer program that allows the user to select from a variety of type fonts and sizes,
..... Click the link for more information. and art products. This premium collection includes some of the highest quality clip art A set of canned images used to illustrate word...
The Knot Ultimate Wedding Planner & Organizer [binder edition]: Worksheets, Checklists, Etiquette, Calendars, and Answers to Frequently Asked Questions|
by Carley Roney (Author)
For the first time, the go-to wedding website, The Knot, has compiled all their essential planning tools—and dozens of new ideas—into this beautiful wedding organizer. Inside you will find:
Detailed timelines and worksheets for scheduling and budgeting
Planning and money-saving tips on everything from the dress to the music to the reception decor
8 tabbed dividers packed with visual inspiration, including more than 100 color photos of centerpieces, table settings, favors, and more
A perforated color swatch page for mixing and matching your own wedding palette
Extensive information on choosing your vendors, including checklists of key questions to ask
Ideas for the twenty-first-century bride, including how to use online tools and...
Morgue: A Life in Death|
by Vincent DiMaio (Author), Ron Franscell (Author)
Forensic science is booming. TV dramas, books and movies have made morgues cool. Complex technology and intricate research can take curdled blood, bone shards, and flakes of skin and turn them into justice. And Vincent Di Maio, MD, son of a famous New York City medical examiner, is one of the lions of forensic science in his own right. In this clear, gritty, and enthralling narrative, Di Maio himself guides us into the inner sanctum, through the cases that have made him famous, from the exhumation of assassin Lee Harvey Oswald and the racially charged shooting of Florida teen Trayvon Martin, to the unmasking of a serial baby-killer and the mysterious death of troubled genius Vincent van Gogh. Along the way, one of the country's most methodical and intuitive criminal pathologists will...
HDR Demystified: Emerging UHDTV Systems|
by Thomas Schulte (Author), Joel Barsotti (Contributor)
The new Ultra High Definition TV (UHDTV) system, which the CE industry is currently migrating to from HDTV, will benefit greatly from Higher Dynamic Range (HDR) and Wide Color Gamut (WCG).
These enhanced features have been received very positively by consumers. CE manufacturers are moving very quickly to introduce equipment to the market with various levels of UHD capability. This fast movement in the industry has left many confused about UHDTV capabilities, proposed system features, system compatibility, and standards.
This preliminary draft document attempts to shed light on High Dynamic Range and Wide Color Gamut, the two significant features of UHDTV that will affect how the image accuracy of these new generation TVs is tested and calibrated.