Science Current Events | Science News | Brightsurf.com
 

Carnegie Mellon researchers build time machine to visually explore space and time

April 22, 2011

Time-lapse GigaPans provide new way to access big data

PITTSBURGH-Researchers at Carnegie Mellon University's Robotics Institute have leveraged the latest browser technology to create GigaPan Time Machine, a system that enables viewers to explore gigapixel-scale, high-resolution videos and image sequences by panning or zooming in and out of the images while simultaneously moving back and forth through time.

Viewers, for instance, can use the system to focus in on the details of a booth within a panorama of a carnival midway, but also reverse time to see how the booth was constructed. Or they can watch a group of plants sprout, grow and flower, shifting perspective to watch some plants move wildly as they grow while others get eaten by caterpillars. Or, they can view a computer simulation of the early universe, watching as gravity works across 600 million light-years to condense matter into filaments and finally into stars that can be seen by zooming in for a close up.

"With GigaPan Time Machine, you can simultaneously explore space and time at extremely high resolutions," said Illah Nourbakhsh, associate professor of robotics and head of the CREATE Lab. "Science has always been about narrowing your point of view - selecting a particular experiment or observation that you think might provide insight. But this system enables what we call exhaustive science, capturing huge amounts of data that can then be explored in amazing ways."

The system is an extension of the GigaPan technology developed by the CREATE Lab and NASA, which can capture a mosaic of hundreds or thousands of digital pictures and stitch those frames into a panorama that be interactively explored via computer. To extend GigaPan into the time dimension, image mosaics are repeatedly captured at set intervals, and then stitched across both space and time to create a video in which each frame can be hundreds of millions, or even billions of pixels.

An enabling technology for time-lapse GigaPans is a feature of the HTML5 language that has been incorporated into such browsers as Google's Chrome and Apple's Safari. HTML5, the latest revision of the HyperText Markup Language (HTML) standard that is at the core of the Internet, makes browsers capable of presenting video content without use of plug-ins such as Adobe Flash or Quicktime.

Using HTML5, CREATE Lab computer scientists Randy Sargent, Chris Bartley and Paul Dille developed algorithms and software architecture that make it possible to shift seamlessly from one video portion to another as viewers zoom in and out of Time Machine imagery. To keep bandwidth manageable, the GigaPan site streams only those video fragments that pertain to the segment and/or time frame being viewed.

"We were crashing the browsers early on," Sargent recalled. "We're really pushing the browser technology to the limits."

Guidelines on how individuals can capture time-lapse images using GigaPan cameras are included on the site created for hosting the new imagery's large data files, http://timemachine.gigapan.org. Sargent explained the CREATE Lab is eager to work with people who want to capture Time Machine imagery with GigaPan, or use the visualization technology for other applications.

Once a Time Machine GigaPan has been created, viewers can annotate and save their explorations of it in the form of video "Time Warps."

Though the time-lapse mode is an extension of the original GigaPan concept, scientists already are applying the visualization techniques to other types of Big Data. Carnegie Mellon's Bruce and Astrid McWilliams Center for Cosmology, for instance, has used it to visualize a simulation of the early universe performed at the Pittsburgh Supercomputing Center by Tiziana Di Matteo, associate professor of physics.

"Simulations are a huge bunch of numbers, ugly numbers," Di Matteo said. "Visualizing even a portion of a simulation requires a huge amount of computing itself." Visualization of these large data sets is crucial to the science, however. "Discoveries often come from just looking at it," she explained.

Rupert Croft, associate professor of physics, said cosmological simulations are so massive that only a segment can be visualized at a time using usual techniques. Yet whatever is happening within that segment is being affected by forces elsewhere in the simulation that cannot be readily accessed. By converting the entire simulation into a time-lapse GigaPan, however, Croft and his Ph.D. student, Yu Feng, were able to create an image that provided both the big picture of what was happening in the early universe and the ability to look in detail at any region of interest.

Using a conventional GigaPan camera, Janet Steven, an assistant professor of biology at Sweet Briar College in Virginia, has created time-lapse imagery of rapid-growing brassicas, known as Wisconsin Fast Plants. "This is such an incredible tool for plant biology," she said. "It gives you the advantage of observing individual plants, groups of plants and parts of plants, all at once."

Steven, who has received GigaPan training through the Fine Outreach for Science program, said time-lapse photography has long been used in biology, but the GigaPan technology makes it possible to observe a number of plants in detail without having separate cameras for each plant. Even as one plant is studied in detail, it's possible to also see what neighboring plants are doing and how that might affect the subject plant, she added.

Steven said creating time-lapse GigaPans of entire landscapes could be a powerful tool for studying seasonal change in plants and ecosystems, an area of increasing interest for understanding climate change. Time-lapse GigaPan imagery of biological experiments also could be an educational tool, allowing students to make independent observations and develop their own hypotheses.

Carnegie Mellon University


Related High-resolution Video Current Events and High-resolution Video News Articles


Hydrothermal vents, methane seeps play enormous role in marine life, global climate
The hydrothermal vents and methane seeps on the ocean floor that were once thought to be geologic and biological oddities are now emerging as a major force in ocean ecosystems, marine life and global climate.

NASA Releases IRIS Footage of X-class Flare
On Sept. 10, 2014, NASA's newest solar observatory, the Interface Region Imaging Spectrograph, or IRIS, mission joined other telescopes to witness an X-class flare - an example of one of the strongest solar flares -- on the sun.

NASA's RXTE Satellite Decodes the Rhythm of an Unusual Black Hole
Astronomers have uncovered rhythmic pulsations from a rare type of black hole 12 million light-years away by sifting through archival data from NASA's Rossi X-ray Timing Explorer (RXTE) satellite.

New Study Reveals the Biomechanics of How Marine Snail Larvae Swim
Equipped with high-speed, high-resolution video, scientists have discovered important new information on how marine snail larvae swim, a key behavior that determines individual dispersal and ultimately, survival.

Nanocables light way to the future
Cables made of carbon nanotubes are inching toward electrical conductivities seen in metal wires, and that may light up interest among a range of industries, according to Rice University researchers.

Speed installation of system to monitor vital signs of global ocean, scientists urge
The ocean surface is 30 percent more acidic today than it was in 1800, much of that increase occurring in the last 50 years - a rising trend that could both harm coral reefs and profoundly impact tiny shelled plankton at the base of the ocean food web, scientists warn.

Brown University-led team discovers how bats avoid collisions
For years, Brown University neuroscientist James Simmons has filmed bats as they flew in packs or individually chased prey in thick foliage. All the while, he asked himself why the bats never collided with objects in their paths or with each other.

NYU physicists find way to explore microscopic systems through holographic video
Physicists at New York University have developed a technique to record three-dimensional movies of microscopic systems, such as biological molecules, through holographic video.

Seamounts may serve as refuges for deep-sea animals that struggle to survive elsewhere
Over the last two decades, marine biologists have discovered lush forests of deep-sea corals and sponges growing on seamounts (underwater mountains) offshore of the California coast. It has generally been assumed that many of these animals live only on seamounts, and are found nowhere else.
More High-resolution Video Current Events and High-resolution Video News Articles

Video Basics 7

Video Basics 7
by Herbert Zettl (Author)


Herbert Zettl draws on his expertise and field experience to bring you the seventh edition of VIDEO BASICS, the handiest and most authoritative, current, and technically accurate student guide to video production available. Meeting the need for a briefer book, this text distills comprehensive video instruction so that it can be covered in a single semester. The book moves students from video concepts and processes to production tools and techniques and, finally, to the production environment (studio and field, inside and outside) and its effects. A more conceptual framework leads students from the idea (what to create) to the image (how to create) on video.

The Kaguya Lunar Atlas: The Moon in High Resolution

The Kaguya Lunar Atlas: The Moon in High Resolution
by Motomaro Shirao (Author), Charles A. Wood (Author)


In late 2007, the Japanese Space Exploration Agency (JAXA) placed the Kaguya/ Selene spacecraft in orbit around the Moon to probe the Moon’s surface and interior. But unlike previous lunar orbiters, Kaguya carries a high definition television camera (HDTV) sent beyond Earth orbit. Sponsored by the Japanese NHK TV network, the HDTV has amazed both scientists and the public with its magnificent views of the lunar surface. What makes these images so much more engaging than standard vertical view lunar photography is that they are taken looking obliquely along the flight path. Thus, they show the Moon as it would be seen by an astronaut looking through a porthole window while orbiting only 100 km above the lunar surface. This is the view we all would wish to have but are never likely to,...

High-Quality Visual Experience: Creation, Processing and Interactivity of High-Resolution and High-Dimensional Video Signals (Signals and Communication Technology)

High-Quality Visual Experience: Creation, Processing and Interactivity of High-Resolution and High-Dimensional Video Signals (Signals and Communication Technology)
by Marta Mrak (Editor), Mislav Grgic (Editor), Murat Kunt (Editor)


Last few years have seen rapid acceptance of high-definition television (HDTV) technology around the world. This technology has been hugely successful in delivering more realistic television experience at home and accurate imaging for professional applications. Adoption of high definition continues to grow as consumers demand enhanced features and greater quality of content. Following this trend, natural evolution of visualisation technologies will be in the direction of fully realistic visual experience and highly precise imaging. However, using the content of even higher resolution and quality is not straightforward as such videos require significantly higher access bandwidth and more processing power. Therefore, methods for radical reduction of video bandwidth are crucial for...

YouTube: Online Video and Participatory Culture

YouTube: Online Video and Participatory Culture
by Jean Burgess (Author), Joshua Green (Author), Henry Jenkins (Contributor), John Hartley (Contributor)


YouTube is one of the most well-known and widely discussed sites of participatory media in the contemporary online environment, and it is the first genuinely mass-popular platform for user-created video. In this timely and comprehensive introduction to how YouTube is being used and why it matters, Burgess and Green discuss the ways that it relates to wider transformations in culture, society and the economy.
The book critically examines the public debates surrounding the site, demonstrating how it is central to struggles for authority and control in the new media environment. Drawing on a range of theoretical sources and empirical research, the authors discuss how YouTube is being used by the media industries, by audiences and amateur producers, and by particular communities of...

How to create high resolution panorama VR video footage (Japanese Edition)

How to create high resolution panorama VR video footage (Japanese Edition)
by KEI HIRANO


この書籍は高解像度パノラマVR動画を作成する際に必要なカメラリグや
その選び方、撮影の際に起こりうる様々な問題に対処するための基本的な知識をまとめたものです。

動画同士を縫い合わせるソフトウェアについてはソフトウェア毎に操作方法が異なるため代表的なソフトウェアの紹介にとどめています。


パノラマ動画の最大のメリットは、360°全周で起こったことをすべて同時に記録できることです。

Digital Compositing for Film and Video

Digital Compositing for Film and Video
by Steve Wright (Author)


This practical, hands-on guide addresses the problems and difficult choices that professional compositors face on a daily basis. You are presented with tips, techniques, and solutions for dealing with badly shot elements, color artifacts, mismatched lighting and other commonly faced compositing obstacles. Practical, in-depth lessons are featured for bluescreen matte extraction, despill operations, compositing operations, as well as color-corrections.

The book is presented entirely in an application-agnostic manner, allowing you to apply lessons learned to your compositing regardless of the software application you are using. The DVD contains before and after examples as well as exercise files for you to refine your own techniques on.

How To Sell Video Courses Online: How I make $2000+ passive income every month

How To Sell Video Courses Online: How I make $2000+ passive income every month
by Rob Cubbon (Author)


You can sell your expertise. I make over $2000 passive income every month from a few hours of video tutorials and you can too.     This book explains: how to research the content and title of your courses, technical information about video course creation, advice on how to create your first course, how to market your course, and loads more.     The world is changing. Education is changing. There is a HUGE demand for career skills courses online.     Once you have created a course it can earn you substantial money every month for years to come.     Plus you will enjoy the process of making the course and the feedback from the students. Course creation is not only very satisfying it also helps builds your brand as an authority within your niche.

Digital Video Surveillance and Security, Second Edition

Digital Video Surveillance and Security, Second Edition
by Anthony C. Caputo (Author)


The use of digital surveillance technology is rapidly growing as it becomes significantly cheaper for live and remote monitoring. The second edition of Digital Video Surveillance and Security provides the most current and complete reference for security professionals and consultants as they plan, design, and implement surveillance systems to secure their places of business. By providing the necessary explanations of terms, concepts, and technological capabilities, this revised edition addresses the newest technologies and solutions available on the market today. With clear descriptions and detailed illustrations, Digital Video Surveillance and Security is the only book that shows the need for an overall understanding of the digital video surveillance (DVS) ecosystem.Highly visual with...

Bill Gentile's Essential Video Journalism Field Manual, Second Edition

Bill Gentile's Essential Video Journalism Field Manual, Second Edition
by Bill Gentile (Author), Bill Gentile (Photographer), J. Bruce Jones (Photographer), J. Bruce Jones (Photographer)


Bill Gentile’s Essential Video Journalism Field Manual, Second Edition, is a how-to guide for anyone aspiring to speak the visual language that increasingly dominates today’s global exchange of information. Founded on a 40-year journalism and teaching career that parallels and embodies the technological revolution that made video journalism possible, Gentile’s Field Manual is a timeless resource for beginners as well as veteran practitioners of the craft. Follow him from the days of black-and-white film covering Nicaragua’s 1979 Sandinista Revolution to high-definition, digital video cameras documenting U.S. Marines in Afghanistan’s Helmand River Valley, to an iPhone 6+ making a film on Kichwa Indians and their spiritual relationship with the Amazon. Read this manual and...

Go Pro Camera: Video editing for Beginners: How to Edit  Video  in Final Cut Pro and Adobe Premiere Pro Step by Step

Go Pro Camera: Video editing for Beginners: How to Edit Video in Final Cut Pro and Adobe Premiere Pro Step by Step
by Vlad Gemstone (Author)


If you notice you are uncomfortable or are not satisfied with some video editing functions in the standard GoPro camera software, then you are on your way to the development of other programs outlined in this book. The features work in two widely used video editors and there are screenshots for a better understanding of the way various functions work. Also considered one of the most interesting features time-lapsing camera. These two video editing software are the top editing tools out there in the market and the basics that this book covers will definitely make it really easy for you to edit or polish your GoPro videos on your own without having to spend some real cash on editing professionals. The book is useful to any novice users of GoPro cameras, especially for travelers.

© 2016 BrightSurf.com