Nav: Home

Model fuses social media, remote sensing data with goal of identifying nuclear threats

July 23, 2018

A new computational model allows researchers to draw on normally incompatible data sets, such as satellite imagery and social media posts, to answer questions about what is happening in targeted locations. The researchers developed the model to serve as a tool for identifying violations of nuclear nonproliferation agreements.

"Our goal was to develop a working framework that uses information from a variety of sensors and data sources to identify these potential violations of nuclear nonproliferation," says Hamid Krim, co-author of a paper on the work, a professor of electrical and computer engineering at North Carolina State University and director of the VISSTA Laboratory. "Some of these data may be conventional, such as Geiger counter readings or multispectral data from satellite imagery. But many of these data sources may be nontraditional, such as social media posts. And these sources provide a wide variety of data that are not normally compatible, such as the text included on Twitter posts and the images posted on Flickr.

"By making these different inputs compatible with each other, we are able to accept a broader range of data inputs and use that data in a meaningful way that, ultimately, can help authorities reach more reliable conclusions," Krim says.

The researchers say the model can be used to work with any data that can be identified as coming from the targeted area. For example, satellite images are clearly identifiable, but they may also draw on social media posts that are actively or passively tagged as coming from the relevant area.

The question then becomes: how do you work with incompatible data? To explain, we'll use a proxy problem that the researchers used in their paper: identifying a flood. They chose a flood because data on flooding is not classified, whereas data regarding nuclear activity is.

The first step in the process is to use mathematical equations to translate each type of data into a useful format. For example, images may be run through models to determine whether they are images of flooding, whereas text posts may be run through models to determine whether they include references to flooding. Once those data streams are translated into a neutral format - meaning they indicate flooding or no flooding - they can be compared to each other to answer basic questions such as: do the data support each other?

But it's not quite that simple. For example, people may be tweeting about a flood that is taking place hundreds of miles away, which could skew any calculation by the overarching model. To address this, the researchers incorporated mathematical elements that account for the complexity of the data they are drawing on.

"Addressing complexity is particularly important in the context of nonproliferation enforcement," Krim says. "Relevant data inputs may include photos of particular types of technology, references made in conversations caught on audio, and so on. A model like the one we developed needs to be flexible enough to account for the variability and complexity of both varied types of data and the varied clues we are looking for."

The researchers tested their model using data from a 2013 flood that took place in Colorado, and were able to resolve the incompatibility of multi-modal data in order to accurately estimate the location of the flooding.

Next steps for the project include evaluating nuclear facilities in the West to identify common characteristics that may also be applicable to facilities in more isolated societies, such as North Korea.

"We want to find ways of transferring information from known environment to a hidden one," Krim says. "How can we determine what information and which models are transferable from one place to another, given incompatible or inconsistent data? What's normal, and what's not? It's not an easy problem."
The paper, "Fusing Heterogeneous Data: A Case for Remote Sensing and Social Media," is published online in the journal IEEE Transactions on Geoscience and Remote Sensing. First author on the paper is Han Wang, a former postdoctoral researcher at NC State who is now a postdoc at the University of Texas in San Antonio. Other co-authors were Erik Skau, a former Ph.D. student at NC State who is a now a postdoc at Los Alamos National Laboratory, and Guido Cervone of Pennsylvania State University.

The work was supported by the Department of Energy National Nuclear Security Administration's Office of Defense Nuclear Nonproliferation R&D through the Consortium for Nonproliferation Enabling Capabilities at North Carolina State University, under grant number DE-NA0002576.

North Carolina State University

Related Flooding Articles:

The Earth sank twice, flooding the Western Amazon
A tiny shark tooth, part of a mantis shrimp and other microscopic marine organisms reveal that as the Andes mountains rose, the Western Amazon sank twice, each time for less than a million years.
More than 100 years of flooding and erosion in 1 event
Sara Rathburn of Colorado State University and colleagues have developed an integrated sediment, wood, and organic carbon budget for North St.
Over time, nuisance flooding can cost more than extreme, infrequent events
Global climate change is being felt in many coastal communities of the United States, not always in the form of big weather disasters but as a steady drip, drip, drip of nuisance flooding.
NASA sees Pineapple Express deliver heavy rains, flooding to California
California which has long been suffering through a strong, multi-year drought, is finally beginning to see some much needed relief as a result of a recent series of storms that are part of a weather pattern known as the 'Pineapple Express.'
Ensemble forecast of a major flooding event in Beijing
The intensity of the rainfall on July 21, 2012, was significantly underpredicted by models.
Plant diversity alleviates the effects of flooding on crops
In grasslands, growing plants in higher diversity fields may help alleviate the negative impacts of flooding.
Storms and tides combine to cause coastal flooding around the Clyde
Severe storms in the Atlantic can cause a tsunami-like wave that funnels into the Firth of Clyde, and when this coincides with high tides it leads to severe coastal flooding, according to a study by mathematicians at the University of Strathclyde.
NASA analyzes deadly Louisiana flooding
Record-setting rainfall and flooding in southern Louisiana have been calculated at NASA with data from satellites.
NASA looks at historic flooding from slow-moving Maryland storms
NASA analyzed rainfall data from slow-moving storms that triggered flash floods over parts of central Maryland and caused devastating flooding in historic Ellicott City, Md.
NASA's IMERG measures deadly West Virginia flooding rainfall
Since June 23, 2016 over two dozen people have been reported killed and hundreds of homes have been destroyed by flooding in West Virginia.

Related Flooding Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Bias And Perception
How does bias distort our thinking, our listening, our beliefs... and even our search results? How can we fight it? This hour, TED speakers explore ideas about the unconscious biases that shape us. Guests include writer and broadcaster Yassmin Abdel-Magied, climatologist J. Marshall Shepherd, journalist Andreas Ekström, and experimental psychologist Tony Salvador.
Now Playing: Science for the People

#513 Dinosaur Tails
This week: dinosaurs! We're discussing dinosaur tails, bipedalism, paleontology public outreach, dinosaur MOOCs, and other neat dinosaur related things with Dr. Scott Persons from the University of Alberta, who is also the author of the book "Dinosaurs of the Alberta Badlands".