Nav: Home

Model fuses social media, remote sensing data with goal of identifying nuclear threats

July 23, 2018

A new computational model allows researchers to draw on normally incompatible data sets, such as satellite imagery and social media posts, to answer questions about what is happening in targeted locations. The researchers developed the model to serve as a tool for identifying violations of nuclear nonproliferation agreements.

"Our goal was to develop a working framework that uses information from a variety of sensors and data sources to identify these potential violations of nuclear nonproliferation," says Hamid Krim, co-author of a paper on the work, a professor of electrical and computer engineering at North Carolina State University and director of the VISSTA Laboratory. "Some of these data may be conventional, such as Geiger counter readings or multispectral data from satellite imagery. But many of these data sources may be nontraditional, such as social media posts. And these sources provide a wide variety of data that are not normally compatible, such as the text included on Twitter posts and the images posted on Flickr.

"By making these different inputs compatible with each other, we are able to accept a broader range of data inputs and use that data in a meaningful way that, ultimately, can help authorities reach more reliable conclusions," Krim says.

The researchers say the model can be used to work with any data that can be identified as coming from the targeted area. For example, satellite images are clearly identifiable, but they may also draw on social media posts that are actively or passively tagged as coming from the relevant area.

The question then becomes: how do you work with incompatible data? To explain, we'll use a proxy problem that the researchers used in their paper: identifying a flood. They chose a flood because data on flooding is not classified, whereas data regarding nuclear activity is.

The first step in the process is to use mathematical equations to translate each type of data into a useful format. For example, images may be run through models to determine whether they are images of flooding, whereas text posts may be run through models to determine whether they include references to flooding. Once those data streams are translated into a neutral format - meaning they indicate flooding or no flooding - they can be compared to each other to answer basic questions such as: do the data support each other?

But it's not quite that simple. For example, people may be tweeting about a flood that is taking place hundreds of miles away, which could skew any calculation by the overarching model. To address this, the researchers incorporated mathematical elements that account for the complexity of the data they are drawing on.

"Addressing complexity is particularly important in the context of nonproliferation enforcement," Krim says. "Relevant data inputs may include photos of particular types of technology, references made in conversations caught on audio, and so on. A model like the one we developed needs to be flexible enough to account for the variability and complexity of both varied types of data and the varied clues we are looking for."

The researchers tested their model using data from a 2013 flood that took place in Colorado, and were able to resolve the incompatibility of multi-modal data in order to accurately estimate the location of the flooding.

Next steps for the project include evaluating nuclear facilities in the West to identify common characteristics that may also be applicable to facilities in more isolated societies, such as North Korea.

"We want to find ways of transferring information from known environment to a hidden one," Krim says. "How can we determine what information and which models are transferable from one place to another, given incompatible or inconsistent data? What's normal, and what's not? It's not an easy problem."
-end-
The paper, "Fusing Heterogeneous Data: A Case for Remote Sensing and Social Media," is published online in the journal IEEE Transactions on Geoscience and Remote Sensing. First author on the paper is Han Wang, a former postdoctoral researcher at NC State who is now a postdoc at the University of Texas in San Antonio. Other co-authors were Erik Skau, a former Ph.D. student at NC State who is a now a postdoc at Los Alamos National Laboratory, and Guido Cervone of Pennsylvania State University.

The work was supported by the Department of Energy National Nuclear Security Administration's Office of Defense Nuclear Nonproliferation R&D through the Consortium for Nonproliferation Enabling Capabilities at North Carolina State University, under grant number DE-NA0002576.

North Carolina State University

Related Flooding Articles:

Climate change: Extreme coastal flooding events in the US expected to rise
Extreme flooding events in some US coastal areas could double every five years if sea levels continue to rise as expected, a study published in Scientific Reports suggests.
Study find delta helps to decrease the impact of river flooding
Most coastal cities and ports face a double threat from storm surge and river flooding.
Texas A&M researchers develop flooding prediction tool
By incorporating the architecture of city drainage systems and readings from flood gauges into a comprehensive statistical framework, researchers at Texas A&M University can now accurately predict the evolution of floods in extreme situations like hurricanes.
Study finds flooding damage to levees is cumulative -- and often invisible
Recent research finds that repeated flooding events have a cumulative effect on the structural integrity of earthen levees, suggesting that the increase in extreme weather events associated with climate change could pose significant challenges for the nation's aging levee system.
NASA's Aqua satellite reveals flooding in Japan from Typhoon Hagibis
Typhoon Hagibis made landfall in Japan over the weekend of October 12 and 13, bringing damaging winds, rough surf and flooding rains.
Extreme flooding from storm surge and heavy precipitation projected to increase higher probability of compound flooding from precipitation and storm surge in Europe under anthropogenic climate change
Risk of compound flooding, which can result when rapid sea level rises associated with storms occur along with heavy rains, is currently concentrated along Mediterranean countries but will greatly increase for Northern European in the future as the climate warms, according to a new modeling study.
Changing climate linked to major changes in flooding across Europe
The impact of a changing climate on the severity of flooding has been demonstrated in the largest-scale study of its kind.
Researchers develop better way to determine coastal flooding risk
Researchers have developed a new methodology for building computer models that paves the way to better understanding the flood risks faced by coastal communities.
Houston's urban sprawl increased rainfall, flooding during Hurricane Harvey
Princeton and University of Iowa researchers found that Houston's urban landscape directly contributed to the torrential rainfall and deadly flooding of Hurricane Harvey in 2017.
Evidence of outburst flooding indicates plentiful water on early Mars
The presence of water on Mars has been theorized for centuries.
More Flooding News and Flooding Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Listen Again: Reinvention
Change is hard, but it's also an opportunity to discover and reimagine what you thought you knew. From our economy, to music, to even ourselves–this hour TED speakers explore the power of reinvention. Guests include OK Go lead singer Damian Kulash Jr., former college gymnastics coach Valorie Kondos Field, Stockton Mayor Michael Tubbs, and entrepreneur Nick Hanauer.
Now Playing: Science for the People

#562 Superbug to Bedside
By now we're all good and scared about antibiotic resistance, one of the many things coming to get us all. But there's good news, sort of. News antibiotics are coming out! How do they get tested? What does that kind of a trial look like and how does it happen? Host Bethany Brookeshire talks with Matt McCarthy, author of "Superbugs: The Race to Stop an Epidemic", about the ins and outs of testing a new antibiotic in the hospital.
Now Playing: Radiolab

Dispatch 6: Strange Times
Covid has disrupted the most basic routines of our days and nights. But in the middle of a conversation about how to fight the virus, we find a place impervious to the stalled plans and frenetic demands of the outside world. It's a very different kind of front line, where urgent work means moving slow, and time is marked out in tiny pre-planned steps. Then, on a walk through the woods, we consider how the tempo of our lives affects our minds and discover how the beats of biology shape our bodies. This episode was produced with help from Molly Webster and Tracie Hunte. Support Radiolab today at Radiolab.org/donate.