Computer scientists predict lightning and thunder with the help of artificial intelligence

June 26, 2019

At the beginning of June, the German Weather Service counted 177,000 lightning bolts in the night sky within a few days. The natural spectacle had consequences: Several people were injured by gusts of wind, hail and rain. Together with Germany's National Meteorological Service, the Deutscher Wetterdienst, computer science professor Jens Dittrich and his doctoral student Christian Schön from Saarland University are now working on a system that is supposed to predict local thunderstorms more precisely than before. It is based on satellite images and artificial intelligence. In order to investigate this approach in more detail, the researchers will receive 270,000 euros from the Federal Ministry of Transport.

One of the core tasks of weather services is to warn of dangerous weather conditions. These include thunderstorms in particular, as these are often accompanied by gusts of wind, hail and heavy rainfall. The Deutscher Wetterdienst (DWD) uses the "NowcastMIX" system for this purpose. Every five minutes it polls several remote sensing systems and observation networks to warn of thunderstorms, heavy rain and snowfall in the next two hours. "However, NowcastMIX can only detect the thunderstorm cells when heavy precipitation has already occurred. This is why satellite data are used to detect the formation of thunderstorm cells earlier and thus to warn of them earlier," explains Professor Jens Dittrich, who teaches computer science at Saarland University and heads the "Big Data Analytics" group. Together with his doctoral student Christian Schön and the meteorologist Richard Müller from DWD, he has therefore developed a system that could soon supplement NowcastMIX in predicting thunderstorms. Their project is a first step to explore the applicability of artificial intelligence in the prediction of weather and climate phenomena.

In order to accurately predict thunderstorms in a specific region, the so-called convection of air masses, i.e. the rise of heated air while colder air sinks in the surrounding area, must be detected early and precisely. This has been known for a long time. The highlight of the new system, however, is that it only requires two-dimensional images, namely satellite images, to detect these three-dimensional air shifts.

In order to see what is happening in the sky three-dimensionally based on the two-dimensional images, the researchers use photographs taken fifteen minutes apart. Part of the image series for the respective area goes as input to an algorithm that calculates what the future image, not supplied to the algorithm, would look like. The scientists then compare this result with the real image. The size of the deviation between the forecast and reality - the researchers call it the "error" - then serves as input for a second algorithm, which the researchers have trained using machine learning to recognize the relationship between the size of the error and the occurrence of a thunderstorm. In this way, they can calculate whether it there is thunder and lightning or not. "This is the strength when we apply artificial intelligence to large amounts of data. It recognizes patterns that remain hidden from us," explains Professor Dittrich. This is one of the reasons why he and other colleagues have just initiated the new bachelor's and master's degree program "Data Science and Artificial Intelligence".

In the case of lightning and thunder, this combination is definitely "multifaceted," says Dittrich. "Based on the satellite images alone, we can predict flashes with an accuracy of 96 percent for the next 15 minutes. If the prediction window is opened further, the accuracy decreases, but still remains above 83 percent for up to five hours."

However, the rate of false alarms is still too high, according to the researchers. Nonetheless, they believe that they can significantly reduce these false alarms by training their model on additional features that are also used by the current NowcastMIX system, for example. The Federal Ministry of Transport has already granted the computer scientists from Saarbruecken 270,000 euros to investigate this in more detail.
-end-
Further information:

Link to the technical paper "The Error is the Feature: How to Forecast Lightning using a Model Prediction Error", ACM SIGKDD 2019
https://bigdata.uni-saarland.de/publications/SDM19_SIGKDD.pdf

New degree program "Data Science and Artificial Intelligence"
https://saarland-informatics-campus.de/piece-of-news/neuer-studiengang-verbindet-kuenstliche-intelligenz-maschinelles-lernen-und-data-science/

Questions can be directed to:
Professor Dr. Jens Dittrich
Big Data Analytics Group
Saarland Informatics Campus
Phone: 0681 302-70141
E-mail: jens.dittrich@bigdata.uni-saarland.de

Editor:
Gordon Bolduan
science communication
Competence Center Computer Science Saarland
Saarland Informatics Campus
Phone: 0681 302-70741
E-mail: bolduan@mmci.uni-saarland.de

Saarland University

Related Algorithm Articles from Brightsurf:

CCNY & partners in quantum algorithm breakthrough
Researchers led by City College of New York physicist Pouyan Ghaemi report the development of a quantum algorithm with the potential to study a class of many-electron quantums system using quantum computers.

Machine learning algorithm could provide Soldiers feedback
A new machine learning algorithm, developed with Army funding, can isolate patterns in brain signals that relate to a specific behavior and then decode it, potentially providing Soldiers with behavioral-based feedback.

New algorithm predicts likelihood of acute kidney injury
In a recent study, a new algorithm outperformed the standard method for predicting which hospitalized patients will develop acute kidney injury.

New algorithm could unleash the power of quantum computers
A new algorithm that fast forwards simulations could bring greater use ability to current and near-term quantum computers, opening the way for applications to run past strict time limits that hamper many quantum calculations.

QUT algorithm could quash Twitter abuse of women
Online abuse targeting women, including threats of harm or sexual violence, has proliferated across all social media platforms but QUT researchers have developed a sophisticated statistical model to identify misogynistic content and help drum it out of the Twittersphere.

New learning algorithm should significantly expand the possible applications of AI
The e-prop learning method developed at Graz University of Technology forms the basis for drastically more energy-efficient hardware implementations of Artificial Intelligence.

Algorithm predicts risk for PTSD after traumatic injury
With high precision, a new algorithm predicts which patients treated for traumatic injuries in the emergency department will later develop posttraumatic stress disorder.

New algorithm uses artificial intelligence to help manage type 1 diabetes
Researchers and physicians at Oregon Health & Science University have designed a method to help people with type 1 diabetes better manage their glucose levels.

A new algorithm predicts the difficulty in fighting fire
The tool completes previous studies with new variables and could improve the ability to respond to forest fires.

New algorithm predicts optimal materials among all possible compounds
Skoltech researchers have offered a solution to the problem of searching for materials with required properties among all possible combinations of chemical elements.

Read More: Algorithm News and Algorithm Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.