Nav: Home

Faulty modeling studies led to overstated predictions of Ebola outbreak

March 31, 2015

ANN ARBOR--Frequently used approaches to understanding and forecasting emerging epidemics--including the West African Ebola outbreak--can lead to big errors that mask their own presence, according to a University of Michigan ecologist and his colleagues.

"In the early days of the Ebola outbreak, a lot of people got into the forecasting business. They did it using appealingly simple mathematical models, and the result was a series of warnings that alerted the world, quite rightly, to the seriousness of the situation," said Aaron King, an associate professor in the U-M Department of Ecology and Evolutionary Biology.

"But in the end, most of those predictions turned out to be overstated."

On March 23, exactly one year after it announced there was an Ebola outbreak in Guinea, the World Health Organization released a situation update stating that there had been 24,842 Ebola cases, including 10,299 deaths, to date in Sierra Leone, Liberia and Guinea.

Last September, the U.S. Centers for Disease Control and Prevention estimated--based on computer modeling--that Liberia and Sierra Leone could see up to 1.4 million Ebola cases by January 2015 if the viral disease kept spreading without effective methods to contain it. Belatedly, the international community stepped up efforts to control the outbreak, and the explosive growth slowed.

"Those predictions proved to be wrong, and it was not only because of the successful intervention in West Africa," King said. "It's also because the methods people were using to make the forecasts were inappropriate."

In a paper scheduled for online publication March 31 in Proceedings of the Royal Society B, King and his colleagues suggest several straightforward and inexpensive ways to avoid those pitfalls when the next big infectious disease outbreak strikes. Their suggestions pertain to disease transmission models, sophisticated systems of equations that use data from the early stages of an outbreak to predict how it will unfold.

"It's just a matter of time before the next outbreak, and we want to make sure that we know how to provide reliable forecasts to guide the public health response when it happens," King said.

Many of last year's Ebola forecasts were made using common, off-the-shelf transmission models called deterministic models. Such models don't account for the random elements in disease transmission--how many people are infected by each transmission event, for example--and are in incapable of accurately communicating uncertainty.

King and his colleagues say deterministic models should be avoided. So-called stochastic models, which account for randomness and which can more precisely communicate uncertainty, should be used instead.

In addition to using deterministic models, many Ebola forecasters tried to fit those models to the total number of cases that had accumulated since the start of the outbreak. The end result was forecasts that overestimated the eventual size of the Ebola outbreak and greatly underestimated the uncertainty in those forecasts, according to King and his colleagues.

"Deterministic models are easier and faster to work with, and the results look really good," King said. "But when you use them, it's a double whammy. Not only are you wrong, you are very sure that you are right."
Co-authors of the paper are Pejman Rohani, Matthieu Domenech de Celles and Felicia M.G. Magpantay of the U-M Department of Ecology and Evolutionary Biology. King and Rohani also have appointments at the U-M Center for the Study of Complex Systems, and King is an associate professor of mathematics. King and Rohani are supported by the Department of Homeland Security and the National Institutes of Health.

University of Michigan

Related Outbreak Articles:

Yale researchers detect unreported Zika outbreak
Researchers at the Yale School of Public Health (YSPH) have detected a large unreported Zika outbreak that occurred in Cuba during 2017, a year after Zika outbreaks peaked throughout the Americas.
2017 pneumonic plague outbreak in Madagascar characterized by scientists
Plague is an endemic disease in Madagascar. Each year there is a seasonal upsurge between September and April, especially in the Central Highlands, which stand at an elevation of more than 800m.
Viral genome sequencing in the heart of a Lassa outbreak
The first researchers to deploy a mobile nanopore sequencing technology to evaluate viral genomics at the height of a Lassa virus outbreak in 2018 now report their results.
Preventing a dengue outbreak at the 2020 Summer Olympics
In 2014, a dengue outbreak unexpectedly occurred in Tokyo. What does that mean for the 2020 summer Olympics and Paralympics being held in the city?
New study finds HIV outbreak in Indiana could have been prevented
An HIV outbreak among people who inject drugs in Indiana from 2011 to 2015 could have been avoided if the state's top health and elected officials had acted sooner on warnings, a new study by the Yale School of Public Health finds.
More Outbreak News and Outbreak Current Events

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Erasing The Stigma
Many of us either cope with mental illness or know someone who does. But we still have a hard time talking about it. This hour, TED speakers explore ways to push past — and even erase — the stigma. Guests include musician and comedian Jordan Raskopoulos, neuroscientist and psychiatrist Thomas Insel, psychiatrist Dixon Chibanda, anxiety and depression researcher Olivia Remes, and entrepreneur Sangu Delle.
Now Playing: Science for the People

#537 Science Journalism, Hold the Hype
Everyone's seen a piece of science getting over-exaggerated in the media. Most people would be quick to blame journalists and big media for getting in wrong. In many cases, you'd be right. But there's other sources of hype in science journalism. and one of them can be found in the humble, and little-known press release. We're talking with Chris Chambers about doing science about science journalism, and where the hype creeps in. Related links: The association between exaggeration in health related science news and academic press releases: retrospective observational study Claims of causality in health news: a randomised trial This...