Nav: Home

Faulty modeling studies led to overstated predictions of Ebola outbreak

March 31, 2015

ANN ARBOR--Frequently used approaches to understanding and forecasting emerging epidemics--including the West African Ebola outbreak--can lead to big errors that mask their own presence, according to a University of Michigan ecologist and his colleagues.

"In the early days of the Ebola outbreak, a lot of people got into the forecasting business. They did it using appealingly simple mathematical models, and the result was a series of warnings that alerted the world, quite rightly, to the seriousness of the situation," said Aaron King, an associate professor in the U-M Department of Ecology and Evolutionary Biology.

"But in the end, most of those predictions turned out to be overstated."

On March 23, exactly one year after it announced there was an Ebola outbreak in Guinea, the World Health Organization released a situation update stating that there had been 24,842 Ebola cases, including 10,299 deaths, to date in Sierra Leone, Liberia and Guinea.

Last September, the U.S. Centers for Disease Control and Prevention estimated--based on computer modeling--that Liberia and Sierra Leone could see up to 1.4 million Ebola cases by January 2015 if the viral disease kept spreading without effective methods to contain it. Belatedly, the international community stepped up efforts to control the outbreak, and the explosive growth slowed.

"Those predictions proved to be wrong, and it was not only because of the successful intervention in West Africa," King said. "It's also because the methods people were using to make the forecasts were inappropriate."

In a paper scheduled for online publication March 31 in Proceedings of the Royal Society B, King and his colleagues suggest several straightforward and inexpensive ways to avoid those pitfalls when the next big infectious disease outbreak strikes. Their suggestions pertain to disease transmission models, sophisticated systems of equations that use data from the early stages of an outbreak to predict how it will unfold.

"It's just a matter of time before the next outbreak, and we want to make sure that we know how to provide reliable forecasts to guide the public health response when it happens," King said.

Many of last year's Ebola forecasts were made using common, off-the-shelf transmission models called deterministic models. Such models don't account for the random elements in disease transmission--how many people are infected by each transmission event, for example--and are in incapable of accurately communicating uncertainty.

King and his colleagues say deterministic models should be avoided. So-called stochastic models, which account for randomness and which can more precisely communicate uncertainty, should be used instead.

In addition to using deterministic models, many Ebola forecasters tried to fit those models to the total number of cases that had accumulated since the start of the outbreak. The end result was forecasts that overestimated the eventual size of the Ebola outbreak and greatly underestimated the uncertainty in those forecasts, according to King and his colleagues.

"Deterministic models are easier and faster to work with, and the results look really good," King said. "But when you use them, it's a double whammy. Not only are you wrong, you are very sure that you are right."
Co-authors of the paper are Pejman Rohani, Matthieu Domenech de Celles and Felicia M.G. Magpantay of the U-M Department of Ecology and Evolutionary Biology. King and Rohani also have appointments at the U-M Center for the Study of Complex Systems, and King is an associate professor of mathematics. King and Rohani are supported by the Department of Homeland Security and the National Institutes of Health.

University of Michigan

Related Outbreak Articles:

Lessons from Ebola: New approach improves disease outbreak management
A new approach could quickly identify the most effective way to manage disease outbreaks -- an advance that could save lives.
Cost of Zika outbreak in the United States could be high
Even a relatively mild Zika outbreak in the United States could cost more than $183 million in medical costs and productivity losses, suggests a computational analysis led by Johns Hopkins Bloomberg School of Public Health researchers, while a more severe one could result in $1.2 billion or more in medical costs and productivity losses.
States can lower risk of measles outbreak by strengthening exemption policies
States with weaker non-medical exemption policies for vaccinations can reduce the likelihood of a measles outbreak 140 to 190 percent by strengthening them, a new study from the University of Colorado Anschutz Medical Campus shows.
Contact tracing, with indoor spraying, can curb dengue outbreak
This novel approach for the surveillance and control of dengue fever -- spread by the same mosquito species that infects people with the Zika virus -- was between 86 and 96 percent effective during one outbreak.
HIV therapy could be contributing to syphilis outbreak: UBC study
Drugs used to treat HIV could affect how the body responds to syphilis, inadvertently contributing to a current outbreak, a new study suggests.
More Outbreak News and Outbreak Current Events

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Teaching For Better Humans
More than test scores or good grades — what do kids need to prepare them for the future? This hour, guest host Manoush Zomorodi and TED speakers explore how to help children grow into better humans, in and out of the classroom. Guests include educators Olympia Della Flora and Liz Kleinrock, psychologist Thomas Curran, and writer Jacqueline Woodson.
Now Playing: Science for the People

#534 Bacteria are Coming for Your OJ
What makes breakfast, breakfast? Well, according to every movie and TV show we've ever seen, a big glass of orange juice is basically required. But our morning grapefruit might be in danger. Why? Citrus greening, a bacteria carried by a bug, has infected 90% of the citrus groves in Florida. It's coming for your OJ. We'll talk with University of Maryland plant virologist Anne Simon about ways to stop the citrus killer, and with science writer and journalist Maryn McKenna about why throwing antibiotics at the problem is probably not the solution. Related links: A Review of the Citrus Greening...