Nav: Home

Researchers work toward systematic assessment of climate models

June 25, 2018

A research team based at the Pacific Northwest National Laboratory in Richland, Wash., has published the results of an international survey designed to assess the relative importance climate scientists assign to variables when analyzing a climate model's ability to simulate real-world climate.

The results, which have serious implications for studies using the models, were published as a cover article in Advances in Atmospheric Sciences on June 22, 2018.

"Climate modelers spend a lot of effort on calibrating certain model parameters to find a model version that does a credible job of simulating the Earth's observed climate," said Susannah Burrows, first author on the paper and a scientist at the Pacific Northwest National Laboratory who specializes in Earth systems analysis and modeling.

However, Burrows noted, there is little systematic study on how experts prioritize such variables as cloud cover or sea ice when judging the performance of climate models.

"Different people might come to slightly different assessments of how 'good' a particular model is, depending to large extent on which aspects they assign the most importance to," Burrows said.

One model, for example, may better simulate sea ice while another model excels in cloud simulation. Each scientist must strike a balance between their competing priorities and goals--a difficult thing to capture systematically in data analysis tools.

"In other words, there isn't a single, completely objective definition of what makes a 'good' climate model, and this fact is an obstacle to developing more systematic approaches and tools to assist in model evaluations and comparisons," Burrows said.

The researchers found, from a survey of 96 participants representing the climate modelling community, that experts took specific scientific objectives into consideration when rating variable importance. They found a high degree of consensus that certain variables are important in certain studies, such as rainfall and evaporation in the assessment of the Amazonian water cycle. That agreement falters on other variables, such as how important it is to accurately simulate surface winds when studying the water cycle in Asia.

Understanding these discrepancies and developing more systematic approaches to model assessment is important, according to Burrows, since each new version of a climate model must undergo significant evaluation, and calibration by multiple developers and users. The labor-intensive process can take more than a year.

The tuning, while designed to maintain a rigorous standard, requires experts to make trade-offs between competing priorities. A model may be calibrated at the expense of one scientific objective in order to achieve another.

Burrows is a member of an interdisciplinary research team at PNNL working to develop a more systematic solution to this assessment problem. The team includes Aritra Dasgupta, Lisa Bramer, and Sarah Reehl, experts in data science and visualization, and Yun Qian, Po-Lun Ma, and Phil Rasch, climate science experts.

To help climate modelers understand these trade-offs more clearly and efficiently, the visualization researchers are building interactive, intuitive visual interfaces that allow modelers to summarize and explore complex information about different aspects of model performance.

The data scientists are working to characterize expert climate model assessment in greater detail, building on the findings from the initial survey. Eventually, the researchers aim to blend a combination of metrics with human expertise to assess how well-suited climate models are for specific science objectives, as well as to predict how frequently experts will agree or disagree with that assessment.

"[We plan] to combine the best of both worlds, using computing to reduce manual effort and allowing scientists to more efficiently apply their human insight and judgment where it is most needed," Burrows said.
-end-
This work was conducted as part of a project led by Dasgupta, the principle investigator and co-author on the paper, and Bramer, co-principle investigator and co-author on the paper, under the Laboratory Directed Research and Development Program at the Pacific Northwest National Laboratory, a multi-program national laboratory operated by Battelle for the U.S. Department of Energy.

Institute of Atmospheric Physics, Chinese Academy of Sciences

Related Sea Ice Articles:

Low sea-ice cover in the Arctic
The sea-ice extent in the Arctic is nearing its annual minimum at the end of the melt season in September.
Arctic sea ice 2019 wintertime extent is seventh lowest
Sea ice in the Arctic appears to have hit its annual maximum extent after growing through the fall and winter.
Study shows algae thrive under Greenland sea ice
Microscopic marine plants flourish beneath the ice that covers the Greenland Sea, according to a new study in the Journal of Geophysical Research: Oceans.
ICESat-2 reveals profile of ice sheets, sea ice, forests
With each pass of the ICESat-2 satellite, the mission is adding to datasets tracking Earth's rapidly changing ice.
Arctic cyclone limits the time-scale of precise sea-ice prediction in Northern Sea Route?
Climate change has accelerated sea-ice retreat in the Arctic Ocean, leading to new opportunities for summer commercial maritime navigation along the Northern Sea Route.
Ocean waves following sea ice loss trigger Antarctic ice shelf collapse
Storm-driven ocean swells have triggered the catastrophic disintegration of Antarctic ice shelves in recent decades, according to new research published in Nature today.
New technique more accurately reflects ponds on Arctic sea ice
This one simple mathematical trick can accurately predict the shape and melting effects of ponds on Arctic sea ice, according to new research by UChicago scientists.
Arctic wintertime sea ice extent is among lowest on record
Sea ice in the Arctic grew to its annual maximum extent last week, and joined 2015, 2016 and 2017 as the four lowest maximum extents on record, according to scientists at the NASA-supported National Snow and Ice Data Center (NSIDC) and NASA.
Sea ice algae blooms in the dark
Researchers from Aarhus University have measured a new world record: Small ice algae on the underside of the Arctic sea ice live and grow at a light level corresponding to only 0.02 percent of the light at the surface of the ice.
Weather anomalies accelerate the melting of sea ice
ETH researchers reveal why Arctic sea ice began to melt in the middle of winter two years ago -- and that the increased melting of ice in summer is linked to recurring periods of fair weather.
More Sea Ice News and Sea Ice Current Events

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Rethinking Anger
Anger is universal and complex: it can be quiet, festering, justified, vengeful, and destructive. This hour, TED speakers explore the many sides of anger, why we need it, and who's allowed to feel it. Guests include psychologists Ryan Martin and Russell Kolts, writer Soraya Chemaly, former talk radio host Lisa Fritsch, and business professor Dan Moshavi.
Now Playing: Science for the People

#538 Nobels and Astrophysics
This week we start with this year's physics Nobel Prize awarded to Jim Peebles, Michel Mayor, and Didier Queloz and finish with a discussion of the Nobel Prizes as a way to award and highlight important science. Are they still relevant? When science breakthroughs are built on the backs of hundreds -- and sometimes thousands -- of people's hard work, how do you pick just three to highlight? Join host Rachelle Saunders and astrophysicist, author, and science communicator Ethan Siegel for their chat about astrophysics and Nobel Prizes.