Nav: Home

How well do laboratory experiments in economics replicate?

March 03, 2016

In a study aiming to replicate laboratory experiments published in high-impact economics journals, researchers reproduced original results in 61% of cases. The work contributes to increasing efforts to demonstrate that scientific findings are reproducible amid continued concern on this matter across disciplines. In recent decades, the reproducibility of results has been questioned in sciences such as medicine, neuroscience and genetics. In economics, concerns have been raised about inflated findings in both empirical and experimental analysis. Here, to contribute data on the latter, Colin Camerer and colleagues replicated 18 experimental studies published in the American Economic Review and the Quarterly Journal of Economics from 2011 through 2014. Four international teams replicated the most important statistically significant finding in each of the 18 studies. All replication and analysis plans were made publicly known on the project website and were also sent to the original authors for verification. To determine what constituted a successful replication, Camerer and colleagues used the same complementary indicators employed in the Reproducibility Project Psychology published in 2015. Ultimately, they were able to reproduce the original results in 11 studies, or 61% of cases. Three more studies were relatively close to being replicated, they said. Their results lead them to conclude that "...replication in this sample of experiments is generally successful, though there is room for improvement." For example, scientists should design and document methods as clearly as possible in anticipation of replications being done in the future.
-end-


American Association for the Advancement of Science

Related Economics Articles:

Research group focuses on economics of transportation needs for rural elderly
A multidisciplinary team of researchers is examining economic issues associated with providing transportation for the rural elderly and other socially disadvantaged populations.
Understanding decisions: The power of combining psychology and economics
A new paper published in the Proceedings of the National Academy of Sciences shows how collaborations between psychologists and economists lead to better understanding of such decisions than either discipline can on its own.
Three Harvard experts explain how economics can shape precision medicines
Many public and private efforts focus on research in precision medicine.
Denmark to honor late Nobel Prize winner Dale T. Mortensen
Three years after the passing of Nobel Prize winner Dale T.
Economics made simple with physics models
Both physical and economic phenomena may possess universal features that could be uncovered using the tools of physics.
Economics of forest biomass raise hurdles for rural development
The use of residual forest biomass for rural development faces significant economic hurdles that make it unlikely to be a source of jobs in the near future, according to an analysis by economists.
'Super yeast' has the power to improve economics of biofuels
Scientists at the University of Wisconsin-Madison and the Great Lakes Bioenergy Research Center have found a way to nearly double the efficiency with which a commonly used industrial yeast strain converts plant sugars to biofuel.
'The Nobel Prize in Economics' and society
In 1968, the scientific status of economics was strengthened by the creation of the 'Nobel Prize in Economic Sciences.' After financial crises, low economic growth and increasing social tension, many are questioning this scientific status.
Tapping into behavioral economics to boost clinical trial participation
Behavioral economics may offer a powerful tool for improving patient enrollment in clinical trials, argue Eric VanEpps, Kevin Volpp, and Scott Halpern in this Focus.
Economics study finds volume discounts don't increase profitability for video game
A study by University of Chicago economists finds discounts tied to buying large quantities of virtual goods have little impact on profitability and do not increase the number of customers making purchases.

Related Economics Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Bias And Perception
How does bias distort our thinking, our listening, our beliefs... and even our search results? How can we fight it? This hour, TED speakers explore ideas about the unconscious biases that shape us. Guests include writer and broadcaster Yassmin Abdel-Magied, climatologist J. Marshall Shepherd, journalist Andreas Ekström, and experimental psychologist Tony Salvador.
Now Playing: Science for the People

#513 Dinosaur Tails
This week: dinosaurs! We're discussing dinosaur tails, bipedalism, paleontology public outreach, dinosaur MOOCs, and other neat dinosaur related things with Dr. Scott Persons from the University of Alberta, who is also the author of the book "Dinosaurs of the Alberta Badlands".