Nav: Home

How well do laboratory experiments in economics replicate?

March 03, 2016

In a study aiming to replicate laboratory experiments published in high-impact economics journals, researchers reproduced original results in 61% of cases. The work contributes to increasing efforts to demonstrate that scientific findings are reproducible amid continued concern on this matter across disciplines. In recent decades, the reproducibility of results has been questioned in sciences such as medicine, neuroscience and genetics. In economics, concerns have been raised about inflated findings in both empirical and experimental analysis. Here, to contribute data on the latter, Colin Camerer and colleagues replicated 18 experimental studies published in the American Economic Review and the Quarterly Journal of Economics from 2011 through 2014. Four international teams replicated the most important statistically significant finding in each of the 18 studies. All replication and analysis plans were made publicly known on the project website and were also sent to the original authors for verification. To determine what constituted a successful replication, Camerer and colleagues used the same complementary indicators employed in the Reproducibility Project Psychology published in 2015. Ultimately, they were able to reproduce the original results in 11 studies, or 61% of cases. Three more studies were relatively close to being replicated, they said. Their results lead them to conclude that "...replication in this sample of experiments is generally successful, though there is room for improvement." For example, scientists should design and document methods as clearly as possible in anticipation of replications being done in the future.
-end-


American Association for the Advancement of Science

Related Economics Articles:

Research group focuses on economics of transportation needs for rural elderly
A multidisciplinary team of researchers is examining economic issues associated with providing transportation for the rural elderly and other socially disadvantaged populations.
Understanding decisions: The power of combining psychology and economics
A new paper published in the Proceedings of the National Academy of Sciences shows how collaborations between psychologists and economists lead to better understanding of such decisions than either discipline can on its own.
Three Harvard experts explain how economics can shape precision medicines
Many public and private efforts focus on research in precision medicine.
Denmark to honor late Nobel Prize winner Dale T. Mortensen
Three years after the passing of Nobel Prize winner Dale T.
Economics made simple with physics models
Both physical and economic phenomena may possess universal features that could be uncovered using the tools of physics.
Economics of forest biomass raise hurdles for rural development
The use of residual forest biomass for rural development faces significant economic hurdles that make it unlikely to be a source of jobs in the near future, according to an analysis by economists.
'Super yeast' has the power to improve economics of biofuels
Scientists at the University of Wisconsin-Madison and the Great Lakes Bioenergy Research Center have found a way to nearly double the efficiency with which a commonly used industrial yeast strain converts plant sugars to biofuel.
'The Nobel Prize in Economics' and society
In 1968, the scientific status of economics was strengthened by the creation of the 'Nobel Prize in Economic Sciences.' After financial crises, low economic growth and increasing social tension, many are questioning this scientific status.
Tapping into behavioral economics to boost clinical trial participation
Behavioral economics may offer a powerful tool for improving patient enrollment in clinical trials, argue Eric VanEpps, Kevin Volpp, and Scott Halpern in this Focus.
Economics study finds volume discounts don't increase profitability for video game
A study by University of Chicago economists finds discounts tied to buying large quantities of virtual goods have little impact on profitability and do not increase the number of customers making purchases.

Related Economics Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Climate Crisis
There's no greater threat to humanity than climate change. What can we do to stop the worst consequences? This hour, TED speakers explore how we can save our planet and whether we can do it in time. Guests include climate activist Greta Thunberg, chemical engineer Jennifer Wilcox, research scientist Sean Davis, food innovator Bruce Friedrich, and psychologist Per Espen Stoknes.
Now Playing: Science for the People

#527 Honey I CRISPR'd the Kids
This week we're coming to you from Awesome Con in Washington, D.C. There, host Bethany Brookshire led a panel of three amazing guests to talk about the promise and perils of CRISPR, and what happens now that CRISPR babies have (maybe?) been born. Featuring science writer Tina Saey, molecular biologist Anne Simon, and bioethicist Alan Regenberg. A Nobel Prize winner argues banning CRISPR babies won’t work Geneticists push for a 5-year global ban on gene-edited babies A CRISPR spin-off causes unintended typos in DNA News of the first gene-edited babies ignited a firestorm The researcher who created CRISPR twins defends...