Evaluation of scientific rigor in animal research

December 02, 2016

The "reproducibility crisis" in biomedical research has led to questions about the scientific rigor in animal research, and thus the ethical justification of animal experiments. In research publishing in the Open Access journals PLOS Biology and PLOS ONE on December 2nd, 2016, researchers from the University of Bern have assessed scientific rigor in animal experimentation in Switzerland. The study, commissioned by the Swiss Federal Food Safety and Veterinary Office (FSVO), found widespread deficiencies in the reporting of experimental methodology.

In a first step, PhD student Lucile Vogt and postdoc Thomas Reichlin from the Division of Animal Welfare at the Vetsuisse Faculty in Bern screened all 1,277 approved applications for animal experiments in Switzerland in 2008, 2010 and 2012, as well as a random sample of 50 scientific publications resulting from studies described in the applications. The materials were assessed to determine whether seven basic methods that can help combat experimental bias were reported (including randomization, blinding, and sample size calculation). Appropriate use and understanding of these methods is a prerequisite for unbiased, scientifically valid results, says lead author Prof. Hanno Würbel, director of the Division of Animal Welfare.

As published in their PLOS Biology study, explicit evidence that these methods were used either in the applications for animal experiments or in the subsequent publications was scarce. For example, fewer than 20% of applications and publications mentioned whether a sample size calculation had been performed (8% in applications, 0% in publications), whether the animals had been assigned randomly to treatment groups (13% in applications, 17% in publications), and whether outcome assessment had been conducted blind to treatment (3% in applications, 11% in publications).

Animal experiments are authorized based on the explicit understanding that they will provide significant new knowledge and that animals will suffer no unnecessary harm. Thus, scientific rigor is a fundamental prerequisite for the ethical justification of animal experiments. Based on this study, the current practice of authorizing animal experiments appears to rest on an assumption of scientific rigor, rather than on evidence that it is applied. The authors of this study recommend more education and training in good research practice and scientific integrity for all those involved in this process.

Although the initial results found that fewer than 20 percent of applications and publications used methods to control for bias, that didn't necessarily mean that more than 80 percent of animal studies failed to include methods to combat bias, and therefore use animals for potentially inconclusive research. "It is possible that the researchers did use these methods but did not mention them in their applications and publications," says study director Hanno Würbel. "So we decided to ask the researchers."

The researchers used an online survey for all 1,891 animal researchers registered in the central online information system of the FSVO who were involved with ongoing experiments. Among other questions, researchers were asked what bias-reducing methods they normally use when conducting animal experiments and which of these they had explicitly reported in their latest scientific publication.

According to the researchers' responses, as published in their PLOS ONE study, the use of methods against bias is considerably higher than reported in the animal research applications and publications. 86% of the participants claimed to assign animals randomly to treatment groups, but only 44% answered that they had reported this in their latest publication. The same applies to the other measures, for example, for sample size calculation (69% claimed to be doing this, but only 18% say they reported it in their latest publication) and for blinded outcome assessment (47% vs. 27%).

Taken together, the researchers draw two conclusions from these results: on the one hand, reporting in animal research applications or publications may underestimate the use of bias-reducing methods. On the other hand, the researchers may overestimate their use of appropriate methods. "We found considerably fewer publications with explicit evidence of the use of measures against risks of bias than claimed by the researchers", says Würbel. For example, 44% of the participants claimed to have reported randomization in their latest publication, but Würbel's team found evidence of randomization in only 17% of publications.
In your coverage please use this URL to provide access to the freely available article in PLOS Biology: http://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.2000598 and this URL to provide access to the freely available article in PLOS ONE: http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0165999

Citations: Vogt L, Reichlin TS, Nathues C, Würbel H (2016) Authorization of Animal Experiments Is Based on Confidence Rather than Evidence of Scientific Rigor. PLoS Biol 14(12): e2000598. doi:10.1371/journal.pbio.2000598

Reichlin TS, Vogt L, Würbel H (2016) The Researchers' View of Scientific Rigor--Survey on the Conduct and Reporting of In Vivo Research. PLoS ONE 11(12): e0165999. doi:10.1371/journal.pone.0165999

Funding: Swiss Food Safety and Veterinary Office (FSVO) https://www.blv.admin.ch/ (grant number 2.13.01). LV and TSR were fully funded through this grant. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing Interests: The authors have declared that no competing interests exist.


Related Bias Articles from Brightsurf:

Gender bias kept alive by people who think it's dead
Workplace gender bias is being kept alive by people who think it's no longer an issue, new research suggests.

Sex bias in pain research
Most pain research remains overwhelmingly based on the study of male rodents, continuing to test hypotheses derived from earlier experiments on males.

Effects of gender bias, stereotypes in surgical training
This randomized clinical trial investigated the association between pro-male gender bias and negative stereotypes against women during surgical residency on surgical skills and proactive career development of residents in general surgery training programs.

New research finds racial bias in rideshare platforms
New research to be published in the INFORMS journal Management Science has found popular rideshare platforms exhibit racial and other biases that penalize under-represented minorities and others seeking to use their services.

Scientists can see the bias in your brain
The strength of alpha brain waves reveals if you are about to make a biased decision, according to research recently published in JNeurosci.

Design approach may help fix bias in artificial intelligence
Bias in artificial intelligence is well established. Researchers are now proposing that developers incorporate the concept of 'feminist design thinking' into their process as a way of improving equity -- particularly in the development of software used in hiring.

A cautionary tale about measuring racial bias in policing
Racial bias and policing made headlines last year after a study examining records of fatal police shootings claimed white officers were no more likely to shoot racial minorities than nonwhite officers.

Scientists reveal the neural basis of confirmation bias
An international research team comprising neuroscientists at Virginia Tech and the University of London revealed brain mechanisms and functional regions that underlie confirmation bias -- a phenomenon where people strongly favor information that reinforces their existing opinions over contradictory ones.

Scientists take action to prevent sexual harassment and bias
In a policy paper published in the journal Science, scientists from a variety of fields highlight key ways institutions and funding agencies can help address sexual harassment and gender bias in the STEM workplace.

'I knew that was going to happen:' Déjà vu and the 'postdictive' bias
Memory researcher Anne Cleary has a new theory on why déjà vu is accompanied not only by feelings of prediction, but also an 'I knew that was going to happen' feeling.

Read More: Bias News and Bias Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.