Inaccurate reporting jeopardizing clinical trials

April 26, 2015

The team led by Dr Sheena Cruickshank of the Faculty of Life Sciences and Professor Andy Brass from the School of Computer Science analysed 58 papers on research into inflammatory bowel disease published between 2000 and 2014. They found a wide variety in how methods were reported and that vital information about experiments were missing, meaning they couldn't be accurately reproduced in animal or human models.

In several instances the gender of the animal used wasn't recorded which can have a bearing on the result as female mice have a stronger immune response to males. How the animals were housed will also impact on the results in experiments about the gut.

Dr Cruickshank says she was shocked at the lack of information provided in papers: "What our research has uncovered is that this lack of data makes it difficult to validate the experiment and the result. Crucially this is having an impact of the reproducibility of experiments, both in the animal model and when transferred to human trials."

The problem first became clear to the researchers when they were looking at building a knowledge base to help pull together research on inflammatory bowel disease (colitis). Working with computer scientists it became clear to the biologists that the data couldn't be understood by colleagues from different disciplines.

Professor Andy Brass says: "So much research is now being carried out across disciplines so it's vital that experiments can be understood by as many scientists as possible. Relying on the reader to make assumptions based on their own experience will only lead to errors, but this is what many papers are asking people to do when they come to replicate the research."

To address the issue the team have developed a critical checklist of what information should be included. It covers nine areas ranging from information about the animals, their housing condition, genetics, how colitis is induced, experiment design and monitoring. The checklist is included in their paper due to be published in the journal Inflammatory Bowel Diseases.

Dr Cruickshank explains: "Our checklist sounds like fairly basic information that should be in all papers. But over the past few years journals have asked for more and more abbreviated methods so information has stopped being included. Instead papers are focussed on the results and discussion and sometimes you have to go back to a paper from the sixties to find the last time a particular method was accurately recorded."

Whilst the researchers have been critical of the method reporting they are keen to point out that their criticism doesn't mean the research isn't valid or accurate. The experiments may well be sound, but the lack of detail in how they're reported makes that judgement more difficult to make and the reproducibility much harder.

As an example Dr Cruickshank points to the test case for the Reproducibility Initiative which was published in the journal PLOS One in December last year. The team wanted to reproduce an experiment which had found that peptide hormones made naturally by cattle are efficient killers of the parasite Leishmania major. When they followed the reported methodology they had to up the dose by ten times to get the same result. But what had actually happened was that the original paper had not precisely described the molecules involved.

Moving forward the Manchester team is recommending the adoption of their checklist as a requirement for publication to improve the quality, comparability and standardization of studies into inflammatory bowel disease. They believe it will make the interpretation and translation of data to human disease more reliable and ultimately contribute to making clinical trials more successful.
Notes to Editors:

Embargoed: 00:01 Monday 27 April 2015

The paper "Quality of Methods Reporting in Animal Models of Colitis" will be published in the journal Inflammatory Bowel Diseases.

For more information and interview requests please contact:

Morwenna Grills
Media Relations Officer
Faculty of Life Sciences
The University of Manchester

Tel: 0161 275 2111
Mob: 07920 087466

Tweet: @MorwennaGrills


Sam Wood
Media Relations Officer
University of Manchester
Tel: +44 (0)161 2758155
Mob: +44 (0)7886 473422

University of Manchester

Related Inflammatory Bowel Disease Articles from Brightsurf:

People with inflammatory bowel disease still die earlier despite increase in life
A study comparing life expectancy of people with inflammatory bowel disease (IBD) and without found that, while life expectancy increased for both groups, people with IBD generally died sooner.

Cell therapy designed to treat inflammatory bowel disease
The UPV/EHU's NanoBioCel research group has for many years been developing systems enabling cells to be used as drugs.

Team develops wearable sensor to help people with inflammatory bowel disease
University of Texas at Dallas researchers have designed a wearable device that monitors sweat for biomarkers that could signal flare-ups of inflammatory bowel disease (IBD).

Antibiotics associated with increased risk of inflammatory bowel disease
Antibiotics use, particularly antibiotics with greater spectrum of microbial coverage, may be associated with an increased risk of new-onset inflammatory bowel disease (IBD) and its subtypes ulcerative colitis and Crohn's disease.

Yes, inflammatory bowel disease and celiac disease are linked
A systematic review and meta-analysis that has determined there is a nine-fold increased risk of having IBD for patients with a previous diagnosis of celiac disease.

The effects of inflammatory bowel disease on pregnancy
Inflammatory bowel disease (IBD) -- including Crohn's disease and ulcerative colitis -- often affects women of childbearing age.

5 major advances in inflammatory bowel disease (IBD) treatment
Summary of five impactful studies to be presented at the Crohn's & Colitis Congress, a partnership of the Crohn's & Colitis Foundation and the American Gastroenterological Association (AGA).

Researchers identify a possible cause and treatment for inflammatory bowel disease
In a study published online in PNAS on Jan. 20, 2020, Prof.

Does inflammatory bowel disease carry certain risks during pregnancy?
Pregnant women with inflammatory bowel disease (IBD) are more likely to undergo delivery by Caesarean section and face certain risks during pregnancy, according to an analysis published in Alimentary Pharmacology & Therapeutics.

Inhibiting a protease could improve the treatment of inflammatory bowel disease
Scientists at the CNIC and CSIC have identified a function of a protease that could be the future target of drugs to treat inflammatory bowel disease.

Read More: Inflammatory Bowel Disease News and Inflammatory Bowel Disease Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to