Nav: Home

Why we should trust registered clinical trials

June 04, 2020

In a time when we have to rely on clinical trials for COVID-19 drugs and vaccines, a new study in the Proceedings of the National Academy of Sciences of the United States of America (PNAS) brings good news about the credibility of registered clinical trials.

The authors are two Bocconi Professors of Economics, Jerome Adda and Marco Ottaviani, and a former MSc student of theirs, Christian Decker, now a PhD candidate at the University of Zurich.

In a clinical trial, statistical significance is a key prerequisite for marketing approval of new drugs. Under a certain threshold of significance, the results of the trial could in fact be due to chance and not to the efficacy of the drug. Given the research costs involved and the lure of large potential profits by the pharmaceutical companies sponsoring the trial, investigators may be pressured to beautify data, a standard argument goes. Previous studies of results of statistical tests reported in scientific journals across a number of disciplines did actually detect an anomalous concentration of significance values immediately above the significance threshold, raising suspicions of selective reporting as well as manipulation.

Adda, Ottaviani and Decker concentrated their attention on the trials registered in ClinicalTrials.gov, the largest registry in the world, and focused on the differences in the results of phase II and phase III trials of the same drug. In phase II a drug's efficacy is initially established in a small sample of people (usually in the low hundreds); in phase III safety and efficacy are then confirmed in a larger group of volunteers (usually in the low thousands). Reasonable expectations are that the statistical significance of phase II will be confirmed in phase III and that trials that record a significance level under the threshold in phase II will be suspended.

Observing all the registered trials, the scholars observe a discontinuity around the significance threshold value only in phase III, but not the spike denounced by previous studies: trials just above the thresholds are only slightly more numerous than expected. They, then, limit their observations to the trials registered by the top-10 pharma companies and by smaller operators. While larger companies are more inclined to suspend experimentation under threshold in phase II, small companies tend to continue with more of the trials under threshold and end up recording a higher share of trials above threshold in phase III. The predicted share of trial results above threshold in phase III for large companies is 65%, and the actually recorded share 68%; with small companies (that bring to phase III also less promising drug candidates), the figures are 57% and 76%.

"Even in the case of phase III trials by small companies", Professor Ottaviani explains, "we do not observe the spike of results just above the significance threshold. We think that the registration process is key for transparency".
-end-
Jerome Adda, Christian Decker, Marco Ottaviani, "P-hacking in clinical trials and how incentives shape the distribution of results across phases", in Proceedings of the National Academy of Sciences of the United States of America (PNAS), 2 June 2020, DOI: 10.1073/pnas.1919906117.

Bocconi University

Related Clinical Trials Articles:

COVID-19 clinical trials lack diversity
Despite disproportionately higher rates of COVID-19 infection, hospitalization and death among people of color, minority groups are significantly underrepresented in COVID-19 clinical trials.
Why we should trust registered clinical trials
In a time when we have to rely on clinical trials for COVID-19 drugs and vaccines, a new study brings good news about the credibility of registered clinical trials.
Inclusion of children in clinical trials of treatments for COVID-19
This Viewpoint discusses the exclusion of children from coronavirus disease 2019 (COVID-19) clinical trials and why that could harm treatment options for children.
Review evaluates how AI could boost the success of clinical trials
In a review publishing July 17, 2019 in the journal Trends in Pharmacological Sciences, researchers examined how artificial intelligence (AI) could affect drug development in the coming decade.
Kidney patients are neglected in clinical trials
The exclusion of patients with kidney diseases from clinical trials remains an unsolved problem that hinders optimal care of these patients.
Clinical trials beginning for possible preeclampsia treatment
For over 20 years, a team of researchers at Lund University has worked on developing a drug against preeclampsia -- a serious disorder which annually affects around 9 million pregnant women worldwide and is one of the main causes of death in both mothers and unborn babies.
Underenrollment in clinical trials: Patients not the problem
The authors of the study published this month in the Journal of Clinical Oncology investigated why many cancer clinical trials fail to enroll enough patients.
When designing clinical trials for huntington's disease, first ask the experts
Progress in understanding the genetic mutation responsible for Huntington's disease (HD) and at least some molecular underpinnings of the disease has resulted in a new era of clinical testing of potential treatments.
New ALS therapy in clinical trials
New research led by Washington University School of Medicine in St.
Telemedicine helps improve participation in clinical trials
Videos and creative uses of other visuals provide a novel way to obtain informed consent during clinical trials to improve participants' understanding and retention of trial information, according to a study by Nemours Children's Health System presented at the American Thoracic Society (ATS) Annual Conference.
More Clinical Trials News and Clinical Trials Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Listen Again: The Power Of Spaces
How do spaces shape the human experience? In what ways do our rooms, homes, and buildings give us meaning and purpose? This hour, TED speakers explore the power of the spaces we make and inhabit. Guests include architect Michael Murphy, musician David Byrne, artist Es Devlin, and architect Siamak Hariri.
Now Playing: Science for the People

#576 Science Communication in Creative Places
When you think of science communication, you might think of TED talks or museum talks or video talks, or... people giving lectures. It's a lot of people talking. But there's more to sci comm than that. This week host Bethany Brookshire talks to three people who have looked at science communication in places you might not expect it. We'll speak with Mauna Dasari, a graduate student at Notre Dame, about making mammals into a March Madness match. We'll talk with Sarah Garner, director of the Pathologists Assistant Program at Tulane University School of Medicine, who takes pathology instruction out of...
Now Playing: Radiolab

What If?
There's plenty of speculation about what Donald Trump might do in the wake of the election. Would he dispute the results if he loses? Would he simply refuse to leave office, or even try to use the military to maintain control? Last summer, Rosa Brooks got together a team of experts and political operatives from both sides of the aisle to ask a slightly different question. Rather than arguing about whether he'd do those things, they dug into what exactly would happen if he did. Part war game part choose your own adventure, Rosa's Transition Integrity Project doesn't give us any predictions, and it isn't a referendum on Trump. Instead, it's a deeply illuminating stress test on our laws, our institutions, and on the commitment to democracy written into the constitution. This episode was reported by Bethel Habte, with help from Tracie Hunte, and produced by Bethel Habte. Jeremy Bloom provided original music. Support Radiolab by becoming a member today at Radiolab.org/donate.     You can read The Transition Integrity Project's report here.