Nav: Home

Majority of first-wave COVID-19 clinical trials have significant design shortcomings, study finds

June 09, 2020

Most of the registered clinical trials of potential treatments for COVID-19 underway as of late March were designed in ways that will greatly limit their value in understanding potential treatments, according to a study from researchers at Johns Hopkins Bloomberg School of Public Health.

The researchers, whose findings appear June 9 in the journal BMJ Open, analyzed the 201 clinical trials for drugs or plasma that, as of March 26, had been registered in the U.S. under ClinicalTrials.gov and in the international clinical trials registry maintained by the World Health Organization (WHO). Of the trials analyzed in this early snapshot, 100 (49.8 percent) were registered in China and 78 (37.8 percent) in the U.S. The majority of trials in the U.S. clinical trials registry were registered from international researchers. Among the 201 trials analyzed, 126 were recruiting participants from China, 31 from Europe, 14 from the U.S.

The researchers found that many of the trials lacked key features needed to optimize their scientific value such as the use of control groups and patient and clinician blinding.

The analysis found that one-third of trials lacked clinical endpoints to clearly define success or failure. Nearly one-half were designed to enroll fewer than 100 patients, limiting their usefulness to assess modestly-sized treatment benefits. Two-thirds were "open label," meaning that patients and doctors were aware who did and didn't receive the treatment--in principle, allowing their unconscious expectations to influence the results.

"Because of these weaknesses, many of these studies are likely to yield only preliminary evidence," says study first author Hemalkumar Mehta, PhD, an assistant professor in the Department of Epidemiology at the Bloomberg School. "Given the urgency of identifying definitive evidence on potential COVID-19 treatments, this is an instance where we wish we did not have to say 'further research is needed' because of basic trial design shortcomings and small trials."

The rapid initiation of so many clinical trials reflects the lack of any effective treatment for acute COVID-19 disease, whose global toll exceeds 400,857 deaths worldwide as of June 8, 2020, according to the World Health Organization's situation report. Of the 201 trials the researchers analyzed in their paper, the vast majority involved treatments already used for other diseases--treatments that could potentially be repurposed for COVID-19 relatively quickly because they have existing safety profiles and have already been evaluated by the U.S. Food and Drug Administration or other regulators around the globe.

U.S. doctors generally have wide discretion to prescribe FDA-approved drugs for other, "off-label" conditions. The authors note that off-label use can carry risks, and it is essential that therapies, including those used off-label, are studied for safety and effectiveness for COVID-19.

In all, the 201 trials involved 92 distinct drugs as well as antibody-containing blood plasma.

Mehta and colleagues found that most of these trials demonstrated design weaknesses. For example, about a third had no defined clinical endpoint, such as hospital discharge or survival, by which success could be measured. About a quarter lacked the standard random assignment of patients to a candidate treatment or control/comparator drug. Of the 152 trials that did randomize patients to a treatment or comparator, only 55 involved the usual practice of 'blinding'--a bias-reducing strategy in which patients as well as doctors and others who direct care and assess outcomes are kept from knowing who received the treatment or placebo.

"We understand the urgency of clinical research on COVID-19, but this is a time when we need rigorous science to inform policy and clinical decision-making," says study senior author G. Caleb Alexander, MD, professor in the Department of Epidemiology at the Bloomberg School. "Any treatment that is ultimately deemed safe and effective via robust trials could potentially be used by millions of people."

The researchers noted that the number of U.S.- or WHO-registered clinical trials of potential COVID-19 treatments tripled from the beginning of March to March 26 when they did their snapshot survey, and since March 26 has risen to more than 2,000 registered trials as of June 8, 2020, as new trials are registered on a daily basis.

"As the safety and effectiveness of new treatments are evaluated, it's vital that we use the best science to do so," Mehta says. "It's especially important at this juncture with many lives in the balance."
-end-
"Characteristics of registered clinical trials assessing treatments for COVID-19: a cross-sectional analysis" was written by Hemalkumar B. Mehta, Stephan Ehrhardt, Thomas J. Moore, Jodi Segal, and G. Caleb Alexander.

Disclosure: Alexander is past chair of the FDA's Peripheral and Central Nervous System Advisory Committee; has served as a paid advisor to IQVIA; is a co-founding principal and equity holder in Monument Analytics, a health care consultancy whose clients include the life sciences industry as well as plaintiffs in opioid litigation; and is a member of OptumRx's National P&T Committee.

Johns Hopkins University Bloomberg School of Public Health

Related Public Health Articles:

COVID-19 and the decolonization of Indigenous public health
Indigenous self-determination, leadership and knowledge have helped protect Indigenous communities in Canada during the coronavirus disease 2019 (COVID-19) pandemic, and these principles should be incorporated into public health in future, argue the authors of a commentary in CMAJ (Canadian Medical Association Journal) http://www.cmaj.ca/lookup/doi/10.1503/cmaj.200852.
Public health consequences of policing homelessness
In a new study examining homelessness, researchers find that policy such a lifestyle has massive public health implications, making sleeping on the street even MORE unhealthy.
Electronic health information exchange improves public health disease reporting
Disease tracking is an important area of focus for health departments in the midst of the COVID-19 pandemic.
Pandemic likely to cause long-term health problems, Yale School of Public Health finds
The coronavirus pandemic's life-altering effects are likely to result in lasting physical and mental health consequences for many people--particularly those from vulnerable populations--a new study led by the Yale School of Public Health finds.
The Lancet Public Health: US modelling study estimates impact of school closures for COVID-19 on US health-care workforce and associated mortality
US policymakers considering physical distancing measures to slow the spread of COVID-19 face a difficult trade-off between closing schools to reduce transmission and new cases, and potential health-care worker absenteeism due to additional childcare needs that could ultimately increase mortality from COVID-19, according to new modelling research published in The Lancet Public Health journal.
The Lancet Public Health: Access to identification documents reflecting gender identity may improve trans mental health
Results from a survey of over 20,000 American trans adults suggest that having access to identification documents which reflect their identified gender helps to improve their mental health and may reduce suicidal thoughts, according to a study published in The Lancet Public Health journal.
The Lancet Public Health: Study estimates mental health impact of welfare reform, Universal Credit, in Great Britain
The 2013 Universal Credit welfare reform appears to have led to an increase in the prevalence of psychological distress among unemployed recipients, according to a nationally representative study following more than 52,000 working-age individuals from England, Wales, and Scotland over nine years between 2009-2018, published as part of an issue of The Lancet Public Health journal on income and health.
BU researchers: Pornography is not a 'public health crisis'
Researchers from the Boston University School of Public Health (BUSPH) have written an editorial in the American Journal of Public Health special February issue arguing against the claim that pornography is a public health crisis, and explaining why such a claim actually endangers the health of the public.
The Lancet Public Health: Ageism linked to poorer health in older people in England
Ageism may be linked with poorer health in older people in England, according to an observational study of over 7,500 people aged over 50 published in The Lancet Public Health journal.
Study: Public transportation use linked to better public health
Promoting robust public transportation systems may come with a bonus for public health -- lower obesity rates.
More Public Health News and Public Health Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Listen Again: The Power Of Spaces
How do spaces shape the human experience? In what ways do our rooms, homes, and buildings give us meaning and purpose? This hour, TED speakers explore the power of the spaces we make and inhabit. Guests include architect Michael Murphy, musician David Byrne, artist Es Devlin, and architect Siamak Hariri.
Now Playing: Science for the People

#576 Science Communication in Creative Places
When you think of science communication, you might think of TED talks or museum talks or video talks, or... people giving lectures. It's a lot of people talking. But there's more to sci comm than that. This week host Bethany Brookshire talks to three people who have looked at science communication in places you might not expect it. We'll speak with Mauna Dasari, a graduate student at Notre Dame, about making mammals into a March Madness match. We'll talk with Sarah Garner, director of the Pathologists Assistant Program at Tulane University School of Medicine, who takes pathology instruction out of...
Now Playing: Radiolab

What If?
There's plenty of speculation about what Donald Trump might do in the wake of the election. Would he dispute the results if he loses? Would he simply refuse to leave office, or even try to use the military to maintain control? Last summer, Rosa Brooks got together a team of experts and political operatives from both sides of the aisle to ask a slightly different question. Rather than arguing about whether he'd do those things, they dug into what exactly would happen if he did. Part war game part choose your own adventure, Rosa's Transition Integrity Project doesn't give us any predictions, and it isn't a referendum on Trump. Instead, it's a deeply illuminating stress test on our laws, our institutions, and on the commitment to democracy written into the constitution. This episode was reported by Bethel Habte, with help from Tracie Hunte, and produced by Bethel Habte. Jeremy Bloom provided original music. Support Radiolab by becoming a member today at Radiolab.org/donate.     You can read The Transition Integrity Project's report here.