Rare diseases: No reason for lower demands for studies

October 23, 2014

On behalf of the Federal Ministry of Health (BMG), the German Institute for Quality and Efficiency in Health Care (IQWiG) examined whether specific methodological aspects have to be considered in the conduct, analysis and assessment of the certainty of results of studies on rare diseases. Within the framework of the same commission, the Institute also analysed the underlying studies for the approval of so-called orphan drugs, i.e. drugs for rare diseases, in Europe.

The result: For a different approach than in more common diseases, there are neither scientific reasons nor specific designs and methods that would not also be relevant for more common diseases. This is the case for both drug and non-drug treatments. If compromises have to be made with regard to the reliability of the conclusions because of a particularly small number of participants, raising the significance level is preferable to a limitation of the external or even internal validity of the studies.

Focus on rare diseases

In the European Union diseases are classified as rare if they occur in not more than 5 per 10 000 inhabitants. Very rare diseases are diseases that affect fewer than 2 per 100 000 inhabitants. Of approximately 30 000 known diseases, 7000 to 8000 are considered rare, so that in Germany alone up to 4 million people are affected.

The German National Action League for People with Rare Diseases (NAMSE), founded in 2010, has developed a catalogue of policy proposals, which, among other things, includes the development of criteria for the assessment and analysis of studies with few participants. Against this background, the BMG awarded a two-part commission to IQWiG, which has now published the results in a so-called rapid report. Its contents follow the rapid report on the evidence in guidelines on rare diseases, which IQWiG produced in 2011, also on behalf of the BMG.

RCT as the gold standard

As explained in the IQWiG report, there are four key components that primarily determine the reliability of the conclusions of a study: the internal validity (i.e. the risk of bias), external validity (i.e. applicability), effect size, and precision of the results. The risk of bias can be minimized by randomization, double-blinding, and the so-called intention-to-treat principle, i.e. within the framework of randomized controlled trials (RCTs).

Study sponsors occasionally argue that the methodological standards that are usually applied in clinical studies should be lowered for rare diseases. They justify this by claiming that RCTs are difficult to conduct due to the low number of participants, and that they are also ethically doubtful if effective comparator therapies are lacking. However, IQWiG reached a different conclusion: A low number of participants is equally problematic in all study types, and controlled studies are only ethically doubtful if the benefit or added benefit of the intervention under investigation is more or less proven already. However, further studies to clarify the question on benefit are then unnecessary anyway - not only in rare diseases.

Raising the significance level, if essential

Just like reduced internal validity, which increases the risk of bias, concessions on external validity can also lead to systematic errors, which cannot be adjusted for even with the most sophisticated statistical method.

Small effect sizes can only be determined with certainty by sufficiently large sample sizes in studies. Supraregional and international networks as well as disease registries that are as complete as possible are useful to collect a sufficient number of evaluable cases. The use of efficient statistical methods, e.g. sequential study designs, may allow for smaller sample sizes without affecting internal or external validity.

If this is not sufficient in the case of very rare diseases, IQWiG recommends compromising on precision: raising the significance level, e.g. from the usual five to ten percent, to obtain statistically significant results despite a small sample size. This makes it possible to at least quantify the probability of error: The uncertainty of a decision is known.

Empirical data support methodological expertise

For the second goal of the commission, IQWiG examined all 85 drug approvals for rare and very rare diseases in Europe between 2001 and 2013. 82 out of the 125 studies submitted within the framework of these approvals were RCTs, which clearly shows that it is not necessary to compromise on methodology. Most studies were multicentre, multinational, and multicontinental. Specific statistical methods aiming for high efficiency were used in about two thirds of the studies.

All patients have a right to quality

"It has been shown that in studies on rare diseases, deviation from the methods usually applied in studies is neither necessary nor possible without compromising on quality", concludes the Institute's Director Jürgen Windeler. "In most cases, reservations concerning RCTs in rare diseases are unwarranted."

The EU regulation No. 141/2000 already stipulated that patients suffering from rare conditions should be entitled to the same drug quality, safety and efficacy as other patients and that orphan drugs should therefore be subjected to the normal evaluation process. "The best way to do justice to these requirements is to conduct multicentre RCTs, in which the risk of bias is minimized and the data recorded are carefully analysed", says Windeler. "This makes it possible to estimate with sufficient certainty the benefit and harm of the intervention for the people affected, despite the small numbers of participants."
Process of report production

The BMG commissioned IQWiG in December 2013. The report was to be prepared in an accelerated procedure as a "rapid report". In contrast to the usual procedure, no preliminary reports are published here. Although a draft version of the report is reviewed by external experts, no hearing at which all interested parties can comment takes place. The report was sent to the commissioning agency on 8 September 2014.

An overview of the background, methods and further results of the report is provided in the executive summary.

Institute for Quality and Efficiency in Health Care

Related Rare Diseases Articles from Brightsurf:

'Rare' brain disorder may not be so rare anymore, trends in japan reveal
Creutzfeldt-Jakob disease (CJD), a fatal neurodegenerative disorder, is an important cause of dementia.

Study provides new hope for children suffering from rare muscle diseases
Stephen Greenspan and Laura Zah were devastated when they learned their son Alexander had a rare genetic mutation, which causes a deadly neuromuscular disease with no known treatment or cure.

New research provides fresh hope for children suffering from rare muscle diseases
Results of an international study published today in Autophagy and led by researchers from Monash University, School of Biological Sciences, provides renewed hope for children suffering from a progressive and devastating muscle disease.

Big drug costs for small patients with rare diseases, study finds
Only about one in every 170 children take them. But ''orphan drugs'' accounted for 1 in every 15 private insurance dollars spent on children's health care in the United States in 2018, according to a new study.

Genetic information can predict predisposition to rare and common blood diseases
Two large-scale genetic studies have identified the bulk of genetic variation that influences medically-important characteristics of our blood cells.

Stretching your legs may help prevent diseases such as heart diseases and diabetes
New research published today in The Journal of Physiology shows that 12 weeks of easy-to-administer passive stretching helps improve blood flow by making it easier for your arteries to dilate and decreasing their stiffness.

3D facial scans could speed diagnoses for children with rare genetic diseases
Now an international team led by scientists and clinicians from the University of Colorado, University of Calgary, and University of California, San Francisco (UCSF) has developed a prototype tool based on three-dimensional (3D) facial imaging that could shorten that diagnostic odyssey by making it easier for clinicians to diagnose genetic syndromes.

Drug development for rare diseases affecting children is increasing
The number of treatments for rare diseases affecting children has increased, a new study suggests.

Rare diseases - Key insights from small samples
The study of a rare genetic disease has enabled a team led by Ludwig-Maximilians-Universitaet (LMU) in Munich´s Christoph Klein to uncover the role of a membrane-associated protein in the development and function of human T cells.

How many rare diseases are there?
Dr. Tudor Oprea says a better method for classifying rare diseases will lead to improved patient care.

Read More: Rare Diseases News and Rare Diseases Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.