Nav: Home

High variability among experts when assessing claimants for work disability benefits

January 25, 2017

Healthcare professionals have high variation in judgement when assessing the same claimant for disability benefits, finds a review published by The BMJ today.

The authors warn that the current evidence base is limited, and the results are "disconcerting," and call for "substantial investment in research to improve assessment of disability."

Many workers seek wage replacement benefits due to a disabling illness or injury. Public and private insurance systems provide wage replacement benefits for such employees, as long as eligibility criteria are met.

Insurers often arrange for evaluation of eligibility by medical professionals, but there are concerns regarding low quality evaluations and poor reliability between medical experts assessing the same claimant.

So a group of European and Canadian researchers, led by Regina Kunz from the University of Basel, Switzerland, explored agreement among healthcare professionals when assessing claimants with ill health for work disability benefits.

They carried out a systematic review of 23 studies, conducted between 1992-2016, from 12 countries in Europe, North America, Australia, the Middle East, and northeast Asia.

The studies include those carried out in an insurance setting, with medical experts assessing claimants for work disability benefits, and in a research setting, where evaluation of patients took place outside of actual assessments, for example, for rehabilitation.

In 63% (10/16) of studies, medical experts reached only low to moderate agreement in their judgement of capacity to work. The results also show higher agreement was strongly associated with the use of a standardised approach to guide judgment.

"Despite their widespread use, medical evaluations of work disability show high variability and often low reliability. Use of standardised and validated instruments to guide the process could improve reliability," say the authors.

They explain that few countries have standards to guide assessments. Promising targets include formal training in evaluation of capacity to work, use of standardised instruments to guide disability evaluations, and addressing the conflict of interest that arises when insurers select their own experts.

Furthermore, they say that there might be greater need for strategies to improve agreement when patients present with subjective complaints, and improved knowledge of individual factors that contribute to variability in evaluation of capacity to work.

They conclude by saying "there is an urgent need for high quality research, conducted in actual insurance settings, to explore promising strategies to improve agreement in evaluation of capacity to work."
Research: Inter-rater agreement in evaluation of disability: systematic review of reproducibility studies

About BMJ

BMJ is a healthcare knowledge provider that aims to advance healthcare worldwide by sharing knowledge and expertise to improve experiences, outcomes and value. For a full list of BMJ products and services, please visit


Related Disability Articles:

Best medications to reduce drooling for those with developmental disability
A new study has revealed the most effective medications to reduce drooling in young people with a developmental disability, which can affect their socialisation, relationships and community life.
Obesity worsens disability in multiple sclerosis
Obesity is an aggravating factor in relapsing-remitting multiple sclerosis, the most common form of the disease.
Musculoskeletal conditions now second global cause of years lived with disability
Musculoskeletal (MSK) conditions, which affect the body's joints, bones, muscles, tendons and ligaments, now rank as the second leading global cause of years lived with a disability, reveals an analysis of international data, published online in the Annals of the Rheumatic Diseases.
Rehabilitation psychologists: #SayTheWord disability
A group of female rehabilitation psychologists with disabilities highlight the need for clinicians, educators and disability allies to normalize the word 'disability.'
Just an hour of weekly walking staves off disability
Just one hour a week of brisk walking -- as if you are late to an appointment or trying to make a train -- staves off disability in older adults with arthritis pain, or aching or stiffness in a knee, hip, ankle or foot, reports a new Northwestern Medicine study.
More Disability News and Disability Current Events

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Erasing The Stigma
Many of us either cope with mental illness or know someone who does. But we still have a hard time talking about it. This hour, TED speakers explore ways to push past — and even erase — the stigma. Guests include musician and comedian Jordan Raskopoulos, neuroscientist and psychiatrist Thomas Insel, psychiatrist Dixon Chibanda, anxiety and depression researcher Olivia Remes, and entrepreneur Sangu Delle.
Now Playing: Science for the People

#537 Science Journalism, Hold the Hype
Everyone's seen a piece of science getting over-exaggerated in the media. Most people would be quick to blame journalists and big media for getting in wrong. In many cases, you'd be right. But there's other sources of hype in science journalism. and one of them can be found in the humble, and little-known press release. We're talking with Chris Chambers about doing science about science journalism, and where the hype creeps in. Related links: The association between exaggeration in health related science news and academic press releases: retrospective observational study Claims of causality in health news: a randomised trial This...