Study identifies potential fix for hospital star rating program

April 02, 2019

DETROIT - Allowing for more quality measures in the federal government's Quality Star Rating program would create a fairer and more equitable model for assessing the level of quality at U.S. acute-care hospitals, according to a Henry Ford Health System study.

Researchers found that recognizing four fundamental quality factors in the safety of care category and assigning more equal weights to the eight measures in that category would modify the rating system's current scoring methodology and produce more accurate and informative results.

"Since the star ratings introduction in 2016, the ratings have been met with skepticism because of the methodology," says David Nerenz, Ph.D., director emeritus of Henry Ford's Center for Policy and Health Services Research and the study's lead author. "In our study, we believe we've identified a simple and straightforward solution in the safety of care domain that would make these ratings more meaningful and unbiased."

The study is published online in the American Journal of Medical Quality.

Created by the Centers for Medicare & Medicaid Services (CMS), the rating system assigns a score of one to five stars - five being the highest - based on a set of 57 individual quality measures across seven categories: mortality, readmission, safety of care, patient experience, effectiveness of care, timeliness of care and efficient use of medical imaging.

The first four categories each account for 22 percent of a hospital's total score, while the last three each count for four percent. A complex weighting scheme is used to assign an importance to each measure in each category, and the scheme for the safety of care category makes only one of the eight measures really count.

For their study, Dr. Nerenz and his team of researchers sought to evaluate the current methodology and how an alternative approach might affect the ratings scoring. Researchers performed principal components analyses on a subset of 674 hospitals in the December 2017 national data set that reported on eight safety measures used at the time. Then they assigned equal weight to each of the measures instead of the model employed by CMS and considered the number of cases at a hospital and how it impacted the accuracy of each measure.

The effect of applying this alternative methodology was illustrated in a single hospital, whose safety category score was markedly different (+1.65) compared to CMS' current methodology (-2.35). That was enough difference to move the score from below average to above average. Assigning equal weight to each measure had a "pronounced effect," researchers wrote.

"A stated aim of the Hospital Star Ratings program is to effectively summarize available hospital performance measures on Hospital Compare into a single, summary rating," says Brian Waterman, Ph.D., MPH, vice president of Analytic Business Solutions for the Missouri Hospital Association and a study co-author. "Our study results indicate that the current form of the methodology employed by CMS likely leaves important information about safety of care effectively out of the mix."

Researchers say the designers of the ratings system were well intentioned in creating a system that would be both "simple and patient-friendly" for consumers. However, the methodology is so highly complex that it has led to confusion and "very significant consequences for the ratings of individual hospitals." Further refining the methodology, they say, would better summarize the quality measures and "offer greater upside for consumers and providers."
MEDIA CONTACT: David Olejarz / / 313.874.4094

Henry Ford Health System

Related Safety Articles from Brightsurf:

Safety of HPV vaccines in males
A new analysis published in the British Journal of Clinical Pharmacology shows that HPV vaccines are safe and well tolerated in the male population, and the side effects that may occur after immunization are similar in both sexes.

How EU safety legislation has affected UK vapers
New research shows that vapers have been largely reassured by recent EU regulations, but some have been pushed to the black market for stronger hits.

Tunnel fire safety
With only minutes to respond, fire education really counts.

New study supports the safety of varenicline
A real-world study of over 600,000 adult participants without a history of depression has found that the stop-smoking medication varenicline (marketed as Chantix and Champix) does not appear to be associated with an increased risk of cardiovascular or neuropsychiatric hospitalization compared with nicotine replacement therapy (NRT).

Advancing frozen food safety: Cornell develops novel food safety assessment tool
New research funded by the Frozen Food Foundation developed a modeling tool to assist the frozen food industry with understanding and managing listeriosis risks.

'Safety signals' may help slow down anxiety
For as many as one in three people, life events or situations that pose no real danger can spark a disabling fear, a hallmark of anxiety and stress-related disorders.

UQ researcher carving a new path for skier safety
A spectacular stack on a ski slope in Canada has led to a University of Queensland researcher determining a simple modification that could improve skier safety on the snow.

Nanomaterial safety on a nano budget
A Rice University laboratory develops and shares a low-cost method to safely handle the transfer of bulk carbon nanotubes and other nanomaterials.

Drexel-developed safety climate scale helps fire departments reach safety goals
A new safety scale, that effectively measures the safety climate of a fire department, has been developed by researchers from Drexel's Dornsife School of Public Health, according to a paper published today in the journal Safety Science.

Safety of overlapping surgeries
Overlapping surgeries, in which more than one procedure is performed by the same surgeon working in different operating rooms, have raised concerns about potential adverse outcomes.

Read More: Safety News and Safety Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to