Validity of JCAHO hospital accreditation

January 14, 2002

ANN ARBOR---Hospital accreditation is a poor predictor of the quality of patient outcomes, according to a new study by two University of Michigan School of Public Health researchers.

A study by Profs. John R. Griffith and Jeffrey A. Alexander, to be published in the January issue of the peer-reviewed journal "Quality Management in Health Care," shows no relationship between Medicare-based measures of mortality and complications and the scores assigned to hospitals by the Joint Commission on Accreditation of Hospitals (JCAHO). Griffith and Alexander each hold funded chairs in the SPH Department of Health Management and Policy.

Griffith and Alexander's study suggests a serious need to review the system that assures quality in 95 percent of U.S. acute care hospitals, and which is used for Medicare certification and often for state licensure. The JCAHO system, in use for 50 years, almost exclusively uses structural and process measures and does not track newer, more direct performance measures such as the number of deaths or unexpected complications, the hospital's financial strength, or its ability to adapt to the latest treatment approaches.

Griffith and Alexander examined Medicare outcomes by comparing JCAHO scores, submitted by JCAHO, against Medicare inpatient data prepared annually for "The 100 Top Hospitals: Benchmarks for Success" study by Solucient LLC.

According to Griffith and Alexander, Solucient mortality and complications indexing, adjusted for differences in the kinds of patients and cases treated, shows patients' chances of having serious adverse events, such as death or complications, are about twice as great at the bottom 20 percent of hospitals as at the top 20 percent of hospitals. On other measures, the top quintile is about one and half times as good.

The "Balanced Scorecard" theory, increasingly popular among leading companies, suggests that a successful organization should achieve in a range of performance areas, including safety, stable financing, and efficiency, as well as in relations with its customers and workers, Griffith said. Such an organization also would work at the kinds of things JCAHO criteria emphasize, such as staffing in care units and compliance with codes.

Performance data like Solucient's suggest that America's hospitals need real improvement, Griffith said. "The differences between best and worst are too big to ignore. Most hospitals make a huge effort to raise their accreditation scores. If they put that energy in a smarter direction, we'd all be better off."

Part of the problem, the researchers said, is lack of public knowledge. JCAHO scores are translated to a "failure count" of the 48 areas studied, and hospitals get a list of "Type I Recommendations" to correct. About one hospital in 12 gets a nearly perfect score, with no recommendations, and only three of 100 get "conditional" accreditation. For details, visit http://www.jcaho.org/qualitycheck/directry/directry.asp

With so many hospitals receiving similar scores, the system does not encourage competition, they said.

Similarly, the Solucient performance scores are used in a "Top 100 Hospitals" program that recognizes only the 100 hospitals that achieve the highest benchmarks but fail to provide ranking information on the more than 5,000 other hospitals studied and ranked annually. (http://www.100tophospitals.com/default.asp)

Another problem is understanding exactly what does contribute to high performance. JCAHO criteria are a consensus of what seems to work, rather than practices tested against real performance, they said.

"JCAHO scores four dozen separate activities in hospitals, calculates a weighted overall score and makes a final decision to accredit. We expected to see 'good' JCAHO hospitals get 'good' performance scores---be safe, well financed, efficient and progressive. The data show the hospitals with the worst JCAHO scores have as good performance as the group with the best," Griffith said.

The disconnect suggests either something left out or something wrong. "I believe it's something left out," Griffith said. "It could be problems with the way JCAHO's inspectors assign the scores, but it's more likely the things JCAHO does not measure, particularly employee and doctor learning and enthusiasm."
-end-
Evanston, Ill.- based Solucient, which does not compete with JCAHO, provided $10,000 in funding for a detailed analysis of the stability of its "100 Top" criteria and recommendations on changes.

For more information on Griffith, author of the textbook "The Well-Managed Healthcare Organization": http://www.sph.umich.edu/hmp/faculty/jrg.html

For more information on Alexander, who recently finished a term as acting dean of the School of Public Health: http://www.sph.umich.edu/hmp/faculty/jalexand.html

For more information on "Structural versus Outcomes Measures in Hospitals," the article by Griffith et al, contact Aspen Publishers Inc. at 800-638-8437 or http://www.aspenpublishers.com

The University of Michigan
News Service
412 Maynard
Ann Arbor, MI 48109-1399

University of Michigan

Related Mortality Articles from Brightsurf:

Being in treatment with statins reduces COVID-19 mortality by 22% to 25%
A research by the Universitat Rovira i Virgili (URV) and Pere Virgili Institut (IISPV) led by LluĂ­s Masana has found that people who are being treated with statins have a 22% to 25% lower risk of dying from COVID-19.

Mortality rate higher for US rural residents
A recent study by Syracuse University sociology professor Shannon Monnat shows that mortality rates are higher for U.S. working-age residents who live in rural areas instead of metro areas, and the gap is getting wider.

COVID-19, excess all-cause mortality in US, 18 comparison countries
COVID-19 deaths and excess all-cause mortality in the U.S. are compared with 18 countries with diverse COVID-19 responses in this study.

New analysis shows hydroxychloroquine does not lower mortality in COVID-19 patients, and is associated with increased mortality when combined with the antibiotic azithromycin
A new meta-analysis of published studies into the drug hydroxychloroquine shows that it does not lower mortality in COVID-19 patients, and using it combined with the antibiotic azithromycin is associated with a 27% increased mortality.

Hydroxychloroquine reduces in-hospital COVID-19 mortality
An Italian observational study contributes to the ongoing debate regarding the use of hydroxychloroquine in the current pandemic.

What's the best way to estimate and track COVID-19 mortality?
When used correctly, the symptomatic case fatality ratio (sCFR) and the infection fatality ratio (IFR) are better measures by which to monitor COVID-19 epidemics than the commonly reported case fatality ratio (CFR), according to a new study published this week in PLOS Medicine by Anthony Hauser of the University of Bern, Switzerland, and colleagues.

COVID-19: Bacteriophage could decrease mortality
Bacteriophage can reduce bacterial growth in the lungs, limiting fluid build-up.

COPD and smoking associated with higher COVID-19 mortality
Current smokers and people with chronic obstructive pulmonary disease (COPD) have an increased risk of severe complications and higher mortality with COVID-19 infection, according to a new study published May 11, 2020 in the open-access journal PLOS ONE by Jaber Alqahtani of University College London, UK, and colleagues.

Highest mortality risks for poor and unemployed
Large dataset shows that income, work status and education have a clear influence on mortality in Germany.

Addressing causes of mortality in Zambia
Despite the fact that people in sub-Saharan Africa are now living longer than they did two decades ago, their average life expectancy remains below that of the rest of the world population.

Read More: Mortality News and Mortality Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.