Nav: Home

Study finds little consistency in doctor reviews on three physician rating websites

March 14, 2017

When looking for a doctor, many consumers turn to websites that post physician ratings and reviews. A study at Hospital for Special Surgery (HSS) found that reviews for individual sports medicine doctors were inconsistent when compared on three popular physician rating websites.

"Consumer-driven healthcare and an increasing emphasis on quality metrics have encouraged patient engagement in the rating of healthcare. As such, online physician rating websites have become mainstream and may play a potential role in future healthcare policy," said Benedict Nwachukwu, MD, MBA, who presented the findings at the American Academy of Orthopaedic Surgeons Annual Meeting in San Diego on March 14.

Doctor rating sites have become a popular outlet for patients to express their satisfaction or dissatisfaction. They've also been shown to influence physician selection. HSS researchers set out to evaluate online ratings for orthopedic sports medicine surgeons, determine predictors of positive ratings, and see if there was a correlation in scores posted on three popular websites: Healthgrades.com, Vitals.com and Ratemds.com.

"Although it is debatable whether these websites in their current form truly capture patient satisfaction and objectively evaluate the delivery of care, they represent a potential tool for both payors and healthcare systems to gauge how surgeons are assessed by their patients," said Anil Ranawat, MD, senior investigator and a sports medicine surgeon at HSS. "Historically, three key qualities -- affability, availability and ability, known as the 'three As' -- have been suggested to promote a successful surgical career and favorable interactions with patients."

To identify surgeons for the study, researchers accessed the online member directory of The American Orthopaedic Society for Sports Medicine. Their query in May 2015 yielded 2,813 entries. Investigators selected every tenth surgeon profile on a continuous basis and came up with 275 sports medicine surgeons to include in their study.

The researchers compiled data on years in practice, location, academic affiliation and ratings for each surgeon on the three websites. Patients' written comments were categorized as relating to surgeon competence, affability and the process of care delivery.

Investigators discovered a low degree of correlation in ratings for individual surgeons on the different websites, an important finding that had not been previously demonstrated, according to Dr. Nwachukwu.

With respect to factors that appeared to influence ratings, being female was a significant predictor of higher ratings on Healthgrades. Surgeons with an academic affiliation were also more likely to receive higher overall ratings.

A physician's online and social media presence, including Facebook, Twitter and possession of a personalized website, did not influence the strength of ratings on Healthgrades, Vitals or Ratemds. Surprisingly, across all three websites, an increased number of years in practice generally led to lower ratings.

Out of 2,341 written comments that were analyzed, perceived surgeon competence and communication skills influenced the scores for the highest and lowest-rated surgeons, but did not affect scores for those with average ratings.

"Surgeons with the highest and lowest ratings were significantly more likely to receive comments about their competence or affability," said Dr. Nwachukwu. "As such, it appears that even in the modern era, and with the adoption of online rating mechanisms, the traditional three As of 'availability, affability and ability' still hold sway."

"Online rating websites are for-profit business enterprises, which at this point demonstrate significant growth potential," said Dr. Ranawat. "However, the low degree of correlation between these websites is concerning. It also questions the collective utility of these sites and potentially demonstrates the individually capricious nature of online physician reviews."

The variation in ratings among the sites may be explained by an insufficiency of reviews necessary to appropriately grade a surgeon, according to the researchers, who noted that the number of reviewers needed to improve reliability is unclear and may warrant further investigation. The researchers also indicated that the study was somewhat limited by the data available -- online surgeon reviews may not represent an accurate appraisal of surgeon quality. In addition, it's not possible to determine if the ratings were posted by actual patients. It was beyond the scope of the study to determine the veracity of the reviews.

"An understanding of the factors that influence online physician ratings may have important implications for sports medicine surgeons, and for physicians in other specialties, as well," Dr. Nwachukwu concluded. "Perhaps more attention should be paid to improving the validity of online ratings for assessing quality and the outcome of care provided."
-end-
About Hospital for Special Surgery

Hospital for Special Surgery (HSS) is the world's largest academic medical center focused on musculoskeletal health. HSS is nationally ranked No. 1 in orthopedics and No. 2 in rheumatology by U.S. News & World Report (2016-2017), and is the first hospital in New York State to receive Magnet Recognition for Excellence in Nursing Service from the American Nurses Credentialing Center four consecutive times. HSS has one of the lowest infection rates in the country. HSS is an affiliate of Weill Cornell Medical College and as such all Hospital for Special Surgery medical staff are faculty of Weill Cornell. The hospital's research division is internationally recognized as a leader in the investigation of musculoskeletal and autoimmune diseases. Hospital for Special Surgery is located in New York City and online at http://www.hss.edu.

Hospital for Special Surgery

Related Healthcare Articles:

Mitochondrial disease has a disproportionate healthcare burden in US
Mitochondrial diseases are a diverse group of disorders caused by mutated genes that impair energy production in a patient's cells, often with severe effects.
Healthcare providers should individualize patient education
Health information should be tailored to a patient's ability to understand health concepts and keep them motivated to maintain long-term changes.
High prevalence of CRE in Washington, D.C. healthcare facilities
Carbapenem-resistant Enterobacteriaceae (CRE), a family of highly pathogenic antibiotic-resistant organisms, are endemic across Washington, D.C. healthcare facilities, with 5.2 percent of inpatients testing positive for the bacteria, according to new research published online today in Infection Control & Hospital Epidemiology, the journal of the Society for Healthcare Epidemiology of America.
Better, cheaper healthcare with dry blood samples
A drop of blood on filter paper, allowed to dry and stored for future diagnostic purposes -- considerably easier than the present-day, resource-consuming method using frozen blood samples in plastic tubes.
Undetected Ebola infection in international healthcare workers very unlikely
Undiagnosed Ebola virus infection was probably very rare in international workers who were deployed during the 2013-2015 outbreak of the virus in West Africa, despite mild and asymptomatic cases of Ebola being known to occur, according to new research led by the London School of Hygiene & Tropical Medicine.
Can we put a price on healthcare innovation in cancer?
Is there evidence that the money spent on innovation 'for the cure' actually benefits cancer patients?
Leaders in Healthcare
Join aspiring leaders to address some of the biggest issues facing healthcare leadership and management in the UK, affecting the professional workforce as well as the population.
New study: Estimated burden of healthcare-associated infections
A study published today by PLOS Medicine, estimates the combined burden of six healthcare-associated infections as being higher than that of diseases such as influenza, HIV/AIDS and tuberculosis together.
Healthcare corruption taken to task by technology, study shows
Mobile phone technology could help to beat bad practices in healthcare delivery, research led by the University of Edinburgh suggests.
Improving LGBT healthcare for military veterans
The U.S. Veterans Health Administration (VHA), which is likely the largest provider of LGBT healthcare in the world, is implementing various system-wide changes aimed at improving LGBT care, including transgender e-consultations to aid interdisciplinary providers and the addition of a self-identified gender identity field to all veteran record systems.

Related Healthcare Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Setbacks
Failure can feel lonely and final. But can we learn from failure, even reframe it, to feel more like a temporary setback? This hour, TED speakers on changing a crushing defeat into a stepping stone. Guests include entrepreneur Leticia Gasca, psychology professor Alison Ledgerwood, astronomer Phil Plait, former professional athlete Charly Haversat, and UPS training manager Jon Bowers.
Now Playing: Science for the People

#524 The Human Network
What does a network of humans look like and how does it work? How does information spread? How do decisions and opinions spread? What gets distorted as it moves through the network and why? This week we dig into the ins and outs of human networks with Matthew Jackson, Professor of Economics at Stanford University and author of the book "The Human Network: How Your Social Position Determines Your Power, Beliefs, and Behaviours".