Nav: Home

Google translates doctor's orders into Spanish and Chinese with few significant errors

February 25, 2019

In multicultural areas like San Francisco, doctors are increasingly looking to Google Translate to provide written instructions their patients can take home, so they stand a better chance of following medical advice.

But is Translate trustworthy?

Researchers at UC San Francisco say the answer is yes -- with some caveats. After analyzing 100 sets of emergency discharge instructions translated by Google's new machine learning algorithm, which was rolled out in 2017, the researchers concluded it was 92 percent accurate for Spanish and 81 percent accurate for Chinese.

The researchers found that only a small minority of the inaccurate translations -- 2 percent in Spanish and 8 percent in Chinese -- had the potential to cause clinically significant harm. These were mostly due to grammar or typographical errors in the original written English instructions, which someone who could read English would have been able to understand correctly.

"Google Translate is more accurate than a lot of clinicians believe, and I think it's definitely more useful than not providing anything at all," said Elaine Khoong, MD, MS, a UCSF primary care research fellow and first author of the study, published Feb. 25, 2019, in JAMA Internal Medicine. "We cautiously support its use."

The algorithm got into trouble, however, when doctors used colloquial terms, like "skip a meal," a phrase that Google translated into Chinese as "jump over" a meal.

A more troubling mistranslation occurred when the doctor told the patient to "hold the kidney medicine," meaning to stop taking it. The algorithm translated that into Spanish as, "keep the medication" and into Chinese as "keep taking" the medication, mistakes that the research team deemed "life threatening."

Machine translation errors were also linked to the use of medical jargon, and long, complicated sentences, such as, "Please return to the emergency department for worsening abdominal pain, inability to eat or drink due to vomiting, bloody diarrhea, if you pass out or any other concerning symptom."

Google's Chinese translation was, "If you pass, vomiting, bloody diarrhea, unable to eat or drink or any other symptoms; come back to the emergency department for treatment."

The researchers deemed this a clinically significant error, although they said it was not life threatening.

"It confused the machine because the sentence structure was so complicated," Khoong said. "It's certainly an argument for doctors to check themselves when they are writing instructions. We get used to communicating in these very complicated sentences."

The researchers said Google Translate is best used in combination with human interpreters, even if they are not in the room, who can interpret the physician's verbal instructions for the patient, over the phone or via video, while the physician shows the patient the written translation on the computer screen or printout. That way, patients can flag errors or confusing passages as they are listening and reading.

The team also recommended that clinicians give their patients the English version of the written instructions, so English-speaking family members or friends can compare them to the machine translation.

Khoong said patients would be worse off with no written translation at all. She described a non-English speaking patient with a neck injury, who left the emergency department with a cervical collar but did not understand the need to put it on.

The patient later showed up with the collar in one hand, and the English discharge instructions in the other, saying, "I know these are important. Can you tell me what they say?"
Authors: Elaine Khoong, MD, MS; Eric Steinbrook; Cortlyn Brown, MD; and Alicia Fernandez, MD, all of UCSF.

Funding: This study was funded by the National Institute of Diabetes and Digestive and Kidney Diseases (K24DK102057) and a National Research Service Award (T32HP19025).

Disclosures: None.

About UCSF: UC San Francisco (UCSF) is a leading university dedicated to promoting health worldwide through advanced biomedical research, graduate-level education in the life sciences and health professions, and excellence in patient care. It includes top-ranked graduate schools of dentistry, medicine, nursing and pharmacy; a graduate division with nationally renowned programs in basic, biomedical, translational and population sciences; and a preeminent biomedical research enterprise. It also includes UCSF Health, which comprises three top-ranked hospitals - UCSF Medical Center and UCSF Benioff Children's Hospitals in San Francisco and Oakland - as well as Langley Porter Psychiatric Hospital and Clinics, UCSF Benioff Children's Physicians and the UCSF Faculty Practice. UCSF Health has affiliations with hospitals and health organizations throughout the Bay Area. UCSF faculty also provide all physician care at the public Zuckerberg San Francisco General Hospital and Trauma Center, and the SF VA Medical Center. The UCSF Fresno Medical Education Program is a major branch of the University of California, San Francisco's School of Medicine. Please visit

Follow UCSF | |

University of California - San Francisco

Related Emergency Department Articles:

Patient race & gender are important in predicting heart attack in the emergency department
Researchers at the George Washington University published research finding that certain symptoms are more and less predictive of patients' risk for acute coronary syndrome, which includes heart attack, in patients of different gender and race.
What are trends in emergency department utilization, costs for shingles?
A new article published by JAMA Dermatology uses a nationwide database of emergency department (ED) visits to examine herpes zoster (HZ, shingles)-related ED utilization and costs.
Many cancer patients' Emergency Department visits appear preventable
As many as 53 percent of cancer patients' Emergency Department visits that do not require admission could be avoided with better symptom management and greater availability of outpatient care tailored to their needs, according to a new study from Fred Hutchinson Cancer Research Center.
Lawn mower injuries send 13 children to the emergency department every day
A recent study from the Center for Injury Research and Policy at Nationwide Children's Hospital published in the American Journal of Emergency Medicine shows that, while there has been a decrease in the number of children injured by lawn mowers over the last few decades, this cause of serious injury continues to be a concern.
Cotton tip applicators are sending 34 kids to the emergency department each day
A study conducted by Nationwide Children's Hospital researchers found that over a 21-year period from 1990 through 2010, an estimated 263,000 children younger than 18 years of age were treated in US hospital emergency departments for cotton tip applicator related ear injuries -- that's about 12,500 annually, or about 34 injuries every day.
More Emergency Department News and Emergency Department Current Events

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Teaching For Better Humans
More than test scores or good grades — what do kids need to prepare them for the future? This hour, guest host Manoush Zomorodi and TED speakers explore how to help children grow into better humans, in and out of the classroom. Guests include educators Olympia Della Flora and Liz Kleinrock, psychologist Thomas Curran, and writer Jacqueline Woodson.
Now Playing: Science for the People

#535 Superior
Apologies for the delay getting this week's episode out! A technical glitch slowed us down, but all is once again well. This week, we look at the often troubling intertwining of science and race: its long history, its ability to persist even during periods of disrepute, and the current forms it takes as it resurfaces, leveraging the internet and nationalism to buoy itself. We speak with Angela Saini, independent journalist and author of the new book "Superior: The Return of Race Science", about where race science went and how it's coming back.