New York, NY [March 10, 2026] — As artificial intelligence (AI) becomes more common in health care, from managing records to assisting with medication decisions, researchers at the Icahn School of Medicine at Mount Sinai are asking an important question: How well does AI hold up when the workload gets intense at health system scale?
A new study, published in the March 9 online issue of npj Health Systems [https://doi.org/10.1038/s44401-026-00077-0], suggests that the answer depends less on the AI itself and more on how it’s designed.
The investigators found that health care AI systems work far better when tasks are distributed among multiple specialized AI “agents”—software systems that can perform complex tasks, learn, and adapt—rather than relying on a single, all-purpose agent. This multi-agent approach kept performance steady even as demands increased, while dramatically reducing computing costs and delays, say the investigators.
“For health care organizations, our findings point to a smarter way to use AI,” says senior study author Girish N. Nadkarni, MD, MPH , Barbara T. Murphy Chair of the Windreich Department of Artificial Intelligence and Human Health, Director of the Hasso Plattner Institute for Digital Health , Irene and Dr. Arthur M. Fishberg Professor of Medicine at the Icahn School of Medicine, and Chief AI Officer of the Mount Sinai Health System. “By assigning different tasks, such as finding patient information, extracting data, or checking medication doses, to specialized AI agents, systems can run faster and more reliably while keeping costs under control. Ultimately, this kind of design could help health care teams spend less time on administrative work and more time focusing on patients.”
As part of the study, the researchers compared two approaches to clinical AI: a single system responsible for handling many different clinical tasks, and a coordinated network of specialized AI agents overseen by a central “orchestrator.” Using state-of-the-art language models, the team evaluated performance across common clinical functions, including information retrieval, data extraction, and medication dosing calculations—under simulated real-world conditions involving up to 80 simultaneous tasks.
“What we found is that AI systems behave a lot like people,” says study lead author Eyal Klang, MD , formerly with the Icahn School of Medicine. “When you ask one system to do too many different things at once, performance suffers. But when one orchestrator agent divides the work among specialized agents, the system stays accurate, responsive, and far more efficient, even under heavy demand.”
The coordinated multi-agent system maintained superior accuracy levels while using far fewer computing resources, up to 65 times fewer, than a single-agent design. The study simulated real clinical “traffic,” where many types of tasks arrive at once and compete for attention, the investigators say.
“Our findings show that smart coordination is not just a technical preference,” Dr. Klang says. “It can make the difference between an AI system that continues to function smoothly and one that begins to break down when it is exposed to the pressures of real clinical workloads.”
Next, the research team plans to test these coordinated AI systems directly in clinical settings, using real-time patient data. If successful, this approach could help shape how hospitals and health systems scale AI in the future, helping them handle peak workloads without sacrificing quality or safety.
The researchers emphasize that the gains are not automatic: even sophisticated AI can fall short when systems are poorly designed or implemented. “Health care does not operate one task at a time,” Dr. Nadkarni says. “Hospitals face constant, overlapping demands, especially during busy periods. Our findings show that the future of health care AI is not a single super-intelligent system, but a coordinated team of focused agents that work together to scale safely, control costs, and support real clinical operations.”
“When a single agent handles everything, you can't trace where it went wrong. With the orchestrator, every step is logged, which tool was called, what it returned, and how the answer was assembled. At 80 simultaneous tasks, the single agent dropped to 16 percent accuracy while burning 65 times more compute—and you'd have no way to figure out why. That kind of transparency isn't optional in medicine,” says second author Mahmud Omar, MD , a visiting researcher in the Windreich Department. “This matters more now than ever—agentic AI is no longer a research concept. Tools like OpenAI's operator mode, Claude's Cowork, and similar platforms are putting autonomous agents directly in the hands of clinicians and patients. As that adoption accelerates, the architecture behind these systems has to be auditable from the start.”
The paper is titled “Orchestrated multi agents sustain accuracy under clinical‑scale workloads compared to a single agent.”
The study’s authors, as listed in the journal, are Eyal Klang, Mahmud Omar, Ganesh Raut, Reem Agbareia, Prem Timsina, Robert Freeman, Lisa Stump, Alexander Charney, Benjamin S. Glicksberg, Girish N. Nadkarni.
This work was supported in part by the Clinical and Translational Science Awards (CTSA) grant UL1TR004419 from the National Center for Advancing Translational Sciences. Research reported in this publication was also supported by the Office of Research Infrastructure of the National Institutes of Health under award number S10OD026880 and S10OD030463.
For more Mount Sinai artificial intelligence news, visit: https://icahn.mssm.edu/about/artificial-intelligence .
About Mount Sinai's Windreich Department of AI and Human Health
Led by Girish N. Nadkarni, MD, MPH—an international authority on the safe, effective, and ethical use of AI in health care—Mount Sinai’s Windreich Department of AI and Human Health is the first of its kind at a U.S. medical school, pioneering transformative advancements at the intersection of artificial intelligence and human health.
The Department is committed to leveraging AI in a responsible, effective, ethical, and safe manner to transform research, clinical care, education, and operations. By bringing together world-class AI expertise, cutting-edge infrastructure, and unparalleled computational power, the department is advancing breakthroughs in multi-scale, multimodal data integration while streamlining pathways for rapid testing and translation into practice.
The Department benefits from dynamic collaborations across Mount Sinai, including with the Hasso Plattner Institute for Digital Health at Mount Sinai—a partnership between the Hasso Plattner Institute for Digital Engineering in Potsdam, Germany, and the Mount Sinai Health System—which complements its mission by advancing data-driven approaches to improve patient care and health outcomes.
At the heart of this innovation is the renowned Icahn School of Medicine at Mount Sinai, which serves as a central hub for learning and collaboration. This unique integration enables dynamic partnerships across institutes, academic departments, hospitals, and outpatient centers, driving progress in disease prevention, improving treatments for complex illnesses, and elevating quality of life on a global scale.
In 2024, the Department's innovative NutriScan AI application, developed by the Mount Sinai Health System Clinical Data Science team in partnership with Department faculty, earned Mount Sinai Health System the prestigious Hearst Health Prize. NutriScan is designed to facilitate faster identification and treatment of malnutrition in hospitalized patients. This machine learning tool improves malnutrition diagnosis rates and resource utilization, demonstrating the impactful application of AI in health care.
For more information on Mount Sinai's Windreich Department of AI and Human Health, visit: ai.mssm.edu
About the Hasso Plattner Institute at Mount Sinai
At the Hasso Plattner Institute for Digital Health at Mount Sinai, the tools of data science, biomedical and digital engineering, and medical expertise are used to improve and extend lives. The Institute represents a collaboration between the Hasso Plattner Institute for Digital Engineering in Potsdam, Germany, and the Mount Sinai Health System.
Under the leadership of Girish Nadkarni, MD, MPH, who directs the Institute, and Professor Lothar Wieler, a globally recognized expert in public health and digital transformation, they jointly oversee the partnership, driving innovations that positively impact patient lives while transforming how people think about personal health and health systems.
The Hasso Plattner Institute for Digital Health at Mount Sinai receives generous support from the Hasso Plattner Foundation. Current research programs and machine-learning efforts focus on improving the ability to diagnose and treat patients.
About the Icahn School of Medicine at Mount Sinai
The Icahn School of Medicine at Mount Sinai is internationally renowned for its outstanding research, educational, and clinical care programs. It is the sole academic partner for the seven member hospitals* of the Mount Sinai Health System, one of the largest academic health systems in the United States, providing care to New York City’s large and diverse patient population.
The Icahn School of Medicine at Mount Sinai offers highly competitive MD, PhD, MD-PhD, and master’s degree programs, with enrollment of more than 1,200 students. It has the largest graduate medical education program in the country, with more than 2,600 clinical residents and fellows training throughout the Health System. Its Graduate School of Biomedical Sciences offers 13 degree-granting programs, conducts innovative basic and translational research, and trains more than 560 postdoctoral research fellows.
Ranked 11th nationwide in National Institutes of Health (NIH) funding, the Icahn School of Medicine at Mount Sinai is among the 99th percentile in research dollars per investigator according to the Association of American Medical Colleges. More than 4,500 scientists, educators, and clinicians work within and across dozens of academic departments and multidisciplinary institutes with an emphasis on translational research and therapeutics. Through Mount Sinai Innovation Partners (MSIP), the Health System facilitates the real-world application and commercialization of medical breakthroughs made at Mount Sinai.
-------------------------------------------------------
* Mount Sinai Health System member hospitals: The Mount Sinai Hospital; Mount Sinai Brooklyn; Mount Sinai Morningside; Mount Sinai Queens; Mount Sinai South Nassau; Mount Sinai West; and New York Eye and Ear Infirmary of Mount Sinai
npj Health Systems
Orchestrated multi agents sustain accuracy under clinical scale workloads compared to a single agent
9-Mar-2026