A first in medical robotics: Autonomous navigation inside the body

April 24, 2019

Bioengineers at Boston Children's Hospital report the first demonstration of a robot able to navigate autonomously inside the body. In an animal model of cardiac valve repair, the team programmed a robotic catheter to find its way along the walls of a beating, blood-filled heart to a leaky valve -- without a surgeon's guidance. They report their work today in Science Robotics.

Surgeons have used robots operated by joysticks for more than a decade, and teams have shown that tiny robots can be steered through the body by external forces such as magnetism. However, senior investigator Pierre Dupont, PhD, chief of Pediatric Cardiac Bioengineering at Boston Children's, says that to his knowledge, this is the first report of the equivalent of a self-driving car navigating to a desired destination inside the body.

Dupont envisions autonomous robots assisting surgeons in complex operations, reducing fatigue and freeing surgeons to focus on the most difficult maneuvers, improving outcomes.

"The right way to think about this is through the analogy of a fighter pilot and a fighter plane," he says. "The fighter plane takes on the routine tasks like flying the plane, so the pilot can focus on the higher-level tasks of the mission."

Touch-guided vision, informed by AI

The team's robotic catheter navigated using an optical touch sensor developed in Dupont's lab, informed by a map of the cardiac anatomy and preoperative scans. The touch sensor uses artificial intelligence (AI) and image processing algorithms to enable the catheter to figure out where it is in the heart and where it needs to go.

For the demo, the team performed a highly technically demanding procedure known as paravalvular aortic leak closure, which repairs replacement heart valves that have begun leaking around the edges. (The team constructed its own valves for the experiments.) Once the robotic catheter reached the leak location, an experienced cardiac surgeon took control and inserted a plug to close the leak.

In repeated trials, the robotic catheter successfully navigated to heart valve leaks in roughly the same amount of time as the surgeon (using either a hand tool or a joystick-controlled robot).

Biologically inspired navigation

Through a navigational technique called "wall following," the robotic catheter's optical touch sensor sampled its environment at regular intervals, in much the way insects' antennae or the whiskers of rodents sample their surroundings to build mental maps of unfamiliar, dark environments. The sensor told the catheter whether it was touching blood, the heart wall or a valve (through images from a tip-mounted camera) and how hard it was pressing (to keep it from damaging the beating heart).

Data from preoperative imaging and machine learning algorithms helped the catheter interpret visual features. In this way, the robotic catheter advanced by itself from the base of the heart, along the wall of the left ventricle and around the leaky valve until it reached the location of the leak.

"The algorithms help the catheter figure out what type of tissue it's touching, where it is in the heart, and how it should choose its next motion to get where we want it to go," Dupont explains.

Though the autonomous robot took a bit longer than the surgeon to reach the leaky valve, its wall-following technique meant that it took the longest path.

"The navigation time was statistically equivalent for all, which we think is pretty impressive given that you're inside the blood-filled beating heart and trying to reach a millimeter-scale target on a specific valve," says Dupont.

He adds that the robot's ability to visualize and sense its environment could eliminate the need for fluoroscopic imaging, which is typically used in this operation and exposes patients to ionizing radiation.

A vision of the future?

Dupont says the project was the most challenging of his career. While the cardiac surgical fellow, who performed the operations on swine, was able to relax while the robot found the valve leaks, the project was taxing for Dupont's engineering fellows, who sometimes had to reprogram the robot mid-operation as they perfected the technology.

"I remember times when the engineers on our team walked out of the OR completely exhausted, but we managed to pull it off," says Dupont. "Now that we've demonstrated autonomous navigation, much more is possible."

Some cardiac interventionalists who are aware of Dupont's work envision using robots for more than navigation, performing routine heart-mapping tasks, for example. Some envision this technology providing guidance during particularly difficult or unusual cases or assisting in operations in parts of the world that lack highly experienced surgeons.

As the Food and Drug Administration begins to develop a regulatory framework for AI-enabled devices, Dupont envisions the possibility of autonomous surgical robots all over the world pooling their data to continuously improve performance over time -- much like self-driving vehicles in the field send their data back to Tesla to refine its algorithms.

"This would not only level the playing field, it would raise it," says Dupont. "Every clinician in the world would be operating at a level of skill and experience equivalent to the best in their field. This has always been the promise of medical robots. Autonomy may be what gets us there."
-end-
Georgios Fagogenis, PhD, of Boston Children's Hospital was first author on the paper. Coauthors were Margherita Mencattelli, PhD, Zurab Machaidze, MD, Karl Price, MaSC, Viktoria Weixler, MD, Mossab Saeed, MB, BS, and John Mayer, MD of Boston Children's Hospital; Benoit Rosa, PhD, of ICube, Universite? de Strasbourg (Strasbourg, France); and Fei-Yi Wu, MD, of Taipei Veterans General Hospital, Taipei, Taiwan. For more on the technology, contact TIDO@childrenshospital.org.

The study was funded by the National Institutes of Health (R01HL124020), with partial support from the ANR/Investissement d'avenir program. Dupont and several of his coauthors are inventors on U.S. patent application held by Boston Children's Hospital that covers the optical imaging technique.

About Boston Children's Hospital

Boston Children's Hospital, the primary pediatric teaching affiliate of Harvard Medical School, is home to the world's largest research enterprise based at a pediatric medical center. Its discoveries have benefited both children and adults since 1869. Today, more than 3,000 scientists, including 8 members of the National Academy of Sciences, 18 members of the National Academy of Medicine and 12 Howard Hughes Medical Investigators comprise Boston Children's research community. Founded as a 20-bed hospital for children, Boston Children's is now a 415-bed comprehensive center for pediatric and adolescent health care. For more, visit our Vector and Thriving blogs and follow us on social media @BostonChildrens, @BCH_Innovation, Facebook and YouTube.

Boston Children's Hospital

Related Robots Articles from Brightsurf:

On the way to lifelike robots
In order for robots to be able to achieve more than simple automated machines in the future, they must not only have their own ''brain''.

Children think robots can help the elderly -- but not their own grandparents
A study that asked children to assess three different robots showed that they responded most positively to simple robots shaped like flower pots, and were most sceptical of Pepper the robot, which looks more human.

Nanomaterial gives robots chameleon skin
A new film made of gold nanoparticles changes color in response to any type of movement.

How many jobs do robots really replace?
MIT economist Daron Acemoglu's new research puts a number on the job costs of automation.

Robots popular with older adults
A new study by psychologists from the University of Jena (Germany) does not confirm that robot skepticism among elder people is often suspected in science.

Showing robots how to do your chores
By observing humans, robots learn to perform complex tasks, such as setting a table.

Designing better nursing care with robots
Robots are becoming an increasingly important part of human care, according to researchers based in Japan.

Darn you, R2! When can we blame robots?
A recent study finds that people are likely to blame robots for workplace accidents, but only if they believe the robots are autonomous.

Robots need a new philosophy to get a grip
Robots need to know the reason why they are doing a job if they are to effectively and safely work alongside people in the near future.

How can robots land like birds?
Birds can perch on a wide variety of surfaces, thick or thin, rough or slick.

Read More: Robots News and Robots Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.