Nav: Home

Augmented Reality helps surgeons to 'see through' tissue and reconnect blood vessels

January 30, 2018

Using augmented reality in the operating theatre could help surgeons to improve the outcome of reconstructive surgery for patients.

In a series of procedures carried out by a team at Imperial College London at St Mary's Hospital, researchers have shown for the first time how surgeons can use Microsoft HoloLens headsets while operating on patients undergoing reconstructive lower limb surgery.

The HoloLens is a self-contained computer headset that immerses the wearer in 'mixed reality', enabling them to interact with 'holograms' - computer-generated objects made visible through the visor. In the UK, headsets are currently only available for developers.

The Imperial team used the technology to overlay images of CT scans - including the position of bones and key blood vessels - onto each patient's leg, in effect enabling the surgeon to 'see through' the limb during surgery.

According to the team trialling the technology, the approach can help surgeons locate and reconnect key blood vessels during reconstructive surgery, which could improve outcomes for patients.

"We are one of the first groups in the world to use the HoloLens successfully in the operating theatre," said Dr Philip Pratt, a Research Fellow in the Department of Surgery & Cancer and lead author of the study, published in European Radiology Experimental. "Through this initial series of patient cases we have shown that the technology is practical, and that it can provide a benefit to the surgical team. With the HoloLens, you look at the leg and essentially see inside of it. You see the bones, the course of the blood vessels, and can identify exactly where the targets are located."

Following a car accident or severe trauma, patients may have tissue damage or open wounds that require reconstructive surgery using fasciocutaneous flaps. These flaps of tissue, which are taken from elsewhere on the body and include the skin and blood vessels, are used to cover the wound and enable it to close and heal properly.

A vital step in the process is connecting the blood vessels of the 'new' tissue with those at the site of the wound, so oxygenated blood can reach the new tissue and keep it alive.

The standard approach for this element of reconstructive surgery has been the use of a handheld scanner which uses ultrasound to identify blood vessels under the skin by detecting the movement of blood pulsing through them, enabling the surgeon to approximate where the vessels are and their course through the tissue.

"Augmented reality offers a new way to find these blood vessels under the skin accurately and quickly by overlaying scan images onto the patient during the operation," explained Dr Pratt.

MAKING THE MODEL

In the procedures used to trial the technology, five patients requiring reconstructive surgery on their legs underwent CT scans to map the structure of the limb, including the position of bones and the location and course of blood vessels.

Images from the scans were then segmented into bone, muscle, fatty tissue and blood vessels by Dr Dimitri Amiras, a consultant radiologist at Imperial College Healthcare NHS Trust (ICHNT), and loaded into intermediary software to create 3D models of the leg.

These models were then fed into specially designed software that renders the images for the HoloLens headset, which in turn overlays the model onto what the surgeon can see in the operating theatre. Clinical staff are able to manipulate these AR images through hand gestures to make any fine adjustments and correctly line up the model with surgical landmarks on the patient's limbs, such as the knee joint or ankle bone.

Dr Amiras said: "St Mary's Hospital is a major trauma centre, giving us the opportunity to try and improve the pre-operative planning for reconstructive flaps. Over time, the scanning protocol has been optimised to give excellent images of the anatomy, however, at first we had to rely on rough measurements of anatomical landmarks taken from 3D CT reconstructions to guide surgery.

"Now, using the HoloLens, we can identify where the blood vessels are in 3D space and use virtual 3D arrows to guide the surgeon. Currently, data preparation is a time consuming process, but in the future much of this could be automated, with the consultant radiologist checking the accuracy of the model against the original scan. I think this is a great example of what can be achieved in an Academic Health Science Centre."

THE SURGEON'S VIEW

Mr Jon Simmons, a plastic and reconstructive surgeon at ICHNT, led the team who carried out the procedures using the HoloLens headset and augmented reality models. The cases ranged from a 41-year-old man who had sustained leg injuries during a car accident, to an 85-year-old woman with a compound fractured ankle. The surgical teams reported the HoloLens to be a powerful tool in the theatre, with the approach being more reliable and less time-consuming than the ultrasound method of locating blood vessels.

"The application of AR technology in the operating theatre has some really exciting possibilities," said Mr Simmons. "It could help to simplify and improve the accuracy of some elements of reconstructive procedures. While the technology can't replace the skill and experience of the clinical team, it could potentially help to reduce the time a patient spends under anaesthetic and reduce the margin for error. We hope that it will allow us to provide more tailored surgical solutions for individual patients."

The group highlights a few limitations with the technology, which could include errors during the modelling stages as well as the potential for the overlaid model to be misaligned. In addition, the case studies so far have been based on the leg, which has a number of clearly visible surgical 'landmarks', such as the ankle or knee. Areas without these rigid landmarks, such as abdomen, may be more complicated with a greater potential for movement of blood vessels.

However, the researchers are confident that, once refined, the approach could be applied to other areas of reconstructive surgery requiring tissue flaps, such as breast reconstruction following mastectomy. The next steps include trialling the technology in a larger set of patients, with procedures carried out by teams at multiple centres.

Dr Pratt added: "In future we hope to automate the process further. We can use software to improve the alignment and will attach markers to the patient when they have the scan, with the same markers present during the operation to use as additional points of reference. There are a number of areas we would like to explore, and further improvements are needed, but the small case series has shown that for reconstructive surgery, this seems to be a valuable tool in the operating theatre."
-end-
'Through the HoloLens looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels' by Philip Pratt et al. is published in the journal European Radiology Experimental.

Imperial College London

Related Blood Vessels Articles:

Study: Use of prefabricated blood vessels may revolutionize root canals
Researchers at OHSU in Portland, Oregon, have developed a process by which they can engineer new blood vessels in teeth, creating better long-term outcomes for root canal patients and clinicians.
New findings on formation and malformation of blood vessels
In diseases like cancer, diabetes, rheumatism and stroke, a disorder develops in the blood vessels that exacerbates the condition and obstructs treatment.
Targeting blood vessels to improve cancer immunotherapy
EPFL scientists have improved the efficacy of cancer immunotherapy by blocking two proteins that regulate the growth of tumor blood vessels.
Reprogrammed blood vessels promote cancer spread
Tumor cells use the bloodstream to spread in the body.
Neurons modulate the growth of blood vessels
A team of researchers at Karlsruhe Institute of Technology shake at the foundations of a dogma of cell biology.
Sensor for blood flow discovered in blood vessels
The PIEZO1 cation channel translates mechanical stimulus into a molecular response to control the diameter of blood vessels.
Blood vessels control brain growth
Blood vessels play a vital role in stem cell reproduction, enabling the brain to grow and develop in the womb, reveals new UCL research in mice.
No blood vessels without cloche
After 20 years of searching, scientists discover the mystic gene controlling vessel and blood cell growth in the embryo.
New way of growing blood vessels could boost regenerative medicine
Growing tissues and organs in the lab for transplantation into patients could become easier after scientists discovered an effective way to produce three-dimensional networks of blood vessels, vital for tissue survival yet a current stumbling block in regenerative medicine.
Regenerating blood vessels gets $2.7 million grant
Biomedical engineers in the Cockrell School of Engineering at The University of Texas at Austin have received $2.7 million in funding to advance a treatment that regenerates blood vessels.

Related Blood Vessels Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Bias And Perception
How does bias distort our thinking, our listening, our beliefs... and even our search results? How can we fight it? This hour, TED speakers explore ideas about the unconscious biases that shape us. Guests include writer and broadcaster Yassmin Abdel-Magied, climatologist J. Marshall Shepherd, journalist Andreas Ekström, and experimental psychologist Tony Salvador.
Now Playing: Science for the People

#514 Arctic Energy (Rebroadcast)
This week we're looking at how alternative energy works in the arctic. We speak to Louie Azzolini and Linda Todd from the Arctic Energy Alliance, a non-profit helping communities reduce their energy usage and transition to more affordable and sustainable forms of energy. And the lessons they're learning along the way can help those of us further south.