Deep Vision: Near-infrared imaging and machine learning can identify hidden tumors

February 02, 2021

Tumors can be damaging to surrounding blood vessels and tissues even if they're benign. If they're malignant, they're aggressive and sneaky, and often irrevocably damaging. In the latter case, early detection is key to treatment and recovery. But such detection can sometimes require advanced imaging technology, beyond what is available commercially today.

For instance, some tumors occur deep inside organs and tissues, covered by a mucosal layer, which makes it difficult for scientists to directly observe them with standard methods like endoscopy (which inserts a small camera into a patient's body via a thin tube) or reach them during biopsies. In particular, gastrointestinal stromal tumors (GISTs)--typically found in the stomach and the small intestines--require demanding techniques that are very time-consuming and prolong the diagnosis. Now, to improve GIST diagnosis, Drs. Daiki Sato, Hiroaki Ikematsu, and Takeshi Kuwata from the National Cancer Center Hospital East in Japan, Dr. Hideo Yokota from the RIKEN Center for Advanced Photonics, Japan, and Drs. Toshihiro Takamatsu and Kohei Soga from Tokyo University of Science, Japan, led by Dr. Hiroshi Takemura, have developed a technology that uses near-infrared hyperspectral imaging (NIR-HSI) along with machine learning. Their findings are published in Scientific Reports.

"This technique is a bit like X-rays, the idea is that you use electromagnetic radiation that can pass through the body to generate images of structures inside," Dr. Takemura explains, "The difference is that X-rays are at 0.01-10 nm, but near-infrared is at around 800-2500 nm. At that wavelength, near-infrared radiation makes tissues seem transparent in images. And these wavelengths are less harmful to the patient than even visible rays."

This should mean that scientists can safely investigate something that is hidden inside tissues, but until the study by Dr. Takemura and his colleagues, no one had attempted to use NIR-HSI on deep tumors like GISTs. Speaking of what got them to go down this line of investigation, Dr. Takemura pays homage to the late professor who began their journey: "This project has been possible only because of late Prof. Kazuhiro Kaneko, who broke the barriers between doctors and engineers and established this collaboration. We are following his wishes."

Dr. Takemura's team performed imaging experiments on 12 patients with confirmed cases of GISTs, who had their tumors removed through surgery. The scientists imaged the excised tissues using NIR-HSI, and then had a pathologist examine the images to determine the border between normal and tumor tissue. These images were then used as training data for a machine-learning algorithm, essentially teaching a computer program to distinguish between the pixels in the images that represent normal tissue versus those that represent tumor tissue.

The scientists found that even though 10 out of the 12 test tumors were completely or partly covered by a mucosal layer, the machine-learning analysis was effective in identifying GISTs, correctly color-coding tumor and non-tumor sections at 86% accuracy. "This is a very exciting development," Dr. Takemura explains, "Being able to accurately, quickly, and non-invasively diagnose different types of submucosal tumors without biopsies, a procedure that requires surgery, is much easier on both the patient and the physicians."

Dr. Takemura acknowledges that there are still challenges ahead, but feels they are prepared to solve them. The researchers identified several areas that would improve on their results, such as making their training dataset much larger, adding information about how deep the tumor is for the machine-learning algorithm, and including other types of tumors in the analysis. Work is also underway to develop an NIR-HSI system that builds on top of existing endoscopy technology.

"We've already built a device that attaches an NIR-HSI camera to the end of an endoscope and hope to perform NIR-HSI analysis directly on a patient soon, instead of just on tissues that had been surgically removed," Dr. Takemura says, "In the future, this will help us separate GISTs from other types of submucosal tumors that could be even more malignant and dangerous. This study is the first step towards much more groundbreaking research in the future, enabled by this interdisciplinary collaboration."

For now, a means of accurately and non-invasively detecting GISTs early on could be clinically available widely, soon!

Authors: Daiki Sato (1), Toshihiro Takamatsu (2,3), Masakazu Umezawa (4), Yuichi Kitagawa (4), Kosuke Maeda (5), Naoki Hosokawa (4), Kyohei Okubo (4,6), Masao Kamimura (4,6), Tomohiro Kadota (1), Tetsuo Akimoto (7,8), Takahiro Kinoshita (9), Tomonori Yano (1), Takeshi Kuwata (10), Hiroaki Ikematsu (1,2), Hiroshi Takemura (3,5), Hideo Yokota (11) & Kohei Soga (3,4,6)

Title of original paper: Distinction of surgically resected gastrointestinal stromal tumor by near-infrared hyperspectral imaging

Journal: Scientific Reports

DOI: 10.1038/s41598-020-79021-7


(1) Department of Gastroenterology and Endoscopy, National Cancer Center Hospital East, Japan.

(2) Exploratory Oncology Research & Clinical Trial Center, National Cancer Center, Japan.

(3) Research Institute for Biomedical Sciences, Tokyo University of Science, Japan.

(4) Department of Materials Science and Technology, Tokyo University of Science, Japan.

(5) Department of Mechanical Engineering, Tokyo University of Science, Japan.

(6) Imaging Frontier Center, Tokyo University of Science, Japan.

(7) Division of Radiation Oncology, National Cancer Center Hospital East, Japan.

(8) Course of Advanced Clinical Research of Cancer, Juntendo University Graduate School of Medicine, Japan.

(9) Department of Gastric Surgery, National Cancer Center Hospital East, Japan.

(10) Department of Pathology and Clinical Laboratories, National Cancer Center Hospital, East Japan.

(11) RIKEN Center for Advanced Photonics, Japan.

Further Information

Professor Hiroshi Takemura
Department of Mechanical Engineering,
Tokyo University of Science

Hiroaki Ikematsu, MD, PhD
Department of Gastroenterology and Endoscopy
National Cancer Center Hospital East

Team Leader: Hideo Yokota (D.Eng.)
Image Processing Research Team
RIKEN Center for Advanced Photonics

Funding information

This study was partially funded by The National Cancer Center Research and Development Fund.

Tokyo University of Science

Related Tumors Articles from Brightsurf:

A viable vaccine for tough tumors
While immunotherapies work well for some cancers, others are immune-resistant and condemn patients to the severe side effects of long-term chemo treatment.

Women could conceive after ovarian tumors
Women receiving fertility-sparing surgery for treatment of borderline ovarian tumours were able to have children, a study from Karolinska Institutet in Sweden published in Fertility & Sterility shows.

Attacking tumors from the inside
A new technology that allows researchers to peer inside malignant tumors shows that two experimental drugs can normalize aberrant blood vessels, oxygenation, and other aspects of the tumor microenvironment in non-small cell lung cancer (NSCLC), helping to suppress the tumor's growth and spread, UT Southwestern researchers report.

Directing nanoparticles straight to tumors
Modern anticancer therapies aim to attack tumor cells while sparing healthy tissue.

A solid vaccine for liquid tumors
Acute myeloid leukemia (AML) is a deadly blood cancer that kills most of its victims within five years.

Evolutionarily novel genes work in tumors
A team of scientists from Peter the Great St. Petersburg Polytechnic University studied the evolutionary ages of human genes and identified a new class of them expressed in tumors -- tumor specifically expressed, evolutionarily novel (TSEEN) genes.

Identification of all types of germ cells tumors
Germ cell tumors were considered very heterogeneous and diverse, until recently.

Laser light detects tumors
A team of researchers from Jena presents a groundbreaking new method for the rapid, gentle and reliable detection of tumors with laser light.

Better prognosticating for dogs with mammary tumors
For dogs with mammary tumors, deciding a course of treatment can depend on a variety of factors, some of which may seem to contradict one another.

The evolution of brain tumors
Scientists from the German Cancer Research Center found in a recent study that only three different genetic alterations drive the early development of malignant glioblastomas.

Read More: Tumors News and Tumors Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to