Nav: Home

Recovering color images from scattered light

July 29, 2019

DURHAM, NC -- Engineers at Duke University have developed a method for extracting a color image from a single exposure of light scattered through a mostly opaque material. The technique has applications in a wide range of fields from healthcare to astronomy.

The study appeared online on July 9 in the journal Optica.

"Others have been able to reconstruct color images from scattered light, but those methods had to sacrifice spatial resolution or required prior characterization of the scatterer in advance, which frequently isn't possible," said Michael Gehm, associate professor of electrical and computer engineering at Duke. "But our approach avoids all those issues."

When light is scattered as it passes through a translucent material, the emerging pattern of "speckle" looks as random as static on a television screen with no signal. But it isn't random. Because the light coming from one point of an object travels a path very similar to that of the light coming from an adjacent point, the speckle pattern from each looks very much the same, just shifted slightly.

With enough images, astronomers used to use this "memory effect" phenomenon to create clearer images of the heavens through a turbulent atmosphere, as long as the objects being imaged were sufficiently compact.

While the technique fell out of favor with the development of adaptive optics, which do the same job by using adjustable mirrors to compensate for the scattering, it has recently became popular once again. Because modern cameras can record hundreds of millions of pixels at a time, only a single exposure is needed to make the statistics work.

While this approach can reconstruct a scattered image, it has limitations in the realm of color. The speckle patterns created by different wavelengths are typically impossible to disentangle from one another.

The new memory effect imaging approach developed by the authors Xiaohan Li, a PhD student in Gehm's lab, Joel Greenberg, associate research professor of electrical and computer engineering, and Gehm breaks through this limitation.

The trick is to use a coded aperture followed by a prism. A coded aperture is basically a filter that allows light to pass through some areas but not others in a specific pattern. After the speckle is "stamped" by the coded aperture, it passes through a prism that causes different frequencies of light to spread out from each other.

This causes the pattern from the coded aperture to shift slightly in relation to the image being captured by the detector. And the amount it shifts is directly related to the color of light passing through.

"This shift is small compared to the overall size of what's being imaged, and because our detector is not sensitive to color, it creates a messy combination," said Li. "But the shift is enough to give our algorithm a toehold to tease the individual speckle patterns apart from each color, and from that we can figure out what the object looks like for each color."

The researchers show that, by focusing on five spectral channels corresponding to violet, green and three shades of red, the technique can reconstruct a letter "H" full of nuanced pinks, yellows and blues. Outside of this difficult proof-of-principle, the researchers believe their approach could find applications in fields such as astronomy and healthcare.

In astronomy, the color content of the light coming from astronomical phenomena contains valuable information about its chemical composition, and speckle is often created as light is distorted by the atmosphere. Similarly in healthcare, color can tell researchers something about the molecular composition of what's being imaged, or it can be used to identify biomolecules that have been tagged with fluorescent markers.

"There are a lot of applications where people really want to know how much energy there is in specific spectral bands emitted from objects located behind opaque occlusions," said Greenberg. "We've shown that this approach can accomplish this goal across the visible spectrum. Knowing the aperture pattern and how much it shifts as a function of wavelength provides the key we need to disentangle the messy sum into separate channels."
-end-
This research was supported by the Defense Advanced Research Projects Agency (HR0011-16-C-0027).

CITATION: "Single shot multi-spectral imaging through a thin scatterer," Xiaohan Li, Joel A. Greenberg, and Michael E. Gehm. Optica, July, 2019. DOI: 10.1364/OPTICA.6.000864

Duke University

Related Science Articles:

75 science societies urge the education department to base Title IX sexual harassment regulations on evidence and science
The American Educational Research Association (AERA) and the American Association for the Advancement of Science (AAAS) today led 75 scientific societies in submitting comments on the US Department of Education's proposed changes to Title IX regulations.
Science/Science Careers' survey ranks top biotech, biopharma, and pharma employers
The Science and Science Careers' 2018 annual Top Employers Survey polled employees in the biotechnology, biopharmaceutical, pharmaceutical, and related industries to determine the 20 best employers in these industries as well as their driving characteristics.
Science in the palm of your hand: How citizen science transforms passive learners
Citizen science projects can engage even children who previously were not interested in science.
Applied science may yield more translational research publications than basic science
While translational research can happen at any stage of the research process, a recent investigation of behavioral and social science research awards granted by the NIH between 2008 and 2014 revealed that applied science yielded a higher volume of translational research publications than basic science, according to a study published May 9, 2018 in the open-access journal PLOS ONE by Xueying Han from the Science and Technology Policy Institute, USA, and colleagues.
Prominent academics, including Salk's Thomas Albright, call for more science in forensic science
Six scientists who recently served on the National Commission on Forensic Science are calling on the scientific community at large to advocate for increased research and financial support of forensic science as well as the introduction of empirical testing requirements to ensure the validity of outcomes.
World Science Forum 2017 Jordan issues Science for Peace Declaration
On behalf of the coordinating organizations responsible for delivering the World Science Forum Jordan, the concluding Science for Peace Declaration issued at the Dead Sea represents a global call for action to science and society to build a future that promises greater equality, security and opportunity for all, and in which science plays an increasingly prominent role as an enabler of fair and sustainable development.
PETA science group promotes animal-free science at society of toxicology conference
The PETA International Science Consortium Ltd. is presenting two posters on animal-free methods for testing inhalation toxicity at the 56th annual Society of Toxicology (SOT) meeting March 12 to 16, 2017, in Baltimore, Maryland.
Citizen Science in the Digital Age: Rhetoric, Science and Public Engagement
James Wynn's timely investigation highlights scientific studies grounded in publicly gathered data and probes the rhetoric these studies employ.
Science/Science Careers' survey ranks top biotech, pharma, and biopharma employers
The Science and Science Careers' 2016 annual Top Employers Survey polled employees in the biotechnology, biopharmaceutical, pharmaceutical, and related industries to determine the 20 best employers in these industries as well as their driving characteristics.
Three natural science professors win TJ Park Science Fellowship
Professor Jung-Min Kee (Department of Chemistry, UNIST), Professor Kyudong Choi (Department of Mathematical Sciences, UNIST), and Professor Kwanpyo Kim (Department of Physics, UNIST) are the recipients of the Cheong-Am (TJ Park) Science Fellowship of the year 2016.
More Science News and Science Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Teaching For Better Humans 2.0
More than test scores or good grades–what do kids need for the future? This hour, TED speakers explore how to help children grow into better humans, both during and after this time of crisis. Guests include educators Richard Culatta and Liz Kleinrock, psychologist Thomas Curran, and writer Jacqueline Woodson.
Now Playing: Science for the People

#556 The Power of Friendship
It's 2020 and times are tough. Maybe some of us are learning about social distancing the hard way. Maybe we just are all a little anxious. No matter what, we could probably use a friend. But what is a friend, exactly? And why do we need them so much? This week host Bethany Brookshire speaks with Lydia Denworth, author of the new book "Friendship: The Evolution, Biology, and Extraordinary Power of Life's Fundamental Bond". This episode is hosted by Bethany Brookshire, science writer from Science News.
Now Playing: Radiolab

Dispatch 3: Shared Immunity
More than a million people have caught Covid-19, and tens of thousands have died. But thousands more have survived and recovered. A week or so ago (aka, what feels like ten years in corona time) producer Molly Webster learned that many of those survivors possess a kind of superpower: antibodies trained to fight the virus. Not only that, they might be able to pass this power on to the people who are sick with corona, and still in the fight. Today we have the story of an experimental treatment that's popping up all over the country: convalescent plasma transfusion, a century-old procedure that some say may become one of our best weapons against this devastating, new disease.   If you have recovered from Covid-19 and want to donate plasma, national and local donation registries are gearing up to collect blood.  To sign up with the American Red Cross, a national organization that works in local communities, head here.  To find out more about the The National COVID-19 Convalescent Plasma Project, which we spoke about in our episode, including information on clinical trials or plasma donation projects in your community, go here.  And if you are in the greater New York City area, and want to donate convalescent plasma, head over to the New York Blood Center to sign up. Or, register with specific NYC hospitals here.   If you are sick with Covid-19, and are interested in participating in a clinical trial, or are looking for a plasma donor match, check in with your local hospital, university, or blood center for more; you can also find more information on trials at The National COVID-19 Convalescent Plasma Project. And lastly, Tatiana Prowell's tweet that tipped us off is here. This episode was reported by Molly Webster and produced by Pat Walters. Special thanks to Drs. Evan Bloch and Tim Byun, as well as the Albert Einstein College of Medicine.  Support Radiolab today at Radiolab.org/donate.