Deep learning merges advantages of holography and bright-field microscopy for 3D imaging

March 06, 2019

Digital holographic microscopy is an imaging modality that can digitally reconstruct the images of 3D samples from a single hologram by digitally refocusing it through the entire 3D sample volume. In comparison, scanning through a sample volume with a conventional light microscope requires using a mechanical stage to shift the sample and taking multiple images at various depths, which sets a constraint on the achievable imaging speed and throughput. Moreover, holographic imaging can be performed at a fraction of the size and cost of a conventional bright-field microscope, also covering a much larger field of view. This has enabled a myriad of hand-held devices powered by holography for bio-medical diagnostics and environmental sensing applications. Despite these advantages, the resulting images of a holographic microscope in general suffer from light interference related spatial artifacts, which can limit the achievable contrast in the reconstructed hologram.

Researchers at UCLA have developed a novel artificial neural network-based method to overcome these limitations of holographic 3D imaging. This new method, termed Bright-field Holography, has the best of both worlds as it combines the image contrast advantage of bright-field microscopy and the snapshot volumetric imaging capability of holography. In Bright-field Holography, a deep neural network is trained using co-registered pairs of digitally refocused holograms and their corresponding bright-field microscope images to learn the statistical image transformation between two different microscopy modalities. After its training, the deep neural network takes in a digitally refocused hologram corresponding to a given depth within the sample volume and transforms it into an image that is equivalent to a bright-field microscope image acquired at the same depth, matching the spatial and color contrast as well as the optical sectioning capability of a bright-field microscope. Although the training of such a neural network takes ~40 hours, after it is trained, the network remains fixed and can rapidly create its output image, within a second for a hologram with millions of pixels.

This research has been published in Light: Science and Applications, an open access journal of Springer Nature. The research was led by Dr. Aydogan Ozcan, the Chancellor's Professor of electrical and computer engineering at the UCLA Henry Samueli School of Engineering and Applied Science, and an associate director of the California NanoSystems Institute (CNSI), along with Yichen Wu a graduate student and Dr. Yair Rivenson, an Adjunct Professor of electrical and computer engineering at UCLA.

"Bright-field Holography bridges the contrast gap between the classical hologram reconstruction methods and a high-end bright-field microscope, while also eliminating the need to use complex hardware and mechanical scanning to rapidly image sample volumes." said Prof. Ozcan. One of the applications that will immediately benefit from this technology is rapid volumetric imaging of dynamic events within large volumes, opening new avenues for significantly advancing high-throughput imaging of liquid samples through deep learning.
Other co-authors of this article include Yilin Luo, Gunvant Chaudhari, Ayfer Calis and Kevin de Haan, all members of the Ozcan Lab at UCLA. Ozcan Lab is supported by the Koç Group, NSF and HHMI.

Link to the published paper:

Link to Ozcan Lab at UCLA:

Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences

Related Engineering Articles from Brightsurf:

Re-engineering antibodies for COVID-19
Catholic University of America researcher uses 'in silico' analysis to fast-track passive immunity

Next frontier in bacterial engineering
A new technique overcomes a serious hurdle in the field of bacterial design and engineering.

COVID-19 and the role of tissue engineering
Tissue engineering has a unique set of tools and technologies for developing preventive strategies, diagnostics, and treatments that can play an important role during the ongoing COVID-19 pandemic.

Engineering the meniscus
Damage to the meniscus is common, but there remains an unmet need for improved restorative therapies that can overcome poor healing in the avascular regions.

Artificially engineering the intestine
Short bowel syndrome is a debilitating condition with few treatment options, and these treatments have limited efficacy.

Reverse engineering the fireworks of life
An interdisciplinary team of Princeton researchers has successfully reverse engineered the components and sequence of events that lead to microtubule branching.

New method for engineering metabolic pathways
Two approaches provide a faster way to create enzymes and analyze their reactions, leading to the design of more complex molecules.

Engineering for high-speed devices
A research team from the University of Delaware has developed cutting-edge technology for photonics devices that could enable faster communications between phones and computers.

Breakthrough in blood vessel engineering
Growing functional blood vessel networks is no easy task. Previously, other groups have made networks that span millimeters in size.

Next-gen batteries possible with new engineering approach
Dramatically longer-lasting, faster-charging and safer lithium metal batteries may be possible, according to Penn State research, recently published in Nature Energy.

Read More: Engineering News and Engineering Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to