Machine learning for faster and smarter fluorescence lifetime imaging microscopy

Abstract

Fluorescence lifetime imaging microscopy (FLIM) is a powerful technique in biomedical research that uses the fluorophore decay rate to provide additional contrast in fluorescence microscopy. However, at present, the calculation, analysis, and interpretation of FLIM is a complex, slow, and computationally expensive process. Machine learning (ML) techniques are well suited to extract and interpret measurements from multi-dimensional FLIM data sets with substantial improvement in speed over conventional methods. In this topical review, we first discuss the basics of FILM and ML. Second, we provide a summary of lifetime extraction strategies using ML and its applications in classifying and segmenting FILM images with higher accuracy compared to conventional methods. Finally, we discuss two potential directions to improve FLIM with ML with proof of concept demonstrations.

Publication
Journal of Physics: Photonics, vol. 2, no. 4, pp. 042005
Yide Zhang
Yide Zhang
Incoming Assistant Professor of ECEE and BME

My long-term research goal is to pioneer optical imaging technologies that surpass current limits in speed, accuracy, and accessibility, advancing translational research. With a foundation in electrical engineering, particularly in biomedical imaging and optics, my PhD work at the University of Notre Dame focused on advancing multiphoton fluorescence lifetime imaging microscopy and super-resolution microscopy, significantly reducing image generation time and cost. I developed an analog signal processing method that enables real-time streaming of fluorescence intensity and lifetime data, and created the first Poisson-Gaussian denoising dataset to benchmark image denoising algorithms for high-quality, real-time applications in biomedical research. As a postdoc at the California Institute of Technology (Caltech), my research expanded to include pioneering photoacoustic imaging techniques, enabling noninvasive and rapid imaging of hemodynamics in humans. In the realm of quantum imaging, I developed innovative techniques utilizing spatial and polarization entangled photon pairs, overcoming challenges such as poor signal-to-noise ratios and low resolvable pixel counts. Additionally, I advanced ultrafast imaging methods for visualizing passive current flows in myelinated axons and electromagnetic pulses in dielectrics. My research is currently funded by the National Institutes of Health (NIH) K99/R00 Pathway to Independence Award. I will join the University of Colorado Boulder (CU Boulder) as an Assistant Professor of Electrical, Computer & Energy Engineering (ECEE) and Biomedical Engineering (BME) in May 2025.

comments powered by Disqus

Related