Convolutional neural network denoising in fluorescence lifetime imaging microscopy (FLIM)
Abstract
Fluorescence lifetime imaging microscopy (FLIM) systems are limited by their slow processing speed, low signal-to-noise ratio (SNR), and expensive and challenging hardware setups. In this work, we demonstrate applying a denoising convolutional network to improve FLIM SNR. The network will integrated with an instant FLIM system with fast data acquisition based on analog signal processing, high SNR using high-efficiency pulse-modulation, and cost-effective implementation utilizing off-the-shelf radio-frequency components. Our instant FLIM system simultaneously provides the intensity, lifetime, and phasor plots in vivo and ex vivo. By integrating image denoising using the trained deep learning model on the FLIM data, provide accurate FLIM phasor measurements are obtained. The enhanced phasor is then passed through the K-means clustering segmentation method, an unbiased and unsupervised machine learning technique to separate different fluorophores accurately. Our experimental in vivo mouse kidney results indicate that introducing the deep learning image denoising model before the segmentation effectively removes the noise in the phasor compared to existing methods and provides clearer segments. Hence, the proposed deep learning-based workflow provides fast and accurate automatic segmentation of fluorescence images using instant FLIM. The denoising operation is effective for the segmentation if the FLIM measurements are noisy. The clustering can effectively enhance the detection of biological structures of interest in biomedical imaging applications.
Yide Zhang
Postdoctoral Fellow
My research is interdisciplinary and focused on developing new types of optical imaging techniques that could advance the work of other researchers and medical personnel in a wide variety of fields. Currently, I am developing next-generation photoacoustic and ultrafast imaging techniques that can observe biological and physical phenomena that are too fast to be imaged with existing methods. The observation of the ultrafast phenomena could provide a better understanding of the fundamentals of life and physical sciences. I am also developing novel quantum imaging approaches that can investigate biological organisms with an imaging performance that cannot be achieved using classical optical imaging. In my free time, I enjoy cooking, hiking, cycling, and traveling.