Spatial resolution improved fluorescence lifetime imaging via deep learning

Xiao, Dong and Zang, Zhenya and Xie, Wujun and Sapermsap, Natakorn and Chen, Yu and Li, David Day Uei (2022) Spatial resolution improved fluorescence lifetime imaging via deep learning. Optics Express, 30 (7). pp. 11479-11494. ISSN 1094-4087 (https://doi.org/10.1364/OE.451215)

[thumbnail of Xiao-etal-OE-2022-Spatial-resolution-improved-fluorescence-lifetime-imaging]
Preview
 Text. Filename: Xiao_etal_OE_2022_Spatial_resolution_improved_fluorescence_lifetime_imaging.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (19MB)| Preview

Abstract

We present a deep learning approach to obtain high-resolution (HR) fluorescence lifetime images from low-resolution (LR) images acquired from Fluorescence Lifetime IMaging (FLIM) systems. We first proposed a theoretical method for training neural networks to generate massive semi-synthetic FLIM data with various cellular morphologies, a sizeable dynamic lifetime range, and complex decay components. We then developed a degrading model to obtain LR-HR pairs and created a hybrid neural network, the Spatial Resolution Improved FLIM net (SRI-FLIMnet), to simultaneously estimate fluorescence lifetimes and realize the nonlinear transformation from LR to HR images. The evaluative results demonstrate SRI-FLIMnet’s superior performance in reconstructing spatial information from limited pixel resolution. We also verified SRI-FLIMnet using experimental images of bacterial infected mouse raw macrophage cells. Results show that the proposed data generation method and SRIFLIMnet efficiently achieve superior spatial resolution for FLIM applications. Our study provides a solution for fast obtaining HR FLIM images.

ORCID iDs

Xiao, Dong, Zang, Zhenya, Xie, Wujun ORCID logoORCID: https://orcid.org/0000-0003-0483-8639, Sapermsap, Natakorn, Chen, Yu and Li, David Day Uei ORCID logoORCID: https://orcid.org/0000-0002-6401-4263;
CORE (COnnecting REpositories)