Non-fusion time-resolved depth image reconstruction using a highly efficient neural network architecture

Zang, Zhenya and Xiao, Dong and Li, David (2021) Non-fusion time-resolved depth image reconstruction using a highly efficient neural network architecture. Optics Express, 29 (13). pp. 19278-19291. ISSN 1094-4087 (https://doi.org/10.1364/OE.425917)

[thumbnail of Zang-etal-OE-2021-Non-fusion-time-resolved-depth-image-reconstruction-using-a-highly-efficient]
Preview
Text. Filename: Zang_etal_OE_2021_Non_fusion_time_resolved_depth_image_reconstruction_using_a_highly_efficient.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo

Download (5MB)| Preview

Abstract

Single-photon avalanche diodes (SPAD) are powerful sensors for 3D light detection and ranging (LiDAR) in low light scenarios due to their single-photon sensitivity. However, accurately retrieving ranging information from noisy time-of-arrival (ToA) point clouds remains a challenge. This paper proposes a photon-efficient, non-fusion neural network architecture that can directly reconstruct high-fidelity depth images from ToA data without relying on other guiding images. Besides, the neural network architecture was compressed via a low-bit quantization scheme so that it is suitable to be implemented on embedded hardware platforms. The proposed quantized neural network architecture achieves superior reconstruction accuracy and fewer parameters than previously reported networks.