Deep learning-based turbulence mitigation for long-range imaging

Vint, David and Di Caterina, Gaetano and Kirkland, Paul and Lamb, Robert; (2024) Deep learning-based turbulence mitigation for long-range imaging. In: SPIE Sensors + Imaging. SPIE, GBR. (In Press)

[thumbnail of Vint-etal-SPIE-2024-Deep-learning-based-turbulence-mitigation-for-long-range-imaging] Text. Filename: Vint-etal-SPIE-2024-Deep-learning-based-turbulence-mitigation-for-long-range-imaging.pdf
Accepted Author Manuscript
Restricted to Repository staff only until 1 January 2099.
Download (6MB) | Request a copy

Abstract

The distortion caused by turbulence in the atmosphere during long range imaging can result in low quality images and videos. This, in turn, greatly increases the difficulty of any post acquisition tasks such as tracking or classification. The mitigation of such distortions is therefore important, allowing any post processing steps to be performed successfully. We make use of the EDVR network, initially designed for video restoration and super resolution, to mitigate the effects of turbulence. This paper presents two modifications to the training and architecture of EDVR, that improve its applicability to turbulence mitigation: namely the replacement of the deformable convolution layers present in the original EDVR architecture, alongside the addition of perceptual loss. This paper also presents an analysis of common metrics used for image quality assessment and it evaluates their suitability for the comparison of turbulence mitigation approaches. In this context, traditional metrics such as Peak Signal-to-Noise Ratio can be misleading, as they could reward undesirable attributes, such as increased contrast instead of high frequency detail. We argue that the applications for which turbulence mitigated imagery is used should be the real markers of quality for any turbulence mitigation technique. To aid in this, we also present a new turbulence classification dataset that can be used to measure the classification performance before and after turbulence mitigation.

ORCID iDs

Vint, David, Di Caterina, Gaetano ORCID logoORCID: https://orcid.org/0000-0002-7256-0897, Kirkland, Paul ORCID logoORCID: https://orcid.org/0000-0001-5905-6816 and Lamb, Robert;
CORE (COnnecting REpositories)