Deep learning-based turbulence mitigation for long-range imaging
Vint, David and Di Caterina, Gaetano and Kirkland, Paul and Lamb, Robert; (2024) Deep learning-based turbulence mitigation for long-range imaging. In: SPIE Sensors + Imaging. SPIE, GBR. (In Press)
Text.
Filename: Vint-etal-SPIE-2024-Deep-learning-based-turbulence-mitigation-for-long-range-imaging.pdf
Accepted Author Manuscript Restricted to Repository staff only until 1 January 2099. Download (6MB) | Request a copy |
Abstract
The distortion caused by turbulence in the atmosphere during long range imaging can result in low quality images and videos. This, in turn, greatly increases the difficulty of any post acquisition tasks such as tracking or classification. The mitigation of such distortions is therefore important, allowing any post processing steps to be performed successfully. We make use of the EDVR network, initially designed for video restoration and super resolution, to mitigate the effects of turbulence. This paper presents two modifications to the training and architecture of EDVR, that improve its applicability to turbulence mitigation: namely the replacement of the deformable convolution layers present in the original EDVR architecture, alongside the addition of perceptual loss. This paper also presents an analysis of common metrics used for image quality assessment and it evaluates their suitability for the comparison of turbulence mitigation approaches. In this context, traditional metrics such as Peak Signal-to-Noise Ratio can be misleading, as they could reward undesirable attributes, such as increased contrast instead of high frequency detail. We argue that the applications for which turbulence mitigated imagery is used should be the real markers of quality for any turbulence mitigation technique. To aid in this, we also present a new turbulence classification dataset that can be used to measure the classification performance before and after turbulence mitigation.
ORCID iDs
Vint, David, Di Caterina, Gaetano ORCID: https://orcid.org/0000-0002-7256-0897, Kirkland, Paul ORCID: https://orcid.org/0000-0001-5905-6816 and Lamb, Robert;-
-
Item type: Book Section ID code: 90478 Dates: DateEvent30 June 2024Published30 June 2024AcceptedSubjects: Technology > Electrical engineering. Electronics Nuclear engineering Department: Faculty of Engineering > Electronic and Electrical Engineering Depositing user: Pure Administrator Date deposited: 04 Sep 2024 14:30 Last modified: 02 Oct 2024 13:37 Related URLs: URI: https://strathprints.strath.ac.uk/id/eprint/90478