SatelliteCloudGenerator : controllable cloud and shadow synthesis for multi-spectral optical satellite images

Czerkawski, Mikolaj and Atkinson, Robert and Michie, Craig and Tachtatzis, Christos (2023) SatelliteCloudGenerator : controllable cloud and shadow synthesis for multi-spectral optical satellite images. Remote Sensing, 15 (17). 4138. ISSN 2072-4292 (https://doi.org/10.3390/rs15174138)

[thumbnail of Czerkawski-etal-RS-2023-controllable-cloud-and-shadow-synthesis-for-multi-spectral-optical-satellite-images]
Preview
 Text. Filename: Czerkawski_etal_RS_2023_controllable_cloud_and_shadow_synthesis_for_multi_spectral_optical_satellite_images.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (25MB)| Preview

Abstract

Optical satellite images of Earth frequently contain cloud cover and shadows. This requires processing pipelines to recognize the presence, location, and features of the cloud-affected regions. Models that make predictions about the ground behind the clouds face the challenge of lacking ground-truth information, i.e. the exact state of Earth’s surface. Currently, the solution to that is to either (i) create pairs from samples acquired at different times, or (ii) simulate cloudy data based on a clear acquisition. This work follows the second approach and proposes an open-source simulation tool, capable of generating a diverse and unlimited amount of high-quality simulated pair data with controllable parameters to adjust cloud appearance, with no annotation cost. The tool is available at https://github.com/strath-ai/SatelliteCloudGenerator. An indication of the quality and utility of the generated clouds is demonstrated by the models for cloud detection and cloud removal trained exclusively on simulated data, which approach the performance of their equivalents trained on real data.

ORCID iDs

Czerkawski, Mikolaj ORCID logoORCID: https://orcid.org/0000-0002-0927-0416, Atkinson, Robert ORCID logoORCID: https://orcid.org/0000-0002-6206-2229, Michie, Craig ORCID logoORCID: https://orcid.org/0000-0001-5132-4572 and Tachtatzis, Christos ORCID logoORCID: https://orcid.org/0000-0001-9150-6805;
CORE (COnnecting REpositories)