A human-on-the-loop approach for labelling seismic recordings from landslide site via a multi-class deep-learning based classification model

Tools

Jiang, Jiaxin and Murray, David and Stankovic, Vladimir and Stankovic, Lina and Hibert, Clement and Pytharouli, Stella and Malet, Jean-Philippe (2025) A human-on-the-loop approach for labelling seismic recordings from landslide site via a multi-class deep-learning based classification model. Science of Remote Sensing, 11. 100189. ISSN 2666-0172 (https://doi.org/10.1016/j.srs.2024.100189)

[thumbnail of Jiang-etal-2025-A-human-on-the-loop-approach-for-labelling-seismic-recordings-from-landslide-site]
Preview
 Text. Filename: Jiang-etal-2025-A-human-on-the-loop-approach-for-labelling-seismic-recordings-from-landslide-site.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (3MB)| Preview

Abstract

With the increased frequency and intensity of landslides in recent years, there is growing research on timely detection of the underlying subsurface processes that contribute to these hazards. Recent advances in machine learning have introduced algorithms for classifying seismic events associated with landslides, such as earthquakes, rockfalls, and smaller quakes. However, the opaque, “black box” nature of deep learning algorithms has raised concerns of reliability and interpretability by Earth scientists and end-users, hesitant to adopt these models. Leveraging on recent recommendations on embedding humans in the Artificial Intelligence (AI) decision making process, particularly training and validation, we propose a methodology that incorporates data labelling, verification, and re-labelling through a multi-class convolutional neural network (CNN) supported by Explainable Artificial Intelligence (XAI) tools, specifically, Layer-wise Relevance Propagation (LRP). To ensure reproducibility, a catalogue of training events is provided as supplementary material. Evaluation from the French Seismologic and Geodetic Network (Résif) dataset, gathered in the Alps in France, demonstrate the effectiveness of the proposed methodology, achieving a recall/sensitivity of 97.3% for rockfalls and 68.4% for quakes.

ORCID iDs

Jiang, Jiaxin, Murray, David ORCID logoORCID: https://orcid.org/0000-0002-5040-9862, Stankovic, Vladimir ORCID logoORCID: https://orcid.org/0000-0002-1075-2420, Stankovic, Lina ORCID logoORCID: https://orcid.org/0000-0002-8112-1976, Hibert, Clement, Pytharouli, Stella ORCID logoORCID: https://orcid.org/0000-0002-2899-1518 and Malet, Jean-Philippe;
CORE (COnnecting REpositories)