Interpretability and reliability-driven knowledge distillation for non-intrusive load monitoring on the edge

Tools

Batic, Djordje and Tanoni, Giulia and Principi, Emanuele and Stankovic, Lina and Stankovic, Vladimir and Squartini, Stefano (2025) Interpretability and reliability-driven knowledge distillation for non-intrusive load monitoring on the edge. Expert Systems with Applications, 294. 128837. ISSN 0957-4174 (https://doi.org/10.1016/j.eswa.2025.128837)

[thumbnail of Batic-etal-ESA-2025-Interpretability-and-reliability-driven-knowledge-distillation-for-non-intrusive]
Preview
 Text. Filename: Batic-etal-ESA-2025-Interpretability-and-reliability-driven-knowledge-distillation-for-non-intrusive.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (2MB)| Preview

Abstract

The deployment of deep neural networks (DNNs) on resource-constrained edge devices necessitates efficient, low-complexity algorithms. Knowledge distillation (KD) addresses this through a student-teacher paradigm, transferring knowledge from complex teacher models to simpler student models. Current KD methods often optimize student performance without adequately addressing the reliability and interpretability of transferred knowledge, thus presenting challenges in maintaining both robustness and decision transparency. This paper introduces an Interpretability and Reliability-driven Knowledge Distillation (IR-KD) framework that enhances teacher model interpretability through perception-aligned gradients while leveraging hidden information from weak labels to optimize knowledge transfer. Our approach ensures compressed models remain computationally efficient while improving interpretability, which is essential for trustworthy edge AI deployment. We demonstrate improved predictive performance and model interpretability in non-intrusive load monitoring (NILM) applications as a case study. Quantitative explainability metrics confirm that perception-aligned gradients provide more faithful explanations, validating our approach’s effectiveness in developing reliable and transparent edge AI systems.

ORCID iDs

Batic, Djordje ORCID logoORCID: https://orcid.org/0000-0002-7647-6641, Tanoni, Giulia, Principi, Emanuele, Stankovic, Lina ORCID logoORCID: https://orcid.org/0000-0002-8112-1976, Stankovic, Vladimir ORCID logoORCID: https://orcid.org/0000-0002-1075-2420 and Squartini, Stefano;
CORE (COnnecting REpositories)