Knowledge distillation for scalable non-intrusive load monitoring

Tanoni, Giulia and Stankovic, Lina and Stankovic, Vladimir and Squartini, Stefano and Principi, Emanuele (2024) Knowledge distillation for scalable non-intrusive load monitoring. IEEE Transactions on Industrial Informatics, 20 (3). pp. 4710-4721. ISSN 1551-3203 (https://doi.org/10.1109/TII.2023.3328436)

[thumbnail of Tanoni-etal-IEEETII-2023-Knowledge-distillation-for-scalable-non-intrusive-load-monitoring]
Preview
 Text. Filename: Tanoni-etal-IEEETII-2023-Knowledge-distillation-for-scalable-non-intrusive-load-monitoring.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (1MB)| Preview

Abstract

Smart meters allow the grid to interface with individual buildings and extract detailed consumption information using nonintrusive load monitoring (NILM) algorithms applied to the acquired data. Deep neural networks, which represent the state of the art for NILM, are affected by scalability issues since they require high computational and memory resources, and by reduced performance when training and target domains mismatched. This article proposes a knowledge distillation approach for NILM, in particular for multilabel appliance classification, to reduce model complexity and improve generalization on unseen data domains. The approach uses weak supervision to reduce labeling effort, which is useful in practical scenarios. Experiments, conducted on U.K.-DALE and REFIT datasets, demonstrated that a low-complexity network can be obtained for deployment on edge devices while maintaining high performance on unseen data domains. The proposed approach outperformed benchmark methods in unseen target domains achieving a F1 -score 0.14 higher than a benchmark model 78 times more complex.

ORCID iDs

Tanoni, Giulia, Stankovic, Lina ORCID logoORCID: https://orcid.org/0000-0002-8112-1976, Stankovic, Vladimir ORCID logoORCID: https://orcid.org/0000-0002-1075-2420, Squartini, Stefano and Principi, Emanuele;
CORE (COnnecting REpositories)