C-ECAFormer : a new lightweight fault diagnosis framework towards heavy noise and small samples

Wang, Jie and Shao, Haidong and Yan, Shen and Liu, Bin (2023) C-ECAFormer : a new lightweight fault diagnosis framework towards heavy noise and small samples. Engineering Applications of Artificial Intelligence, 126 (Part C). 107031. ISSN 0952-1976 (https://doi.org/10.1016/j.engappai.2023.107031)

[thumbnail of Wang-etal-EAAI-2023-C-ECAFormer-a-new-lightweight-fault-diagnosis-framework-towards-heavy-noise-and-small-samples]
Preview
 Text. Filename: Wang_etal_EAAI_2023_C_ECAFormer_a_new_lightweight_fault_diagnosis_framework_towards_heavy_noise_and_small_samples.pdf
Accepted Author Manuscript
License: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 logo
Download (4MB)| Preview

Abstract

In engineering practice, small-sample fault diagnosis of mechanical equipment towards heavy noise interference poses great challenges for the existing Transformer based intelligent models. To address these challenges, this paper proposes a new lightweight model called C-ECAFormer. Firstly, inverted residual block is used to establish signal correlations and inductive bias capability and to extract richer local feature information by varying the input channel dimensions. Secondly, ECAFormer module is designed to enhance the relationship awareness between different channels in the input signal features, thereby improving the model's attention to important channels. Finally, collaborative self-attention block is developed to facilitate spatial interaction between window local and grid global in vibration signals, reducing the number of parameters and computational complexity of the model. The results of two experiments demonstrate that the proposed approach accommodates advantages of lightweight and robustness in small-sample fault diagnosis tasks, compared to the existing mainstream Transformer and CNN fault diagnosis frameworks.

ORCID iDs

Wang, Jie, Shao, Haidong, Yan, Shen and Liu, Bin ORCID logoORCID: https://orcid.org/0000-0002-3946-8124;
CORE (COnnecting REpositories)