A Lightweight Scale-Aware Modulation Swin Transformer Network for Axlebox Bearing Fault Diagnosis

DENG Feiyue; ZHENG Shouxi; HAO Rujiang

doi:10.7652/xjtuxb202409009

您当前的位置：

首页 >

文章列表页 >

A Lightweight Scale-Aware Modulation Swin Transformer Network for Axlebox Bearing Fault Diagnosis

更新时间：2025-07-28

- A Lightweight Scale-Aware Modulation Swin Transformer Network for Axlebox Bearing Fault Diagnosis
- Vol. 58, Issue 9, Pages: 83-93(2024)
- 作者机构：
  
  1. 石家庄铁道大学机械工程学院,石家庄,050043
  2. 河北省工程机械动力与传动控制重点实验室,石家庄,050043
- 作者简介：
- 基金信息：
- DOI：10.7652/xjtuxb202409009
  CLC： TH17
- Online First：10 September 2024，
  
  Published：2024
- 稿件说明：
移动端阅览
DENG Feiyue, ZHENG Shouxi, HAO Rujiang. A Lightweight Scale-Aware Modulation Swin Transformer Network for Axlebox Bearing Fault Diagnosis[J]. 2024, 58(9): 83-93.
DOI：

DENG Feiyue, ZHENG Shouxi, HAO Rujiang. A Lightweight Scale-Aware Modulation Swin Transformer Network for Axlebox Bearing Fault Diagnosis[J]. 2024, 58(9): 83-93. DOI： 10.7652/xjtuxb202409009.

摘要

针对当前Transformer网络模型运算效率偏低

且难以用于复杂工况条件下高速列车轴箱轴承故障诊断的问题

提出了一种基于时频多域融合与轻量化结构的尺度感知调制Swin Transformer(SMST)模型的轴箱轴承故障诊断方法。首先

采用格拉姆角场法、双谱法与Chirplet变换法

将轴承振动信号转化为时域、频域与时频域内的二维图像

基于多域特征融合思想集成为新的特征图像; 然后

设计了一种新的轻量化结构SMST模块

在其内部实现了卷积运算与Transformer自注意力运算的进一步融合; 最后

在层次化模型框架中引入特征金字塔模块(FPB)

弥补不同层输出特征的不一致性

实现了上下文信息的特征深度融合及复杂工况条件下轴箱轴承故障诊断。实验结果表明:相比格拉姆角场法、双谱法、Chirplet变换法、短时傅里叶变换法、连续小波变换法等单一领域图像生成方法

时频多域融合方法生成的图像特征信息表征能力更好; 所提网络模型在1 010、760、505 r/min这3种转速变工况任务中的轴箱轴承故障识别准确率分别为99.88%、99.92%与99.96%; 对比ResNets、GoogleNet、ViT、Swin Transformer和SMT这5种模型

所提方法的故障识别准确率更高

模型轻量化程度更好。所提方法可为实际工况中列车轴箱轴承故障诊断提供参考。

Abstract

A scale-aware modulation swin transformer(SMST)model is proposed based on multi-domain fusion and lightweight structure

for axlebox bearing fault diagnosis

aiming to address the inefficiency of the current Transformer network model and its unsuitability for axlebox bearing fault diagnosis of high-speed trains under complex working conditions. Firstly

Gram angle field(GAF)

bispectrum

and Chirplet transform techniques are applied to convert the bearing vibration signals into two-dimensional images in time

frequency

and time-frequency domains

which are integrated into a new image based on the idea of multi-domain feature fusion. Then

a new lightweight structure SMST module is designed

combining the further fusion of convolution operation and Transformer self-attention operation. Finally

a feature pyramid block(FPB)is introduced into the SMST hierarchical model framework to address the inconsistency of the output features across layers and enable deep feature fusion with contextual information. The fault diagnosis of axlebox bearings under complex working conditions is realized. Results show that the time-frequency multi-domain fusion method offers a superior representation of image feature information compared to single-domain image generation methods such as Gram angle field

bispectrum

Chirplet transform

short-time Fourier transform

and continuous wavelet transform. The proposed network model achieves high accuracy rates of 99.88%

99.92%

and 99.96% in identifying axlebox bearing faults in the three tasks under variable working conditions with different speeds of 1 010 r/min

760 r/min

and 505 r/min

respectively. Comparative analysis against five models of ResNets

GoogleNet

ViT

Swin Transformer

and SMT showcases the higher fault identification accuracy and better model lightweight of the proposed method. The proposed method can serve as a reference for the diagnosis of axlebox bearing faults in trains under actual working conditions.

关键词

Keywords

references

SUN Runtao, YANG Jianwei, YAO Dechen, et al. A new method of wheelset bearing fault diagnosis [J]. Entropy, 2022, 24(10): 1381.

向宙, 张西宁, 张雯雯, 等. 区分自编码网络及其在滚动轴承故障特征提取中的应用 [J]. 西安交通大学学报, 2019, 53(8): 47-55.

XIANG Zhou, ZHANG Xining, ZHANG Wenwen, et al. Discriminative auto-encoding network with applications in fault feature extraction of rolling bearing [J]. Journal of Xi'an Jiaotong University,2019, 53(8): 47-55.

JIANG Hongkai, LI Xingqiu, SHAO Haidong, et al. Intelligent fault diagnosis of rolling bearings using an improved deep recurrent neural network [J]. Measurement Science and Technology, 2018, 29(6): 065107.

KRIZHEVSKY A, SUTSKEVER I, HINTON G E. ImageNet classification with deep convolutional neural networks [J]. Communications of the ACM, 2017, 60(6): 84-90.

AL-QIZWINI M, BARJASTEH I, AL-QASSAB H, et al. Deep learning algorithm for autonomous driving using GoogLeNet [C]//2017 IEEE Intelligent Vehicles Symposium(IV). Piscataway, NJ, USA: IEEE, 2017: 89-96.

HE Kaiming, ZHANG Xiangyu, REN Shaoqing, et al. Deep residual learning for image recognition [C]//2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Piscataway, NJ, USA: IEEE, 2016: 770-778.

ZHANG Xiangyu, ZHOU Xinyu, LIN Mengxiao, et al. ShuffleNet: an extremely efficient convolutional neural network for mobile devices [C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway, NJ, USA: IEEE, 2018: 6848-6856.

周凌孟, 邓飞其, 张清华, 等. 基于主成分分析的多域特征融合轴承故障诊断 [J]. 机床与液压, 2024, 52(6): 167-176.

ZHOU Lingmeng, DENG Feiqi, ZHANG Qinghua, et al. Bearing fault diagnosis based on principal component analysis and multi-domain feature fusion [J]. Machine Tool Hydraulics, 2024, 52(6): 167-176.

DENG Feiyue, DING Hao, YANG Shaopu, et al. An improved deep residual network with multiscale feature fusion for rotating machinery fault diagnosis [J]. Measurement Science and Technology, 2021, 32(2): 024002.

PENG Binsen, XIA Hong, LÜ Xinzhi, et al. An intelligent fault diagnosis method for rotating machinery based on data fusion and deep residual neural network [J]. Applied Intelligence, 2022, 52(3): 3051-3065.

YANG Yanli, FU Peiying. Rolling-element bearing fault data automatic clustering based on wavelet and deep neural network [J]. Shock and Vibration, 2018, 2018: 3047830.

VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need [C]//Proceedings of the 31st International Conference on Neural Information Processing Systems. Red Hook, NY, USA: Curran Associates Inc., 2017: 6000-6010.

DOSOVITSKIY A, BEYER L, KOLESNIKOV A, et al. An image is worth 16x16 words: transformers for image recognition at scale [EB/OL].(2021-06-03)[2024-02-01]. https://arxiv.org/abs/2010.11929.

LIU Ze, LIN Yutong, CAO Yue, et al. Swin transformer: hierarchical vision transformer using shifted windows [C]//2021 IEEE/CVF International Conference on Computer Vision(ICCV). Piscataway, NJ, USA: IEEE, 2021: 9992-10002.

HUANG Zilong, BEN Youcheng, LUO Guozhong, et al. Shuffle transformer: rethinking spatial shuffle for vision transformer [EB/OL].(2021-06-07)[2024-02-01]. https://arxiv.org/abs/2106.03650.

CHU Xiangxiang, TIAN Zhi, WANG Yuqing, et al. Twins: revisiting the design of spatial attention in vision transformers [C]//Advances in Neural Information Processing Systems. Red Hook, NY, USA: Curran Associates Inc., 2021: 9355-9366.

YANG Zhuohong, CEN Jian, LIU Xi, et al. Research on bearing fault diagnosis method based on transformer neural network [J]. Measurement Science and Technology, 2022, 33(8): 085111.

FANG Hairui, DENG Jin, BAI Yaoxu, et al. CLFormer: a lightweight transformer based on convolutional embedding and linear self-attention with strong robustness for bearing fault diagnosis under limited sample conditions [J]. IEEE Transactions on Instrumentation and Measurement, 2022, 71: 1-8.

HAO Wei, LI Zhixuan, QIN Guohao, et al. A novel prediction method based on bi-channel hierarchical vision transformer for rolling bearings' remaining useful life [J]. Processes, 2023, 11(4): 1153.

LIANG Pengfei, YU Zhuoze, WANG Bin, et al. Fault transfer diagnosis of rolling bearings across multiple working conditions via subdomain adaptation and improved vision transformer network [J]. Advanced Engineering Informatics, 2023, 57: 102075.

张淑清, 杜灵韵, 王册浩, 等. 基于格拉姆角场与改进CNN-ResNet的风电功率预测方法 [J]. 电网技术, 2023, 47(4): 1540-1547.

ZHANG Shuqing, DU Lingyun, WANG Cehao, et al. Windpower forecasting method based on GAF and improved CNN-ResNet [J]. Power System Technology, 2023, 47(4): 1540-1547.

谢跃雷, 邓涵方. 基于改进ResNet的射频指纹识别方法 [J]. 电讯技术, 2022, 62(4): 416-423.

XIE Yuelei, DENG Hanfang. A radio frequency fingerprinting identification method based on improved ResNet [J]. Telecommunication Engineering,2022, 62(4): 416-423.

张力新, 贾义红, 许敏鹏, 等. 基于Chirplet变换的变频视觉诱发电位脑-机接口研究 [J]. 纳米技术与精密工程, 2014, 12(3): 157-161.

ZHANG Lixin, JIA Yihong, XU Minpeng. Chirp stimuli visual evoked potential based brain-computer interface by Chirplet transform algorithm [J]. Nanotechnology and Precision Engineering,2014, 12(3): 157-161.

LIN Weifeng, WU Ziheng, CHEN Jiayu, et al. Scale-aware modulation meet transformer [C]//2023 IEEE/CVF International Conference on Computer Vision(ICCV). Piscataway, NJ, USA: IEEE, 2023: 5992-6003.

LIU Yanting, ZHAO Junjuan, LUO Quanyong, et al. Automated classification of cervical lymph-node-level from ultrasound using depthwise separable convolutional Swin transformer [J]. Computers in Biology and Medicine, 2022, 148: 105821.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Construction and Application of Multi-Agent Large Language Model for Power Transformer Fault Diagnosis

Dual-Wavelet Dictionary Based Feature Extraction Method for Compound Faults in Gearboxes

Mechanism and Design Methodology for Ultra-Low Frequency Bandgaps in Lightweight High-Stiffness Metastructures

Study on the Interpretability of One-Dimensional Convolutional Neural Networks in Mechanical Fault Feature Extraction

Application of Mayfly Algorithm Optimized Dual-Channel Network in Gearbox Fault Diagnosis

Related Author

LIN Jinshan

LI Yuan

FANG Qixuan

LIU Zhihao

LI Chunpeng

ZHANG Guanjun

WANG Xiangdong

LIU Qiang

Related Institution

西安交通大学电气工程学院，710049，西安School of Electrical Engineering, Xi'an Jiaotong University, Xi'an 710049, China

College of Hydraulic & Environmental Engineering, China Three Gorges University

China Yangtze Power Co., Ltd.

College of Mechanical and Power Engineering, China Three Gorges University

Hubei Key Laboratory of Hydroelectric Machinery Design and Maintenance, China Three Gorges University

⁰