Fault Diagnosis for Aero-engine Rolling Bearings Based on an Attention Augmented Convolutional Neural Network with FeatureFusion

doi:10.12382/bgxb.2021.0666

Abstract

Abstract: The existing fault diagnosis methods based on deep convolutional neural networks have only considered the extraction of local features while ignoring global information. To address this problem, an attention mechanism that can grasp global information is integrated into the convolution layer. The purpose is to allow both attention mechanism parameters and convolutional layer parameters to participate in network training. An attention augmented convolutional neural network for mechanical fault diagnosis is proposed. First, the high-dimensional feature modulus of the vibration signal of a rolling bearing fault is extracted using empirical mode decomposition, variational mode decomposition, and wavelet packet decomposition. Then, multi-channel samples composed of the feature modulus are input into the attention augmented convolutional neural network for training. The feature modulus are adaptively fused and selected by the network to mine the hidden information. Finally, the classifier Softmax is used to recognize and classify the results. The fault diagnosis of rolling bearings at high rolling speeds is carried out by the trained model. The proposed model is further tested by signals with different signal-to-noise ratios to verify the generalization ability of the network and the effectiveness of fault diagnosis. The experimental results show that the proposed method can accurately and effectively classify the damage degree of different bearing faults in aero-engines.

Key words: attentionaugmentedconvolution, deepconvolutionalneuralnetwork, featurefusion, aero-enginerollingbearing, faultdiagnosis

CLC Number:

TH133.33

LI Zedong, LI Zhinong, TAO Junyong, MAO Qinghua, ZHANG Xuhui. Fault Diagnosis for Aero-engine Rolling Bearings Based on an Attention Augmented Convolutional Neural Network with FeatureFusion[J]. Acta Armamentarii, 2022, 43(12): 3228-3239.

References

［1］ LI S B, LIU G K, TANG X H, et al. An ensemble deep convolutional neural network model with import D-S evidence fusion for bearing fault diagnosis[J]. Sensors, 2017, 17(8):1729.
[2］ LIU H M, LI L F, MA J. Rolling bearing fault diagnosis based on STFT-deep learning and sound signals[J]. Shock and Vibration, 2016, 2016: 6127479.
[3］ HOANG D T, KANG H J. Rolling element bearing fault diagnosis using convolutional neural network and vibration image[J].Cognitive Systems Research, 2019, 53:42-50.
[4］ XU G W, LIU M, JIANG Z F, et al. Bearing fault diagnosis method based on deep convolutional neural network and random forest ensemble learning[J]. Sensor, 2019, 19(5):1088.
[5］ HE Z Y, SHAO H D, ZHONG X, et al. An intelligent fault diagnosis method for rotor-bearing system using small labeled infrared from CAE[J]. Advanced Engineering Informatics, 2020, 46(2):101150.
[6］ WANG F, JIANG H K, SHAO H D, et al. An adaptive deep convolutional neural network for rolling bearing[J]. Measurement Science and Technology, 2017, 28(9): 095005.
[7］ ZHANG W, LI C H, PENG G L, et al. A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load[J]. Mechanical Systems and Signal Processing, 2017, 100: 439-453.
[8］ HUANG W Y, CHENG J S, YANG Y, et al. An improved deep convolutional neural network with multi-scale information for bearing fault diagnosis[J］.Neurocomputing, 2019, 359: 77-92.
[9］ JIN G Q, ZHU T Y, AKRAM M W, et al.An adaptive anti-noise neural network for bearing fault diagnosis under noise and varying load conditions[J]. IEEE Access, 2020, 8: 74793-74807.
[10］ KHORRAM A, KHALLOOEI M, REZGHI M. End-to-end CNN+LSTM deep learning approach for bearing fault diagnosis[J]. Applied Intelligence, 2020, 51(2):736-751.
[11］ GU J X, WANG Z H, KUEEN J, et al.Recent advances in convolutional neural networks[J]. Pattern Recognition, 2018, 77:354-377.
[12］ WOO S, PARK J, LEE J Y.CBAM: convolutional Block attention module[C]∥Ferrari V, Hebert M, Sminchisescu C, et al. Proceedings of the 15th European Conference on Computer Vision. Munich,Germany: Springer, 2018:3-19.
[13］ HUANG T D, FU S, FENG H N, et al.Bearing fault diagnosis based on shallow multi-scale convolutional neural network with attention[J]. Energies, 2019, 12(20): 3937.
[14］孔子迁, 邓蕾, 汤宝平, 等.基于时频融合和注意力机制的深度学习行星齿轮箱故障诊断方法[J].仪器仪表学报, 2019, 40(6): 221-227.
KONG Z Q, DENG L, TANG B P, et al.Fault diagnosis of planetary gearbox based on deep learning with time-frequency fusion and attention mechanism[J].Chinese Journal of Scientific Instrument, 2019, 40(6):221-227.(in Chinese)
[15］吴静然, 丁恩杰, 崔冉, 等.采用多尺度注意力机制的旋转机械故障诊断方法[J].西安交通大学学报, 2020, 54(2):51-58.
WU J R, DING E J, CUI R, et al.A diagnostic approach for rotating machinery using multi-scale feature attention mechanism[J].Journal of Xi'an Jiaotong University, 2020, 54(2):51-58. (in Chinese)
[16］ XU Z F, LI C, YANG Y. Fault diagnosis of rolling bearings using an improved multi-scale convolutional neural network with feature attention mechanism[J]. ISA Transactions, 2021, 110:379-393.
[17］ SHAW P, USZKOREIT J, ASHISH V. Self-attention with relative position representations[C]∥Proceedings of the 16th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. New Orleans, LA, US: North American Chapter of the Association for Computational Linguistics,2018.
[18］ DAGA A P, FASANA A, MARCHESIELLO S, et al. The politecnico di torino rolling bearing test rig: description and analysis of open access data[J]. Mechanical Systems and Signal Processing, 2019, 120: 252-273.
[19］ WALCZAK B, MASSART D L. Noise suppression and signal compression using the wavelet packet transform[J]. Chemometrics and Intelligent Laboratory Systems, 1997, 36(2): 81-94.
[20］ DRAGOMIRETSKIY K, ZOSSO D. Variational mode decomposition[J]. IEEE Transactions on Signal Processing, 2014, 62(3):531-544.
[21］ LEI Y G, LIN J, HE Z J, et al. A review on empirical mode decomposition in fault diagnosis of rotating machinery[J]. Mechanical Systems and Signal Processing, 2013, 35(1/2): 108-126.
[22］胡茑庆, 陈徽鹏, 程哲, 等.基于经验模态分解和深度卷积神经网络的行星齿轮箱故障诊断方法[J].机械工程学报, 2019, 55(7):9-18.
HU N Q, CHEN H P, CHENG Z, et al.Fault diagnosis for planetary gearbox based on EMD and deep convolutional neural networks[J]. Journal of Mechanical Engineering, 2019, 55(7): 9-18. (in Chinese)

[1]	LI Liangyu， SU Tiexiong， MA Fukang， WU Xiaojun， XU Chunlong. Fault Diagnosis Method of High-pressure Common Rail System Based on EEMD-SVM [J]. Acta Armamentarii, 2022, 43(5): 992-1001.
[2]	YU Bowen， L Ming. Improved YOLOv3 Algorithm and Its Application in Military Target Detection [J]. Acta Armamentarii, 2022, 43(2): 345-354.
[3]	TIAN Heng, XU Rongbin, JIANG Yanhong, ZHANG Wenhu, DENG Si'er. Fault Diagnosis Strategy for Multi-valued Attribute System Based on a Discrete Particle Swarm Optimization Algorithm [J]. Acta Armamentarii, 2022, 43(12): 3240-3246.
[4]	LI Wei, HAN Yinlong, SUN Xiaojing. Incipient Fault Diagnosis Method of Vehicle Power Supply Based on Feature Optimization and Deep Learning [J]. Acta Armamentarii, 2022, 43(11): 2935-2944.
[5]	LI Zhinong, HU Zhifeng, MAO Qinghua, ZHANG Xuhui, TAO Junyong. Variational Nonlinear Chirp Mode Decomposition-synchroextracting Transform Method and Its Application in Fault Diagnosisof Rolling Bearing [J]. Acta Armamentarii, 2021, 42(6): 1324-1330.
[6]	ZHU Min， XU Aiqiang， XU Qing， LI Ruifeng. Fault Diagnosis of Analog Circuits Based on Improved Multilayer Kernel Extreme Learning Machine [J]. Acta Armamentarii, 2021, 42(2): 356-369.
[7]	LI Xiang， SU Juan， YANG Long. A SAR Image Building Detection Algorithm Based on Improved YOLOv3 [J]. Acta Armamentarii, 2020, 41(7): 1347-1359.
[8]	LI Jiawei, CUI Tao, LIU Yuhang, SHI Shuainan, SUN Qiang. Construction for Online Observer Based on Exhaust Gas Temperature Dynamic Model [J]. Acta Armamentarii, 2019, 40(8): 1562-1571.
[9]	GUO Weichao, ZHAO Huaishan, LI Cheng, LI Yan, TANG Aofei. Fault Feature Enhancement Method for Rolling Bearing Fault Diagnosis Based on Wavelet Packet Energy Spectrum and Principal Component Analysis [J]. Acta Armamentarii, 2019, 40(11): 2370-2377.
[10]	ZHAI Yuyao, SHI Xianjun, L Jiapeng. Research on Evaluation Method for Testability Index and Modeling of Missile System Based on GSPN [J]. Acta Armamentarii, 2019, 40(10): 2070-2079.
[11]	ZHANG Wei， LIU Xing, XU Ai-qiang， PING Dian-fa. Three-layer Multiple Kernel Fault Diagnosis Model with l_p-norm Constraint for Analog Circuit [J]. Acta Armamentarii, 2018, 39(7): 1352-1363.
[12]	REN Hai-feng, PAN Hong-xia. Crack Fault Diagnosis of Gun Automatic Mechanism Based on Multifractal Features [J]. Acta Armamentarii, 2018, 39(3): 457-462.
[13]	WANG Ying-min， CUI Tao， ZHANG Fu-jun， DONG Tian-pu. Fault Diagnosis of Intake System of Diesel Engine Based on LOLIMOT [J]. Acta Armamentarii, 2017, 38(8): 1457-1468.
[14]	HUANG Da-rong, CHEN Chang-sha, SUN Guo-xi, ZHAO Ling，MI Bo. Linear Discriminant Analysis and Back Propagation Neural Network Cooperative Diagnosis Method for Multiple Faults of ComplexEquipment Bearings [J]. Acta Armamentarii, 2017, 38(8): 1649-1657.
[15]	LI Zhi-nong, ZHU Ming. Research on Mechanical Fault Diagnosis Method Based on Variational Mode Decomposition [J]. Acta Armamentarii, 2017, 38(3): 593-599.