A novel temporal convolutional network with residual self-attention mechanism for remaining useful life prediction of rolling bearings

• Published in: Reliability engineering & system safety 2021-11, Vol.215, p.107813, Article 107813
• Main Authors: Cao, Yudong, Ding, Yifei, Jia, Minping, Tian, Rushuai
• Format: Article
• Language: English
• Subjects: Comparative studies; Datasets; Feature extraction; Life prediction; Maintenance costs; Mechanical systems; Nonlinear systems; Predictions; Reliability engineering; Remaining useful life prediction; Roller bearings; Rolling bearings; Self-attention mechanism; Temporal convolutional; Useful life; Vibration
• ISSN: 0951-8320; 1879-0836
• DOI: 10.1016/j.ress.2021.107813

•Causal dilated convolution block is built to learn the temporal dependencies.•A residual attention mechanism is proposed to obtain the contribution degree.•Residual connection is used to solve the problem of gradient disappearance.•A novel framework based on TCN-RSA can realize RUL prediction of bearings. Remaining useful life (RUL) prediction has been a hotspot in the engineering field, which is useful to avoid unexpected breakdowns and reduce maintenance costs of the system. Due to the high nonlinearity and complexity of mechanical systems, traditional methods cannot meet the requirements of medium-term and long-term prediction tasks, and often ignore the influence of temporal information on prediction performance. To solve this problem, this paper proposes a new deep learning framework – Temporal convolutional network with residual self-attention mechanism (TCN-RSA), which can learn both time-frequency and temporal information of signals. First, we input the marginal spectrum of vibration signals to TCN. The causal dilated convolution structure in the TCN has the ability to capture long-term dependencies and extract high-level feature representations from the time-frequency domain at the same time. Then, a residual self-attention mechanism is introduced to obtain the feature contribution degree of different moments in the bearing degradation process. Finally, an end-to-end RUL prediction implementation can be established based on TCN-RSA network. The effectiveness of the proposed method is verified by IEEE PHM 2012 Data challenge datasets and XJTU-SY datasets respectively. The comparative study indicates that the proposed TCN-RSA framework outperforms the other state-of-the-art methods in RUL prediction and system prognosis with respect to better accuracy and computation efficiency.