Loading…

An adaptive model with dual-dimensional attention for remaining useful life prediction of aero-engine

•We design an model for remaining useful life prediction of the aero-engine.•We develop a module to parallel extract the dual-dimensional attention features.•We propose an adaptive TCN model to extract the deep temporal representations.•We achieve a better prediction accuracy than the state-of-art m...

Full description

Saved in:
Bibliographic Details
Published in:Knowledge-based systems 2024-06, Vol.293, p.111738, Article 111738
Main Authors: Gan, Fanfan, Shao, Haidong, Xia, Baizhan
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites cdi_FETCH-LOGICAL-c255t-4a7ad277ec585c307e2cc5579392a0c29b69d3db505f593d27281b2a5c0080723
container_end_page
container_issue
container_start_page 111738
container_title Knowledge-based systems
container_volume 293
creator Gan, Fanfan
Shao, Haidong
Xia, Baizhan
description •We design an model for remaining useful life prediction of the aero-engine.•We develop a module to parallel extract the dual-dimensional attention features.•We propose an adaptive TCN model to extract the deep temporal representations.•We achieve a better prediction accuracy than the state-of-art methods. As an indispensable part in prognostics and health management (PHM) of mechanical systems, the remaining useful life (RUL) estimation has been studied widely and intensively. Recently, with the boom in deep learning, the traditional data-driven prognostic methods like the temporal convolutional neural networks (TCNs), have made remarkable progress in the RUL estimation. However, the conventional TCNs methods do not have a well-established mechanism to parallel weigh the dual-dimensional features of multi-sensory data. Moreover, the conventional TCNs have a fixed network structure which is not flexible to learn deep temporal representations. Here, we propose an adaptive model with dual-dimensional attention for aero-engine RUL prognostics. Specifically, the dual-dimensional multi-head attention (DMHA) module is constructed to assign weights to features in the spatial and temporal dimensions, and then preforms the feature fusion. The mathematical derivations of the DMHA module parameter iterations are performed, which enhances the interpretability of the model. Next, the adaptive TCN (ATCN) is designed to further learn the time correlations of the fused features. Compared with the traditional TCN, the ATCN can adjust the network structure adaptively and extract the deep temporal representations better. Last, the prediction ability of the DMHA-ATCN is verified by conducting experiments on the C-MAPSS dataset.
doi_str_mv 10.1016/j.knosys.2024.111738
format article
fullrecord <record><control><sourceid>elsevier_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1016_j_knosys_2024_111738</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0950705124003733</els_id><sourcerecordid>S0950705124003733</sourcerecordid><originalsourceid>FETCH-LOGICAL-c255t-4a7ad277ec585c307e2cc5579392a0c29b69d3db505f593d27281b2a5c0080723</originalsourceid><addsrcrecordid>eNp9kM1OwzAQhC0EEqXwBhz8AglrJ66TC1JV8SchcYGz5dqb4pLYle0W9e1JCWdOs4eZ0c5HyC2DkgFb3G3LLx_SMZUceF0yxmTVnJEZayQvZA3tOZlBK6CQINgluUppCwCcs2ZGcOmptnqX3QHpECz29NvlT2r3ui-sG9AnF7zuqc4ZfR5v2oVIIw7aeec3dJ-w2_e0dx3SXUTrzK8pdFRjDAX6jfN4TS463Se8-dM5-Xh8eF89F69vTy-r5WthuBC5qLXUlkuJRjTCVCCRGyOEbKuWazC8XS9aW9m1ANGJthqtvGFrroUBaEDyak7qqdfEkFLETu2iG3Q8KgbqhEpt1YRKnVCpCdUYu59iOP52cBhVMg69GddENFnZ4P4v-AEWzHWI</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>An adaptive model with dual-dimensional attention for remaining useful life prediction of aero-engine</title><source>Elsevier</source><creator>Gan, Fanfan ; Shao, Haidong ; Xia, Baizhan</creator><creatorcontrib>Gan, Fanfan ; Shao, Haidong ; Xia, Baizhan</creatorcontrib><description>•We design an model for remaining useful life prediction of the aero-engine.•We develop a module to parallel extract the dual-dimensional attention features.•We propose an adaptive TCN model to extract the deep temporal representations.•We achieve a better prediction accuracy than the state-of-art methods. As an indispensable part in prognostics and health management (PHM) of mechanical systems, the remaining useful life (RUL) estimation has been studied widely and intensively. Recently, with the boom in deep learning, the traditional data-driven prognostic methods like the temporal convolutional neural networks (TCNs), have made remarkable progress in the RUL estimation. However, the conventional TCNs methods do not have a well-established mechanism to parallel weigh the dual-dimensional features of multi-sensory data. Moreover, the conventional TCNs have a fixed network structure which is not flexible to learn deep temporal representations. Here, we propose an adaptive model with dual-dimensional attention for aero-engine RUL prognostics. Specifically, the dual-dimensional multi-head attention (DMHA) module is constructed to assign weights to features in the spatial and temporal dimensions, and then preforms the feature fusion. The mathematical derivations of the DMHA module parameter iterations are performed, which enhances the interpretability of the model. Next, the adaptive TCN (ATCN) is designed to further learn the time correlations of the fused features. Compared with the traditional TCN, the ATCN can adjust the network structure adaptively and extract the deep temporal representations better. Last, the prediction ability of the DMHA-ATCN is verified by conducting experiments on the C-MAPSS dataset.</description><identifier>ISSN: 0950-7051</identifier><identifier>EISSN: 1872-7409</identifier><identifier>DOI: 10.1016/j.knosys.2024.111738</identifier><language>eng</language><publisher>Elsevier B.V</publisher><subject>Aero-engine ; C-mapss dataset ; Dual-dimensional attention ; Remaining useful life estimation ; Temporal convolutional network</subject><ispartof>Knowledge-based systems, 2024-06, Vol.293, p.111738, Article 111738</ispartof><rights>2024 Elsevier B.V.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c255t-4a7ad277ec585c307e2cc5579392a0c29b69d3db505f593d27281b2a5c0080723</cites><orcidid>0000-0001-7897-1454</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27923,27924</link.rule.ids></links><search><creatorcontrib>Gan, Fanfan</creatorcontrib><creatorcontrib>Shao, Haidong</creatorcontrib><creatorcontrib>Xia, Baizhan</creatorcontrib><title>An adaptive model with dual-dimensional attention for remaining useful life prediction of aero-engine</title><title>Knowledge-based systems</title><description>•We design an model for remaining useful life prediction of the aero-engine.•We develop a module to parallel extract the dual-dimensional attention features.•We propose an adaptive TCN model to extract the deep temporal representations.•We achieve a better prediction accuracy than the state-of-art methods. As an indispensable part in prognostics and health management (PHM) of mechanical systems, the remaining useful life (RUL) estimation has been studied widely and intensively. Recently, with the boom in deep learning, the traditional data-driven prognostic methods like the temporal convolutional neural networks (TCNs), have made remarkable progress in the RUL estimation. However, the conventional TCNs methods do not have a well-established mechanism to parallel weigh the dual-dimensional features of multi-sensory data. Moreover, the conventional TCNs have a fixed network structure which is not flexible to learn deep temporal representations. Here, we propose an adaptive model with dual-dimensional attention for aero-engine RUL prognostics. Specifically, the dual-dimensional multi-head attention (DMHA) module is constructed to assign weights to features in the spatial and temporal dimensions, and then preforms the feature fusion. The mathematical derivations of the DMHA module parameter iterations are performed, which enhances the interpretability of the model. Next, the adaptive TCN (ATCN) is designed to further learn the time correlations of the fused features. Compared with the traditional TCN, the ATCN can adjust the network structure adaptively and extract the deep temporal representations better. Last, the prediction ability of the DMHA-ATCN is verified by conducting experiments on the C-MAPSS dataset.</description><subject>Aero-engine</subject><subject>C-mapss dataset</subject><subject>Dual-dimensional attention</subject><subject>Remaining useful life estimation</subject><subject>Temporal convolutional network</subject><issn>0950-7051</issn><issn>1872-7409</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9kM1OwzAQhC0EEqXwBhz8AglrJ66TC1JV8SchcYGz5dqb4pLYle0W9e1JCWdOs4eZ0c5HyC2DkgFb3G3LLx_SMZUceF0yxmTVnJEZayQvZA3tOZlBK6CQINgluUppCwCcs2ZGcOmptnqX3QHpECz29NvlT2r3ui-sG9AnF7zuqc4ZfR5v2oVIIw7aeec3dJ-w2_e0dx3SXUTrzK8pdFRjDAX6jfN4TS463Se8-dM5-Xh8eF89F69vTy-r5WthuBC5qLXUlkuJRjTCVCCRGyOEbKuWazC8XS9aW9m1ANGJthqtvGFrroUBaEDyak7qqdfEkFLETu2iG3Q8KgbqhEpt1YRKnVCpCdUYu59iOP52cBhVMg69GddENFnZ4P4v-AEWzHWI</recordid><startdate>20240607</startdate><enddate>20240607</enddate><creator>Gan, Fanfan</creator><creator>Shao, Haidong</creator><creator>Xia, Baizhan</creator><general>Elsevier B.V</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0001-7897-1454</orcidid></search><sort><creationdate>20240607</creationdate><title>An adaptive model with dual-dimensional attention for remaining useful life prediction of aero-engine</title><author>Gan, Fanfan ; Shao, Haidong ; Xia, Baizhan</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c255t-4a7ad277ec585c307e2cc5579392a0c29b69d3db505f593d27281b2a5c0080723</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Aero-engine</topic><topic>C-mapss dataset</topic><topic>Dual-dimensional attention</topic><topic>Remaining useful life estimation</topic><topic>Temporal convolutional network</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Gan, Fanfan</creatorcontrib><creatorcontrib>Shao, Haidong</creatorcontrib><creatorcontrib>Xia, Baizhan</creatorcontrib><collection>CrossRef</collection><jtitle>Knowledge-based systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Gan, Fanfan</au><au>Shao, Haidong</au><au>Xia, Baizhan</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>An adaptive model with dual-dimensional attention for remaining useful life prediction of aero-engine</atitle><jtitle>Knowledge-based systems</jtitle><date>2024-06-07</date><risdate>2024</risdate><volume>293</volume><spage>111738</spage><pages>111738-</pages><artnum>111738</artnum><issn>0950-7051</issn><eissn>1872-7409</eissn><abstract>•We design an model for remaining useful life prediction of the aero-engine.•We develop a module to parallel extract the dual-dimensional attention features.•We propose an adaptive TCN model to extract the deep temporal representations.•We achieve a better prediction accuracy than the state-of-art methods. As an indispensable part in prognostics and health management (PHM) of mechanical systems, the remaining useful life (RUL) estimation has been studied widely and intensively. Recently, with the boom in deep learning, the traditional data-driven prognostic methods like the temporal convolutional neural networks (TCNs), have made remarkable progress in the RUL estimation. However, the conventional TCNs methods do not have a well-established mechanism to parallel weigh the dual-dimensional features of multi-sensory data. Moreover, the conventional TCNs have a fixed network structure which is not flexible to learn deep temporal representations. Here, we propose an adaptive model with dual-dimensional attention for aero-engine RUL prognostics. Specifically, the dual-dimensional multi-head attention (DMHA) module is constructed to assign weights to features in the spatial and temporal dimensions, and then preforms the feature fusion. The mathematical derivations of the DMHA module parameter iterations are performed, which enhances the interpretability of the model. Next, the adaptive TCN (ATCN) is designed to further learn the time correlations of the fused features. Compared with the traditional TCN, the ATCN can adjust the network structure adaptively and extract the deep temporal representations better. Last, the prediction ability of the DMHA-ATCN is verified by conducting experiments on the C-MAPSS dataset.</abstract><pub>Elsevier B.V</pub><doi>10.1016/j.knosys.2024.111738</doi><orcidid>https://orcid.org/0000-0001-7897-1454</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0950-7051
ispartof Knowledge-based systems, 2024-06, Vol.293, p.111738, Article 111738
issn 0950-7051
1872-7409
language eng
recordid cdi_crossref_primary_10_1016_j_knosys_2024_111738
source Elsevier
subjects Aero-engine
C-mapss dataset
Dual-dimensional attention
Remaining useful life estimation
Temporal convolutional network
title An adaptive model with dual-dimensional attention for remaining useful life prediction of aero-engine
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-09T02%3A06%3A04IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=An%20adaptive%20model%20with%20dual-dimensional%20attention%20for%20remaining%20useful%20life%20prediction%20of%20aero-engine&rft.jtitle=Knowledge-based%20systems&rft.au=Gan,%20Fanfan&rft.date=2024-06-07&rft.volume=293&rft.spage=111738&rft.pages=111738-&rft.artnum=111738&rft.issn=0950-7051&rft.eissn=1872-7409&rft_id=info:doi/10.1016/j.knosys.2024.111738&rft_dat=%3Celsevier_cross%3ES0950705124003733%3C/elsevier_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c255t-4a7ad277ec585c307e2cc5579392a0c29b69d3db505f593d27281b2a5c0080723%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true