Loading…

Mechanical health indicator construction and similarity remaining useful life prediction based on natural language processing model

Remaining useful life (RUL) prediction, as an essential task for prediction and health management, can improve the reliability of degradation systems. In this paper, multi-dimensional mechanical monitoring readings are treated as natural language sequences and inputted to a natural language processi...

Full description

Saved in:
Bibliographic Details
Published in:Measurement science & technology 2022-09, Vol.33 (9), p.94008
Main Authors: Duan, Yuhang, Li, Honghui, Zhang, Ning
Format: Article
Language:English
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c243t-5796425e65dfb245bc56d083f72d31d6a22b39c969b38650c3384b7119a38db83
cites cdi_FETCH-LOGICAL-c243t-5796425e65dfb245bc56d083f72d31d6a22b39c969b38650c3384b7119a38db83
container_end_page
container_issue 9
container_start_page 94008
container_title Measurement science & technology
container_volume 33
creator Duan, Yuhang
Li, Honghui
Zhang, Ning
description Remaining useful life (RUL) prediction, as an essential task for prediction and health management, can improve the reliability of degradation systems. In this paper, multi-dimensional mechanical monitoring readings are treated as natural language sequences and inputted to a natural language processing model, Transformer, to extract semantic compression vectors. The health indicators (HIs) are constructed from the changes of compressed semantic vectors during the mechanical system operation, reflecting the mechanical health status at each monitoring point. Subsequently, combined with the similarity matching method, the RUL prediction is achieved by weighted summation. Transformer mainly consists of attention layers and residual connection layers, which contain no recurrence and convolution. The attention layer can highlight the critical time step information during the HI construction. Moreover, the output of different time steps can be obtained simultaneously in a parallel computation manner. The proposed scheme is conducted on two publicly available datasets for experimental and evaluation metrics comparison. The experimental results show that the proposed scheme can achieve competitive prediction results, with some of the metrics reaching the highest. An autoencoder only containing attention mechanism can effectively extract degradation feature representations for the adaptive construction of unsupervised HIs.
doi_str_mv 10.1088/1361-6501/ac793f
format article
fullrecord <record><control><sourceid>crossref</sourceid><recordid>TN_cdi_crossref_primary_10_1088_1361_6501_ac793f</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>10_1088_1361_6501_ac793f</sourcerecordid><originalsourceid>FETCH-LOGICAL-c243t-5796425e65dfb245bc56d083f72d31d6a22b39c969b38650c3384b7119a38db83</originalsourceid><addsrcrecordid>eNo9kDtPwzAUhS0EEqWwM_oPBOw4duwRVbykIhaYoxs_WiPHqWxn6MwfJ6GI6T50zpHOh9AtJXeUSHlPmaCV4ITeg24Vc2do9f86RyuieFuRmrFLdJXzFyGkJUqt0Peb1XuIXkPAewuh7LGPZj7LmLAeYy5p0sWPEUM0OPvBB0i-HHGyA_jo4w5P2bop4OCdxYdkZ_OvvodsDZ6XCGVKc3yAuJtgt4hGbXNevMNobLhGFw5Ctjd_c40-nx4_Ni_V9v35dfOwrXTdsFLxVomm5lZw4_q64b3mwhDJXFsbRo2Auu6Z0kqonsm5tmZMNn1LqQImTS_ZGpFTrk5jzsm67pD8AOnYUdItELuFWLcQ604Q2Q8ckWiU</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Mechanical health indicator construction and similarity remaining useful life prediction based on natural language processing model</title><source>Institute of Physics</source><creator>Duan, Yuhang ; Li, Honghui ; Zhang, Ning</creator><creatorcontrib>Duan, Yuhang ; Li, Honghui ; Zhang, Ning</creatorcontrib><description>Remaining useful life (RUL) prediction, as an essential task for prediction and health management, can improve the reliability of degradation systems. In this paper, multi-dimensional mechanical monitoring readings are treated as natural language sequences and inputted to a natural language processing model, Transformer, to extract semantic compression vectors. The health indicators (HIs) are constructed from the changes of compressed semantic vectors during the mechanical system operation, reflecting the mechanical health status at each monitoring point. Subsequently, combined with the similarity matching method, the RUL prediction is achieved by weighted summation. Transformer mainly consists of attention layers and residual connection layers, which contain no recurrence and convolution. The attention layer can highlight the critical time step information during the HI construction. Moreover, the output of different time steps can be obtained simultaneously in a parallel computation manner. The proposed scheme is conducted on two publicly available datasets for experimental and evaluation metrics comparison. The experimental results show that the proposed scheme can achieve competitive prediction results, with some of the metrics reaching the highest. An autoencoder only containing attention mechanism can effectively extract degradation feature representations for the adaptive construction of unsupervised HIs.</description><identifier>ISSN: 0957-0233</identifier><identifier>EISSN: 1361-6501</identifier><identifier>DOI: 10.1088/1361-6501/ac793f</identifier><language>eng</language><ispartof>Measurement science &amp; technology, 2022-09, Vol.33 (9), p.94008</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c243t-5796425e65dfb245bc56d083f72d31d6a22b39c969b38650c3384b7119a38db83</citedby><cites>FETCH-LOGICAL-c243t-5796425e65dfb245bc56d083f72d31d6a22b39c969b38650c3384b7119a38db83</cites><orcidid>0000-0002-0200-9549 ; 0000-0002-6831-1919 ; 0000-0002-8614-4851</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids></links><search><creatorcontrib>Duan, Yuhang</creatorcontrib><creatorcontrib>Li, Honghui</creatorcontrib><creatorcontrib>Zhang, Ning</creatorcontrib><title>Mechanical health indicator construction and similarity remaining useful life prediction based on natural language processing model</title><title>Measurement science &amp; technology</title><description>Remaining useful life (RUL) prediction, as an essential task for prediction and health management, can improve the reliability of degradation systems. In this paper, multi-dimensional mechanical monitoring readings are treated as natural language sequences and inputted to a natural language processing model, Transformer, to extract semantic compression vectors. The health indicators (HIs) are constructed from the changes of compressed semantic vectors during the mechanical system operation, reflecting the mechanical health status at each monitoring point. Subsequently, combined with the similarity matching method, the RUL prediction is achieved by weighted summation. Transformer mainly consists of attention layers and residual connection layers, which contain no recurrence and convolution. The attention layer can highlight the critical time step information during the HI construction. Moreover, the output of different time steps can be obtained simultaneously in a parallel computation manner. The proposed scheme is conducted on two publicly available datasets for experimental and evaluation metrics comparison. The experimental results show that the proposed scheme can achieve competitive prediction results, with some of the metrics reaching the highest. An autoencoder only containing attention mechanism can effectively extract degradation feature representations for the adaptive construction of unsupervised HIs.</description><issn>0957-0233</issn><issn>1361-6501</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><recordid>eNo9kDtPwzAUhS0EEqWwM_oPBOw4duwRVbykIhaYoxs_WiPHqWxn6MwfJ6GI6T50zpHOh9AtJXeUSHlPmaCV4ITeg24Vc2do9f86RyuieFuRmrFLdJXzFyGkJUqt0Peb1XuIXkPAewuh7LGPZj7LmLAeYy5p0sWPEUM0OPvBB0i-HHGyA_jo4w5P2bop4OCdxYdkZ_OvvodsDZ6XCGVKc3yAuJtgt4hGbXNevMNobLhGFw5Ctjd_c40-nx4_Ni_V9v35dfOwrXTdsFLxVomm5lZw4_q64b3mwhDJXFsbRo2Auu6Z0kqonsm5tmZMNn1LqQImTS_ZGpFTrk5jzsm67pD8AOnYUdItELuFWLcQ604Q2Q8ckWiU</recordid><startdate>20220901</startdate><enddate>20220901</enddate><creator>Duan, Yuhang</creator><creator>Li, Honghui</creator><creator>Zhang, Ning</creator><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-0200-9549</orcidid><orcidid>https://orcid.org/0000-0002-6831-1919</orcidid><orcidid>https://orcid.org/0000-0002-8614-4851</orcidid></search><sort><creationdate>20220901</creationdate><title>Mechanical health indicator construction and similarity remaining useful life prediction based on natural language processing model</title><author>Duan, Yuhang ; Li, Honghui ; Zhang, Ning</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c243t-5796425e65dfb245bc56d083f72d31d6a22b39c969b38650c3384b7119a38db83</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Duan, Yuhang</creatorcontrib><creatorcontrib>Li, Honghui</creatorcontrib><creatorcontrib>Zhang, Ning</creatorcontrib><collection>CrossRef</collection><jtitle>Measurement science &amp; technology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Duan, Yuhang</au><au>Li, Honghui</au><au>Zhang, Ning</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Mechanical health indicator construction and similarity remaining useful life prediction based on natural language processing model</atitle><jtitle>Measurement science &amp; technology</jtitle><date>2022-09-01</date><risdate>2022</risdate><volume>33</volume><issue>9</issue><spage>94008</spage><pages>94008-</pages><issn>0957-0233</issn><eissn>1361-6501</eissn><abstract>Remaining useful life (RUL) prediction, as an essential task for prediction and health management, can improve the reliability of degradation systems. In this paper, multi-dimensional mechanical monitoring readings are treated as natural language sequences and inputted to a natural language processing model, Transformer, to extract semantic compression vectors. The health indicators (HIs) are constructed from the changes of compressed semantic vectors during the mechanical system operation, reflecting the mechanical health status at each monitoring point. Subsequently, combined with the similarity matching method, the RUL prediction is achieved by weighted summation. Transformer mainly consists of attention layers and residual connection layers, which contain no recurrence and convolution. The attention layer can highlight the critical time step information during the HI construction. Moreover, the output of different time steps can be obtained simultaneously in a parallel computation manner. The proposed scheme is conducted on two publicly available datasets for experimental and evaluation metrics comparison. The experimental results show that the proposed scheme can achieve competitive prediction results, with some of the metrics reaching the highest. An autoencoder only containing attention mechanism can effectively extract degradation feature representations for the adaptive construction of unsupervised HIs.</abstract><doi>10.1088/1361-6501/ac793f</doi><orcidid>https://orcid.org/0000-0002-0200-9549</orcidid><orcidid>https://orcid.org/0000-0002-6831-1919</orcidid><orcidid>https://orcid.org/0000-0002-8614-4851</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0957-0233
ispartof Measurement science & technology, 2022-09, Vol.33 (9), p.94008
issn 0957-0233
1361-6501
language eng
recordid cdi_crossref_primary_10_1088_1361_6501_ac793f
source Institute of Physics
title Mechanical health indicator construction and similarity remaining useful life prediction based on natural language processing model
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T10%3A38%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-crossref&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Mechanical%20health%20indicator%20construction%20and%20similarity%20remaining%20useful%20life%20prediction%20based%20on%20natural%20language%20processing%20model&rft.jtitle=Measurement%20science%20&%20technology&rft.au=Duan,%20Yuhang&rft.date=2022-09-01&rft.volume=33&rft.issue=9&rft.spage=94008&rft.pages=94008-&rft.issn=0957-0233&rft.eissn=1361-6501&rft_id=info:doi/10.1088/1361-6501/ac793f&rft_dat=%3Ccrossref%3E10_1088_1361_6501_ac793f%3C/crossref%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c243t-5796425e65dfb245bc56d083f72d31d6a22b39c969b38650c3384b7119a38db83%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true