Loading…

Deep domain-adversarial anomaly detection with robust one-class transfer learning

Establishing an anomaly detection model as quickly as possible with a small number of measurement samples for use with new equipment or working conditions has been a research focus. In recent years, despite the effectiveness of transfer learning techniques in terms of coping with such problems, it i...

Full description

Saved in:
Bibliographic Details
Published in:Knowledge-based systems 2024-09, Vol.300, p.112225, Article 112225
Main Authors: Chi, Jingkai, Mao, Zhizhong
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites cdi_FETCH-LOGICAL-c185t-b545a6c2b198bbac6a557a1fc8b4cdb06db5f6b62ec07fa33e9749befa7e5f963
container_end_page
container_issue
container_start_page 112225
container_title Knowledge-based systems
container_volume 300
creator Chi, Jingkai
Mao, Zhizhong
description Establishing an anomaly detection model as quickly as possible with a small number of measurement samples for use with new equipment or working conditions has been a research focus. In recent years, despite the effectiveness of transfer learning techniques in terms of coping with such problems, it is still challenging to map the detection rules of an existing device to a target device to enhance its single-class anomaly detection capabilities. In addition, the robustness requirement of the detection rule transfer process makes the problem further complicated, particularly in cases where limited target device data still have unknown outliers. To achieve good anomaly detection performance in such a complex scenario, we propose a robust deep one-class support vector description-based anomaly detection algorithm built on adversarial transfer learning. First, we designed a new hyperspherical adversarial training mechanism that integrates robust adaptive constraints into an improved domain-adversarial neural network. Additionally, to eliminate outlier interference to the greatest extent possible during the domain-adversarial process, we aimed to compute the probability of a sample being normal based on the utilized anomaly detection module and embedded this probability in a domain discriminator. Finally, an end-to-end optimization strategy was derived to find the optimal network parameters that could separate the anomalous classes as much as possible while promoting the consistency of the normal class data in the source and target domains. To validate the performance of our model, we experimented with three scenarios, i.e., digit image detection (with the MNIST and USPS datasets), object recognition (with the Office-Home dataset), and rolling bearing anomaly detection. The results showed that the proposed algorithm outperformed the state-of-the-art methods in terms of detection accuracy and robustness.
doi_str_mv 10.1016/j.knosys.2024.112225
format article
fullrecord <record><control><sourceid>elsevier_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1016_j_knosys_2024_112225</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0950705124008591</els_id><sourcerecordid>S0950705124008591</sourcerecordid><originalsourceid>FETCH-LOGICAL-c185t-b545a6c2b198bbac6a557a1fc8b4cdb06db5f6b62ec07fa33e9749befa7e5f963</originalsourceid><addsrcrecordid>eNp9kM9KxDAYxHNQcF19Aw95gdYkbdL2Isj6FxZE0HP4knzRrN10SerKvr1d6tnTwMAMMz9CrjgrOePqelN-xSEfcimYqEvOhRDyhCxYJ1nRMMnPyHnOG8aYELxdkNc7xB11wxZCLMDtMWVIAXoKcfL6A3U4oh3DEOlPGD9pGsx3HukQsbA95EzHBDF7TLRHSDHEjwty6qHPePmnS_L-cP-2eirWL4_Pq9t1YXkrx8LIWoKywvCuNQasAikb4N62prbOMOWM9MoogZY1HqoKu6buDHpoUPpOVUtSz702DTkn9HqXwhbSQXOmjyj0Rs8o9BGFnlFMsZs5htO2fcCksw0YLbqQpqPaDeH_gl9nB26F</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Deep domain-adversarial anomaly detection with robust one-class transfer learning</title><source>ScienceDirect Freedom Collection</source><creator>Chi, Jingkai ; Mao, Zhizhong</creator><creatorcontrib>Chi, Jingkai ; Mao, Zhizhong</creatorcontrib><description>Establishing an anomaly detection model as quickly as possible with a small number of measurement samples for use with new equipment or working conditions has been a research focus. In recent years, despite the effectiveness of transfer learning techniques in terms of coping with such problems, it is still challenging to map the detection rules of an existing device to a target device to enhance its single-class anomaly detection capabilities. In addition, the robustness requirement of the detection rule transfer process makes the problem further complicated, particularly in cases where limited target device data still have unknown outliers. To achieve good anomaly detection performance in such a complex scenario, we propose a robust deep one-class support vector description-based anomaly detection algorithm built on adversarial transfer learning. First, we designed a new hyperspherical adversarial training mechanism that integrates robust adaptive constraints into an improved domain-adversarial neural network. Additionally, to eliminate outlier interference to the greatest extent possible during the domain-adversarial process, we aimed to compute the probability of a sample being normal based on the utilized anomaly detection module and embedded this probability in a domain discriminator. Finally, an end-to-end optimization strategy was derived to find the optimal network parameters that could separate the anomalous classes as much as possible while promoting the consistency of the normal class data in the source and target domains. To validate the performance of our model, we experimented with three scenarios, i.e., digit image detection (with the MNIST and USPS datasets), object recognition (with the Office-Home dataset), and rolling bearing anomaly detection. The results showed that the proposed algorithm outperformed the state-of-the-art methods in terms of detection accuracy and robustness.</description><identifier>ISSN: 0950-7051</identifier><identifier>DOI: 10.1016/j.knosys.2024.112225</identifier><language>eng</language><publisher>Elsevier B.V</publisher><subject>Anomaly detection ; Domain-adversarial adaptation ; Robust one-class classification ; Transfer learning</subject><ispartof>Knowledge-based systems, 2024-09, Vol.300, p.112225, Article 112225</ispartof><rights>2024 Elsevier B.V.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c185t-b545a6c2b198bbac6a557a1fc8b4cdb06db5f6b62ec07fa33e9749befa7e5f963</cites><orcidid>0000-0002-2658-3297</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27922,27923</link.rule.ids></links><search><creatorcontrib>Chi, Jingkai</creatorcontrib><creatorcontrib>Mao, Zhizhong</creatorcontrib><title>Deep domain-adversarial anomaly detection with robust one-class transfer learning</title><title>Knowledge-based systems</title><description>Establishing an anomaly detection model as quickly as possible with a small number of measurement samples for use with new equipment or working conditions has been a research focus. In recent years, despite the effectiveness of transfer learning techniques in terms of coping with such problems, it is still challenging to map the detection rules of an existing device to a target device to enhance its single-class anomaly detection capabilities. In addition, the robustness requirement of the detection rule transfer process makes the problem further complicated, particularly in cases where limited target device data still have unknown outliers. To achieve good anomaly detection performance in such a complex scenario, we propose a robust deep one-class support vector description-based anomaly detection algorithm built on adversarial transfer learning. First, we designed a new hyperspherical adversarial training mechanism that integrates robust adaptive constraints into an improved domain-adversarial neural network. Additionally, to eliminate outlier interference to the greatest extent possible during the domain-adversarial process, we aimed to compute the probability of a sample being normal based on the utilized anomaly detection module and embedded this probability in a domain discriminator. Finally, an end-to-end optimization strategy was derived to find the optimal network parameters that could separate the anomalous classes as much as possible while promoting the consistency of the normal class data in the source and target domains. To validate the performance of our model, we experimented with three scenarios, i.e., digit image detection (with the MNIST and USPS datasets), object recognition (with the Office-Home dataset), and rolling bearing anomaly detection. The results showed that the proposed algorithm outperformed the state-of-the-art methods in terms of detection accuracy and robustness.</description><subject>Anomaly detection</subject><subject>Domain-adversarial adaptation</subject><subject>Robust one-class classification</subject><subject>Transfer learning</subject><issn>0950-7051</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9kM9KxDAYxHNQcF19Aw95gdYkbdL2Isj6FxZE0HP4knzRrN10SerKvr1d6tnTwMAMMz9CrjgrOePqelN-xSEfcimYqEvOhRDyhCxYJ1nRMMnPyHnOG8aYELxdkNc7xB11wxZCLMDtMWVIAXoKcfL6A3U4oh3DEOlPGD9pGsx3HukQsbA95EzHBDF7TLRHSDHEjwty6qHPePmnS_L-cP-2eirWL4_Pq9t1YXkrx8LIWoKywvCuNQasAikb4N62prbOMOWM9MoogZY1HqoKu6buDHpoUPpOVUtSz702DTkn9HqXwhbSQXOmjyj0Rs8o9BGFnlFMsZs5htO2fcCksw0YLbqQpqPaDeH_gl9nB26F</recordid><startdate>20240927</startdate><enddate>20240927</enddate><creator>Chi, Jingkai</creator><creator>Mao, Zhizhong</creator><general>Elsevier B.V</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-2658-3297</orcidid></search><sort><creationdate>20240927</creationdate><title>Deep domain-adversarial anomaly detection with robust one-class transfer learning</title><author>Chi, Jingkai ; Mao, Zhizhong</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c185t-b545a6c2b198bbac6a557a1fc8b4cdb06db5f6b62ec07fa33e9749befa7e5f963</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Anomaly detection</topic><topic>Domain-adversarial adaptation</topic><topic>Robust one-class classification</topic><topic>Transfer learning</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Chi, Jingkai</creatorcontrib><creatorcontrib>Mao, Zhizhong</creatorcontrib><collection>CrossRef</collection><jtitle>Knowledge-based systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Chi, Jingkai</au><au>Mao, Zhizhong</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Deep domain-adversarial anomaly detection with robust one-class transfer learning</atitle><jtitle>Knowledge-based systems</jtitle><date>2024-09-27</date><risdate>2024</risdate><volume>300</volume><spage>112225</spage><pages>112225-</pages><artnum>112225</artnum><issn>0950-7051</issn><abstract>Establishing an anomaly detection model as quickly as possible with a small number of measurement samples for use with new equipment or working conditions has been a research focus. In recent years, despite the effectiveness of transfer learning techniques in terms of coping with such problems, it is still challenging to map the detection rules of an existing device to a target device to enhance its single-class anomaly detection capabilities. In addition, the robustness requirement of the detection rule transfer process makes the problem further complicated, particularly in cases where limited target device data still have unknown outliers. To achieve good anomaly detection performance in such a complex scenario, we propose a robust deep one-class support vector description-based anomaly detection algorithm built on adversarial transfer learning. First, we designed a new hyperspherical adversarial training mechanism that integrates robust adaptive constraints into an improved domain-adversarial neural network. Additionally, to eliminate outlier interference to the greatest extent possible during the domain-adversarial process, we aimed to compute the probability of a sample being normal based on the utilized anomaly detection module and embedded this probability in a domain discriminator. Finally, an end-to-end optimization strategy was derived to find the optimal network parameters that could separate the anomalous classes as much as possible while promoting the consistency of the normal class data in the source and target domains. To validate the performance of our model, we experimented with three scenarios, i.e., digit image detection (with the MNIST and USPS datasets), object recognition (with the Office-Home dataset), and rolling bearing anomaly detection. The results showed that the proposed algorithm outperformed the state-of-the-art methods in terms of detection accuracy and robustness.</abstract><pub>Elsevier B.V</pub><doi>10.1016/j.knosys.2024.112225</doi><orcidid>https://orcid.org/0000-0002-2658-3297</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0950-7051
ispartof Knowledge-based systems, 2024-09, Vol.300, p.112225, Article 112225
issn 0950-7051
language eng
recordid cdi_crossref_primary_10_1016_j_knosys_2024_112225
source ScienceDirect Freedom Collection
subjects Anomaly detection
Domain-adversarial adaptation
Robust one-class classification
Transfer learning
title Deep domain-adversarial anomaly detection with robust one-class transfer learning
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-09T14%3A10%3A16IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Deep%20domain-adversarial%20anomaly%20detection%20with%20robust%20one-class%20transfer%20learning&rft.jtitle=Knowledge-based%20systems&rft.au=Chi,%20Jingkai&rft.date=2024-09-27&rft.volume=300&rft.spage=112225&rft.pages=112225-&rft.artnum=112225&rft.issn=0950-7051&rft_id=info:doi/10.1016/j.knosys.2024.112225&rft_dat=%3Celsevier_cross%3ES0950705124008591%3C/elsevier_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c185t-b545a6c2b198bbac6a557a1fc8b4cdb06db5f6b62ec07fa33e9749befa7e5f963%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true