Loading…
Resilient VAE: Unsupervised Anomaly Detection at the SLAC Linac Coherent Light Source
Significant advances in utilizing deep learning for anomaly detection have been made in recent years. However, these methods largely assume the existence of a normal training set (i.e., uncontaminated by anomalies) or even a completely labeled training set. In many complex engineering systems, such...
Saved in:
Published in: | arXiv.org 2023-09 |
---|---|
Main Authors: | , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | |
---|---|
cites | |
container_end_page | |
container_issue | |
container_start_page | |
container_title | arXiv.org |
container_volume | |
creator | Humble, Ryan Colocho, William O'Shea, Finn Ratner, Daniel Darve, Eric |
description | Significant advances in utilizing deep learning for anomaly detection have been made in recent years. However, these methods largely assume the existence of a normal training set (i.e., uncontaminated by anomalies) or even a completely labeled training set. In many complex engineering systems, such as particle accelerators, labels are sparse and expensive; in order to perform anomaly detection in these cases, we must drop these assumptions and utilize a completely unsupervised method. This paper introduces the Resilient Variational Autoencoder (ResVAE), a deep generative model specifically designed for anomaly detection. ResVAE exhibits resilience to anomalies present in the training data and provides feature-level anomaly attribution. During the training process, ResVAE learns the anomaly probability for each sample as well as each individual feature, utilizing these probabilities to effectively disregard anomalous examples in the training data. We apply our proposed method to detect anomalies in the accelerator status at the SLAC Linac Coherent Light Source (LCLS). By utilizing shot-to-shot data from the beam position monitoring system, we demonstrate the exceptional capability of ResVAE in identifying various types of anomalies that are visible in the accelerator. |
format | article |
fullrecord | <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_2861510135</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2861510135</sourcerecordid><originalsourceid>FETCH-proquest_journals_28615101353</originalsourceid><addsrcrecordid>eNqNi80KgkAYAJcgSMp3-KCzsD9p0k3M6OAps6ss9pUrtmvuGvT2GfQAneYwMzPicSFYEG84XxDf2pZSyqMtD0PhkfKEVnUKtYNLku2g1HbscXgpi1dItHnI7g17dFg7ZTRIB65BKPIkhVxpWUNqGhy-e67ujYPCjEONKzK_yc6i_-OSrA_ZOT0G_WCeI1pXtVOnJ1XxOGIho0yE4r_qAyE6P30</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2861510135</pqid></control><display><type>article</type><title>Resilient VAE: Unsupervised Anomaly Detection at the SLAC Linac Coherent Light Source</title><source>Publicly Available Content Database</source><creator>Humble, Ryan ; Colocho, William ; O'Shea, Finn ; Ratner, Daniel ; Darve, Eric</creator><creatorcontrib>Humble, Ryan ; Colocho, William ; O'Shea, Finn ; Ratner, Daniel ; Darve, Eric</creatorcontrib><description>Significant advances in utilizing deep learning for anomaly detection have been made in recent years. However, these methods largely assume the existence of a normal training set (i.e., uncontaminated by anomalies) or even a completely labeled training set. In many complex engineering systems, such as particle accelerators, labels are sparse and expensive; in order to perform anomaly detection in these cases, we must drop these assumptions and utilize a completely unsupervised method. This paper introduces the Resilient Variational Autoencoder (ResVAE), a deep generative model specifically designed for anomaly detection. ResVAE exhibits resilience to anomalies present in the training data and provides feature-level anomaly attribution. During the training process, ResVAE learns the anomaly probability for each sample as well as each individual feature, utilizing these probabilities to effectively disregard anomalous examples in the training data. We apply our proposed method to detect anomalies in the accelerator status at the SLAC Linac Coherent Light Source (LCLS). By utilizing shot-to-shot data from the beam position monitoring system, we demonstrate the exceptional capability of ResVAE in identifying various types of anomalies that are visible in the accelerator.</description><identifier>EISSN: 2331-8422</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Anomalies ; Coherent light ; Light sources ; Linear accelerators ; Machine learning ; Particle accelerators ; Resilience ; Training</subject><ispartof>arXiv.org, 2023-09</ispartof><rights>2023. This work is published under http://creativecommons.org/licenses/by-nc-sa/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/2861510135?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>780,784,25753,37012,44590</link.rule.ids></links><search><creatorcontrib>Humble, Ryan</creatorcontrib><creatorcontrib>Colocho, William</creatorcontrib><creatorcontrib>O'Shea, Finn</creatorcontrib><creatorcontrib>Ratner, Daniel</creatorcontrib><creatorcontrib>Darve, Eric</creatorcontrib><title>Resilient VAE: Unsupervised Anomaly Detection at the SLAC Linac Coherent Light Source</title><title>arXiv.org</title><description>Significant advances in utilizing deep learning for anomaly detection have been made in recent years. However, these methods largely assume the existence of a normal training set (i.e., uncontaminated by anomalies) or even a completely labeled training set. In many complex engineering systems, such as particle accelerators, labels are sparse and expensive; in order to perform anomaly detection in these cases, we must drop these assumptions and utilize a completely unsupervised method. This paper introduces the Resilient Variational Autoencoder (ResVAE), a deep generative model specifically designed for anomaly detection. ResVAE exhibits resilience to anomalies present in the training data and provides feature-level anomaly attribution. During the training process, ResVAE learns the anomaly probability for each sample as well as each individual feature, utilizing these probabilities to effectively disregard anomalous examples in the training data. We apply our proposed method to detect anomalies in the accelerator status at the SLAC Linac Coherent Light Source (LCLS). By utilizing shot-to-shot data from the beam position monitoring system, we demonstrate the exceptional capability of ResVAE in identifying various types of anomalies that are visible in the accelerator.</description><subject>Anomalies</subject><subject>Coherent light</subject><subject>Light sources</subject><subject>Linear accelerators</subject><subject>Machine learning</subject><subject>Particle accelerators</subject><subject>Resilience</subject><subject>Training</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNqNi80KgkAYAJcgSMp3-KCzsD9p0k3M6OAps6ss9pUrtmvuGvT2GfQAneYwMzPicSFYEG84XxDf2pZSyqMtD0PhkfKEVnUKtYNLku2g1HbscXgpi1dItHnI7g17dFg7ZTRIB65BKPIkhVxpWUNqGhy-e67ujYPCjEONKzK_yc6i_-OSrA_ZOT0G_WCeI1pXtVOnJ1XxOGIho0yE4r_qAyE6P30</recordid><startdate>20230905</startdate><enddate>20230905</enddate><creator>Humble, Ryan</creator><creator>Colocho, William</creator><creator>O'Shea, Finn</creator><creator>Ratner, Daniel</creator><creator>Darve, Eric</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PTHSS</scope></search><sort><creationdate>20230905</creationdate><title>Resilient VAE: Unsupervised Anomaly Detection at the SLAC Linac Coherent Light Source</title><author>Humble, Ryan ; Colocho, William ; O'Shea, Finn ; Ratner, Daniel ; Darve, Eric</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-proquest_journals_28615101353</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Anomalies</topic><topic>Coherent light</topic><topic>Light sources</topic><topic>Linear accelerators</topic><topic>Machine learning</topic><topic>Particle accelerators</topic><topic>Resilience</topic><topic>Training</topic><toplevel>online_resources</toplevel><creatorcontrib>Humble, Ryan</creatorcontrib><creatorcontrib>Colocho, William</creatorcontrib><creatorcontrib>O'Shea, Finn</creatorcontrib><creatorcontrib>Ratner, Daniel</creatorcontrib><creatorcontrib>Darve, Eric</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>Engineering Collection</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Humble, Ryan</au><au>Colocho, William</au><au>O'Shea, Finn</au><au>Ratner, Daniel</au><au>Darve, Eric</au><format>book</format><genre>document</genre><ristype>GEN</ristype><atitle>Resilient VAE: Unsupervised Anomaly Detection at the SLAC Linac Coherent Light Source</atitle><jtitle>arXiv.org</jtitle><date>2023-09-05</date><risdate>2023</risdate><eissn>2331-8422</eissn><abstract>Significant advances in utilizing deep learning for anomaly detection have been made in recent years. However, these methods largely assume the existence of a normal training set (i.e., uncontaminated by anomalies) or even a completely labeled training set. In many complex engineering systems, such as particle accelerators, labels are sparse and expensive; in order to perform anomaly detection in these cases, we must drop these assumptions and utilize a completely unsupervised method. This paper introduces the Resilient Variational Autoencoder (ResVAE), a deep generative model specifically designed for anomaly detection. ResVAE exhibits resilience to anomalies present in the training data and provides feature-level anomaly attribution. During the training process, ResVAE learns the anomaly probability for each sample as well as each individual feature, utilizing these probabilities to effectively disregard anomalous examples in the training data. We apply our proposed method to detect anomalies in the accelerator status at the SLAC Linac Coherent Light Source (LCLS). By utilizing shot-to-shot data from the beam position monitoring system, we demonstrate the exceptional capability of ResVAE in identifying various types of anomalies that are visible in the accelerator.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | EISSN: 2331-8422 |
ispartof | arXiv.org, 2023-09 |
issn | 2331-8422 |
language | eng |
recordid | cdi_proquest_journals_2861510135 |
source | Publicly Available Content Database |
subjects | Anomalies Coherent light Light sources Linear accelerators Machine learning Particle accelerators Resilience Training |
title | Resilient VAE: Unsupervised Anomaly Detection at the SLAC Linac Coherent Light Source |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T00%3A02%3A13IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=document&rft.atitle=Resilient%20VAE:%20Unsupervised%20Anomaly%20Detection%20at%20the%20SLAC%20Linac%20Coherent%20Light%20Source&rft.jtitle=arXiv.org&rft.au=Humble,%20Ryan&rft.date=2023-09-05&rft.eissn=2331-8422&rft_id=info:doi/&rft_dat=%3Cproquest%3E2861510135%3C/proquest%3E%3Cgrp_id%3Ecdi_FETCH-proquest_journals_28615101353%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2861510135&rft_id=info:pmid/&rfr_iscdi=true |