Loading…

Resilient VAE: Unsupervised Anomaly Detection at the SLAC Linac Coherent Light Source

Significant advances in utilizing deep learning for anomaly detection have been made in recent years. However, these methods largely assume the existence of a normal training set (i.e., uncontaminated by anomalies) or even a completely labeled training set. In many complex engineering systems, such...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2023-09
Main Authors: Humble, Ryan, Colocho, William, O'Shea, Finn, Ratner, Daniel, Darve, Eric
Format: Article
Language:English
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Humble, Ryan
Colocho, William
O'Shea, Finn
Ratner, Daniel
Darve, Eric
description Significant advances in utilizing deep learning for anomaly detection have been made in recent years. However, these methods largely assume the existence of a normal training set (i.e., uncontaminated by anomalies) or even a completely labeled training set. In many complex engineering systems, such as particle accelerators, labels are sparse and expensive; in order to perform anomaly detection in these cases, we must drop these assumptions and utilize a completely unsupervised method. This paper introduces the Resilient Variational Autoencoder (ResVAE), a deep generative model specifically designed for anomaly detection. ResVAE exhibits resilience to anomalies present in the training data and provides feature-level anomaly attribution. During the training process, ResVAE learns the anomaly probability for each sample as well as each individual feature, utilizing these probabilities to effectively disregard anomalous examples in the training data. We apply our proposed method to detect anomalies in the accelerator status at the SLAC Linac Coherent Light Source (LCLS). By utilizing shot-to-shot data from the beam position monitoring system, we demonstrate the exceptional capability of ResVAE in identifying various types of anomalies that are visible in the accelerator.
format article
fullrecord <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_2861510135</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2861510135</sourcerecordid><originalsourceid>FETCH-proquest_journals_28615101353</originalsourceid><addsrcrecordid>eNqNi80KgkAYAJcgSMp3-KCzsD9p0k3M6OAps6ss9pUrtmvuGvT2GfQAneYwMzPicSFYEG84XxDf2pZSyqMtD0PhkfKEVnUKtYNLku2g1HbscXgpi1dItHnI7g17dFg7ZTRIB65BKPIkhVxpWUNqGhy-e67ujYPCjEONKzK_yc6i_-OSrA_ZOT0G_WCeI1pXtVOnJ1XxOGIho0yE4r_qAyE6P30</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2861510135</pqid></control><display><type>article</type><title>Resilient VAE: Unsupervised Anomaly Detection at the SLAC Linac Coherent Light Source</title><source>Publicly Available Content Database</source><creator>Humble, Ryan ; Colocho, William ; O'Shea, Finn ; Ratner, Daniel ; Darve, Eric</creator><creatorcontrib>Humble, Ryan ; Colocho, William ; O'Shea, Finn ; Ratner, Daniel ; Darve, Eric</creatorcontrib><description>Significant advances in utilizing deep learning for anomaly detection have been made in recent years. However, these methods largely assume the existence of a normal training set (i.e., uncontaminated by anomalies) or even a completely labeled training set. In many complex engineering systems, such as particle accelerators, labels are sparse and expensive; in order to perform anomaly detection in these cases, we must drop these assumptions and utilize a completely unsupervised method. This paper introduces the Resilient Variational Autoencoder (ResVAE), a deep generative model specifically designed for anomaly detection. ResVAE exhibits resilience to anomalies present in the training data and provides feature-level anomaly attribution. During the training process, ResVAE learns the anomaly probability for each sample as well as each individual feature, utilizing these probabilities to effectively disregard anomalous examples in the training data. We apply our proposed method to detect anomalies in the accelerator status at the SLAC Linac Coherent Light Source (LCLS). By utilizing shot-to-shot data from the beam position monitoring system, we demonstrate the exceptional capability of ResVAE in identifying various types of anomalies that are visible in the accelerator.</description><identifier>EISSN: 2331-8422</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Anomalies ; Coherent light ; Light sources ; Linear accelerators ; Machine learning ; Particle accelerators ; Resilience ; Training</subject><ispartof>arXiv.org, 2023-09</ispartof><rights>2023. This work is published under http://creativecommons.org/licenses/by-nc-sa/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/2861510135?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>780,784,25753,37012,44590</link.rule.ids></links><search><creatorcontrib>Humble, Ryan</creatorcontrib><creatorcontrib>Colocho, William</creatorcontrib><creatorcontrib>O'Shea, Finn</creatorcontrib><creatorcontrib>Ratner, Daniel</creatorcontrib><creatorcontrib>Darve, Eric</creatorcontrib><title>Resilient VAE: Unsupervised Anomaly Detection at the SLAC Linac Coherent Light Source</title><title>arXiv.org</title><description>Significant advances in utilizing deep learning for anomaly detection have been made in recent years. However, these methods largely assume the existence of a normal training set (i.e., uncontaminated by anomalies) or even a completely labeled training set. In many complex engineering systems, such as particle accelerators, labels are sparse and expensive; in order to perform anomaly detection in these cases, we must drop these assumptions and utilize a completely unsupervised method. This paper introduces the Resilient Variational Autoencoder (ResVAE), a deep generative model specifically designed for anomaly detection. ResVAE exhibits resilience to anomalies present in the training data and provides feature-level anomaly attribution. During the training process, ResVAE learns the anomaly probability for each sample as well as each individual feature, utilizing these probabilities to effectively disregard anomalous examples in the training data. We apply our proposed method to detect anomalies in the accelerator status at the SLAC Linac Coherent Light Source (LCLS). By utilizing shot-to-shot data from the beam position monitoring system, we demonstrate the exceptional capability of ResVAE in identifying various types of anomalies that are visible in the accelerator.</description><subject>Anomalies</subject><subject>Coherent light</subject><subject>Light sources</subject><subject>Linear accelerators</subject><subject>Machine learning</subject><subject>Particle accelerators</subject><subject>Resilience</subject><subject>Training</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNqNi80KgkAYAJcgSMp3-KCzsD9p0k3M6OAps6ss9pUrtmvuGvT2GfQAneYwMzPicSFYEG84XxDf2pZSyqMtD0PhkfKEVnUKtYNLku2g1HbscXgpi1dItHnI7g17dFg7ZTRIB65BKPIkhVxpWUNqGhy-e67ujYPCjEONKzK_yc6i_-OSrA_ZOT0G_WCeI1pXtVOnJ1XxOGIho0yE4r_qAyE6P30</recordid><startdate>20230905</startdate><enddate>20230905</enddate><creator>Humble, Ryan</creator><creator>Colocho, William</creator><creator>O'Shea, Finn</creator><creator>Ratner, Daniel</creator><creator>Darve, Eric</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PTHSS</scope></search><sort><creationdate>20230905</creationdate><title>Resilient VAE: Unsupervised Anomaly Detection at the SLAC Linac Coherent Light Source</title><author>Humble, Ryan ; Colocho, William ; O'Shea, Finn ; Ratner, Daniel ; Darve, Eric</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-proquest_journals_28615101353</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Anomalies</topic><topic>Coherent light</topic><topic>Light sources</topic><topic>Linear accelerators</topic><topic>Machine learning</topic><topic>Particle accelerators</topic><topic>Resilience</topic><topic>Training</topic><toplevel>online_resources</toplevel><creatorcontrib>Humble, Ryan</creatorcontrib><creatorcontrib>Colocho, William</creatorcontrib><creatorcontrib>O'Shea, Finn</creatorcontrib><creatorcontrib>Ratner, Daniel</creatorcontrib><creatorcontrib>Darve, Eric</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>Engineering Collection</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Humble, Ryan</au><au>Colocho, William</au><au>O'Shea, Finn</au><au>Ratner, Daniel</au><au>Darve, Eric</au><format>book</format><genre>document</genre><ristype>GEN</ristype><atitle>Resilient VAE: Unsupervised Anomaly Detection at the SLAC Linac Coherent Light Source</atitle><jtitle>arXiv.org</jtitle><date>2023-09-05</date><risdate>2023</risdate><eissn>2331-8422</eissn><abstract>Significant advances in utilizing deep learning for anomaly detection have been made in recent years. However, these methods largely assume the existence of a normal training set (i.e., uncontaminated by anomalies) or even a completely labeled training set. In many complex engineering systems, such as particle accelerators, labels are sparse and expensive; in order to perform anomaly detection in these cases, we must drop these assumptions and utilize a completely unsupervised method. This paper introduces the Resilient Variational Autoencoder (ResVAE), a deep generative model specifically designed for anomaly detection. ResVAE exhibits resilience to anomalies present in the training data and provides feature-level anomaly attribution. During the training process, ResVAE learns the anomaly probability for each sample as well as each individual feature, utilizing these probabilities to effectively disregard anomalous examples in the training data. We apply our proposed method to detect anomalies in the accelerator status at the SLAC Linac Coherent Light Source (LCLS). By utilizing shot-to-shot data from the beam position monitoring system, we demonstrate the exceptional capability of ResVAE in identifying various types of anomalies that are visible in the accelerator.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2023-09
issn 2331-8422
language eng
recordid cdi_proquest_journals_2861510135
source Publicly Available Content Database
subjects Anomalies
Coherent light
Light sources
Linear accelerators
Machine learning
Particle accelerators
Resilience
Training
title Resilient VAE: Unsupervised Anomaly Detection at the SLAC Linac Coherent Light Source
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T00%3A02%3A13IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=document&rft.atitle=Resilient%20VAE:%20Unsupervised%20Anomaly%20Detection%20at%20the%20SLAC%20Linac%20Coherent%20Light%20Source&rft.jtitle=arXiv.org&rft.au=Humble,%20Ryan&rft.date=2023-09-05&rft.eissn=2331-8422&rft_id=info:doi/&rft_dat=%3Cproquest%3E2861510135%3C/proquest%3E%3Cgrp_id%3Ecdi_FETCH-proquest_journals_28615101353%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2861510135&rft_id=info:pmid/&rfr_iscdi=true