VLAD: Task-agnostic VAE-based lifelong anomaly detection

• Published in: Neural networks 2023-08, Vol.165, p.248-273
• Main Authors: Faber, Kamil, Corizzo, Roberto, Sniezynski, Bartlomiej, Japkowicz, Nathalie
• Format: Article
• Language: English
• Subjects: Anomaly detection; Continual learning; Lifelong anomaly detection; Lifelong learning; Neural networks
• ISSN: 0893-6080; 1879-2782
• DOI: 10.1016/j.neunet.2023.05.032

Lifelong learning represents an emerging machine learning paradigm that aims at designing new methods providing accurate analyses in complex and dynamic real-world environments. Although a significant amount of research has been conducted in image classification and reinforcement learning, very limited work has been done to solve lifelong anomaly detection problems. In this context, a successful method has to detect anomalies while adapting to changing environments and preserving knowledge to avoid catastrophic forgetting. While state-of-the-art online anomaly detection methods are able to detect anomalies and adapt to a changing environment, they are not designed to preserve past knowledge. On the other hand, while lifelong learning methods are focused on adapting to changing environments and preserving knowledge, they are not tailored for detecting anomalies, and often require task labels or task boundaries which are not available in task-agnostic lifelong anomaly detection scenarios. This paper proposes VLAD, a novel VAE-based Lifelong Anomaly Detection method addressing all these challenges simultaneously in complex task-agnostic scenarios. VLAD leverages the combination of lifelong change point detection and an effective model update strategy supported by experience replay with a hierarchical memory maintained by means of consolidation and summarization. An extensive quantitative evaluation showcases the merit of the proposed method in a variety of applied settings. VLAD outperforms state-of-the-art methods for anomaly detection, presenting increased robustness and performance in complex lifelong settings. •VAE-based Lifelong Anomaly Detection (VLAD) for complex task-agnostic scenarios.•Model update strategy based on lifelong change point detection and experience replay.•A hierarchical memory maintained by means of consolidation and summarization.•Extensive evaluation showing VLAD’s strengths in applied real-world evolving domains.•VLAD yields a robust task-agnostic lifelong anomaly detection performance.