Deep End-to-End One-Class Classifier

• Published in: IEEE transaction on neural networks and learning systems 2021-02, Vol.32 (2), p.675-684
• Main Authors: Sabokrou, Mohammad, Fathy, Mahmood, Zhao, Guoying, Adeli, Ehsan
• Format: Article
• Language: English
• Subjects: Anomalies; Anomaly detection; Artificial neural networks; Classifiers; Computer vision; Consumer goods; Data analysis; Datasets; Detectors; Gallium nitride; Generative adversarial network (GAN); Image reconstruction; Learning algorithms; Machine learning; Neural networks; one-class classification (OCC); Outliers (statistics); Probability distribution; Task analysis; Testing; Training; video anomaly detection
• ISSN: 2162-237X; 2162-2388
• DOI: 10.1109/TNNLS.2020.2979049

One-class classification (OCC) poses as an essential component in many machine learning and computer vision applications, including novelty, anomaly, and outlier detection systems. With a known definition for a target or normal set of data, one-class classifiers can determine if any given new sample spans within the distribution of the target class. Solving for this task in a general setting is particularly very challenging, due to the high diversity of samples from the target class and the absence of any supervising signal over the novelty (nontarget) concept, which makes designing end-to-end models unattainable. In this article, we propose an adversarial training approach to detect out-of-distribution samples in an end-to-end trainable deep model. To this end, we jointly train two deep neural networks, \mathcal {R} and \mathcal {D} . The latter plays as the discriminator while the former, during training, helps \mathcal {D} characterize a probability distribution for the target class by creating adversarial examples and, during testing, collaborates with it to detect novelties. Using our OCC, we first test outlier detection on two image data sets, Modified National Institute of Standards and Technology (MNIST) and Caltech-256. Then, several experiments for video anomaly detection are performed on University of Minnesota (UMN) and University of California, San Diego (UCSD) data sets. Our proposed method can successfully learn the target class underlying distribution and outperforms other approaches.