RODS: Rarity based Outlier Detection in a Sparse Coding Framework

Outlier detection has been an active area of research for a few decades. We propose a new definition of outlier that is useful for high-dimensional data. According to this definition, given a dictionary of atoms learned using the sparse coding objective, the outlierness of a data point depends joint...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on knowledge and data engineering 2016-02, Vol.28 (2), p.483-495
Main Authors: Dutta, Jayanta K., Banerjee, Bonny, Reddy, Chandan K.
Format: Article
Language:English
Subjects:
abnormal event detection
Algorithms
Anomaly detection
Change detection
Coding
Data analysis
Data points
data streams
Detection algorithms
Encoding
Feature extraction
Image detection
Image reconstruction
Outliers (statistics)
Rods
saliency detection
Streaming media
Videos
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Outlier detection has been an active area of research for a few decades. We propose a new definition of outlier that is useful for high-dimensional data. According to this definition, given a dictionary of atoms learned using the sparse coding objective, the outlierness of a data point depends jointly on two factors: the frequency of each atom in reconstructing all data points (or its negative log activity ratio, NLAR) and the strength by which it is used in reconstructing the current point. A R arity based O utlier D etection algorithm in a S parse coding framework (RODS) that consists of two components, NLAR learning and outlier scoring, is developed. This algorithm is unsupervised; both the offline and online variants are presented. It is governed by very few manually-tunable parameters and operates in linear time. We demonstrate the superior performance of the RODS in comparison with various state-of-the-art outlier detection algorithms on several benchmark datasets. We also demonstrate its effectiveness using three real-world case studies: saliency detection in images, abnormal event detection in videos, and change detection in data streams. Our evaluations shows that RODS outperforms competing algorithms reported in the outlier detection, saliency detection, video event detection, and change detection literature.
ISSN:1041-4347
1558-2191
DOI:10.1109/TKDE.2015.2475748