Anomaly detection in spatiotemporal data via regularized non-negative tensor analysis

• Published in: Data mining and knowledge discovery 2018-07, Vol.32 (4), p.1056-1073
• Main Authors: Lin, Chaoguang, Zhu, Qiuhan, Guo, Shunan, Jin, Zhuochen, Lin, Yu-Ru, Cao, Nan
• Format: Article
• Language: English
• Subjects: Anomalies; Artificial Intelligence; Chemistry and Earth Sciences; Computer Science; Data Mining and Knowledge Discovery; Economic models; Feature extraction; Information Storage and Retrieval; Multidimensional data; Physics; Risk aversion; Spatiotemporal data; Statistics for Engineering; Tensor analysis; Traffic information
• ISSN: 1384-5810; 1573-756X
• DOI: 10.1007/s10618-018-0560-3

Anomaly detection in multidimensional data is a challenging task. Detecting anomalous mobility patterns in a city needs to take spatial, temporal, and traffic information into consideration. Although existing techniques are able to extract spatiotemporal features for anomaly analysis, few systematic analysis about how different factors contribute to or affect the anomalous patterns has been proposed. In this paper, we propose a novel technique to localize spatiotemporal anomalous events based on tensor decomposition. The proposed method employs a spatial-feature-temporal tensor model and analyzes latent mobility patterns through unsupervised learning. We first train the model based on historical data and then use the model to capture the anomalies, i.e., the mobility patterns that are significantly different from the normal patterns. The proposed technique is evaluated based on the yellow-cab dataset collected from New York City. The results show several interesting latent mobility patterns and traffic anomalies that can be deemed as anomalous events in the city, suggesting the effectiveness of the proposed anomaly detection method.