CatSight, a direct path to proper multi-variate time series change detection: perceiving a concept drift through common spatial pattern

• Published in: International journal of machine learning and cybernetics 2023-09, Vol.14 (9), p.2925-2944
• Main Authors: Flórez, Arantzazu, Rodríguez-Moreno, Itsaso, Artetxe, Arkaitz, Olaizola, Igor García, Sierra, Basilio
• Format: Article
• Language: English
• Subjects: Algorithms; Artificial Intelligence; Behavior; Change detection; Classification; Complex Systems; Computational Intelligence; Control; Data transmission; Drift; Engineering; Industry 4.0; Machine learning; Mechatronics; Monitoring; Multivariate analysis; Original Article; Pattern Recognition; Performance prediction; Principal components analysis; Robotics; Sensors; Systems Biology; Time series
• ISSN: 1868-8071; 1868-808X
• DOI: 10.1007/s13042-023-01810-z

Detecting changes in data streams, with the data flowing continuously, is an important problem which Industry 4.0 has to deal with. In industrial monitoring, the data distribution may vary after a change in the machine’s operating point; this situation is known as concept drift, and it is key to detecting this change. One drawback of conventional machine learning algorithms is that they are usually static, trained offline, and require monitoring at the input level. A change in the distribution of data, in the relationship between the input and the output data, would result in the deterioration of the predictive performance of the models due to the lack of an ability to generalize the model to new concepts. Drift detecting methods emerge as a solution to identify the concept drift in the data. This paper proposes a new approach for concept drift detection—a novel approach to deal with sudden or abrupt drift, the most common drift found in industrial processes-, called CatSight. Briefly, this method is composed of two steps: (i) Use of Common Spatial Patterns (a statistical approach to deal with data streaming, closely related to Principal Component Analysis) to maximize the difference between two different distributions of a multivariate temporal data, and (ii) Machine Learning conventional algorithms to detect whether a change in the data flow has been occurred or not. The performance of the CatSight method, has been evaluated on a real use case, training six state of the art Machine Learning (ML) classifiers; obtained results indicate how adequate the new approach is.