Learning Slow Features for Behaviour Analysis

• Main Authors: Zafeiriou, Lazaros, Nicolaou, Mihalis A., Zafeiriou, Stefanos, Nikitidis, Symeon, Pantic, Maja
• Format: Conference Proceeding
• Language: English
• Subjects: Algorithm design and analysis; Algorithms; Component Analysis; Computer vision; Covariance matrices; Dynamics; Eigenvalues and eigenfunctions; Feature extraction; Learning; Mathematical model; Maximization; Optimization; Probabilistic logic; Probabilistic methods; Probability theory; Projection; Sequences; Slow Feature Analysis
• ISSN: 1550-5499; 2380-7504
• DOI: 10.1109/ICCV.2013.353

A recently introduced latent feature learning technique for time varying dynamic phenomena analysis is the so called Slow Feature Analysis (SFA). SFA is a deterministic component analysis technique for multi-dimensional sequences that by minimizing the variance of the first order time derivative approximation of the input signal finds uncorrelated projections that extract slowly-varying features ordered by their temporal consistency and constancy. In this paper, we propose a number of extensions in both the deterministic and the probabilistic SFA optimization frameworks. In particular, we derive a novel deterministic SFA algorithm that is able to identify linear projections that extract the common slowest varying features of two or more sequences. In addition, we propose an Expectation Maximization (EM) algorithm to perform inference in a probabilistic formulation of SFA and similarly extend it in order to handle two and more time varying data sequences. Moreover, we demonstrate that the probabilistic SFA (EMSFA) algorithm that discovers the common slowest varying latent space of multiple sequences can be combined with dynamic time warping techniques for robust sequence time alignment. The proposed SFA algorithms were applied for facial behavior analysis demonstrating their usefulness and appropriateness for this task.