Unsupervised flow-based motion analysis for an autonomous moving system

• Published in: Image and vision computing 2014-06, Vol.32 (6-7), p.391-404
• Main Authors: Pinto, Andry Maykol, Correia, Miguel V., Paulo Moreira, A., Costa, Paulo G.
• Format: Article
• Language: English
• Subjects: Active surveillance; Autonomous; Clusters; Computation; Mathematical models; Mobile robot; Motion segmentation; Moving observer; Optical flow; Refining; Robotics; Segmentation; Surveillance
• ISSN: 0262-8856; 1872-8138
• DOI: 10.1016/j.imavis.2014.04.003

This article discusses the motion analysis based on dense optical flow fields and for a new generation of robotic moving systems with real-time constraints. It focuses on a surveillance scenario where an especially designed autonomous mobile robot uses a monocular camera for perceiving motion in the environment. The computational resources and the processing-time are two of the most critical aspects in robotics and therefore, two non-parametric techniques are proposed, namely, the Hybrid Hierarchical Optical Flow Segmentation and the Hybrid Density-Based Optical Flow Segmentation. Both methods are able to extract the moving objects by performing two consecutive operations: refining and collecting. During the refining phase, the flow field is decomposed in a set of clusters and based on descriptive motion properties. These properties are used in the collecting stage by a hierarchical or density-based scheme to merge the set of clusters that represent different motion models. In addition, a model selection method is introduced. This novel method analyzes the flow field and estimates the number of distinct moving objects using a Bayesian formulation. The research evaluates the performance achieved by the methods in a realistic surveillance situation. The experiments conducted proved that the proposed methods extract reliable motion information in real-time and without using specialized computers. Moreover, the resulting segmentation is less computationally demanding compared to other recent methods and therefore, they are suitable for most of the robotic or surveillance applications. [Display omitted] •This paper focuses on segmenting the motion from dense optical flow fields.•Two unsupervised clustering methods are presented and a model selection is proposed.•A comparison between the proposed techniques with the K-means and EM is made.•Experiments are conducted in a surveillance scenario with an autonomous mobile.•The proposed techniques are superior in terms of robustness and computational demands