Depth-supported real-time video segmentation with the Kinect

We present a real-time technique for the spatiotemporal segmentation of color/depth movies. Images are segmented using a parallel Metropolis algorithm implemented on a GPU utilizing both color and depth information, acquired with the Microsoft Kinect. Segments represent the equilibrium states of a P...

Full description

Saved in:
Bibliographic Details
Main Authors: Abramov, A., Pauwels, K., Papon, J., Worgotter, F., Dellen, B.
Format: Conference Proceeding
Language:English
Subjects:
Calibration
Cameras
Image color analysis
Image segmentation
Kernel
Optical imaging
Streaming media
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We present a real-time technique for the spatiotemporal segmentation of color/depth movies. Images are segmented using a parallel Metropolis algorithm implemented on a GPU utilizing both color and depth information, acquired with the Microsoft Kinect. Segments represent the equilibrium states of a Potts model, where tracking of segments is achieved by warping obtained segment labels to the next frame using real-time optical flow, which reduces the number of iterations required for the Metropolis method to encounter the new equilibrium state. By including depth information into the framework, true objects boundaries can be found more easily, improving also the temporal coherency of the method. The algorithm has been tested for videos of medium resolutions showing human manipulations of objects. The framework provides an inexpensive visual front end for visual preprocessing of videos in industrial settings and robot labs which can potentially be used in various applications.
ISSN:1550-5790
2642-9381
DOI:10.1109/WACV.2012.6163000