Facial Expression Recognition From Depth Video With Patterns of Oriented Motion Flow

In this paper, we propose a novel feature representation method by a new feature descriptor, named patterns of oriented motion flow (POMF) from the optical flow information, to recognize the proper facial expression from the facial video. The POMF computes different directional motion information an...

Full description

Saved in:
Bibliographic Details
Published in:IEEE access 2017, Vol.5, p.8880-8889
Main Authors: Kabir, Md Hasanul, Salekin, Md Sirajus, Uddin, Md Zia, Abdullah-Al-Wadud, M.
Format: Article
Language:English
Subjects:
Cluster analysis
Clustering
Computer vision
Depth image
Estimation
Face recognition
facial expression recognition
Feature extraction
Histograms
Image motion analysis
local binary pattern
Markov chains
optical flow
Optical flow (image analysis)
Optical imaging
patterns of oriented motion flow (POMF)
Robustness
Vector quantization
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we propose a novel feature representation method by a new feature descriptor, named patterns of oriented motion flow (POMF) from the optical flow information, to recognize the proper facial expression from the facial video. The POMF computes different directional motion information and encodes the directional flow information with enhanced local texture micro patterns. As it captures the spatial temporal changes of facial movements through optical flow and enables us to observe both local and global structures, it shows its robustness in recognizing facial information. Finally, the POMF histogram is used to train the expression model through the hidden Markov model (HMM). To train through the HMM, the objective sequences are produced by the generation of a codebook using the K-means clustering technique. The performance of the proposed method has been evaluated over the RGB and depth camera-based video. Experimental results demonstrate that the proposed POMF descriptor is more robust in extracting facial information and provides a higher classification rate than other existing promising methods.
ISSN:2169-3536
2169-3536
DOI:10.1109/ACCESS.2017.2704087