Automatic micro-expression apex spotting using Cubic-LBP

• Published in: Multimedia tools and applications 2020-07, Vol.79 (27-28), p.20221-20239
• Main Authors: Esmaeili, Vida, Shahdi, Seyed Omid
• Format: Article
• Language: English
• Subjects: Accuracy; Computer Communication Networks; Computer Science; Data Structures and Information Theory; Feature extraction; Methods; Multimedia; Multimedia Information Systems; Orthogonality; Special Purpose and Application-Based Systems
• ISSN: 1380-7501; 1573-7721
• DOI: 10.1007/s11042-020-08737-5

The main way to communicate is through non-verbal expressions, although it could totally be manipulated by the person to give false expression. Unlike ordinary facial expressions, facial micro-expression has characterized by subtle movement and short duration of appearance which unleashes the true expression beyond the control of the person. Due to the nature of micro-expression which is very brief in time and low in intensity, prevalent methods could not come up with its challenges. One of the well-known dynamic texture descriptors is Local Binary Patterns on Three Orthogonal Planes (LBP-TOP) which mainly lacks in grabbing most vital information. To address this issue in this paper, we propose a novel feature extractor called Cubic-LBP that computes LBP on fifteen introduced planes. We demonstrate the effectiveness of these planes to find the apex frame where maximum facial movements within video sequences have occurred. Moreover, the whole process of spotting the apex frame in this paper is done automatically. Achieving results of apex frame spotting is satisfying on CASME and CASME II databases in comparison with most relevant state-of-the-art methods.