Loading…

Automatic micro-expression apex spotting using Cubic-LBP

The main way to communicate is through non-verbal expressions, although it could totally be manipulated by the person to give false expression. Unlike ordinary facial expressions, facial micro-expression has characterized by subtle movement and short duration of appearance which unleashes the true e...

Full description

Saved in:
Bibliographic Details
Published in:Multimedia tools and applications 2020-07, Vol.79 (27-28), p.20221-20239
Main Authors: Esmaeili, Vida, Shahdi, Seyed Omid
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c319t-42efcc27f1393700b0f1e10a23c6bc42173e6a2fedb672768bd529085d91adc23
cites cdi_FETCH-LOGICAL-c319t-42efcc27f1393700b0f1e10a23c6bc42173e6a2fedb672768bd529085d91adc23
container_end_page 20239
container_issue 27-28
container_start_page 20221
container_title Multimedia tools and applications
container_volume 79
creator Esmaeili, Vida
Shahdi, Seyed Omid
description The main way to communicate is through non-verbal expressions, although it could totally be manipulated by the person to give false expression. Unlike ordinary facial expressions, facial micro-expression has characterized by subtle movement and short duration of appearance which unleashes the true expression beyond the control of the person. Due to the nature of micro-expression which is very brief in time and low in intensity, prevalent methods could not come up with its challenges. One of the well-known dynamic texture descriptors is Local Binary Patterns on Three Orthogonal Planes (LBP-TOP) which mainly lacks in grabbing most vital information. To address this issue in this paper, we propose a novel feature extractor called Cubic-LBP that computes LBP on fifteen introduced planes. We demonstrate the effectiveness of these planes to find the apex frame where maximum facial movements within video sequences have occurred. Moreover, the whole process of spotting the apex frame in this paper is done automatically. Achieving results of apex frame spotting is satisfying on CASME and CASME II databases in comparison with most relevant state-of-the-art methods.
doi_str_mv 10.1007/s11042-020-08737-5
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2432262082</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2432262082</sourcerecordid><originalsourceid>FETCH-LOGICAL-c319t-42efcc27f1393700b0f1e10a23c6bc42173e6a2fedb672768bd529085d91adc23</originalsourceid><addsrcrecordid>eNp9kE9LxDAQxYMouK5-AU8Fz9GZSdO0x7XoKhT0oOeQpunSxf4xaWH99nat4M3LzBzee8P7MXaNcIsA6i4gQkwcCDikSiguT9gKpRJcKcLT-RYpcCUBz9lFCHsATCTFK5ZuprFvzdjYqG2s77k7DN6F0PRdZAZ3iMLQj2PT7aIpHGc-lY3lxf3rJTurzUdwV797zd4fH97yJ168bJ_zTcGtwGzkMbnaWlI1ikwogBJqdAiGhE1KGxMq4RJDtavKRJFK0rKSlEEqqwxNZUms2c2SO_j-c3Jh1Pt-8t38UlMsiBKC9KiiRTVXCMG7Wg--aY3_0gj6SEgvhPRMSP8Q0nI2icUUZnG3c_4v-h_XN7IYZ7w</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2432262082</pqid></control><display><type>article</type><title>Automatic micro-expression apex spotting using Cubic-LBP</title><source>ABI/INFORM Global</source><source>Springer Nature</source><creator>Esmaeili, Vida ; Shahdi, Seyed Omid</creator><creatorcontrib>Esmaeili, Vida ; Shahdi, Seyed Omid</creatorcontrib><description>The main way to communicate is through non-verbal expressions, although it could totally be manipulated by the person to give false expression. Unlike ordinary facial expressions, facial micro-expression has characterized by subtle movement and short duration of appearance which unleashes the true expression beyond the control of the person. Due to the nature of micro-expression which is very brief in time and low in intensity, prevalent methods could not come up with its challenges. One of the well-known dynamic texture descriptors is Local Binary Patterns on Three Orthogonal Planes (LBP-TOP) which mainly lacks in grabbing most vital information. To address this issue in this paper, we propose a novel feature extractor called Cubic-LBP that computes LBP on fifteen introduced planes. We demonstrate the effectiveness of these planes to find the apex frame where maximum facial movements within video sequences have occurred. Moreover, the whole process of spotting the apex frame in this paper is done automatically. Achieving results of apex frame spotting is satisfying on CASME and CASME II databases in comparison with most relevant state-of-the-art methods.</description><identifier>ISSN: 1380-7501</identifier><identifier>EISSN: 1573-7721</identifier><identifier>DOI: 10.1007/s11042-020-08737-5</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Accuracy ; Computer Communication Networks ; Computer Science ; Data Structures and Information Theory ; Feature extraction ; Methods ; Multimedia ; Multimedia Information Systems ; Orthogonality ; Special Purpose and Application-Based Systems</subject><ispartof>Multimedia tools and applications, 2020-07, Vol.79 (27-28), p.20221-20239</ispartof><rights>Springer Science+Business Media, LLC, part of Springer Nature 2020</rights><rights>Springer Science+Business Media, LLC, part of Springer Nature 2020.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c319t-42efcc27f1393700b0f1e10a23c6bc42173e6a2fedb672768bd529085d91adc23</citedby><cites>FETCH-LOGICAL-c319t-42efcc27f1393700b0f1e10a23c6bc42173e6a2fedb672768bd529085d91adc23</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/2432262082/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$H</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2432262082?pq-origsite=primo$$EHTML$$P50$$Gproquest$$H</linktohtml><link.rule.ids>314,778,782,11671,27907,27908,36043,44346,74646</link.rule.ids></links><search><creatorcontrib>Esmaeili, Vida</creatorcontrib><creatorcontrib>Shahdi, Seyed Omid</creatorcontrib><title>Automatic micro-expression apex spotting using Cubic-LBP</title><title>Multimedia tools and applications</title><addtitle>Multimed Tools Appl</addtitle><description>The main way to communicate is through non-verbal expressions, although it could totally be manipulated by the person to give false expression. Unlike ordinary facial expressions, facial micro-expression has characterized by subtle movement and short duration of appearance which unleashes the true expression beyond the control of the person. Due to the nature of micro-expression which is very brief in time and low in intensity, prevalent methods could not come up with its challenges. One of the well-known dynamic texture descriptors is Local Binary Patterns on Three Orthogonal Planes (LBP-TOP) which mainly lacks in grabbing most vital information. To address this issue in this paper, we propose a novel feature extractor called Cubic-LBP that computes LBP on fifteen introduced planes. We demonstrate the effectiveness of these planes to find the apex frame where maximum facial movements within video sequences have occurred. Moreover, the whole process of spotting the apex frame in this paper is done automatically. Achieving results of apex frame spotting is satisfying on CASME and CASME II databases in comparison with most relevant state-of-the-art methods.</description><subject>Accuracy</subject><subject>Computer Communication Networks</subject><subject>Computer Science</subject><subject>Data Structures and Information Theory</subject><subject>Feature extraction</subject><subject>Methods</subject><subject>Multimedia</subject><subject>Multimedia Information Systems</subject><subject>Orthogonality</subject><subject>Special Purpose and Application-Based Systems</subject><issn>1380-7501</issn><issn>1573-7721</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>M0C</sourceid><recordid>eNp9kE9LxDAQxYMouK5-AU8Fz9GZSdO0x7XoKhT0oOeQpunSxf4xaWH99nat4M3LzBzee8P7MXaNcIsA6i4gQkwcCDikSiguT9gKpRJcKcLT-RYpcCUBz9lFCHsATCTFK5ZuprFvzdjYqG2s77k7DN6F0PRdZAZ3iMLQj2PT7aIpHGc-lY3lxf3rJTurzUdwV797zd4fH97yJ168bJ_zTcGtwGzkMbnaWlI1ikwogBJqdAiGhE1KGxMq4RJDtavKRJFK0rKSlEEqqwxNZUms2c2SO_j-c3Jh1Pt-8t38UlMsiBKC9KiiRTVXCMG7Wg--aY3_0gj6SEgvhPRMSP8Q0nI2icUUZnG3c_4v-h_XN7IYZ7w</recordid><startdate>20200701</startdate><enddate>20200701</enddate><creator>Esmaeili, Vida</creator><creator>Shahdi, Seyed Omid</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7SC</scope><scope>7WY</scope><scope>7WZ</scope><scope>7XB</scope><scope>87Z</scope><scope>8AL</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>8FL</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BEZIV</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FRNLG</scope><scope>F~G</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K60</scope><scope>K6~</scope><scope>K7-</scope><scope>L.-</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0C</scope><scope>M0N</scope><scope>M2O</scope><scope>MBDVC</scope><scope>P5Z</scope><scope>P62</scope><scope>PQBIZ</scope><scope>PQBZA</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>Q9U</scope></search><sort><creationdate>20200701</creationdate><title>Automatic micro-expression apex spotting using Cubic-LBP</title><author>Esmaeili, Vida ; Shahdi, Seyed Omid</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c319t-42efcc27f1393700b0f1e10a23c6bc42173e6a2fedb672768bd529085d91adc23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Accuracy</topic><topic>Computer Communication Networks</topic><topic>Computer Science</topic><topic>Data Structures and Information Theory</topic><topic>Feature extraction</topic><topic>Methods</topic><topic>Multimedia</topic><topic>Multimedia Information Systems</topic><topic>Orthogonality</topic><topic>Special Purpose and Application-Based Systems</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Esmaeili, Vida</creatorcontrib><creatorcontrib>Shahdi, Seyed Omid</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>ABI/INFORM Collection</collection><collection>ABI/INFORM Global (PDF only)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>ABI/INFORM Global (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection (Alumni Edition)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Business Premium Collection</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Business Premium Collection (Alumni)</collection><collection>ABI/INFORM Global (Corporate)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Business Collection (Alumni Edition)</collection><collection>ProQuest Business Collection</collection><collection>Computer Science Database</collection><collection>ABI/INFORM Professional Advanced</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>ABI/INFORM Global</collection><collection>Computing Database</collection><collection>Research Library</collection><collection>Research Library (Corporate)</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>One Business</collection><collection>ProQuest One Business (Alumni)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central Basic</collection><jtitle>Multimedia tools and applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Esmaeili, Vida</au><au>Shahdi, Seyed Omid</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Automatic micro-expression apex spotting using Cubic-LBP</atitle><jtitle>Multimedia tools and applications</jtitle><stitle>Multimed Tools Appl</stitle><date>2020-07-01</date><risdate>2020</risdate><volume>79</volume><issue>27-28</issue><spage>20221</spage><epage>20239</epage><pages>20221-20239</pages><issn>1380-7501</issn><eissn>1573-7721</eissn><abstract>The main way to communicate is through non-verbal expressions, although it could totally be manipulated by the person to give false expression. Unlike ordinary facial expressions, facial micro-expression has characterized by subtle movement and short duration of appearance which unleashes the true expression beyond the control of the person. Due to the nature of micro-expression which is very brief in time and low in intensity, prevalent methods could not come up with its challenges. One of the well-known dynamic texture descriptors is Local Binary Patterns on Three Orthogonal Planes (LBP-TOP) which mainly lacks in grabbing most vital information. To address this issue in this paper, we propose a novel feature extractor called Cubic-LBP that computes LBP on fifteen introduced planes. We demonstrate the effectiveness of these planes to find the apex frame where maximum facial movements within video sequences have occurred. Moreover, the whole process of spotting the apex frame in this paper is done automatically. Achieving results of apex frame spotting is satisfying on CASME and CASME II databases in comparison with most relevant state-of-the-art methods.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s11042-020-08737-5</doi><tpages>19</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1380-7501
ispartof Multimedia tools and applications, 2020-07, Vol.79 (27-28), p.20221-20239
issn 1380-7501
1573-7721
language eng
recordid cdi_proquest_journals_2432262082
source ABI/INFORM Global; Springer Nature
subjects Accuracy
Computer Communication Networks
Computer Science
Data Structures and Information Theory
Feature extraction
Methods
Multimedia
Multimedia Information Systems
Orthogonality
Special Purpose and Application-Based Systems
title Automatic micro-expression apex spotting using Cubic-LBP
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T18%3A43%3A09IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Automatic%20micro-expression%20apex%20spotting%20using%20Cubic-LBP&rft.jtitle=Multimedia%20tools%20and%20applications&rft.au=Esmaeili,%20Vida&rft.date=2020-07-01&rft.volume=79&rft.issue=27-28&rft.spage=20221&rft.epage=20239&rft.pages=20221-20239&rft.issn=1380-7501&rft.eissn=1573-7721&rft_id=info:doi/10.1007/s11042-020-08737-5&rft_dat=%3Cproquest_cross%3E2432262082%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c319t-42efcc27f1393700b0f1e10a23c6bc42173e6a2fedb672768bd529085d91adc23%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2432262082&rft_id=info:pmid/&rfr_iscdi=true