Loading…
Automatic micro-expression apex spotting using Cubic-LBP
The main way to communicate is through non-verbal expressions, although it could totally be manipulated by the person to give false expression. Unlike ordinary facial expressions, facial micro-expression has characterized by subtle movement and short duration of appearance which unleashes the true e...
Saved in:
Published in: | Multimedia tools and applications 2020-07, Vol.79 (27-28), p.20221-20239 |
---|---|
Main Authors: | , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c319t-42efcc27f1393700b0f1e10a23c6bc42173e6a2fedb672768bd529085d91adc23 |
---|---|
cites | cdi_FETCH-LOGICAL-c319t-42efcc27f1393700b0f1e10a23c6bc42173e6a2fedb672768bd529085d91adc23 |
container_end_page | 20239 |
container_issue | 27-28 |
container_start_page | 20221 |
container_title | Multimedia tools and applications |
container_volume | 79 |
creator | Esmaeili, Vida Shahdi, Seyed Omid |
description | The main way to communicate is through non-verbal expressions, although it could totally be manipulated by the person to give false expression. Unlike ordinary facial expressions, facial micro-expression has characterized by subtle movement and short duration of appearance which unleashes the true expression beyond the control of the person. Due to the nature of micro-expression which is very brief in time and low in intensity, prevalent methods could not come up with its challenges. One of the well-known dynamic texture descriptors is Local Binary Patterns on Three Orthogonal Planes (LBP-TOP) which mainly lacks in grabbing most vital information. To address this issue in this paper, we propose a novel feature extractor called Cubic-LBP that computes LBP on fifteen introduced planes. We demonstrate the effectiveness of these planes to find the apex frame where maximum facial movements within video sequences have occurred. Moreover, the whole process of spotting the apex frame in this paper is done automatically. Achieving results of apex frame spotting is satisfying on CASME and CASME II databases in comparison with most relevant state-of-the-art methods. |
doi_str_mv | 10.1007/s11042-020-08737-5 |
format | article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2432262082</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2432262082</sourcerecordid><originalsourceid>FETCH-LOGICAL-c319t-42efcc27f1393700b0f1e10a23c6bc42173e6a2fedb672768bd529085d91adc23</originalsourceid><addsrcrecordid>eNp9kE9LxDAQxYMouK5-AU8Fz9GZSdO0x7XoKhT0oOeQpunSxf4xaWH99nat4M3LzBzee8P7MXaNcIsA6i4gQkwcCDikSiguT9gKpRJcKcLT-RYpcCUBz9lFCHsATCTFK5ZuprFvzdjYqG2s77k7DN6F0PRdZAZ3iMLQj2PT7aIpHGc-lY3lxf3rJTurzUdwV797zd4fH97yJ168bJ_zTcGtwGzkMbnaWlI1ikwogBJqdAiGhE1KGxMq4RJDtavKRJFK0rKSlEEqqwxNZUms2c2SO_j-c3Jh1Pt-8t38UlMsiBKC9KiiRTVXCMG7Wg--aY3_0gj6SEgvhPRMSP8Q0nI2icUUZnG3c_4v-h_XN7IYZ7w</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2432262082</pqid></control><display><type>article</type><title>Automatic micro-expression apex spotting using Cubic-LBP</title><source>ABI/INFORM Global</source><source>Springer Nature</source><creator>Esmaeili, Vida ; Shahdi, Seyed Omid</creator><creatorcontrib>Esmaeili, Vida ; Shahdi, Seyed Omid</creatorcontrib><description>The main way to communicate is through non-verbal expressions, although it could totally be manipulated by the person to give false expression. Unlike ordinary facial expressions, facial micro-expression has characterized by subtle movement and short duration of appearance which unleashes the true expression beyond the control of the person. Due to the nature of micro-expression which is very brief in time and low in intensity, prevalent methods could not come up with its challenges. One of the well-known dynamic texture descriptors is Local Binary Patterns on Three Orthogonal Planes (LBP-TOP) which mainly lacks in grabbing most vital information. To address this issue in this paper, we propose a novel feature extractor called Cubic-LBP that computes LBP on fifteen introduced planes. We demonstrate the effectiveness of these planes to find the apex frame where maximum facial movements within video sequences have occurred. Moreover, the whole process of spotting the apex frame in this paper is done automatically. Achieving results of apex frame spotting is satisfying on CASME and CASME II databases in comparison with most relevant state-of-the-art methods.</description><identifier>ISSN: 1380-7501</identifier><identifier>EISSN: 1573-7721</identifier><identifier>DOI: 10.1007/s11042-020-08737-5</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Accuracy ; Computer Communication Networks ; Computer Science ; Data Structures and Information Theory ; Feature extraction ; Methods ; Multimedia ; Multimedia Information Systems ; Orthogonality ; Special Purpose and Application-Based Systems</subject><ispartof>Multimedia tools and applications, 2020-07, Vol.79 (27-28), p.20221-20239</ispartof><rights>Springer Science+Business Media, LLC, part of Springer Nature 2020</rights><rights>Springer Science+Business Media, LLC, part of Springer Nature 2020.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c319t-42efcc27f1393700b0f1e10a23c6bc42173e6a2fedb672768bd529085d91adc23</citedby><cites>FETCH-LOGICAL-c319t-42efcc27f1393700b0f1e10a23c6bc42173e6a2fedb672768bd529085d91adc23</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/2432262082/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$H</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2432262082?pq-origsite=primo$$EHTML$$P50$$Gproquest$$H</linktohtml><link.rule.ids>314,778,782,11671,27907,27908,36043,44346,74646</link.rule.ids></links><search><creatorcontrib>Esmaeili, Vida</creatorcontrib><creatorcontrib>Shahdi, Seyed Omid</creatorcontrib><title>Automatic micro-expression apex spotting using Cubic-LBP</title><title>Multimedia tools and applications</title><addtitle>Multimed Tools Appl</addtitle><description>The main way to communicate is through non-verbal expressions, although it could totally be manipulated by the person to give false expression. Unlike ordinary facial expressions, facial micro-expression has characterized by subtle movement and short duration of appearance which unleashes the true expression beyond the control of the person. Due to the nature of micro-expression which is very brief in time and low in intensity, prevalent methods could not come up with its challenges. One of the well-known dynamic texture descriptors is Local Binary Patterns on Three Orthogonal Planes (LBP-TOP) which mainly lacks in grabbing most vital information. To address this issue in this paper, we propose a novel feature extractor called Cubic-LBP that computes LBP on fifteen introduced planes. We demonstrate the effectiveness of these planes to find the apex frame where maximum facial movements within video sequences have occurred. Moreover, the whole process of spotting the apex frame in this paper is done automatically. Achieving results of apex frame spotting is satisfying on CASME and CASME II databases in comparison with most relevant state-of-the-art methods.</description><subject>Accuracy</subject><subject>Computer Communication Networks</subject><subject>Computer Science</subject><subject>Data Structures and Information Theory</subject><subject>Feature extraction</subject><subject>Methods</subject><subject>Multimedia</subject><subject>Multimedia Information Systems</subject><subject>Orthogonality</subject><subject>Special Purpose and Application-Based Systems</subject><issn>1380-7501</issn><issn>1573-7721</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>M0C</sourceid><recordid>eNp9kE9LxDAQxYMouK5-AU8Fz9GZSdO0x7XoKhT0oOeQpunSxf4xaWH99nat4M3LzBzee8P7MXaNcIsA6i4gQkwcCDikSiguT9gKpRJcKcLT-RYpcCUBz9lFCHsATCTFK5ZuprFvzdjYqG2s77k7DN6F0PRdZAZ3iMLQj2PT7aIpHGc-lY3lxf3rJTurzUdwV797zd4fH97yJ168bJ_zTcGtwGzkMbnaWlI1ikwogBJqdAiGhE1KGxMq4RJDtavKRJFK0rKSlEEqqwxNZUms2c2SO_j-c3Jh1Pt-8t38UlMsiBKC9KiiRTVXCMG7Wg--aY3_0gj6SEgvhPRMSP8Q0nI2icUUZnG3c_4v-h_XN7IYZ7w</recordid><startdate>20200701</startdate><enddate>20200701</enddate><creator>Esmaeili, Vida</creator><creator>Shahdi, Seyed Omid</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7SC</scope><scope>7WY</scope><scope>7WZ</scope><scope>7XB</scope><scope>87Z</scope><scope>8AL</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>8FL</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BEZIV</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FRNLG</scope><scope>F~G</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K60</scope><scope>K6~</scope><scope>K7-</scope><scope>L.-</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0C</scope><scope>M0N</scope><scope>M2O</scope><scope>MBDVC</scope><scope>P5Z</scope><scope>P62</scope><scope>PQBIZ</scope><scope>PQBZA</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>Q9U</scope></search><sort><creationdate>20200701</creationdate><title>Automatic micro-expression apex spotting using Cubic-LBP</title><author>Esmaeili, Vida ; Shahdi, Seyed Omid</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c319t-42efcc27f1393700b0f1e10a23c6bc42173e6a2fedb672768bd529085d91adc23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Accuracy</topic><topic>Computer Communication Networks</topic><topic>Computer Science</topic><topic>Data Structures and Information Theory</topic><topic>Feature extraction</topic><topic>Methods</topic><topic>Multimedia</topic><topic>Multimedia Information Systems</topic><topic>Orthogonality</topic><topic>Special Purpose and Application-Based Systems</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Esmaeili, Vida</creatorcontrib><creatorcontrib>Shahdi, Seyed Omid</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>ABI/INFORM Collection</collection><collection>ABI/INFORM Global (PDF only)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>ABI/INFORM Global (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection (Alumni Edition)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Business Premium Collection</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Business Premium Collection (Alumni)</collection><collection>ABI/INFORM Global (Corporate)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Business Collection (Alumni Edition)</collection><collection>ProQuest Business Collection</collection><collection>Computer Science Database</collection><collection>ABI/INFORM Professional Advanced</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>ABI/INFORM Global</collection><collection>Computing Database</collection><collection>Research Library</collection><collection>Research Library (Corporate)</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>One Business</collection><collection>ProQuest One Business (Alumni)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central Basic</collection><jtitle>Multimedia tools and applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Esmaeili, Vida</au><au>Shahdi, Seyed Omid</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Automatic micro-expression apex spotting using Cubic-LBP</atitle><jtitle>Multimedia tools and applications</jtitle><stitle>Multimed Tools Appl</stitle><date>2020-07-01</date><risdate>2020</risdate><volume>79</volume><issue>27-28</issue><spage>20221</spage><epage>20239</epage><pages>20221-20239</pages><issn>1380-7501</issn><eissn>1573-7721</eissn><abstract>The main way to communicate is through non-verbal expressions, although it could totally be manipulated by the person to give false expression. Unlike ordinary facial expressions, facial micro-expression has characterized by subtle movement and short duration of appearance which unleashes the true expression beyond the control of the person. Due to the nature of micro-expression which is very brief in time and low in intensity, prevalent methods could not come up with its challenges. One of the well-known dynamic texture descriptors is Local Binary Patterns on Three Orthogonal Planes (LBP-TOP) which mainly lacks in grabbing most vital information. To address this issue in this paper, we propose a novel feature extractor called Cubic-LBP that computes LBP on fifteen introduced planes. We demonstrate the effectiveness of these planes to find the apex frame where maximum facial movements within video sequences have occurred. Moreover, the whole process of spotting the apex frame in this paper is done automatically. Achieving results of apex frame spotting is satisfying on CASME and CASME II databases in comparison with most relevant state-of-the-art methods.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s11042-020-08737-5</doi><tpages>19</tpages></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1380-7501 |
ispartof | Multimedia tools and applications, 2020-07, Vol.79 (27-28), p.20221-20239 |
issn | 1380-7501 1573-7721 |
language | eng |
recordid | cdi_proquest_journals_2432262082 |
source | ABI/INFORM Global; Springer Nature |
subjects | Accuracy Computer Communication Networks Computer Science Data Structures and Information Theory Feature extraction Methods Multimedia Multimedia Information Systems Orthogonality Special Purpose and Application-Based Systems |
title | Automatic micro-expression apex spotting using Cubic-LBP |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T18%3A43%3A09IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Automatic%20micro-expression%20apex%20spotting%20using%20Cubic-LBP&rft.jtitle=Multimedia%20tools%20and%20applications&rft.au=Esmaeili,%20Vida&rft.date=2020-07-01&rft.volume=79&rft.issue=27-28&rft.spage=20221&rft.epage=20239&rft.pages=20221-20239&rft.issn=1380-7501&rft.eissn=1573-7721&rft_id=info:doi/10.1007/s11042-020-08737-5&rft_dat=%3Cproquest_cross%3E2432262082%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c319t-42efcc27f1393700b0f1e10a23c6bc42173e6a2fedb672768bd529085d91adc23%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2432262082&rft_id=info:pmid/&rfr_iscdi=true |