Generating 3D Virtual Human Animation Based on Facial Expression and Human Posture Captured by Dual Cameras

In order to generate 3D virtual human animation with smoother actions and richer and more vivid expressions, this article proposes a system based on dual cameras to synchronously capture human facial expressions and human posture, so as to better generate 3D virtual human animation. Firstly, the 2D...

Full description

Saved in:
Bibliographic Details
Published in:Advances in multimedia 2022-08, Vol.2022, p.1-9
Main Authors: Wang, Junming, Chai, Xiaojie, Han, Guo, Wang, Jixia
Format: Article
Language:English
Subjects:
Algorithms
Animation
Cameras
Feature extraction
Human body
Human motion
Magnetic fields
Motion capture
Sensors
Silicon wafers
Three dimensional models
Virtual humans
Virtual reality
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c504t-1a36d5cfcd8736ea973a165f0c7c29ce59e4247a2a91d57c9a452ff685a5f2bc3
cites cdi_FETCH-LOGICAL-c504t-1a36d5cfcd8736ea973a165f0c7c29ce59e4247a2a91d57c9a452ff685a5f2bc3
container_end_page 9
container_issue
container_start_page 1
container_title Advances in multimedia
container_volume 2022
creator Wang, Junming
Chai, Xiaojie
Han, Guo
Wang, Jixia
description In order to generate 3D virtual human animation with smoother actions and richer and more vivid expressions, this article proposes a system based on dual cameras to synchronously capture human facial expressions and human posture, so as to better generate 3D virtual human animation. Firstly, the 2D features of the image are extracted through facial expression, and the benchmark is provided for the standard 3D coordinate values. At the same time, the 3D pose fusion is realized by using the pose measurement algorithm for human motion capture. Through the test, it is found that the two fusion algorithms can meet the requirements of the static accuracy of 0.5° and the dynamic accuracy of 0°, and the three-dimensional model of a virtual human body has a good effect in data-driven animation. The experiments show that the system can better capture facial expressions and human posture synchronously, and the frame rate in the experimental test can reach 20 fps, which can generate more natural and realistic 3D virtual human animation in real time.
doi_str_mv 10.1155/2022/4833436
format article
fullrecord <record><control><sourceid>proquest_doaj_</sourceid><recordid>TN_cdi_doaj_primary_oai_doaj_org_article_c9cf3f4032c04a7c9f1c79da9a92e1bd</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><doaj_id>oai_doaj_org_article_c9cf3f4032c04a7c9f1c79da9a92e1bd</doaj_id><sourcerecordid>2704756618</sourcerecordid><originalsourceid>FETCH-LOGICAL-c504t-1a36d5cfcd8736ea973a165f0c7c29ce59e4247a2a91d57c9a452ff685a5f2bc3</originalsourceid><addsrcrecordid>eNp9kU1LAzEQhhdRUNSbPyDgUav5zuZY60cLBT2o1zDNR422uzXZRf33prb06GmGmYdnEt6qOiP4ihAhrimm9JrXjHEm96ojIms1EFLr_V1f48PqNOc4wwIrWnMmjqqPB9_4BF1s5ojdoteYuh4WaNwvoUHDJi7Lqm3QDWTvUGnuwcayv_teJV9UZQKN2-JPbe765NEIVuvq0OwH3a5tI1iWG_mkOgiwyP50W4-rl_u759F4MH18mIyG04EVmHcDAkw6YYN1tWLSg1YMiBQBW2Wptl5ozylXQEETJ5TVwAUNQdYCRKAzy46rycbrWng3q1Q-kX5MC9H8Ddo0N5C6aBfeWG0DCxwzajGH4grEKu1Ag6aezFxxnW9cq9R-9j535r3tU1Oeb6jCXAkpSV2oyw1lU5tz8mF3lWCzTses0zHbdAp-scHfYuPgK_5P_wIXJY5F</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2704756618</pqid></control><display><type>article</type><title>Generating 3D Virtual Human Animation Based on Facial Expression and Human Posture Captured by Dual Cameras</title><source>ProQuest - Publicly Available Content Database</source><source>Wiley Open Access</source><creator>Wang, Junming ; Chai, Xiaojie ; Han, Guo ; Wang, Jixia</creator><contributor>Li, Qiangyi ; Qiangyi Li</contributor><creatorcontrib>Wang, Junming ; Chai, Xiaojie ; Han, Guo ; Wang, Jixia ; Li, Qiangyi ; Qiangyi Li</creatorcontrib><description>In order to generate 3D virtual human animation with smoother actions and richer and more vivid expressions, this article proposes a system based on dual cameras to synchronously capture human facial expressions and human posture, so as to better generate 3D virtual human animation. Firstly, the 2D features of the image are extracted through facial expression, and the benchmark is provided for the standard 3D coordinate values. At the same time, the 3D pose fusion is realized by using the pose measurement algorithm for human motion capture. Through the test, it is found that the two fusion algorithms can meet the requirements of the static accuracy of 0.5° and the dynamic accuracy of 0°, and the three-dimensional model of a virtual human body has a good effect in data-driven animation. The experiments show that the system can better capture facial expressions and human posture synchronously, and the frame rate in the experimental test can reach 20 fps, which can generate more natural and realistic 3D virtual human animation in real time.</description><identifier>ISSN: 1687-5680</identifier><identifier>EISSN: 1687-5699</identifier><identifier>DOI: 10.1155/2022/4833436</identifier><language>eng</language><publisher>New York: Hindawi</publisher><subject>Algorithms ; Animation ; Cameras ; Feature extraction ; Human body ; Human motion ; Magnetic fields ; Motion capture ; Sensors ; Silicon wafers ; Three dimensional models ; Virtual humans ; Virtual reality</subject><ispartof>Advances in multimedia, 2022-08, Vol.2022, p.1-9</ispartof><rights>Copyright © 2022 Junming Wang et al.</rights><rights>Copyright © 2022 Junming Wang et al. This is an open access article distributed under the Creative Commons Attribution License (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. https://creativecommons.org/licenses/by/4.0</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c504t-1a36d5cfcd8736ea973a165f0c7c29ce59e4247a2a91d57c9a452ff685a5f2bc3</citedby><cites>FETCH-LOGICAL-c504t-1a36d5cfcd8736ea973a165f0c7c29ce59e4247a2a91d57c9a452ff685a5f2bc3</cites><orcidid>0000-0002-8173-5839</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/2704756618/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2704756618?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>314,777,781,25734,27905,27906,36993,44571,74875</link.rule.ids></links><search><contributor>Li, Qiangyi</contributor><contributor>Qiangyi Li</contributor><creatorcontrib>Wang, Junming</creatorcontrib><creatorcontrib>Chai, Xiaojie</creatorcontrib><creatorcontrib>Han, Guo</creatorcontrib><creatorcontrib>Wang, Jixia</creatorcontrib><title>Generating 3D Virtual Human Animation Based on Facial Expression and Human Posture Captured by Dual Cameras</title><title>Advances in multimedia</title><description>In order to generate 3D virtual human animation with smoother actions and richer and more vivid expressions, this article proposes a system based on dual cameras to synchronously capture human facial expressions and human posture, so as to better generate 3D virtual human animation. Firstly, the 2D features of the image are extracted through facial expression, and the benchmark is provided for the standard 3D coordinate values. At the same time, the 3D pose fusion is realized by using the pose measurement algorithm for human motion capture. Through the test, it is found that the two fusion algorithms can meet the requirements of the static accuracy of 0.5° and the dynamic accuracy of 0°, and the three-dimensional model of a virtual human body has a good effect in data-driven animation. The experiments show that the system can better capture facial expressions and human posture synchronously, and the frame rate in the experimental test can reach 20 fps, which can generate more natural and realistic 3D virtual human animation in real time.</description><subject>Algorithms</subject><subject>Animation</subject><subject>Cameras</subject><subject>Feature extraction</subject><subject>Human body</subject><subject>Human motion</subject><subject>Magnetic fields</subject><subject>Motion capture</subject><subject>Sensors</subject><subject>Silicon wafers</subject><subject>Three dimensional models</subject><subject>Virtual humans</subject><subject>Virtual reality</subject><issn>1687-5680</issn><issn>1687-5699</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><sourceid>DOA</sourceid><recordid>eNp9kU1LAzEQhhdRUNSbPyDgUav5zuZY60cLBT2o1zDNR422uzXZRf33prb06GmGmYdnEt6qOiP4ihAhrimm9JrXjHEm96ojIms1EFLr_V1f48PqNOc4wwIrWnMmjqqPB9_4BF1s5ojdoteYuh4WaNwvoUHDJi7Lqm3QDWTvUGnuwcayv_teJV9UZQKN2-JPbe765NEIVuvq0OwH3a5tI1iWG_mkOgiwyP50W4-rl_u759F4MH18mIyG04EVmHcDAkw6YYN1tWLSg1YMiBQBW2Wptl5ozylXQEETJ5TVwAUNQdYCRKAzy46rycbrWng3q1Q-kX5MC9H8Ddo0N5C6aBfeWG0DCxwzajGH4grEKu1Ag6aezFxxnW9cq9R-9j535r3tU1Oeb6jCXAkpSV2oyw1lU5tz8mF3lWCzTses0zHbdAp-scHfYuPgK_5P_wIXJY5F</recordid><startdate>20220809</startdate><enddate>20220809</enddate><creator>Wang, Junming</creator><creator>Chai, Xiaojie</creator><creator>Han, Guo</creator><creator>Wang, Jixia</creator><general>Hindawi</general><general>Hindawi Limited</general><scope>RHU</scope><scope>RHW</scope><scope>RHX</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7SC</scope><scope>7XB</scope><scope>8AL</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>CWDGH</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0N</scope><scope>P5Z</scope><scope>P62</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>Q9U</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-8173-5839</orcidid></search><sort><creationdate>20220809</creationdate><title>Generating 3D Virtual Human Animation Based on Facial Expression and Human Posture Captured by Dual Cameras</title><author>Wang, Junming ; Chai, Xiaojie ; Han, Guo ; Wang, Jixia</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c504t-1a36d5cfcd8736ea973a165f0c7c29ce59e4247a2a91d57c9a452ff685a5f2bc3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Algorithms</topic><topic>Animation</topic><topic>Cameras</topic><topic>Feature extraction</topic><topic>Human body</topic><topic>Human motion</topic><topic>Magnetic fields</topic><topic>Motion capture</topic><topic>Sensors</topic><topic>Silicon wafers</topic><topic>Three dimensional models</topic><topic>Virtual humans</topic><topic>Virtual reality</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wang, Junming</creatorcontrib><creatorcontrib>Chai, Xiaojie</creatorcontrib><creatorcontrib>Han, Guo</creatorcontrib><creatorcontrib>Wang, Jixia</creatorcontrib><collection>Hindawi Publishing Complete</collection><collection>Hindawi Publishing Subscription Journals</collection><collection>Hindawi Publishing Open Access Journals</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Computing Database (Alumni Edition)</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>Middle East &amp; Africa Database</collection><collection>ProQuest Central</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Computing Database</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest - Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest Central Basic</collection><collection>Directory of Open Access Journals</collection><jtitle>Advances in multimedia</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Wang, Junming</au><au>Chai, Xiaojie</au><au>Han, Guo</au><au>Wang, Jixia</au><au>Li, Qiangyi</au><au>Qiangyi Li</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Generating 3D Virtual Human Animation Based on Facial Expression and Human Posture Captured by Dual Cameras</atitle><jtitle>Advances in multimedia</jtitle><date>2022-08-09</date><risdate>2022</risdate><volume>2022</volume><spage>1</spage><epage>9</epage><pages>1-9</pages><issn>1687-5680</issn><eissn>1687-5699</eissn><abstract>In order to generate 3D virtual human animation with smoother actions and richer and more vivid expressions, this article proposes a system based on dual cameras to synchronously capture human facial expressions and human posture, so as to better generate 3D virtual human animation. Firstly, the 2D features of the image are extracted through facial expression, and the benchmark is provided for the standard 3D coordinate values. At the same time, the 3D pose fusion is realized by using the pose measurement algorithm for human motion capture. Through the test, it is found that the two fusion algorithms can meet the requirements of the static accuracy of 0.5° and the dynamic accuracy of 0°, and the three-dimensional model of a virtual human body has a good effect in data-driven animation. The experiments show that the system can better capture facial expressions and human posture synchronously, and the frame rate in the experimental test can reach 20 fps, which can generate more natural and realistic 3D virtual human animation in real time.</abstract><cop>New York</cop><pub>Hindawi</pub><doi>10.1155/2022/4833436</doi><tpages>9</tpages><orcidid>https://orcid.org/0000-0002-8173-5839</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1687-5680
ispartof Advances in multimedia, 2022-08, Vol.2022, p.1-9
issn 1687-5680
1687-5699
language eng
recordid cdi_doaj_primary_oai_doaj_org_article_c9cf3f4032c04a7c9f1c79da9a92e1bd
source ProQuest - Publicly Available Content Database; Wiley Open Access
subjects Algorithms
Animation
Cameras
Feature extraction
Human body
Human motion
Magnetic fields
Motion capture
Sensors
Silicon wafers
Three dimensional models
Virtual humans
Virtual reality
title Generating 3D Virtual Human Animation Based on Facial Expression and Human Posture Captured by Dual Cameras
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-20T13%3A48%3A36IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_doaj_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Generating%203D%20Virtual%20Human%20Animation%20Based%20on%20Facial%20Expression%20and%20Human%20Posture%20Captured%20by%20Dual%20Cameras&rft.jtitle=Advances%20in%20multimedia&rft.au=Wang,%20Junming&rft.date=2022-08-09&rft.volume=2022&rft.spage=1&rft.epage=9&rft.pages=1-9&rft.issn=1687-5680&rft.eissn=1687-5699&rft_id=info:doi/10.1155/2022/4833436&rft_dat=%3Cproquest_doaj_%3E2704756618%3C/proquest_doaj_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c504t-1a36d5cfcd8736ea973a165f0c7c29ce59e4247a2a91d57c9a452ff685a5f2bc3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2704756618&rft_id=info:pmid/&rfr_iscdi=true