Intelligent Digital Human Agent Service With Deep Learning Based-Face Recognition

This study proposes a framework for an intelligent agent information service using digital human and deep learning technology. The framework can recognize the identity of individuals using facial features and provide personalized services through a digital human. The personalized service is defined...

Full description

Saved in:
Bibliographic Details
Published in:IEEE access 2022, Vol.10, p.72794-72805
Main Authors: Kim, Bum-Soo, Seo, Sanghyun
Format: Article
Language:English
Subjects:
Animation
Customization
Data collection
Data processing
Deep learning
digital human
Domains
Face recognition
Image recognition
Intelligent agent service
Intelligent agents
Interpolation
Machine learning
Pipelines
Speech recognition
Training
User experience
Virtual assistants
Virtual humans
Visual effects
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This study proposes a framework for an intelligent agent information service using digital human and deep learning technology. The framework can recognize the identity of individuals using facial features and provide personalized services through a digital human. The personalized service is defined by a relevance graph based on personal data collected in advance. The proposed system can continuously evolve to recommend customized services using relevance graphs and dynamic data processing, gradually become more intelligent using additionally collected data. Moreover, it uses animation keyframe interpolation for natural and seamless digital human interaction and provides visual effects that are synchronized based on specific information collected for the intuitive service. The proposed system was tested on a school domain for two months, and a statistical domain feedback system based on a mathematical model that predicts service usage per unit time was developed using the recorded information. Additionally, we evaluate our system through user experience surveys.
ISSN:2169-3536
2169-3536
DOI:10.1109/ACCESS.2022.3188852