Loading…

Designing and Evaluating a Social Gaze-Control System for a Humanoid Robot

This paper describes a context-dependent social gaze-control system implemented as part of a humanoid social robot. The system enables the robot to direct its gaze at multiple humans who are interacting with each other and with the robot. The attention mechanism of the gaze-control system is based o...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on human-machine systems 2014-04, Vol.44 (2), p.157-168
Main Authors: Zaraki, Abolfazl, Mazzei, Daniele, Giuliani, Manuel, De Rossi, Danilo
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c422t-f30ef177c2a74d1866e55ad736c61a7622c41fce502719ac5beb2f5edddbb793
cites cdi_FETCH-LOGICAL-c422t-f30ef177c2a74d1866e55ad736c61a7622c41fce502719ac5beb2f5edddbb793
container_end_page 168
container_issue 2
container_start_page 157
container_title IEEE transactions on human-machine systems
container_volume 44
creator Zaraki, Abolfazl
Mazzei, Daniele
Giuliani, Manuel
De Rossi, Danilo
description This paper describes a context-dependent social gaze-control system implemented as part of a humanoid social robot. The system enables the robot to direct its gaze at multiple humans who are interacting with each other and with the robot. The attention mechanism of the gaze-control system is based on features that have been proven to guide human attention: nonverbal and verbal cues, proxemics, the visual field of view, and the habituation effect. Our gaze-control system uses Kinect skeleton tracking together with speech recognition and SHORE-based facial expression recognition to implement the same features. As part of a pilot evaluation, we collected the gaze behavior of 11 participants in an eye-tracking study. We showed participants videos of two-person interactions and tracked their gaze behavior. A comparison of the human gaze behavior with the behavior of our gaze-control system running on the same videos shows that it replicated human gaze behavior 89% of the time.
doi_str_mv 10.1109/THMS.2014.2303083
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1520965328</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>6736067</ieee_id><sourcerecordid>1520965328</sourcerecordid><originalsourceid>FETCH-LOGICAL-c422t-f30ef177c2a74d1866e55ad736c61a7622c41fce502719ac5beb2f5edddbb793</originalsourceid><addsrcrecordid>eNpdkEtLw0AQx4MoWGo_gHgJiOAldR_ZR45Sa6tUBNt72GwmZUuSrbuJUD-9W1t7cA7zYH4zzPyj6BqjMcYoe1jN35ZjgnA6JhRRJOlZNCCYyySU7PwvJxm-jEbeb1AwSRhjchC9PoE369a061i1ZTz9UnWvut8yXlptVB3P1DckE9t2ztbxcuc7aOLKugDM-0a11pTxhy1sdxVdVKr2MDrGYbR6nq4m82TxPnuZPC4SnRLSJRVFUGEhNFEiLbHkHBhTpaBcc6wEJ0SnuNLAEBE4U5oVUJCKQVmWRSEyOozuD2u3zn724Lu8MV5DXasWbO9zzAjKOKNEBvT2H7qxvWvDcYFCAqcYURoofKC0s947qPKtM41yuxyjfK9vvtc33-ubH_UNM3fHzcprVVdOtdr40yCRabheosDdHDgDAKc2D8-i4H4AgU2BrQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1507141033</pqid></control><display><type>article</type><title>Designing and Evaluating a Social Gaze-Control System for a Humanoid Robot</title><source>IEEE Electronic Library (IEL) Journals</source><creator>Zaraki, Abolfazl ; Mazzei, Daniele ; Giuliani, Manuel ; De Rossi, Danilo</creator><creatorcontrib>Zaraki, Abolfazl ; Mazzei, Daniele ; Giuliani, Manuel ; De Rossi, Danilo</creatorcontrib><description>This paper describes a context-dependent social gaze-control system implemented as part of a humanoid social robot. The system enables the robot to direct its gaze at multiple humans who are interacting with each other and with the robot. The attention mechanism of the gaze-control system is based on features that have been proven to guide human attention: nonverbal and verbal cues, proxemics, the visual field of view, and the habituation effect. Our gaze-control system uses Kinect skeleton tracking together with speech recognition and SHORE-based facial expression recognition to implement the same features. As part of a pilot evaluation, we collected the gaze behavior of 11 participants in an eye-tracking study. We showed participants videos of two-person interactions and tracked their gaze behavior. A comparison of the human gaze behavior with the behavior of our gaze-control system running on the same videos shows that it replicated human gaze behavior 89% of the time.</description><identifier>ISSN: 2168-2291</identifier><identifier>EISSN: 2168-2305</identifier><identifier>DOI: 10.1109/THMS.2014.2303083</identifier><identifier>CODEN: ITHSA6</identifier><language>eng</language><publisher>New York, NY: IEEE</publisher><subject>Active vision ; Applied sciences ; Artificial intelligence ; Biological and medical sciences ; Computer science; control theory; systems ; context-dependent social gaze behavior ; Control systems ; Control theory. Systems ; Exact sciences and technology ; Face ; Face recognition ; Feature extraction ; Fundamental and applied biological sciences. Psychology ; Human ; human-robot interaction ; Humanoid ; Humanoid robots ; Pattern recognition. Digital image processing. Computational geometry ; Pilots ; Psychology. Psychoanalysis. Psychiatry ; Psychology. Psychophysiology ; Robot kinematics ; Robotics ; Robots ; Running ; scene analysis ; social attention ; Social interactions. Communication. Group processes ; Social psychology ; Speech and sound recognition and synthesis. Linguistics ; Speech recognition ; Tracking ; Visualization</subject><ispartof>IEEE transactions on human-machine systems, 2014-04, Vol.44 (2), p.157-168</ispartof><rights>2015 INIST-CNRS</rights><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Apr 2014</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c422t-f30ef177c2a74d1866e55ad736c61a7622c41fce502719ac5beb2f5edddbb793</citedby><cites>FETCH-LOGICAL-c422t-f30ef177c2a74d1866e55ad736c61a7622c41fce502719ac5beb2f5edddbb793</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/6736067$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,54796</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&amp;idt=28402780$$DView record in Pascal Francis$$Hfree_for_read</backlink></links><search><creatorcontrib>Zaraki, Abolfazl</creatorcontrib><creatorcontrib>Mazzei, Daniele</creatorcontrib><creatorcontrib>Giuliani, Manuel</creatorcontrib><creatorcontrib>De Rossi, Danilo</creatorcontrib><title>Designing and Evaluating a Social Gaze-Control System for a Humanoid Robot</title><title>IEEE transactions on human-machine systems</title><addtitle>THMS</addtitle><description>This paper describes a context-dependent social gaze-control system implemented as part of a humanoid social robot. The system enables the robot to direct its gaze at multiple humans who are interacting with each other and with the robot. The attention mechanism of the gaze-control system is based on features that have been proven to guide human attention: nonverbal and verbal cues, proxemics, the visual field of view, and the habituation effect. Our gaze-control system uses Kinect skeleton tracking together with speech recognition and SHORE-based facial expression recognition to implement the same features. As part of a pilot evaluation, we collected the gaze behavior of 11 participants in an eye-tracking study. We showed participants videos of two-person interactions and tracked their gaze behavior. A comparison of the human gaze behavior with the behavior of our gaze-control system running on the same videos shows that it replicated human gaze behavior 89% of the time.</description><subject>Active vision</subject><subject>Applied sciences</subject><subject>Artificial intelligence</subject><subject>Biological and medical sciences</subject><subject>Computer science; control theory; systems</subject><subject>context-dependent social gaze behavior</subject><subject>Control systems</subject><subject>Control theory. Systems</subject><subject>Exact sciences and technology</subject><subject>Face</subject><subject>Face recognition</subject><subject>Feature extraction</subject><subject>Fundamental and applied biological sciences. Psychology</subject><subject>Human</subject><subject>human-robot interaction</subject><subject>Humanoid</subject><subject>Humanoid robots</subject><subject>Pattern recognition. Digital image processing. Computational geometry</subject><subject>Pilots</subject><subject>Psychology. Psychoanalysis. Psychiatry</subject><subject>Psychology. Psychophysiology</subject><subject>Robot kinematics</subject><subject>Robotics</subject><subject>Robots</subject><subject>Running</subject><subject>scene analysis</subject><subject>social attention</subject><subject>Social interactions. Communication. Group processes</subject><subject>Social psychology</subject><subject>Speech and sound recognition and synthesis. Linguistics</subject><subject>Speech recognition</subject><subject>Tracking</subject><subject>Visualization</subject><issn>2168-2291</issn><issn>2168-2305</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2014</creationdate><recordtype>article</recordtype><recordid>eNpdkEtLw0AQx4MoWGo_gHgJiOAldR_ZR45Sa6tUBNt72GwmZUuSrbuJUD-9W1t7cA7zYH4zzPyj6BqjMcYoe1jN35ZjgnA6JhRRJOlZNCCYyySU7PwvJxm-jEbeb1AwSRhjchC9PoE369a061i1ZTz9UnWvut8yXlptVB3P1DckE9t2ztbxcuc7aOLKugDM-0a11pTxhy1sdxVdVKr2MDrGYbR6nq4m82TxPnuZPC4SnRLSJRVFUGEhNFEiLbHkHBhTpaBcc6wEJ0SnuNLAEBE4U5oVUJCKQVmWRSEyOozuD2u3zn724Lu8MV5DXasWbO9zzAjKOKNEBvT2H7qxvWvDcYFCAqcYURoofKC0s947qPKtM41yuxyjfK9vvtc33-ubH_UNM3fHzcprVVdOtdr40yCRabheosDdHDgDAKc2D8-i4H4AgU2BrQ</recordid><startdate>20140401</startdate><enddate>20140401</enddate><creator>Zaraki, Abolfazl</creator><creator>Mazzei, Daniele</creator><creator>Giuliani, Manuel</creator><creator>De Rossi, Danilo</creator><general>IEEE</general><general>Institute of Electrical and Electronics Engineers</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>IQODW</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7TB</scope><scope>8FD</scope><scope>FR3</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>F28</scope></search><sort><creationdate>20140401</creationdate><title>Designing and Evaluating a Social Gaze-Control System for a Humanoid Robot</title><author>Zaraki, Abolfazl ; Mazzei, Daniele ; Giuliani, Manuel ; De Rossi, Danilo</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c422t-f30ef177c2a74d1866e55ad736c61a7622c41fce502719ac5beb2f5edddbb793</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2014</creationdate><topic>Active vision</topic><topic>Applied sciences</topic><topic>Artificial intelligence</topic><topic>Biological and medical sciences</topic><topic>Computer science; control theory; systems</topic><topic>context-dependent social gaze behavior</topic><topic>Control systems</topic><topic>Control theory. Systems</topic><topic>Exact sciences and technology</topic><topic>Face</topic><topic>Face recognition</topic><topic>Feature extraction</topic><topic>Fundamental and applied biological sciences. Psychology</topic><topic>Human</topic><topic>human-robot interaction</topic><topic>Humanoid</topic><topic>Humanoid robots</topic><topic>Pattern recognition. Digital image processing. Computational geometry</topic><topic>Pilots</topic><topic>Psychology. Psychoanalysis. Psychiatry</topic><topic>Psychology. Psychophysiology</topic><topic>Robot kinematics</topic><topic>Robotics</topic><topic>Robots</topic><topic>Running</topic><topic>scene analysis</topic><topic>social attention</topic><topic>Social interactions. Communication. Group processes</topic><topic>Social psychology</topic><topic>Speech and sound recognition and synthesis. Linguistics</topic><topic>Speech recognition</topic><topic>Tracking</topic><topic>Visualization</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zaraki, Abolfazl</creatorcontrib><creatorcontrib>Mazzei, Daniele</creatorcontrib><creatorcontrib>Giuliani, Manuel</creatorcontrib><creatorcontrib>De Rossi, Danilo</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>Pascal-Francis</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Mechanical &amp; Transportation Engineering Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>ANTE: Abstracts in New Technology &amp; Engineering</collection><jtitle>IEEE transactions on human-machine systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zaraki, Abolfazl</au><au>Mazzei, Daniele</au><au>Giuliani, Manuel</au><au>De Rossi, Danilo</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Designing and Evaluating a Social Gaze-Control System for a Humanoid Robot</atitle><jtitle>IEEE transactions on human-machine systems</jtitle><stitle>THMS</stitle><date>2014-04-01</date><risdate>2014</risdate><volume>44</volume><issue>2</issue><spage>157</spage><epage>168</epage><pages>157-168</pages><issn>2168-2291</issn><eissn>2168-2305</eissn><coden>ITHSA6</coden><abstract>This paper describes a context-dependent social gaze-control system implemented as part of a humanoid social robot. The system enables the robot to direct its gaze at multiple humans who are interacting with each other and with the robot. The attention mechanism of the gaze-control system is based on features that have been proven to guide human attention: nonverbal and verbal cues, proxemics, the visual field of view, and the habituation effect. Our gaze-control system uses Kinect skeleton tracking together with speech recognition and SHORE-based facial expression recognition to implement the same features. As part of a pilot evaluation, we collected the gaze behavior of 11 participants in an eye-tracking study. We showed participants videos of two-person interactions and tracked their gaze behavior. A comparison of the human gaze behavior with the behavior of our gaze-control system running on the same videos shows that it replicated human gaze behavior 89% of the time.</abstract><cop>New York, NY</cop><pub>IEEE</pub><doi>10.1109/THMS.2014.2303083</doi><tpages>12</tpages></addata></record>
fulltext fulltext
identifier ISSN: 2168-2291
ispartof IEEE transactions on human-machine systems, 2014-04, Vol.44 (2), p.157-168
issn 2168-2291
2168-2305
language eng
recordid cdi_proquest_miscellaneous_1520965328
source IEEE Electronic Library (IEL) Journals
subjects Active vision
Applied sciences
Artificial intelligence
Biological and medical sciences
Computer science
control theory
systems
context-dependent social gaze behavior
Control systems
Control theory. Systems
Exact sciences and technology
Face
Face recognition
Feature extraction
Fundamental and applied biological sciences. Psychology
Human
human-robot interaction
Humanoid
Humanoid robots
Pattern recognition. Digital image processing. Computational geometry
Pilots
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Robot kinematics
Robotics
Robots
Running
scene analysis
social attention
Social interactions. Communication. Group processes
Social psychology
Speech and sound recognition and synthesis. Linguistics
Speech recognition
Tracking
Visualization
title Designing and Evaluating a Social Gaze-Control System for a Humanoid Robot
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-24T21%3A54%3A27IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Designing%20and%20Evaluating%20a%20Social%20Gaze-Control%20System%20for%20a%20Humanoid%20Robot&rft.jtitle=IEEE%20transactions%20on%20human-machine%20systems&rft.au=Zaraki,%20Abolfazl&rft.date=2014-04-01&rft.volume=44&rft.issue=2&rft.spage=157&rft.epage=168&rft.pages=157-168&rft.issn=2168-2291&rft.eissn=2168-2305&rft.coden=ITHSA6&rft_id=info:doi/10.1109/THMS.2014.2303083&rft_dat=%3Cproquest_cross%3E1520965328%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c422t-f30ef177c2a74d1866e55ad736c61a7622c41fce502719ac5beb2f5edddbb793%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=1507141033&rft_id=info:pmid/&rft_ieee_id=6736067&rfr_iscdi=true