Eyetracking for two-person tasks with manipulation of a virtual world

Eyetracking facilities are typically restricted to monitoring a single person viewing static images or prerecorded video. In the present article, we describe a system that makes it possible to study visual attention in coordination with other activity during joint action. The software links two eyet...

Full description

Saved in:
Bibliographic Details
Published in:Behavior research methods 2010-02, Vol.42 (1), p.254-265
Main Authors: Carletta, Jean, Hill, Robin L., Nicol, Craig, Taylor, Tim, de Ruiter, Jan Peter, Bard, Ellen Gurman
Format: Article
Language:English
Subjects:
Behavioral Science and Psychology
Cognitive Psychology
Data collection
Eye Movements - physiology
Fixation, Ocular
Humans
Problem solving
Psychology
Software
Studies
User-Computer Interface
Visual Perception
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Eyetracking facilities are typically restricted to monitoring a single person viewing static images or prerecorded video. In the present article, we describe a system that makes it possible to study visual attention in coordination with other activity during joint action. The software links two eyetracking systems in parallel and provides an on-screen task. By locating eye movements against dynamic screen regions, it permits automatic tracking of moving on-screen objects. Using existing SR technology, the system can also cross-project each participant’s eyetrack and mouse location onto the other’s on-screen work space. Keeping a complete record of eyetrack and on-screen events in the same format as subsequent human coding, the system permits the analysis of multiple modalities. The software offers new approaches to spontaneous multimodal communication: joint action and joint attention. These capacities are demonstrated using an experimental paradigm for cooperative on-screen assembly of a two-dimensional model. The software is available under an open source license.
ISSN:1554-351X
1554-3528
DOI:10.3758/BRM.42.1.254