Gaze-to-Object Mapping during Visual Search in 3D Virtual Environments

Stimuli obtained from highly dynamic 3D virtual environments and synchronous eye-tracking data are commonly used by algorithms that strive to correlate gaze to scene objects, a process referred to as gaze-to-object mapping (GTOM) . We propose to address this problem with a probabilistic approach usi...

Full description

Saved in:
Bibliographic Details
Published in:ACM transactions on applied perception 2014-10, Vol.11 (3), p.1-17
Main Authors: Bernhard, Matthias, Stavrakis, Efstathios, Hecher, Michael, Wimmer, Michael
Format: Article
Language:English
Subjects:
Dynamics
Inference
Mapping
Probability density functions
Searching
Three dimensional
Virtual environments
Visual
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Stimuli obtained from highly dynamic 3D virtual environments and synchronous eye-tracking data are commonly used by algorithms that strive to correlate gaze to scene objects, a process referred to as gaze-to-object mapping (GTOM) . We propose to address this problem with a probabilistic approach using Bayesian inference. The desired result of the inference is a predicted probability density function (PDF) specifying for each object in the scene a probability to be attended by the user. To evaluate the quality of a predicted attention PDF, we present a methodology to assess the information value (i.e., likelihood) in the predictions of different approaches that can be used to infer object attention. To this end, we propose an experiment based on a visual search task, which allows us to determine the object of attention at a certain point in time under controlled conditions. We perform this experiment with a wide range of static and dynamic visual scenes to obtain a ground-truth evaluation dataset, allowing us to assess GTOM techniques in a set of 30 particularly challenging cases.
ISSN:1544-3558
1544-3965
DOI:10.1145/2644812