Evaluation of a Hybrid of Hand Gesture and Controller Inputs in Virtual Reality

Controller and hand gesture recognition are both common input mechanisms in immersive environments. We evaluate the effect of combining them as a hybrid input to perform game-like tasks. To explore the possible design space, three tests were conducted sequentially. First, a design study was conducte...

Full description

Saved in:
Bibliographic Details
Published in:International journal of human-computer interaction 2021-01, Vol.ahead-of-print (ahead-of-print), p.1-12
Main Authors: Huang, Yi-Jheng, Liu, Kang-Yi, Lee, Suiang-Shyan, Yeh, I-Cheng
Format: Article
Language:English
Subjects:
Controllers
Evaluation
Gesture recognition
Virtual reality
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Controller and hand gesture recognition are both common input mechanisms in immersive environments. We evaluate the effect of combining them as a hybrid input to perform game-like tasks. To explore the possible design space, three tests were conducted sequentially. First, a design study was conducted to investigate which of the tasks were most likely to be performed with hybrid inputs. Next, we implemented the four highest-ranked tasks and invited 22 participants to perform these tasks with different input combinations. From examining execution times and reviewing feedback from participants, we provide observations and discussions concerning the usage of a hybrid input. A follow-up experiment was designed to refine these observations. The results indicate that task execution using hybrid inputs is as efficient as bimanual controllers when assigning actions to the appropriate input. Finally, a few guidelines are provided suggesting how to consider possible scenarios for this hybrid input.
ISSN:1044-7318
1532-7590
1044-7318
DOI:10.1080/10447318.2020.1809248