Hand-gesture-based sterile interface for the operating room using contextual cues for the navigation of radiological images

This paper presents a method to improve the navigation and manipulation of radiological images through a sterile hand gesture recognition interface based on attentional contextual cues. Computer vision algorithms were developed to extract intention and attention cues from the surgeon's behavior...

Full description

Saved in:
Bibliographic Details
Published in:Journal of the American Medical Informatics Association : JAMIA 2013-06, Vol.20 (e1), p.e183-e186
Main Authors: Jacob, Mithun George, Wachs, Juan Pablo, Packer, Rebecca A
Format: Article
Language:English
Subjects:
Adolescent
Adult
Algorithms
Brief Communication
Computers
Cues
Equipment Contamination - prevention & control
Female
Gestures
Hand
Humans
Male
Operating Room Information Systems
Operating Rooms
Radiology Information Systems
Sterilization
User-Computer Interface
Young Adult
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper presents a method to improve the navigation and manipulation of radiological images through a sterile hand gesture recognition interface based on attentional contextual cues. Computer vision algorithms were developed to extract intention and attention cues from the surgeon's behavior and combine them with sensory data from a commodity depth camera. The developed interface was tested in a usability experiment to assess the effectiveness of the new interface. An image navigation and manipulation task was performed, and the gesture recognition accuracy, false positives and task completion times were computed to evaluate system performance. Experimental results show that gesture interaction and surgeon behavior analysis can be used to accurately navigate, manipulate and access MRI images, and therefore this modality could replace the use of keyboard and mice-based interfaces.
ISSN:1067-5027
1527-974X
DOI:10.1136/amiajnl-2012-001212