Virtual annotations of the surgical field through an augmented reality transparent display

Existing telestrator-based surgical telementoring systems require a trainee surgeon to shift focus frequently between the operating field and a nearby monitor to acquire and apply instructions from a remote mentor. We present a novel approach to surgical telementoring where annotations are superimpo...

Full description

Saved in:
Bibliographic Details
Published in:The Visual computer 2016-11, Vol.32 (11), p.1481-1498
Main Authors: Andersen, Daniel, Popescu, Voicu, Cabrera, Maria Eugenia, Shanghavi, Aditya, Gomez, Gerardo, Marley, Sherri, Mullis, Brian, Wachs, Juan
Format: Article
Language:English
Subjects:
Annotations
Artificial Intelligence
Augmented reality
Cameras
Computer Graphics
Computer Science
Image Processing and Computer Vision
Laparoscopy
Medical research
Original Article
Surgeons
Surgery
Tablets
Telemedicine
User interface
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Existing telestrator-based surgical telementoring systems require a trainee surgeon to shift focus frequently between the operating field and a nearby monitor to acquire and apply instructions from a remote mentor. We present a novel approach to surgical telementoring where annotations are superimposed directly onto the surgical field using an augmented reality (AR) simulated transparent display. We present our first steps towards realizing this vision, using two networked conventional tablets to allow a mentor to remotely annotate the operating field as seen by a trainee. Annotations are anchored to the surgical field as the trainee tablet moves and as the surgical field deforms or becomes occluded. The system is built exclusively from compact commodity-level components—all imaging and processing are performed on the two tablets.
ISSN:0178-2789
1432-2315
DOI:10.1007/s00371-015-1135-6