Virtual Resection Specimen Interaction Using Augmented Reality Holograms to Guide Margin Communication and Flap Sizing

Head and neck surgeons often have difficulty in relocating sites of positive margins due to the complex 3‐dimensional (3D) anatomy of the head and neck. We introduce a new technique where resection specimens are 3D scanned with a smartphone, annotated in computer‐assisted design software, and immedi...

Full description

Saved in:
Bibliographic Details
Published in:Otolaryngology-head and neck surgery 2023-10, Vol.169 (4), p.1083-1085
Main Authors: Necker, Fabian N., Chang, Marcello, Leuze, Christoph, Topf, Michael C., Daniel, Bruce L., Baik, Fred M.
Format: Article
Language:English
Subjects:
3D scanning
Augmented Reality
computer‐aided surgery
computer‐guided surgical planning
digital anatomy
digital pathology
Head
head‐neck cancer
head‐neck surgery
HoloLens
Humans
Image Processing, Computer-Assisted
Imaging, Three-Dimensional
microvascular reconstruction
Software
Surgery, Computer-Assisted - methods
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Head and neck surgeons often have difficulty in relocating sites of positive margins due to the complex 3‐dimensional (3D) anatomy of the head and neck. We introduce a new technique where resection specimens are 3D scanned with a smartphone, annotated in computer‐assisted design software, and immediately visualized on augmented reality (AR) glasses. The 3D virtual specimen can be accurately superimposed onto surgical sites for orientation and sizing applications. During an operative workshop, a surgeon using AR glasses projected virtual, annotated specimen models back into the resection bed onto a cadaver within approximately 10 minutes. Colored annotations can correspond with pathologic annotations and guide the orientation of the virtual 3D specimen. The model was also overlayed onto a flap harvest site to aid in reconstructive planning. We present a new technique allowing interactive, sterile inspection of tissue specimens in AR that could facilitate communication among surgeons and pathologists and assist with reconstructive surgery.
ISSN:0194-5998
1097-6817
DOI:10.1002/ohn.325