Virtual Shadow Drawing System Using Augmented Reality for Laparoscopic Surgery

Laparoscopic surgery holds great promise in medicine but remains challenging for surgeons because it is difficult to perceive depth while suturing. In addition to binocular parallax, such as three-dimensional vision, shadow is essential for depth perception. This paper presents an augmented reality...

Full description

Saved in:
Bibliographic Details
Published in:Advanced Biomedical Engineering 2022, Vol.11, pp.87-97
Main Authors: Miura, Satoshi, Seki, Masaki, Koreeda, Yuta, Cao, Yang, Kawamura, Kazuya, Kobayashi, Yo, Fujie, Masakatsu G., Miyashita, Tomoyuki
Format: Article
Language:English
Subjects:
Augmented reality
Binocular vision
biomedical engineering
Depth perception
Image processing
Laparoscopy
Medical instruments
medical robotics
Parallax
Shadows
Space perception
Surgeons
Surgery
surgical instrument
Sutures
Virtual reality
Visual perception
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Laparoscopic surgery holds great promise in medicine but remains challenging for surgeons because it is difficult to perceive depth while suturing. In addition to binocular parallax, such as three-dimensional vision, shadow is essential for depth perception. This paper presents an augmented reality system that draws virtual shadows to aid depth perception. On the visual display, the system generates shadows that mimic actual shadows by estimating shadow positions using image processing. The distance and angle between the forceps tip and the surface were estimated to evaluate the accuracy of the system. To validate the usefulness of this system in surgical applications, novices performed suturing tasks with and without the augmented reality system. The system error and delay were sufficiently small, and the generated shadows were similar to actual shadows. Furthermore, the suturing error decreased significantly when the augmented reality system was used. The shadow-drawing system developed in this study may help surgeons perceive depth during laparoscopic surgery.
ISSN:2187-5219
2187-5219
DOI:10.14326/abe.11.87