Navigation of 3D brain MRI images during surgery using hand gestures

Since the 1980s, gestures have been assessed to facilitate easy, convenient, and seamless interaction in interfaces between humans and computers. Today surgical procedures require the viewing of medical images. Manipulating these images is complex. Touchless hand gestures provide an excellent soluti...

Full description

Saved in:
Bibliographic Details
Main Authors: Shah, Sanket, Shah, Saakshi, Uppoor, Sakshi, Desai, Amogh, Kanani, Pratik
Format: Conference Proceeding
Language:English
Subjects:
Gesture recognition
Human-computer interface
Image enhancement
Image manipulation
Machine learning
Medical imaging
Surgeons
Surgery
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Since the 1980s, gestures have been assessed to facilitate easy, convenient, and seamless interaction in interfaces between humans and computers. Today surgical procedures require the viewing of medical images. Manipulating these images is complex. Touchless hand gestures provide an excellent solution to reduce the risk of infection and contamination and reduce the time taken during surgery. This work proposes using a 21-point landmark hand gesture recognition to manipulate 3D images performing scaling and slicing across the three planes - axial, coronal, and sagittal. After conducting extensive domain research, the system has been built to assess the requirements of an ideal approach and the drawbacks and shortcomings of previously built systems. Human-Computer Interaction and Machine Learning have been extensively employed to make the application usable and intuitive. The system shall aid doctors, surgeons, and support staff to view images and perform image transformations on them with ease in an aseptic environment driving far lesser complications, mistakes, delays while enhancing a doctor/surgeon’s ability to decipher medical images.
ISSN:0094-243X
1551-7616
DOI:10.1063/5.0160362