Adaptive Tensor-Based Feature Extraction for Pupil Segmentation in Cataract Surgery

• Published in: IEEE journal of biomedical and health informatics 2024-03, Vol.28 (3), p.1599-1610
• Main Authors: Giap, Binh Duong, Srinivasan, Karthik, Mahmoud, Ossama, Mian, Shahzad I., Tannen, Bradford L., Nallasamy, Nambi
• Format: Article
• Language: English
• Subjects: Accuracy; Cataract - diagnostic imaging; Cataract Extraction - methods; Cataract surgery; Cataracts; Datasets; Deep learning; Eye surgery; Feature extraction; Humans; Image Processing, Computer-Assisted; Lenses; Performance assessment; Pupil; pupil segmentation; Pupils; Recognition; Risk factors; Segmentation; Singular value decomposition; Spatial data; Statistical analysis; Surgery; Surgical instruments; Surgical outcomes; tensor; Tensors; wavelet transform
• ISSN: 2168-2194; 2168-2208; 2168-2208
• DOI: 10.1109/JBHI.2023.3345837

Cataract surgery remains the only definitive treatment for visually significant cataracts, which are a major cause of preventable blindness worldwide. Successful performance of cataract surgery relies on stable dilation of the pupil. Automated pupil segmentation from surgical videos can assist surgeons in detecting risk factors for pupillary instability prior to the development of surgical complications. However, surgical illumination variations, surgical instrument obstruction, and lens material hydration during cataract surgery can limit pupil segmentation accuracy. To address these problems, we propose a novel method named adaptive wavelet tensor feature extraction (AWTFE). AWTFE is designed to enhance the accuracy of deep learning-powered pupil recognition systems. First, we represent the correlations among spatial information, color channels, and wavelet subbands by constructing a third-order tensor. We then utilize higher-order singular value decomposition to eliminate redundant information adaptively and estimate pupil feature information. We evaluated the proposed method by conducting experiments with state-of-the-art deep learning segmentation models on our BigCat dataset consisting of 5,700 annotated intraoperative images from 190 cataract surgeries and a public CaDIS dataset. The experimental results reveal that the AWTFE method effectively identifies features relevant to the pupil region and improved the overall performance of segmentation models by up to 2.26% (BigCat) and 3.31% (CaDIS). Incorporation of the AWTFE method led to statistically significant improvements in segmentation performance (P