A neural network based framework for effective laparoscopic video quality assessment

Video quality assessment is a challenging problem having a critical significance in the context of medical imaging. For instance, in laparoscopic surgery, the acquired video data suffers from different kinds of distortion that not only hinder surgery performance but also affect the execution of subs...

Full description

Saved in:
Bibliographic Details
Published in:Computerized medical imaging and graphics 2022-10, Vol.101, p.102121-102121, Article 102121
Main Authors: Khan, Zohaib Amjad, Beghdadi, Azeddine, Kaaniche, Mounir, Alaya-Cheikh, Faouzi, Gharbi, Osama
Format: Article
Language:English
Subjects:
Databases, Factual
Diagnostic Imaging
Distortion classification
End-to-end learning
Engineering Sciences
Fully connected neural network
Laparoscopy
Neural Networks, Computer
Quality prediction
Residual networks
Robotic Surgical Procedures
Video guided surgery
Video quality assessment
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Video quality assessment is a challenging problem having a critical significance in the context of medical imaging. For instance, in laparoscopic surgery, the acquired video data suffers from different kinds of distortion that not only hinder surgery performance but also affect the execution of subsequent tasks in surgical navigation and robotic surgeries. For this reason, we propose in this paper neural network-based approaches for distortion classification as well as quality prediction. More precisely, a Residual Network (ResNet) based approach is firstly developed for simultaneous ranking and classification task. Then, this architecture is extended to make it appropriate for the quality prediction task by using an additional Fully Connected Neural Network (FCNN). To train the overall architecture (ResNet and FCNN models), transfer learning and end-to-end learning approaches are investigated. Experimental results, carried out on a new laparoscopic video quality database, have shown the efficiency of the proposed methods compared to recent conventional and deep learning based approaches. •A new blind quality assessment method for laparoscopic videos using neural networks.•Simultaneous score and distortion prediction unlike existing NN VQA methods.•A novel and effective temporal aggregation based on Fully Connected Neural Network.•The proposed method with an end-to-end learning outperforms state-of-the-art methods.
ISSN:0895-6111
1879-0771
DOI:10.1016/j.compmedimag.2022.102121