Classification of Diabetic Retinopathy Based on Efficient Computational Modeling

Convolutional neural networks (CNN) and Vision Transformers (ViT) have long been the main backbone networks for visual classification in the field of deep learning. Although ViT has recently received more attention than CNN due to its excellent fitting ability, their scalability is largely limited b...

Full description

Saved in:
Bibliographic Details
Published in:Applied sciences 2024-12, Vol.14 (23), p.11327
Main Authors: Xue, Jiao, Wu, Jianyu, Bian, Yingxu, Zhang, Shiyan, Du, Qinsheng
Format: Article
Language:English
Subjects:
Accuracy
Analysis
Architectural design
Artificial intelligence
attention mechanism
Blindness
Blood vessels
Classification
classification of diabetic retinopathy
Computational linguistics
Computer simulation
Computer vision
Computer-generated environments
Deep learning
Diabetes
Diabetic retinopathy
Efficiency
Language
Language processing
Machine learning
Natural language interfaces
Natural language processing
Neural networks
Support vector machines
Telecommunication systems
Visual impairment
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Convolutional neural networks (CNN) and Vision Transformers (ViT) have long been the main backbone networks for visual classification in the field of deep learning. Although ViT has recently received more attention than CNN due to its excellent fitting ability, their scalability is largely limited by the quadratic complexity of attention computation. For the determination of diabetic retinopathy, the fundus lesions as well as the width, angle, and branching pattern of retinal blood vessels are characterized, inspired by the ability of Mamba and VMamba to efficiently model long sequences, VMamba-m is proposed in this paper. This is a generalized visual skeleton model designed to reduce computational complexity to linear while retaining the advantageous features of ViTs. By modifying the cross-entropy loss function, we enhance the model’s attention to rare categories, especially in large-scale multi-category classification tasks. In order to enhance the adaptability of the VMamba-m model in processing visual data, we introduce the se channel attention mechanism, which enables the model to learn features in the channel dimension and form the importance of each channel. Finally, different weights are assigned to each channel through the incentive part. In addition to this, this paper further improves the implementation details and architectural design by introducing a novel attention mechanism implemented based on the local windowing method, which aims to optimize the model’s ability in processing long sequence data to enhance the performance of VMamba-m and improve its inference speed. Extensive experimental results show that VMamba-m performs well in the retinopathy V classification task, and it has significant advantages in terms of accuracy and computation time over existing benchmark models.
ISSN:2076-3417
2076-3417
DOI:10.3390/app142311327