Loading…

An Improved Microaneurysm Detection Model Based on SwinIR and YOLOv8

Diabetic retinopathy (DR) is a microvascular complication of diabetes. Microaneurysms (MAs) are often observed in the retinal vessels of diabetic patients and represent one of the earliest signs of DR. Accurate and efficient detection of MAs is crucial for the diagnosis of DR. In this study, an auto...

Full description

Saved in:
Bibliographic Details
Published in:Bioengineering (Basel) 2023-12, Vol.10 (12), p.1405
Main Authors: Zhang, Bowei, Li, Jing, Bai, Yun, Jiang, Qing, Yan, Biao, Wang, Zhenhua
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c520t-f5d4d305478b1b3c8cd5f6c1243c22513ebd26457b87667e12111cb88a1451653
cites cdi_FETCH-LOGICAL-c520t-f5d4d305478b1b3c8cd5f6c1243c22513ebd26457b87667e12111cb88a1451653
container_end_page
container_issue 12
container_start_page 1405
container_title Bioengineering (Basel)
container_volume 10
creator Zhang, Bowei
Li, Jing
Bai, Yun
Jiang, Qing
Yan, Biao
Wang, Zhenhua
description Diabetic retinopathy (DR) is a microvascular complication of diabetes. Microaneurysms (MAs) are often observed in the retinal vessels of diabetic patients and represent one of the earliest signs of DR. Accurate and efficient detection of MAs is crucial for the diagnosis of DR. In this study, an automatic model (MA-YOLO) is proposed for MA detection in fluorescein angiography (FFA) images. To obtain detailed features and improve the discriminability of MAs in FFA images, SwinIR was utilized to reconstruct super-resolution images. To solve the problems of missed detection of small features and feature information loss, an MA detection layer was added between the neck and the head sections of YOLOv8. To enhance the generalization ability of the MA-YOLO model, transfer learning was conducted between high-resolution images and low-resolution images. To avoid excessive penalization due to geometric factors and address sample distribution imbalance, the loss function was optimized by taking the Wise-IoU loss as a bounding box regression loss. The performance of the MA-YOLO model in MA detection was compared with that of other state-of-the-art models, including SSD, RetinaNet, YOLOv5, YOLOX, and YOLOv7. The results showed that the MA-YOLO model had the best performance in MA detection, as shown by its optimal metrics, including recall, precision, F1 score, and AP, which were 88.23%, 97.98%, 92.85%, and 94.62%, respectively. Collectively, the proposed MA-YOLO model is suitable for the automatic detection of MAs in FFA images, which can assist ophthalmologists in the diagnosis of the progression of DR.
doi_str_mv 10.3390/bioengineering10121405
format article
fullrecord <record><control><sourceid>gale_doaj_</sourceid><recordid>TN_cdi_doaj_primary_oai_doaj_org_article_8233ddabc87b480db0761c4494199836</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A777496528</galeid><doaj_id>oai_doaj_org_article_8233ddabc87b480db0761c4494199836</doaj_id><sourcerecordid>A777496528</sourcerecordid><originalsourceid>FETCH-LOGICAL-c520t-f5d4d305478b1b3c8cd5f6c1243c22513ebd26457b87667e12111cb88a1451653</originalsourceid><addsrcrecordid>eNptkktvEzEUhS0EolXpX6hGYsMmxe_HMrQFIqWKxGPByvJrIkczdrFnivrvcUgpLaq8sH31neN7dA3AGYLnhCj43sYc0jamEEpMWwQRRhSyF-AYE8gXjDD68tH5CJzWuoMQIoIZ5vQ1OCISEaYUPwaXy9StxpuSb4PvrqMr2aQwl7s6dpdhCm6KOXXX2Yeh-2BqY9r166-YVl86k3z3Y7Pe3Mo34FVvhhpO7_cT8P3j1beLz4v15tPqYrleOIbhtOiZp55ARoW0yBInnWc9dwhT4jBmiATrW39MWCk4F6HFQshZKQ2iDHFGTsDq4Ouz2embEkdT7nQ2Uf8p5LLVpkzRDUFLTIj3xjopLJXQWyg4cpQqipSShDevdwevlv3nHOqkx1hdGIaWP89VYwVZ6xoy0dC3_6G7PJfUku4pyjHFXP2jtqa9H1Ofp2Lc3lQvhRBUcYZlo86fodryYYwup9DHVn8i4AdBG02tJfQPuRHU-9-gn_8NTXh23_Vsx-AfZH9nT34Df9SuNw</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2904624269</pqid></control><display><type>article</type><title>An Improved Microaneurysm Detection Model Based on SwinIR and YOLOv8</title><source>Publicly Available Content Database</source><source>PubMed Central</source><creator>Zhang, Bowei ; Li, Jing ; Bai, Yun ; Jiang, Qing ; Yan, Biao ; Wang, Zhenhua</creator><creatorcontrib>Zhang, Bowei ; Li, Jing ; Bai, Yun ; Jiang, Qing ; Yan, Biao ; Wang, Zhenhua</creatorcontrib><description>Diabetic retinopathy (DR) is a microvascular complication of diabetes. Microaneurysms (MAs) are often observed in the retinal vessels of diabetic patients and represent one of the earliest signs of DR. Accurate and efficient detection of MAs is crucial for the diagnosis of DR. In this study, an automatic model (MA-YOLO) is proposed for MA detection in fluorescein angiography (FFA) images. To obtain detailed features and improve the discriminability of MAs in FFA images, SwinIR was utilized to reconstruct super-resolution images. To solve the problems of missed detection of small features and feature information loss, an MA detection layer was added between the neck and the head sections of YOLOv8. To enhance the generalization ability of the MA-YOLO model, transfer learning was conducted between high-resolution images and low-resolution images. To avoid excessive penalization due to geometric factors and address sample distribution imbalance, the loss function was optimized by taking the Wise-IoU loss as a bounding box regression loss. The performance of the MA-YOLO model in MA detection was compared with that of other state-of-the-art models, including SSD, RetinaNet, YOLOv5, YOLOX, and YOLOv7. The results showed that the MA-YOLO model had the best performance in MA detection, as shown by its optimal metrics, including recall, precision, F1 score, and AP, which were 88.23%, 97.98%, 92.85%, and 94.62%, respectively. Collectively, the proposed MA-YOLO model is suitable for the automatic detection of MAs in FFA images, which can assist ophthalmologists in the diagnosis of the progression of DR.</description><identifier>ISSN: 2306-5354</identifier><identifier>EISSN: 2306-5354</identifier><identifier>DOI: 10.3390/bioengineering10121405</identifier><identifier>PMID: 38135996</identifier><language>eng</language><publisher>Switzerland: MDPI AG</publisher><subject>Aneurysms ; Angiography ; Bioengineering ; Blood vessels ; Datasets ; Deep learning ; Design ; Diabetes mellitus ; Diabetic retinopathy ; Diagnosis ; Efficiency ; Health aspects ; Image reconstruction ; Image resolution ; Localization ; Machine learning ; Machine vision ; Medical imaging ; microaneurysm ; Microvasculature ; Neural networks ; Retinopathy ; Semantics ; SwinIR ; Transfer learning ; YOLOv8</subject><ispartof>Bioengineering (Basel), 2023-12, Vol.10 (12), p.1405</ispartof><rights>COPYRIGHT 2023 MDPI AG</rights><rights>2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c520t-f5d4d305478b1b3c8cd5f6c1243c22513ebd26457b87667e12111cb88a1451653</citedby><cites>FETCH-LOGICAL-c520t-f5d4d305478b1b3c8cd5f6c1243c22513ebd26457b87667e12111cb88a1451653</cites><orcidid>0000-0002-6603-2019</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/2904624269/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2904624269?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>314,777,781,25734,27905,27906,36993,36994,44571,74875</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/38135996$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Zhang, Bowei</creatorcontrib><creatorcontrib>Li, Jing</creatorcontrib><creatorcontrib>Bai, Yun</creatorcontrib><creatorcontrib>Jiang, Qing</creatorcontrib><creatorcontrib>Yan, Biao</creatorcontrib><creatorcontrib>Wang, Zhenhua</creatorcontrib><title>An Improved Microaneurysm Detection Model Based on SwinIR and YOLOv8</title><title>Bioengineering (Basel)</title><addtitle>Bioengineering (Basel)</addtitle><description>Diabetic retinopathy (DR) is a microvascular complication of diabetes. Microaneurysms (MAs) are often observed in the retinal vessels of diabetic patients and represent one of the earliest signs of DR. Accurate and efficient detection of MAs is crucial for the diagnosis of DR. In this study, an automatic model (MA-YOLO) is proposed for MA detection in fluorescein angiography (FFA) images. To obtain detailed features and improve the discriminability of MAs in FFA images, SwinIR was utilized to reconstruct super-resolution images. To solve the problems of missed detection of small features and feature information loss, an MA detection layer was added between the neck and the head sections of YOLOv8. To enhance the generalization ability of the MA-YOLO model, transfer learning was conducted between high-resolution images and low-resolution images. To avoid excessive penalization due to geometric factors and address sample distribution imbalance, the loss function was optimized by taking the Wise-IoU loss as a bounding box regression loss. The performance of the MA-YOLO model in MA detection was compared with that of other state-of-the-art models, including SSD, RetinaNet, YOLOv5, YOLOX, and YOLOv7. The results showed that the MA-YOLO model had the best performance in MA detection, as shown by its optimal metrics, including recall, precision, F1 score, and AP, which were 88.23%, 97.98%, 92.85%, and 94.62%, respectively. Collectively, the proposed MA-YOLO model is suitable for the automatic detection of MAs in FFA images, which can assist ophthalmologists in the diagnosis of the progression of DR.</description><subject>Aneurysms</subject><subject>Angiography</subject><subject>Bioengineering</subject><subject>Blood vessels</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Design</subject><subject>Diabetes mellitus</subject><subject>Diabetic retinopathy</subject><subject>Diagnosis</subject><subject>Efficiency</subject><subject>Health aspects</subject><subject>Image reconstruction</subject><subject>Image resolution</subject><subject>Localization</subject><subject>Machine learning</subject><subject>Machine vision</subject><subject>Medical imaging</subject><subject>microaneurysm</subject><subject>Microvasculature</subject><subject>Neural networks</subject><subject>Retinopathy</subject><subject>Semantics</subject><subject>SwinIR</subject><subject>Transfer learning</subject><subject>YOLOv8</subject><issn>2306-5354</issn><issn>2306-5354</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><sourceid>DOA</sourceid><recordid>eNptkktvEzEUhS0EolXpX6hGYsMmxe_HMrQFIqWKxGPByvJrIkczdrFnivrvcUgpLaq8sH31neN7dA3AGYLnhCj43sYc0jamEEpMWwQRRhSyF-AYE8gXjDD68tH5CJzWuoMQIoIZ5vQ1OCISEaYUPwaXy9StxpuSb4PvrqMr2aQwl7s6dpdhCm6KOXXX2Yeh-2BqY9r166-YVl86k3z3Y7Pe3Mo34FVvhhpO7_cT8P3j1beLz4v15tPqYrleOIbhtOiZp55ARoW0yBInnWc9dwhT4jBmiATrW39MWCk4F6HFQshZKQ2iDHFGTsDq4Ouz2embEkdT7nQ2Uf8p5LLVpkzRDUFLTIj3xjopLJXQWyg4cpQqipSShDevdwevlv3nHOqkx1hdGIaWP89VYwVZ6xoy0dC3_6G7PJfUku4pyjHFXP2jtqa9H1Ofp2Lc3lQvhRBUcYZlo86fodryYYwup9DHVn8i4AdBG02tJfQPuRHU-9-gn_8NTXh23_Vsx-AfZH9nT34Df9SuNw</recordid><startdate>20231201</startdate><enddate>20231201</enddate><creator>Zhang, Bowei</creator><creator>Li, Jing</creator><creator>Bai, Yun</creator><creator>Jiang, Qing</creator><creator>Yan, Biao</creator><creator>Wang, Zhenhua</creator><general>MDPI AG</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>8FE</scope><scope>8FG</scope><scope>8FH</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>BHPHI</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>LK8</scope><scope>M7P</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PTHSS</scope><scope>7X8</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-6603-2019</orcidid></search><sort><creationdate>20231201</creationdate><title>An Improved Microaneurysm Detection Model Based on SwinIR and YOLOv8</title><author>Zhang, Bowei ; Li, Jing ; Bai, Yun ; Jiang, Qing ; Yan, Biao ; Wang, Zhenhua</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c520t-f5d4d305478b1b3c8cd5f6c1243c22513ebd26457b87667e12111cb88a1451653</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Aneurysms</topic><topic>Angiography</topic><topic>Bioengineering</topic><topic>Blood vessels</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Design</topic><topic>Diabetes mellitus</topic><topic>Diabetic retinopathy</topic><topic>Diagnosis</topic><topic>Efficiency</topic><topic>Health aspects</topic><topic>Image reconstruction</topic><topic>Image resolution</topic><topic>Localization</topic><topic>Machine learning</topic><topic>Machine vision</topic><topic>Medical imaging</topic><topic>microaneurysm</topic><topic>Microvasculature</topic><topic>Neural networks</topic><topic>Retinopathy</topic><topic>Semantics</topic><topic>SwinIR</topic><topic>Transfer learning</topic><topic>YOLOv8</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhang, Bowei</creatorcontrib><creatorcontrib>Li, Jing</creatorcontrib><creatorcontrib>Bai, Yun</creatorcontrib><creatorcontrib>Jiang, Qing</creatorcontrib><creatorcontrib>Yan, Biao</creatorcontrib><creatorcontrib>Wang, Zhenhua</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>Natural Science Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>ProQuest Biological Science Collection</collection><collection>Biological Science Database</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>Engineering Collection</collection><collection>MEDLINE - Academic</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>Bioengineering (Basel)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhang, Bowei</au><au>Li, Jing</au><au>Bai, Yun</au><au>Jiang, Qing</au><au>Yan, Biao</au><au>Wang, Zhenhua</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>An Improved Microaneurysm Detection Model Based on SwinIR and YOLOv8</atitle><jtitle>Bioengineering (Basel)</jtitle><addtitle>Bioengineering (Basel)</addtitle><date>2023-12-01</date><risdate>2023</risdate><volume>10</volume><issue>12</issue><spage>1405</spage><pages>1405-</pages><issn>2306-5354</issn><eissn>2306-5354</eissn><abstract>Diabetic retinopathy (DR) is a microvascular complication of diabetes. Microaneurysms (MAs) are often observed in the retinal vessels of diabetic patients and represent one of the earliest signs of DR. Accurate and efficient detection of MAs is crucial for the diagnosis of DR. In this study, an automatic model (MA-YOLO) is proposed for MA detection in fluorescein angiography (FFA) images. To obtain detailed features and improve the discriminability of MAs in FFA images, SwinIR was utilized to reconstruct super-resolution images. To solve the problems of missed detection of small features and feature information loss, an MA detection layer was added between the neck and the head sections of YOLOv8. To enhance the generalization ability of the MA-YOLO model, transfer learning was conducted between high-resolution images and low-resolution images. To avoid excessive penalization due to geometric factors and address sample distribution imbalance, the loss function was optimized by taking the Wise-IoU loss as a bounding box regression loss. The performance of the MA-YOLO model in MA detection was compared with that of other state-of-the-art models, including SSD, RetinaNet, YOLOv5, YOLOX, and YOLOv7. The results showed that the MA-YOLO model had the best performance in MA detection, as shown by its optimal metrics, including recall, precision, F1 score, and AP, which were 88.23%, 97.98%, 92.85%, and 94.62%, respectively. Collectively, the proposed MA-YOLO model is suitable for the automatic detection of MAs in FFA images, which can assist ophthalmologists in the diagnosis of the progression of DR.</abstract><cop>Switzerland</cop><pub>MDPI AG</pub><pmid>38135996</pmid><doi>10.3390/bioengineering10121405</doi><orcidid>https://orcid.org/0000-0002-6603-2019</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2306-5354
ispartof Bioengineering (Basel), 2023-12, Vol.10 (12), p.1405
issn 2306-5354
2306-5354
language eng
recordid cdi_doaj_primary_oai_doaj_org_article_8233ddabc87b480db0761c4494199836
source Publicly Available Content Database; PubMed Central
subjects Aneurysms
Angiography
Bioengineering
Blood vessels
Datasets
Deep learning
Design
Diabetes mellitus
Diabetic retinopathy
Diagnosis
Efficiency
Health aspects
Image reconstruction
Image resolution
Localization
Machine learning
Machine vision
Medical imaging
microaneurysm
Microvasculature
Neural networks
Retinopathy
Semantics
SwinIR
Transfer learning
YOLOv8
title An Improved Microaneurysm Detection Model Based on SwinIR and YOLOv8
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-19T16%3A02%3A01IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_doaj_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=An%20Improved%20Microaneurysm%20Detection%20Model%20Based%20on%20SwinIR%20and%20YOLOv8&rft.jtitle=Bioengineering%20(Basel)&rft.au=Zhang,%20Bowei&rft.date=2023-12-01&rft.volume=10&rft.issue=12&rft.spage=1405&rft.pages=1405-&rft.issn=2306-5354&rft.eissn=2306-5354&rft_id=info:doi/10.3390/bioengineering10121405&rft_dat=%3Cgale_doaj_%3EA777496528%3C/gale_doaj_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c520t-f5d4d305478b1b3c8cd5f6c1243c22513ebd26457b87667e12111cb88a1451653%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2904624269&rft_id=info:pmid/38135996&rft_galeid=A777496528&rfr_iscdi=true