Loading…
An Improved Microaneurysm Detection Model Based on SwinIR and YOLOv8
Diabetic retinopathy (DR) is a microvascular complication of diabetes. Microaneurysms (MAs) are often observed in the retinal vessels of diabetic patients and represent one of the earliest signs of DR. Accurate and efficient detection of MAs is crucial for the diagnosis of DR. In this study, an auto...
Saved in:
Published in: | Bioengineering (Basel) 2023-12, Vol.10 (12), p.1405 |
---|---|
Main Authors: | , , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c520t-f5d4d305478b1b3c8cd5f6c1243c22513ebd26457b87667e12111cb88a1451653 |
---|---|
cites | cdi_FETCH-LOGICAL-c520t-f5d4d305478b1b3c8cd5f6c1243c22513ebd26457b87667e12111cb88a1451653 |
container_end_page | |
container_issue | 12 |
container_start_page | 1405 |
container_title | Bioengineering (Basel) |
container_volume | 10 |
creator | Zhang, Bowei Li, Jing Bai, Yun Jiang, Qing Yan, Biao Wang, Zhenhua |
description | Diabetic retinopathy (DR) is a microvascular complication of diabetes. Microaneurysms (MAs) are often observed in the retinal vessels of diabetic patients and represent one of the earliest signs of DR. Accurate and efficient detection of MAs is crucial for the diagnosis of DR. In this study, an automatic model (MA-YOLO) is proposed for MA detection in fluorescein angiography (FFA) images. To obtain detailed features and improve the discriminability of MAs in FFA images, SwinIR was utilized to reconstruct super-resolution images. To solve the problems of missed detection of small features and feature information loss, an MA detection layer was added between the neck and the head sections of YOLOv8. To enhance the generalization ability of the MA-YOLO model, transfer learning was conducted between high-resolution images and low-resolution images. To avoid excessive penalization due to geometric factors and address sample distribution imbalance, the loss function was optimized by taking the Wise-IoU loss as a bounding box regression loss. The performance of the MA-YOLO model in MA detection was compared with that of other state-of-the-art models, including SSD, RetinaNet, YOLOv5, YOLOX, and YOLOv7. The results showed that the MA-YOLO model had the best performance in MA detection, as shown by its optimal metrics, including recall, precision, F1 score, and AP, which were 88.23%, 97.98%, 92.85%, and 94.62%, respectively. Collectively, the proposed MA-YOLO model is suitable for the automatic detection of MAs in FFA images, which can assist ophthalmologists in the diagnosis of the progression of DR. |
doi_str_mv | 10.3390/bioengineering10121405 |
format | article |
fullrecord | <record><control><sourceid>gale_doaj_</sourceid><recordid>TN_cdi_doaj_primary_oai_doaj_org_article_8233ddabc87b480db0761c4494199836</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A777496528</galeid><doaj_id>oai_doaj_org_article_8233ddabc87b480db0761c4494199836</doaj_id><sourcerecordid>A777496528</sourcerecordid><originalsourceid>FETCH-LOGICAL-c520t-f5d4d305478b1b3c8cd5f6c1243c22513ebd26457b87667e12111cb88a1451653</originalsourceid><addsrcrecordid>eNptkktvEzEUhS0EolXpX6hGYsMmxe_HMrQFIqWKxGPByvJrIkczdrFnivrvcUgpLaq8sH31neN7dA3AGYLnhCj43sYc0jamEEpMWwQRRhSyF-AYE8gXjDD68tH5CJzWuoMQIoIZ5vQ1OCISEaYUPwaXy9StxpuSb4PvrqMr2aQwl7s6dpdhCm6KOXXX2Yeh-2BqY9r166-YVl86k3z3Y7Pe3Mo34FVvhhpO7_cT8P3j1beLz4v15tPqYrleOIbhtOiZp55ARoW0yBInnWc9dwhT4jBmiATrW39MWCk4F6HFQshZKQ2iDHFGTsDq4Ouz2embEkdT7nQ2Uf8p5LLVpkzRDUFLTIj3xjopLJXQWyg4cpQqipSShDevdwevlv3nHOqkx1hdGIaWP89VYwVZ6xoy0dC3_6G7PJfUku4pyjHFXP2jtqa9H1Ofp2Lc3lQvhRBUcYZlo86fodryYYwup9DHVn8i4AdBG02tJfQPuRHU-9-gn_8NTXh23_Vsx-AfZH9nT34Df9SuNw</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2904624269</pqid></control><display><type>article</type><title>An Improved Microaneurysm Detection Model Based on SwinIR and YOLOv8</title><source>Publicly Available Content Database</source><source>PubMed Central</source><creator>Zhang, Bowei ; Li, Jing ; Bai, Yun ; Jiang, Qing ; Yan, Biao ; Wang, Zhenhua</creator><creatorcontrib>Zhang, Bowei ; Li, Jing ; Bai, Yun ; Jiang, Qing ; Yan, Biao ; Wang, Zhenhua</creatorcontrib><description>Diabetic retinopathy (DR) is a microvascular complication of diabetes. Microaneurysms (MAs) are often observed in the retinal vessels of diabetic patients and represent one of the earliest signs of DR. Accurate and efficient detection of MAs is crucial for the diagnosis of DR. In this study, an automatic model (MA-YOLO) is proposed for MA detection in fluorescein angiography (FFA) images. To obtain detailed features and improve the discriminability of MAs in FFA images, SwinIR was utilized to reconstruct super-resolution images. To solve the problems of missed detection of small features and feature information loss, an MA detection layer was added between the neck and the head sections of YOLOv8. To enhance the generalization ability of the MA-YOLO model, transfer learning was conducted between high-resolution images and low-resolution images. To avoid excessive penalization due to geometric factors and address sample distribution imbalance, the loss function was optimized by taking the Wise-IoU loss as a bounding box regression loss. The performance of the MA-YOLO model in MA detection was compared with that of other state-of-the-art models, including SSD, RetinaNet, YOLOv5, YOLOX, and YOLOv7. The results showed that the MA-YOLO model had the best performance in MA detection, as shown by its optimal metrics, including recall, precision, F1 score, and AP, which were 88.23%, 97.98%, 92.85%, and 94.62%, respectively. Collectively, the proposed MA-YOLO model is suitable for the automatic detection of MAs in FFA images, which can assist ophthalmologists in the diagnosis of the progression of DR.</description><identifier>ISSN: 2306-5354</identifier><identifier>EISSN: 2306-5354</identifier><identifier>DOI: 10.3390/bioengineering10121405</identifier><identifier>PMID: 38135996</identifier><language>eng</language><publisher>Switzerland: MDPI AG</publisher><subject>Aneurysms ; Angiography ; Bioengineering ; Blood vessels ; Datasets ; Deep learning ; Design ; Diabetes mellitus ; Diabetic retinopathy ; Diagnosis ; Efficiency ; Health aspects ; Image reconstruction ; Image resolution ; Localization ; Machine learning ; Machine vision ; Medical imaging ; microaneurysm ; Microvasculature ; Neural networks ; Retinopathy ; Semantics ; SwinIR ; Transfer learning ; YOLOv8</subject><ispartof>Bioengineering (Basel), 2023-12, Vol.10 (12), p.1405</ispartof><rights>COPYRIGHT 2023 MDPI AG</rights><rights>2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c520t-f5d4d305478b1b3c8cd5f6c1243c22513ebd26457b87667e12111cb88a1451653</citedby><cites>FETCH-LOGICAL-c520t-f5d4d305478b1b3c8cd5f6c1243c22513ebd26457b87667e12111cb88a1451653</cites><orcidid>0000-0002-6603-2019</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/2904624269/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2904624269?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>314,777,781,25734,27905,27906,36993,36994,44571,74875</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/38135996$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Zhang, Bowei</creatorcontrib><creatorcontrib>Li, Jing</creatorcontrib><creatorcontrib>Bai, Yun</creatorcontrib><creatorcontrib>Jiang, Qing</creatorcontrib><creatorcontrib>Yan, Biao</creatorcontrib><creatorcontrib>Wang, Zhenhua</creatorcontrib><title>An Improved Microaneurysm Detection Model Based on SwinIR and YOLOv8</title><title>Bioengineering (Basel)</title><addtitle>Bioengineering (Basel)</addtitle><description>Diabetic retinopathy (DR) is a microvascular complication of diabetes. Microaneurysms (MAs) are often observed in the retinal vessels of diabetic patients and represent one of the earliest signs of DR. Accurate and efficient detection of MAs is crucial for the diagnosis of DR. In this study, an automatic model (MA-YOLO) is proposed for MA detection in fluorescein angiography (FFA) images. To obtain detailed features and improve the discriminability of MAs in FFA images, SwinIR was utilized to reconstruct super-resolution images. To solve the problems of missed detection of small features and feature information loss, an MA detection layer was added between the neck and the head sections of YOLOv8. To enhance the generalization ability of the MA-YOLO model, transfer learning was conducted between high-resolution images and low-resolution images. To avoid excessive penalization due to geometric factors and address sample distribution imbalance, the loss function was optimized by taking the Wise-IoU loss as a bounding box regression loss. The performance of the MA-YOLO model in MA detection was compared with that of other state-of-the-art models, including SSD, RetinaNet, YOLOv5, YOLOX, and YOLOv7. The results showed that the MA-YOLO model had the best performance in MA detection, as shown by its optimal metrics, including recall, precision, F1 score, and AP, which were 88.23%, 97.98%, 92.85%, and 94.62%, respectively. Collectively, the proposed MA-YOLO model is suitable for the automatic detection of MAs in FFA images, which can assist ophthalmologists in the diagnosis of the progression of DR.</description><subject>Aneurysms</subject><subject>Angiography</subject><subject>Bioengineering</subject><subject>Blood vessels</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Design</subject><subject>Diabetes mellitus</subject><subject>Diabetic retinopathy</subject><subject>Diagnosis</subject><subject>Efficiency</subject><subject>Health aspects</subject><subject>Image reconstruction</subject><subject>Image resolution</subject><subject>Localization</subject><subject>Machine learning</subject><subject>Machine vision</subject><subject>Medical imaging</subject><subject>microaneurysm</subject><subject>Microvasculature</subject><subject>Neural networks</subject><subject>Retinopathy</subject><subject>Semantics</subject><subject>SwinIR</subject><subject>Transfer learning</subject><subject>YOLOv8</subject><issn>2306-5354</issn><issn>2306-5354</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><sourceid>DOA</sourceid><recordid>eNptkktvEzEUhS0EolXpX6hGYsMmxe_HMrQFIqWKxGPByvJrIkczdrFnivrvcUgpLaq8sH31neN7dA3AGYLnhCj43sYc0jamEEpMWwQRRhSyF-AYE8gXjDD68tH5CJzWuoMQIoIZ5vQ1OCISEaYUPwaXy9StxpuSb4PvrqMr2aQwl7s6dpdhCm6KOXXX2Yeh-2BqY9r166-YVl86k3z3Y7Pe3Mo34FVvhhpO7_cT8P3j1beLz4v15tPqYrleOIbhtOiZp55ARoW0yBInnWc9dwhT4jBmiATrW39MWCk4F6HFQshZKQ2iDHFGTsDq4Ouz2embEkdT7nQ2Uf8p5LLVpkzRDUFLTIj3xjopLJXQWyg4cpQqipSShDevdwevlv3nHOqkx1hdGIaWP89VYwVZ6xoy0dC3_6G7PJfUku4pyjHFXP2jtqa9H1Ofp2Lc3lQvhRBUcYZlo86fodryYYwup9DHVn8i4AdBG02tJfQPuRHU-9-gn_8NTXh23_Vsx-AfZH9nT34Df9SuNw</recordid><startdate>20231201</startdate><enddate>20231201</enddate><creator>Zhang, Bowei</creator><creator>Li, Jing</creator><creator>Bai, Yun</creator><creator>Jiang, Qing</creator><creator>Yan, Biao</creator><creator>Wang, Zhenhua</creator><general>MDPI AG</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>8FE</scope><scope>8FG</scope><scope>8FH</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>BHPHI</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>LK8</scope><scope>M7P</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PTHSS</scope><scope>7X8</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-6603-2019</orcidid></search><sort><creationdate>20231201</creationdate><title>An Improved Microaneurysm Detection Model Based on SwinIR and YOLOv8</title><author>Zhang, Bowei ; Li, Jing ; Bai, Yun ; Jiang, Qing ; Yan, Biao ; Wang, Zhenhua</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c520t-f5d4d305478b1b3c8cd5f6c1243c22513ebd26457b87667e12111cb88a1451653</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Aneurysms</topic><topic>Angiography</topic><topic>Bioengineering</topic><topic>Blood vessels</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Design</topic><topic>Diabetes mellitus</topic><topic>Diabetic retinopathy</topic><topic>Diagnosis</topic><topic>Efficiency</topic><topic>Health aspects</topic><topic>Image reconstruction</topic><topic>Image resolution</topic><topic>Localization</topic><topic>Machine learning</topic><topic>Machine vision</topic><topic>Medical imaging</topic><topic>microaneurysm</topic><topic>Microvasculature</topic><topic>Neural networks</topic><topic>Retinopathy</topic><topic>Semantics</topic><topic>SwinIR</topic><topic>Transfer learning</topic><topic>YOLOv8</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhang, Bowei</creatorcontrib><creatorcontrib>Li, Jing</creatorcontrib><creatorcontrib>Bai, Yun</creatorcontrib><creatorcontrib>Jiang, Qing</creatorcontrib><creatorcontrib>Yan, Biao</creatorcontrib><creatorcontrib>Wang, Zhenhua</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>Natural Science Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>ProQuest Biological Science Collection</collection><collection>Biological Science Database</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>Engineering Collection</collection><collection>MEDLINE - Academic</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>Bioengineering (Basel)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhang, Bowei</au><au>Li, Jing</au><au>Bai, Yun</au><au>Jiang, Qing</au><au>Yan, Biao</au><au>Wang, Zhenhua</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>An Improved Microaneurysm Detection Model Based on SwinIR and YOLOv8</atitle><jtitle>Bioengineering (Basel)</jtitle><addtitle>Bioengineering (Basel)</addtitle><date>2023-12-01</date><risdate>2023</risdate><volume>10</volume><issue>12</issue><spage>1405</spage><pages>1405-</pages><issn>2306-5354</issn><eissn>2306-5354</eissn><abstract>Diabetic retinopathy (DR) is a microvascular complication of diabetes. Microaneurysms (MAs) are often observed in the retinal vessels of diabetic patients and represent one of the earliest signs of DR. Accurate and efficient detection of MAs is crucial for the diagnosis of DR. In this study, an automatic model (MA-YOLO) is proposed for MA detection in fluorescein angiography (FFA) images. To obtain detailed features and improve the discriminability of MAs in FFA images, SwinIR was utilized to reconstruct super-resolution images. To solve the problems of missed detection of small features and feature information loss, an MA detection layer was added between the neck and the head sections of YOLOv8. To enhance the generalization ability of the MA-YOLO model, transfer learning was conducted between high-resolution images and low-resolution images. To avoid excessive penalization due to geometric factors and address sample distribution imbalance, the loss function was optimized by taking the Wise-IoU loss as a bounding box regression loss. The performance of the MA-YOLO model in MA detection was compared with that of other state-of-the-art models, including SSD, RetinaNet, YOLOv5, YOLOX, and YOLOv7. The results showed that the MA-YOLO model had the best performance in MA detection, as shown by its optimal metrics, including recall, precision, F1 score, and AP, which were 88.23%, 97.98%, 92.85%, and 94.62%, respectively. Collectively, the proposed MA-YOLO model is suitable for the automatic detection of MAs in FFA images, which can assist ophthalmologists in the diagnosis of the progression of DR.</abstract><cop>Switzerland</cop><pub>MDPI AG</pub><pmid>38135996</pmid><doi>10.3390/bioengineering10121405</doi><orcidid>https://orcid.org/0000-0002-6603-2019</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 2306-5354 |
ispartof | Bioengineering (Basel), 2023-12, Vol.10 (12), p.1405 |
issn | 2306-5354 2306-5354 |
language | eng |
recordid | cdi_doaj_primary_oai_doaj_org_article_8233ddabc87b480db0761c4494199836 |
source | Publicly Available Content Database; PubMed Central |
subjects | Aneurysms Angiography Bioengineering Blood vessels Datasets Deep learning Design Diabetes mellitus Diabetic retinopathy Diagnosis Efficiency Health aspects Image reconstruction Image resolution Localization Machine learning Machine vision Medical imaging microaneurysm Microvasculature Neural networks Retinopathy Semantics SwinIR Transfer learning YOLOv8 |
title | An Improved Microaneurysm Detection Model Based on SwinIR and YOLOv8 |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-19T16%3A02%3A01IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_doaj_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=An%20Improved%20Microaneurysm%20Detection%20Model%20Based%20on%20SwinIR%20and%20YOLOv8&rft.jtitle=Bioengineering%20(Basel)&rft.au=Zhang,%20Bowei&rft.date=2023-12-01&rft.volume=10&rft.issue=12&rft.spage=1405&rft.pages=1405-&rft.issn=2306-5354&rft.eissn=2306-5354&rft_id=info:doi/10.3390/bioengineering10121405&rft_dat=%3Cgale_doaj_%3EA777496528%3C/gale_doaj_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c520t-f5d4d305478b1b3c8cd5f6c1243c22513ebd26457b87667e12111cb88a1451653%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2904624269&rft_id=info:pmid/38135996&rft_galeid=A777496528&rfr_iscdi=true |