Loading…
U-TranSvision: Transformer-based deep supervision approach for COVID-19 lesion segmentation on Computed Tomography images
Artificial intelligence (AI)-assisted COVID-19 detection in chest computed tomography (CT) images has an important role in the early diagnosis and appropriate treatment of infected patients. Convolutional neural network based AI approaches have shown significant performance in segmenting COVID-19 le...
Saved in:
Published in: | Biomedical signal processing and control 2024-07, Vol.93, p.106167, Article 106167 |
---|---|
Main Authors: | , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | |
---|---|
cites | cdi_FETCH-LOGICAL-c251t-b1a6a6c8dbae3d3e8b8a2ad94e93d407d022b525f926b66b00f0d786f530b8273 |
container_end_page | |
container_issue | |
container_start_page | 106167 |
container_title | Biomedical signal processing and control |
container_volume | 93 |
creator | Ağralı, Mahmut Kılıç, Volkan |
description | Artificial intelligence (AI)-assisted COVID-19 detection in chest computed tomography (CT) images has an important role in the early diagnosis and appropriate treatment of infected patients. Convolutional neural network based AI approaches have shown significant performance in segmenting COVID-19 lesion regions. However, they have several limitations to deal with the complexity of the lesion characteristics, low or high image contrast, and small lesion regions. To address these limitations, we propose a novel architecture called U-TranSvision, which leverages transformers and deep supervision to improve segmentation performance by focusing on the salient features of small COVID-19 lesions. Furthermore, Pix2Pix generative adversarial network was used in data augmentation to improve the performance of U-TranSvision, and pre-processing steps were applied to remove the noise around human tissue on an image. In addition, we created a relatively large-scale dataset of 11,717 axial chest CT images, along with their corresponding pixel-level annotations. Based on extensive experimental evaluations, U-TranSvision achieved a dice similarity coefficient of 85.57% and an intersection over Union of 74.82%. The experiments were also conducted on three publicly available datasets, such as COVID-19-CT-Seg, MosMedData, and MedSeg, to demonstrate the robustness of U-TranSvision. The qualitative and quantitative results proved that U-TranSvision had promising performance compared to the state-of-the-art architectures for COVID-19 lesion segmentation. In addition, U-TranSvision has relatively low learning parameters, which results in low computational costs.
•U-TranSvision architecture for COVID-19 lesion segmentation under deep supervision.•New large-scale dataset with their corresponding pixel-level annotations are created.•Advantages of small-size lesions detection on CT images with faster convergence.•Exploitation of the transformer and deep supervision in medical imaging. |
doi_str_mv | 10.1016/j.bspc.2024.106167 |
format | article |
fullrecord | <record><control><sourceid>elsevier_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1016_j_bspc_2024_106167</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S1746809424002258</els_id><sourcerecordid>S1746809424002258</sourcerecordid><originalsourceid>FETCH-LOGICAL-c251t-b1a6a6c8dbae3d3e8b8a2ad94e93d407d022b525f926b66b00f0d786f530b8273</originalsourceid><addsrcrecordid>eNp9UMtqwzAQFKWFpml_oCf9gFNJtmW59FLSVyCQQ5NehR7rxCG2hOQE8ve16_ZaWNid3ZllGITuKZlRQvnDfqajNzNGWNYvOOXFBZrQIuOJoERc_s2kzK7RTYx7QjJR0GyCzptkHVT7eapj7dpHPIBYudBASLSKYLEF8DgePYSRg5X3wSmzwz0Nz1dfi5eElvgAP8cI2wbaTnUD6GvuGn_s-jdr17htUH53xnWjthBv0VWlDhHufvsUbd5e1_OPZLl6X8yfl4lhOe0STRVX3AirFaQ2BaGFYsqWGZSpzUhhCWM6Z3lVMq4514RUxBaCV3lKtGBFOkVs_GuCizFAJX3oHYSzpEQO4cm9HMKTQ3hyDK8XPY0i6J2daggymhpaA7YOYDppXf2f_Bte43pf</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>U-TranSvision: Transformer-based deep supervision approach for COVID-19 lesion segmentation on Computed Tomography images</title><source>ScienceDirect Freedom Collection</source><creator>Ağralı, Mahmut ; Kılıç, Volkan</creator><creatorcontrib>Ağralı, Mahmut ; Kılıç, Volkan</creatorcontrib><description>Artificial intelligence (AI)-assisted COVID-19 detection in chest computed tomography (CT) images has an important role in the early diagnosis and appropriate treatment of infected patients. Convolutional neural network based AI approaches have shown significant performance in segmenting COVID-19 lesion regions. However, they have several limitations to deal with the complexity of the lesion characteristics, low or high image contrast, and small lesion regions. To address these limitations, we propose a novel architecture called U-TranSvision, which leverages transformers and deep supervision to improve segmentation performance by focusing on the salient features of small COVID-19 lesions. Furthermore, Pix2Pix generative adversarial network was used in data augmentation to improve the performance of U-TranSvision, and pre-processing steps were applied to remove the noise around human tissue on an image. In addition, we created a relatively large-scale dataset of 11,717 axial chest CT images, along with their corresponding pixel-level annotations. Based on extensive experimental evaluations, U-TranSvision achieved a dice similarity coefficient of 85.57% and an intersection over Union of 74.82%. The experiments were also conducted on three publicly available datasets, such as COVID-19-CT-Seg, MosMedData, and MedSeg, to demonstrate the robustness of U-TranSvision. The qualitative and quantitative results proved that U-TranSvision had promising performance compared to the state-of-the-art architectures for COVID-19 lesion segmentation. In addition, U-TranSvision has relatively low learning parameters, which results in low computational costs.
•U-TranSvision architecture for COVID-19 lesion segmentation under deep supervision.•New large-scale dataset with their corresponding pixel-level annotations are created.•Advantages of small-size lesions detection on CT images with faster convergence.•Exploitation of the transformer and deep supervision in medical imaging.</description><identifier>ISSN: 1746-8094</identifier><identifier>EISSN: 1746-8108</identifier><identifier>DOI: 10.1016/j.bspc.2024.106167</identifier><language>eng</language><publisher>Elsevier Ltd</publisher><subject>Artificial intelligence ; COVID-19 lesion segmentation ; Deep learning ; Deep supervision ; Transformer</subject><ispartof>Biomedical signal processing and control, 2024-07, Vol.93, p.106167, Article 106167</ispartof><rights>2024 Elsevier Ltd</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c251t-b1a6a6c8dbae3d3e8b8a2ad94e93d407d022b525f926b66b00f0d786f530b8273</cites><orcidid>0000-0002-3164-1981</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,777,781,27905,27906</link.rule.ids></links><search><creatorcontrib>Ağralı, Mahmut</creatorcontrib><creatorcontrib>Kılıç, Volkan</creatorcontrib><title>U-TranSvision: Transformer-based deep supervision approach for COVID-19 lesion segmentation on Computed Tomography images</title><title>Biomedical signal processing and control</title><description>Artificial intelligence (AI)-assisted COVID-19 detection in chest computed tomography (CT) images has an important role in the early diagnosis and appropriate treatment of infected patients. Convolutional neural network based AI approaches have shown significant performance in segmenting COVID-19 lesion regions. However, they have several limitations to deal with the complexity of the lesion characteristics, low or high image contrast, and small lesion regions. To address these limitations, we propose a novel architecture called U-TranSvision, which leverages transformers and deep supervision to improve segmentation performance by focusing on the salient features of small COVID-19 lesions. Furthermore, Pix2Pix generative adversarial network was used in data augmentation to improve the performance of U-TranSvision, and pre-processing steps were applied to remove the noise around human tissue on an image. In addition, we created a relatively large-scale dataset of 11,717 axial chest CT images, along with their corresponding pixel-level annotations. Based on extensive experimental evaluations, U-TranSvision achieved a dice similarity coefficient of 85.57% and an intersection over Union of 74.82%. The experiments were also conducted on three publicly available datasets, such as COVID-19-CT-Seg, MosMedData, and MedSeg, to demonstrate the robustness of U-TranSvision. The qualitative and quantitative results proved that U-TranSvision had promising performance compared to the state-of-the-art architectures for COVID-19 lesion segmentation. In addition, U-TranSvision has relatively low learning parameters, which results in low computational costs.
•U-TranSvision architecture for COVID-19 lesion segmentation under deep supervision.•New large-scale dataset with their corresponding pixel-level annotations are created.•Advantages of small-size lesions detection on CT images with faster convergence.•Exploitation of the transformer and deep supervision in medical imaging.</description><subject>Artificial intelligence</subject><subject>COVID-19 lesion segmentation</subject><subject>Deep learning</subject><subject>Deep supervision</subject><subject>Transformer</subject><issn>1746-8094</issn><issn>1746-8108</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9UMtqwzAQFKWFpml_oCf9gFNJtmW59FLSVyCQQ5NehR7rxCG2hOQE8ve16_ZaWNid3ZllGITuKZlRQvnDfqajNzNGWNYvOOXFBZrQIuOJoERc_s2kzK7RTYx7QjJR0GyCzptkHVT7eapj7dpHPIBYudBASLSKYLEF8DgePYSRg5X3wSmzwz0Nz1dfi5eElvgAP8cI2wbaTnUD6GvuGn_s-jdr17htUH53xnWjthBv0VWlDhHufvsUbd5e1_OPZLl6X8yfl4lhOe0STRVX3AirFaQ2BaGFYsqWGZSpzUhhCWM6Z3lVMq4514RUxBaCV3lKtGBFOkVs_GuCizFAJX3oHYSzpEQO4cm9HMKTQ3hyDK8XPY0i6J2daggymhpaA7YOYDppXf2f_Bte43pf</recordid><startdate>202407</startdate><enddate>202407</enddate><creator>Ağralı, Mahmut</creator><creator>Kılıç, Volkan</creator><general>Elsevier Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-3164-1981</orcidid></search><sort><creationdate>202407</creationdate><title>U-TranSvision: Transformer-based deep supervision approach for COVID-19 lesion segmentation on Computed Tomography images</title><author>Ağralı, Mahmut ; Kılıç, Volkan</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c251t-b1a6a6c8dbae3d3e8b8a2ad94e93d407d022b525f926b66b00f0d786f530b8273</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Artificial intelligence</topic><topic>COVID-19 lesion segmentation</topic><topic>Deep learning</topic><topic>Deep supervision</topic><topic>Transformer</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ağralı, Mahmut</creatorcontrib><creatorcontrib>Kılıç, Volkan</creatorcontrib><collection>CrossRef</collection><jtitle>Biomedical signal processing and control</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Ağralı, Mahmut</au><au>Kılıç, Volkan</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>U-TranSvision: Transformer-based deep supervision approach for COVID-19 lesion segmentation on Computed Tomography images</atitle><jtitle>Biomedical signal processing and control</jtitle><date>2024-07</date><risdate>2024</risdate><volume>93</volume><spage>106167</spage><pages>106167-</pages><artnum>106167</artnum><issn>1746-8094</issn><eissn>1746-8108</eissn><abstract>Artificial intelligence (AI)-assisted COVID-19 detection in chest computed tomography (CT) images has an important role in the early diagnosis and appropriate treatment of infected patients. Convolutional neural network based AI approaches have shown significant performance in segmenting COVID-19 lesion regions. However, they have several limitations to deal with the complexity of the lesion characteristics, low or high image contrast, and small lesion regions. To address these limitations, we propose a novel architecture called U-TranSvision, which leverages transformers and deep supervision to improve segmentation performance by focusing on the salient features of small COVID-19 lesions. Furthermore, Pix2Pix generative adversarial network was used in data augmentation to improve the performance of U-TranSvision, and pre-processing steps were applied to remove the noise around human tissue on an image. In addition, we created a relatively large-scale dataset of 11,717 axial chest CT images, along with their corresponding pixel-level annotations. Based on extensive experimental evaluations, U-TranSvision achieved a dice similarity coefficient of 85.57% and an intersection over Union of 74.82%. The experiments were also conducted on three publicly available datasets, such as COVID-19-CT-Seg, MosMedData, and MedSeg, to demonstrate the robustness of U-TranSvision. The qualitative and quantitative results proved that U-TranSvision had promising performance compared to the state-of-the-art architectures for COVID-19 lesion segmentation. In addition, U-TranSvision has relatively low learning parameters, which results in low computational costs.
•U-TranSvision architecture for COVID-19 lesion segmentation under deep supervision.•New large-scale dataset with their corresponding pixel-level annotations are created.•Advantages of small-size lesions detection on CT images with faster convergence.•Exploitation of the transformer and deep supervision in medical imaging.</abstract><pub>Elsevier Ltd</pub><doi>10.1016/j.bspc.2024.106167</doi><orcidid>https://orcid.org/0000-0002-3164-1981</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1746-8094 |
ispartof | Biomedical signal processing and control, 2024-07, Vol.93, p.106167, Article 106167 |
issn | 1746-8094 1746-8108 |
language | eng |
recordid | cdi_crossref_primary_10_1016_j_bspc_2024_106167 |
source | ScienceDirect Freedom Collection |
subjects | Artificial intelligence COVID-19 lesion segmentation Deep learning Deep supervision Transformer |
title | U-TranSvision: Transformer-based deep supervision approach for COVID-19 lesion segmentation on Computed Tomography images |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-21T00%3A47%3A06IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=U-TranSvision:%20Transformer-based%20deep%20supervision%20approach%20for%20COVID-19%20lesion%20segmentation%20on%20Computed%20Tomography%20images&rft.jtitle=Biomedical%20signal%20processing%20and%20control&rft.au=A%C4%9Fral%C4%B1,%20Mahmut&rft.date=2024-07&rft.volume=93&rft.spage=106167&rft.pages=106167-&rft.artnum=106167&rft.issn=1746-8094&rft.eissn=1746-8108&rft_id=info:doi/10.1016/j.bspc.2024.106167&rft_dat=%3Celsevier_cross%3ES1746809424002258%3C/elsevier_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c251t-b1a6a6c8dbae3d3e8b8a2ad94e93d407d022b525f926b66b00f0d786f530b8273%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |