Loading…

U-TranSvision: Transformer-based deep supervision approach for COVID-19 lesion segmentation on Computed Tomography images

Artificial intelligence (AI)-assisted COVID-19 detection in chest computed tomography (CT) images has an important role in the early diagnosis and appropriate treatment of infected patients. Convolutional neural network based AI approaches have shown significant performance in segmenting COVID-19 le...

Full description

Saved in:
Bibliographic Details
Published in:Biomedical signal processing and control 2024-07, Vol.93, p.106167, Article 106167
Main Authors: Ağralı, Mahmut, Kılıç, Volkan
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites cdi_FETCH-LOGICAL-c251t-b1a6a6c8dbae3d3e8b8a2ad94e93d407d022b525f926b66b00f0d786f530b8273
container_end_page
container_issue
container_start_page 106167
container_title Biomedical signal processing and control
container_volume 93
creator Ağralı, Mahmut
Kılıç, Volkan
description Artificial intelligence (AI)-assisted COVID-19 detection in chest computed tomography (CT) images has an important role in the early diagnosis and appropriate treatment of infected patients. Convolutional neural network based AI approaches have shown significant performance in segmenting COVID-19 lesion regions. However, they have several limitations to deal with the complexity of the lesion characteristics, low or high image contrast, and small lesion regions. To address these limitations, we propose a novel architecture called U-TranSvision, which leverages transformers and deep supervision to improve segmentation performance by focusing on the salient features of small COVID-19 lesions. Furthermore, Pix2Pix generative adversarial network was used in data augmentation to improve the performance of U-TranSvision, and pre-processing steps were applied to remove the noise around human tissue on an image. In addition, we created a relatively large-scale dataset of 11,717 axial chest CT images, along with their corresponding pixel-level annotations. Based on extensive experimental evaluations, U-TranSvision achieved a dice similarity coefficient of 85.57% and an intersection over Union of 74.82%. The experiments were also conducted on three publicly available datasets, such as COVID-19-CT-Seg, MosMedData, and MedSeg, to demonstrate the robustness of U-TranSvision. The qualitative and quantitative results proved that U-TranSvision had promising performance compared to the state-of-the-art architectures for COVID-19 lesion segmentation. In addition, U-TranSvision has relatively low learning parameters, which results in low computational costs. •U-TranSvision architecture for COVID-19 lesion segmentation under deep supervision.•New large-scale dataset with their corresponding pixel-level annotations are created.•Advantages of small-size lesions detection on CT images with faster convergence.•Exploitation of the transformer and deep supervision in medical imaging.
doi_str_mv 10.1016/j.bspc.2024.106167
format article
fullrecord <record><control><sourceid>elsevier_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1016_j_bspc_2024_106167</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S1746809424002258</els_id><sourcerecordid>S1746809424002258</sourcerecordid><originalsourceid>FETCH-LOGICAL-c251t-b1a6a6c8dbae3d3e8b8a2ad94e93d407d022b525f926b66b00f0d786f530b8273</originalsourceid><addsrcrecordid>eNp9UMtqwzAQFKWFpml_oCf9gFNJtmW59FLSVyCQQ5NehR7rxCG2hOQE8ve16_ZaWNid3ZllGITuKZlRQvnDfqajNzNGWNYvOOXFBZrQIuOJoERc_s2kzK7RTYx7QjJR0GyCzptkHVT7eapj7dpHPIBYudBASLSKYLEF8DgePYSRg5X3wSmzwz0Nz1dfi5eElvgAP8cI2wbaTnUD6GvuGn_s-jdr17htUH53xnWjthBv0VWlDhHufvsUbd5e1_OPZLl6X8yfl4lhOe0STRVX3AirFaQ2BaGFYsqWGZSpzUhhCWM6Z3lVMq4514RUxBaCV3lKtGBFOkVs_GuCizFAJX3oHYSzpEQO4cm9HMKTQ3hyDK8XPY0i6J2daggymhpaA7YOYDppXf2f_Bte43pf</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>U-TranSvision: Transformer-based deep supervision approach for COVID-19 lesion segmentation on Computed Tomography images</title><source>ScienceDirect Freedom Collection</source><creator>Ağralı, Mahmut ; Kılıç, Volkan</creator><creatorcontrib>Ağralı, Mahmut ; Kılıç, Volkan</creatorcontrib><description>Artificial intelligence (AI)-assisted COVID-19 detection in chest computed tomography (CT) images has an important role in the early diagnosis and appropriate treatment of infected patients. Convolutional neural network based AI approaches have shown significant performance in segmenting COVID-19 lesion regions. However, they have several limitations to deal with the complexity of the lesion characteristics, low or high image contrast, and small lesion regions. To address these limitations, we propose a novel architecture called U-TranSvision, which leverages transformers and deep supervision to improve segmentation performance by focusing on the salient features of small COVID-19 lesions. Furthermore, Pix2Pix generative adversarial network was used in data augmentation to improve the performance of U-TranSvision, and pre-processing steps were applied to remove the noise around human tissue on an image. In addition, we created a relatively large-scale dataset of 11,717 axial chest CT images, along with their corresponding pixel-level annotations. Based on extensive experimental evaluations, U-TranSvision achieved a dice similarity coefficient of 85.57% and an intersection over Union of 74.82%. The experiments were also conducted on three publicly available datasets, such as COVID-19-CT-Seg, MosMedData, and MedSeg, to demonstrate the robustness of U-TranSvision. The qualitative and quantitative results proved that U-TranSvision had promising performance compared to the state-of-the-art architectures for COVID-19 lesion segmentation. In addition, U-TranSvision has relatively low learning parameters, which results in low computational costs. •U-TranSvision architecture for COVID-19 lesion segmentation under deep supervision.•New large-scale dataset with their corresponding pixel-level annotations are created.•Advantages of small-size lesions detection on CT images with faster convergence.•Exploitation of the transformer and deep supervision in medical imaging.</description><identifier>ISSN: 1746-8094</identifier><identifier>EISSN: 1746-8108</identifier><identifier>DOI: 10.1016/j.bspc.2024.106167</identifier><language>eng</language><publisher>Elsevier Ltd</publisher><subject>Artificial intelligence ; COVID-19 lesion segmentation ; Deep learning ; Deep supervision ; Transformer</subject><ispartof>Biomedical signal processing and control, 2024-07, Vol.93, p.106167, Article 106167</ispartof><rights>2024 Elsevier Ltd</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c251t-b1a6a6c8dbae3d3e8b8a2ad94e93d407d022b525f926b66b00f0d786f530b8273</cites><orcidid>0000-0002-3164-1981</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,777,781,27905,27906</link.rule.ids></links><search><creatorcontrib>Ağralı, Mahmut</creatorcontrib><creatorcontrib>Kılıç, Volkan</creatorcontrib><title>U-TranSvision: Transformer-based deep supervision approach for COVID-19 lesion segmentation on Computed Tomography images</title><title>Biomedical signal processing and control</title><description>Artificial intelligence (AI)-assisted COVID-19 detection in chest computed tomography (CT) images has an important role in the early diagnosis and appropriate treatment of infected patients. Convolutional neural network based AI approaches have shown significant performance in segmenting COVID-19 lesion regions. However, they have several limitations to deal with the complexity of the lesion characteristics, low or high image contrast, and small lesion regions. To address these limitations, we propose a novel architecture called U-TranSvision, which leverages transformers and deep supervision to improve segmentation performance by focusing on the salient features of small COVID-19 lesions. Furthermore, Pix2Pix generative adversarial network was used in data augmentation to improve the performance of U-TranSvision, and pre-processing steps were applied to remove the noise around human tissue on an image. In addition, we created a relatively large-scale dataset of 11,717 axial chest CT images, along with their corresponding pixel-level annotations. Based on extensive experimental evaluations, U-TranSvision achieved a dice similarity coefficient of 85.57% and an intersection over Union of 74.82%. The experiments were also conducted on three publicly available datasets, such as COVID-19-CT-Seg, MosMedData, and MedSeg, to demonstrate the robustness of U-TranSvision. The qualitative and quantitative results proved that U-TranSvision had promising performance compared to the state-of-the-art architectures for COVID-19 lesion segmentation. In addition, U-TranSvision has relatively low learning parameters, which results in low computational costs. •U-TranSvision architecture for COVID-19 lesion segmentation under deep supervision.•New large-scale dataset with their corresponding pixel-level annotations are created.•Advantages of small-size lesions detection on CT images with faster convergence.•Exploitation of the transformer and deep supervision in medical imaging.</description><subject>Artificial intelligence</subject><subject>COVID-19 lesion segmentation</subject><subject>Deep learning</subject><subject>Deep supervision</subject><subject>Transformer</subject><issn>1746-8094</issn><issn>1746-8108</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9UMtqwzAQFKWFpml_oCf9gFNJtmW59FLSVyCQQ5NehR7rxCG2hOQE8ve16_ZaWNid3ZllGITuKZlRQvnDfqajNzNGWNYvOOXFBZrQIuOJoERc_s2kzK7RTYx7QjJR0GyCzptkHVT7eapj7dpHPIBYudBASLSKYLEF8DgePYSRg5X3wSmzwz0Nz1dfi5eElvgAP8cI2wbaTnUD6GvuGn_s-jdr17htUH53xnWjthBv0VWlDhHufvsUbd5e1_OPZLl6X8yfl4lhOe0STRVX3AirFaQ2BaGFYsqWGZSpzUhhCWM6Z3lVMq4514RUxBaCV3lKtGBFOkVs_GuCizFAJX3oHYSzpEQO4cm9HMKTQ3hyDK8XPY0i6J2daggymhpaA7YOYDppXf2f_Bte43pf</recordid><startdate>202407</startdate><enddate>202407</enddate><creator>Ağralı, Mahmut</creator><creator>Kılıç, Volkan</creator><general>Elsevier Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-3164-1981</orcidid></search><sort><creationdate>202407</creationdate><title>U-TranSvision: Transformer-based deep supervision approach for COVID-19 lesion segmentation on Computed Tomography images</title><author>Ağralı, Mahmut ; Kılıç, Volkan</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c251t-b1a6a6c8dbae3d3e8b8a2ad94e93d407d022b525f926b66b00f0d786f530b8273</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Artificial intelligence</topic><topic>COVID-19 lesion segmentation</topic><topic>Deep learning</topic><topic>Deep supervision</topic><topic>Transformer</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ağralı, Mahmut</creatorcontrib><creatorcontrib>Kılıç, Volkan</creatorcontrib><collection>CrossRef</collection><jtitle>Biomedical signal processing and control</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Ağralı, Mahmut</au><au>Kılıç, Volkan</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>U-TranSvision: Transformer-based deep supervision approach for COVID-19 lesion segmentation on Computed Tomography images</atitle><jtitle>Biomedical signal processing and control</jtitle><date>2024-07</date><risdate>2024</risdate><volume>93</volume><spage>106167</spage><pages>106167-</pages><artnum>106167</artnum><issn>1746-8094</issn><eissn>1746-8108</eissn><abstract>Artificial intelligence (AI)-assisted COVID-19 detection in chest computed tomography (CT) images has an important role in the early diagnosis and appropriate treatment of infected patients. Convolutional neural network based AI approaches have shown significant performance in segmenting COVID-19 lesion regions. However, they have several limitations to deal with the complexity of the lesion characteristics, low or high image contrast, and small lesion regions. To address these limitations, we propose a novel architecture called U-TranSvision, which leverages transformers and deep supervision to improve segmentation performance by focusing on the salient features of small COVID-19 lesions. Furthermore, Pix2Pix generative adversarial network was used in data augmentation to improve the performance of U-TranSvision, and pre-processing steps were applied to remove the noise around human tissue on an image. In addition, we created a relatively large-scale dataset of 11,717 axial chest CT images, along with their corresponding pixel-level annotations. Based on extensive experimental evaluations, U-TranSvision achieved a dice similarity coefficient of 85.57% and an intersection over Union of 74.82%. The experiments were also conducted on three publicly available datasets, such as COVID-19-CT-Seg, MosMedData, and MedSeg, to demonstrate the robustness of U-TranSvision. The qualitative and quantitative results proved that U-TranSvision had promising performance compared to the state-of-the-art architectures for COVID-19 lesion segmentation. In addition, U-TranSvision has relatively low learning parameters, which results in low computational costs. •U-TranSvision architecture for COVID-19 lesion segmentation under deep supervision.•New large-scale dataset with their corresponding pixel-level annotations are created.•Advantages of small-size lesions detection on CT images with faster convergence.•Exploitation of the transformer and deep supervision in medical imaging.</abstract><pub>Elsevier Ltd</pub><doi>10.1016/j.bspc.2024.106167</doi><orcidid>https://orcid.org/0000-0002-3164-1981</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 1746-8094
ispartof Biomedical signal processing and control, 2024-07, Vol.93, p.106167, Article 106167
issn 1746-8094
1746-8108
language eng
recordid cdi_crossref_primary_10_1016_j_bspc_2024_106167
source ScienceDirect Freedom Collection
subjects Artificial intelligence
COVID-19 lesion segmentation
Deep learning
Deep supervision
Transformer
title U-TranSvision: Transformer-based deep supervision approach for COVID-19 lesion segmentation on Computed Tomography images
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-21T00%3A47%3A06IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=U-TranSvision:%20Transformer-based%20deep%20supervision%20approach%20for%20COVID-19%20lesion%20segmentation%20on%20Computed%20Tomography%20images&rft.jtitle=Biomedical%20signal%20processing%20and%20control&rft.au=A%C4%9Fral%C4%B1,%20Mahmut&rft.date=2024-07&rft.volume=93&rft.spage=106167&rft.pages=106167-&rft.artnum=106167&rft.issn=1746-8094&rft.eissn=1746-8108&rft_id=info:doi/10.1016/j.bspc.2024.106167&rft_dat=%3Celsevier_cross%3ES1746809424002258%3C/elsevier_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c251t-b1a6a6c8dbae3d3e8b8a2ad94e93d407d022b525f926b66b00f0d786f530b8273%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true