Loading…
Robust color medical image segmentation on unseen domain by randomized illumination enhancement
Owing to the data distribution shifts generated by collecting images using various imaging protocols and device vendors, the generalization capability of deep models is crucial for medical image analysis when applied to test datasets in clinical environments. Domain generalization (DG) methods have...
Saved in:
Published in: | Computers in biology and medicine 2022-06, Vol.145, p.105427-105427, Article 105427 |
---|---|
Main Authors: | , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c402t-bd685388054f6be3aa5444f16f4886c7d853542435170692022e21d1a52c72b23 |
---|---|
cites | cdi_FETCH-LOGICAL-c402t-bd685388054f6be3aa5444f16f4886c7d853542435170692022e21d1a52c72b23 |
container_end_page | 105427 |
container_issue | |
container_start_page | 105427 |
container_title | Computers in biology and medicine |
container_volume | 145 |
creator | Zhang, Zuyu Li, Yan Shin, Byeong-Seok |
description | Owing to the data distribution shifts generated by collecting images using various imaging protocols and device vendors, the generalization capability of deep models is crucial for medical image analysis when applied to test datasets in clinical environments. Domain generalization (DG) methods have shown promising generalization performance in the field of medical image segmentation. In contrast to conventional DG, which has strict requirements regarding the availability of multiple source domains, we consider a more challenging problem, that is, single-domain generalization (SDG), where only a single source is available during network training. In this scenario, the augmentation of the entire image to improve the model generalization ability may cause alteration of hue values, resulting in the wrong segmentation of tissues in color medical images. To resolve this problem, we first present a novel illumination-randomized SDG framework to improve the model generalization power for color medical image segmentation by synthesizing randomized illumination maps. Specifically, we devise unsupervised retinex-based image decomposition neural networks (ID-Nets) to decompose color medical images into reflectance and illumination maps. Illumination maps are augmented by performing illumination randomization to generate medical color images under diverse illumination conditions. Second, to measure the quality of retinex-based image decomposition, we devise a novel metric, the transport gradient consistency index, by modeling physical illumination. Extensive experiments are performed to evaluate our proposed framework on two retinal fundus image segmentation tasks: optic cup and disc segmentation. The experimental results demonstrate that our framework outperforms other SDG and image enhancement methods, surpassing the state-of-the-art SDG methods by up to 9.6% with respect to the Dice coefficient.
•Illumination-randomized SDG framework improves the generalization capability of CNNs on unseen target datasets.•Unsupervised retinex-based ID-Net decomposes color medical images into illumination and reflectance components.•TGCI measures the quality of retinex-based image decomposition and is strongly related to segmentation performance. |
doi_str_mv | 10.1016/j.compbiomed.2022.105427 |
format | article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2666907144</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0010482522002190</els_id><sourcerecordid>2666907144</sourcerecordid><originalsourceid>FETCH-LOGICAL-c402t-bd685388054f6be3aa5444f16f4886c7d853542435170692022e21d1a52c72b23</originalsourceid><addsrcrecordid>eNqFkdtqFTEUhoNY7Lb6ChLwxpvZrhwn-1JLPUBBKO11yGTW1Gxmkm0yI9SnN-O0CN4IgZCsbx3-fxFCGewZMP3-uPdpOnUhTdjvOXBev5Xk7TOyY6Y9NKCEfE52AAwaabg6Jy9LOQKABAEvyLlQyqhWsB2xN6lbykx9GlOmtVzwbqRhcvdIC95PGGc3hxRpPUssiJH2aXIh0u6BZhfrI_zCnoZxXKYQNxbjdxc9rsmvyNngxoKvH-8Lcvfp6vbyS3P97fPXyw_XjZfA56brtVHCmKpi0B0K55SUcmB6kMZo3_Y1WgVKoVgL-rBKRs565hT3Le-4uCDvtrqnnH4sWGY7heJxHF3EtBTLtdYHaJmUFX37D3pMS451upUSDFr9hzIb5XMqJeNgT7nakh8sA7suwR7t3yXYdSK7LaGmvnlssHRr7CnxyfUKfNwArI78DJht8QGrY33I6Gfbp_D_Lr8BLK2caA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2663107644</pqid></control><display><type>article</type><title>Robust color medical image segmentation on unseen domain by randomized illumination enhancement</title><source>Elsevier</source><creator>Zhang, Zuyu ; Li, Yan ; Shin, Byeong-Seok</creator><creatorcontrib>Zhang, Zuyu ; Li, Yan ; Shin, Byeong-Seok</creatorcontrib><description>Owing to the data distribution shifts generated by collecting images using various imaging protocols and device vendors, the generalization capability of deep models is crucial for medical image analysis when applied to test datasets in clinical environments. Domain generalization (DG) methods have shown promising generalization performance in the field of medical image segmentation. In contrast to conventional DG, which has strict requirements regarding the availability of multiple source domains, we consider a more challenging problem, that is, single-domain generalization (SDG), where only a single source is available during network training. In this scenario, the augmentation of the entire image to improve the model generalization ability may cause alteration of hue values, resulting in the wrong segmentation of tissues in color medical images. To resolve this problem, we first present a novel illumination-randomized SDG framework to improve the model generalization power for color medical image segmentation by synthesizing randomized illumination maps. Specifically, we devise unsupervised retinex-based image decomposition neural networks (ID-Nets) to decompose color medical images into reflectance and illumination maps. Illumination maps are augmented by performing illumination randomization to generate medical color images under diverse illumination conditions. Second, to measure the quality of retinex-based image decomposition, we devise a novel metric, the transport gradient consistency index, by modeling physical illumination. Extensive experiments are performed to evaluate our proposed framework on two retinal fundus image segmentation tasks: optic cup and disc segmentation. The experimental results demonstrate that our framework outperforms other SDG and image enhancement methods, surpassing the state-of-the-art SDG methods by up to 9.6% with respect to the Dice coefficient.
•Illumination-randomized SDG framework improves the generalization capability of CNNs on unseen target datasets.•Unsupervised retinex-based ID-Net decomposes color medical images into illumination and reflectance components.•TGCI measures the quality of retinex-based image decomposition and is strongly related to segmentation performance.</description><identifier>ISSN: 0010-4825</identifier><identifier>EISSN: 1879-0534</identifier><identifier>DOI: 10.1016/j.compbiomed.2022.105427</identifier><identifier>PMID: 35585731</identifier><language>eng</language><publisher>United States: Elsevier Ltd</publisher><subject>Clinical medicine ; Color ; Color imagery ; Color vision ; Decomposition ; Diabetic retinopathy ; Domain generalization ; Domains ; Fundus Oculi ; Illumination ; Image analysis ; Image contrast ; Image Enhancement ; Image processing ; Image Processing, Computer-Assisted ; Image quality ; Image segmentation ; Learning ; Lighting ; Luminance distribution ; Medical image segmentation ; Medical imaging ; Neural networks ; Neural Networks, Computer ; Optic Disk ; Randomization</subject><ispartof>Computers in biology and medicine, 2022-06, Vol.145, p.105427-105427, Article 105427</ispartof><rights>2022 Elsevier Ltd</rights><rights>Copyright © 2022 Elsevier Ltd. All rights reserved.</rights><rights>2022. Elsevier Ltd</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c402t-bd685388054f6be3aa5444f16f4886c7d853542435170692022e21d1a52c72b23</citedby><cites>FETCH-LOGICAL-c402t-bd685388054f6be3aa5444f16f4886c7d853542435170692022e21d1a52c72b23</cites><orcidid>0000-0001-5483-237X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/35585731$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Zhang, Zuyu</creatorcontrib><creatorcontrib>Li, Yan</creatorcontrib><creatorcontrib>Shin, Byeong-Seok</creatorcontrib><title>Robust color medical image segmentation on unseen domain by randomized illumination enhancement</title><title>Computers in biology and medicine</title><addtitle>Comput Biol Med</addtitle><description>Owing to the data distribution shifts generated by collecting images using various imaging protocols and device vendors, the generalization capability of deep models is crucial for medical image analysis when applied to test datasets in clinical environments. Domain generalization (DG) methods have shown promising generalization performance in the field of medical image segmentation. In contrast to conventional DG, which has strict requirements regarding the availability of multiple source domains, we consider a more challenging problem, that is, single-domain generalization (SDG), where only a single source is available during network training. In this scenario, the augmentation of the entire image to improve the model generalization ability may cause alteration of hue values, resulting in the wrong segmentation of tissues in color medical images. To resolve this problem, we first present a novel illumination-randomized SDG framework to improve the model generalization power for color medical image segmentation by synthesizing randomized illumination maps. Specifically, we devise unsupervised retinex-based image decomposition neural networks (ID-Nets) to decompose color medical images into reflectance and illumination maps. Illumination maps are augmented by performing illumination randomization to generate medical color images under diverse illumination conditions. Second, to measure the quality of retinex-based image decomposition, we devise a novel metric, the transport gradient consistency index, by modeling physical illumination. Extensive experiments are performed to evaluate our proposed framework on two retinal fundus image segmentation tasks: optic cup and disc segmentation. The experimental results demonstrate that our framework outperforms other SDG and image enhancement methods, surpassing the state-of-the-art SDG methods by up to 9.6% with respect to the Dice coefficient.
•Illumination-randomized SDG framework improves the generalization capability of CNNs on unseen target datasets.•Unsupervised retinex-based ID-Net decomposes color medical images into illumination and reflectance components.•TGCI measures the quality of retinex-based image decomposition and is strongly related to segmentation performance.</description><subject>Clinical medicine</subject><subject>Color</subject><subject>Color imagery</subject><subject>Color vision</subject><subject>Decomposition</subject><subject>Diabetic retinopathy</subject><subject>Domain generalization</subject><subject>Domains</subject><subject>Fundus Oculi</subject><subject>Illumination</subject><subject>Image analysis</subject><subject>Image contrast</subject><subject>Image Enhancement</subject><subject>Image processing</subject><subject>Image Processing, Computer-Assisted</subject><subject>Image quality</subject><subject>Image segmentation</subject><subject>Learning</subject><subject>Lighting</subject><subject>Luminance distribution</subject><subject>Medical image segmentation</subject><subject>Medical imaging</subject><subject>Neural networks</subject><subject>Neural Networks, Computer</subject><subject>Optic Disk</subject><subject>Randomization</subject><issn>0010-4825</issn><issn>1879-0534</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><recordid>eNqFkdtqFTEUhoNY7Lb6ChLwxpvZrhwn-1JLPUBBKO11yGTW1Gxmkm0yI9SnN-O0CN4IgZCsbx3-fxFCGewZMP3-uPdpOnUhTdjvOXBev5Xk7TOyY6Y9NKCEfE52AAwaabg6Jy9LOQKABAEvyLlQyqhWsB2xN6lbykx9GlOmtVzwbqRhcvdIC95PGGc3hxRpPUssiJH2aXIh0u6BZhfrI_zCnoZxXKYQNxbjdxc9rsmvyNngxoKvH-8Lcvfp6vbyS3P97fPXyw_XjZfA56brtVHCmKpi0B0K55SUcmB6kMZo3_Y1WgVKoVgL-rBKRs565hT3Le-4uCDvtrqnnH4sWGY7heJxHF3EtBTLtdYHaJmUFX37D3pMS451upUSDFr9hzIb5XMqJeNgT7nakh8sA7suwR7t3yXYdSK7LaGmvnlssHRr7CnxyfUKfNwArI78DJht8QGrY33I6Gfbp_D_Lr8BLK2caA</recordid><startdate>202206</startdate><enddate>202206</enddate><creator>Zhang, Zuyu</creator><creator>Li, Yan</creator><creator>Shin, Byeong-Seok</creator><general>Elsevier Ltd</general><general>Elsevier Limited</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7RV</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8AL</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FH</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>BHPHI</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FR3</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>K9.</scope><scope>KB0</scope><scope>LK8</scope><scope>M0N</scope><scope>M0S</scope><scope>M1P</scope><scope>M2O</scope><scope>M7P</scope><scope>M7Z</scope><scope>MBDVC</scope><scope>NAPCQ</scope><scope>P5Z</scope><scope>P62</scope><scope>P64</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>Q9U</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0001-5483-237X</orcidid></search><sort><creationdate>202206</creationdate><title>Robust color medical image segmentation on unseen domain by randomized illumination enhancement</title><author>Zhang, Zuyu ; Li, Yan ; Shin, Byeong-Seok</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c402t-bd685388054f6be3aa5444f16f4886c7d853542435170692022e21d1a52c72b23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Clinical medicine</topic><topic>Color</topic><topic>Color imagery</topic><topic>Color vision</topic><topic>Decomposition</topic><topic>Diabetic retinopathy</topic><topic>Domain generalization</topic><topic>Domains</topic><topic>Fundus Oculi</topic><topic>Illumination</topic><topic>Image analysis</topic><topic>Image contrast</topic><topic>Image Enhancement</topic><topic>Image processing</topic><topic>Image Processing, Computer-Assisted</topic><topic>Image quality</topic><topic>Image segmentation</topic><topic>Learning</topic><topic>Lighting</topic><topic>Luminance distribution</topic><topic>Medical image segmentation</topic><topic>Medical imaging</topic><topic>Neural networks</topic><topic>Neural Networks, Computer</topic><topic>Optic Disk</topic><topic>Randomization</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhang, Zuyu</creatorcontrib><creatorcontrib>Li, Yan</creatorcontrib><creatorcontrib>Shin, Byeong-Seok</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Nursing & Allied Health Database</collection><collection>Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>Natural Science Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Engineering Research Database</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Nursing & Allied Health Database (Alumni Edition)</collection><collection>ProQuest Biological Science Collection</collection><collection>Computing Database</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Research Library</collection><collection>Biological Science Database</collection><collection>Biochemistry Abstracts 1</collection><collection>Research Library (Corporate)</collection><collection>Nursing & Allied Health Premium</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest Central Basic</collection><collection>MEDLINE - Academic</collection><jtitle>Computers in biology and medicine</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhang, Zuyu</au><au>Li, Yan</au><au>Shin, Byeong-Seok</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Robust color medical image segmentation on unseen domain by randomized illumination enhancement</atitle><jtitle>Computers in biology and medicine</jtitle><addtitle>Comput Biol Med</addtitle><date>2022-06</date><risdate>2022</risdate><volume>145</volume><spage>105427</spage><epage>105427</epage><pages>105427-105427</pages><artnum>105427</artnum><issn>0010-4825</issn><eissn>1879-0534</eissn><abstract>Owing to the data distribution shifts generated by collecting images using various imaging protocols and device vendors, the generalization capability of deep models is crucial for medical image analysis when applied to test datasets in clinical environments. Domain generalization (DG) methods have shown promising generalization performance in the field of medical image segmentation. In contrast to conventional DG, which has strict requirements regarding the availability of multiple source domains, we consider a more challenging problem, that is, single-domain generalization (SDG), where only a single source is available during network training. In this scenario, the augmentation of the entire image to improve the model generalization ability may cause alteration of hue values, resulting in the wrong segmentation of tissues in color medical images. To resolve this problem, we first present a novel illumination-randomized SDG framework to improve the model generalization power for color medical image segmentation by synthesizing randomized illumination maps. Specifically, we devise unsupervised retinex-based image decomposition neural networks (ID-Nets) to decompose color medical images into reflectance and illumination maps. Illumination maps are augmented by performing illumination randomization to generate medical color images under diverse illumination conditions. Second, to measure the quality of retinex-based image decomposition, we devise a novel metric, the transport gradient consistency index, by modeling physical illumination. Extensive experiments are performed to evaluate our proposed framework on two retinal fundus image segmentation tasks: optic cup and disc segmentation. The experimental results demonstrate that our framework outperforms other SDG and image enhancement methods, surpassing the state-of-the-art SDG methods by up to 9.6% with respect to the Dice coefficient.
•Illumination-randomized SDG framework improves the generalization capability of CNNs on unseen target datasets.•Unsupervised retinex-based ID-Net decomposes color medical images into illumination and reflectance components.•TGCI measures the quality of retinex-based image decomposition and is strongly related to segmentation performance.</abstract><cop>United States</cop><pub>Elsevier Ltd</pub><pmid>35585731</pmid><doi>10.1016/j.compbiomed.2022.105427</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0001-5483-237X</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0010-4825 |
ispartof | Computers in biology and medicine, 2022-06, Vol.145, p.105427-105427, Article 105427 |
issn | 0010-4825 1879-0534 |
language | eng |
recordid | cdi_proquest_miscellaneous_2666907144 |
source | Elsevier |
subjects | Clinical medicine Color Color imagery Color vision Decomposition Diabetic retinopathy Domain generalization Domains Fundus Oculi Illumination Image analysis Image contrast Image Enhancement Image processing Image Processing, Computer-Assisted Image quality Image segmentation Learning Lighting Luminance distribution Medical image segmentation Medical imaging Neural networks Neural Networks, Computer Optic Disk Randomization |
title | Robust color medical image segmentation on unseen domain by randomized illumination enhancement |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T18%3A44%3A05IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Robust%20color%20medical%20image%20segmentation%20on%20unseen%20domain%20by%20randomized%20illumination%20enhancement&rft.jtitle=Computers%20in%20biology%20and%20medicine&rft.au=Zhang,%20Zuyu&rft.date=2022-06&rft.volume=145&rft.spage=105427&rft.epage=105427&rft.pages=105427-105427&rft.artnum=105427&rft.issn=0010-4825&rft.eissn=1879-0534&rft_id=info:doi/10.1016/j.compbiomed.2022.105427&rft_dat=%3Cproquest_cross%3E2666907144%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c402t-bd685388054f6be3aa5444f16f4886c7d853542435170692022e21d1a52c72b23%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2663107644&rft_id=info:pmid/35585731&rfr_iscdi=true |