Loading…

Robust color medical image segmentation on unseen domain by randomized illumination enhancement

Owing to the data distribution shifts generated by collecting images using various imaging protocols and device vendors, the generalization capability of deep models is crucial for medical image analysis when applied to test datasets in clinical environments. Domain generalization (DG) methods have...

Full description

Saved in:
Bibliographic Details
Published in:Computers in biology and medicine 2022-06, Vol.145, p.105427-105427, Article 105427
Main Authors: Zhang, Zuyu, Li, Yan, Shin, Byeong-Seok
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c402t-bd685388054f6be3aa5444f16f4886c7d853542435170692022e21d1a52c72b23
cites cdi_FETCH-LOGICAL-c402t-bd685388054f6be3aa5444f16f4886c7d853542435170692022e21d1a52c72b23
container_end_page 105427
container_issue
container_start_page 105427
container_title Computers in biology and medicine
container_volume 145
creator Zhang, Zuyu
Li, Yan
Shin, Byeong-Seok
description Owing to the data distribution shifts generated by collecting images using various imaging protocols and device vendors, the generalization capability of deep models is crucial for medical image analysis when applied to test datasets in clinical environments. Domain generalization (DG) methods have shown promising generalization performance in the field of medical image segmentation. In contrast to conventional DG, which has strict requirements regarding the availability of multiple source domains, we consider a more challenging problem, that is, single-domain generalization (SDG), where only a single source is available during network training. In this scenario, the augmentation of the entire image to improve the model generalization ability may cause alteration of hue values, resulting in the wrong segmentation of tissues in color medical images. To resolve this problem, we first present a novel illumination-randomized SDG framework to improve the model generalization power for color medical image segmentation by synthesizing randomized illumination maps. Specifically, we devise unsupervised retinex-based image decomposition neural networks (ID-Nets) to decompose color medical images into reflectance and illumination maps. Illumination maps are augmented by performing illumination randomization to generate medical color images under diverse illumination conditions. Second, to measure the quality of retinex-based image decomposition, we devise a novel metric, the transport gradient consistency index, by modeling physical illumination. Extensive experiments are performed to evaluate our proposed framework on two retinal fundus image segmentation tasks: optic cup and disc segmentation. The experimental results demonstrate that our framework outperforms other SDG and image enhancement methods, surpassing the state-of-the-art SDG methods by up to 9.6% with respect to the Dice coefficient. •Illumination-randomized SDG framework improves the generalization capability of CNNs on unseen target datasets.•Unsupervised retinex-based ID-Net decomposes color medical images into illumination and reflectance components.•TGCI measures the quality of retinex-based image decomposition and is strongly related to segmentation performance.
doi_str_mv 10.1016/j.compbiomed.2022.105427
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2666907144</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0010482522002190</els_id><sourcerecordid>2666907144</sourcerecordid><originalsourceid>FETCH-LOGICAL-c402t-bd685388054f6be3aa5444f16f4886c7d853542435170692022e21d1a52c72b23</originalsourceid><addsrcrecordid>eNqFkdtqFTEUhoNY7Lb6ChLwxpvZrhwn-1JLPUBBKO11yGTW1Gxmkm0yI9SnN-O0CN4IgZCsbx3-fxFCGewZMP3-uPdpOnUhTdjvOXBev5Xk7TOyY6Y9NKCEfE52AAwaabg6Jy9LOQKABAEvyLlQyqhWsB2xN6lbykx9GlOmtVzwbqRhcvdIC95PGGc3hxRpPUssiJH2aXIh0u6BZhfrI_zCnoZxXKYQNxbjdxc9rsmvyNngxoKvH-8Lcvfp6vbyS3P97fPXyw_XjZfA56brtVHCmKpi0B0K55SUcmB6kMZo3_Y1WgVKoVgL-rBKRs565hT3Le-4uCDvtrqnnH4sWGY7heJxHF3EtBTLtdYHaJmUFX37D3pMS451upUSDFr9hzIb5XMqJeNgT7nakh8sA7suwR7t3yXYdSK7LaGmvnlssHRr7CnxyfUKfNwArI78DJht8QGrY33I6Gfbp_D_Lr8BLK2caA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2663107644</pqid></control><display><type>article</type><title>Robust color medical image segmentation on unseen domain by randomized illumination enhancement</title><source>Elsevier</source><creator>Zhang, Zuyu ; Li, Yan ; Shin, Byeong-Seok</creator><creatorcontrib>Zhang, Zuyu ; Li, Yan ; Shin, Byeong-Seok</creatorcontrib><description>Owing to the data distribution shifts generated by collecting images using various imaging protocols and device vendors, the generalization capability of deep models is crucial for medical image analysis when applied to test datasets in clinical environments. Domain generalization (DG) methods have shown promising generalization performance in the field of medical image segmentation. In contrast to conventional DG, which has strict requirements regarding the availability of multiple source domains, we consider a more challenging problem, that is, single-domain generalization (SDG), where only a single source is available during network training. In this scenario, the augmentation of the entire image to improve the model generalization ability may cause alteration of hue values, resulting in the wrong segmentation of tissues in color medical images. To resolve this problem, we first present a novel illumination-randomized SDG framework to improve the model generalization power for color medical image segmentation by synthesizing randomized illumination maps. Specifically, we devise unsupervised retinex-based image decomposition neural networks (ID-Nets) to decompose color medical images into reflectance and illumination maps. Illumination maps are augmented by performing illumination randomization to generate medical color images under diverse illumination conditions. Second, to measure the quality of retinex-based image decomposition, we devise a novel metric, the transport gradient consistency index, by modeling physical illumination. Extensive experiments are performed to evaluate our proposed framework on two retinal fundus image segmentation tasks: optic cup and disc segmentation. The experimental results demonstrate that our framework outperforms other SDG and image enhancement methods, surpassing the state-of-the-art SDG methods by up to 9.6% with respect to the Dice coefficient. •Illumination-randomized SDG framework improves the generalization capability of CNNs on unseen target datasets.•Unsupervised retinex-based ID-Net decomposes color medical images into illumination and reflectance components.•TGCI measures the quality of retinex-based image decomposition and is strongly related to segmentation performance.</description><identifier>ISSN: 0010-4825</identifier><identifier>EISSN: 1879-0534</identifier><identifier>DOI: 10.1016/j.compbiomed.2022.105427</identifier><identifier>PMID: 35585731</identifier><language>eng</language><publisher>United States: Elsevier Ltd</publisher><subject>Clinical medicine ; Color ; Color imagery ; Color vision ; Decomposition ; Diabetic retinopathy ; Domain generalization ; Domains ; Fundus Oculi ; Illumination ; Image analysis ; Image contrast ; Image Enhancement ; Image processing ; Image Processing, Computer-Assisted ; Image quality ; Image segmentation ; Learning ; Lighting ; Luminance distribution ; Medical image segmentation ; Medical imaging ; Neural networks ; Neural Networks, Computer ; Optic Disk ; Randomization</subject><ispartof>Computers in biology and medicine, 2022-06, Vol.145, p.105427-105427, Article 105427</ispartof><rights>2022 Elsevier Ltd</rights><rights>Copyright © 2022 Elsevier Ltd. All rights reserved.</rights><rights>2022. Elsevier Ltd</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c402t-bd685388054f6be3aa5444f16f4886c7d853542435170692022e21d1a52c72b23</citedby><cites>FETCH-LOGICAL-c402t-bd685388054f6be3aa5444f16f4886c7d853542435170692022e21d1a52c72b23</cites><orcidid>0000-0001-5483-237X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/35585731$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Zhang, Zuyu</creatorcontrib><creatorcontrib>Li, Yan</creatorcontrib><creatorcontrib>Shin, Byeong-Seok</creatorcontrib><title>Robust color medical image segmentation on unseen domain by randomized illumination enhancement</title><title>Computers in biology and medicine</title><addtitle>Comput Biol Med</addtitle><description>Owing to the data distribution shifts generated by collecting images using various imaging protocols and device vendors, the generalization capability of deep models is crucial for medical image analysis when applied to test datasets in clinical environments. Domain generalization (DG) methods have shown promising generalization performance in the field of medical image segmentation. In contrast to conventional DG, which has strict requirements regarding the availability of multiple source domains, we consider a more challenging problem, that is, single-domain generalization (SDG), where only a single source is available during network training. In this scenario, the augmentation of the entire image to improve the model generalization ability may cause alteration of hue values, resulting in the wrong segmentation of tissues in color medical images. To resolve this problem, we first present a novel illumination-randomized SDG framework to improve the model generalization power for color medical image segmentation by synthesizing randomized illumination maps. Specifically, we devise unsupervised retinex-based image decomposition neural networks (ID-Nets) to decompose color medical images into reflectance and illumination maps. Illumination maps are augmented by performing illumination randomization to generate medical color images under diverse illumination conditions. Second, to measure the quality of retinex-based image decomposition, we devise a novel metric, the transport gradient consistency index, by modeling physical illumination. Extensive experiments are performed to evaluate our proposed framework on two retinal fundus image segmentation tasks: optic cup and disc segmentation. The experimental results demonstrate that our framework outperforms other SDG and image enhancement methods, surpassing the state-of-the-art SDG methods by up to 9.6% with respect to the Dice coefficient. •Illumination-randomized SDG framework improves the generalization capability of CNNs on unseen target datasets.•Unsupervised retinex-based ID-Net decomposes color medical images into illumination and reflectance components.•TGCI measures the quality of retinex-based image decomposition and is strongly related to segmentation performance.</description><subject>Clinical medicine</subject><subject>Color</subject><subject>Color imagery</subject><subject>Color vision</subject><subject>Decomposition</subject><subject>Diabetic retinopathy</subject><subject>Domain generalization</subject><subject>Domains</subject><subject>Fundus Oculi</subject><subject>Illumination</subject><subject>Image analysis</subject><subject>Image contrast</subject><subject>Image Enhancement</subject><subject>Image processing</subject><subject>Image Processing, Computer-Assisted</subject><subject>Image quality</subject><subject>Image segmentation</subject><subject>Learning</subject><subject>Lighting</subject><subject>Luminance distribution</subject><subject>Medical image segmentation</subject><subject>Medical imaging</subject><subject>Neural networks</subject><subject>Neural Networks, Computer</subject><subject>Optic Disk</subject><subject>Randomization</subject><issn>0010-4825</issn><issn>1879-0534</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><recordid>eNqFkdtqFTEUhoNY7Lb6ChLwxpvZrhwn-1JLPUBBKO11yGTW1Gxmkm0yI9SnN-O0CN4IgZCsbx3-fxFCGewZMP3-uPdpOnUhTdjvOXBev5Xk7TOyY6Y9NKCEfE52AAwaabg6Jy9LOQKABAEvyLlQyqhWsB2xN6lbykx9GlOmtVzwbqRhcvdIC95PGGc3hxRpPUssiJH2aXIh0u6BZhfrI_zCnoZxXKYQNxbjdxc9rsmvyNngxoKvH-8Lcvfp6vbyS3P97fPXyw_XjZfA56brtVHCmKpi0B0K55SUcmB6kMZo3_Y1WgVKoVgL-rBKRs565hT3Le-4uCDvtrqnnH4sWGY7heJxHF3EtBTLtdYHaJmUFX37D3pMS451upUSDFr9hzIb5XMqJeNgT7nakh8sA7suwR7t3yXYdSK7LaGmvnlssHRr7CnxyfUKfNwArI78DJht8QGrY33I6Gfbp_D_Lr8BLK2caA</recordid><startdate>202206</startdate><enddate>202206</enddate><creator>Zhang, Zuyu</creator><creator>Li, Yan</creator><creator>Shin, Byeong-Seok</creator><general>Elsevier Ltd</general><general>Elsevier Limited</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7RV</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8AL</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FH</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>BHPHI</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FR3</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>K9.</scope><scope>KB0</scope><scope>LK8</scope><scope>M0N</scope><scope>M0S</scope><scope>M1P</scope><scope>M2O</scope><scope>M7P</scope><scope>M7Z</scope><scope>MBDVC</scope><scope>NAPCQ</scope><scope>P5Z</scope><scope>P62</scope><scope>P64</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>Q9U</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0001-5483-237X</orcidid></search><sort><creationdate>202206</creationdate><title>Robust color medical image segmentation on unseen domain by randomized illumination enhancement</title><author>Zhang, Zuyu ; Li, Yan ; Shin, Byeong-Seok</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c402t-bd685388054f6be3aa5444f16f4886c7d853542435170692022e21d1a52c72b23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Clinical medicine</topic><topic>Color</topic><topic>Color imagery</topic><topic>Color vision</topic><topic>Decomposition</topic><topic>Diabetic retinopathy</topic><topic>Domain generalization</topic><topic>Domains</topic><topic>Fundus Oculi</topic><topic>Illumination</topic><topic>Image analysis</topic><topic>Image contrast</topic><topic>Image Enhancement</topic><topic>Image processing</topic><topic>Image Processing, Computer-Assisted</topic><topic>Image quality</topic><topic>Image segmentation</topic><topic>Learning</topic><topic>Lighting</topic><topic>Luminance distribution</topic><topic>Medical image segmentation</topic><topic>Medical imaging</topic><topic>Neural networks</topic><topic>Neural Networks, Computer</topic><topic>Optic Disk</topic><topic>Randomization</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhang, Zuyu</creatorcontrib><creatorcontrib>Li, Yan</creatorcontrib><creatorcontrib>Shin, Byeong-Seok</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Nursing &amp; Allied Health Database</collection><collection>Health &amp; Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>Natural Science Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Engineering Research Database</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Nursing &amp; Allied Health Database (Alumni Edition)</collection><collection>ProQuest Biological Science Collection</collection><collection>Computing Database</collection><collection>Health &amp; Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Research Library</collection><collection>Biological Science Database</collection><collection>Biochemistry Abstracts 1</collection><collection>Research Library (Corporate)</collection><collection>Nursing &amp; Allied Health Premium</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest Central Basic</collection><collection>MEDLINE - Academic</collection><jtitle>Computers in biology and medicine</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhang, Zuyu</au><au>Li, Yan</au><au>Shin, Byeong-Seok</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Robust color medical image segmentation on unseen domain by randomized illumination enhancement</atitle><jtitle>Computers in biology and medicine</jtitle><addtitle>Comput Biol Med</addtitle><date>2022-06</date><risdate>2022</risdate><volume>145</volume><spage>105427</spage><epage>105427</epage><pages>105427-105427</pages><artnum>105427</artnum><issn>0010-4825</issn><eissn>1879-0534</eissn><abstract>Owing to the data distribution shifts generated by collecting images using various imaging protocols and device vendors, the generalization capability of deep models is crucial for medical image analysis when applied to test datasets in clinical environments. Domain generalization (DG) methods have shown promising generalization performance in the field of medical image segmentation. In contrast to conventional DG, which has strict requirements regarding the availability of multiple source domains, we consider a more challenging problem, that is, single-domain generalization (SDG), where only a single source is available during network training. In this scenario, the augmentation of the entire image to improve the model generalization ability may cause alteration of hue values, resulting in the wrong segmentation of tissues in color medical images. To resolve this problem, we first present a novel illumination-randomized SDG framework to improve the model generalization power for color medical image segmentation by synthesizing randomized illumination maps. Specifically, we devise unsupervised retinex-based image decomposition neural networks (ID-Nets) to decompose color medical images into reflectance and illumination maps. Illumination maps are augmented by performing illumination randomization to generate medical color images under diverse illumination conditions. Second, to measure the quality of retinex-based image decomposition, we devise a novel metric, the transport gradient consistency index, by modeling physical illumination. Extensive experiments are performed to evaluate our proposed framework on two retinal fundus image segmentation tasks: optic cup and disc segmentation. The experimental results demonstrate that our framework outperforms other SDG and image enhancement methods, surpassing the state-of-the-art SDG methods by up to 9.6% with respect to the Dice coefficient. •Illumination-randomized SDG framework improves the generalization capability of CNNs on unseen target datasets.•Unsupervised retinex-based ID-Net decomposes color medical images into illumination and reflectance components.•TGCI measures the quality of retinex-based image decomposition and is strongly related to segmentation performance.</abstract><cop>United States</cop><pub>Elsevier Ltd</pub><pmid>35585731</pmid><doi>10.1016/j.compbiomed.2022.105427</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0001-5483-237X</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0010-4825
ispartof Computers in biology and medicine, 2022-06, Vol.145, p.105427-105427, Article 105427
issn 0010-4825
1879-0534
language eng
recordid cdi_proquest_miscellaneous_2666907144
source Elsevier
subjects Clinical medicine
Color
Color imagery
Color vision
Decomposition
Diabetic retinopathy
Domain generalization
Domains
Fundus Oculi
Illumination
Image analysis
Image contrast
Image Enhancement
Image processing
Image Processing, Computer-Assisted
Image quality
Image segmentation
Learning
Lighting
Luminance distribution
Medical image segmentation
Medical imaging
Neural networks
Neural Networks, Computer
Optic Disk
Randomization
title Robust color medical image segmentation on unseen domain by randomized illumination enhancement
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T18%3A44%3A05IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Robust%20color%20medical%20image%20segmentation%20on%20unseen%20domain%20by%20randomized%20illumination%20enhancement&rft.jtitle=Computers%20in%20biology%20and%20medicine&rft.au=Zhang,%20Zuyu&rft.date=2022-06&rft.volume=145&rft.spage=105427&rft.epage=105427&rft.pages=105427-105427&rft.artnum=105427&rft.issn=0010-4825&rft.eissn=1879-0534&rft_id=info:doi/10.1016/j.compbiomed.2022.105427&rft_dat=%3Cproquest_cross%3E2666907144%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c402t-bd685388054f6be3aa5444f16f4886c7d853542435170692022e21d1a52c72b23%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2663107644&rft_id=info:pmid/35585731&rfr_iscdi=true