Loading…
Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning
Deformable image registration is a crucial step in medical image analysis for finding a non-linear spatial transformation between a pair of fixed and moving images. Deep registration methods based on Convolutional Neural Networks (CNNs) have been widely used as they can perform image registration in...
Saved in:
Published in: | arXiv.org 2022-06 |
---|---|
Main Authors: | , , , |
Format: | Article |
Language: | English |
Subjects: | |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | |
---|---|
cites | |
container_end_page | |
container_issue | |
container_start_page | |
container_title | arXiv.org |
container_volume | |
creator | Meng, Mingyuan Bi, Lei Dagan Feng Kim, Jinman |
description | Deformable image registration is a crucial step in medical image analysis for finding a non-linear spatial transformation between a pair of fixed and moving images. Deep registration methods based on Convolutional Neural Networks (CNNs) have been widely used as they can perform image registration in a fast and end-to-end manner. However, these methods usually have limited performance for image pairs with large deformations. Recently, iterative deep registration methods have been used to alleviate this limitation, where the transformations are iteratively learned in a coarse-to-fine manner. However, iterative methods inevitably prolong the registration runtime, and tend to learn separate image features for each iteration, which hinders the features from being leveraged to facilitate the registration at later iterations. In this study, we propose a Non-Iterative Coarse-to-finE registration Network (NICE-Net) for deformable image registration. In the NICE-Net, we propose: (i) a Single-pass Deep Cumulative Learning (SDCL) decoder that can cumulatively learn coarse-to-fine transformations within a single pass (iteration) of the network, and (ii) a Selectively-propagated Feature Learning (SFL) encoder that can learn common image features for the whole coarse-to-fine registration process and selectively propagate the features as needed. Extensive experiments on six public datasets of 3D brain Magnetic Resonance Imaging (MRI) show that our proposed NICE-Net can outperform state-of-the-art iterative deep registration methods while only requiring similar runtime to non-iterative methods. |
doi_str_mv | 10.48550/arxiv.2206.12596 |
format | article |
fullrecord | <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_2681641347</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2681641347</sourcerecordid><originalsourceid>FETCH-LOGICAL-a527-c46ec876394dc975c1c454e5940283963656537fe0195ed65a7cf4deffe2fa263</originalsourceid><addsrcrecordid>eNotjc1KxDAURoMgOIzzAO4CrlOTm9ykXUr9haKgAy6HmN4MHWpbm3bw8a2Mq-_AgfMxdqVkZnJEeePHn-aYAUibKcDCnrEVaK1EbgAu2Calg5QSrANEvWIfL30nmolGPzVH4mXvx0Ri6kVsOuJvtG_S9Of6jn_6RDVf4L3p9i2JwafE74gGXs5fc3sKVOTHbvGX7Dz6NtHmf9ds-3C_LZ9E9fr4XN5WwiM4EYylkDurC1OHwmFQwaAhLIyEXBdWW7SoXSSpCqTaonchmppiJIgerF6z61N2GPvvmdK0O_Tz2C2PO7C5skZp4_QvdF5SyQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2681641347</pqid></control><display><type>article</type><title>Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning</title><source>Publicly Available Content Database</source><creator>Meng, Mingyuan ; Bi, Lei ; Dagan Feng ; Kim, Jinman</creator><creatorcontrib>Meng, Mingyuan ; Bi, Lei ; Dagan Feng ; Kim, Jinman</creatorcontrib><description>Deformable image registration is a crucial step in medical image analysis for finding a non-linear spatial transformation between a pair of fixed and moving images. Deep registration methods based on Convolutional Neural Networks (CNNs) have been widely used as they can perform image registration in a fast and end-to-end manner. However, these methods usually have limited performance for image pairs with large deformations. Recently, iterative deep registration methods have been used to alleviate this limitation, where the transformations are iteratively learned in a coarse-to-fine manner. However, iterative methods inevitably prolong the registration runtime, and tend to learn separate image features for each iteration, which hinders the features from being leveraged to facilitate the registration at later iterations. In this study, we propose a Non-Iterative Coarse-to-finE registration Network (NICE-Net) for deformable image registration. In the NICE-Net, we propose: (i) a Single-pass Deep Cumulative Learning (SDCL) decoder that can cumulatively learn coarse-to-fine transformations within a single pass (iteration) of the network, and (ii) a Selectively-propagated Feature Learning (SFL) encoder that can learn common image features for the whole coarse-to-fine registration process and selectively propagate the features as needed. Extensive experiments on six public datasets of 3D brain Magnetic Resonance Imaging (MRI) show that our proposed NICE-Net can outperform state-of-the-art iterative deep registration methods while only requiring similar runtime to non-iterative methods.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.2206.12596</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Artificial neural networks ; Coders ; Deformation ; Formability ; Image analysis ; Image registration ; Iterative methods ; Learning ; Magnetic resonance imaging ; Medical imaging ; Moving images ; Registration ; Transformations</subject><ispartof>arXiv.org, 2022-06</ispartof><rights>2022. This work is published under http://creativecommons.org/licenses/by-nc-sa/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/2681641347?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>780,784,25753,27925,37012,44590</link.rule.ids></links><search><creatorcontrib>Meng, Mingyuan</creatorcontrib><creatorcontrib>Bi, Lei</creatorcontrib><creatorcontrib>Dagan Feng</creatorcontrib><creatorcontrib>Kim, Jinman</creatorcontrib><title>Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning</title><title>arXiv.org</title><description>Deformable image registration is a crucial step in medical image analysis for finding a non-linear spatial transformation between a pair of fixed and moving images. Deep registration methods based on Convolutional Neural Networks (CNNs) have been widely used as they can perform image registration in a fast and end-to-end manner. However, these methods usually have limited performance for image pairs with large deformations. Recently, iterative deep registration methods have been used to alleviate this limitation, where the transformations are iteratively learned in a coarse-to-fine manner. However, iterative methods inevitably prolong the registration runtime, and tend to learn separate image features for each iteration, which hinders the features from being leveraged to facilitate the registration at later iterations. In this study, we propose a Non-Iterative Coarse-to-finE registration Network (NICE-Net) for deformable image registration. In the NICE-Net, we propose: (i) a Single-pass Deep Cumulative Learning (SDCL) decoder that can cumulatively learn coarse-to-fine transformations within a single pass (iteration) of the network, and (ii) a Selectively-propagated Feature Learning (SFL) encoder that can learn common image features for the whole coarse-to-fine registration process and selectively propagate the features as needed. Extensive experiments on six public datasets of 3D brain Magnetic Resonance Imaging (MRI) show that our proposed NICE-Net can outperform state-of-the-art iterative deep registration methods while only requiring similar runtime to non-iterative methods.</description><subject>Artificial neural networks</subject><subject>Coders</subject><subject>Deformation</subject><subject>Formability</subject><subject>Image analysis</subject><subject>Image registration</subject><subject>Iterative methods</subject><subject>Learning</subject><subject>Magnetic resonance imaging</subject><subject>Medical imaging</subject><subject>Moving images</subject><subject>Registration</subject><subject>Transformations</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNotjc1KxDAURoMgOIzzAO4CrlOTm9ykXUr9haKgAy6HmN4MHWpbm3bw8a2Mq-_AgfMxdqVkZnJEeePHn-aYAUibKcDCnrEVaK1EbgAu2Calg5QSrANEvWIfL30nmolGPzVH4mXvx0Ri6kVsOuJvtG_S9Of6jn_6RDVf4L3p9i2JwafE74gGXs5fc3sKVOTHbvGX7Dz6NtHmf9ds-3C_LZ9E9fr4XN5WwiM4EYylkDurC1OHwmFQwaAhLIyEXBdWW7SoXSSpCqTaonchmppiJIgerF6z61N2GPvvmdK0O_Tz2C2PO7C5skZp4_QvdF5SyQ</recordid><startdate>20220630</startdate><enddate>20220630</enddate><creator>Meng, Mingyuan</creator><creator>Bi, Lei</creator><creator>Dagan Feng</creator><creator>Kim, Jinman</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope></search><sort><creationdate>20220630</creationdate><title>Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning</title><author>Meng, Mingyuan ; Bi, Lei ; Dagan Feng ; Kim, Jinman</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a527-c46ec876394dc975c1c454e5940283963656537fe0195ed65a7cf4deffe2fa263</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Artificial neural networks</topic><topic>Coders</topic><topic>Deformation</topic><topic>Formability</topic><topic>Image analysis</topic><topic>Image registration</topic><topic>Iterative methods</topic><topic>Learning</topic><topic>Magnetic resonance imaging</topic><topic>Medical imaging</topic><topic>Moving images</topic><topic>Registration</topic><topic>Transformations</topic><toplevel>online_resources</toplevel><creatorcontrib>Meng, Mingyuan</creatorcontrib><creatorcontrib>Bi, Lei</creatorcontrib><creatorcontrib>Dagan Feng</creatorcontrib><creatorcontrib>Kim, Jinman</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering collection</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Meng, Mingyuan</au><au>Bi, Lei</au><au>Dagan Feng</au><au>Kim, Jinman</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning</atitle><jtitle>arXiv.org</jtitle><date>2022-06-30</date><risdate>2022</risdate><eissn>2331-8422</eissn><abstract>Deformable image registration is a crucial step in medical image analysis for finding a non-linear spatial transformation between a pair of fixed and moving images. Deep registration methods based on Convolutional Neural Networks (CNNs) have been widely used as they can perform image registration in a fast and end-to-end manner. However, these methods usually have limited performance for image pairs with large deformations. Recently, iterative deep registration methods have been used to alleviate this limitation, where the transformations are iteratively learned in a coarse-to-fine manner. However, iterative methods inevitably prolong the registration runtime, and tend to learn separate image features for each iteration, which hinders the features from being leveraged to facilitate the registration at later iterations. In this study, we propose a Non-Iterative Coarse-to-finE registration Network (NICE-Net) for deformable image registration. In the NICE-Net, we propose: (i) a Single-pass Deep Cumulative Learning (SDCL) decoder that can cumulatively learn coarse-to-fine transformations within a single pass (iteration) of the network, and (ii) a Selectively-propagated Feature Learning (SFL) encoder that can learn common image features for the whole coarse-to-fine registration process and selectively propagate the features as needed. Extensive experiments on six public datasets of 3D brain Magnetic Resonance Imaging (MRI) show that our proposed NICE-Net can outperform state-of-the-art iterative deep registration methods while only requiring similar runtime to non-iterative methods.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.2206.12596</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | EISSN: 2331-8422 |
ispartof | arXiv.org, 2022-06 |
issn | 2331-8422 |
language | eng |
recordid | cdi_proquest_journals_2681641347 |
source | Publicly Available Content Database |
subjects | Artificial neural networks Coders Deformation Formability Image analysis Image registration Iterative methods Learning Magnetic resonance imaging Medical imaging Moving images Registration Transformations |
title | Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-29T09%3A33%3A48IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Non-iterative%20Coarse-to-fine%20Registration%20based%20on%20Single-pass%20Deep%20Cumulative%20Learning&rft.jtitle=arXiv.org&rft.au=Meng,%20Mingyuan&rft.date=2022-06-30&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.2206.12596&rft_dat=%3Cproquest%3E2681641347%3C/proquest%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-a527-c46ec876394dc975c1c454e5940283963656537fe0195ed65a7cf4deffe2fa263%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2681641347&rft_id=info:pmid/&rfr_iscdi=true |