Loading…

Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning

Deformable image registration is a crucial step in medical image analysis for finding a non-linear spatial transformation between a pair of fixed and moving images. Deep registration methods based on Convolutional Neural Networks (CNNs) have been widely used as they can perform image registration in...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2022-06
Main Authors: Meng, Mingyuan, Bi, Lei, Dagan Feng, Kim, Jinman
Format: Article
Language:English
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Meng, Mingyuan
Bi, Lei
Dagan Feng
Kim, Jinman
description Deformable image registration is a crucial step in medical image analysis for finding a non-linear spatial transformation between a pair of fixed and moving images. Deep registration methods based on Convolutional Neural Networks (CNNs) have been widely used as they can perform image registration in a fast and end-to-end manner. However, these methods usually have limited performance for image pairs with large deformations. Recently, iterative deep registration methods have been used to alleviate this limitation, where the transformations are iteratively learned in a coarse-to-fine manner. However, iterative methods inevitably prolong the registration runtime, and tend to learn separate image features for each iteration, which hinders the features from being leveraged to facilitate the registration at later iterations. In this study, we propose a Non-Iterative Coarse-to-finE registration Network (NICE-Net) for deformable image registration. In the NICE-Net, we propose: (i) a Single-pass Deep Cumulative Learning (SDCL) decoder that can cumulatively learn coarse-to-fine transformations within a single pass (iteration) of the network, and (ii) a Selectively-propagated Feature Learning (SFL) encoder that can learn common image features for the whole coarse-to-fine registration process and selectively propagate the features as needed. Extensive experiments on six public datasets of 3D brain Magnetic Resonance Imaging (MRI) show that our proposed NICE-Net can outperform state-of-the-art iterative deep registration methods while only requiring similar runtime to non-iterative methods.
doi_str_mv 10.48550/arxiv.2206.12596
format article
fullrecord <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_2681641347</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2681641347</sourcerecordid><originalsourceid>FETCH-LOGICAL-a527-c46ec876394dc975c1c454e5940283963656537fe0195ed65a7cf4deffe2fa263</originalsourceid><addsrcrecordid>eNotjc1KxDAURoMgOIzzAO4CrlOTm9ykXUr9haKgAy6HmN4MHWpbm3bw8a2Mq-_AgfMxdqVkZnJEeePHn-aYAUibKcDCnrEVaK1EbgAu2Calg5QSrANEvWIfL30nmolGPzVH4mXvx0Ri6kVsOuJvtG_S9Of6jn_6RDVf4L3p9i2JwafE74gGXs5fc3sKVOTHbvGX7Dz6NtHmf9ds-3C_LZ9E9fr4XN5WwiM4EYylkDurC1OHwmFQwaAhLIyEXBdWW7SoXSSpCqTaonchmppiJIgerF6z61N2GPvvmdK0O_Tz2C2PO7C5skZp4_QvdF5SyQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2681641347</pqid></control><display><type>article</type><title>Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning</title><source>Publicly Available Content Database</source><creator>Meng, Mingyuan ; Bi, Lei ; Dagan Feng ; Kim, Jinman</creator><creatorcontrib>Meng, Mingyuan ; Bi, Lei ; Dagan Feng ; Kim, Jinman</creatorcontrib><description>Deformable image registration is a crucial step in medical image analysis for finding a non-linear spatial transformation between a pair of fixed and moving images. Deep registration methods based on Convolutional Neural Networks (CNNs) have been widely used as they can perform image registration in a fast and end-to-end manner. However, these methods usually have limited performance for image pairs with large deformations. Recently, iterative deep registration methods have been used to alleviate this limitation, where the transformations are iteratively learned in a coarse-to-fine manner. However, iterative methods inevitably prolong the registration runtime, and tend to learn separate image features for each iteration, which hinders the features from being leveraged to facilitate the registration at later iterations. In this study, we propose a Non-Iterative Coarse-to-finE registration Network (NICE-Net) for deformable image registration. In the NICE-Net, we propose: (i) a Single-pass Deep Cumulative Learning (SDCL) decoder that can cumulatively learn coarse-to-fine transformations within a single pass (iteration) of the network, and (ii) a Selectively-propagated Feature Learning (SFL) encoder that can learn common image features for the whole coarse-to-fine registration process and selectively propagate the features as needed. Extensive experiments on six public datasets of 3D brain Magnetic Resonance Imaging (MRI) show that our proposed NICE-Net can outperform state-of-the-art iterative deep registration methods while only requiring similar runtime to non-iterative methods.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.2206.12596</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Artificial neural networks ; Coders ; Deformation ; Formability ; Image analysis ; Image registration ; Iterative methods ; Learning ; Magnetic resonance imaging ; Medical imaging ; Moving images ; Registration ; Transformations</subject><ispartof>arXiv.org, 2022-06</ispartof><rights>2022. This work is published under http://creativecommons.org/licenses/by-nc-sa/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/2681641347?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>780,784,25753,27925,37012,44590</link.rule.ids></links><search><creatorcontrib>Meng, Mingyuan</creatorcontrib><creatorcontrib>Bi, Lei</creatorcontrib><creatorcontrib>Dagan Feng</creatorcontrib><creatorcontrib>Kim, Jinman</creatorcontrib><title>Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning</title><title>arXiv.org</title><description>Deformable image registration is a crucial step in medical image analysis for finding a non-linear spatial transformation between a pair of fixed and moving images. Deep registration methods based on Convolutional Neural Networks (CNNs) have been widely used as they can perform image registration in a fast and end-to-end manner. However, these methods usually have limited performance for image pairs with large deformations. Recently, iterative deep registration methods have been used to alleviate this limitation, where the transformations are iteratively learned in a coarse-to-fine manner. However, iterative methods inevitably prolong the registration runtime, and tend to learn separate image features for each iteration, which hinders the features from being leveraged to facilitate the registration at later iterations. In this study, we propose a Non-Iterative Coarse-to-finE registration Network (NICE-Net) for deformable image registration. In the NICE-Net, we propose: (i) a Single-pass Deep Cumulative Learning (SDCL) decoder that can cumulatively learn coarse-to-fine transformations within a single pass (iteration) of the network, and (ii) a Selectively-propagated Feature Learning (SFL) encoder that can learn common image features for the whole coarse-to-fine registration process and selectively propagate the features as needed. Extensive experiments on six public datasets of 3D brain Magnetic Resonance Imaging (MRI) show that our proposed NICE-Net can outperform state-of-the-art iterative deep registration methods while only requiring similar runtime to non-iterative methods.</description><subject>Artificial neural networks</subject><subject>Coders</subject><subject>Deformation</subject><subject>Formability</subject><subject>Image analysis</subject><subject>Image registration</subject><subject>Iterative methods</subject><subject>Learning</subject><subject>Magnetic resonance imaging</subject><subject>Medical imaging</subject><subject>Moving images</subject><subject>Registration</subject><subject>Transformations</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNotjc1KxDAURoMgOIzzAO4CrlOTm9ykXUr9haKgAy6HmN4MHWpbm3bw8a2Mq-_AgfMxdqVkZnJEeePHn-aYAUibKcDCnrEVaK1EbgAu2Calg5QSrANEvWIfL30nmolGPzVH4mXvx0Ri6kVsOuJvtG_S9Of6jn_6RDVf4L3p9i2JwafE74gGXs5fc3sKVOTHbvGX7Dz6NtHmf9ds-3C_LZ9E9fr4XN5WwiM4EYylkDurC1OHwmFQwaAhLIyEXBdWW7SoXSSpCqTaonchmppiJIgerF6z61N2GPvvmdK0O_Tz2C2PO7C5skZp4_QvdF5SyQ</recordid><startdate>20220630</startdate><enddate>20220630</enddate><creator>Meng, Mingyuan</creator><creator>Bi, Lei</creator><creator>Dagan Feng</creator><creator>Kim, Jinman</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope></search><sort><creationdate>20220630</creationdate><title>Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning</title><author>Meng, Mingyuan ; Bi, Lei ; Dagan Feng ; Kim, Jinman</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a527-c46ec876394dc975c1c454e5940283963656537fe0195ed65a7cf4deffe2fa263</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Artificial neural networks</topic><topic>Coders</topic><topic>Deformation</topic><topic>Formability</topic><topic>Image analysis</topic><topic>Image registration</topic><topic>Iterative methods</topic><topic>Learning</topic><topic>Magnetic resonance imaging</topic><topic>Medical imaging</topic><topic>Moving images</topic><topic>Registration</topic><topic>Transformations</topic><toplevel>online_resources</toplevel><creatorcontrib>Meng, Mingyuan</creatorcontrib><creatorcontrib>Bi, Lei</creatorcontrib><creatorcontrib>Dagan Feng</creatorcontrib><creatorcontrib>Kim, Jinman</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering collection</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Meng, Mingyuan</au><au>Bi, Lei</au><au>Dagan Feng</au><au>Kim, Jinman</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning</atitle><jtitle>arXiv.org</jtitle><date>2022-06-30</date><risdate>2022</risdate><eissn>2331-8422</eissn><abstract>Deformable image registration is a crucial step in medical image analysis for finding a non-linear spatial transformation between a pair of fixed and moving images. Deep registration methods based on Convolutional Neural Networks (CNNs) have been widely used as they can perform image registration in a fast and end-to-end manner. However, these methods usually have limited performance for image pairs with large deformations. Recently, iterative deep registration methods have been used to alleviate this limitation, where the transformations are iteratively learned in a coarse-to-fine manner. However, iterative methods inevitably prolong the registration runtime, and tend to learn separate image features for each iteration, which hinders the features from being leveraged to facilitate the registration at later iterations. In this study, we propose a Non-Iterative Coarse-to-finE registration Network (NICE-Net) for deformable image registration. In the NICE-Net, we propose: (i) a Single-pass Deep Cumulative Learning (SDCL) decoder that can cumulatively learn coarse-to-fine transformations within a single pass (iteration) of the network, and (ii) a Selectively-propagated Feature Learning (SFL) encoder that can learn common image features for the whole coarse-to-fine registration process and selectively propagate the features as needed. Extensive experiments on six public datasets of 3D brain Magnetic Resonance Imaging (MRI) show that our proposed NICE-Net can outperform state-of-the-art iterative deep registration methods while only requiring similar runtime to non-iterative methods.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.2206.12596</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2022-06
issn 2331-8422
language eng
recordid cdi_proquest_journals_2681641347
source Publicly Available Content Database
subjects Artificial neural networks
Coders
Deformation
Formability
Image analysis
Image registration
Iterative methods
Learning
Magnetic resonance imaging
Medical imaging
Moving images
Registration
Transformations
title Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-29T09%3A33%3A48IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Non-iterative%20Coarse-to-fine%20Registration%20based%20on%20Single-pass%20Deep%20Cumulative%20Learning&rft.jtitle=arXiv.org&rft.au=Meng,%20Mingyuan&rft.date=2022-06-30&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.2206.12596&rft_dat=%3Cproquest%3E2681641347%3C/proquest%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-a527-c46ec876394dc975c1c454e5940283963656537fe0195ed65a7cf4deffe2fa263%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2681641347&rft_id=info:pmid/&rfr_iscdi=true