Loading…

Automatic brain MRI motion artifact detection based on end-to-end deep learning is similarly effective as traditional machine learning trained on image quality metrics

•N = 2072 brain MRI scans rated by neuroradiologists from a clinical perspective.•Lightweight 3D CNN achieves ∼94% balanced accuracy in identifying severe head motion.•SVM trained on IQMs achieves comparably high balanced accuracy of ∼88%.•No significant difference between models regarding confusion...

Full description

Saved in:
Bibliographic Details
Published in:Medical image analysis 2023-08, Vol.88, p.102850-102850, Article 102850
Main Authors: Vakli, Pál, Weiss, Béla, Szalma, János, Barsi, Péter, Gyuricza, István, Kemenczky, Péter, Somogyi, Eszter, Nárai, Ádám, Gál, Viktor, Hermann, Petra, Vidnyánszky, Zoltán
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c404t-882485923777e5ba41eb70e6d99e4efe023c552d74dd41b997ff8fbc1089138f3
cites cdi_FETCH-LOGICAL-c404t-882485923777e5ba41eb70e6d99e4efe023c552d74dd41b997ff8fbc1089138f3
container_end_page 102850
container_issue
container_start_page 102850
container_title Medical image analysis
container_volume 88
creator Vakli, Pál
Weiss, Béla
Szalma, János
Barsi, Péter
Gyuricza, István
Kemenczky, Péter
Somogyi, Eszter
Nárai, Ádám
Gál, Viktor
Hermann, Petra
Vidnyánszky, Zoltán
description •N = 2072 brain MRI scans rated by neuroradiologists from a clinical perspective.•Lightweight 3D CNN achieves ∼94% balanced accuracy in identifying severe head motion.•SVM trained on IQMs achieves comparably high balanced accuracy of ∼88%.•No significant difference between models regarding confusion matrix, error rate, ROC. Head motion artifacts in magnetic resonance imaging (MRI) are an important confounding factor concerning brain research as well as clinical practice. For this reason, several machine learning-based methods have been developed for the automatic quality control of structural MRI scans. Deep learning offers a promising solution to this problem, however, given its data-hungry nature and the scarcity of expert-annotated datasets, its advantage over traditional machine learning methods in identifying motion-corrupted brain scans is yet to be determined. In the present study, we investigated the relative advantage of the two methods in structural MRI quality control. To this end, we collected publicly available T1-weighted images and scanned subjects in our own lab under conventional and active head motion conditions. The quality of the images was rated by a team of radiologists from the point of view of clinical diagnostic use. We present a relatively simple, lightweight 3D convolutional neural network trained in an end-to-end manner that achieved a test set (N = 411) balanced accuracy of 94.41% in classifying brain scans into clinically usable or unusable categories. A support vector machine trained on image quality metrics achieved a balanced accuracy of 88.44% on the same test set. Statistical comparison of the two models yielded no significant difference in terms of confusion matrices, error rates, or receiver operating characteristic curves. Our results suggest that these machine learning methods are similarly effective in identifying severe motion artifacts in brain MRI scans, and underline the efficacy of end-to-end deep learning-based systems in brain MRI quality control, allowing the rapid evaluation of diagnostic utility without the need for elaborate image pre-processing. [Display omitted]
doi_str_mv 10.1016/j.media.2023.102850
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2822379750</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S136184152300110X</els_id><sourcerecordid>2822379750</sourcerecordid><originalsourceid>FETCH-LOGICAL-c404t-882485923777e5ba41eb70e6d99e4efe023c552d74dd41b997ff8fbc1089138f3</originalsourceid><addsrcrecordid>eNp9UcluFDEQbSEQWeALkJCPXHrw1mP3gUMUBRIpUSSUnC23XQ416mViuyPNF_GbuNMh3DhVqeotdr2q-sTohlG2_brbDODRbjjloky4buib6piJLau15OLta8-ao-okpR2lVElJ31dHQvGtYFQfV7_P5jwNNqMjXbQ4kpufV2SYMk4jsTFjsC4TDxnc86izCTwpDYy-zlNdStnCnvRg44jjA8FEEg7Y29gfCISwEJ-A2ERytB4XFduTwbpfOMI_Wl7MV2kc7AOQx9n2mA9kgBzRpQ_Vu2D7BB9f6ml1__3i7vyyvr79cXV-dl07SWWuteZSNy0XSiloOisZdIrC1rctSAhQTuWahnslvZesa1sVgg6dK7domdBBnFZfVt19nB5nSNkMmBz0vR1hmpPhmhfxVjW0QMUKdXFKKUIw-1jeHg-GUbMkZHbmOSGzJGTWhArr84vB3JXtK-dvJAXwbQVA-eYTQjTJIYyuKMVyTOMn_K_BH4JvpaU</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2822379750</pqid></control><display><type>article</type><title>Automatic brain MRI motion artifact detection based on end-to-end deep learning is similarly effective as traditional machine learning trained on image quality metrics</title><source>Elsevier</source><creator>Vakli, Pál ; Weiss, Béla ; Szalma, János ; Barsi, Péter ; Gyuricza, István ; Kemenczky, Péter ; Somogyi, Eszter ; Nárai, Ádám ; Gál, Viktor ; Hermann, Petra ; Vidnyánszky, Zoltán</creator><creatorcontrib>Vakli, Pál ; Weiss, Béla ; Szalma, János ; Barsi, Péter ; Gyuricza, István ; Kemenczky, Péter ; Somogyi, Eszter ; Nárai, Ádám ; Gál, Viktor ; Hermann, Petra ; Vidnyánszky, Zoltán</creatorcontrib><description>•N = 2072 brain MRI scans rated by neuroradiologists from a clinical perspective.•Lightweight 3D CNN achieves ∼94% balanced accuracy in identifying severe head motion.•SVM trained on IQMs achieves comparably high balanced accuracy of ∼88%.•No significant difference between models regarding confusion matrix, error rate, ROC. Head motion artifacts in magnetic resonance imaging (MRI) are an important confounding factor concerning brain research as well as clinical practice. For this reason, several machine learning-based methods have been developed for the automatic quality control of structural MRI scans. Deep learning offers a promising solution to this problem, however, given its data-hungry nature and the scarcity of expert-annotated datasets, its advantage over traditional machine learning methods in identifying motion-corrupted brain scans is yet to be determined. In the present study, we investigated the relative advantage of the two methods in structural MRI quality control. To this end, we collected publicly available T1-weighted images and scanned subjects in our own lab under conventional and active head motion conditions. The quality of the images was rated by a team of radiologists from the point of view of clinical diagnostic use. We present a relatively simple, lightweight 3D convolutional neural network trained in an end-to-end manner that achieved a test set (N = 411) balanced accuracy of 94.41% in classifying brain scans into clinically usable or unusable categories. A support vector machine trained on image quality metrics achieved a balanced accuracy of 88.44% on the same test set. Statistical comparison of the two models yielded no significant difference in terms of confusion matrices, error rates, or receiver operating characteristic curves. Our results suggest that these machine learning methods are similarly effective in identifying severe motion artifacts in brain MRI scans, and underline the efficacy of end-to-end deep learning-based systems in brain MRI quality control, allowing the rapid evaluation of diagnostic utility without the need for elaborate image pre-processing. [Display omitted]</description><identifier>ISSN: 1361-8415</identifier><identifier>EISSN: 1361-8423</identifier><identifier>DOI: 10.1016/j.media.2023.102850</identifier><identifier>PMID: 37263108</identifier><language>eng</language><publisher>Netherlands: Elsevier B.V</publisher><subject>Convolutional neural networks ; Head motion ; Image quality metrics ; MRI artifacts ; Support vector machine</subject><ispartof>Medical image analysis, 2023-08, Vol.88, p.102850-102850, Article 102850</ispartof><rights>2023 The Author(s)</rights><rights>Copyright © 2023 The Author(s). Published by Elsevier B.V. All rights reserved.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c404t-882485923777e5ba41eb70e6d99e4efe023c552d74dd41b997ff8fbc1089138f3</citedby><cites>FETCH-LOGICAL-c404t-882485923777e5ba41eb70e6d99e4efe023c552d74dd41b997ff8fbc1089138f3</cites><orcidid>0000-0003-1031-0283 ; 0000-0002-0845-5400 ; 0000-0002-3574-9973 ; 0000-0001-5972-6509</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/37263108$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Vakli, Pál</creatorcontrib><creatorcontrib>Weiss, Béla</creatorcontrib><creatorcontrib>Szalma, János</creatorcontrib><creatorcontrib>Barsi, Péter</creatorcontrib><creatorcontrib>Gyuricza, István</creatorcontrib><creatorcontrib>Kemenczky, Péter</creatorcontrib><creatorcontrib>Somogyi, Eszter</creatorcontrib><creatorcontrib>Nárai, Ádám</creatorcontrib><creatorcontrib>Gál, Viktor</creatorcontrib><creatorcontrib>Hermann, Petra</creatorcontrib><creatorcontrib>Vidnyánszky, Zoltán</creatorcontrib><title>Automatic brain MRI motion artifact detection based on end-to-end deep learning is similarly effective as traditional machine learning trained on image quality metrics</title><title>Medical image analysis</title><addtitle>Med Image Anal</addtitle><description>•N = 2072 brain MRI scans rated by neuroradiologists from a clinical perspective.•Lightweight 3D CNN achieves ∼94% balanced accuracy in identifying severe head motion.•SVM trained on IQMs achieves comparably high balanced accuracy of ∼88%.•No significant difference between models regarding confusion matrix, error rate, ROC. Head motion artifacts in magnetic resonance imaging (MRI) are an important confounding factor concerning brain research as well as clinical practice. For this reason, several machine learning-based methods have been developed for the automatic quality control of structural MRI scans. Deep learning offers a promising solution to this problem, however, given its data-hungry nature and the scarcity of expert-annotated datasets, its advantage over traditional machine learning methods in identifying motion-corrupted brain scans is yet to be determined. In the present study, we investigated the relative advantage of the two methods in structural MRI quality control. To this end, we collected publicly available T1-weighted images and scanned subjects in our own lab under conventional and active head motion conditions. The quality of the images was rated by a team of radiologists from the point of view of clinical diagnostic use. We present a relatively simple, lightweight 3D convolutional neural network trained in an end-to-end manner that achieved a test set (N = 411) balanced accuracy of 94.41% in classifying brain scans into clinically usable or unusable categories. A support vector machine trained on image quality metrics achieved a balanced accuracy of 88.44% on the same test set. Statistical comparison of the two models yielded no significant difference in terms of confusion matrices, error rates, or receiver operating characteristic curves. Our results suggest that these machine learning methods are similarly effective in identifying severe motion artifacts in brain MRI scans, and underline the efficacy of end-to-end deep learning-based systems in brain MRI quality control, allowing the rapid evaluation of diagnostic utility without the need for elaborate image pre-processing. [Display omitted]</description><subject>Convolutional neural networks</subject><subject>Head motion</subject><subject>Image quality metrics</subject><subject>MRI artifacts</subject><subject>Support vector machine</subject><issn>1361-8415</issn><issn>1361-8423</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNp9UcluFDEQbSEQWeALkJCPXHrw1mP3gUMUBRIpUSSUnC23XQ416mViuyPNF_GbuNMh3DhVqeotdr2q-sTohlG2_brbDODRbjjloky4buib6piJLau15OLta8-ao-okpR2lVElJ31dHQvGtYFQfV7_P5jwNNqMjXbQ4kpufV2SYMk4jsTFjsC4TDxnc86izCTwpDYy-zlNdStnCnvRg44jjA8FEEg7Y29gfCISwEJ-A2ERytB4XFduTwbpfOMI_Wl7MV2kc7AOQx9n2mA9kgBzRpQ_Vu2D7BB9f6ml1__3i7vyyvr79cXV-dl07SWWuteZSNy0XSiloOisZdIrC1rctSAhQTuWahnslvZesa1sVgg6dK7domdBBnFZfVt19nB5nSNkMmBz0vR1hmpPhmhfxVjW0QMUKdXFKKUIw-1jeHg-GUbMkZHbmOSGzJGTWhArr84vB3JXtK-dvJAXwbQVA-eYTQjTJIYyuKMVyTOMn_K_BH4JvpaU</recordid><startdate>202308</startdate><enddate>202308</enddate><creator>Vakli, Pál</creator><creator>Weiss, Béla</creator><creator>Szalma, János</creator><creator>Barsi, Péter</creator><creator>Gyuricza, István</creator><creator>Kemenczky, Péter</creator><creator>Somogyi, Eszter</creator><creator>Nárai, Ádám</creator><creator>Gál, Viktor</creator><creator>Hermann, Petra</creator><creator>Vidnyánszky, Zoltán</creator><general>Elsevier B.V</general><scope>6I.</scope><scope>AAFTH</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0003-1031-0283</orcidid><orcidid>https://orcid.org/0000-0002-0845-5400</orcidid><orcidid>https://orcid.org/0000-0002-3574-9973</orcidid><orcidid>https://orcid.org/0000-0001-5972-6509</orcidid></search><sort><creationdate>202308</creationdate><title>Automatic brain MRI motion artifact detection based on end-to-end deep learning is similarly effective as traditional machine learning trained on image quality metrics</title><author>Vakli, Pál ; Weiss, Béla ; Szalma, János ; Barsi, Péter ; Gyuricza, István ; Kemenczky, Péter ; Somogyi, Eszter ; Nárai, Ádám ; Gál, Viktor ; Hermann, Petra ; Vidnyánszky, Zoltán</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c404t-882485923777e5ba41eb70e6d99e4efe023c552d74dd41b997ff8fbc1089138f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Convolutional neural networks</topic><topic>Head motion</topic><topic>Image quality metrics</topic><topic>MRI artifacts</topic><topic>Support vector machine</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Vakli, Pál</creatorcontrib><creatorcontrib>Weiss, Béla</creatorcontrib><creatorcontrib>Szalma, János</creatorcontrib><creatorcontrib>Barsi, Péter</creatorcontrib><creatorcontrib>Gyuricza, István</creatorcontrib><creatorcontrib>Kemenczky, Péter</creatorcontrib><creatorcontrib>Somogyi, Eszter</creatorcontrib><creatorcontrib>Nárai, Ádám</creatorcontrib><creatorcontrib>Gál, Viktor</creatorcontrib><creatorcontrib>Hermann, Petra</creatorcontrib><creatorcontrib>Vidnyánszky, Zoltán</creatorcontrib><collection>ScienceDirect Open Access Titles</collection><collection>Elsevier:ScienceDirect:Open Access</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Medical image analysis</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Vakli, Pál</au><au>Weiss, Béla</au><au>Szalma, János</au><au>Barsi, Péter</au><au>Gyuricza, István</au><au>Kemenczky, Péter</au><au>Somogyi, Eszter</au><au>Nárai, Ádám</au><au>Gál, Viktor</au><au>Hermann, Petra</au><au>Vidnyánszky, Zoltán</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Automatic brain MRI motion artifact detection based on end-to-end deep learning is similarly effective as traditional machine learning trained on image quality metrics</atitle><jtitle>Medical image analysis</jtitle><addtitle>Med Image Anal</addtitle><date>2023-08</date><risdate>2023</risdate><volume>88</volume><spage>102850</spage><epage>102850</epage><pages>102850-102850</pages><artnum>102850</artnum><issn>1361-8415</issn><eissn>1361-8423</eissn><abstract>•N = 2072 brain MRI scans rated by neuroradiologists from a clinical perspective.•Lightweight 3D CNN achieves ∼94% balanced accuracy in identifying severe head motion.•SVM trained on IQMs achieves comparably high balanced accuracy of ∼88%.•No significant difference between models regarding confusion matrix, error rate, ROC. Head motion artifacts in magnetic resonance imaging (MRI) are an important confounding factor concerning brain research as well as clinical practice. For this reason, several machine learning-based methods have been developed for the automatic quality control of structural MRI scans. Deep learning offers a promising solution to this problem, however, given its data-hungry nature and the scarcity of expert-annotated datasets, its advantage over traditional machine learning methods in identifying motion-corrupted brain scans is yet to be determined. In the present study, we investigated the relative advantage of the two methods in structural MRI quality control. To this end, we collected publicly available T1-weighted images and scanned subjects in our own lab under conventional and active head motion conditions. The quality of the images was rated by a team of radiologists from the point of view of clinical diagnostic use. We present a relatively simple, lightweight 3D convolutional neural network trained in an end-to-end manner that achieved a test set (N = 411) balanced accuracy of 94.41% in classifying brain scans into clinically usable or unusable categories. A support vector machine trained on image quality metrics achieved a balanced accuracy of 88.44% on the same test set. Statistical comparison of the two models yielded no significant difference in terms of confusion matrices, error rates, or receiver operating characteristic curves. Our results suggest that these machine learning methods are similarly effective in identifying severe motion artifacts in brain MRI scans, and underline the efficacy of end-to-end deep learning-based systems in brain MRI quality control, allowing the rapid evaluation of diagnostic utility without the need for elaborate image pre-processing. [Display omitted]</abstract><cop>Netherlands</cop><pub>Elsevier B.V</pub><pmid>37263108</pmid><doi>10.1016/j.media.2023.102850</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0003-1031-0283</orcidid><orcidid>https://orcid.org/0000-0002-0845-5400</orcidid><orcidid>https://orcid.org/0000-0002-3574-9973</orcidid><orcidid>https://orcid.org/0000-0001-5972-6509</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1361-8415
ispartof Medical image analysis, 2023-08, Vol.88, p.102850-102850, Article 102850
issn 1361-8415
1361-8423
language eng
recordid cdi_proquest_miscellaneous_2822379750
source Elsevier
subjects Convolutional neural networks
Head motion
Image quality metrics
MRI artifacts
Support vector machine
title Automatic brain MRI motion artifact detection based on end-to-end deep learning is similarly effective as traditional machine learning trained on image quality metrics
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-06T23%3A46%3A39IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Automatic%20brain%20MRI%20motion%20artifact%20detection%20based%20on%20end-to-end%20deep%20learning%20is%20similarly%20effective%20as%20traditional%20machine%20learning%20trained%20on%20image%20quality%20metrics&rft.jtitle=Medical%20image%20analysis&rft.au=Vakli,%20P%C3%A1l&rft.date=2023-08&rft.volume=88&rft.spage=102850&rft.epage=102850&rft.pages=102850-102850&rft.artnum=102850&rft.issn=1361-8415&rft.eissn=1361-8423&rft_id=info:doi/10.1016/j.media.2023.102850&rft_dat=%3Cproquest_cross%3E2822379750%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c404t-882485923777e5ba41eb70e6d99e4efe023c552d74dd41b997ff8fbc1089138f3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2822379750&rft_id=info:pmid/37263108&rfr_iscdi=true