Loading…

ProtoASNet: Dynamic Prototypes for Inherently Interpretable and Uncertainty-Aware Aortic Stenosis Classification in Echocardiography

Aortic stenosis (AS) is a common heart valve disease that requires accurate and timely diagnosis for appropriate treatment. Most current automatic AS severity detection methods rely on black-box models with a low level of trustworthiness, which hinders clinical adoption. To address this issue, we pr...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2023-07
Main Authors: Vaseli, Hooman, Ang Nan Gu, S Neda Ahmadi Amiri, Tsang, Michael Y, Fung, Andrea, Kondori, Nima, Saadat, Armin, Abolmaesumi, Purang, Tsang, Teresa S M
Format: Article
Language:English
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Vaseli, Hooman
Ang Nan Gu
S Neda Ahmadi Amiri
Tsang, Michael Y
Fung, Andrea
Kondori, Nima
Saadat, Armin
Abolmaesumi, Purang
Tsang, Teresa S M
description Aortic stenosis (AS) is a common heart valve disease that requires accurate and timely diagnosis for appropriate treatment. Most current automatic AS severity detection methods rely on black-box models with a low level of trustworthiness, which hinders clinical adoption. To address this issue, we propose ProtoASNet, a prototypical network that directly detects AS from B-mode echocardiography videos, while making interpretable predictions based on the similarity between the input and learned spatio-temporal prototypes. This approach provides supporting evidence that is clinically relevant, as the prototypes typically highlight markers such as calcification and restricted movement of aortic valve leaflets. Moreover, ProtoASNet utilizes abstention loss to estimate aleatoric uncertainty by defining a set of prototypes that capture ambiguity and insufficient information in the observed data. This provides a reliable system that can detect and explain when it may fail. We evaluate ProtoASNet on a private dataset and the publicly available TMED-2 dataset, where it outperforms existing state-of-the-art methods with an accuracy of 80.0% and 79.7%, respectively. Furthermore, ProtoASNet provides interpretability and an uncertainty measure for each prediction, which can improve transparency and facilitate the interactive usage of deep networks to aid clinical decision-making. Our source code is available at: https://github.com/hooman007/ProtoASNet.
format article
fullrecord <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_2843254857</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2843254857</sourcerecordid><originalsourceid>FETCH-proquest_journals_28432548573</originalsourceid><addsrcrecordid>eNqNjEFLw0AQhYMgWLT_YcBzIO4mNngLtaIXEVrPZdxOzJY4E2enyN794QbxB3h6j-99vLNi4by_KdvauYtimdKxqip3u3JN4xfF94uKSbd9JruD-8z4EQP8MssTJehF4YkHUmIb81yNdFIyfBsJkA_wyoHUMLLlsvtCJehEbT7ZGrGkmGA9YkqxjwEtCkNk2IRBAuohyrviNOSr4rzHMdHyLy-L64fNbv1YTiqfJ0q2P8pJeZ72rq29a-q2Wfn_WT8UuVNZ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2843254857</pqid></control><display><type>article</type><title>ProtoASNet: Dynamic Prototypes for Inherently Interpretable and Uncertainty-Aware Aortic Stenosis Classification in Echocardiography</title><source>Publicly Available Content Database</source><creator>Vaseli, Hooman ; Ang Nan Gu ; S Neda Ahmadi Amiri ; Tsang, Michael Y ; Fung, Andrea ; Kondori, Nima ; Saadat, Armin ; Abolmaesumi, Purang ; Tsang, Teresa S M</creator><creatorcontrib>Vaseli, Hooman ; Ang Nan Gu ; S Neda Ahmadi Amiri ; Tsang, Michael Y ; Fung, Andrea ; Kondori, Nima ; Saadat, Armin ; Abolmaesumi, Purang ; Tsang, Teresa S M</creatorcontrib><description>Aortic stenosis (AS) is a common heart valve disease that requires accurate and timely diagnosis for appropriate treatment. Most current automatic AS severity detection methods rely on black-box models with a low level of trustworthiness, which hinders clinical adoption. To address this issue, we propose ProtoASNet, a prototypical network that directly detects AS from B-mode echocardiography videos, while making interpretable predictions based on the similarity between the input and learned spatio-temporal prototypes. This approach provides supporting evidence that is clinically relevant, as the prototypes typically highlight markers such as calcification and restricted movement of aortic valve leaflets. Moreover, ProtoASNet utilizes abstention loss to estimate aleatoric uncertainty by defining a set of prototypes that capture ambiguity and insufficient information in the observed data. This provides a reliable system that can detect and explain when it may fail. We evaluate ProtoASNet on a private dataset and the publicly available TMED-2 dataset, where it outperforms existing state-of-the-art methods with an accuracy of 80.0% and 79.7%, respectively. Furthermore, ProtoASNet provides interpretability and an uncertainty measure for each prediction, which can improve transparency and facilitate the interactive usage of deep networks to aid clinical decision-making. Our source code is available at: https://github.com/hooman007/ProtoASNet.</description><identifier>EISSN: 2331-8422</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Aorta ; Aortic stenosis ; Calcification ; Datasets ; Decision making ; Echocardiography ; Heart valves ; Low level ; Prototypes ; Source code ; Uncertainty ; Valve leaflets</subject><ispartof>arXiv.org, 2023-07</ispartof><rights>2023. This work is published under http://creativecommons.org/licenses/by-nc-sa/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/2843254857?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>780,784,25753,37012,44590</link.rule.ids></links><search><creatorcontrib>Vaseli, Hooman</creatorcontrib><creatorcontrib>Ang Nan Gu</creatorcontrib><creatorcontrib>S Neda Ahmadi Amiri</creatorcontrib><creatorcontrib>Tsang, Michael Y</creatorcontrib><creatorcontrib>Fung, Andrea</creatorcontrib><creatorcontrib>Kondori, Nima</creatorcontrib><creatorcontrib>Saadat, Armin</creatorcontrib><creatorcontrib>Abolmaesumi, Purang</creatorcontrib><creatorcontrib>Tsang, Teresa S M</creatorcontrib><title>ProtoASNet: Dynamic Prototypes for Inherently Interpretable and Uncertainty-Aware Aortic Stenosis Classification in Echocardiography</title><title>arXiv.org</title><description>Aortic stenosis (AS) is a common heart valve disease that requires accurate and timely diagnosis for appropriate treatment. Most current automatic AS severity detection methods rely on black-box models with a low level of trustworthiness, which hinders clinical adoption. To address this issue, we propose ProtoASNet, a prototypical network that directly detects AS from B-mode echocardiography videos, while making interpretable predictions based on the similarity between the input and learned spatio-temporal prototypes. This approach provides supporting evidence that is clinically relevant, as the prototypes typically highlight markers such as calcification and restricted movement of aortic valve leaflets. Moreover, ProtoASNet utilizes abstention loss to estimate aleatoric uncertainty by defining a set of prototypes that capture ambiguity and insufficient information in the observed data. This provides a reliable system that can detect and explain when it may fail. We evaluate ProtoASNet on a private dataset and the publicly available TMED-2 dataset, where it outperforms existing state-of-the-art methods with an accuracy of 80.0% and 79.7%, respectively. Furthermore, ProtoASNet provides interpretability and an uncertainty measure for each prediction, which can improve transparency and facilitate the interactive usage of deep networks to aid clinical decision-making. Our source code is available at: https://github.com/hooman007/ProtoASNet.</description><subject>Aorta</subject><subject>Aortic stenosis</subject><subject>Calcification</subject><subject>Datasets</subject><subject>Decision making</subject><subject>Echocardiography</subject><subject>Heart valves</subject><subject>Low level</subject><subject>Prototypes</subject><subject>Source code</subject><subject>Uncertainty</subject><subject>Valve leaflets</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNqNjEFLw0AQhYMgWLT_YcBzIO4mNngLtaIXEVrPZdxOzJY4E2enyN794QbxB3h6j-99vLNi4by_KdvauYtimdKxqip3u3JN4xfF94uKSbd9JruD-8z4EQP8MssTJehF4YkHUmIb81yNdFIyfBsJkA_wyoHUMLLlsvtCJehEbT7ZGrGkmGA9YkqxjwEtCkNk2IRBAuohyrviNOSr4rzHMdHyLy-L64fNbv1YTiqfJ0q2P8pJeZ72rq29a-q2Wfn_WT8UuVNZ</recordid><startdate>20230726</startdate><enddate>20230726</enddate><creator>Vaseli, Hooman</creator><creator>Ang Nan Gu</creator><creator>S Neda Ahmadi Amiri</creator><creator>Tsang, Michael Y</creator><creator>Fung, Andrea</creator><creator>Kondori, Nima</creator><creator>Saadat, Armin</creator><creator>Abolmaesumi, Purang</creator><creator>Tsang, Teresa S M</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope></search><sort><creationdate>20230726</creationdate><title>ProtoASNet: Dynamic Prototypes for Inherently Interpretable and Uncertainty-Aware Aortic Stenosis Classification in Echocardiography</title><author>Vaseli, Hooman ; Ang Nan Gu ; S Neda Ahmadi Amiri ; Tsang, Michael Y ; Fung, Andrea ; Kondori, Nima ; Saadat, Armin ; Abolmaesumi, Purang ; Tsang, Teresa S M</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-proquest_journals_28432548573</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Aorta</topic><topic>Aortic stenosis</topic><topic>Calcification</topic><topic>Datasets</topic><topic>Decision making</topic><topic>Echocardiography</topic><topic>Heart valves</topic><topic>Low level</topic><topic>Prototypes</topic><topic>Source code</topic><topic>Uncertainty</topic><topic>Valve leaflets</topic><toplevel>online_resources</toplevel><creatorcontrib>Vaseli, Hooman</creatorcontrib><creatorcontrib>Ang Nan Gu</creatorcontrib><creatorcontrib>S Neda Ahmadi Amiri</creatorcontrib><creatorcontrib>Tsang, Michael Y</creatorcontrib><creatorcontrib>Fung, Andrea</creatorcontrib><creatorcontrib>Kondori, Nima</creatorcontrib><creatorcontrib>Saadat, Armin</creatorcontrib><creatorcontrib>Abolmaesumi, Purang</creatorcontrib><creatorcontrib>Tsang, Teresa S M</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering collection</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Vaseli, Hooman</au><au>Ang Nan Gu</au><au>S Neda Ahmadi Amiri</au><au>Tsang, Michael Y</au><au>Fung, Andrea</au><au>Kondori, Nima</au><au>Saadat, Armin</au><au>Abolmaesumi, Purang</au><au>Tsang, Teresa S M</au><format>book</format><genre>document</genre><ristype>GEN</ristype><atitle>ProtoASNet: Dynamic Prototypes for Inherently Interpretable and Uncertainty-Aware Aortic Stenosis Classification in Echocardiography</atitle><jtitle>arXiv.org</jtitle><date>2023-07-26</date><risdate>2023</risdate><eissn>2331-8422</eissn><abstract>Aortic stenosis (AS) is a common heart valve disease that requires accurate and timely diagnosis for appropriate treatment. Most current automatic AS severity detection methods rely on black-box models with a low level of trustworthiness, which hinders clinical adoption. To address this issue, we propose ProtoASNet, a prototypical network that directly detects AS from B-mode echocardiography videos, while making interpretable predictions based on the similarity between the input and learned spatio-temporal prototypes. This approach provides supporting evidence that is clinically relevant, as the prototypes typically highlight markers such as calcification and restricted movement of aortic valve leaflets. Moreover, ProtoASNet utilizes abstention loss to estimate aleatoric uncertainty by defining a set of prototypes that capture ambiguity and insufficient information in the observed data. This provides a reliable system that can detect and explain when it may fail. We evaluate ProtoASNet on a private dataset and the publicly available TMED-2 dataset, where it outperforms existing state-of-the-art methods with an accuracy of 80.0% and 79.7%, respectively. Furthermore, ProtoASNet provides interpretability and an uncertainty measure for each prediction, which can improve transparency and facilitate the interactive usage of deep networks to aid clinical decision-making. Our source code is available at: https://github.com/hooman007/ProtoASNet.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2023-07
issn 2331-8422
language eng
recordid cdi_proquest_journals_2843254857
source Publicly Available Content Database
subjects Aorta
Aortic stenosis
Calcification
Datasets
Decision making
Echocardiography
Heart valves
Low level
Prototypes
Source code
Uncertainty
Valve leaflets
title ProtoASNet: Dynamic Prototypes for Inherently Interpretable and Uncertainty-Aware Aortic Stenosis Classification in Echocardiography
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-01T06%3A57%3A24IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=document&rft.atitle=ProtoASNet:%20Dynamic%20Prototypes%20for%20Inherently%20Interpretable%20and%20Uncertainty-Aware%20Aortic%20Stenosis%20Classification%20in%20Echocardiography&rft.jtitle=arXiv.org&rft.au=Vaseli,%20Hooman&rft.date=2023-07-26&rft.eissn=2331-8422&rft_id=info:doi/&rft_dat=%3Cproquest%3E2843254857%3C/proquest%3E%3Cgrp_id%3Ecdi_FETCH-proquest_journals_28432548573%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2843254857&rft_id=info:pmid/&rfr_iscdi=true