Loading…
PI Prob: A risk prediction and clinical guidance system for evaluating patients with recurrent infections
Primary immunodeficiency diseases represent an expanding set of heterogeneous conditions which are difficult to recognize clinically. Diagnostic rates outside of the newborn period have not changed appreciably. This concern underscores a need for novel methods of disease detection. We built a Bayesi...
Saved in:
Published in: | PloS one 2021-02, Vol.16 (2), p.e0237285-e0237285 |
---|---|
Main Authors: | , , , , , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c692t-bcb6c54a805963e37a679ca3b827513e394087febbdd05e91ed9dd90a2f41db03 |
---|---|
cites | cdi_FETCH-LOGICAL-c692t-bcb6c54a805963e37a679ca3b827513e394087febbdd05e91ed9dd90a2f41db03 |
container_end_page | e0237285 |
container_issue | 2 |
container_start_page | e0237285 |
container_title | PloS one |
container_volume | 16 |
creator | Rider, Nicholas L Cahill, Gina Motazedi, Tina Wei, Lei Kurian, Ashok Noroski, Lenora M Seeborg, Filiz O Chinn, Ivan K Roberts, Kirk |
description | Primary immunodeficiency diseases represent an expanding set of heterogeneous conditions which are difficult to recognize clinically. Diagnostic rates outside of the newborn period have not changed appreciably. This concern underscores a need for novel methods of disease detection.
We built a Bayesian network to provide real-time risk assessment about primary immunodeficiency and to facilitate prescriptive analytics for initiating the most appropriate diagnostic work up. Our goal is to improve diagnostic rates for primary immunodeficiency and shorten time to diagnosis. We aimed to use readily available health record data and a small training dataset to prove utility in diagnosing patients with relatively rare features.
We extracted data from the Texas Children's Hospital electronic health record on a large population of primary immunodeficiency patients (n = 1762) and appropriately-matched set of controls (n = 1698). From the cohorts, clinically relevant prior probabilities were calculated enabling construction of a Bayesian network probabilistic model(PI Prob). Our model was constructed with clinical-immunology domain expertise, trained on a balanced cohort of 100 cases-controls and validated on an unseen balanced cohort of 150 cases-controls. Performance was measured by area under the receiver operator characteristic curve (AUROC). We also compared our network performance to classic machine learning model performance on the same dataset.
PI Prob was accurate in classifying immunodeficiency patients from controls (AUROC = 0.945; p |
doi_str_mv | 10.1371/journal.pone.0237285 |
format | article |
fullrecord | <record><control><sourceid>gale_plos_</sourceid><recordid>TN_cdi_plos_journals_2490079894</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A651981569</galeid><doaj_id>oai_doaj_org_article_e3c5c11a519d4109b4b706746bc9c2ed</doaj_id><sourcerecordid>A651981569</sourcerecordid><originalsourceid>FETCH-LOGICAL-c692t-bcb6c54a805963e37a679ca3b827513e394087febbdd05e91ed9dd90a2f41db03</originalsourceid><addsrcrecordid>eNqNk11v0zAUhiMEYmPwDxBYQkJw0WLHiRNzgVRNfFSatImvW8uxT1IP1-7sZLB_j9tmU4N2gXLh-Pg5r31e-2TZc4LnhFbk3aUfgpN2vvEO5jinVV6XD7Jjwmk-YzmmDw_-j7InMV5iXNKascfZEaUlJ7zKjzNzsUQXwTfv0QIFE3-hTQBtVG-8Q9JppKxxRkmLusFo6RSgeBN7WKPWBwTX0g6yN65DmzSA6yP6bfoVCqCGENIcGdfCTi0-zR610kZ4No4n2Y9PH7-ffpmdnX9eni7OZorxvJ81qmGqLGSNS84o0EqyiitJmzqvSpICvMB11ULTaI1L4AQ015pjmbcF0Q2mJ9nLve7G-ihGl6LIC45xxWteJGK5J7SXl2ITzFqGG-GlEbuAD52QoTfKggCqSkWILAnXBcG8KZoKs6pgjeIqB520Poy7Dc0atEo1B2knotMVZ1ai89eiqmtGiu1x34wCwV8NEHuxNlGBtdKBH_bnZrhIbiT01T_o_dWNVCdTAcl_n_ZVW1GxYKmOmpRsqzW_h0qfhrVR6Um1JsUnCW8nCYnp4U_fySFGsfz29f_Z859T9vUBuwJp-1X0dti9mSlY7EEVfIwB2juTCRbbjrh1Q2w7QowdkdJeHF7QXdJtC9C_wH0HGw</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2490079894</pqid></control><display><type>article</type><title>PI Prob: A risk prediction and clinical guidance system for evaluating patients with recurrent infections</title><source>PubMed Central(OpenAccess)</source><source>ProQuest - Publicly Available Content Database</source><creator>Rider, Nicholas L ; Cahill, Gina ; Motazedi, Tina ; Wei, Lei ; Kurian, Ashok ; Noroski, Lenora M ; Seeborg, Filiz O ; Chinn, Ivan K ; Roberts, Kirk</creator><contributor>Son, Le Hoang</contributor><creatorcontrib>Rider, Nicholas L ; Cahill, Gina ; Motazedi, Tina ; Wei, Lei ; Kurian, Ashok ; Noroski, Lenora M ; Seeborg, Filiz O ; Chinn, Ivan K ; Roberts, Kirk ; Son, Le Hoang</creatorcontrib><description>Primary immunodeficiency diseases represent an expanding set of heterogeneous conditions which are difficult to recognize clinically. Diagnostic rates outside of the newborn period have not changed appreciably. This concern underscores a need for novel methods of disease detection.
We built a Bayesian network to provide real-time risk assessment about primary immunodeficiency and to facilitate prescriptive analytics for initiating the most appropriate diagnostic work up. Our goal is to improve diagnostic rates for primary immunodeficiency and shorten time to diagnosis. We aimed to use readily available health record data and a small training dataset to prove utility in diagnosing patients with relatively rare features.
We extracted data from the Texas Children's Hospital electronic health record on a large population of primary immunodeficiency patients (n = 1762) and appropriately-matched set of controls (n = 1698). From the cohorts, clinically relevant prior probabilities were calculated enabling construction of a Bayesian network probabilistic model(PI Prob). Our model was constructed with clinical-immunology domain expertise, trained on a balanced cohort of 100 cases-controls and validated on an unseen balanced cohort of 150 cases-controls. Performance was measured by area under the receiver operator characteristic curve (AUROC). We also compared our network performance to classic machine learning model performance on the same dataset.
PI Prob was accurate in classifying immunodeficiency patients from controls (AUROC = 0.945; p<0.0001) at a risk threshold of ≥6%. Additionally, the model was 89% accurate for categorizing validation cohort members into appropriate International Union of Immunological Societies diagnostic categories. Our network outperformed 3 other machine learning models and provides superior transparency with a prescriptive output element.
Artificial intelligence methods can classify risk for primary immunodeficiency and guide management. PI Prob enables accurate, objective decision making about risk and guides the user towards the appropriate diagnostic evaluation for patients with recurrent infections. Probabilistic models can be trained with small datasets underscoring their utility for rare disease detection given appropriate domain expertise for feature selection and network construction.</description><identifier>ISSN: 1932-6203</identifier><identifier>EISSN: 1932-6203</identifier><identifier>DOI: 10.1371/journal.pone.0237285</identifier><identifier>PMID: 33591972</identifier><language>eng</language><publisher>United States: Public Library of Science</publisher><subject>Application programming interface ; Bioinformatics ; Biology and Life Sciences ; Children ; Clinical decision making ; Colon ; Colon cancer ; Computer and Information Sciences ; Congestive heart failure ; Data analysis ; Decision making ; Disease ; Diseases ; Drafting software ; Editing ; Evaluation ; Health risks ; Hospitals ; Hypersensitivity ; Immunology ; Infectious diseases ; Information services ; Liver cancer ; Liver diseases ; Medical schools ; Medicine ; Medicine and Health Sciences ; Patients ; Pediatrics ; Probability ; Relapse ; Streptococcus infections</subject><ispartof>PloS one, 2021-02, Vol.16 (2), p.e0237285-e0237285</ispartof><rights>COPYRIGHT 2021 Public Library of Science</rights><rights>2021 Rider et al. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>2021 Rider et al 2021 Rider et al</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c692t-bcb6c54a805963e37a679ca3b827513e394087febbdd05e91ed9dd90a2f41db03</citedby><cites>FETCH-LOGICAL-c692t-bcb6c54a805963e37a679ca3b827513e394087febbdd05e91ed9dd90a2f41db03</cites><orcidid>0000-0003-2549-0678 ; 0000-0001-5684-5457 ; 0000-0001-5975-4550 ; 0000-0003-0716-3630</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/2490079894/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2490079894?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>230,314,727,780,784,885,25753,27924,27925,37012,37013,44590,53791,53793,75126</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/33591972$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><contributor>Son, Le Hoang</contributor><creatorcontrib>Rider, Nicholas L</creatorcontrib><creatorcontrib>Cahill, Gina</creatorcontrib><creatorcontrib>Motazedi, Tina</creatorcontrib><creatorcontrib>Wei, Lei</creatorcontrib><creatorcontrib>Kurian, Ashok</creatorcontrib><creatorcontrib>Noroski, Lenora M</creatorcontrib><creatorcontrib>Seeborg, Filiz O</creatorcontrib><creatorcontrib>Chinn, Ivan K</creatorcontrib><creatorcontrib>Roberts, Kirk</creatorcontrib><title>PI Prob: A risk prediction and clinical guidance system for evaluating patients with recurrent infections</title><title>PloS one</title><addtitle>PLoS One</addtitle><description>Primary immunodeficiency diseases represent an expanding set of heterogeneous conditions which are difficult to recognize clinically. Diagnostic rates outside of the newborn period have not changed appreciably. This concern underscores a need for novel methods of disease detection.
We built a Bayesian network to provide real-time risk assessment about primary immunodeficiency and to facilitate prescriptive analytics for initiating the most appropriate diagnostic work up. Our goal is to improve diagnostic rates for primary immunodeficiency and shorten time to diagnosis. We aimed to use readily available health record data and a small training dataset to prove utility in diagnosing patients with relatively rare features.
We extracted data from the Texas Children's Hospital electronic health record on a large population of primary immunodeficiency patients (n = 1762) and appropriately-matched set of controls (n = 1698). From the cohorts, clinically relevant prior probabilities were calculated enabling construction of a Bayesian network probabilistic model(PI Prob). Our model was constructed with clinical-immunology domain expertise, trained on a balanced cohort of 100 cases-controls and validated on an unseen balanced cohort of 150 cases-controls. Performance was measured by area under the receiver operator characteristic curve (AUROC). We also compared our network performance to classic machine learning model performance on the same dataset.
PI Prob was accurate in classifying immunodeficiency patients from controls (AUROC = 0.945; p<0.0001) at a risk threshold of ≥6%. Additionally, the model was 89% accurate for categorizing validation cohort members into appropriate International Union of Immunological Societies diagnostic categories. Our network outperformed 3 other machine learning models and provides superior transparency with a prescriptive output element.
Artificial intelligence methods can classify risk for primary immunodeficiency and guide management. PI Prob enables accurate, objective decision making about risk and guides the user towards the appropriate diagnostic evaluation for patients with recurrent infections. Probabilistic models can be trained with small datasets underscoring their utility for rare disease detection given appropriate domain expertise for feature selection and network construction.</description><subject>Application programming interface</subject><subject>Bioinformatics</subject><subject>Biology and Life Sciences</subject><subject>Children</subject><subject>Clinical decision making</subject><subject>Colon</subject><subject>Colon cancer</subject><subject>Computer and Information Sciences</subject><subject>Congestive heart failure</subject><subject>Data analysis</subject><subject>Decision making</subject><subject>Disease</subject><subject>Diseases</subject><subject>Drafting software</subject><subject>Editing</subject><subject>Evaluation</subject><subject>Health risks</subject><subject>Hospitals</subject><subject>Hypersensitivity</subject><subject>Immunology</subject><subject>Infectious diseases</subject><subject>Information services</subject><subject>Liver cancer</subject><subject>Liver diseases</subject><subject>Medical schools</subject><subject>Medicine</subject><subject>Medicine and Health Sciences</subject><subject>Patients</subject><subject>Pediatrics</subject><subject>Probability</subject><subject>Relapse</subject><subject>Streptococcus infections</subject><issn>1932-6203</issn><issn>1932-6203</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><sourceid>DOA</sourceid><recordid>eNqNk11v0zAUhiMEYmPwDxBYQkJw0WLHiRNzgVRNfFSatImvW8uxT1IP1-7sZLB_j9tmU4N2gXLh-Pg5r31e-2TZc4LnhFbk3aUfgpN2vvEO5jinVV6XD7Jjwmk-YzmmDw_-j7InMV5iXNKascfZEaUlJ7zKjzNzsUQXwTfv0QIFE3-hTQBtVG-8Q9JppKxxRkmLusFo6RSgeBN7WKPWBwTX0g6yN65DmzSA6yP6bfoVCqCGENIcGdfCTi0-zR610kZ4No4n2Y9PH7-ffpmdnX9eni7OZorxvJ81qmGqLGSNS84o0EqyiitJmzqvSpICvMB11ULTaI1L4AQ015pjmbcF0Q2mJ9nLve7G-ihGl6LIC45xxWteJGK5J7SXl2ITzFqGG-GlEbuAD52QoTfKggCqSkWILAnXBcG8KZoKs6pgjeIqB520Poy7Dc0atEo1B2knotMVZ1ai89eiqmtGiu1x34wCwV8NEHuxNlGBtdKBH_bnZrhIbiT01T_o_dWNVCdTAcl_n_ZVW1GxYKmOmpRsqzW_h0qfhrVR6Um1JsUnCW8nCYnp4U_fySFGsfz29f_Z859T9vUBuwJp-1X0dti9mSlY7EEVfIwB2juTCRbbjrh1Q2w7QowdkdJeHF7QXdJtC9C_wH0HGw</recordid><startdate>20210216</startdate><enddate>20210216</enddate><creator>Rider, Nicholas L</creator><creator>Cahill, Gina</creator><creator>Motazedi, Tina</creator><creator>Wei, Lei</creator><creator>Kurian, Ashok</creator><creator>Noroski, Lenora M</creator><creator>Seeborg, Filiz O</creator><creator>Chinn, Ivan K</creator><creator>Roberts, Kirk</creator><general>Public Library of Science</general><general>Public Library of Science (PLoS)</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>IOV</scope><scope>ISR</scope><scope>3V.</scope><scope>7QG</scope><scope>7QL</scope><scope>7QO</scope><scope>7RV</scope><scope>7SN</scope><scope>7SS</scope><scope>7T5</scope><scope>7TG</scope><scope>7TM</scope><scope>7U9</scope><scope>7X2</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8AO</scope><scope>8C1</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FH</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>ATCPS</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>BHPHI</scope><scope>C1K</scope><scope>CCPQU</scope><scope>D1I</scope><scope>DWQXO</scope><scope>FR3</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>H94</scope><scope>HCIFZ</scope><scope>K9.</scope><scope>KB.</scope><scope>KB0</scope><scope>KL.</scope><scope>L6V</scope><scope>LK8</scope><scope>M0K</scope><scope>M0S</scope><scope>M1P</scope><scope>M7N</scope><scope>M7P</scope><scope>M7S</scope><scope>NAPCQ</scope><scope>P5Z</scope><scope>P62</scope><scope>P64</scope><scope>PATMY</scope><scope>PDBOC</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>PYCSY</scope><scope>RC3</scope><scope>7X8</scope><scope>5PM</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0003-2549-0678</orcidid><orcidid>https://orcid.org/0000-0001-5684-5457</orcidid><orcidid>https://orcid.org/0000-0001-5975-4550</orcidid><orcidid>https://orcid.org/0000-0003-0716-3630</orcidid></search><sort><creationdate>20210216</creationdate><title>PI Prob: A risk prediction and clinical guidance system for evaluating patients with recurrent infections</title><author>Rider, Nicholas L ; Cahill, Gina ; Motazedi, Tina ; Wei, Lei ; Kurian, Ashok ; Noroski, Lenora M ; Seeborg, Filiz O ; Chinn, Ivan K ; Roberts, Kirk</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c692t-bcb6c54a805963e37a679ca3b827513e394087febbdd05e91ed9dd90a2f41db03</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Application programming interface</topic><topic>Bioinformatics</topic><topic>Biology and Life Sciences</topic><topic>Children</topic><topic>Clinical decision making</topic><topic>Colon</topic><topic>Colon cancer</topic><topic>Computer and Information Sciences</topic><topic>Congestive heart failure</topic><topic>Data analysis</topic><topic>Decision making</topic><topic>Disease</topic><topic>Diseases</topic><topic>Drafting software</topic><topic>Editing</topic><topic>Evaluation</topic><topic>Health risks</topic><topic>Hospitals</topic><topic>Hypersensitivity</topic><topic>Immunology</topic><topic>Infectious diseases</topic><topic>Information services</topic><topic>Liver cancer</topic><topic>Liver diseases</topic><topic>Medical schools</topic><topic>Medicine</topic><topic>Medicine and Health Sciences</topic><topic>Patients</topic><topic>Pediatrics</topic><topic>Probability</topic><topic>Relapse</topic><topic>Streptococcus infections</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Rider, Nicholas L</creatorcontrib><creatorcontrib>Cahill, Gina</creatorcontrib><creatorcontrib>Motazedi, Tina</creatorcontrib><creatorcontrib>Wei, Lei</creatorcontrib><creatorcontrib>Kurian, Ashok</creatorcontrib><creatorcontrib>Noroski, Lenora M</creatorcontrib><creatorcontrib>Seeborg, Filiz O</creatorcontrib><creatorcontrib>Chinn, Ivan K</creatorcontrib><creatorcontrib>Roberts, Kirk</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>Gale In Context: Opposing Viewpoints</collection><collection>Science (Gale in Context)</collection><collection>ProQuest Central (Corporate)</collection><collection>Animal Behavior Abstracts</collection><collection>Bacteriology Abstracts (Microbiology B)</collection><collection>Biotechnology Research Abstracts</collection><collection>ProQuest Nursing and Allied Health Journals</collection><collection>Ecology Abstracts</collection><collection>Entomology Abstracts (Full archive)</collection><collection>Immunology Abstracts</collection><collection>Meteorological & Geoastrophysical Abstracts</collection><collection>Nucleic Acids Abstracts</collection><collection>Virology and AIDS Abstracts</collection><collection>Agricultural Science Collection</collection><collection>ProQuest - Health & Medical Complete保健、医学与药学数据库</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Public Health Database (Proquest)</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>Agricultural & Environmental Science Collection</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ProQuest One Community College</collection><collection>ProQuest Materials Science Collection</collection><collection>ProQuest Central Korea</collection><collection>Engineering Research Database</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>AIDS and Cancer Research Abstracts</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>https://resources.nclive.org/materials</collection><collection>Nursing & Allied Health Database (Alumni Edition)</collection><collection>Meteorological & Geoastrophysical Abstracts - Academic</collection><collection>ProQuest Engineering Collection</collection><collection>ProQuest Biological Science Collection</collection><collection>Agriculture Science Database</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Algology Mycology and Protozoology Abstracts (Microbiology C)</collection><collection>ProQuest Biological Science Journals</collection><collection>Engineering Database</collection><collection>Nursing & Allied Health Premium</collection><collection>ProQuest advanced technologies & aerospace journals</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>Environmental Science Database</collection><collection>Materials science collection</collection><collection>ProQuest - Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering collection</collection><collection>Environmental Science Collection</collection><collection>Genetics Abstracts</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>PloS one</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Rider, Nicholas L</au><au>Cahill, Gina</au><au>Motazedi, Tina</au><au>Wei, Lei</au><au>Kurian, Ashok</au><au>Noroski, Lenora M</au><au>Seeborg, Filiz O</au><au>Chinn, Ivan K</au><au>Roberts, Kirk</au><au>Son, Le Hoang</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>PI Prob: A risk prediction and clinical guidance system for evaluating patients with recurrent infections</atitle><jtitle>PloS one</jtitle><addtitle>PLoS One</addtitle><date>2021-02-16</date><risdate>2021</risdate><volume>16</volume><issue>2</issue><spage>e0237285</spage><epage>e0237285</epage><pages>e0237285-e0237285</pages><issn>1932-6203</issn><eissn>1932-6203</eissn><abstract>Primary immunodeficiency diseases represent an expanding set of heterogeneous conditions which are difficult to recognize clinically. Diagnostic rates outside of the newborn period have not changed appreciably. This concern underscores a need for novel methods of disease detection.
We built a Bayesian network to provide real-time risk assessment about primary immunodeficiency and to facilitate prescriptive analytics for initiating the most appropriate diagnostic work up. Our goal is to improve diagnostic rates for primary immunodeficiency and shorten time to diagnosis. We aimed to use readily available health record data and a small training dataset to prove utility in diagnosing patients with relatively rare features.
We extracted data from the Texas Children's Hospital electronic health record on a large population of primary immunodeficiency patients (n = 1762) and appropriately-matched set of controls (n = 1698). From the cohorts, clinically relevant prior probabilities were calculated enabling construction of a Bayesian network probabilistic model(PI Prob). Our model was constructed with clinical-immunology domain expertise, trained on a balanced cohort of 100 cases-controls and validated on an unseen balanced cohort of 150 cases-controls. Performance was measured by area under the receiver operator characteristic curve (AUROC). We also compared our network performance to classic machine learning model performance on the same dataset.
PI Prob was accurate in classifying immunodeficiency patients from controls (AUROC = 0.945; p<0.0001) at a risk threshold of ≥6%. Additionally, the model was 89% accurate for categorizing validation cohort members into appropriate International Union of Immunological Societies diagnostic categories. Our network outperformed 3 other machine learning models and provides superior transparency with a prescriptive output element.
Artificial intelligence methods can classify risk for primary immunodeficiency and guide management. PI Prob enables accurate, objective decision making about risk and guides the user towards the appropriate diagnostic evaluation for patients with recurrent infections. Probabilistic models can be trained with small datasets underscoring their utility for rare disease detection given appropriate domain expertise for feature selection and network construction.</abstract><cop>United States</cop><pub>Public Library of Science</pub><pmid>33591972</pmid><doi>10.1371/journal.pone.0237285</doi><tpages>e0237285</tpages><orcidid>https://orcid.org/0000-0003-2549-0678</orcidid><orcidid>https://orcid.org/0000-0001-5684-5457</orcidid><orcidid>https://orcid.org/0000-0001-5975-4550</orcidid><orcidid>https://orcid.org/0000-0003-0716-3630</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1932-6203 |
ispartof | PloS one, 2021-02, Vol.16 (2), p.e0237285-e0237285 |
issn | 1932-6203 1932-6203 |
language | eng |
recordid | cdi_plos_journals_2490079894 |
source | PubMed Central(OpenAccess); ProQuest - Publicly Available Content Database |
subjects | Application programming interface Bioinformatics Biology and Life Sciences Children Clinical decision making Colon Colon cancer Computer and Information Sciences Congestive heart failure Data analysis Decision making Disease Diseases Drafting software Editing Evaluation Health risks Hospitals Hypersensitivity Immunology Infectious diseases Information services Liver cancer Liver diseases Medical schools Medicine Medicine and Health Sciences Patients Pediatrics Probability Relapse Streptococcus infections |
title | PI Prob: A risk prediction and clinical guidance system for evaluating patients with recurrent infections |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-01T09%3A01%3A13IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_plos_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=PI%20Prob:%20A%20risk%20prediction%20and%20clinical%20guidance%20system%20for%20evaluating%20patients%20with%20recurrent%20infections&rft.jtitle=PloS%20one&rft.au=Rider,%20Nicholas%20L&rft.date=2021-02-16&rft.volume=16&rft.issue=2&rft.spage=e0237285&rft.epage=e0237285&rft.pages=e0237285-e0237285&rft.issn=1932-6203&rft.eissn=1932-6203&rft_id=info:doi/10.1371/journal.pone.0237285&rft_dat=%3Cgale_plos_%3EA651981569%3C/gale_plos_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c692t-bcb6c54a805963e37a679ca3b827513e394087febbdd05e91ed9dd90a2f41db03%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2490079894&rft_id=info:pmid/33591972&rft_galeid=A651981569&rfr_iscdi=true |