Loading…

Using Machine Learning in Psychiatry: The Need to Establish a Framework That Nurtures Trustworthiness

The rapid embracing of artificial intelligence in psychiatry has a flavor of being the current "wild west"; a multidisciplinary approach that is very technical and complex, yet seems to produce findings that resonate. These studies are hard to review as the methods are often opaque and it...

Full description

Saved in:
Bibliographic Details
Published in:Schizophrenia bulletin 2020-01, Vol.46 (1), p.11-14
Main Authors: Chandler, Chelsea, Foltz, Peter W, Elvevåg, Brita
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c411t-890f890203d0bdebb186269fc54c578b9547dcba6bbc1497d92562745b54ef0b3
cites cdi_FETCH-LOGICAL-c411t-890f890203d0bdebb186269fc54c578b9547dcba6bbc1497d92562745b54ef0b3
container_end_page 14
container_issue 1
container_start_page 11
container_title Schizophrenia bulletin
container_volume 46
creator Chandler, Chelsea
Foltz, Peter W
Elvevåg, Brita
description The rapid embracing of artificial intelligence in psychiatry has a flavor of being the current "wild west"; a multidisciplinary approach that is very technical and complex, yet seems to produce findings that resonate. These studies are hard to review as the methods are often opaque and it is tricky to find the suitable combination of reviewers. This issue will only get more complex in the absence of a rigorous framework to evaluate such studies and thus nurture trustworthiness. Therefore, our paper discusses the urgency of the field to develop a framework with which to evaluate the complex methodology such that the process is done honestly, fairly, scientifically, and accurately. However, evaluation is a complicated process and so we focus on three issues, namely explainability, transparency, and generalizability, that are critical for establishing the viability of using artificial intelligence in psychiatry. We discuss how defining these three issues helps towards building a framework to ensure trustworthiness, but show how difficult definition can be, as the terms have different meanings in medicine, computer science, and law. We conclude that it is important to start the discussion such that there can be a call for policy on this and that the community takes extra care when reviewing clinical applications of such models..
doi_str_mv 10.1093/schbul/sbz105
format article
fullrecord <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_7145638</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2333609827</sourcerecordid><originalsourceid>FETCH-LOGICAL-c411t-890f890203d0bdebb186269fc54c578b9547dcba6bbc1497d92562745b54ef0b3</originalsourceid><addsrcrecordid>eNpVkc1P3DAQxS1UBFvgyLX1sZcUO47tuIdKFYK20vJxWM6W7TjEbdahHge0_evr1QKiB2ukNz89z8xD6JSSz5QodgZusPN4BvYvJXwPLahseEUloe_QgvBWVFLQ5hC9B_hFCG2UqA_QIaOKUErIAvk7CPEeXxk3hOjx0psUt0KI-BY2RTQ5bb7g1eDxtfcdzhO-gGzsGGDABl8ms_ZPU_pdCJPx9ZzynDzgVZohFz1vXQGO0X5vRvAnz_UI3V1erM5_VMub7z_Pvy0r11Caq1aRvryasI7YzltLW1EL1TveOC5bq3gjO2eNsNaVVWSnai7qsrDlje-JZUfo6873YbZr3zkfczKjfkhhbdJGTybo_zsxDPp-etSSNlywthh83Bm4FCCHqOOUjC6XYlLXRFFViE_PX6Tpz-wh63UA58fRRD_NoGvGmCCqrWVBqxezCSD5_nUQSvQ2PL0LT-_CK_yHt9O_0i9psX8EI5gZ</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2333609827</pqid></control><display><type>article</type><title>Using Machine Learning in Psychiatry: The Need to Establish a Framework That Nurtures Trustworthiness</title><source>PubMed Central Free</source><source>NORA - Norwegian Open Research Archives</source><source>Oxford Journals Online</source><creator>Chandler, Chelsea ; Foltz, Peter W ; Elvevåg, Brita</creator><creatorcontrib>Chandler, Chelsea ; Foltz, Peter W ; Elvevåg, Brita</creatorcontrib><description>The rapid embracing of artificial intelligence in psychiatry has a flavor of being the current "wild west"; a multidisciplinary approach that is very technical and complex, yet seems to produce findings that resonate. These studies are hard to review as the methods are often opaque and it is tricky to find the suitable combination of reviewers. This issue will only get more complex in the absence of a rigorous framework to evaluate such studies and thus nurture trustworthiness. Therefore, our paper discusses the urgency of the field to develop a framework with which to evaluate the complex methodology such that the process is done honestly, fairly, scientifically, and accurately. However, evaluation is a complicated process and so we focus on three issues, namely explainability, transparency, and generalizability, that are critical for establishing the viability of using artificial intelligence in psychiatry. We discuss how defining these three issues helps towards building a framework to ensure trustworthiness, but show how difficult definition can be, as the terms have different meanings in medicine, computer science, and law. We conclude that it is important to start the discussion such that there can be a call for policy on this and that the community takes extra care when reviewing clinical applications of such models..</description><identifier>ISSN: 0586-7614</identifier><identifier>ISSN: 1745-1701</identifier><identifier>EISSN: 1745-1701</identifier><identifier>DOI: 10.1093/schbul/sbz105</identifier><identifier>PMID: 31901100</identifier><language>eng</language><publisher>United States: Oxford University Press</publisher><subject>At Issue ; Clinical medical disciplines: 750 ; Humans ; Klinisk medisinske fag: 750 ; Machine Learning ; Medical disciplines: 700 ; Medisinske Fag: 700 ; Models, Theoretical ; Psychiatry - methods ; Psychiatry - standards ; Psychiatry, child psychiatry: 757 ; Psykiatri, barnepsykiatri: 757 ; VDP</subject><ispartof>Schizophrenia bulletin, 2020-01, Vol.46 (1), p.11-14</ispartof><rights>The Author(s) 2019. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com.</rights><rights>info:eu-repo/semantics/openAccess</rights><rights>The Author(s) 2019. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com 2019</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c411t-890f890203d0bdebb186269fc54c578b9547dcba6bbc1497d92562745b54ef0b3</citedby><cites>FETCH-LOGICAL-c411t-890f890203d0bdebb186269fc54c578b9547dcba6bbc1497d92562745b54ef0b3</cites><orcidid>0000-0002-9409-0937</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC7145638/pdf/$$EPDF$$P50$$Gpubmedcentral$$H</linktopdf><linktohtml>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC7145638/$$EHTML$$P50$$Gpubmedcentral$$H</linktohtml><link.rule.ids>230,314,727,780,784,885,26567,27924,27925,53791,53793</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/31901100$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Chandler, Chelsea</creatorcontrib><creatorcontrib>Foltz, Peter W</creatorcontrib><creatorcontrib>Elvevåg, Brita</creatorcontrib><title>Using Machine Learning in Psychiatry: The Need to Establish a Framework That Nurtures Trustworthiness</title><title>Schizophrenia bulletin</title><addtitle>Schizophr Bull</addtitle><description>The rapid embracing of artificial intelligence in psychiatry has a flavor of being the current "wild west"; a multidisciplinary approach that is very technical and complex, yet seems to produce findings that resonate. These studies are hard to review as the methods are often opaque and it is tricky to find the suitable combination of reviewers. This issue will only get more complex in the absence of a rigorous framework to evaluate such studies and thus nurture trustworthiness. Therefore, our paper discusses the urgency of the field to develop a framework with which to evaluate the complex methodology such that the process is done honestly, fairly, scientifically, and accurately. However, evaluation is a complicated process and so we focus on three issues, namely explainability, transparency, and generalizability, that are critical for establishing the viability of using artificial intelligence in psychiatry. We discuss how defining these three issues helps towards building a framework to ensure trustworthiness, but show how difficult definition can be, as the terms have different meanings in medicine, computer science, and law. We conclude that it is important to start the discussion such that there can be a call for policy on this and that the community takes extra care when reviewing clinical applications of such models..</description><subject>At Issue</subject><subject>Clinical medical disciplines: 750</subject><subject>Humans</subject><subject>Klinisk medisinske fag: 750</subject><subject>Machine Learning</subject><subject>Medical disciplines: 700</subject><subject>Medisinske Fag: 700</subject><subject>Models, Theoretical</subject><subject>Psychiatry - methods</subject><subject>Psychiatry - standards</subject><subject>Psychiatry, child psychiatry: 757</subject><subject>Psykiatri, barnepsykiatri: 757</subject><subject>VDP</subject><issn>0586-7614</issn><issn>1745-1701</issn><issn>1745-1701</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>3HK</sourceid><recordid>eNpVkc1P3DAQxS1UBFvgyLX1sZcUO47tuIdKFYK20vJxWM6W7TjEbdahHge0_evr1QKiB2ukNz89z8xD6JSSz5QodgZusPN4BvYvJXwPLahseEUloe_QgvBWVFLQ5hC9B_hFCG2UqA_QIaOKUErIAvk7CPEeXxk3hOjx0psUt0KI-BY2RTQ5bb7g1eDxtfcdzhO-gGzsGGDABl8ms_ZPU_pdCJPx9ZzynDzgVZohFz1vXQGO0X5vRvAnz_UI3V1erM5_VMub7z_Pvy0r11Caq1aRvryasI7YzltLW1EL1TveOC5bq3gjO2eNsNaVVWSnai7qsrDlje-JZUfo6873YbZr3zkfczKjfkhhbdJGTybo_zsxDPp-etSSNlywthh83Bm4FCCHqOOUjC6XYlLXRFFViE_PX6Tpz-wh63UA58fRRD_NoGvGmCCqrWVBqxezCSD5_nUQSvQ2PL0LT-_CK_yHt9O_0i9psX8EI5gZ</recordid><startdate>20200104</startdate><enddate>20200104</enddate><creator>Chandler, Chelsea</creator><creator>Foltz, Peter W</creator><creator>Elvevåg, Brita</creator><general>Oxford University Press</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><scope>3HK</scope><scope>5PM</scope><orcidid>https://orcid.org/0000-0002-9409-0937</orcidid></search><sort><creationdate>20200104</creationdate><title>Using Machine Learning in Psychiatry: The Need to Establish a Framework That Nurtures Trustworthiness</title><author>Chandler, Chelsea ; Foltz, Peter W ; Elvevåg, Brita</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c411t-890f890203d0bdebb186269fc54c578b9547dcba6bbc1497d92562745b54ef0b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>At Issue</topic><topic>Clinical medical disciplines: 750</topic><topic>Humans</topic><topic>Klinisk medisinske fag: 750</topic><topic>Machine Learning</topic><topic>Medical disciplines: 700</topic><topic>Medisinske Fag: 700</topic><topic>Models, Theoretical</topic><topic>Psychiatry - methods</topic><topic>Psychiatry - standards</topic><topic>Psychiatry, child psychiatry: 757</topic><topic>Psykiatri, barnepsykiatri: 757</topic><topic>VDP</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Chandler, Chelsea</creatorcontrib><creatorcontrib>Foltz, Peter W</creatorcontrib><creatorcontrib>Elvevåg, Brita</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><collection>NORA - Norwegian Open Research Archives</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Schizophrenia bulletin</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Chandler, Chelsea</au><au>Foltz, Peter W</au><au>Elvevåg, Brita</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Using Machine Learning in Psychiatry: The Need to Establish a Framework That Nurtures Trustworthiness</atitle><jtitle>Schizophrenia bulletin</jtitle><addtitle>Schizophr Bull</addtitle><date>2020-01-04</date><risdate>2020</risdate><volume>46</volume><issue>1</issue><spage>11</spage><epage>14</epage><pages>11-14</pages><issn>0586-7614</issn><issn>1745-1701</issn><eissn>1745-1701</eissn><abstract>The rapid embracing of artificial intelligence in psychiatry has a flavor of being the current "wild west"; a multidisciplinary approach that is very technical and complex, yet seems to produce findings that resonate. These studies are hard to review as the methods are often opaque and it is tricky to find the suitable combination of reviewers. This issue will only get more complex in the absence of a rigorous framework to evaluate such studies and thus nurture trustworthiness. Therefore, our paper discusses the urgency of the field to develop a framework with which to evaluate the complex methodology such that the process is done honestly, fairly, scientifically, and accurately. However, evaluation is a complicated process and so we focus on three issues, namely explainability, transparency, and generalizability, that are critical for establishing the viability of using artificial intelligence in psychiatry. We discuss how defining these three issues helps towards building a framework to ensure trustworthiness, but show how difficult definition can be, as the terms have different meanings in medicine, computer science, and law. We conclude that it is important to start the discussion such that there can be a call for policy on this and that the community takes extra care when reviewing clinical applications of such models..</abstract><cop>United States</cop><pub>Oxford University Press</pub><pmid>31901100</pmid><doi>10.1093/schbul/sbz105</doi><tpages>4</tpages><orcidid>https://orcid.org/0000-0002-9409-0937</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0586-7614
ispartof Schizophrenia bulletin, 2020-01, Vol.46 (1), p.11-14
issn 0586-7614
1745-1701
1745-1701
language eng
recordid cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_7145638
source PubMed Central Free; NORA - Norwegian Open Research Archives; Oxford Journals Online
subjects At Issue
Clinical medical disciplines: 750
Humans
Klinisk medisinske fag: 750
Machine Learning
Medical disciplines: 700
Medisinske Fag: 700
Models, Theoretical
Psychiatry - methods
Psychiatry - standards
Psychiatry, child psychiatry: 757
Psykiatri, barnepsykiatri: 757
VDP
title Using Machine Learning in Psychiatry: The Need to Establish a Framework That Nurtures Trustworthiness
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-02T18%3A53%3A27IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Using%20Machine%20Learning%20in%20Psychiatry:%20The%20Need%20to%20Establish%20a%20Framework%20That%20Nurtures%20Trustworthiness&rft.jtitle=Schizophrenia%20bulletin&rft.au=Chandler,%20Chelsea&rft.date=2020-01-04&rft.volume=46&rft.issue=1&rft.spage=11&rft.epage=14&rft.pages=11-14&rft.issn=0586-7614&rft.eissn=1745-1701&rft_id=info:doi/10.1093/schbul/sbz105&rft_dat=%3Cproquest_pubme%3E2333609827%3C/proquest_pubme%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c411t-890f890203d0bdebb186269fc54c578b9547dcba6bbc1497d92562745b54ef0b3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2333609827&rft_id=info:pmid/31901100&rfr_iscdi=true