Loading…

Standard-based comprehensive detection of adverse drug reaction signals from nursing statements and laboratory results in electronic health records

Abstract Objective. We propose 2 Medical Dictionary for Regulatory Activities–enabled pharmacovigilance algorithms, MetaLAB and MetaNurse, powered by a per-year meta-analysis technique and improved subject sampling strategy. Matrials and methods. This study developed 2 novel algorithms, MetaLAB for...

Full description

Saved in:
Bibliographic Details
Published in:Journal of the American Medical Informatics Association : JAMIA 2017-07, Vol.24 (4), p.697-708
Main Authors: Lee, Suehyun, Choi, Jiyeob, Kim, Hun-Sung, Kim, Grace Juyun, Lee, Kye Hwa, Park, Chan Hee, Han, Jongsoo, Yoon, Dukyong, Park, Man Young, Park, Rae Woong, Kang, Hye-Ryun, Kim, Ju Han
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c416t-eaf585449607a750709a3ad801b6e9a7780cbdd0023249f39add8fc2cf20908c3
cites cdi_FETCH-LOGICAL-c416t-eaf585449607a750709a3ad801b6e9a7780cbdd0023249f39add8fc2cf20908c3
container_end_page 708
container_issue 4
container_start_page 697
container_title Journal of the American Medical Informatics Association : JAMIA
container_volume 24
creator Lee, Suehyun
Choi, Jiyeob
Kim, Hun-Sung
Kim, Grace Juyun
Lee, Kye Hwa
Park, Chan Hee
Han, Jongsoo
Yoon, Dukyong
Park, Man Young
Park, Rae Woong
Kang, Hye-Ryun
Kim, Ju Han
description Abstract Objective. We propose 2 Medical Dictionary for Regulatory Activities–enabled pharmacovigilance algorithms, MetaLAB and MetaNurse, powered by a per-year meta-analysis technique and improved subject sampling strategy. Matrials and methods. This study developed 2 novel algorithms, MetaLAB for laboratory abnormalities and MetaNurse for standard nursing statements, as significantly improved versions of our previous electronic health record (EHR)–based pharmacovigilance method, called CLEAR. Adverse drug reaction (ADR) signals from 117 laboratory abnormalities and 1357 standard nursing statements for all precautionary drugs (n  = 101) were comprehensively detected and validated against SIDER (Side Effect Resource) by MetaLAB and MetaNurse against 11 817 and 76 457 drug-ADR pairs, respectively. Results. We demonstrate that MetaLAB (area under the curve, AUC = 0.61 ± 0.18) outperformed CLEAR (AUC = 0.55 ± 0.06) when we applied the same 470 drug-event pairs as the gold standard, as in our previous research. Receiver operating characteristic curves for 101 precautionary terms in the Medical Dictionary for Regulatory Activities Preferred Terms were obtained for MetaLAB and MetaNurse (0.69 ± 0.11; 0.62 ± 0.07), which complemented each other in terms of ADR signal coverage. Novel ADR signals discovered by MetaLAB and MetaNurse were successfully validated against spontaneous reports in the US Food and Drug Administration Adverse Event Reporting System database. Discussion. The present study demonstrates the symbiosis of laboratory test results and nursing statements for ADR signal detection in terms of their system organ class coverage and performance profiles. Conclusion. Systematic discovery and evaluation of the wide spectrum of ADR signals using standard-based observational electronic health record data across many institutions will affect drug development and use, as well as postmarketing surveillance and regulation.
doi_str_mv 10.1093/jamia/ocw168
format article
fullrecord <record><control><sourceid>oup_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_7651894</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><oup_id>10.1093/jamia/ocw168</oup_id><sourcerecordid>10.1093/jamia/ocw168</sourcerecordid><originalsourceid>FETCH-LOGICAL-c416t-eaf585449607a750709a3ad801b6e9a7780cbdd0023249f39add8fc2cf20908c3</originalsourceid><addsrcrecordid>eNp9kTtvFTEQhS0EIiHQUSN3NCwZ78t2g4QiXlIkChKJbjVrz97raNe-sr0X5Xfwh2NYiKBJNaM5Z76xdRh7KeCtAN2c3-Di8DyYH6JXj9ip6GpZadl-f1x66GXVQS1P2LOUbgBEXzfdU3ZSK1CyU90p-_kto7cYbTViIstNWA6R9uSTOxK3lMlkFzwPE0d7pJjKMK47Hgk3IbmdxznxKYaF-zUm53c8Zcy0kM-JFzqfcQwRc4i3ZS-tcxk7z2ku7Bi8M3xPOOd9EU2INj1nT6aCpBd_6hm7_vjh6uJzdfn105eL95eVaUWfK8KpfKFtdQ8SZQcSNDZoFYixJ41SKjCjtQB1U7d6ajRaqyZTm6kGDco0Z-zdxj2s40LWlPdGnIdDdAvG2yGgG_5XvNsPu3AcZN8JpdsCeLMBTAwpRZrudwUMv8IZfoczbOEU-6t_792b_6ZRDK83Q1gPD6PuAJRLoF8</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Standard-based comprehensive detection of adverse drug reaction signals from nursing statements and laboratory results in electronic health records</title><source>Oxford Journals Online</source><source>PubMed Central</source><creator>Lee, Suehyun ; Choi, Jiyeob ; Kim, Hun-Sung ; Kim, Grace Juyun ; Lee, Kye Hwa ; Park, Chan Hee ; Han, Jongsoo ; Yoon, Dukyong ; Park, Man Young ; Park, Rae Woong ; Kang, Hye-Ryun ; Kim, Ju Han</creator><creatorcontrib>Lee, Suehyun ; Choi, Jiyeob ; Kim, Hun-Sung ; Kim, Grace Juyun ; Lee, Kye Hwa ; Park, Chan Hee ; Han, Jongsoo ; Yoon, Dukyong ; Park, Man Young ; Park, Rae Woong ; Kang, Hye-Ryun ; Kim, Ju Han</creatorcontrib><description>Abstract Objective. We propose 2 Medical Dictionary for Regulatory Activities–enabled pharmacovigilance algorithms, MetaLAB and MetaNurse, powered by a per-year meta-analysis technique and improved subject sampling strategy. Matrials and methods. This study developed 2 novel algorithms, MetaLAB for laboratory abnormalities and MetaNurse for standard nursing statements, as significantly improved versions of our previous electronic health record (EHR)–based pharmacovigilance method, called CLEAR. Adverse drug reaction (ADR) signals from 117 laboratory abnormalities and 1357 standard nursing statements for all precautionary drugs (n  = 101) were comprehensively detected and validated against SIDER (Side Effect Resource) by MetaLAB and MetaNurse against 11 817 and 76 457 drug-ADR pairs, respectively. Results. We demonstrate that MetaLAB (area under the curve, AUC = 0.61 ± 0.18) outperformed CLEAR (AUC = 0.55 ± 0.06) when we applied the same 470 drug-event pairs as the gold standard, as in our previous research. Receiver operating characteristic curves for 101 precautionary terms in the Medical Dictionary for Regulatory Activities Preferred Terms were obtained for MetaLAB and MetaNurse (0.69 ± 0.11; 0.62 ± 0.07), which complemented each other in terms of ADR signal coverage. Novel ADR signals discovered by MetaLAB and MetaNurse were successfully validated against spontaneous reports in the US Food and Drug Administration Adverse Event Reporting System database. Discussion. The present study demonstrates the symbiosis of laboratory test results and nursing statements for ADR signal detection in terms of their system organ class coverage and performance profiles. Conclusion. Systematic discovery and evaluation of the wide spectrum of ADR signals using standard-based observational electronic health record data across many institutions will affect drug development and use, as well as postmarketing surveillance and regulation.</description><identifier>ISSN: 1067-5027</identifier><identifier>EISSN: 1527-974X</identifier><identifier>DOI: 10.1093/jamia/ocw168</identifier><identifier>PMID: 28087585</identifier><language>eng</language><publisher>England: Oxford University Press</publisher><subject>Adverse Drug Reaction Reporting Systems ; Algorithms ; Area Under Curve ; Clinical Laboratory Information Systems ; Electronic Health Records ; Humans ; Nursing Records ; Pharmacovigilance ; Research and Applications ; ROC Curve</subject><ispartof>Journal of the American Medical Informatics Association : JAMIA, 2017-07, Vol.24 (4), p.697-708</ispartof><rights>The Author 2017. Published by Oxford University Press on behalf of the American Medical Informatics Association. 2017</rights><rights>The Author 2017. Published by Oxford University Press on behalf of the American Medical Informatics Association.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c416t-eaf585449607a750709a3ad801b6e9a7780cbdd0023249f39add8fc2cf20908c3</citedby><cites>FETCH-LOGICAL-c416t-eaf585449607a750709a3ad801b6e9a7780cbdd0023249f39add8fc2cf20908c3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC7651894/pdf/$$EPDF$$P50$$Gpubmedcentral$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC7651894/$$EHTML$$P50$$Gpubmedcentral$$Hfree_for_read</linktohtml><link.rule.ids>230,314,727,780,784,885,27924,27925,53791,53793</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/28087585$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Lee, Suehyun</creatorcontrib><creatorcontrib>Choi, Jiyeob</creatorcontrib><creatorcontrib>Kim, Hun-Sung</creatorcontrib><creatorcontrib>Kim, Grace Juyun</creatorcontrib><creatorcontrib>Lee, Kye Hwa</creatorcontrib><creatorcontrib>Park, Chan Hee</creatorcontrib><creatorcontrib>Han, Jongsoo</creatorcontrib><creatorcontrib>Yoon, Dukyong</creatorcontrib><creatorcontrib>Park, Man Young</creatorcontrib><creatorcontrib>Park, Rae Woong</creatorcontrib><creatorcontrib>Kang, Hye-Ryun</creatorcontrib><creatorcontrib>Kim, Ju Han</creatorcontrib><title>Standard-based comprehensive detection of adverse drug reaction signals from nursing statements and laboratory results in electronic health records</title><title>Journal of the American Medical Informatics Association : JAMIA</title><addtitle>J Am Med Inform Assoc</addtitle><description>Abstract Objective. We propose 2 Medical Dictionary for Regulatory Activities–enabled pharmacovigilance algorithms, MetaLAB and MetaNurse, powered by a per-year meta-analysis technique and improved subject sampling strategy. Matrials and methods. This study developed 2 novel algorithms, MetaLAB for laboratory abnormalities and MetaNurse for standard nursing statements, as significantly improved versions of our previous electronic health record (EHR)–based pharmacovigilance method, called CLEAR. Adverse drug reaction (ADR) signals from 117 laboratory abnormalities and 1357 standard nursing statements for all precautionary drugs (n  = 101) were comprehensively detected and validated against SIDER (Side Effect Resource) by MetaLAB and MetaNurse against 11 817 and 76 457 drug-ADR pairs, respectively. Results. We demonstrate that MetaLAB (area under the curve, AUC = 0.61 ± 0.18) outperformed CLEAR (AUC = 0.55 ± 0.06) when we applied the same 470 drug-event pairs as the gold standard, as in our previous research. Receiver operating characteristic curves for 101 precautionary terms in the Medical Dictionary for Regulatory Activities Preferred Terms were obtained for MetaLAB and MetaNurse (0.69 ± 0.11; 0.62 ± 0.07), which complemented each other in terms of ADR signal coverage. Novel ADR signals discovered by MetaLAB and MetaNurse were successfully validated against spontaneous reports in the US Food and Drug Administration Adverse Event Reporting System database. Discussion. The present study demonstrates the symbiosis of laboratory test results and nursing statements for ADR signal detection in terms of their system organ class coverage and performance profiles. Conclusion. Systematic discovery and evaluation of the wide spectrum of ADR signals using standard-based observational electronic health record data across many institutions will affect drug development and use, as well as postmarketing surveillance and regulation.</description><subject>Adverse Drug Reaction Reporting Systems</subject><subject>Algorithms</subject><subject>Area Under Curve</subject><subject>Clinical Laboratory Information Systems</subject><subject>Electronic Health Records</subject><subject>Humans</subject><subject>Nursing Records</subject><subject>Pharmacovigilance</subject><subject>Research and Applications</subject><subject>ROC Curve</subject><issn>1067-5027</issn><issn>1527-974X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2017</creationdate><recordtype>article</recordtype><sourceid>TOX</sourceid><recordid>eNp9kTtvFTEQhS0EIiHQUSN3NCwZ78t2g4QiXlIkChKJbjVrz97raNe-sr0X5Xfwh2NYiKBJNaM5Z76xdRh7KeCtAN2c3-Di8DyYH6JXj9ip6GpZadl-f1x66GXVQS1P2LOUbgBEXzfdU3ZSK1CyU90p-_kto7cYbTViIstNWA6R9uSTOxK3lMlkFzwPE0d7pJjKMK47Hgk3IbmdxznxKYaF-zUm53c8Zcy0kM-JFzqfcQwRc4i3ZS-tcxk7z2ku7Bi8M3xPOOd9EU2INj1nT6aCpBd_6hm7_vjh6uJzdfn105eL95eVaUWfK8KpfKFtdQ8SZQcSNDZoFYixJ41SKjCjtQB1U7d6ajRaqyZTm6kGDco0Z-zdxj2s40LWlPdGnIdDdAvG2yGgG_5XvNsPu3AcZN8JpdsCeLMBTAwpRZrudwUMv8IZfoczbOEU-6t_792b_6ZRDK83Q1gPD6PuAJRLoF8</recordid><startdate>20170701</startdate><enddate>20170701</enddate><creator>Lee, Suehyun</creator><creator>Choi, Jiyeob</creator><creator>Kim, Hun-Sung</creator><creator>Kim, Grace Juyun</creator><creator>Lee, Kye Hwa</creator><creator>Park, Chan Hee</creator><creator>Han, Jongsoo</creator><creator>Yoon, Dukyong</creator><creator>Park, Man Young</creator><creator>Park, Rae Woong</creator><creator>Kang, Hye-Ryun</creator><creator>Kim, Ju Han</creator><general>Oxford University Press</general><scope>TOX</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>5PM</scope></search><sort><creationdate>20170701</creationdate><title>Standard-based comprehensive detection of adverse drug reaction signals from nursing statements and laboratory results in electronic health records</title><author>Lee, Suehyun ; Choi, Jiyeob ; Kim, Hun-Sung ; Kim, Grace Juyun ; Lee, Kye Hwa ; Park, Chan Hee ; Han, Jongsoo ; Yoon, Dukyong ; Park, Man Young ; Park, Rae Woong ; Kang, Hye-Ryun ; Kim, Ju Han</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c416t-eaf585449607a750709a3ad801b6e9a7780cbdd0023249f39add8fc2cf20908c3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2017</creationdate><topic>Adverse Drug Reaction Reporting Systems</topic><topic>Algorithms</topic><topic>Area Under Curve</topic><topic>Clinical Laboratory Information Systems</topic><topic>Electronic Health Records</topic><topic>Humans</topic><topic>Nursing Records</topic><topic>Pharmacovigilance</topic><topic>Research and Applications</topic><topic>ROC Curve</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Lee, Suehyun</creatorcontrib><creatorcontrib>Choi, Jiyeob</creatorcontrib><creatorcontrib>Kim, Hun-Sung</creatorcontrib><creatorcontrib>Kim, Grace Juyun</creatorcontrib><creatorcontrib>Lee, Kye Hwa</creatorcontrib><creatorcontrib>Park, Chan Hee</creatorcontrib><creatorcontrib>Han, Jongsoo</creatorcontrib><creatorcontrib>Yoon, Dukyong</creatorcontrib><creatorcontrib>Park, Man Young</creatorcontrib><creatorcontrib>Park, Rae Woong</creatorcontrib><creatorcontrib>Kang, Hye-Ryun</creatorcontrib><creatorcontrib>Kim, Ju Han</creatorcontrib><collection>Oxford Journals Open Access Collection</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Journal of the American Medical Informatics Association : JAMIA</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lee, Suehyun</au><au>Choi, Jiyeob</au><au>Kim, Hun-Sung</au><au>Kim, Grace Juyun</au><au>Lee, Kye Hwa</au><au>Park, Chan Hee</au><au>Han, Jongsoo</au><au>Yoon, Dukyong</au><au>Park, Man Young</au><au>Park, Rae Woong</au><au>Kang, Hye-Ryun</au><au>Kim, Ju Han</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Standard-based comprehensive detection of adverse drug reaction signals from nursing statements and laboratory results in electronic health records</atitle><jtitle>Journal of the American Medical Informatics Association : JAMIA</jtitle><addtitle>J Am Med Inform Assoc</addtitle><date>2017-07-01</date><risdate>2017</risdate><volume>24</volume><issue>4</issue><spage>697</spage><epage>708</epage><pages>697-708</pages><issn>1067-5027</issn><eissn>1527-974X</eissn><abstract>Abstract Objective. We propose 2 Medical Dictionary for Regulatory Activities–enabled pharmacovigilance algorithms, MetaLAB and MetaNurse, powered by a per-year meta-analysis technique and improved subject sampling strategy. Matrials and methods. This study developed 2 novel algorithms, MetaLAB for laboratory abnormalities and MetaNurse for standard nursing statements, as significantly improved versions of our previous electronic health record (EHR)–based pharmacovigilance method, called CLEAR. Adverse drug reaction (ADR) signals from 117 laboratory abnormalities and 1357 standard nursing statements for all precautionary drugs (n  = 101) were comprehensively detected and validated against SIDER (Side Effect Resource) by MetaLAB and MetaNurse against 11 817 and 76 457 drug-ADR pairs, respectively. Results. We demonstrate that MetaLAB (area under the curve, AUC = 0.61 ± 0.18) outperformed CLEAR (AUC = 0.55 ± 0.06) when we applied the same 470 drug-event pairs as the gold standard, as in our previous research. Receiver operating characteristic curves for 101 precautionary terms in the Medical Dictionary for Regulatory Activities Preferred Terms were obtained for MetaLAB and MetaNurse (0.69 ± 0.11; 0.62 ± 0.07), which complemented each other in terms of ADR signal coverage. Novel ADR signals discovered by MetaLAB and MetaNurse were successfully validated against spontaneous reports in the US Food and Drug Administration Adverse Event Reporting System database. Discussion. The present study demonstrates the symbiosis of laboratory test results and nursing statements for ADR signal detection in terms of their system organ class coverage and performance profiles. Conclusion. Systematic discovery and evaluation of the wide spectrum of ADR signals using standard-based observational electronic health record data across many institutions will affect drug development and use, as well as postmarketing surveillance and regulation.</abstract><cop>England</cop><pub>Oxford University Press</pub><pmid>28087585</pmid><doi>10.1093/jamia/ocw168</doi><tpages>12</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1067-5027
ispartof Journal of the American Medical Informatics Association : JAMIA, 2017-07, Vol.24 (4), p.697-708
issn 1067-5027
1527-974X
language eng
recordid cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_7651894
source Oxford Journals Online; PubMed Central
subjects Adverse Drug Reaction Reporting Systems
Algorithms
Area Under Curve
Clinical Laboratory Information Systems
Electronic Health Records
Humans
Nursing Records
Pharmacovigilance
Research and Applications
ROC Curve
title Standard-based comprehensive detection of adverse drug reaction signals from nursing statements and laboratory results in electronic health records
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T21%3A32%3A26IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-oup_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Standard-based%20comprehensive%20detection%20of%20adverse%20drug%20reaction%20signals%20from%20nursing%20statements%20and%20laboratory%20results%20in%20electronic%20health%20records&rft.jtitle=Journal%20of%20the%20American%20Medical%20Informatics%20Association%20:%20JAMIA&rft.au=Lee,%20Suehyun&rft.date=2017-07-01&rft.volume=24&rft.issue=4&rft.spage=697&rft.epage=708&rft.pages=697-708&rft.issn=1067-5027&rft.eissn=1527-974X&rft_id=info:doi/10.1093/jamia/ocw168&rft_dat=%3Coup_pubme%3E10.1093/jamia/ocw168%3C/oup_pubme%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c416t-eaf585449607a750709a3ad801b6e9a7780cbdd0023249f39add8fc2cf20908c3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/28087585&rft_oup_id=10.1093/jamia/ocw168&rfr_iscdi=true