Loading…

Predicting Ambulance Patient Wait Times: A Multicenter Derivation and Validation Study

To derive and internally and externally validate machine-learning models to predict emergency ambulance patient door–to–off-stretcher wait times that are applicable to a wide variety of emergency departments. Nine emergency departments provided 3 years (2017 to 2019) of retrospective administrative...

Full description

Saved in:
Bibliographic Details
Published in:Annals of emergency medicine 2021-07, Vol.78 (1), p.113-122
Main Authors: Walker, Katie J., Jiarpakdee, Jirayus, Loupis, Anne, Tantithamthavorn, Chakkrit, Joe, Keith, Ben-Meir, Michael, Akhlaghi, Hamed, Hutton, Jennie, Wang, Wei, Stephenson, Michael, Blecher, Gabriel, Buntine, Paul, Sweeny, Amy, Turhan, Burak
Format: Article
Language:English
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c428t-c57d3f61a0cc5add13db403fc8e34c51f508318ff464b13d01809ed4cb241c743
cites cdi_FETCH-LOGICAL-c428t-c57d3f61a0cc5add13db403fc8e34c51f508318ff464b13d01809ed4cb241c743
container_end_page 122
container_issue 1
container_start_page 113
container_title Annals of emergency medicine
container_volume 78
creator Walker, Katie J.
Jiarpakdee, Jirayus
Loupis, Anne
Tantithamthavorn, Chakkrit
Joe, Keith
Ben-Meir, Michael
Akhlaghi, Hamed
Hutton, Jennie
Wang, Wei
Stephenson, Michael
Blecher, Gabriel
Buntine, Paul
Sweeny, Amy
Turhan, Burak
description To derive and internally and externally validate machine-learning models to predict emergency ambulance patient door–to–off-stretcher wait times that are applicable to a wide variety of emergency departments. Nine emergency departments provided 3 years (2017 to 2019) of retrospective administrative data from Australia. Descriptive and exploratory analyses were undertaken on the datasets. Statistical and machine-learning models were developed to predict wait times at each site and were internally and externally validated. There were 421,894 episodes analyzed, and median site off-load times varied from 13 (interquartile range [IQR], 9 to 20) to 29 (IQR, 16 to 48) minutes. The global site prediction model median absolute errors were 11.7 minutes (95% confidence interval [CI], 11.7 to 11.8) using linear regression and 12.8 minutes (95% CI, 12.7 to 12.9) using elastic net. The individual site model prediction median absolute errors varied from the most accurate at 6.3 minutes (95% CI, 6.2 to 6.4) to the least accurate at 16.1 minutes (95% CI, 15.8 to 16.3). The model technique performance was the same for linear regression, random forests, elastic net, and rolling average. The important variables were the last k-patient average waits, triage category, and patient age. The global model performed at the lower end of the accuracy range compared with models for the individual sites but was within tolerable limits. Electronic emergency demographic and flow information can be used to estimate emergency ambulance patient off-stretcher times. Models can be built with reasonable accuracy for multiple hospitals using a small number of point-of-care variables.
doi_str_mv 10.1016/j.annemergmed.2021.02.010
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2525650388</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0196064421001219</els_id><sourcerecordid>2525650388</sourcerecordid><originalsourceid>FETCH-LOGICAL-c428t-c57d3f61a0cc5add13db403fc8e34c51f508318ff464b13d01809ed4cb241c743</originalsourceid><addsrcrecordid>eNqNkEtLJDEQgIO4rKPuX5B489K9lUe_vA3jE1wUdN1jSCfVkqEfmqQH_PdmGAWPeyqq6qsq6iPklEHOgJW_17keRxzQvwxocw6c5cBzYLBHFgyaKiurEvbJAlhTZlBKeUAOQ1gDQCM5-0kOhGgqzni1IM8PHq0z0Y0vdDm0c69Hg_RBR4djpP-0i_TJDRjO6ZL-mfvoTKqjpxfo3SZR00j1aOmz7p3dpY9xtu_H5Een-4C_PuMR-Xt1-bS6ye7ur29Xy7vMSF7HzBSVFV3JNBhTaGuZsK0E0ZkahTQF6wqoBau7TpayTU1gNTRopWm5ZKaS4oic7fa--ultxhDV4ILBPr2B0xwUL3hRFiDqOqHNDjV-CsFjp169G7R_VwzUVqtaq29a1VarAq6S1jR78nlmbre9r8kvjwlY7QBMz24cehVMMmiSW48mKju5_zjzAcaWjwE</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2525650388</pqid></control><display><type>article</type><title>Predicting Ambulance Patient Wait Times: A Multicenter Derivation and Validation Study</title><source>ScienceDirect Freedom Collection</source><creator>Walker, Katie J. ; Jiarpakdee, Jirayus ; Loupis, Anne ; Tantithamthavorn, Chakkrit ; Joe, Keith ; Ben-Meir, Michael ; Akhlaghi, Hamed ; Hutton, Jennie ; Wang, Wei ; Stephenson, Michael ; Blecher, Gabriel ; Buntine, Paul ; Sweeny, Amy ; Turhan, Burak</creator><creatorcontrib>Walker, Katie J. ; Jiarpakdee, Jirayus ; Loupis, Anne ; Tantithamthavorn, Chakkrit ; Joe, Keith ; Ben-Meir, Michael ; Akhlaghi, Hamed ; Hutton, Jennie ; Wang, Wei ; Stephenson, Michael ; Blecher, Gabriel ; Buntine, Paul ; Sweeny, Amy ; Turhan, Burak ; Australasian College for Emergency Medicine, Clinical Trials Network</creatorcontrib><description>To derive and internally and externally validate machine-learning models to predict emergency ambulance patient door–to–off-stretcher wait times that are applicable to a wide variety of emergency departments. Nine emergency departments provided 3 years (2017 to 2019) of retrospective administrative data from Australia. Descriptive and exploratory analyses were undertaken on the datasets. Statistical and machine-learning models were developed to predict wait times at each site and were internally and externally validated. There were 421,894 episodes analyzed, and median site off-load times varied from 13 (interquartile range [IQR], 9 to 20) to 29 (IQR, 16 to 48) minutes. The global site prediction model median absolute errors were 11.7 minutes (95% confidence interval [CI], 11.7 to 11.8) using linear regression and 12.8 minutes (95% CI, 12.7 to 12.9) using elastic net. The individual site model prediction median absolute errors varied from the most accurate at 6.3 minutes (95% CI, 6.2 to 6.4) to the least accurate at 16.1 minutes (95% CI, 15.8 to 16.3). The model technique performance was the same for linear regression, random forests, elastic net, and rolling average. The important variables were the last k-patient average waits, triage category, and patient age. The global model performed at the lower end of the accuracy range compared with models for the individual sites but was within tolerable limits. Electronic emergency demographic and flow information can be used to estimate emergency ambulance patient off-stretcher times. Models can be built with reasonable accuracy for multiple hospitals using a small number of point-of-care variables.</description><identifier>ISSN: 0196-0644</identifier><identifier>EISSN: 1097-6760</identifier><identifier>DOI: 10.1016/j.annemergmed.2021.02.010</identifier><identifier>PMID: 33972127</identifier><language>eng</language><publisher>United States: Elsevier Inc</publisher><ispartof>Annals of emergency medicine, 2021-07, Vol.78 (1), p.113-122</ispartof><rights>2021 American College of Emergency Physicians</rights><rights>Copyright © 2021 American College of Emergency Physicians. Published by Elsevier Inc. All rights reserved.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c428t-c57d3f61a0cc5add13db403fc8e34c51f508318ff464b13d01809ed4cb241c743</citedby><cites>FETCH-LOGICAL-c428t-c57d3f61a0cc5add13db403fc8e34c51f508318ff464b13d01809ed4cb241c743</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,27901,27902</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/33972127$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Walker, Katie J.</creatorcontrib><creatorcontrib>Jiarpakdee, Jirayus</creatorcontrib><creatorcontrib>Loupis, Anne</creatorcontrib><creatorcontrib>Tantithamthavorn, Chakkrit</creatorcontrib><creatorcontrib>Joe, Keith</creatorcontrib><creatorcontrib>Ben-Meir, Michael</creatorcontrib><creatorcontrib>Akhlaghi, Hamed</creatorcontrib><creatorcontrib>Hutton, Jennie</creatorcontrib><creatorcontrib>Wang, Wei</creatorcontrib><creatorcontrib>Stephenson, Michael</creatorcontrib><creatorcontrib>Blecher, Gabriel</creatorcontrib><creatorcontrib>Buntine, Paul</creatorcontrib><creatorcontrib>Sweeny, Amy</creatorcontrib><creatorcontrib>Turhan, Burak</creatorcontrib><creatorcontrib>Australasian College for Emergency Medicine, Clinical Trials Network</creatorcontrib><title>Predicting Ambulance Patient Wait Times: A Multicenter Derivation and Validation Study</title><title>Annals of emergency medicine</title><addtitle>Ann Emerg Med</addtitle><description>To derive and internally and externally validate machine-learning models to predict emergency ambulance patient door–to–off-stretcher wait times that are applicable to a wide variety of emergency departments. Nine emergency departments provided 3 years (2017 to 2019) of retrospective administrative data from Australia. Descriptive and exploratory analyses were undertaken on the datasets. Statistical and machine-learning models were developed to predict wait times at each site and were internally and externally validated. There were 421,894 episodes analyzed, and median site off-load times varied from 13 (interquartile range [IQR], 9 to 20) to 29 (IQR, 16 to 48) minutes. The global site prediction model median absolute errors were 11.7 minutes (95% confidence interval [CI], 11.7 to 11.8) using linear regression and 12.8 minutes (95% CI, 12.7 to 12.9) using elastic net. The individual site model prediction median absolute errors varied from the most accurate at 6.3 minutes (95% CI, 6.2 to 6.4) to the least accurate at 16.1 minutes (95% CI, 15.8 to 16.3). The model technique performance was the same for linear regression, random forests, elastic net, and rolling average. The important variables were the last k-patient average waits, triage category, and patient age. The global model performed at the lower end of the accuracy range compared with models for the individual sites but was within tolerable limits. Electronic emergency demographic and flow information can be used to estimate emergency ambulance patient off-stretcher times. Models can be built with reasonable accuracy for multiple hospitals using a small number of point-of-care variables.</description><issn>0196-0644</issn><issn>1097-6760</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><recordid>eNqNkEtLJDEQgIO4rKPuX5B489K9lUe_vA3jE1wUdN1jSCfVkqEfmqQH_PdmGAWPeyqq6qsq6iPklEHOgJW_17keRxzQvwxocw6c5cBzYLBHFgyaKiurEvbJAlhTZlBKeUAOQ1gDQCM5-0kOhGgqzni1IM8PHq0z0Y0vdDm0c69Hg_RBR4djpP-0i_TJDRjO6ZL-mfvoTKqjpxfo3SZR00j1aOmz7p3dpY9xtu_H5Een-4C_PuMR-Xt1-bS6ye7ur29Xy7vMSF7HzBSVFV3JNBhTaGuZsK0E0ZkahTQF6wqoBau7TpayTU1gNTRopWm5ZKaS4oic7fa--ultxhDV4ILBPr2B0xwUL3hRFiDqOqHNDjV-CsFjp169G7R_VwzUVqtaq29a1VarAq6S1jR78nlmbre9r8kvjwlY7QBMz24cehVMMmiSW48mKju5_zjzAcaWjwE</recordid><startdate>20210701</startdate><enddate>20210701</enddate><creator>Walker, Katie J.</creator><creator>Jiarpakdee, Jirayus</creator><creator>Loupis, Anne</creator><creator>Tantithamthavorn, Chakkrit</creator><creator>Joe, Keith</creator><creator>Ben-Meir, Michael</creator><creator>Akhlaghi, Hamed</creator><creator>Hutton, Jennie</creator><creator>Wang, Wei</creator><creator>Stephenson, Michael</creator><creator>Blecher, Gabriel</creator><creator>Buntine, Paul</creator><creator>Sweeny, Amy</creator><creator>Turhan, Burak</creator><general>Elsevier Inc</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope></search><sort><creationdate>20210701</creationdate><title>Predicting Ambulance Patient Wait Times: A Multicenter Derivation and Validation Study</title><author>Walker, Katie J. ; Jiarpakdee, Jirayus ; Loupis, Anne ; Tantithamthavorn, Chakkrit ; Joe, Keith ; Ben-Meir, Michael ; Akhlaghi, Hamed ; Hutton, Jennie ; Wang, Wei ; Stephenson, Michael ; Blecher, Gabriel ; Buntine, Paul ; Sweeny, Amy ; Turhan, Burak</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c428t-c57d3f61a0cc5add13db403fc8e34c51f508318ff464b13d01809ed4cb241c743</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Walker, Katie J.</creatorcontrib><creatorcontrib>Jiarpakdee, Jirayus</creatorcontrib><creatorcontrib>Loupis, Anne</creatorcontrib><creatorcontrib>Tantithamthavorn, Chakkrit</creatorcontrib><creatorcontrib>Joe, Keith</creatorcontrib><creatorcontrib>Ben-Meir, Michael</creatorcontrib><creatorcontrib>Akhlaghi, Hamed</creatorcontrib><creatorcontrib>Hutton, Jennie</creatorcontrib><creatorcontrib>Wang, Wei</creatorcontrib><creatorcontrib>Stephenson, Michael</creatorcontrib><creatorcontrib>Blecher, Gabriel</creatorcontrib><creatorcontrib>Buntine, Paul</creatorcontrib><creatorcontrib>Sweeny, Amy</creatorcontrib><creatorcontrib>Turhan, Burak</creatorcontrib><creatorcontrib>Australasian College for Emergency Medicine, Clinical Trials Network</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Annals of emergency medicine</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Walker, Katie J.</au><au>Jiarpakdee, Jirayus</au><au>Loupis, Anne</au><au>Tantithamthavorn, Chakkrit</au><au>Joe, Keith</au><au>Ben-Meir, Michael</au><au>Akhlaghi, Hamed</au><au>Hutton, Jennie</au><au>Wang, Wei</au><au>Stephenson, Michael</au><au>Blecher, Gabriel</au><au>Buntine, Paul</au><au>Sweeny, Amy</au><au>Turhan, Burak</au><aucorp>Australasian College for Emergency Medicine, Clinical Trials Network</aucorp><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Predicting Ambulance Patient Wait Times: A Multicenter Derivation and Validation Study</atitle><jtitle>Annals of emergency medicine</jtitle><addtitle>Ann Emerg Med</addtitle><date>2021-07-01</date><risdate>2021</risdate><volume>78</volume><issue>1</issue><spage>113</spage><epage>122</epage><pages>113-122</pages><issn>0196-0644</issn><eissn>1097-6760</eissn><abstract>To derive and internally and externally validate machine-learning models to predict emergency ambulance patient door–to–off-stretcher wait times that are applicable to a wide variety of emergency departments. Nine emergency departments provided 3 years (2017 to 2019) of retrospective administrative data from Australia. Descriptive and exploratory analyses were undertaken on the datasets. Statistical and machine-learning models were developed to predict wait times at each site and were internally and externally validated. There were 421,894 episodes analyzed, and median site off-load times varied from 13 (interquartile range [IQR], 9 to 20) to 29 (IQR, 16 to 48) minutes. The global site prediction model median absolute errors were 11.7 minutes (95% confidence interval [CI], 11.7 to 11.8) using linear regression and 12.8 minutes (95% CI, 12.7 to 12.9) using elastic net. The individual site model prediction median absolute errors varied from the most accurate at 6.3 minutes (95% CI, 6.2 to 6.4) to the least accurate at 16.1 minutes (95% CI, 15.8 to 16.3). The model technique performance was the same for linear regression, random forests, elastic net, and rolling average. The important variables were the last k-patient average waits, triage category, and patient age. The global model performed at the lower end of the accuracy range compared with models for the individual sites but was within tolerable limits. Electronic emergency demographic and flow information can be used to estimate emergency ambulance patient off-stretcher times. Models can be built with reasonable accuracy for multiple hospitals using a small number of point-of-care variables.</abstract><cop>United States</cop><pub>Elsevier Inc</pub><pmid>33972127</pmid><doi>10.1016/j.annemergmed.2021.02.010</doi><tpages>10</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0196-0644
ispartof Annals of emergency medicine, 2021-07, Vol.78 (1), p.113-122
issn 0196-0644
1097-6760
language eng
recordid cdi_proquest_miscellaneous_2525650388
source ScienceDirect Freedom Collection
title Predicting Ambulance Patient Wait Times: A Multicenter Derivation and Validation Study
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-24T02%3A16%3A16IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Predicting%20Ambulance%20Patient%20Wait%20Times:%20A%20Multicenter%20Derivation%20and%20Validation%20Study&rft.jtitle=Annals%20of%20emergency%20medicine&rft.au=Walker,%20Katie%20J.&rft.aucorp=Australasian%20College%20for%20Emergency%20Medicine,%20Clinical%20Trials%20Network&rft.date=2021-07-01&rft.volume=78&rft.issue=1&rft.spage=113&rft.epage=122&rft.pages=113-122&rft.issn=0196-0644&rft.eissn=1097-6760&rft_id=info:doi/10.1016/j.annemergmed.2021.02.010&rft_dat=%3Cproquest_cross%3E2525650388%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c428t-c57d3f61a0cc5add13db403fc8e34c51f508318ff464b13d01809ed4cb241c743%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2525650388&rft_id=info:pmid/33972127&rfr_iscdi=true