Loading…

Development of a predictive model to identify inpatients at risk of re-admission within 30 days of discharge (PARR-30)

Objectives To develop an algorithm for identifying inpatients at high risk of re-admission to a National Health Service (NHS) hospital in England within 30 days of discharge using information that can either be obtained from hospital information systems or from the patient and their notes. Design Mu...

Full description

Saved in:
Bibliographic Details
Published in:BMJ open 2012-01, Vol.2 (4), p.e001667
Main Authors: Billings, John, Blunt, Ian, Steventon, Adam, Georghiou, Theo, Lewis, Geraint, Bardsley, Martin
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-b472t-aab6e079736212349ece8af235169abdc501c1f870d3104fdbed4ec456570ce63
cites cdi_FETCH-LOGICAL-b472t-aab6e079736212349ece8af235169abdc501c1f870d3104fdbed4ec456570ce63
container_end_page
container_issue 4
container_start_page e001667
container_title BMJ open
container_volume 2
creator Billings, John
Blunt, Ian
Steventon, Adam
Georghiou, Theo
Lewis, Geraint
Bardsley, Martin
description Objectives To develop an algorithm for identifying inpatients at high risk of re-admission to a National Health Service (NHS) hospital in England within 30 days of discharge using information that can either be obtained from hospital information systems or from the patient and their notes. Design Multivariate statistical analysis of routinely collected hospital episode statistics (HES) data using logistic regression to build the predictive model. The model's performance was calculated using bootstrapping. Setting HES data covering all NHS hospital admissions in England. Participants The NHS patients were admitted to hospital between April 2008 and March 2009 (10% sample of all admissions, n=576 868). Main outcome measures Area under the receiver operating characteristic curve for the algorithm, together with its positive predictive value and sensitivity for a range of risk score thresholds. Results The algorithm produces a ‘risk score’ ranging (0–1) for each admitted patient, and the percentage of patients with a re-admission within 30 days and the mean re-admission costs of all patients are provided for 20 risk bands. At a risk score threshold of 0.5, the positive predictive value (ie, percentage of inpatients identified as high risk who were subsequently re-admitted within 30 days) was 59.2% (95% CI 58.0% to 60.5%); representing 5.4% (95% CI 5.2% to 5.6%) of all inpatients who would be re-admitted within 30 days (sensitivity). The area under the receiver operating characteristic curve was 0.70 (95% CI 0.69 to 0.70). Conclusions We have developed a method of identifying inpatients at high risk of unplanned re-admission to NHS hospitals within 30 days of discharge. Though the models had a low sensitivity, we show how to identify subgroups of patients that contain a high proportion of patients who will be re-admitted within 30 days. Additional work is necessary to validate the model in practice.
doi_str_mv 10.1136/bmjopen-2012-001667
format article
fullrecord <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_3425907</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1034796841</sourcerecordid><originalsourceid>FETCH-LOGICAL-b472t-aab6e079736212349ece8af235169abdc501c1f870d3104fdbed4ec456570ce63</originalsourceid><addsrcrecordid>eNqNkU9rFDEYxoMottR-AkECXuphav5n5iKUVm2hUCl6DpnknW7WmcmYzK7uzYtf1E9ill1L7clckvD-nof34UHoJSWnlHL1th2WcYKxYoSyihCqlH6CDhkRolJEyqcP3gfoOOclKUfIRkr2HB0wVtdSNvQQ_biANfRxGmCcceywxVMCH9wc1oCH6KHHc8TBl3HoNjiMk51D-WRsZ5xC_roVJaisH0LOIY74e5gXYcSc_P75y9tN3gI-ZLew6Q7wyaez29uKkzcv0LPO9hmO9_cR-vLh_efzy-r65uPV-dl11QrN5sraVgHRjeaKUcZFAw5q2zEuqWps650k1NGu1sRzSkTnW_ACnJBKauJA8SP0buc7rdoBvCu7J9ubKYXBpo2JNph_J2NYmLu4Nlww2RBdDE72Bil-W0GeTUnqoO_tCHGVDSVc6EbVghb09SN0GVdpLPEM1TWXuqFaForvKJdizgm6-2UoMdtyzb5csy3X7MotqlcPc9xr_lZZgNMdUNT_5fgHLWmxqQ</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1783579175</pqid></control><display><type>article</type><title>Development of a predictive model to identify inpatients at risk of re-admission within 30 days of discharge (PARR-30)</title><source>Publicly Available Content Database</source><source>BMJ Publishing</source><source>BMJ Journals (Open Access)</source><source>PubMed Central</source><creator>Billings, John ; Blunt, Ian ; Steventon, Adam ; Georghiou, Theo ; Lewis, Geraint ; Bardsley, Martin</creator><creatorcontrib>Billings, John ; Blunt, Ian ; Steventon, Adam ; Georghiou, Theo ; Lewis, Geraint ; Bardsley, Martin</creatorcontrib><description>Objectives To develop an algorithm for identifying inpatients at high risk of re-admission to a National Health Service (NHS) hospital in England within 30 days of discharge using information that can either be obtained from hospital information systems or from the patient and their notes. Design Multivariate statistical analysis of routinely collected hospital episode statistics (HES) data using logistic regression to build the predictive model. The model's performance was calculated using bootstrapping. Setting HES data covering all NHS hospital admissions in England. Participants The NHS patients were admitted to hospital between April 2008 and March 2009 (10% sample of all admissions, n=576 868). Main outcome measures Area under the receiver operating characteristic curve for the algorithm, together with its positive predictive value and sensitivity for a range of risk score thresholds. Results The algorithm produces a ‘risk score’ ranging (0–1) for each admitted patient, and the percentage of patients with a re-admission within 30 days and the mean re-admission costs of all patients are provided for 20 risk bands. At a risk score threshold of 0.5, the positive predictive value (ie, percentage of inpatients identified as high risk who were subsequently re-admitted within 30 days) was 59.2% (95% CI 58.0% to 60.5%); representing 5.4% (95% CI 5.2% to 5.6%) of all inpatients who would be re-admitted within 30 days (sensitivity). The area under the receiver operating characteristic curve was 0.70 (95% CI 0.69 to 0.70). Conclusions We have developed a method of identifying inpatients at high risk of unplanned re-admission to NHS hospitals within 30 days of discharge. Though the models had a low sensitivity, we show how to identify subgroups of patients that contain a high proportion of patients who will be re-admitted within 30 days. Additional work is necessary to validate the model in practice.</description><identifier>ISSN: 2044-6055</identifier><identifier>EISSN: 2044-6055</identifier><identifier>DOI: 10.1136/bmjopen-2012-001667</identifier><identifier>PMID: 22885591</identifier><language>eng</language><publisher>England: BMJ Publishing Group LTD</publisher><subject>Accuracy ; Algorithms ; Cost control ; Health Services Research ; Patient admissions ; Variables</subject><ispartof>BMJ open, 2012-01, Vol.2 (4), p.e001667</ispartof><rights>2012, Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.</rights><rights>2012 2012, Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions. This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/3.0/ and http://creativecommons.org/licenses/by-nc/3.0/legalcode Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>2012, Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions. 2012</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-b472t-aab6e079736212349ece8af235169abdc501c1f870d3104fdbed4ec456570ce63</citedby><cites>FETCH-LOGICAL-b472t-aab6e079736212349ece8af235169abdc501c1f870d3104fdbed4ec456570ce63</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/1783579175/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/1783579175?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>112,113,230,314,724,777,781,882,3181,25734,27530,27531,27905,27906,36993,36994,44571,53772,53774,74875,77343,77344,77350,77381</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/22885591$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Billings, John</creatorcontrib><creatorcontrib>Blunt, Ian</creatorcontrib><creatorcontrib>Steventon, Adam</creatorcontrib><creatorcontrib>Georghiou, Theo</creatorcontrib><creatorcontrib>Lewis, Geraint</creatorcontrib><creatorcontrib>Bardsley, Martin</creatorcontrib><title>Development of a predictive model to identify inpatients at risk of re-admission within 30 days of discharge (PARR-30)</title><title>BMJ open</title><addtitle>BMJ Open</addtitle><description>Objectives To develop an algorithm for identifying inpatients at high risk of re-admission to a National Health Service (NHS) hospital in England within 30 days of discharge using information that can either be obtained from hospital information systems or from the patient and their notes. Design Multivariate statistical analysis of routinely collected hospital episode statistics (HES) data using logistic regression to build the predictive model. The model's performance was calculated using bootstrapping. Setting HES data covering all NHS hospital admissions in England. Participants The NHS patients were admitted to hospital between April 2008 and March 2009 (10% sample of all admissions, n=576 868). Main outcome measures Area under the receiver operating characteristic curve for the algorithm, together with its positive predictive value and sensitivity for a range of risk score thresholds. Results The algorithm produces a ‘risk score’ ranging (0–1) for each admitted patient, and the percentage of patients with a re-admission within 30 days and the mean re-admission costs of all patients are provided for 20 risk bands. At a risk score threshold of 0.5, the positive predictive value (ie, percentage of inpatients identified as high risk who were subsequently re-admitted within 30 days) was 59.2% (95% CI 58.0% to 60.5%); representing 5.4% (95% CI 5.2% to 5.6%) of all inpatients who would be re-admitted within 30 days (sensitivity). The area under the receiver operating characteristic curve was 0.70 (95% CI 0.69 to 0.70). Conclusions We have developed a method of identifying inpatients at high risk of unplanned re-admission to NHS hospitals within 30 days of discharge. Though the models had a low sensitivity, we show how to identify subgroups of patients that contain a high proportion of patients who will be re-admitted within 30 days. Additional work is necessary to validate the model in practice.</description><subject>Accuracy</subject><subject>Algorithms</subject><subject>Cost control</subject><subject>Health Services Research</subject><subject>Patient admissions</subject><subject>Variables</subject><issn>2044-6055</issn><issn>2044-6055</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2012</creationdate><recordtype>article</recordtype><sourceid>9YT</sourceid><sourceid>PIMPY</sourceid><recordid>eNqNkU9rFDEYxoMottR-AkECXuphav5n5iKUVm2hUCl6DpnknW7WmcmYzK7uzYtf1E9ill1L7clckvD-nof34UHoJSWnlHL1th2WcYKxYoSyihCqlH6CDhkRolJEyqcP3gfoOOclKUfIRkr2HB0wVtdSNvQQ_biANfRxGmCcceywxVMCH9wc1oCH6KHHc8TBl3HoNjiMk51D-WRsZ5xC_roVJaisH0LOIY74e5gXYcSc_P75y9tN3gI-ZLew6Q7wyaez29uKkzcv0LPO9hmO9_cR-vLh_efzy-r65uPV-dl11QrN5sraVgHRjeaKUcZFAw5q2zEuqWps650k1NGu1sRzSkTnW_ACnJBKauJA8SP0buc7rdoBvCu7J9ubKYXBpo2JNph_J2NYmLu4Nlww2RBdDE72Bil-W0GeTUnqoO_tCHGVDSVc6EbVghb09SN0GVdpLPEM1TWXuqFaForvKJdizgm6-2UoMdtyzb5csy3X7MotqlcPc9xr_lZZgNMdUNT_5fgHLWmxqQ</recordid><startdate>20120101</startdate><enddate>20120101</enddate><creator>Billings, John</creator><creator>Blunt, Ian</creator><creator>Steventon, Adam</creator><creator>Georghiou, Theo</creator><creator>Lewis, Geraint</creator><creator>Bardsley, Martin</creator><general>BMJ Publishing Group LTD</general><general>BMJ Group</general><scope>9YT</scope><scope>ACMMV</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7RV</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>88G</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BTHHO</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>K9-</scope><scope>K9.</scope><scope>KB0</scope><scope>M0R</scope><scope>M0S</scope><scope>M1P</scope><scope>M2M</scope><scope>NAPCQ</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PSYQQ</scope><scope>Q9U</scope><scope>7X8</scope><scope>5PM</scope></search><sort><creationdate>20120101</creationdate><title>Development of a predictive model to identify inpatients at risk of re-admission within 30 days of discharge (PARR-30)</title><author>Billings, John ; Blunt, Ian ; Steventon, Adam ; Georghiou, Theo ; Lewis, Geraint ; Bardsley, Martin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-b472t-aab6e079736212349ece8af235169abdc501c1f870d3104fdbed4ec456570ce63</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2012</creationdate><topic>Accuracy</topic><topic>Algorithms</topic><topic>Cost control</topic><topic>Health Services Research</topic><topic>Patient admissions</topic><topic>Variables</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Billings, John</creatorcontrib><creatorcontrib>Blunt, Ian</creatorcontrib><creatorcontrib>Steventon, Adam</creatorcontrib><creatorcontrib>Georghiou, Theo</creatorcontrib><creatorcontrib>Lewis, Geraint</creatorcontrib><creatorcontrib>Bardsley, Martin</creatorcontrib><collection>BMJ Journals (Open Access)</collection><collection>BMJ Journals:Open Access</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>ProQuest Nursing and Allied Health Source</collection><collection>ProQuest Health and Medical</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Psychology Database (Alumni)</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>BMJ Journals</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>Consumer Health Database</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Nursing &amp; Allied Health Database (Alumni Edition)</collection><collection>ProQuest Consumer Health Database</collection><collection>Health &amp; Medical Collection (Alumni Edition)</collection><collection>PML(ProQuest Medical Library)</collection><collection>Psychology Database (ProQuest)</collection><collection>Nursing &amp; Allied Health Premium</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest One Psychology</collection><collection>ProQuest Central Basic</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>BMJ open</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Billings, John</au><au>Blunt, Ian</au><au>Steventon, Adam</au><au>Georghiou, Theo</au><au>Lewis, Geraint</au><au>Bardsley, Martin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Development of a predictive model to identify inpatients at risk of re-admission within 30 days of discharge (PARR-30)</atitle><jtitle>BMJ open</jtitle><addtitle>BMJ Open</addtitle><date>2012-01-01</date><risdate>2012</risdate><volume>2</volume><issue>4</issue><spage>e001667</spage><pages>e001667-</pages><issn>2044-6055</issn><eissn>2044-6055</eissn><abstract>Objectives To develop an algorithm for identifying inpatients at high risk of re-admission to a National Health Service (NHS) hospital in England within 30 days of discharge using information that can either be obtained from hospital information systems or from the patient and their notes. Design Multivariate statistical analysis of routinely collected hospital episode statistics (HES) data using logistic regression to build the predictive model. The model's performance was calculated using bootstrapping. Setting HES data covering all NHS hospital admissions in England. Participants The NHS patients were admitted to hospital between April 2008 and March 2009 (10% sample of all admissions, n=576 868). Main outcome measures Area under the receiver operating characteristic curve for the algorithm, together with its positive predictive value and sensitivity for a range of risk score thresholds. Results The algorithm produces a ‘risk score’ ranging (0–1) for each admitted patient, and the percentage of patients with a re-admission within 30 days and the mean re-admission costs of all patients are provided for 20 risk bands. At a risk score threshold of 0.5, the positive predictive value (ie, percentage of inpatients identified as high risk who were subsequently re-admitted within 30 days) was 59.2% (95% CI 58.0% to 60.5%); representing 5.4% (95% CI 5.2% to 5.6%) of all inpatients who would be re-admitted within 30 days (sensitivity). The area under the receiver operating characteristic curve was 0.70 (95% CI 0.69 to 0.70). Conclusions We have developed a method of identifying inpatients at high risk of unplanned re-admission to NHS hospitals within 30 days of discharge. Though the models had a low sensitivity, we show how to identify subgroups of patients that contain a high proportion of patients who will be re-admitted within 30 days. Additional work is necessary to validate the model in practice.</abstract><cop>England</cop><pub>BMJ Publishing Group LTD</pub><pmid>22885591</pmid><doi>10.1136/bmjopen-2012-001667</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2044-6055
ispartof BMJ open, 2012-01, Vol.2 (4), p.e001667
issn 2044-6055
2044-6055
language eng
recordid cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_3425907
source Publicly Available Content Database; BMJ Publishing; BMJ Journals (Open Access); PubMed Central
subjects Accuracy
Algorithms
Cost control
Health Services Research
Patient admissions
Variables
title Development of a predictive model to identify inpatients at risk of re-admission within 30 days of discharge (PARR-30)
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-17T23%3A14%3A21IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Development%20of%20a%20predictive%20model%20to%20identify%20inpatients%20at%20risk%20of%20re-admission%20within%2030%E2%80%85days%20of%20discharge%20(PARR-30)&rft.jtitle=BMJ%20open&rft.au=Billings,%20John&rft.date=2012-01-01&rft.volume=2&rft.issue=4&rft.spage=e001667&rft.pages=e001667-&rft.issn=2044-6055&rft.eissn=2044-6055&rft_id=info:doi/10.1136/bmjopen-2012-001667&rft_dat=%3Cproquest_pubme%3E1034796841%3C/proquest_pubme%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-b472t-aab6e079736212349ece8af235169abdc501c1f870d3104fdbed4ec456570ce63%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=1783579175&rft_id=info:pmid/22885591&rfr_iscdi=true