Severity of Illness Index and the Adverse Patient Occurrence Index: A Reliability Study and Policy Implications

• Published in: Medical care 1987-08, Vol.25 (8), p.695-704
• Main Authors: Schumacher, Dale N., Parker, Barbara, Kofie, Vincent, Munns, Joyce M.
• Format: Article
• Language: English
• Subjects: Abstracting and Indexing as Topic - standards; Diagnosis related groups; Diseases; Evaluation Studies as Topic; Health care quality; Hospital admissions; Hospitals; Hospitals, Teaching - standards; Humans; Iatrogenic Disease - classification; Medical records; Medical Records - standards; Quality of Health Care; Random Allocation; Randomness; Referents; Severity of Illness Index; Severity of illness indices; Teaching hospitals; United States
• ISSN: 0025-7079; 1537-1948
• DOI: 10.1097/00005650-198708000-00003

Seven hundred fifty-two randomly selected charts from seven teaching hospitals were rated by pairs of medical record analysts. The Severity of Illness Index was unreliable with an interrater-agreement rate of 73% (kappa statistic = 0.41), and demonstrated a significant (P < 0.0001) association with the Adverse Patient Occurrence (APO) Index. This suggests that the Severity of Illness Index is not differentiating severity of illness from quality of care. The fair to poor field reliability stems from underlying instrument subjectivity, lack of clear referent groups, and time pressure. The APO Index was also found to be unreliable (r = 0.33 and range = -0.05-0.58). Greater attention should be directed to improving objective discharge abstract, billing, and laboratory data for measuring patient severity and adverse patient occurrences.