Combining knowledge- and data-driven methods for de-identification of clinical narratives

• Published in: Journal of biomedical informatics 2015-12, Vol.58 (Suppl), p.S53-S59
• Main Authors: Dehghan, Azad, Kovacevic, Aleksandar, Karystianis, George, Keane, John A., Nenadic, Goran
• Format: Article
• Language: English
• Subjects: Automation; Clinical text mining; Cohort Studies; Computer Security; Computer Simulation; Confidence; Confidentiality; Data Mining - methods; De-identification; Dictionaries; Electronic health record; Electronic Health Records - organization & administration; Information dissemination; Information extraction; Machine Learning; Models, Statistical; Named entity recognition; Narration; Narratives; Natural Language Processing; Pattern Recognition, Automated - methods; Profession; Texts; United Kingdom; Unstructured data; Vocabulary, Controlled
• ISSN: 1532-0464; 1532-0480
• DOI: 10.1016/j.jbi.2015.06.029

[Display omitted] •We present a method for automatic de-identification of clinical narratives.•We propose and validate a two-pass tagging method to improve PHI entity recognition.•We have shown that automated de-identification is comparable to human benchmark. A recent promise to access unstructured clinical data from electronic health records on large-scale has revitalized the interest in automated de-identification of clinical notes, which includes the identification of mentions of Protected Health Information (PHI). We describe the methods developed and evaluated as part of the i2b2/UTHealth 2014 challenge to identify PHI defined by 25 entity types in longitudinal clinical narratives. Our approach combines knowledge-driven (dictionaries and rules) and data-driven (machine learning) methods with a large range of features to address de-identification of specific named entities. In addition, we have devised a two-pass recognition approach that creates a patient-specific run-time dictionary from the PHI entities identified in the first step with high confidence, which is then used in the second pass to identify mentions that lack specific clues. The proposed method achieved the overall micro F1-measures of 91% on strict and 95% on token-level evaluation on the test dataset (514 narratives). Whilst most PHI entities can be reliably identified, particularly challenging were mentions of Organizations and Professions. Still, the overall results suggest that automated text mining methods can be used to reliably process clinical notes to identify personal information and thus providing a crucial step in large-scale de-identification of unstructured data for further clinical and epidemiological studies.