A novel pain assessment tool incorporating automated facial analysis: interrater reliability in advanced dementia

• Published in: Clinical interventions in aging 2018-01, Vol.13, p.1245-1258
• Main Authors: Atee, Mustafa, Hoti, Kreshnik, Parsons, Richard, Hughes, Jeffery D
• Format: Article
• Language: English
• Subjects: Aged; Aged, 80 and over; Arthritis; automated facial expression analysis; Automation; Cognitive ability; Cognitive biases; Consent; Dementia; Dementia - epidemiology; Digitization; Elder care; ePAT; Ethics; facial action units; Facial Expression; Female; Geriatrics; Health facilities; Homes for the Aged - organization & administration; Humans; inter-rater reliability; Male; Medical equipment; Middle Aged; Movement; Nurses; Nursing home patients; Nursing homes; Nursing Homes - organization & administration; Observer Variation; Older people; Original Research; Pain; Pain - diagnosis; Pain - epidemiology; Pain management; Pain Measurement - methods; Pain Measurement - standards; Pharmacy; Practical nurses; Psychotropic drugs; Quality of life; Registered nurses; Reproducibility of Results; Rest; Severity of Illness Index; total pain scores; Western Australia; Workers
• ISSN: 1178-1998; 1176-9092; 1178-1998
• DOI: 10.2147/CIA.S168024

Regardless of its severity, dementia does not negate the experience of pain. Rather, dementia hinders self-reporting mechanisms in affected individuals because they lose the ability to do so. The primary aim of this study was to examine the interrater reliability of the electronic Pain Assessment Tool (ePAT) among raters when assessing pain in residents with moderate-to-severe dementia. Secondly, it sought to examine the relationship between total instrument scores and facial scores, as determined by automated facial expression analysis. A 2-week observational study. An accredited, high-care, and dementia-specific residential aged care facility in Perth, Western Australia. Subjects were 10 residents (age range: 63.1-84.4 years old) predominantly with severe dementia (Dementia Severity Rating Scale score: 46.3±8.4) rated for pain by 11 aged care staff. Raters (female: 82%; mean age: 44.1±12.6 years) consisted of one clinical nurse, four registered nurses, five enrolled nurses, and one care worker. ePAT measured pain using automated detection of facial action codes and recordings of pain behaviors. A total of 76 assessments (rest =38 [n=19 pairs], movement =38 [n=19 pairs]) were conducted. At rest, raters' agreement was excellent on overall total scores (coefficient of concordance =0.92 [95% CI: 0.85-0.96]) and broad category scores (κ=1.0). Agreement was moderate (κ=0.59) on categorical scores upon movement, while it was exact in 68.4% of the cases. Agreement in actual pain category scores gave κ =0.72 (95% CI: 0.58-0.86) at rest and κ =0.69 (95% CI: 0.50-0.87) with movement. All raters scored residents with higher total scores post-mobilization compared to rest. More facial action unit codes were also detected during pain (mean: 2.5 vs 1.9;