Monitoring Provider Fidelity of a Parenting Intervention Using Observational Methods

• Published in: Professional psychology, research and practice research and practice, 2019-08, Vol.50 (4), p.264-271
• Main Authors: Costello, Amanda H., Roben, Caroline K. P., Schein, Stevie S., Blake, Fabianne, Dozier, Mary
• Format: Article
• Language: English
• Subjects: Change agents; Coaches; Comments; Dissemination; Early Intervention; Evidence Based Practice; Feedback; Female; Fidelity; Human; Individual differences; Intervention; Male; Monitoring; Observation Methods; Observational studies; Parenthood education; Parenting; Parents & parenting; Teleconferencing; Training; Variability; Video conferencing
• ISSN: 0735-7028; 1939-1323
• DOI: 10.1037/pro0000236

Monitoring fidelity to evidence-based interventions is a critical component of successful dissemination. Attachment and Biobehavioral Catch-Up is a nationally and internationally disseminated evidence-based early intervention that uses observational methods (e.g., video review and content coding) to monitor fidelity as well as video conferencing to provide consistent and interactive feedback. The current study examined patterns of change in fidelity data, measured by "in-the-moment" commenting rate, across 2 cohorts of parent coaches. Coaches demonstrated a significant increase in commenting rate across the training year. However, there was also a significant amount of individual variation, with some coaches exhibiting initial high rates of commenting and others providing limited commenting, with individually varying patterns of change across time. The within-coach variability raises the possibility of individualized supervision processes based on regular quantitative feedback. Future investigations should identify common trajectories in fidelity across coaches and factors (e.g., coach, session, organizational) that may affect commenting. Public Significance Statement This study found that all trained providers were able to reach fidelity to an evidence-based intervention (Attachment and Biobehavioral Catch-Up); however, there was also significant within-provider variability in meeting fidelity requirements during the training period. Although follow-up studies are needed, results suggest the potential of an individualized, data-driven approach to supervision to support evidence-based intervention fidelity.