Psychometric Characteristics of Process Evaluation Measures for a Rural School-Based Childhood Obesity Prevention Study: Louisiana Health

• Published in: American journal of health promotion 2011-07, Vol.25 (6), p.417-421
• Main Authors: Newton, Robert L., Thomson, Jessica L., Rau, Kristi K., Ragusa, Shelly A., Sample, Alicia D., Singleton, Nakisha N., Anton, Stephen D., Webber, Larry S., Williamson, Donald A.
• Format: Article
• Language: English
• Subjects: Analysis of Variance; Food Services; Health Plan Implementation; Health Promotion - organization & administration; Health technology assessment; Humans; Louisiana; Obesity - prevention & control; Process Assessment (Health Care) - methods; Program Development; Psychometrics - statistics & numerical data; Rural Population - statistics & numerical data; School Health Services - organization & administration; Schools; Surveys and Questionnaires
• ISSN: 0890-1171; 2168-6602
• DOI: 10.4278/ajhp.090914-ARB-297

Purpose. To evaluate the implementation of intervention components of the Louisiana Health study, which was a multicomponent childhood obesity prevention program conducted in rural schools. Design. Content analysis. Setting. Process evaluation assessed implementation in classrooms, gym classes, and cafeterias. Subjects. Classroom teachers (n = 232), physical education teachers (n = 53), food service managers (n = 33), and trained observers (n = 9). Measures. Five process evaluation measures were created: Physical Education Questionnaire (PEQ), Intervention Questionnaire (IQ), Food Service Manager Questionnaire (FSMQ), Classroom Observation (CO), and School Nutrition Environment Observation (SNEO). Analysis. Interrater reliability and internal consistency were assessed on all measures. Analysis of variance and χ2 were used to compare differences across study groups on questionnaires and observations. Results. The PEQ and one subscale from the FSMQ were eliminated because their reliability coefficients fell below acceptable standards. The subscale internal consistencies for the IQ, FSMQ, CO, and SNEO (all Cronbach α > .60) were acceptable. Conclusions. After the initial 4 months of intervention, there was evidence that the Louisiana Health intervention was being implemented as it was designed. In summary, four process evaluation measures were found to be sufficiently reliable and valid for assessing the delivery of various aspects of a school-based obesity prevention program. These process measures could be modified to evaluate the delivery of other similar school-based interventions.