Training effectiveness evaluation: Advancing a Kirkpatrick model based composite framework

• Published in: Evaluation and program planning 2024-12, Vol.107, p.102494, Article 102494
• Main Authors: Paul, Sudipta, Burman, Rajarshi Roy, Singh, Rahul
• Format: Article
• Language: English
• Subjects: Farmers training; Kirkpatrick model; Training effectiveness index; Training effectiveness indicators; Training evaluation
• ISSN: 0149-7189
• DOI: 10.1016/j.evalprogplan.2024.102494

The present study aims at ideating a quantitative protocol to evaluate effectiveness of training programmes especially meant for farmers, farm women, and rural youth. The specific objective was to develop a robust framework for measuring the effectiveness of rural training programmes organized by the Farmers Training Centres (FTCs) of India. Kirkpatrick’s training evaluation model provides us the foundation to design a four-dimensional composite framework based on range-based indicator normalization, principal component analysis based indicator weight estimation, and rank correlation based framework sensitivity testing. We used cross-sectional primary data generated through household survey and personal interviews with randomly selected one thousand trainees to test and validate our proposed protocol. Applying it on our evaluation target we find that the degree of effectiveness of the training programmes varies; one in every four training programmes may not be effective. Trainees’ reactions on various aspects of the training programmes may have positive and significant influence on learning. Training outcomes may be linked with the trainees’ post-training changes in behaviour. A sensitivity test confirms that the proposed framework is not susceptible to changes in weighting schemes, implying robustness of indicator selection. The findings offer dissection of individual training programmes guiding policy decisions for a training organization. The proposed framework enriches the Kirkpatrick’s training evaluation model by offering standardized indicators for training effectiveness evaluation. •We advance a composite training evaluation framework based on Kirkpatrick’s model.•Robustness of the measure has been ensured through sensitivity testing.•Validity of the measure has been established after field testing through sample survey.•Findings offer detailed analysis of individual training programmes guiding policy.