Quality Control Process for EQ-5D-5L Valuation Studies

• Published in: Value in health 2017-03, Vol.20 (3), p.466-473
• Main Authors: Ramos-Goñi, Juan M., MSc, Oppe, Mark, PhD, Slaap, Bernhard, PhD, Busschbach, Jan J.V., PhD, Stolk, Elly, PhD
• Format: Article
• Language: English
• Subjects: Clustering; Compliance; Data quality; Discrete choice; economic; Feedback; Health Status; health status index; Health Status Indicators; Humans; Information processing; Internal Medicine; Interviews; Interviews as Topic; life valuation; Netherlands; Performance evaluation; Quality Control; Quality of Life; Questionnaires; Reproducibility of Results; Severity; Sickness Impact Profile; Spain; Surveys and Questionnaires; Valuation; Variability; Violations
• ISSN: 1098-3015; 1524-4733
• DOI: 10.1016/j.jval.2016.10.012

Abstract Background The values of the five-level EuroQol five-dimensional questionnaire (EQ-5D-5L) are elicited using composite time trade-off and discrete choice experiments. Unfortunately, data quality issues and interviewer effects were observed in the first few EQ-5D-5L valuation studies. To prevent these issues from occurring in later studies, the EuroQol Group established a cyclic quality control (QC) process. Objectives To describe this QC process and show its impact on data quality. Methods A newly developed QC tool provided information about protocol compliance, interviewer effects, and mean values by health state severity. In a cyclic process, this information is initially used to evaluate whether new interviewers meet minimal quality requirements and later to provide feedback about how their performance may be improved. To investigate the impact of this cyclic process, we compared the quality of the data in Dutch and Spanish valuation studies that did not have this QC process with that in the follow-up studies in the same countries that used the QC process. Data quality was measured using protocol violations, variability between interviewers, the proportion of inconsistent responders, and clustering of composite time trade-off values. Results In Spain, protocol violations were reduced from 87% in the valuation study to 5% in the follow-up study and in the Netherlands from 20% to 8%. In both countries, interviewers performed more homogeneously in the follow-up studies. The number of inconsistent respondents was reduced by 23.2% in Spain and 23.6% in the Netherlands. Values were less clustered in the follow-up studies. Conclusions The implementation of a strict QC process in EQ-5D-5L valuation studies increases interviewer protocol compliance and promotes data quality.