Assessing general attentiveness to online panel surveys: the use of instructional manipulation checks

In online surveys, the use of manipulation checks aimed at measuring respondents' attentiveness has become common. More than being measures of attentiveness pertaining to a specific survey, instructional manipulation checks (IMC) could work as generic measures of the quality of the answers a pe...

Full description

Saved in:
Bibliographic Details
Published in:International journal of social research methodology 2022-03, Vol.25 (2), p.233-246
Main Author: Ladini, Riccardo
Format: Article
Language:English
Subjects:
Answers
Attention
Attention Control
attentiveness
Computer Mediated Communication
data quality
Data Use
Evaluation Methods
Instructional manipulation checks
Internet
Manipulation
National elections
online survey
Online Surveys
panel survey
Polls & surveys
Quality Assurance
Questioning Techniques
Respondents
Responses
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In online surveys, the use of manipulation checks aimed at measuring respondents' attentiveness has become common. More than being measures of attentiveness pertaining to a specific survey, instructional manipulation checks (IMC) could work as generic measures of the quality of the answers a person gives when completing a questionnaire. By using several waves of the ITANES (Italian National Election Study) - University of Milan online panel survey, the article shows that the outcome of an IMC predicts the quality of the answers a respondent gives in previous and subsequent waves of the panel. Moreover, through a survey experiment that randomizes the length of an IMC we show that, overall, the answers' quality of 'attentive' respondents assigned to different IMCs do not substantially vary. Findings also show that IMCs are reliable measures, as the outcome of two IMCs placed in two consecutive waves proved to be highly associated.
ISSN:1364-5579
1464-5300
DOI:10.1080/13645579.2021.1877948