Evaluating Bias of Sequential Mixed-mode Designs Against Benchmark Surveys

This study evaluated three types of bias—total, measurement, and selection bias (SB)—in three sequential mixed-mode designs of the Dutch Crime Victimization Survey: telephone, mail, and web, where nonrespondents were followed up face-to-face (F2F). In the absence of true scores, all biases were esti...

Full description

Saved in:
Bibliographic Details
Published in:Sociological methods & research 2017-08, Vol.46 (3), p.456-489
Main Authors: Klausch, Thomas, Schouten, Barry, Hox, Joop J.
Format: Article
Language:English
Subjects:
Accuracy
Benchmarking
Bias
Crime
Definitions
Error of Measurement
Evaluation Methods
Foreign Countries
Inference
Mail Surveys
Measurement
Missing data
Mixed Methods Research
Online Surveys
Polls & surveys
Research design
Research Problems
Selection bias
Sequential Approach
Statistical Bias
Statistical Inference
Studies
Telephone Surveys
Victimization
Victims
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This study evaluated three types of bias—total, measurement, and selection bias (SB)—in three sequential mixed-mode designs of the Dutch Crime Victimization Survey: telephone, mail, and web, where nonrespondents were followed up face-to-face (F2F). In the absence of true scores, all biases were estimated as mode effects against two different types of benchmarks. In the single-mode benchmark (SMB), effects were evaluated against a F2F reference survey. In an alternative analysis, a “hybrid-mode benchmark” (HMB) was used, where effects were evaluated against a mix of the measurements of a web survey and the SB of a F2F survey. A special reinterview design made available additional auxiliary data exploited in estimation for a range of survey variables. Depending on the SMB and HMB perspectives, a telephone, mail, or web design with a F2F follow-up (SMB) or a design involving only mail and/or web but not a F2F follow-up (HMB) is recommended based on the empirical findings.
ISSN:0049-1241
1552-8294
DOI:10.1177/0049124115585362