A Survey on Task Assignment in Crowdsourcing

Quality improvement methods are essential to gathering high-quality crowdsourced data, both for research and industry applications. A popular and broadly applicable method is task assignment that dynamically adjusts crowd workflow parameters. In this survey, we review task assignment methods that ad...

Full description

Saved in:
Bibliographic Details
Published in:ACM computing surveys 2022-02, Vol.55 (3), p.1-35, Article 49
Main Authors: Hettiachchi, Danula, Kostakos, Vassilis, Goncalves, Jorge
Format: Article
Language:English
Subjects:
Computer science
Computer supported cooperative work
Crowdsourcing
General and reference
Human-centered computing
Industrial applications
Information systems
Surveys and overviews
Workflow
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Quality improvement methods are essential to gathering high-quality crowdsourced data, both for research and industry applications. A popular and broadly applicable method is task assignment that dynamically adjusts crowd workflow parameters. In this survey, we review task assignment methods that address: heterogeneous task assignment, question assignment, and plurality problems in crowdsourcing. We discuss and contrast how these methods estimate worker performance, and highlight potential challenges in their implementation. Finally, we discuss future research directions for task assignment methods, and how crowdsourcing platforms and other stakeholders can benefit from them.
ISSN:0360-0300
1557-7341
DOI:10.1145/3494522