psiTurk: An open-source framework for conducting replicable behavioral experiments online

Online data collection has begun to revolutionize the behavioral sciences. However, conducting carefully controlled behavioral experiments online introduces a number of new of technical and scientific challenges. The project described in this paper, psiTurk, is an open-source platform which helps re...

Full description

Saved in:
Bibliographic Details
Published in:Behavior research methods 2016-09, Vol.48 (3), p.829-842
Main Authors: Gureckis, Todd M., Martin, Jay, McDonnell, John, Rich, Alexander S., Markant, Doug, Coenen, Anna, Halpern, David, Hamrick, Jessica B., Chan, Patricia
Format: Article
Language:English
Subjects:
Behavioral Research - methods
Behavioral Science and Psychology
Behavioral sciences
Cognitive Psychology
Crowdsourcing
Data collection
Data Collection - methods
Experiments
Internet
Labor market
Open source software
Psychology
Research Design
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Online data collection has begun to revolutionize the behavioral sciences. However, conducting carefully controlled behavioral experiments online introduces a number of new of technical and scientific challenges. The project described in this paper, psiTurk, is an open-source platform which helps researchers develop experiment designs which can be conducted over the Internet. The tool primarily interfaces with Amazon’s Mechanical Turk, a popular crowd-sourcing labor market. This paper describes the basic architecture of the system and introduces new users to the overall goals. psiTurk aims to reduce the technical hurdles for researchers developing online experiments while improving the transparency and collaborative nature of the behavioral sciences.
ISSN:1554-3528
1554-3528
DOI:10.3758/s13428-015-0642-8