Title: Crowdsourcing Experiments and Platforms
David M. Howcroft

Abstract:

The first part of this tutorial focuses on the wide variety of crowdsourcing experiments used by researchers in NLP and psycholinguistics, to provide an overview of what is possible to implement and the kind of data it can provide beyond simple survey results. In the second part, we discuss the pros and cons of two crowdsourcing platforms, Mechanical Turk and Prolific, before concluding with best practices for experimental design and reporting.