Jin, YuanCarman, Mark J.Xie, Lexing2025-12-312025-12-311613-0073https://hdl.handle.net/1885/733797730This paper investigates the effect of real-time performance feedback and competition on the accuracy of crowd-workers for a document relevance assessment task. Through a series of controlled tests, we show that displaying a leaderboard to crowd-workers can motivate them to improve their performance, providing a bonus is offered to the best performing workers. This effect is observed even when test questions are used to enforce quality control during task completion.8enPublisher Copyright: Copyright © by the paper's authors.201684985914355