Cultural advice

The Australian National University acknowledges, celebrates and pays our respects to the Ngunnawal and Ngambri people of the Canberra region and to all First Nations Australians on whose traditional lands we meet and work, and whose cultures are among the oldest continuing cultures in human history.

Aboriginal and Torres Strait Islander peoples are advised that ANU Library collections may include images, names, voices, and other representations of deceased persons.

Material in the collection may contain terms, language or views that reflect the period in which the item was created and may be considered inappropriate today.

A little competition never hurt anyone's relevance assessments

Thumbnail Image

Date

2016

Authors

Jin, Yuan
Carman, Mark J.
Xie, Lexing

Journal Title

Journal ISSN

Volume Title

Publisher

Access Statement

Research Projects

Organizational Units

Journal Issue

Abstract

This paper investigates the effect of real-time performance feedback and competition on the accuracy of crowd-workers for a document relevance assessment task. Through a series of controlled tests, we show that displaying a leaderboard to crowd-workers can motivate them to improve their performance, providing a bonus is offered to the best performing workers. This effect is observed even when test questions are used to enforce quality control during task completion.

Description

Keywords

Citation

URI

https://hdl.handle.net/1885/733797730

Collections

ANU Research Publications

Source

CEUR Workshop Proceedings

Type

Conference paper

Book Title

Entity type

Publication

Access Statement

License Rights

DOI

Restricted until

DSpace software copyright © 2002-2026 LYRASIS