Skip navigation
Skip navigation

Users versus models: What observation tells us about effectiveness metrics

Moffat, Alistair; Thomas, Paul; Scholer, Falk

Description

Retrieval system effectiveness can be measured in two quite different ways: by monitoring the behavior of users and gathering data about the ease and accuracy with which they accomplish certain specified information-seeking tasks; or by using numeric effectiveness metrics to score system runs in reference to a set of relevance judgments. In the second approach, the effectiveness metric is chosen in the belief that user task performance, if it were to be measured by the first approach, should be...[Show more]

CollectionsANU Research Publications
Date published: 2013
Type: Conference paper
URI: http://hdl.handle.net/1885/27383
Source: Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
DOI: 10.1145/2505515.2507665

Download

File Description SizeFormat Image
01_Moffat_Users_versus_models:_What_2013.pdf173.49 kBAdobe PDF    Request a copy


Items in Open Research are protected by copyright, with all rights reserved, unless otherwise indicated.

Updated:  12 November 2018/ Responsible Officer:  University Librarian/ Page Contact:  Library Systems & Web Coordinator