Skip navigation
Skip navigation

Wake Up and Smell the Coffee: Evaluation Methodology for the 21st Century

Blackburn, Stephen; McKinley, Kathryn; Garner, Robin; Hoffmann, Chris; Khan, Asjad M; Bentzur, Rotem; Diwan, Amer; Feinberg, Daniel; Frampton, Daniel; Guyer, Samuel Z; Hirzel, Martin; Hosking, Anthony; Jump, Maria; Lee, H; Moss, J Eliot B; Phansalkar, Aashish; Stefanovic, Darko; VanDrunen, Thomas


Evaluation methodology underpins all innovation in experimental computer science. It requires relevant workloads, appropriate experimental design, and rigorous analysis. Unfortunately, methodology is not keeping pace with the changes in our field. The rise of managed languages such as Java, C#, and Ruby in the past decade and the imminent rise of commodity multicore architectures for the next decade pose new methodological challenges that are not yet widely understood. This paper explores the...[Show more]

CollectionsANU Research Publications
Date published: 2008
Type: Journal article
Source: Communications of the Association for Computing Machinery
DOI: 10.1145/1378704.1378723


File Description SizeFormat Image
01_Blackburn_Wake_Up_and_Smell_the_Coffee:_2008.pdf297.95 kBAdobe PDF    Request a copy

Items in Open Research are protected by copyright, with all rights reserved, unless otherwise indicated.

Updated:  19 May 2020/ Responsible Officer:  University Librarian/ Page Contact:  Library Systems & Web Coordinator