Crowd-sourced Text Analysis: Reproducible and Agile Production of Political Data

dc.contributor.authorBenoit, Kenneth
dc.contributor.authorConway, Drew
dc.contributor.authorLauderdale, Benjamin E
dc.contributor.authorLaver, Michael
dc.contributor.authorMikhaylov, Slava
dc.date.accessioned2019-05-07T00:08:38Z
dc.date.issued2016
dc.date.updated2019-03-12T07:36:58Z
dc.description.abstractEmpirical social science often relies on data that are not observed in the field, but are transformed into quantitative variables by expert researchers who analyze and interpret qualitative raw sources. While generally considered the most valid way to produce data, this expert-driven process is inherently difficult to replicate or to assess on grounds of reliability. Using crowd-sourcing to distribute text for reading and interpretation by massive numbers of non-experts, we generate results comparable to those using experts to read and interpret the same texts, but do so far more quickly and flexibly. Crucially, the data we collect can be reproduced and extended transparently, making crowd-sourced datasets intrinsically reproducible. This focuses researchers’ attention on the fundamental scientific objective of specifying reliable and replicable methods for collecting the data needed, rather than on the content of any particular dataset. We also show that our approach works straightforwardly with different types of political text, written in different languages. While findings reported here concern text analysis, they have far-reaching implications for expert-generated data in the social sciences.en_AU
dc.format.mimetypeapplication/pdfen_AU
dc.identifier.issn0003-0554en_AU
dc.identifier.urihttp://hdl.handle.net/1885/160874
dc.language.isoen_AUen_AU
dc.publisherCambridge University Pressen_AU
dc.rights© American Political Science Association 2016en_AU
dc.sourceAmerican Political Science Reviewen_AU
dc.titleCrowd-sourced Text Analysis: Reproducible and Agile Production of Political Dataen_AU
dc.typeJournal articleen_AU
local.bibliographicCitation.issue2en_AU
local.bibliographicCitation.lastpage295en_AU
local.bibliographicCitation.startpage278en_AU
local.contributor.affiliationBenoit, Kenneth, College of Arts and Social Sciences, ANUen_AU
local.contributor.affiliationConway, Drew, New York Universityen_AU
local.contributor.affiliationLauderdale, Benjamin E, London School of Economics and Political Scienceen_AU
local.contributor.affiliationLaver, Michael, New York Universityen_AU
local.contributor.affiliationMikhaylov, Slava, University College Londonen_AU
local.contributor.authoremailrepository.admin@anu.edu.auen_AU
local.contributor.authoruidBenoit, Kenneth, u1010305en_AU
local.description.embargo2037-12-31
local.description.notesImported from ARIESen_AU
local.identifier.absfor160600 - POLITICAL SCIENCEen_AU
local.identifier.ariespublicationu4970190xPUB37en_AU
local.identifier.citationvolume110en_AU
local.identifier.doi10.1017/S0003055416000058en_AU
local.identifier.thomsonID000382561900005
local.identifier.uidSubmittedByu4970190en_AU
local.publisher.urlhttps://www.cambridge.org/en_AU
local.type.statusPublished Versionen_AU

Downloads

Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
crowdsourced_text_analysis_reproducible_and_agile_production_of_political_data.pdf
Size:
915.35 KB
Format:
Adobe Portable Document Format
Description: