Skip navigation
Skip navigation

Overview of the CLEF eHealth Evaluation Lab 2016

Kelly, Liadh; Goeuriot, Lorraine; Suominen, Hanna; Névéol, Aurélie; Palotti, João; Zuccon, Guido

Description

In this paper we provide an overview of the fourth edition of the CLEF eHealth evaluation lab. CLEF eHealth 2016 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins and clinical staff in understanding, accessing and authoring eHealth information in a multilingual setting. This year’s lab offered three tasks: Task 1 on handover information extraction related to Australian nursing shift changes, Task 2 on information extraction in...[Show more]

dc.contributor.authorKelly, Liadh
dc.contributor.authorGoeuriot, Lorraine
dc.contributor.authorSuominen, Hanna
dc.contributor.authorNévéol, Aurélie
dc.contributor.authorPalotti, João
dc.contributor.authorZuccon, Guido
dc.date.accessioned2017-04-03T05:59:06Z
dc.identifier.isbn978-3-319-44563-2
dc.identifier.issn0302-9743
dc.identifier.urihttp://hdl.handle.net/1885/114364
dc.description.abstractIn this paper we provide an overview of the fourth edition of the CLEF eHealth evaluation lab. CLEF eHealth 2016 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins and clinical staff in understanding, accessing and authoring eHealth information in a multilingual setting. This year’s lab offered three tasks: Task 1 on handover information extraction related to Australian nursing shift changes, Task 2 on information extraction in French corpora, and Task 3 on multilingual patient-centred information retrieval considering query variations. In total 20 teams took part in these tasks (3 in Task 1, 7 in Task 2 and 10 in Task 3). Herein, we describe the resources created for these tasks, evaluation methodology adopted and provide a brief summary of participants to this year’s challenges and some results obtained. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research and development.
dc.description.sponsorshipThe CLEF eHealth 2016 evaluation lab has been supported in part by (in alphabetical order) the ANR, the French National Research Agency, under grant CABeRneT ANR-13-JS02-0009-01; CLEF Initiative; ESF ELIAS network program Horizon 2020 program (H2020-ICT-2014-1) under grant agreement 644753 (KCONNECT); Microsoft Azure for Research Award CRM:0518649; NICTA, funded by the Australian Government through the Department of Communications and the Australian Research Council through the Information and Communications Technology (ICT) Centre of Excellence Program; and PhysioNetWorks Workspaces. We express our gratitude to Maricel Angel, Registered Nurse at NICTA, for helping us to create the Task 1 dataset, using the Prot´eg´e resource, which is supported by grant GM10331601 from the National Institute of General Medical Sciences of the United States National Institutes of Health.
dc.format.mimetypeapplication/pdf
dc.publisherSpringer Verlag
dc.rights© Springer International Publishing Switzerland 2016. http://www.sherpa.ac.uk/romeo/issn/0302-9743/..."Author's post-print on author's personal website, institutional repository, funder's designated repository" from SHERPA/RoMEO site (as at 5/04/17). The final publication is available at link.springer.com
dc.subjectEvaluation
dc.subjectEntity linking
dc.subjectInformation retrieval
dc.subjectInformation extraction
dc.subjectMedical informatics
dc.subjectNursing records
dc.subjectPatient handoff/handover
dc.subjectSpeech recognition
dc.subjectTest-set generation
dc.subjectText classification
dc.subjectText segmentation
dc.subjectSelf-diagnosis
dc.titleOverview of the CLEF eHealth Evaluation Lab 2016
dc.typeJournal article
local.identifier.citationvolume9822
dc.date.issued2016
local.publisher.urlhttp://link.springer.com/
local.type.statusAccepted Version
local.contributor.affiliationSuominen, H., College of Engineering & Computer Science, The Australian National University
local.bibliographicCitation.startpage255
local.bibliographicCitation.lastpage266
local.identifier.doi10.1007/978-3-319-44564-9_24
dcterms.accessRightsOpen Access
dcterms.accessRightsOpen Access
CollectionsANU Research Publications

Download

File Description SizeFormat Image
01_Kelly_Overview_of_the_CLEF_2016.pdf346.61 kBAdobe PDFThumbnail


Items in Open Research are protected by copyright, with all rights reserved, unless otherwise indicated.

Updated:  19 May 2020/ Responsible Officer:  University Librarian/ Page Contact:  Library Systems & Web Coordinator