Task 1: ShARe/CLEF eHealth evaluation lab 2013
Date
Authors
Pradhan, Sameer
Elhadad, Noemie
South, Brett R.
Martinez, David
Christensen, Lee
Vogel, Amy
Suominen, Hanna
Chapman, Wendy W.
Savova, Guergana
Journal Title
Journal ISSN
Volume Title
Publisher
Access Statement
Abstract
This report outlines the Task 1 of the ShARe/CLEF eHealth evaluation lab pilot. This task focused on identification (1a) and normalization (1b) of diseases and disorders in clinical reports. It used annotations from the ShARe corpus. A total of 22 teams competed in Task 1a and 17 of them also participated Task 1b. The best systems had an F1 score of 0.75 (0.80 Precision, 0.71 Recall) in Task 1a and an accuracy of 0.59 in Task 1b. The organizers have made the text corpora, annotations, and evaluation tools available for future research and development.
Description
Citation
Collections
Source
CEUR Workshop Proceedings
Type
Book Title
Entity type
Publication