Browse DORAS
Browse Theses
Latest Additions
Creative Commons License
Except where otherwise noted, content on this site is licensed for use under a:

Task 2: ShARe/CLEF eHealth evaluation lab 2014

Mowery, Danielle L. and Velupillai, Sumithra and South, Brett R. and Christensen, Lee and Martinez, David and Kelly, Liadh and Goeuriot, Lorraine and Elhadad, Noemie and Pradhan, Sameer and Savova, Guergana and Chapman, Wendy (2014) Task 2: ShARe/CLEF eHealth evaluation lab 2014. CLEF 2014 Online Working Notes, 1180 . pp. 31-42. ISSN 1613-0073

Full text available as:

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader


This paper reports on Task 2 of the 2014 ShARe/CLEF eHealth evaluation lab which extended Task 1 of the 2013 ShARe/CLEF eHealth evaluation lab by focusing on template lling of disorder attributes. The task was comprised of two subtasks: attribute normalization (task 2a) and cue identication (task 2b).We instructed participants to develop a system which either kept or updated a default attribute value for each task. Participant systems were evaluated against a blind reference standard of 133 discharge summaries using Accuracy (task 2a) and F-score (task 2b). In total, ten teams participated in task 2a, and three teams in task 2b. For task 2a and 2b, the HITACHI team systems (run 2) had the highest performances, with an overall average average accuracy of 0.868 and F1-score (strict) of 0.676, respectively.

Item Type:Article (Published)
Uncontrolled Keywords:Natural Language Processing; Template Filling; Information Extraction; Clinical Text
Subjects:Computer Science > Information retrieval
DCU Faculties and Centres:Research Initiatives and Centres > Centre for Next Generation Localisation (CNGL)
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Official URL:
Copyright Information:© 2014 The Authors
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
ID Code:20112
Deposited On:29 Sep 2014 13:37 by Liadh Kelly. Last Modified 25 Oct 2017 13:25

Download statistics

Archive Staff Only: edit this record