Browse DORAS
Browse Theses
Latest Additions
Creative Commons License
Except where otherwise noted, content on this site is licensed for use under a:

Report on the CIKM workshop on living labs for information retrieval evaluation

Balog, Krisztian and Elsweiler, David and Kanoulas, Evangelos and Kelly, Liadh and Smucker, Mark (2014) Report on the CIKM workshop on living labs for information retrieval evaluation. ACM SIGIR Forum, 48 (1). pp. 21-28. ISSN 0163-5840

Full text available as:

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader


Evaluation is a central aspect of information retrieval (IR) research. In the past few years, a new evaluation methodology known as living labs has been proposed as a way for researchers to be able to perform in-situ evaluation. The rst CIKM workshop on Living Labs for IR evaluation (LL'13) was held on 1st November 2013 in San Francisco, USA. The workshop consisted of an industrial keynote, four oral paper presentations, three demo presentations, and a discussion session. This report presents an overview of the scope and contents of the workshop and outlines the major outcomes.

Item Type:Article (Published)
Uncontrolled Keywords:Review article; Information Retrieval (IR) evaluation
Subjects:Computer Science > Information retrieval
DCU Faculties and Centres:Research Initiatives and Centres > Centre for Next Generation Localisation (CNGL)
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Publisher:Association for Computing Machinery
Official URL:
Copyright Information:© ACM, 2014. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in ACM SIGIR Forum {VOL48(1), 2014}
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
ID Code:20108
Deposited On:16 Sep 2014 11:11 by Liadh Kelly. Last Modified 16 Sep 2014 11:11

Download statistics

Archive Staff Only: edit this record