Report on the CIKM workshop on living labs
for information retrieval evaluation
Balog, Krisztian, Elsweiler, David, Kanoulas, Evangelos, Kelly, LiadhORCID: 0000-0003-1131-5238 and Smucker, Mark
(2014)
Report on the CIKM workshop on living labs
for information retrieval evaluation.
ACM SIGIR Forum, 48
(1).
pp. 21-28.
ISSN 0163-5840
Evaluation is a central aspect of information retrieval (IR) research. In the past few years, a new evaluation methodology known as living labs has been proposed as a way for researchers to be able to perform in-situ evaluation. The rst CIKM workshop on Living Labs for IR evaluation (LL'13) was held on 1st November 2013 in San Francisco, USA.
The workshop consisted of an industrial keynote, four oral paper presentations, three demo presentations, and a discussion session. This report presents an overview of the scope and contents of the workshop and outlines the major outcomes.
Metadata
Item Type:
Article (Published)
Refereed:
No
Uncontrolled Keywords:
Review article; Information Retrieval (IR) evaluation