CIKM 2013 workshop on living labs for information
retrieval evaluation
Balog, Krisztian, Elsweiler, David, Kanoulas, Evangelos, Kelly, LiadhORCID: 0000-0003-1131-5238 and Smucker, Mark
(2013)
CIKM 2013 workshop on living labs for information
retrieval evaluation.
In: ACM International Conference on Information and Knowledge Management (CIKM 2013), 27 Oct - 1 Nov 2013, San Francisco, CA..
ISBN 978-1-4503-2420-5
In the past few years the information retrieval (IR) community has been exploring ways to move further away from the Cranfield style evaluation paradigm, and make evaluations more ‘realistic’ (more centered on real users, their needs and behaviours). As part of this drive, living labs which involve and integrate users in the research process have been proposed. The Living Labs for Information Retrieval Evaluation workshop (LL’13) brings together for the first time people interested in progressing the living labs for IR evaluation methodology.