A laboratory-based method for the evaluation of
personalised search
Sanvitto, Camilla, Ganguly, DebasisORCID: 0000-0003-0050-7138, Jones, Gareth J.F.ORCID: 0000-0003-2923-8365 and Pasi, Gabriella
(2016)
A laboratory-based method for the evaluation of
personalised search.
In: Seventh International Workshop on Evaluating Information Access (EVIA 2016), 7 June 2016, Tokyo, Japan.
ISBN 978-4-86049-072-0
Comparative evaluation of Information Retrieval Systems
(IRSs) using publically available test collections has become
an established practice in Information Retrieval (IR). By
means of the popular Cranfield evaluation paradigm IR test
collections enable researchers to compare new methods to
existing approaches. An important area of IR research where
this strategy has not been applied to date is Personalised
Information Retrieval (PIR), which has generally relied on
user-based evaluations. This paper describes a method that
enables the creation of publically available extended test collections to allow repeatable laboratory-based evaluation of
personalised search.
Metadata
Item Type:
Conference or Workshop Item (Paper)
Event Type:
Workshop
Refereed:
Yes
Uncontrolled Keywords:
personalised search; laboratory-based evaluation; test collection development
Clarke, Charles L.A. and Yilmaz, Emine, (eds.)
Proceedings of the Seventh International Workshop on Evaluating Information Access (EVIA 2016).
.
National Institute of Informatics (NII). ISBN 978-4-86049-072-0