NTCIR Lifelog: the first test collection for lifelog research
Gurrin, CathalORCID: 0000-0003-2903-3968, Joho, Hideo, Hopfgartner, FrankORCID: 0000-0003-0380-6088, Zhou, LitingORCID: 0000-0002-7778-8743 and Albatal, RamiORCID: 0000-0002-9269-8578
(2016)
NTCIR Lifelog: the first test collection for lifelog research.
In: SIGIR'16 - the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, 17-21 July 2017, Pisa, Italy.
ISBN 978-1-4503-4069-4
Test collections have a long history of supporting repeatable and comparable evaluation in Information Retrieval (IR). However, thus far, no shared test collection exists for IR systems that are designed to index and retrieve multimodal lifelog data. In this paper we introduce the first test collection for personal lifelog data, which has been employed for the NTCIR12-Lifelog task. In this paper, the requirements for the test collection are motivated, the process of creating the test collection is described, along with an overview of the test collection. Finally suggestions are given for possible applications of the test collection.
Metadata
Item Type:
Conference or Workshop Item (Poster)
Event Type:
Conference
Refereed:
Yes
Uncontrolled Keywords:
test collection; information retrieval; multimodal; evaluation