An experiment in Interactive Retrieval for the lifelog moment retrieval task at imageCLEFlifelog2020.
Tran, Ly-Duyen, Nguyen, Manh-Duy, Nguyen, Binh T. and Gurrin, CathalORCID: 0000-0003-2903-3968
(2020)
An experiment in Interactive Retrieval for the lifelog moment retrieval task at imageCLEFlifelog2020.
In: CLEFlifelog2020, 22-25 Sept 2020, Thessaloniki, Greece + Online.
The development of technology has led to an increase in mobile devices’ use to keep track of individual daily activities, as known as Lifelogging. Lifelogging has raised many research challenges, one of which is how to retrieve a specific moment in response to a user’s information need. This paper presents an efficient interactive search engine for large multimodal lifelog data which is evaluated in the ImageCLEFlifelog2020 Lifelog Moment Retrieval task (LMRT). The system is the modified version of the Myscéal demonstrator used in the Lifelog Search Challenge 2020, with the addition of visual similarity and a new method of visualising results. In interactive experimentation, our system achieved an F1@ 10 score of 0.48 in the official submission but can be significantly improved by implementing a number of post-processing steps.