Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

The State-of-the-Art in Lifelog Retrieval: A Review of Progress at the ACM Lifelog Search Challenge Workshop 2022-2024

Tran, Allie et al (2025) The State-of-the-Art in Lifelog Retrieval: A Review of Progress at the ACM Lifelog Search Challenge Workshop 2022-2024. IEEE Access, 13 . ISSN 2169-3536

Abstract
The ACM Lifelog Search Challenge (LSC) is the only long-running benchmark that evaluates lifelog retrieval systems through real-time, human-in-the-loop interaction. This paper presents a longitudinal analysis of technical and interaction design progress at LSC from 2022 to 2024, conducted under fixed datasets, tasks, and evaluation protocols. Unlike prior surveys of lifelogging research, our study leverages competitive, synchronous evaluations to examine how retrieval architectures, interface design choices, and interaction strategies directly influence task performance. Through a comparative analysis of knownitem search, question answering, and ad-hoc retrieval tasks, we identify a clear paradigm shift from concept-based pipelines toward embedding-driven and LLM-supported retrieval systems. We show how these shifts affect retrieval effectiveness, response time, and user behaviour, as well as provide empirical insight into how retrieval and interface design choices manifest in performance during interactive search. Beyond documenting emerging techniques, we expose evaluation artefacts such as performance variability across system instances and user familiarity effects, raising important considerations for future interactive benchmarks.
Metadata
Item Type:Article (Published)
Refereed:Yes
Uncontrolled Keywords:Analytics, interactive search, lifelog, multimodal retrieval, benchmarking.
Subjects:UNSPECIFIED
DCU Faculties and Centres:Research Institutes and Centres > ADAPT
Publisher:Institute of Electrical and Electronics Engineers
Official URL:https://arxiv.org/abs/2506.06743
Copyright Information:Authors
ID Code:32275
Deposited On:10 Feb 2026 12:02 by Gordon Kennedy . Last Modified 10 Feb 2026 12:02
Documents

Full text available as:

[thumbnail of The_State-of-the-Art_in_Lifelog_Retrieval_A_Review_of_Progress_at_the_ACM_Lifelog_Search_Challenge_Workshop_2022-2024.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution 4.0
4MB
Metrics

Altmetric Badge

Dimensions Badge

Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record