Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

OpenLifelogQA: An Open-Ended Multimodal Lifelog Question-Answering Dataset

Tran, Quang-Linh orcid logoORCID: 0000-0002-5409-0916, Le, Hoang-Bao orcid logoORCID: 0009-0000-2496-4347, Diep, Nghiem Tuong, Nguyen, Binh T. orcid logoORCID: 0000-0001-5249-9702, Jones, Gareth J.F. orcid logoORCID: 0000-0003-2923-8365 and Gurrin, Cathal orcid logoORCID: 0000-0003-2903-3968 (2025) OpenLifelogQA: An Open-Ended Multimodal Lifelog Question-Answering Dataset. In: The 14th International Symposium on Information and Communication Technology, 12-14 December 2025, Nha Trang, Vietnam. ISBN 978-981-92-2584-2

Abstract
We introduce OpenLifelogQA, a large-scale open-ended lifelog QA dataset constructed from 18 months of multimodal lifelog data. Lifelogging is the passive collection and analysis of personal daily activities using wearable devices, producing rich multimodal data such as images, locations, and biometrics. Question answering (QA) over lifelog data enables users to interactively query their own experiences, supporting applications in memory support, lifestyle analysis, and personal assistance. OpenLifelogQA contains 14,187 Q&A pairs spanning multiple question types and difficulty levels, designed to support robust evaluation in realistic settings. Compared with prior resources, OpenLifelogQA offers greater diversity and practicality for real-world applications. To establish baselines, we evaluate the LLaVA-NeXT-Interleave 7B model, achieving 89.7% BERTScore, 25.87% ROUGE-L, and an average LLM Score of 3.97. By releasing OpenLifelogQA, we aim to promote future research on lifelog technologies, paving the way for personal lifelog assistants capable of memory augmentation, healthcare support, and lifestyle coaching.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Refereed:Yes
Uncontrolled Keywords:Lifelog Question Answering; Multi-modal Question Answering Dataset; Large Language Models
Subjects:Computer Science > Artificial intelligence
Computer Science > Lifelog
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Research Institutes and Centres > ADAPT
Published in: Information and Communication Technology. Communications in Computer and Information Science . Springer Nature. ISBN 978-981-92-2584-2
Publisher:Springer Nature
Official URL:https://link.springer.com/book/10.1007/978-981-92-...
Copyright Information:Authors
Funders:ADAPT
ID Code:33277
Deposited On:31 Aug 2026 12:43 by Quang-Linh Tran . Last Modified 31 Aug 2026 12:43
Documents

Full text available as:

[thumbnail of OpenLifelogQA.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution 4.0
566kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record