Tran, Ly Duyen, Nguyen, Thanh-Binh, Gurrin, Cathal ORCID: 0000-0003-2903-3968 and Zhou, Liting
(2024)
MyEachtraX: Lifelog Question Answering on Mobile.
In: 7th Annual ACM Workshop on the Lifelog Search Challenge, 10 June 2024, Phuket, Thailand.
ISBN 9798400705502
Abstract
Your whole life in your pocket. That is the premise of lifelogging, a technology that captures and stores every moment of your life in digital form. Built on top of MyEachtra and the lifelog question-answering pipeline, MyEachtraX is a mobile-based application that addresses the overlook of mobile platforms in the area. Furthermore, leveraging the latest advancements in natural language processing, such as Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs), the system enhances the query-parsing, post-processing, and question-answering processes in lifelog retrieval. Official lifelog questions from the previous Lifelog Search Challenges were used to evaluate the system, which achieved an accuracy of 72.2%. We identify the retrieval component as the main bottleneck of the pipeline and propose future works to improve the system.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Workshop |
Refereed: | Yes |
Uncontrolled Keywords: | lifelog, mobile, retrieval, question answering |
Subjects: | Computer Science > Computer engineering Computer Science > Computer software |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing |
Published in: | Proceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge. LSC '24 . Association for Computing Machinery. ISBN 9798400705502 |
Publisher: | Association for Computing Machinery |
Official URL: | https://dl.acm.org/doi/10.1145/3643489.3661128 |
Funders: | Science Foundation Ireland |
ID Code: | 30727 |
Deposited On: | 04 Feb 2025 13:42 by Allie Tran . Last Modified 04 Feb 2025 13:42 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution 4.0 2MB |
Metrics
Altmetric Badge
Dimensions Badge
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record