Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

LifeInsight2.0: An Enhanced Approach for Automated Lifelog Retrieval in LSC'24

Vuong, Gia Huy, Ho, Van-Son, Nguyen Dang, Tien Thanh, Thai, Xuan-Dang, Nguyen-Ho, Thang-Long, Pham, Minh-Khoi, Le, Tu-Khiem, Ninh, Van-Tu, Healy, Graham orcid logoORCID: 0000-0001-6429-6339, Gurrin, Cathal orcid logoORCID: 0000-0003-2903-3968 and Tran, Minh-Triet (2024) LifeInsight2.0: An Enhanced Approach for Automated Lifelog Retrieval in LSC'24. In: Proceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge, 10 June 2024, Phuket, Thailand. ISBN 9798400705502

Abstract
We introduce the LifeInsight 2.0 system - an enhanced version of LifeInsight, built specifically for the sixth annual Lifelog Search Challenge (LSC'23). LifeInsight 2.0 leverages the core functionalities of LifeInsight while incorporating significant improvements to address performance bottlenecks. This refined architecture aims to deliver superior search capabilities within the LSC'24. LifeInsight 2.0 employs an ensemble approach combining two powerful foundation models: CLIP (Contrastive Language-Image Pretraining) and BLIP2 (Bootstrapping Language-Image Pretraining) model. In addition, the system incorporates a temporal query mechanism and an automatic query parser. The former enables LifeInsight 2.0 to interpret queries that include time-based information, while the latter specifically handles tasks involving question answering.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Workshop
Refereed:Yes
Uncontrolled Keywords:lifelog, interactive retrieval, automatic retrieval, spatial insights, AI-based assistance
Subjects:Computer Science > Information retrieval
Computer Science > Lifelog
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Research Institutes and Centres > ADAPT
Published in: LSC '24: Proceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge. LSC '24 . Association for Computing Machinery. ISBN 9798400705502
Publisher:Association for Computing Machinery
Official URL:https://dl.acm.org/doi/10.1145/3652583.3658890
Copyright Information:Authors
ID Code:30674
Deposited On:23 Jan 2025 13:10 by Cathal Gurrin . Last Modified 23 Jan 2025 13:10
Documents

Full text available as:

[thumbnail of 3643489.3661119.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution 4.0
4MB
Metrics

Altmetric Badge

Dimensions Badge

Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record