Vuong, Gia Huy, Ho, Van-Son, Nguyen Dang, Tien Thanh, Thai, Xuan-Dang, Nguyen-Ho, Thang-Long, Pham, Minh-Khoi, Le, Tu-Khiem, Ninh, Van-Tu, Healy, Graham ORCID: 0000-0001-6429-6339, Gurrin, Cathal
ORCID: 0000-0003-2903-3968 and Tran, Minh-Triet
(2024)
LifeInsight2.0: An Enhanced Approach for Automated Lifelog Retrieval in LSC'24.
In: Proceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge, 10 June 2024, Phuket, Thailand.
ISBN 9798400705502
Abstract
We introduce the LifeInsight 2.0 system - an enhanced version of LifeInsight, built specifically for the sixth annual Lifelog Search Challenge (LSC'23). LifeInsight 2.0 leverages the core functionalities of LifeInsight while incorporating significant improvements to address performance bottlenecks. This refined architecture aims to deliver superior search capabilities within the LSC'24. LifeInsight 2.0 employs an ensemble approach combining two powerful foundation models: CLIP (Contrastive Language-Image Pretraining) and BLIP2 (Bootstrapping Language-Image Pretraining) model. In addition, the system incorporates a temporal query mechanism and an automatic query parser. The former enables LifeInsight 2.0 to interpret queries that include time-based information, while the latter specifically handles tasks involving question answering.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Workshop |
Refereed: | Yes |
Uncontrolled Keywords: | lifelog, interactive retrieval, automatic retrieval, spatial insights, AI-based assistance |
Subjects: | Computer Science > Information retrieval Computer Science > Lifelog |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing Research Institutes and Centres > ADAPT |
Published in: | LSC '24: Proceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge. LSC '24 . Association for Computing Machinery. ISBN 9798400705502 |
Publisher: | Association for Computing Machinery |
Official URL: | https://dl.acm.org/doi/10.1145/3652583.3658890 |
Copyright Information: | Authors |
ID Code: | 30674 |
Deposited On: | 23 Jan 2025 13:10 by Cathal Gurrin . Last Modified 23 Jan 2025 13:10 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution 4.0 4MB |
Metrics
Altmetric Badge
Dimensions Badge
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record