Vuong, Gia Huy, Ho, Van-Son, Nguyen Dang, Tien Thanh, Thai, Xuan-Dang, Nguyen-Ho, Thang-Long, Pham, Minh-Khoi, Le, Tu-Khiem, Ninh, Van-Tu, Healy, Graham 
ORCID: 0000-0001-6429-6339, Gurrin, Cathal ORCID: 0000-0003-2903-3968 and Tran, Minh-Triet
(2024)
LifeInsight2.0: An Enhanced Approach for Automated Lifelog Retrieval in LSC'24.
In: 7th Annual ACM Workshop on the Lifelog Search Challenge, 10 June, 2024, Phuket,Thailand.
ISBN 9798400705502
Abstract
We introduce the LifeInsight 2.0 system - an enhanced version of LifeInsight, built specifically for the sixth annual Lifelog Search Challenge (LSC'23). LifeInsight 2.0 leverages the core functionalities of LifeInsight while incorporating significant improvements to address performance bottlenecks. This refined architecture aims to deliver superior search capabilities within the LSC'24. LifeInsight 2.0 employs an ensemble approach combining two powerful foundation models: CLIP (Contrastive Language-Image Pretraining) and BLIP2 (Bootstrapping Language-Image Pretraining) model. In addition, the system incorporates a temporal query mechanism and an automatic query parser. The former enables LifeInsight 2.0 to interpret queries that include time-based information, while the latter specifically handles tasks involving question answering.
Metadata
| Item Type: | Conference or Workshop Item (Paper) |
|---|---|
| Event Type: | Workshop |
| Refereed: | Yes |
| Uncontrolled Keywords: | lifelog, interactive retrieval, automatic retrieval, spatial insights, AI-based assistance |
| Subjects: | Computer Science > Information retrieval Computer Science > Multimedia systems Computer Science > Lifelog |
| DCU Faculties and Centres: | UNSPECIFIED |
| Published in: | Proceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge. LSC '24 . Association for Computing Machinery. ISBN 9798400705502 |
| Publisher: | Association for Computing Machinery |
| Official URL: | https://dl.acm.org/doi/proceedings/10.1145/3643489 |
| Copyright Information: | Authors |
| ID Code: | 30672 |
| Deposited On: | 02 Sep 2025 14:54 by Cathal Gurrin . Last Modified 02 Sep 2025 14:54 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution 4.0 3MB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record