Tran, Ly-Duyen ORCID: 0000-0002-9597-1832, Nguyen, Manh-Duy ORCID: 0000-0001-6878-7039, Nguyen, Binh ORCID: 0000-0001-5249-9702, Lee, Hyowon ORCID: 0000-0003-4395-7702, Zhou, Liting ORCID: 0000-0002-7778-8743 and Gurrin, Cathal ORCID: 0000-0003-2903-3968 (2022) E-Myscéal: embedding-based Interactive lifelog retrieval system for LSC'22. In: ICMR '22: International Conference on Multimedia Retrieval, 27 - 30 June 2022, Newark, NJ. USA. ISBN 978-1-4503-9239-6
Abstract
Developing interactive lifelog retrieval systems is a growing research area. There are many international competitions for lifelog retrieval that encourage researchers to build effective systems that can address the multimodal retrieval challenge of lifelogs. The Lifelog Search Challenge (LSC) was first organised in 2018 and is currently the only interactive benchmarking evaluation for lifelog retrieval systems. Participating systems should have an accurate search engine and a user-friendly interface that can help users to retrieve relevant content. In this paper, we upgrade our previous MyScéal, which was the top performing system in LSC'20 and LSC'21, and present E-MyScéal for LSC'22, which includes a completely different search engine. Instead of using visual concepts for retrieval such as MyScéal, the new E-MyScéal employs an embedding technique that facilitates novice users who are not familiar with the concepts. Our experiments show that the new search engine can find relevant images in the first place in the ranked list, four a quarter of the LSC'21 queries (26%) by using just the first hint from the textual information need. Regarding the user interface, we still keep the simple non-faceted design as in the previous version but improve the event view browsing in order to better support novice users.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Conference |
Refereed: | Yes |
Uncontrolled Keywords: | interactive retrieval system; elasticsearch; human factors |
Subjects: | Computer Science > Image processing Computer Science > Information retrieval Computer Science > Interactive computer systems Computer Science > Multimedia systems Computer Science > Information storage and retrieval systems Computer Science > Lifelog |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing Research Institutes and Centres > INSIGHT Centre for Data Analytics |
Published in: | Proceedings of the 5th Annual on Lifelog Search Challenge. . Association for Computing Machinery (ACM). ISBN 978-1-4503-9239-6 |
Publisher: | Association for Computing Machinery (ACM) |
Official URL: | https://doi.org/10.1145/3512729.3533012 |
Copyright Information: | © 2022 The Authors. |
Funders: | Science Foundation Ireland grant numbers SFI/12/RC/2289, SFI/13/RC/2106, 18/CRT/6223 and 18/CRT/6224 |
ID Code: | 27801 |
Deposited On: | 28 Sep 2022 10:05 by Ly Duyen Tran . Last Modified 04 Mar 2024 12:37 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution 4.0 3MB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record