Skip to main content
DORAS
DCU Online Research Access Service
Login (DCU Staff Only)
E-Myscéal: embedding-based Interactive lifelog retrieval system for LSC'22

Tran, Ly Duyen ORCID: 0000-0002-9597-1832, Nguyen, Manh-Duy ORCID: 0000-0001-6878-7039, Nguyen, Binh ORCID: 0000-0001-5249-9702, Lee, Hyowon ORCID: 0000-0003-4395-7702, Zhou, Liting ORCID: 0000-0002-7778-8743 and Gurrin, Cathal ORCID: 0000-0003-2903-3968 (2022) E-Myscéal: embedding-based Interactive lifelog retrieval system for LSC'22. In: ICMR '22: International Conference on Multimedia Retrieval, 27 - 30 June 2022, Newark, NJ. USA. ISBN 978-1-4503-9239-6

Full text available as:

[img]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
3MB

Abstract

Developing interactive lifelog retrieval systems is a growing research area. There are many international competitions for lifelog retrieval that encourage researchers to build effective systems that can address the multimodal retrieval challenge of lifelogs. The Lifelog Search Challenge (LSC) was first organised in 2018 and is currently the only interactive benchmarking evaluation for lifelog retrieval systems. Participating systems should have an accurate search engine and a user-friendly interface that can help users to retrieve relevant content. In this paper, we upgrade our previous MyScéal, which was the top performing system in LSC'20 and LSC'21, and present E-MyScéal for LSC'22, which includes a completely different search engine. Instead of using visual concepts for retrieval such as MyScéal, the new E-MyScéal employs an embedding technique that facilitates novice users who are not familiar with the concepts. Our experiments show that the new search engine can find relevant images in the first place in the ranked list, four a quarter of the LSC'21 queries (26%) by using just the first hint from the textual information need. Regarding the user interface, we still keep the simple non-faceted design as in the previous version but improve the event view browsing in order to better support novice users.

Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Refereed:Yes
Uncontrolled Keywords:interactive retrieval system; elasticsearch; human factors
Subjects:Computer Science > Image processing
Computer Science > Information retrieval
Computer Science > Interactive computer systems
Computer Science > Multimedia systems
Computer Science > Information storage and retrieval systems
Computer Science > Lifelog
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Research Initiatives and Centres > INSIGHT Centre for Data Analytics
Published in: Proceedings of the 5th Annual on Lifelog Search Challenge. . Association for Computing Machinery (ACM). ISBN 978-1-4503-9239-6
Publisher:Association for Computing Machinery (ACM)
Official URL:https://doi.org/10.1145/3512729.3533012
Copyright Information:© 2022 The Authors. Open Access (CC-BY 4.0)
Funders:Science Foundation Ireland grant numbers SFI/12/RC/2289, SFI/13/RC/2106, 18/CRT/6223 and 18/CRT/6224
ID Code:27801
Deposited On:28 Sep 2022 10:05 by Ly Duyen Tran . Last Modified 28 Sep 2022 10:05

Downloads

Downloads per month over past year

Archive Staff Only: edit this record

Altmetric
- Altmetric
+ Altmetric
  • Student Email
  • Staff Email
  • Student Apps
  • Staff Apps
  • Loop
  • Disclaimer
  • Privacy
  • Contact Us