Nguyen, Thao-Nhu, Quang, Le Minh, Healy, Graham ORCID: 0000-0001-6429-6339, Nguyen, Binh T. and Gurrin, Cathal ORCID: 0000-0003-4395-7702 (2024) VideoCLIP 2.0: An Interactive CLIP-Based Video Retrieval System for Novice Users at VBS2024. In: MultiMedia Modeling. ISBN 978-3-031-53302-0
Abstract
In this paper, we present an interactive video retrieval system named VideoCLIP 2.0 developed for the Video Browser Showdown in 2024. Building upon the foundation of the previous year's system, VideoCLIP, this upgraded version incorporates several enhancements to support novice users in solving retrieval tasks quickly and effectively. Firstly, the revised system enables search using a variety of modalities, such as rich text, dominant colour, OCR, query-by-image, and now relevance feedback. Additionally a new keyframe selection technique and a new embedding model to replace the existing CLIP model have been employed. This new model aims to obtain richer visual representations in order to improve search performance in the live interactive challenge. Lastly, the user interface has been refined to enable quicker inspection and user-friendly navigation, particularly beneficial for novice users. In this paper we describe the updates to VideoCLIP.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Conference |
Refereed: | Yes |
Uncontrolled Keywords: | Video Browser Showdown · Interactive Video Retrieval · Embedding Model · Multimodal Retrieval · Video Retrieval System |
Subjects: | Computer Science > Information retrieval Computer Science > Information technology Computer Science > Interactive computer systems Computer Science > Multimedia systems Computer Science > Information storage and retrieval systems |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing |
Publisher: | Springer Nature Switzerland |
Official URL: | https://link.springer.com/chapter/10.1007/978-3-03... |
Copyright Information: | Authors |
ID Code: | 29972 |
Deposited On: | 30 Apr 2024 11:05 by Thao-Nhu Nguyen . Last Modified 30 Apr 2024 11:05 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution-Noncommercial-No Derivative Works 4.0 4MB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record