Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

VideoCLIP 2.0: An Interactive CLIP-Based Video Retrieval System for Novice Users at VBS2024

Nguyen, Thao-Nhu, Quang, Le Minh, Healy, Graham orcid logoORCID: 0000-0001-6429-6339, Nguyen, Binh T. and Gurrin, Cathal orcid logoORCID: 0000-0003-4395-7702 (2024) VideoCLIP 2.0: An Interactive CLIP-Based Video Retrieval System for Novice Users at VBS2024. In: MultiMedia Modeling. ISBN 978-3-031-53302-0

Abstract
In this paper, we present an interactive video retrieval system named VideoCLIP 2.0 developed for the Video Browser Showdown in 2024. Building upon the foundation of the previous year's system, VideoCLIP, this upgraded version incorporates several enhancements to support novice users in solving retrieval tasks quickly and effectively. Firstly, the revised system enables search using a variety of modalities, such as rich text, dominant colour, OCR, query-by-image, and now relevance feedback. Additionally a new keyframe selection technique and a new embedding model to replace the existing CLIP model have been employed. This new model aims to obtain richer visual representations in order to improve search performance in the live interactive challenge. Lastly, the user interface has been refined to enable quicker inspection and user-friendly navigation, particularly beneficial for novice users. In this paper we describe the updates to VideoCLIP.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Refereed:Yes
Uncontrolled Keywords:Video Browser Showdown · Interactive Video Retrieval · Embedding Model · Multimodal Retrieval · Video Retrieval System
Subjects:Computer Science > Information retrieval
Computer Science > Information technology
Computer Science > Interactive computer systems
Computer Science > Multimedia systems
Computer Science > Information storage and retrieval systems
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Publisher:Springer Nature Switzerland
Official URL:https://link.springer.com/chapter/10.1007/978-3-03...
Copyright Information:Authors
ID Code:29972
Deposited On:30 Apr 2024 11:05 by Thao-Nhu Nguyen . Last Modified 30 Apr 2024 11:05
Documents

Full text available as:

[thumbnail of VBS2024_Nhu_Quang.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution-Noncommercial-No Derivative Works 4.0
4MB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record