Skip to main content
DORAS
DCU Online Research Access Service
Login (DCU Staff Only)
A task category space for user-centric comparative multimedia search evaluations

Lokoc, Jakub ORCID: 0000-0002-3558-4144, Bailer, Werner ORCID: 0000-0003-2442-4900, Barthel, Kai Uwe ORCID: 0000-0001-6309-572X, Gurrin, Cathal ORCID: 0000-0003-2903-3968, Heller, Silvan ORCID: 0000-0001-5386-330X, Jónsson, Björn Þór ORCID: 0000-0003-0889-3491, Peska, Ladislav ORCID: 0000-0001-8082-4509, Rossetto, Luca ORCID: 0000-0002-5389-9465, Schoeffmann, Klaus ORCID: 0000-0002-9218-1704, Vadicamo, Lucia ORCID: 0000-0001-7182-7038, Vrochidis, Stefanos ORCID: 0000-0002-2505-9178 and Wu, Jiaxin ORCID: 0000-0003-4074-3442 (2022) A task category space for user-centric comparative multimedia search evaluations. In: International Conference on Multimedia Modeling (MMM2022), 6–10 June 2022,, Phu Quoc, Vietnam.

Full text available as:

[img]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
399kB

Abstract

In the last decade, user-centric video search competitions have facilitated the evolution of interactive video search systems. So far, these competitions focused on a small number of search task categories, with few attempts to change task category configurations. Based on our extensive experience with interactive video search contests, we have analyzed the spectrum of possible task categories and propose a list of individual axes that define a large space of possible task categories. Using this concept of category space, new user-centric video search competitions can be designed to benchmark video search systems from different perspectives. We further analyse the three task categories considered so far at the Video Browser Showdown and discuss possible (but sometimes challenging) shifts within the task category space

Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Refereed:Yes
Uncontrolled Keywords:Multimedia retrieval; Task taxonomy; Evaluation design;
Subjects:Computer Science > Multimedia systems
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Electronic Engineering
Research Initiatives and Centres > ADAPT
Published in: MMM 2022: MultiMedia Modeling. Lecture Notes in Computer Science (LNCS) 13141. Springer.
Publisher:Springer
Official URL:https://dx.doi.org/10.1007/978-3-030-98358-1_16
Copyright Information:© 2022 Springer
Funders:Czech Science Foundation (GAČR) project 19-22071Y, Science Foundation Ireland under grant number SFI/12/RC/2289_2, EU’s Horizon 2020 research and innovation programs, under grant agreements n◦ 951911 AI4Media and n◦ 825079 MindSpaces
ID Code:27657
Deposited On:07 Sep 2022 16:10 by Cathal Gurrin . Last Modified 03 Mar 2023 12:45

Downloads

Downloads per month over past year

Archive Staff Only: edit this record

Altmetric
- Altmetric
+ Altmetric
  • Student Email
  • Staff Email
  • Student Apps
  • Staff Apps
  • Loop
  • Disclaimer
  • Privacy
  • Contact Us