Browse DORAS
Browse Theses
Latest Additions
Creative Commons License
Except where otherwise noted, content on this site is licensed for use under a:

The uncertain representation ranking framework for concept-based video retrieval

Aly, Robin and Doherty, Aiden R. and Hiemstra, Djoerd and de Jong, Franciska and Smeaton, Alan F. (2012) The uncertain representation ranking framework for concept-based video retrieval. Information Retrieval, 15 . pp. 1-27. ISSN 1386-4564

Full text available as:

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader


Concept based video retrieval often relies on imperfect and uncertain concept detectors. We propose a general ranking framework to define effective and robust ranking functions, through explicitly addressing detector uncertainty. It can cope with multiple concept-based representations per video segment and it allows the re-use of effective text retrieval functions which are defined on similar representations. The final ranking status value is a weighted combination of two components: the expected score of the possible scores, which represents the risk-neutral choice, and the scores’ standard deviation, which represents the risk or opportunity that the score for the actual representation is higher. The framework consistently improves the search performance in the shot retrieval task and the segment retrieval task over several baselines in five TRECVid collections and two collections which use simulated detectors of varying performance.

Item Type:Article (Published)
Additional Information:Further information from
Uncontrolled Keywords:semantic concepts; concept detection; data fusion; Representation uncertainty; Concept-based representation; Video retrieval
Subjects:Computer Science > Machine learning
Computer Science > Multimedia systems
Computer Science > Digital video
Computer Science > Information retrieval
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Research Initiatives and Centres > CLARITY: The Centre for Sensor Web Technologies
Publisher:Kluwer (Springer)
Official URL:
Copyright Information:The original publication is available at
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:Science Foundation Ireland
ID Code:17144
Deposited On:25 Jul 2012 10:50 by Alan Smeaton. Last Modified 25 Jul 2012 10:50

Download statistics

Archive Staff Only: edit this record