Browse DORAS
Browse Theses
Latest Additions
Creative Commons License
Except where otherwise noted, content on this site is licensed for use under a:

The TRECVID 2007 BBC rushes summarization evaluation pilot

Over, Paul and Smeaton, Alan F. and Kelly, Philip (2007) The TRECVID 2007 BBC rushes summarization evaluation pilot. In: TVS 2007 - TRECVID BBC Rushes Summarization Workshop, 24-29 September 2007, Augsburg, Germany.

Full text available as:

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader


This paper provides an overview of a pilot evaluation of video summaries using rushes from several BBC dramatic series. It was carried out under the auspices of TRECVID. Twenty-two research teams submitted video summaries of up to 4% duration, of 42 individual rushes video files aimed at compressing out redundant and insignificant material. The output of two baseline systems built on straightforward content reduction techniques was contributed by Carnegie Mellon University as a control. Procedures for developing ground truth lists of important segments from each video were developed at Dublin City University and applied to the BBC video. At NIST each summary was judged by three humans with respect to how much of the ground truth was included, how easy the summary was to understand, and how much repeated material the summary contained. Additional objective measures included: how long it took the system to create the summary, how long it took the assessor to judge it against the ground truth, and what the summary's duration was. Assessor agreement on finding desired segments averaged 78% and results indicate that while it is difficult to exceed the performance of baselines, a few systems did.

Item Type:Conference or Workshop Item (Paper)
Event Type:Workshop
Additional Information:Workshop held in conjunction with ACM Multimedia '07
Uncontrolled Keywords:Video summarization; Evaluation; Benchmarking;
Subjects:Computer Science > Digital video
Computer Science > Information retrieval
DCU Faculties and Centres:Research Initiatives and Centres > Centre for Digital Video Processing (CDVP)
Research Initiatives and Centres > Adaptive Information Cluster (AIC)
Publisher:Association for Computing Machinery
Official URL:
Copyright Information:© ACM, 2007. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution.
Funders:Science Foundation Ireland, SFI 03/IN.3/I361
ID Code:404
Deposited On:02 Apr 2008 by DORAS Administrator. Last Modified 01 Feb 2017 13:52

Download statistics

Archive Staff Only: edit this record