Automatic summarization of rushes video using bipartite graphs
Bai, Liang and Songyang, Lao and Smeaton, Alan F. and O'Connor, Noel E. (2008) Automatic summarization of rushes video using bipartite graphs. In: SAMT 2008 - 3rd International Conference on Semantic and Multimedia Technologies, 3-5 December 2008, Koblenz, Germany. ISBN 978-3-540-92234-6
Full text available as:
In this paper we present a new approach for automatic summarization of rushes video. Our approach is composed of three main steps. First, based on a temporal segmentation, we filter sub-shots with low information content not likely to be useful in a summary. Second, a method using maximal matching in a bipartite graph is adapted to measure similarity between the remaining shots and to minimize inter-shot redundancy by removing repetitive retake shots common in rushes content. Finally, the presence of faces and the motion intensity are characterised in each sub-shot. A measure of how representative the sub-shot is in the context of the overall video is then proposed. Video summaries composed of keyframe slideshows are then generated. In order to evaluate the effectiveness of this approach we re-run the evaluation carried out by the TREC, using the same dataset and evaluation metrics used in the TRECVID video summarization task in 2007 but with our own assessors. Results show that our approach leads to a significant improvement in terms of the fraction of the TRECVID summary ground truth included and is competitive with other approaches in TRECVID 2007.
Archive Staff Only: edit this record