Bai, Liang, Hu, Yanli, Lao, Songyang, Smeaton, Alan F. ORCID: 0000-0003-1028-8389 and O'Connor, Noel E. ORCID: 0000-0002-4033-9135 (2010) Automatic summarization of rushes video using bipartite graphs. Multimedia Tools and Applications, 49 (1). pp. 63-80. ISSN 1573-7721
Abstract
In this paper we present a new approach for automatic summarization of rushes, or unstructured video. Our approach is composed of three major steps. First, based on shot and sub-shot segmentations, we filter sub-shots with low information content not likely to be useful in a summary. Second, a method using maximal matching in a bipartite graph is adapted to measure similarity between the remaining shots and to minimize inter-shot redundancy by removing repetitive retake shots common in rushes video. Finally, the presence of faces and motion intensity are characterised in each sub-shot. A measure of how representative the sub-shot is in the context of the overall video is then proposed. Video summaries composed of keyframe slideshows are then generated. In order to evaluate the effectiveness of this approach we re-run the evaluation carried out by TRECVid, using the same dataset and evaluation metrics used in the TRECVid video summarization task in 2007 but with our own assessors. Results show that our approach leads to a significant improvement on our own work in terms of the fraction of the TRECVid summary ground truth included and is competitive with the best of other approaches in TRECVid 2007.
Metadata
Item Type: | Article (Published) |
---|---|
Refereed: | Yes |
Additional Information: | Further information Alan.Smeaton@dcu.ie The original publication is available at www.springerlink.com |
Uncontrolled Keywords: | video summarization; evaluation; |
Subjects: | Computer Science > Algorithms Computer Science > Digital video |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Electronic Engineering DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing Research Institutes and Centres > CLARITY: The Centre for Sensor Web Technologies |
Publisher: | Springer Netherlands |
Official URL: | http://dx.doi.org/10.1007/s11042-009-0398-1 |
Copyright Information: | © 2009 Springer |
Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License |
Funders: | Science Foundation Ireland |
ID Code: | 14931 |
Deposited On: | 16 Oct 2009 08:53 by Alan Smeaton . Last Modified 31 Oct 2018 13:26 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
1MB |
Metrics
Altmetric Badge
Dimensions Badge
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record