Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Indexing of fictional video content for event detection and summarisation

Lehane, Bart, O'Connor, Noel E. orcid logoORCID: 0000-0002-4033-9135, Lee, Hyowon orcid logoORCID: 0000-0003-4395-7702 and Smeaton, Alan F. orcid logoORCID: 0000-0003-1028-8389 (2007) Indexing of fictional video content for event detection and summarisation. EURASIP Journal on Image and Video Processing . ISSN 1687-5176

Abstract
This paper presents an approach to movie video indexing that utilises audiovisual analysis to detect important and meaningful temporal video segments, that we term events. We consider three event classes, corresponding to dialogues, action sequences, and montages, where the latter also includes musical sequences. These three event classes are intuitive for a viewer to understand and recognise whilst accounting for over 90% of the content of most movies. To detect events we leverage traditional filmmaking principles and map these to a set of computable low-level audiovisual features. Finite state machines (FSMs) are used to detect when temporal sequences of specific features occur. A set of heuristics, again inspired by filmmaking conventions, are then applied to the output of multiple FSMs to detect the required events. A movie search system, named MovieBrowser, built upon this approach is also described. The overall approach is evaluated against a ground truth of over twenty-three hours of movie content drawn from various genres and consistently obtains high precision and recall for all event classes. A user experiment designed to evaluate the usefulness of an event-based structure for both searching and browsing movie archives is also described and the results indicate the usefulness of the proposed approach.
Metadata
Item Type:Article (Published)
Refereed:Yes
Uncontrolled Keywords:video indexing; audiovisual analysis; finite state machines (FSMs);
Subjects:Computer Science > Multimedia systems
Computer Science > Digital video
DCU Faculties and Centres:Research Institutes and Centres > Centre for Digital Video Processing (CDVP)
Research Institutes and Centres > Adaptive Information Cluster (AIC)
Publisher:Hindawi Publishing Corporation
Official URL:http://dx.doi.org/10.1155/2007/14615
Copyright Information:Copyright © 2007 Bart Lehane et al.
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:Enterprise Ireland, Science Foundation Ireland, SFI 03/IN.3/I361
ID Code:207
Deposited On:04 Mar 2008 by DORAS Administrator . Last Modified 08 Nov 2018 12:32
Documents

Full text available as:

[thumbnail of eurasip_jour_image_video_proc_aug_2007.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
1MB
Metrics

Altmetric Badge

Dimensions Badge

Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record