Salway, Andrew, Lehane, Bart and O'Connor, Noel E. ORCID: 0000-0002-4033-9135 (2007) Associating characters with events in films. In: CIVR 2007 - ACM International Conference on Image and Video Retrieval, 9-11 July 2007, Amsterdam, The Netherlands.
Abstract
The work presented here combines the analysis of a film's audiovisual features with the analysis of an accompanying audio description. Specifically, we describe a technique for semantic-based indexing of feature films that associates character names with meaningful events. The technique fuses the results of event detection based on audiovisual features with the inferred on-screen presence of characters, based on an analysis of an audio description script. In an evaluation with 215 events from 11 films, the technique performed the character detection task with Precision = 93% and Recall = 71%. We then go on to show how novel access modes to film content are enabled by our analysis. The specific examples illustrated include video retrieval via a combination of event-type and character name and our first steps towards visualization of narrative and character interplay based on characters occurrence and co-occurrence in events.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Conference |
Refereed: | Yes |
Uncontrolled Keywords: | audio description; film; video indexing; video retrieval; |
Subjects: | Computer Science > Digital video Computer Science > Information retrieval |
DCU Faculties and Centres: | Research Institutes and Centres > Centre for Digital Video Processing (CDVP) Research Institutes and Centres > Adaptive Information Cluster (AIC) |
Publisher: | Association for Computing Machinery |
Official URL: | http://dx.doi.org/10.1145/1282280.1282354 |
Copyright Information: | © ACM, 2007. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution |
Funders: | Irish Research Council for Science Engineering and Technology, Science Foundation Ireland, SFI 03/IN.3/I361 |
ID Code: | 286 |
Deposited On: | 11 Mar 2008 by DORAS Administrator . Last Modified 08 Nov 2018 12:27 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
2MB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record