Analyzing image-text relations for semantic media adaptation and personalization
Hughes, Mark and Salway, Andrew and Jones, Gareth J.F. and O'Connor, Noel E. (2007) Analyzing image-text relations for semantic media adaptation and personalization. In: SMAP 2007 - Second International Workshop on Semantic Media Adaptation and Personalization, 17-18 December 2007, London, UK.
Full text available as:
Progress in semantic media adaptation and personalisation requires that we know more about how different media types, such as texts and images, work together in multimedia communication. To this end, we present our ongoing investigation into image-text relations. Our idea is that the ways in which the meanings of images and texts relate in multimodal documents, such as web pages, can be classified on the basis of low-level media features and that this classification should be an early processing step in systems targeting semantic multimedia analysis. In this paper we present the first empirical evidence that humans can predict something about the main theme of a text from an accompanying image, and that this prediction can be emulated by a machine via analysis of low- level image features. We close by discussing how these findings could impact on applications for news adaptation and personalisation, and how they may generalise to other kinds of multimodal documents and to applications for semantic media retrieval, browsing, adaptation and creation.
|Item Type:||Conference or Workshop Item (Paper)|
|Uncontrolled Keywords:||semantic media adaptation and personalisation|
|Subjects:||Computer Science > Information retrieval|
Computer Science > Image processing
|DCU Faculties and Centres:||Research Initiatives and Centres > Centre for Digital Video Processing (CDVP)|
|Publisher:||Institute of Electrical and Electronics Engineers|
|Copyright Information:||Copyright © 2007 IEEE. Reprinted from Second International Workshop on Semantic Media Adaptation and Personalization. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to firstname.lastname@example.org. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.|
|Funders:||European Commission FP6 045335|
|Deposited On:||20 May 2008 by DORAS Administrator. Last Modified 04 May 2010 16:37|
Archive Staff Only: edit this record