Browse DORAS
Browse Theses
Latest Additions
Creative Commons License
Except where otherwise noted, content on this site is licensed for use under a:

Analyzing image-text relations for semantic media adaptation and personalization

Hughes, Mark and Salway, Andrew and Jones, Gareth J.F. and O'Connor, Noel E. (2007) Analyzing image-text relations for semantic media adaptation and personalization. In: SMAP 2007 - Second International Workshop on Semantic Media Adaptation and Personalization, 17-18 December 2007, London, UK.

Full text available as:

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader


Progress in semantic media adaptation and personalisation requires that we know more about how different media types, such as texts and images, work together in multimedia communication. To this end, we present our ongoing investigation into image-text relations. Our idea is that the ways in which the meanings of images and texts relate in multimodal documents, such as web pages, can be classified on the basis of low-level media features and that this classification should be an early processing step in systems targeting semantic multimedia analysis. In this paper we present the first empirical evidence that humans can predict something about the main theme of a text from an accompanying image, and that this prediction can be emulated by a machine via analysis of low- level image features. We close by discussing how these findings could impact on applications for news adaptation and personalisation, and how they may generalise to other kinds of multimodal documents and to applications for semantic media retrieval, browsing, adaptation and creation.

Item Type:Conference or Workshop Item (Paper)
Event Type:Workshop
Uncontrolled Keywords:semantic media adaptation and personalisation
Subjects:Computer Science > Information retrieval
Computer Science > Image processing
DCU Faculties and Centres:Research Initiatives and Centres > Centre for Digital Video Processing (CDVP)
Publisher:Institute of Electrical and Electronics Engineers
Official URL:
Copyright Information:Copyright © 2007 IEEE. Reprinted from Second International Workshop on Semantic Media Adaptation and Personalization. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to By choosing to view this document, you agree to all provisions of the copyright laws protecting it.
Funders:European Commission FP6 045335
ID Code:439
Deposited On:20 May 2008 by DORAS Administrator. Last Modified 01 Feb 2017 11:22

Download statistics

Archive Staff Only: edit this record