Context-aware person identification in personal photo collections
O'Hare, Neil and Smeaton, Alan F. (2009) Context-aware person identification in personal photo collections. IEEE Transactions on Multimedia, 11 (2). ISSN 1520-9210
Full text available as:
Identifying the people in photos is an important need for users of photo management systems. We present MediAssist, one such system which facilitates browsing, searching and semi-automatic annotation of personal photos, using analysis of both image content and the context in which the photo is captured. This semi-automatic annotation includes annotation of the identity of people in photos. In this paper, we focus on such person annotation, and propose person identiﬁcation techniques based on a combination of context and content. We propose language modelling and nearest neighbor approaches to context-based person identiﬁcation, in addition to novel face color and image color content-based features (used alongside face recognition and body patch features). We conduct a comprehensive empirical study of these techniques using the real private photo collections of a number of users, and show that combining context- and content-based analysis improves performance over content or context alone.
Archive Staff Only: edit this record