Automatic structuring and augmentation of a lifelog of images

Abstract

The SenseCam is a passively capturing wearable camera that takes approximately 3,000 images on average per day. This provides a user with an extensive visual diary. Possible applications making use of this device include helping dementia sufferers recall events from short-term memory, and also this device can be used by tourists to maintain an extensive image collection of their trip. However a large image collection will quickly build up, with an average of 1 million images captured each year. This presents a considerable challenge in terms of managing such a large collection and to make it accessible for users. This proposal addresses the problem in 4 steps: 1) Identifying distinct events within the 3,000 images per day 2) Highlighting the most unique of those events 3) Finding similar events to a given event 4) Augmenting the low-quality images from the wearable camera with higher quality images from external sources.