Doherty, Aiden R. ORCID: 0000-0003-4395-7702 (2008) Providing effective memory retrieval cues through automatic structuring and augmentation of a lifelog of images. In: Seminar at the Multimedia Information Retrieval Group, Yahoo! Research, 11 December 2008, Barcelona, Spain.
Abstract
Almost everything we do these days is in some way monitored or logged by computers. We've come to accept - or maybe just ignore – this massive surveillance because it brings us benefits. In the past we have been easily able to monitor activities on our PC's (e.g. documents we worked
on, e-mails received, etc.), however recently with the advent of numerous types of wearable sensors we have been able to log many more aspects of our activities. While we have the technology to log these activities, we're not really sure what applications we can develop to usefully use this data. One application of lifelogging is as a memory aid to sufferers of neurodegenerative diseases as Alzheimer’s. Indeed in studies on the human mind it has been shown that images are strongly encoded in the brain, and in this seminar we talk about our work in using visual lifelog images to provide effective memory cues. To passively capture these lifelog images we use a wearable camera called the SenseCam. This device captures an average of 2,000 images per day, which equates to over 600,000 images per year! This is too much information for any individual to sift through, therefore we firstly exploit various aspects of the human memory system to break
this data down into manageable chunks or events. Finally in order to provide additional memory cues to an individual (on say a tourist trip), we automatically augment their own lifelog images with images taken from web 2.0 sites such as Flickr. Through analysing the tags of geotagged images on Flickr, we are also automatically able to provide additional augmented material from other sites such as the Yahoo search engine for example. The talk will conclude by talking about future directions that lifelogging may take and the data sources that may drive these changes.
Metadata
Item Type: | Conference or Workshop Item (Invited Talk) |
---|---|
Event Type: | Seminar |
Refereed: | No |
Subjects: | Computer Science > Lifelog Computer Science > Information storage and retrieval systems Computer Science > Multimedia systems Computer Science > Information retrieval Computer Science > Image processing |
DCU Faculties and Centres: | Research Institutes and Centres > Centre for Digital Video Processing (CDVP) Research Institutes and Centres > CLARITY: The Centre for Sensor Web Technologies DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing |
Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License |
Funders: | Science Foundation Ireland, Irish Research Council for Science Engineering and Technology |
ID Code: | 4643 |
Deposited On: | 29 Jun 2009 15:06 by Dr Aiden Doherty . Last Modified 04 Oct 2018 11:24 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
9MB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record