Tran, Ly-Duyen, Nie, Dongyun, Zhou, Liting, Nguyen, Binh and Gurrin, Cathal ORCID: 0000-0003-4395-7702 (2023) VAISL: Visual-aware identification of semantic locations in lifelog. In: International Conference on Multimedia Modeling. ISBN 978-3-031-27817-4
Abstract
Organising and preprocessing are crucial steps in order to perform analysis on lifelogs. This paper presents a method for preprocessing, enriching, and segmenting lifelogs based on GPS trajectories and images captured from wearable cameras. The proposed method consists of four components: data cleaning, stop/trip point classification, post-processing, and event characterisation. The novelty of this paper lies in the incorporation of a visual module (using a pretrained CLIP model) to improve outlier detection, correct classification errors, and identify each event’s movement mode or location name. This visual component is capable of addressing imprecise boundaries in GPS trajectories and the partition of clusters due to data drift. The results are encouraging, which further emphasises the importance of visual analytics for organising lifelog data.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Conference |
Refereed: | Yes |
Uncontrolled Keywords: | Lifelogging; GPS trajectories; Embedding models |
Subjects: | Computer Science > Information retrieval Computer Science > Information technology Computer Science > Information storage and retrieval systems Computer Science > Lifelog |
DCU Faculties and Centres: | UNSPECIFIED |
Published in: | MultiMedia Modeling. MMM 2023. 13834. Springer. ISBN 978-3-031-27817-4 |
Publisher: | Springer |
Official URL: | https://link.springer.com/chapter/10.1007/978-3-03... |
Copyright Information: | Authors |
Funders: | SFI Centre for Research Training in Digitally Enhanced Reality |
ID Code: | 29961 |
Deposited On: | 29 Apr 2024 14:10 by Ly Duyen Tran . Last Modified 29 Apr 2024 14:10 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution-Noncommercial-No Derivative Works 4.0 1MB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record