Panagiotis, Linardos, Mohedano, Eva, Cherto, Monica, Gurrin, Cathal ORCID: 0000-0003-2903-3968 and Giró-i-Nieto, Xavier ORCID: 0000-0002-9935-5332 (2018) Temporal saliency adaptation in egocentric videos. In: The Third International Workshop on Egocentric Perception, Interaction and Computing (EPIC@ECCV18), 9 Sept 2018, Munich, Germany.
Abstract
This work adapts a deep neural model for image saliency
prediction to the temporal domain of egocentric video. We compute the
saliency map for each video frame, firstly with an off-the-shelf model
trained from static images, secondly by adding a a convolutional or
conv-LSTM layers trained with a dataset for video saliency prediction.
We study each configuration on EgoMon, a new dataset made of seven
egocentric videos recorded by three subjects in both free-viewing and
task-driven set ups. Our results indicate that the temporal adaptation is
beneficial when the viewer is not moving and observing the scene from
a narrow field of view. Encouraged by this observation, we compute and
publish the saliency maps for the EPIC Kitchens dataset, in which view-
ers are cooking.
Metadata
Item Type: | Conference or Workshop Item (Poster) |
---|---|
Event Type: | Workshop |
Refereed: | Yes |
Subjects: | Computer Science > Artificial intelligence Computer Science > Digital video Computer Science > Lifelog |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing DCU Faculties and Schools > Faculty of Engineering and Computing > School of Electronic Engineering Research Institutes and Centres > INSIGHT Centre for Data Analytics |
Copyright Information: | © The Authors |
Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License |
Funders: | SFI/12/RC/2289 |
ID Code: | 22679 |
Deposited On: | 19 Sep 2018 13:02 by Eva Mohedano Robles . Last Modified 22 Oct 2018 10:48 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
282kB |
Downloads
Downloads
Downloads per month over past year
Available Versions of this Item
-
The impact of temporal regularisation in egocentric saliency prediction. (deposited 22 Oct 2018 10:53)
-
The impact of temporal regularisation in egocentric saliency prediction. (deposited 19 Sep 2018 09:47)
- Temporal saliency adaptation in egocentric videos. (deposited 19 Sep 2018 13:02) [Currently Displayed]
-
The impact of temporal regularisation in egocentric saliency prediction. (deposited 19 Sep 2018 09:47)
Archive Staff Only: edit this record