Skip to main content
DORAS
DCU Online Research Access Service
Login (DCU Staff Only)
Temporal saliency adaptation in egocentric videos

Panagiotis, Linardos, Mohedano, Eva, Cherto, Monica, Gurrin, Cathal ORCID: 0000-0003-2903-3968 and Giró-i-Nieto, Xavier ORCID: 0000-0002-9935-5332 (2018) Temporal saliency adaptation in egocentric videos. In: The Third International Workshop on Egocentric Perception, Interaction and Computing (EPIC@ECCV18), 9 Sept 2018, Munich, Germany.

This is the latest version of this item.

Full text available as:

[img]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
282kB

Abstract

This work adapts a deep neural model for image saliency prediction to the temporal domain of egocentric video. We compute the saliency map for each video frame, firstly with an off-the-shelf model trained from static images, secondly by adding a a convolutional or conv-LSTM layers trained with a dataset for video saliency prediction. We study each configuration on EgoMon, a new dataset made of seven egocentric videos recorded by three subjects in both free-viewing and task-driven set ups. Our results indicate that the temporal adaptation is beneficial when the viewer is not moving and observing the scene from a narrow field of view. Encouraged by this observation, we compute and publish the saliency maps for the EPIC Kitchens dataset, in which view- ers are cooking.

Item Type:Conference or Workshop Item (Poster)
Event Type:Workshop
Refereed:Yes
Subjects:Computer Science > Artificial intelligence
Computer Science > Digital video
Computer Science > Lifelog
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Electronic Engineering
Research Initiatives and Centres > INSIGHT Centre for Data Analytics
Copyright Information:© The Authors
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:SFI/12/RC/2289
ID Code:22679
Deposited On:19 Sep 2018 13:02 by Eva Mohedano Robles . Last Modified 22 Oct 2018 10:48

Available Versions of this Item

  • The impact of temporal regularisation in egocentric saliency prediction. (deposited 22 Oct 2018 10:53)
    • The impact of temporal regularisation in egocentric saliency prediction. (deposited 19 Sep 2018 09:47)
      • Temporal saliency adaptation in egocentric videos. (deposited 19 Sep 2018 13:02) [Currently Displayed]

Downloads

Downloads per month over past year

Archive Staff Only: edit this record

Altmetric
- Altmetric
+ Altmetric
  • Student Email
  • Staff Email
  • Student Apps
  • Staff Apps
  • Loop
  • Disclaimer
  • Privacy
  • Contact Us