Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

On guiding video object segmentation

Ortego, Diego orcid logoORCID: 0000-0002-1011-3610, McGuinness, Kevin orcid logoORCID: 0000-0003-1336-6477, SanMiguel, Juan C., Arazo, Eric, Martínez, José M. and O'Connor, Noel E. orcid logoORCID: 0000-0002-4033-9135 (2019) On guiding video object segmentation. In: International Conference on Content-Based Multimedia Indexing, 4-6 Sept 2019, Dublin, Ireland.

Abstract
This paper presents a novel approach for segmenting moving objects in unconstrained environments using guided convolutional neural networks. This guiding process relies on foreground masks from independent algorithms (i.e. state-of-the-art algorithms) to implement an attention mechanism that incorporates the spatial location of foreground and background to compute their separated representations. Our approach initially extracts two kinds of features for each frame using colour and optical flow information. Such features are combined following a multiplicative scheme to benefit from their complementarity. These unified colour and motion features are later processed to obtain the separated foreground and background representations. Then, both independent representations are concatenated and decoded to perform foreground segmentation. Experiments conducted on the challenging DAVIS 2016 dataset demonstrate that our guided representations not only outperform non-guided, but also recent and top-performing video object segmentation algorithms.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Refereed:Yes
Uncontrolled Keywords:Video object segmentation; foreground segmentation; attention; deep learning
Subjects:Computer Science > Artificial intelligence
Computer Science > Image processing
Computer Science > Machine learning
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Electronic Engineering
Research Institutes and Centres > INSIGHT Centre for Data Analytics
Published in: Proceedings of Content Based Multimedia Information (CBMI 2019). . IEEE.
Publisher:IEEE
Official URL:http://dx.doi.org/10.1109/CBMI.2019.8877438
Copyright Information:© 2019 The Authors
Funders:Spanish Government (MobiNetVideo TEC2017-88169-R), UAM-BANCO SANTANDER ´ con Europa (Red Yerun)” (2017/YERUN/02 (SOFDL), Science Foundation Ireland (SFI/12/RC/2289 and SFI/15/SIRG/3283)
ID Code:23798
Deposited On:02 Oct 2019 15:09 by Diego Ortego Hernández . Last Modified 27 Oct 2021 12:25
Documents

Full text available as:

[thumbnail of 2019_CBMI_paper.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
644kB
Metrics

Altmetric Badge

Dimensions Badge

Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record