Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Interpreting CNN for low complexity learned sub-pixel motion compensation in video coding

Murn, Luka, Blasi, Saverio, Smeaton, Alan F. orcid logoORCID: 0000-0002-4033-9135, O'Connor, Noel E. orcid logoORCID: 0000-0002-4033-9135 and Mrak, Marta (2020) Interpreting CNN for low complexity learned sub-pixel motion compensation in video coding. In: IEEE International Conference on Image Processing (ICIP), 25-28 Oct 2020, Abu Dhabi, United Arab Emirates (Online).

Abstract
Deep learning has shown great potential in image and video compression tasks. However, it brings bit savings at the cost of significant increases in coding complexity, which limits its potential for implementation within practical applications. In this paper, a novel neural network-based tool is presented which improves the interpolation of reference samples needed for fractional precision motion compensation. Contrary to previous efforts, the proposed approach focuses on complexity reduction achieved by interpreting the interpolation filters learned by the networks. When the approach is implemented in the Versatile Video Coding (VVC) test model, up to 4.5% BD-rate saving for individual sequences is achieved compared with the baseline VVC, while the complexity of learned interpolation is significantly reduced compared to the application of full neural network.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Refereed:Yes
Uncontrolled Keywords:Neural network interpretability; video coding standards; fractional-pixel motion compensation; convolutional neural networks; inter prediction
Subjects:Computer Science > Artificial intelligence
Computer Science > Machine learning
Computer Science > Digital video
Computer Science > Video compression
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Electronic Engineering
Research Institutes and Centres > INSIGHT Centre for Data Analytics
Published in: 2020 IEEE International Conference on Image Processing (ICIP). . IEEE.
Publisher:IEEE
Official URL:http://dx.doi.org/10.1109/ICIP40778.2020.9191193
Copyright Information:© 2020 The Authors
Funders:Marie Skłodowska-Curie grant agreement No 765140, Science Foundation Ireland
ID Code:24619
Deposited On:23 Oct 2020 11:01 by Alan Smeaton . Last Modified 11 Nov 2020 16:59
Documents

Full text available as:

[thumbnail of BBC-CNNInterpretability_LukaMurn-Camera_Ready.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
792kB
Metrics

Altmetric Badge

Dimensions Badge

Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record