Murn, Luka, Blasi, Saverio, Smeaton, Alan F. ORCID: 0000-0002-4033-9135, O'Connor, Noel E. ORCID: 0000-0002-4033-9135 and Mrak, Marta (2020) Interpreting CNN for low complexity learned sub-pixel motion compensation in video coding. In: IEEE International Conference on Image Processing (ICIP), 25-28 Oct 2020, Abu Dhabi, United Arab Emirates (Online).
Abstract
Deep learning has shown great potential in image and video compression tasks. However, it brings bit savings at the cost of significant increases in coding complexity, which limits its potential for implementation within practical applications. In this paper, a novel neural network-based tool is presented which improves the interpolation of reference samples needed for fractional precision motion compensation. Contrary to previous efforts, the proposed approach focuses on complexity reduction achieved by interpreting the interpolation filters learned by the networks. When the approach is implemented in the Versatile Video Coding (VVC) test model, up to 4.5% BD-rate saving for individual sequences is achieved compared with the baseline VVC, while the complexity of learned interpolation is significantly reduced compared to the application of full neural network.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Conference |
Refereed: | Yes |
Uncontrolled Keywords: | Neural network interpretability; video coding standards; fractional-pixel motion compensation; convolutional neural networks; inter prediction |
Subjects: | Computer Science > Artificial intelligence Computer Science > Machine learning Computer Science > Digital video Computer Science > Video compression |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing DCU Faculties and Schools > Faculty of Engineering and Computing > School of Electronic Engineering Research Institutes and Centres > INSIGHT Centre for Data Analytics |
Published in: | 2020 IEEE International Conference on Image Processing (ICIP). . IEEE. |
Publisher: | IEEE |
Official URL: | http://dx.doi.org/10.1109/ICIP40778.2020.9191193 |
Copyright Information: | © 2020 The Authors |
Funders: | Marie Skłodowska-Curie grant agreement No 765140, Science Foundation Ireland |
ID Code: | 24619 |
Deposited On: | 23 Oct 2020 11:01 by Alan Smeaton . Last Modified 11 Nov 2020 16:59 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
792kB |
Metrics
Altmetric Badge
Dimensions Badge
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record