A CU-level adaptive decision method for CNN-based in-loop filtering

Yue Bei; Qi Wang; Zhipeng Cheng; Xinghao Pan; Jian Lei; Limin Wang; Dandan Ding

doi:10.1117/12.2557183

3 January 2020 A CU-level adaptive decision method for CNN-based in-loop filtering

Yue Bei, Qi Wang, Zhipeng Cheng, Xinghao Pan, Jian Lei, Limin Wang, Dandan Ding

Proceedings Volume 11373, Eleventh International Conference on Graphics and Image Processing (ICGIP 2019); 113731G (2020) https://doi.org/10.1117/12.2557183
Event: Eleventh International Conference on Graphics and Image Processing, 2019, Hangzhou, China

Abstract

Convolutional Neural Network (CNN) has been introduced to in-loop filtering in video coding for further performance improvement. For intra frame coding, a CNN model can be directly trained through learning the correlation between the reconstructed and the original frames, and the obtained model can then be applied to every single reconstructed frame to help improve the video quality. In contrast, for inter frame coding, intertwined reference dependency exists across frames. If a similar procedure of model training and deployment is adopted for inter as that for intra coding, over-smoothed reconstructed frames may be generated, which may further seriously deteriorate the overall coding performance. To address such an issue, state-of-the-art work resorts to the Rate Distortion Optimization (RDO) to determine whether to adopt the conventional or the CNN-based scheme for in-loop filtering, however leading to high computational complexity. In this paper, we propose a Coding-unit (CU) level Adaptive Decision approach (CAD) which employs an early decision for each CU, based on their coding parameters. Experimental results show that the proposed scheme achieves comparable performance with that of the RDO scheme while effectively reduces the encoding time complexity.

Citation Download Citation

Yue Bei, Qi Wang, Zhipeng Cheng, Xinghao Pan, Jian Lei, Limin Wang, and Dandan Ding "A CU-level adaptive decision method for CNN-based in-loop filtering", Proc. SPIE 11373, Eleventh International Conference on Graphics and Image Processing (ICGIP 2019), 113731G (3 January 2020); https://doi.org/10.1117/12.2557183

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available