Presentation + Paper
21 August 2020 Per-clip adaptive Lagrangian multiplier optimisation with low-resolution proxies
Author Affiliations +
Abstract
Optimising the parameters of a video codec for a specific video clip has been shown to yield significant bitrate savings. In particular, per-clip optimisation of the Lagrangian multiplier in Rate controlled compression, has led to BD-Rate improvements of up to 20% using HEVC. Unfortunately, this was computationally expensive as it required multiple measurement of rate distortion curves which meant in excess of fifty video encodes were used to generate that level of savings. This work focuses on reducing the computational cost of repeated video encodes by using a lower resolution clip as a proxy. Features extracted from the low resolution clip are then used to learn the mapping to an optimal Lagrange Multiplier for the original resolution clip. In addition to reducing the computational cost and encode time by using lower resolution clips, we also investigate the use of older, but faster codecs such as H.264 to create proxies. This work shows the computational load is reduced by up to 22 times using 144p proxies, and more than 60% of the possible gain at the original resolution is achieved. Our tests are based on the YouTube UGC dataset, using the same computational platform; hence our results are based on a practical instance of the adaptive bitrate encoding problem. Further improvements are possible, by optimising the placement and sparsity of operating points required for the rate distortion curves. Our contribution is to improve the computational cost of per clip optimisation with the Lagrangian multiplier, while maintaining BD-Rate improvement.
Conference Presentation
© (2020) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Daniel J. Ringis, François Pitié, and Anil Kokaram "Per-clip adaptive Lagrangian multiplier optimisation with low-resolution proxies", Proc. SPIE 11510, Applications of Digital Image Processing XLIII, 115100E (21 August 2020); https://doi.org/10.1117/12.2567654
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Video

Machine learning

Video compression

Video processing

Video coding

RELATED CONTENT

Motion-aware deep video coding network
Proceedings of SPIE (April 21 2020)
Using machine learning for fast intra MB coding in H.264
Proceedings of SPIE (January 29 2007)
Low complexity H.264 video encoding
Proceedings of SPIE (September 02 2009)

Back to Top