24 June 2005 Extending the prediction error coder of H.264/AVC by a vector quantizer
Author Affiliations +
Proceedings Volume 5960, Visual Communications and Image Processing 2005; 59606M (2005) https://doi.org/10.1117/12.633517
Event: Visual Communications and Image Processing 2005, 2005, Beijing, China
Abstract
The standardized video coding algorithms are based on hybrid coding using blockwise motion compensated prediction and transform coding of the resulting prediction error. For the purpose of transform coding, the recent standard H.264/AVC applies an integer transform. For each block, the Lagrangian costs are analyzed, which are measured by the sum of the squared reconstruction errors and the bit rate weighted by a Lagrange multiplier. It is observed that the costs of blocks with marginally or diagonally correlated samples are frequently higher than the costs theoretically required due to the fact that the transform coder of H.264/AVC is unadjusted for these blocks. In this paper, it is investigated if the coding efficiency can be improved by extending the prediction error coder by a vector quantizer which is optimized for the coding of these blocks. For each block of the prediction error either standardized transform coding or vector quantization is applied whereas the algorithm with lower costs is chosen. For broadcast quality at 34 dB PSNR, the bit rate is reduced by 7-10% compared to H.264/AVC using CAVLC with slightly reduced computational expense in the decoder. Compared to H.264/AVC using CABAC, almost the same coding efficiency is achieved with significantly lower computational expense in the decoder.
© (2005) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Matthias Narroschke, Matthias Narroschke, } "Extending the prediction error coder of H.264/AVC by a vector quantizer", Proc. SPIE 5960, Visual Communications and Image Processing 2005, 59606M (24 June 2005); doi: 10.1117/12.633517; https://doi.org/10.1117/12.633517
PROCEEDINGS
12 PAGES


SHARE
Back to Top