7 December 2001 Joint temporal-spatial quality enhancement for full frame-rate video playback
Author Affiliations +
Abstract
A joint temporal-spatial rate control scheme is investigated to optimize temporal and spatial rate-distortion (R-D) performances for full frame-rate video playback, where skipped frames are reconstructed via frame interpolation. The derived optimization problem is too complex to solve by using a straightforward Lagrangian multiplier method due to inter-frame coding dependency (e.g. I/P/B) and the frame-dependent reconstruction. To reduce the complexity, frames are adaptively grouped based on MAD (mean absolute difference) differentials, and iterative greedy search based on the R-D cost is applied to each group of frames to obtain a suboptimal solution. The performance of full frame-rate playback of the ITU-T H.263+/TMN8 codec is evaluated by reconstructing skipped frames with bidirectional motion-compensated interpolation. Experimental results show that the proposed solution has a gain of 0.2 - 1.0 dB over the traditional scheme with a fixed frame skip in average PSNR. Furthermore, the frame-by-frame PSNR variance is also reduced.
© (2001) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Shan Liu, JongWon Kim, C.-C. Jay Kuo, "Joint temporal-spatial quality enhancement for full frame-rate video playback", Proc. SPIE 4472, Applications of Digital Image Processing XXIV, (7 December 2001); doi: 10.1117/12.449770; https://doi.org/10.1117/12.449770
PROCEEDINGS
11 PAGES


SHARE
Back to Top