25 February 2014 Theory and practice of perceptual video processing in broadcast encoders for cable, IPTV, satellite, and internet distribution
Author Affiliations +
Abstract
This paper describes the theory and application of a perceptually-inspired video processing technology that was recently incorporated into professional video encoders now being used by major cable, IPTV, satellite, and internet video service providers. We will present data that show that this perceptual video processing (PVP) technology can improve video compression efficiency by up to 50% for MPEG-2, H.264, and High Efficiency Video Coding (HEVC). The PVP technology described in this paper works by forming predicted eye-tracking attractor maps that indicate how likely it might be that a free viewing person would look at particular area of an image or video. We will introduce in this paper the novel model and supporting theory used to calculate the eye-tracking attractor maps. We will show how the underlying perceptual model was inspired by electrophysiological studies of the vertebrate retina, and will explain how the model incorporates statistical expectations about natural scenes as well as a novel method for predicting error in signal estimation tasks. Finally, we will describe how the eye-tracking attractor maps are created in real time and used to modify video prior to encoding so that it is more compressible but not noticeably different than the original unmodified video.
© (2014) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
S. McCarthy, "Theory and practice of perceptual video processing in broadcast encoders for cable, IPTV, satellite, and internet distribution", Proc. SPIE 9014, Human Vision and Electronic Imaging XIX, 90140O (25 February 2014); doi: 10.1117/12.2043090; https://doi.org/10.1117/12.2043090
PROCEEDINGS
13 PAGES


SHARE
Back to Top