22 March 1996 Segmentation-based coding of stereoscopic image sequences
Author Affiliations +
Abstract
A binocular disparity based segmentation scheme to compactly represent one image of a stereoscopic image pair given the other image was proposed earlier by us. That scheme adapted the excess bitcount, needed to code the additional image, to the binocular disparity detail present in the image pair. This paper addresses the issue of extending such a segmentation in the temporal dimension to achieve efficient stereoscopic sequence compression. The easiest conceivable temporal extension would be to code one of the sequences using an MPEG-type scheme while the frames of the other stream are coded based on the segmentation. However such independent compression of one of the streams fails to take advantage of the segmentation or the additional disparity information available. To achieve better compression by exploiting this additional information, we propose the following scheme. Each frame in one of the streams is segmented based on disparity. An MPEG-type frame structure is used for motion compensated prediction of the segments in this segmented stream. The corresponding segments in the other stream are encoded by reversing the disparity-map obtained during the segmentation. Areas without correspondence in this stream, arising from binocular occlusions and disparity estimation errors, are filled in using a disparity-map based predictive error concealment method. Over a test set of several different stereoscopic image sequences, high perceived stereoscopic image qualities were achieved at an excess bandwidth that is roughly 40% above that of a highly compressed monoscopic sequence. Stereo perception can be achieved at significantly smaller excess bandwidths, albeit with a perceivable loss in the image quality.
© (1996) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Sriram Sethuraman, Mel Siegel, Angel G. Jordan, "Segmentation-based coding of stereoscopic image sequences", Proc. SPIE 2668, Digital Video Compression: Algorithms and Technologies 1996, (22 March 1996); doi: 10.1117/12.235437; https://doi.org/10.1117/12.235437
PROCEEDINGS
10 PAGES


SHARE
KEYWORDS
Image segmentation

Image compression

Motion estimation

Error analysis

Image quality

Cameras

Visualization

RELATED CONTENT

Region based time varying image coding at low bit rate...
Proceedings of SPIE (April 21 1995)
Error-resilient image compression based on JPEG
Proceedings of SPIE (March 13 1996)
Depth-controlled 3D TV image coding
Proceedings of SPIE (April 30 1998)
Interframe hierarchical address-vector quantization
Proceedings of SPIE (September 01 1990)

Back to Top