FMOE-MR: content-driven multiresolution MPEG-4 fine grained scalable layered video encoding

S. Chattopadhyay; X. Luo; S. M. Bhandarkar; K. Li

doi:10.1117/12.705927

29 January 2007 FMOE-MR: content-driven multiresolution MPEG-4 fine grained scalable layered video encoding

S. Chattopadhyay, X. Luo, S. M. Bhandarkar, K. Li

Proceedings Volume 6504, Multimedia Computing and Networking 2007; 650404 (2007) https://doi.org/10.1117/12.705927
Event: Electronic Imaging 2007, 2007, San Jose, CA, United States

Abstract

The MPEG-4 Fine Grained Scalability (FGS) profile aims at scalable layered video encoding, in order to ensure efficient video streaming in networks with fluctuating bandwidths. In this paper, we propose a novel technique, termed as FMOEMR, which delivers significantly improved rate distortion performance compared to existing MPEG-4 Base Layer encoding techniques. The video frames are re-encoded at high resolution at semantically and visually important regions of the video (termed as Features, Motion and Objects) that are defined using a mask (FMO-Mask) and at low resolution in the remaining regions. The multiple-resolution re-rendering step is implemented such that further MPEG-4 compression leads to low bit rate Base Layer video encoding. The Features, Motion and Objects Encoded-Multi- Resolution (FMOE-MR) scheme is an integrated approach that requires only encoder-side modifications, and is transparent to the decoder. Further, since the FMOE-MR scheme incorporates "smart" video preprocessing, it requires no change in existing MPEG-4 codecs. As a result, it is straightforward to use the proposed FMOE-MR scheme with any existing MPEG codec, thus allowing great flexibility in implementation. In this paper, we have described, and implemented, unsupervised and semi-supervised algorithms to create the FMO-Mask from a given video sequence, using state-of-the-art computer vision algorithms.

Citation Download Citation

S. Chattopadhyay, X. Luo, S. M. Bhandarkar, and K. Li "FMOE-MR: content-driven multiresolution MPEG-4 fine grained scalable layered video encoding", Proc. SPIE 6504, Multimedia Computing and Networking 2007, 650404 (29 January 2007); https://doi.org/10.1117/12.705927

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available