In this paper, we present a novel video coding scheme based on overcomplete motion compensated temporal filtering (OMCTF) for robust video transmission over wireless channel. In this research, we introduce EREC and unequal error protection strategy under the framework of OMCTF. The intrinsic nature of the OMCTF structure not only provides fully scalable features for time-varying mobile wireless channels but also facilitates unequal error protection for robust video transmission. Since the most destructive effect of channel induced error in video communications over error-prone network is due to the loss of synchronization at the decoder, we apply error resilient entropy coding (EREC) to the compressed video bitstream to gain additional error resilience with negligible increase in bit budget. With EREC, the bitstream can be reorganized into fixed-length slots so that the synchronization can be easily regained at the beginning of the next uncorrupted slot, which will greatly limit the error propagation in the scalable video bitstream. To further enhance the robustness for video communication over error-prone channels, we introduce the Rate Compatible Punctured Convolutional (RCPC) codes for the protection of transmitted video over mobile wireless links. Due to the apparent prioritization order in the framework of OMCTF, the RCPC codes can be easily applied to achieve unequal error protection in the proposed OMCTF-based scheme. Integration of these strategies under the framework of OMCTF-based video coding scheme enables us to achieve robust video transmission over mobile wireless channels with an increased error resilience capability. Experimental results have demonstrated the performance of the proposed approach.
This paper presents a multiple description scalable video coding scheme based on overcomplete motion compensated
temporal filtering, named MD-OMCTF, for robust video transmission over wireless and packet loss networks. The
intrinsic nature of the structure of OMCTF and embedded coding with modified SPIHT algorithm enable us to provide
fully scalable properties for the proposed scheme. We show that multiple description coding is very effective in
combating with channel failures in both Internet and wireless video. The integration of MD with OMCTF allows us to
achieve both loss resilience and complete scalability. In order to further improve error-resilience to channel bit error for
this scheme and reduce error propagation in error-prone network, we apply error resilient entropy coding (EREC) to the
multiple bitstreams to gain additional error resilience. With EREC, multiple bitstreams are reorganized into fixed-length
slots so that synchronization of the beginning of each bitstream can be automatically obtained at the receiver. The
integration of scalable coding and EREC with MDC enables the coded video bitstream to be adaptive to the varying
channel condition and to be resilient to both transmission losses and bit errors. We also develop corresponding error
concealment scheme to recover the lost or erroneous information during video transmission. Experimental results show
that the proposed scheme is able to achieve robust video transmission over both wireless and packet loss networks.
We proposed in this paper a new multiple description scalable coding (MDSC) scheme based on in-band motion compensation temporal filtering (IBMCTF) technique in order to achieve high video coding performance and robust video transmission. The input video sequence is first split into equal-sized groups of frames (GOF). Within a GOF, each frame is hierarchically decomposed by discrete wavelet transform. Since there is a direct relationship between wavelet coefficients and what they represent in the image content after wavelet decomposition, we are able to reorganize the spatial orientation trees to generate multiple bit-streams. We have shown that multiple bit-stream transmission is very effective in combating error propagation in both Internet video streaming and mobile wireless video. We adopt the IBMCTF in our MDSC scheme to take full advantage of its good performance with flexible scalability, particularly at low spatial resolution. To achieve high coding performance for each bit-stream, we apply in-band motion estimation and motion compensated temporal filtering using over-complete DWT of each frame. Furthermore, we adopt bi-directional motion estimation between different bit-streams so as to facilitate the error concealment at the decoder to guarantee robust video transmission over error prone channels. Unlike traditional multiple description schemes, the integration of these techniques enable us to generate more than two bit-streams that may be more appropriate for multiple antenna transmission of compressed video. The integration also provides flexible tradeoff between coding efficiency and error resilience. Preliminary results on several standard video sequences have confirmed the high coding performance and flexible scalability.