Perceptual multimedia compression based on predictive Kalman filter eye movement modeling

Oleg V. Komogortsev; Javed I. Khan

doi:10.1117/12.702748

Translator Disclaimer

29 January 2007 Perceptual multimedia compression based on the predictive Kalman filter eye movement modeling

Oleg V. Komogortsev, Javed I. Khan

Author Affiliations +

Proceedings Volume 6504, Multimedia Computing and Networking 2007; 650406 (2007) https://doi.org/10.1117/12.702748
Event: Electronic Imaging 2007, 2007, San Jose, CA, United States

Abstract

In this paper we propose an algorithm for predicting a person's perceptual attention focus (PAtF) through the use of a Kalman Filter design of the human visual system. The concept of the PAtF allows significant reduction of the bandwidth of a video stream and computational burden reduction in the case of 3D media creation and transmission. This is possible due to the fact that the human visual system has limited perception capabilities and only 2 degrees out of the total of 180 provide the highest quality of perception. The peripheral image quality can be decreased without a viewer noticing image quality reduction. Multimedia transmission through a network introduces a delay. This delay reduces the benefits of using a PAtF due to the fact that the person's attention area can change drastically during the delay period, thus increasing the probability of peripheral image quality reduction being detected. We have created a framework which uses a Kalman Filter to predict future PAtFs in order to compensate for the delay/lag and to reduce the bandwidth/creation burden of any visual multimedia.

Citation Download Citation

Oleg V. Komogortsev and Javed I. Khan "Perceptual multimedia compression based on the predictive Kalman filter eye movement modeling", Proc. SPIE 6504, Multimedia Computing and Networking 2007, 650406 (29 January 2007); https://doi.org/10.1117/12.702748

ACCESS THE FULL ARTICLE