Translator Disclaimer
28 April 2010 Color-based lip localization method
Author Affiliations +
This paper is concerned with lip localization for visual speech recognition (VSR) system. We shall present an efficient method for localization human's lips/mouth in video images. This method is based on using the YCbCr approach to find at least any part of the lip as an initial step. Then we use all the available information about the segmented lip-pixels such as r, g, b, warped hue, etc. to segment the rest of the lip. The mean is calculated for each value, then for each pixel in ROI, Euclidian distance from the mean vector is calculated. Pixels with smaller distances are further clustered as lip pixels. Thus, the rest of the pixels in ROI will be clustered (to lip/non-lip pixel) depending on their distances from the mean vector of the initial segmented lip region. The method is evaluated on a new-recorded database of 780,000 frames; the experiments show that the method localizes the lips efficiently, with high level of accuracy (91.15%) that outperforms existing lip detection approaches.
© (2010) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Ahmad B. A. Hassanat and Sabah Jassim "Color-based lip localization method", Proc. SPIE 7708, Mobile Multimedia/Image Processing, Security, and Applications 2010, 77080Y (28 April 2010);


Robust face detection based on components and their topology
Proceedings of SPIE (January 18 2006)
Automatic face-region detection in MPEG video sequences
Proceedings of SPIE (September 29 1996)
Hierarchy visual attention map
Proceedings of SPIE (February 11 2007)
MPEG-4 outer-inner lip FAP interpolation
Proceedings of SPIE (March 13 2005)
Lip reading using neural networks
Proceedings of SPIE (September 30 2011)

Back to Top