25 February 2008 Person and gesture tracking with smart stereo cameras
Author Affiliations +
Physical security increasingly involves sophisticated, real-time visual tracking of a person's location inside a given environment, often in conjunction with biometrics and other security-related technologies. However, demanding real-world conditions like crowded rooms, changes in lighting and physical obstructions have proved incredibly challenging for 2D computer vision technology. In contrast, 3D imaging technology is not affected by constant changes in lighting and apparent color, and thus allows tracking accuracy to be maintained in dynamically lit environments. In addition, person tracking with a 3D stereo camera can provide the location and movement of each individual very precisely, even in a very crowded environment. 3D vision only requires that the subject be partially visible to a single stereo camera to be correctly tracked; multiple cameras are used to extend the system's operational footprint, and to contend with heavy occlusion. A successful person tracking system, must not only perform visual analysis robustly, but also be small, cheap and consume relatively little power. The TYZX Embedded 3D Vision systems are perfectly suited to provide the low power, small footprint, and low cost points required by these types of volume applications. Several security-focused organizations, including the U.S Government, have deployed TYZX 3D stereo vision systems in security applications. 3D image data is also advantageous in the related application area of gesture tracking. Visual (uninstrumented) tracking of natural hand gestures and movement provides new opportunities for interactive control including: video gaming, location based entertainment, and interactive displays. 2D images have been used to extract the location of hands within a plane, but 3D hand location enables a much broader range of interactive applications. In this paper, we provide some background on the TYZX smart stereo cameras platform, describe the person tracking and gesture tracking systems implemented on this platform, and discuss some deployed applications.
© (2008) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Gaile Gordon, Xiangrong Chen, Ron Buck, "Person and gesture tracking with smart stereo cameras", Proc. SPIE 6805, Three-Dimensional Image Capture and Applications 2008, 68050T (25 February 2008); doi: 10.1117/12.759206; https://doi.org/10.1117/12.759206


Video-CRM: understanding customer behaviors in stores
Proceedings of SPIE (March 19 2013)
3D vision system for intelligent milking robot automation
Proceedings of SPIE (February 03 2014)
3D FaceCam a fast and accurate 3D facial imaging...
Proceedings of SPIE (August 25 2004)
Vision system for telerobotics operation
Proceedings of SPIE (October 01 1992)

Back to Top