Nonintrusive viewpoint tracking for 3D for perception in smart video conference

Xavier Desurmont; Isabel Martinez-Ponte; Jerome Meessen; Jean-francois Delaigle

doi:10.1117/12.642924

26 January 2006 Nonintrusive viewpoint tracking for 3D for perception in smart video conference

Xavier Desurmont, Isabel Martinez-Ponte, Jerome Meessen, Jean-francois Delaigle

Proceedings Volume 6056, Three-Dimensional Image Capture and Applications VII; 60560C (2006) https://doi.org/10.1117/12.642924
Event: Electronic Imaging 2006, 2006, San Jose, California, United States

Abstract

Globalisation of people's interaction in the industrial world and ecological cost of transport make video-conference an interesting solution for collaborative work. However, the lack of immersive perception makes video-conference not appealing. TIFANIS tele-immersion system was conceived to let users interact as if they were physically together. In this paper, we focus on an important feature of the immersive system: the automatic tracking of the user's point of view in order to render correctly in his display the scene from the ther site. Viewpoint information has to be computed in a very short time and the detection system should be no intrusive, otherwise it would become cumbersome for the user, i.e. he would lose the feeling of "being there". The viewpoint detection system consists of several modules. First, an analysis module identifies and follows regions of interest (ROI) where faces are detected. We will show the cooperative approach between spatial detection and temporal tracking. Secondly, an eye detector finds the position of the eyes within faces. Then, the 3D positions of the eyes are deduced using stereoscopic images from a binocular camera. Finally, the 3D scene is rendered in real-time according to the new point of view.

Citation Download Citation

Xavier Desurmont, Isabel Martinez-Ponte, Jerome Meessen, and Jean-francois Delaigle "Nonintrusive viewpoint tracking for 3D for perception in smart video conference", Proc. SPIE 6056, Three-Dimensional Image Capture and Applications VII, 60560C (26 January 2006); https://doi.org/10.1117/12.642924

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available