Temporally coherent 3D video sequence analysis and modeling

Andreas C. Kopernik; W. Tuleweit; S. Wagenbreth

doi:10.1117/12.233306

27 February 1996 Temporally coherent 3D video sequence analysis and modeling

Andreas C. Kopernik, W. Tuleweit, S. Wagenbreth

Proceedings Volume 2727, Visual Communications and Image Processing '96; (1996) https://doi.org/10.1117/12.233306
Event: Visual Communications and Image Processing '96, 1996, Orlando, FL, United States

Abstract

This paper covers two modules of an analysis-synthesis-chain for 3D video that were optimized to support a more consistent temporal scene modeling. In a first section it addresses the disparity analysis of the scene, and in a second section the synthesis of a 3D adapted wireframe representing the visual scene surface based on the previous disparity analysis results. The assumption of parallel stereo camera axes, or the rectification of the stereo images prior to analysis, allows the application of stereopsis constraints such as uniqueness and ordering and the focus on single image scanlines for correspondence analysis. This led to the development of dynamic programming search algorithms for the ordering of the scanline matching results during the disparity estimation process, either region-based or feature-based. The approach presented in this paper expands the focus of the ordering method from the single scanline to a neighborhood region and combines this with a temporal recursion in order to include as much information as possible already in the ordering process before starting the disparity diffusion. The wireframe approximation of the visual surface of 3D video traditionally starts with a 2D network construction based on the projection of the segmented surface labels into the image plane. The 3D adaptation of this network is performed afterwards resulting in certain image regions into a degeneration of the mesh that cannot be controlled. In the second section of this paper for this reason an algorithm is suggested that performs the 3D triangulation directly in 3D space based on the 3D visual surface in order to achieve maximum regularity of the wireframe.

Citation Download Citation

Andreas C. Kopernik, W. Tuleweit, and S. Wagenbreth "Temporally coherent 3D video sequence analysis and modeling", Proc. SPIE 2727, Visual Communications and Image Processing '96, (27 February 1996); https://doi.org/10.1117/12.233306

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

3D modeling

Video

Visualization

Image segmentation

3D image processing

3D visualizations

Algorithm development

Show All Keywords

Keywords/Phrases

Search In:

Publication Years