Free-viewpoint image generation from a video captured by a handheld camera

Kota Takeuchi; Norishige Fukushima; Tomohiro Yendo; Mehrdad Panahpour Tehrani; Toshiaki Fujii; Masayuki Tanimoto

doi:10.1117/12.872292

Translator Disclaimer

15 February 2011 Free-viewpoint image generation from a video captured by a handheld camera

Kota Takeuchi; Norishige Fukushima; Tomohiro Yendo; Mehrdad Panahpour Tehrani; Toshiaki Fujii; Masayuki Tanimoto

Author Affiliations +

Proceedings Volume 7863, Stereoscopic Displays and Applications XXII; 78631N (2011) https://doi.org/10.1117/12.872292
Event: IS&T/SPIE Electronic Imaging, 2011, San Francisco Airport, California, United States

Abstract

In general, free-viewpoint image is generated by captured images by a camera array aligned on a straight line or circle. A camera array is able to capture synchronized dynamic scene. However, camera array is expensive and requires great care to be aligned exactly. In contrast to camera array, a handy camera is easily available and can capture a static scene easily. We propose a method that generates free-viewpoint images from a video captured by a handheld camera in a static scene. To generate free-viewpoint images, view images from several viewpoints and information of camera pose/positions of these viewpoints are needed. In a previous work, a checkerboard pattern has to be captured in every frame to calculate these parameters. And in another work, a pseudo perspective projection is assumed to estimate parameters. This assumption limits a camera movement. However, in this paper, we can calculate these parameters by "Structure From Motion". Additionally, we propose a selection method for reference images from many captured frames. And we propose a method that uses projective block matching and graph-cuts algorithm with reconstructed feature points to estimate a depth map of a virtual viewpoint.

Citation Download Citation

Kota Takeuchi, Norishige Fukushima, Tomohiro Yendo, Mehrdad Panahpour Tehrani, Toshiaki Fujii, and Masayuki Tanimoto "Free-viewpoint image generation from a video captured by a handheld camera", Proc. SPIE 7863, Stereoscopic Displays and Applications XXII, 78631N (15 February 2011); https://doi.org/10.1117/12.872292

ACCESS THE FULL ARTICLE