3D surface reconstruction based on image stitching from gastric endoscopic video sequence

Mengyao Duan; Rong Xu; Jun Ohya

doi:10.1117/12.2022531

26 September 2013 3D surface reconstruction based on image stitching from gastric endoscopic video sequence

Mengyao Duan, Rong Xu, Jun Ohya

Proceedings Volume 8856, Applications of Digital Image Processing XXXVI; 88561I (2013) https://doi.org/10.1117/12.2022531
Event: SPIE Optical Engineering + Applications, 2013, San Diego, California, United States

Abstract

This paper proposes a method for reconstructing 3D detailed structures of internal organs such as gastric wall from endoscopic video sequences. The proposed method consists of the four major steps: Feature-point-based 3D reconstruction, 3D point cloud stitching, dense point cloud creation and Poisson surface reconstruction. Before the first step, we partition one video sequence into groups, where each group consists of two successive frames (image pairs), and each pair in each group contains one overlapping part, which is used as a stitching region. Fist, the 3D point cloud of each group is reconstructed by utilizing structure from motion (SFM). Secondly, a scheme based on SIFT features registers and stitches the obtained 3D point clouds, by estimating the transformation matrix of the overlapping part between different groups with high accuracy and efficiency. Thirdly, we select the most robust SIFT feature points as the seed points, and then obtain the dense point cloud from sparse point cloud via a depth testing method presented by Furukawa. Finally, by utilizing Poisson surface reconstruction, polygonal patches for the internal organs are obtained. Experimental results demonstrate that the proposed method achieves a high accuracy and efficiency for 3D reconstruction of gastric surface from an endoscopic video sequence.

Citation Download Citation

Mengyao Duan, Rong Xu, and Jun Ohya "3D surface reconstruction based on image stitching from gastric endoscopic video sequence", Proc. SPIE 8856, Applications of Digital Image Processing XXXVI, 88561I (26 September 2013); https://doi.org/10.1117/12.2022531

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available