3D patch-based multi-view stereo for high-resolution imagery

Shizeng Yao; Hadi AliAkbarpour; Guna Seetharaman; Kannappan Palaniappan

doi:10.1117/12.2309806

Translator Disclaimer

27 April 2018 3D patch-based multi-view stereo for high-resolution imagery

Shizeng Yao; Hadi AliAkbarpour; Guna Seetharaman; Kannappan Palaniappan

Author Affiliations +

Proceedings Volume 10645, Geospatial Informatics, Motion Imagery, and Network Analytics VIII; 106450K (2018) https://doi.org/10.1117/12.2309806
Event: SPIE Defense + Security, 2018, Orlando, Florida, United States

Abstract

This paper proposes an improved solution to image-based three-dimensional (3D) modeling (also known as ”multi-view stereo”) that outputs surfaces visible in high-resolution wide-area format video also known as widearea motion imagery (WAMI) consisting of a dense set of small 3D points. The improved approach, named 3D patch-based multi-view stereo, is an expansion of PMVS¹ and is implemented also as a match, expand, and filter procedure. This approach takes a sequence of image frames and corresponding camera parameters together with a sparse set of matched feature points. As an initial step, it formulates a small 3D patch for each of the matched feature points. It then finds the best fitted curved surface inside the 3D patch based on the photometric consistency of each 3D point inside. Expansion and filtering procedures are then recursively applied on those initial surfaces until a certain percentage of image coverage is achieved. The proposed solution is able to precisely preserve small details and automatically detect and discard outliers. Moreover this approach does not require any initialization in the form of a visual hull, a bounding box, or valid depth ranges. We have tested our algorithm on various data sets including single object with fine surface details, and outdoor occluded extremely large WAMI dataset, where moving or static obstacles appear in front of static structures of interest and large areas of repetitive texture are present.

Citation Download Citation

Shizeng Yao, Hadi AliAkbarpour, Guna Seetharaman, and Kannappan Palaniappan "3D patch-based multi-view stereo for high-resolution imagery", Proc. SPIE 10645, Geospatial Informatics, Motion Imagery, and Network Analytics VIII, 106450K (27 April 2018); https://doi.org/10.1117/12.2309806