25 February 2014 Edge preserving motion estimation with occlusions correction for assisted 2D to 3D conversion
Author Affiliations +
In this article we propose high quality motion estimation based on variational optical flow formulation with non-local regularization term. To improve motion in occlusion areas we introduce occlusion motion inpainting based on 3-frame motion clustering. Variational formulation of optical flow proved itself to be very successful, however a global optimization of cost function can be time consuming. To achieve acceptable computation times we adapted the algorithm that optimizes convex function in coarse-to-fine pyramid strategy and is suitable for modern GPU hardware implementation. We also introduced two simplifications of cost function that significantly decrease computation time with acceptable decrease of quality. For motion clustering based motion inpaitning in occlusion areas we introduce effective method of occlusion aware joint 3-frame motion clustering using RANSAC algorithm. Occlusion areas are inpainted by motion model taken from cluster that shows consistency in opposite direction. We tested our algorithm on Middlebury optical flow benchmark, where we scored around 20th position, but being one of the fastest method near the top. We also successfully used this algorithm in semi-automatic 2D to 3D conversion tool for spatio-temporal background inpainting, automatic adaptive key frame detection and key points tracking.
© (2014) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Petr Pohl, Petr Pohl, Michael Sirotenko, Michael Sirotenko, Ekaterina Tolstaya, Ekaterina Tolstaya, Victor Bucha, Victor Bucha, "Edge preserving motion estimation with occlusions correction for assisted 2D to 3D conversion", Proc. SPIE 9019, Image Processing: Algorithms and Systems XII, 901906 (25 February 2014); doi: 10.1117/12.2039674; https://doi.org/10.1117/12.2039674

Back to Top