16 March 2015 No-reference visual quality assessment for image inpainting
Author Affiliations +
Inpainting has received a lot of attention in recent years and quality assessment is an important task to evaluate different image reconstruction approaches. In many cases inpainting methods introduce a blur in sharp transitions in image and image contours in the recovery of large areas with missing pixels and often fail to recover curvy boundary edges. Quantitative metrics of inpainting results currently do not exist and researchers use human comparisons to evaluate their methodologies and techniques. Most objective quality assessment methods rely on a reference image, which is often not available in inpainting applications. Usually researchers use subjective quality assessment by human observers. It is difficult and time consuming procedure. This paper focuses on a machine learning approach for no-reference visual quality assessment for image inpainting based on the human visual property. Our method is based on observation that Local Binary Patterns well describe local structural information of the image. We use a support vector regression learned on assessed by human images to predict perceived quality of inpainted images. We demonstrate how our predicted quality value correlates with qualitative opinion in a human observer study. Results are shown on a human-scored dataset for different inpainting methods.
© (2015) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
V. V. Voronin, V. V. Voronin, Vladimir A. Frantc, Vladimir A. Frantc, V. I. Marchuk, V. I. Marchuk, A. I. Sherstobitov, A. I. Sherstobitov, K. Egiazarian, K. Egiazarian, "No-reference visual quality assessment for image inpainting", Proc. SPIE 9399, Image Processing: Algorithms and Systems XIII, 93990U (16 March 2015); doi: 10.1117/12.2076507; https://doi.org/10.1117/12.2076507

Back to Top