Translator Disclaimer
12 June 2020 Image-to-image translation based face de-occlusion
Author Affiliations +
Proceedings Volume 11519, Twelfth International Conference on Digital Image Processing (ICDIP 2020); 115191A (2020) https://doi.org/10.1117/12.2573031
Event: Twelfth International Conference on Digital Image Processing, 2020, Osaka, Japan
Abstract
Existing deep learning-based object removal methods produce plausible results. However, they generate unsatisfactory results when the object is large, especially in facial images due to the lack of information about the affected region. Most of these methods rely on the object information in terms of a binary segmentation map which is insufficient to provide information about the face boundary and semantics symmetric relation. To address the problem, we propose a two-stage GAN-based image-to-image translation method that exploits the face semantic segmentation instead of the binary segmentation map of the object. Specifically, our model learns a complete facial segmentation map from an input image (face image with unwanted object) in the first stage and translates that generated semantic segmentation map combined with input image into a plausible face image without the object. We also exploit the joint loss function that consists of low-level loss, adversarial loss, and perceptual loss to produce semantically realistic facial images. Experimental results show that our method outperforms previous state-of-the-art methods both quantitatively and qualitatively.
© (2020) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Rahul S. Maharjan, Nizam Ud Din, and Juneho Yi "Image-to-image translation based face de-occlusion", Proc. SPIE 11519, Twelfth International Conference on Digital Image Processing (ICDIP 2020), 115191A (12 June 2020); https://doi.org/10.1117/12.2573031
PROCEEDINGS
8 PAGES


SHARE
Advertisement
Advertisement
RELATED CONTENT


Back to Top