Unsupervised generation of artistic representations

Roman Steinberg; Sergey Kastryulin

doi:10.1117/12.2557111

31 January 2020 Unsupervised generation of artistic representations

Roman Steinberg, Sergey Kastryulin

Proceedings Volume 11433, Twelfth International Conference on Machine Vision (ICMV 2019); 114332U (2020) https://doi.org/10.1117/12.2557111
Event: Twelfth International Conference on Machine Vision, 2019, Amsterdam, Netherlands

Abstract

While deep neural networks excel at a variety of visual tasks, obtaining large quantities of labeled data remains exorbitantly expensive or time-consuming, especially when it comes to pairs of photos and their artistic representations. To overcome the burden of annotation, various solutions exploiting the unlabeled data have been proposed recently. In this paper, we present a novel approach to the unsupervised domain adaptation problem, allowing us to successfully generate avatars from photos. Assembling a system of several neural networks, including a Generative Adversarial Network (GAN), fully trained on unlabeled data, we researched the influence of various factors on the GAN training process and eventually built a system superior to current analogues. In contrast to the existing unsupervised domain adaption approaches, the proposed solution is highly flexible, which allows tuning of individual elements of the system to achieve different visual results. During the user study, we evaluated the performance of the proposed method and found results close to the human level quality.

Citation Download Citation

Roman Steinberg and Sergey Kastryulin "Unsupervised generation of artistic representations", Proc. SPIE 11433, Twelfth International Conference on Machine Vision (ICMV 2019), 114332U (31 January 2020); https://doi.org/10.1117/12.2557111

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available