An example-based face relighting

Hyunjung Shim; Tsuhan Chen

doi:10.1117/12.908480

8 February 2012 An example-based face relighting

Hyunjung Shim, Tsuhan Chen

Proceedings Volume 8289, The Engineering Reality of Virtual Reality 2012; 82890B (2012) https://doi.org/10.1117/12.908480
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

In this paper, we propose a new face relighting algorithm powered by a large database of face images captured under various known lighting conditions (a Multi-PIE database). Key insight of our algorithm is that a face can be represented by an assemble of patches from many other faces. The algorithm finds the most similar face patches in the database in terms of the lighting and the appearance. By assembling the matched patches, we can visualize the input face under various lighting conditions. Unlike existing face relighting algorithms, we neither use any kinds of face model nor make a physical assumption. Instead, our algorithm is a data-driven approach, synthesizing the appearance of the image patch using the appearance of the example patch. Using a data-driven approach, we can account for various intrinsic facial features including the non-Lambertian skin properties as well as the hair. Also, our algorithm is insensitive to the face misalignment. We demonstrate the performance of our algorithm by face relighting and face recognition experiments. Especially, the synthesized results show that the proposed algorithm can successfully handle various intrinsic features of an input face. Also, from the face recognition experiment, we show that our method is comparable to the most recent face relighting work.

Citation Download Citation

Hyunjung Shim and Tsuhan Chen "An example-based face relighting", Proc. SPIE 8289, The Engineering Reality of Virtual Reality 2012, 82890B (8 February 2012); https://doi.org/10.1117/12.908480

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available