Divide-and-conquer for holistic and expressive 3D human body reconstruction from a single RGB image

Xiaoliang Ma; Baoyu Liu; Xunyu Liu; Lei Wang; Zhenghua Huang; Jun Cheng

doi:10.1117/12.2623417

16 February 2022 Divide-and-conquer for holistic and expressive 3D human body reconstruction from a single RGB image

Xiaoliang Ma, Baoyu Liu, Xunyu Liu, Lei Wang, Zhenghua Huang, Jun Cheng

Proceedings Volume 12083, Thirteenth International Conference on Graphics and Image Processing (ICGIP 2021); 120831L (2022) https://doi.org/10.1117/12.2623417
Event: Thirteenth International Conference on Graphics and Image Processing (ICGIP 2021), 2021, Kunming, China

Abstract

Despite that 3D human body reconstruction from a single image has obtained rapid progress in recent years, most methods aim at the body without the hands and face. However, hand gestures and facial expressions are also important for delivering human intentions or emotions. This paper proposes a method for holistic 3D reconstruction of the human body from a single RGB image, including hands, body, and face. Our approach is based on the SMPL eXpressive (SMPL-X), a unified 3D parametric human body model of body, hands, and face. Since it is difficult to exactly regress the model's parameters of different body parts by a single framework, we use a divide-and-conquer strategy for the whole human body reconstruction. We exploit different deep neural networks to predict the hand, body, and head model's parameters, then integrate them into an entire 3D model to realize a holistic and expressive 3D human body reconstruction. Simulation results demonstrate that our method has obtained state-of-the-art performance with better facial expression.

Citation Download Citation

Xiaoliang Ma, Baoyu Liu, Xunyu Liu, Lei Wang, Zhenghua Huang, and Jun Cheng "Divide-and-conquer for holistic and expressive 3D human body reconstruction from a single RGB image", Proc. SPIE 12083, Thirteenth International Conference on Graphics and Image Processing (ICGIP 2021), 120831L (16 February 2022); https://doi.org/10.1117/12.2623417

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available