Robust human action recognition based on depth motion maps and improved convolutional neural network

Linqin Cai; Xiaolin Liu; Fuli Chen; Min Xiang

doi:10.1117/1.JEI.27.5.051218

28 April 2018 Robust human action recognition based on depth motion maps and improved convolutional neural network

Linqin Cai, Xiaolin Liu, Fuli Chen, Min Xiang

Author Affiliations +

Journal of Electronic Imaging, Vol. 27, Issue 5, 051218 (April 2018). https://doi.org/10.1117/1.JEI.27.5.051218

Abstract

Human action recognition has been widely used in various fields of computer vision, pattern recognition, and human–computer interaction and has attracted substantial attention. Combining deep learning and depth information, this paper proposed a method of human action recognition based on improved convolutional neural networks (CNN). First, we use the depth motion maps to extract the depth sequence features and obtain three projected maps corresponding to front, side, and the top views. On this basis, an improved CNN is constructed to realize the recognition of human action, which uses three-dimensional (3-D) input and two-dimensional process identification to speed up the computation and reduce the complexity of recognition process. We evaluate our approach on two public 3-D action datasets: MSR Action3D dataset and UT-Kinect dataset, and our private CTP Action3D dataset built using Kinect to collect data. The experimental results show that the proposed methods of human action recognition achieve higher average recognition rate of 91.3% on MSR Action3D dataset, 97.98% on UT-Kinect dataset, and the average recognition rate is 93.8% on our CTP Action3D dataset. Furthermore, the trained model on one depth video sequence dataset can be easily generalized to different datasets without changing network parameters.

Citation Download Citation

Linqin Cai, Xiaolin Liu, Fuli Chen, and Min Xiang "Robust human action recognition based on depth motion maps and improved convolutional neural network," Journal of Electronic Imaging 27(5), 051218 (28 April 2018). https://doi.org/10.1117/1.JEI.27.5.051218

Received: 8 January 2018; Accepted: 10 April 2018; Published: 28 April 2018

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available