Two-stream deep representation for human action recognition

Najla Bouarada Ghrab; Emna Fendri; Mohamed Hammami

doi:10.1117/12.2623121

4 March 2022 Two-stream deep representation for human action recognition

Najla Bouarada Ghrab, Emna Fendri, Mohamed Hammami

Proceedings Volume 12084, Fourteenth International Conference on Machine Vision (ICMV 2021); 1208410 (2022) https://doi.org/10.1117/12.2623121
Event: Fourteenth International Conference on Machine Vision (ICMV 2021), 2021, Rome, Italy

Abstract

Human action recognition has received a lot of attention in computer vision community given its interest in many real applications. In this paper, we proposed a new method for human action recognition based on deep learning methods. The main contribution of the proposed method is an efficient combination of two Convolutional neural networks. The two-stream framework allows to fully utilize the rich multimodal information in videos. In fact, we explored the complementarity between appearance information and motion information to represent human actions. Specifically, we suggested a spatial Convolutional Neural Network performed on still individual images to model spatial information. To exploit motion between frames, a second Convolutional Neural Network is processed on accumulated optical flow images obtained by stacking the optical flow estimations between consecutive frames in a single image. Then, a fusion score is performed between the two Convolutional Neural Networks to achieve the appropriate class. In order to prove the performance of our method, we trained and evaluated our architecture on a standard human actions benchmark, the Weizmann dataset.

Citation Download Citation

Najla Bouarada Ghrab, Emna Fendri, and Mohamed Hammami "Two-stream deep representation for human action recognition", Proc. SPIE 12084, Fourteenth International Conference on Machine Vision (ICMV 2021), 1208410 (4 March 2022); https://doi.org/10.1117/12.2623121

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Video

Convolutional neural networks

Optical flow

Feature extraction

Video surveillance

Image fusion

Motion models

Show All Keywords

Keywords/Phrases

Search In:

Publication Years