Deep visual-semantic for crowded video understanding

Chunhua Deng; Junwen Zhang

doi:10.1117/12.2285848

8 March 2018 Deep visual-semantic for crowded video understanding

Chunhua Deng, Junwen Zhang

Proceedings Volume 10609, MIPPR 2017: Pattern Recognition and Computer Vision; 106091E (2018) https://doi.org/10.1117/12.2285848
Event: Tenth International Symposium on Multispectral Image Processing and Pattern Recognition (MIPPR2017), 2017, Xiangyang, China

Abstract

Visual-semantic features play a vital role for crowded video understanding. Convolutional Neural Networks (CNNs) have experienced a significant breakthrough in learning representations from images. However, the learning of visualsemantic features, and how it can be effectively extracted for video analysis, still remains a challenging task. In this study, we propose a novel visual-semantic method to capture both appearance and dynamic representations. In particular, we propose a spatial context method, based on the fractional Fisher vector (FV) encoding on CNN features, which can be regarded as our main contribution. In addition, to capture temporal context information, we also applied fractional encoding method on dynamic images. Experimental results on the WWW crowed video dataset demonstrate that the proposed method outperform the state of the art.

Citation Download Citation

Chunhua Deng and Junwen Zhang " Deep visual-semantic for crowded video understanding", Proc. SPIE 10609, MIPPR 2017: Pattern Recognition and Computer Vision, 106091E (8 March 2018); https://doi.org/10.1117/12.2285848

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
5 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Video

Visualization

Video surveillance

Computer programming

Nonlinear filtering

Feature extraction

Convolution

Show All Keywords

Keywords/Phrases

Search In:

Publication Years