Human action recognition using a Markovian conditional exponential model

Atulya Velivelli; Alexander G. Hauptmann

doi:10.1117/12.907309

9 February 2012 Human action recognition using a Markovian conditional exponential model

Atulya Velivelli, Alexander G. Hauptmann

Proceedings Volume 8304, Multimedia on Mobile Devices 2012; and Multimedia Content Access: Algorithms and Systems VI; 83040X (2012) https://doi.org/10.1117/12.907309
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

We model the sequence of human actions operating an infusion pump using a Markovian conditional exponential model. We divide each video recorded by a camera into video action units. A video action unit corresponds to the start of a unique human action operation of the infusion pump to the end of that human action operating an infusion pump. We calculate the MOSIFT features of video action units which combines the spatial and temporal dimensions from videos. We vector quantize the MOSIFT features of video action units using K means clustering as video codebook elements. We estimate the conditional exponential model parameters from a training set using maximum entropy constraint and use the video codebook elements as maximum entropy constraint features. We estimate the parameters of the Markovian conditional exponential model from a training set. This Markovian conditional exponential model has 6 states which correspond to the 6 classes of infusion pump operation. To find the optimal state sequence of the Markovian conditional exponential model we use the Viterbi algorithm. This optimal state sequence corresponds to the class label sequence. The infusion pump operation is recorded from 4 video cameras. We calculate the results of classification of 6 classes of infusion pump operation using the conditional exponential model for the 4 video cameras and also we calculate the results of of classification of 6 classes of infusion pump operation using the Markovian conditional exponential model for the 4 video cameras. The classification performance of the Markovian conditional exponential model is better than the classification performance of conditional exponential model.

Citation Download Citation

Atulya Velivelli and Alexander G. Hauptmann "Human action recognition using a Markovian conditional exponential model", Proc. SPIE 8304, Multimedia on Mobile Devices 2012; and Multimedia Content Access: Algorithms and Systems VI, 83040X (9 February 2012); https://doi.org/10.1117/12.907309

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available