No-reference video quality assessment based on perceptual features extracted from multi-directional video spatiotemporal slices images

Peng Yan; Xuanqin Mou

doi:10.1117/12.2503149

8 November 2018 No-reference video quality assessment based on perceptual features extracted from multi-directional video spatiotemporal slices images

Peng Yan, Xuanqin Mou

Author Affiliations +

Proceedings Volume 10817, Optoelectronic Imaging and Multimedia Technology V; 108171D (2018) https://doi.org/10.1117/12.2503149
Event: SPIE/COS Photonics Asia, 2018, Beijing, China

Abstract

As video applications become more popular, no-reference video quality assessment (NR-VQA) has become a focus of research. In many existing NR-VQA methods, perceptual feature extraction is often the key to success. Therefore, we design methods to extract the perceptual features that contain a wider range of spatiotemporal information from multidirectional video spatiotemporal slices (STS) images (the images generated by cutting video data parallel to temporal dimension in multiple directions) and use support vector machine (SVM) to perform a successful NR video quality evaluation in this paper. In the proposed NR-VQA design, we first extracted the multi-directional video STS images to obtain as much as possible the overall video motion representation. Secondly, the perceptual features of multi-directional video STS images such as the moments of feature maps, joint distribution features from the gradient magnitude and filtering response of Laplacian of Gaussian, and motion energy characteristics were extracted to characterize the motion statistics of videos. Finally, the extracted perceptual features were fed in SVM or multilayer perceptron (MLP) to perform training and testing. And the experimental results show that the proposed method has achieved the state-of-theart quality prediction performance on the largest existing annotated video database.

Citation Download Citation

Peng Yan and Xuanqin Mou "No-reference video quality assessment based on perceptual features extracted from multi-directional video spatiotemporal slices images", Proc. SPIE 10817, Optoelectronic Imaging and Multimedia Technology V, 108171D (8 November 2018); https://doi.org/10.1117/12.2503149

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available