Performance analysis of a video quality ruler methodology for subjective quality assessment

Pedro Garcia Freitas; Alexandre Fieno Silva; Judith A. Redi; Mylène C. Q. Farias

doi:10.1117/1.JEI.27.5.053020

26 September 2018 Performance analysis of a video quality ruler methodology for subjective quality assessment

Pedro Garcia Freitas, Alexandre Fieno Silva, Judith A. Redi, Mylène C. Q. Farias

Author Affiliations +

Journal of Electronic Imaging, Vol. 27, Issue 5, 053020 (September 2018). https://doi.org/10.1117/1.JEI.27.5.053020

Abstract

Objective video quality metrics are designed to be as reliable as the subjective quality assessments on which they are calibrated and validated. However, existing standard methodologies for subjective video quality assessment provide low reliable results for some conditions. We investigate whether an extension of the quality ruler experimental methodology, originally defined for images and shown to be more reliable than, e.g., standard single stimulus (SS) methods, can be adapted to reliably assess the quality of videos. The video quality ruler methodology allows subjects to assess video quality using a set of reference anchor images (the ruler), spanning a wide range of quality altogether, but closely spaced in function of quality one from the other. Subjects are asked to compare the quality of the displayed test video with the quality of these anchor images, displayed on a tablet, and indicate which of the reference images matches in quality the test video. As a result, the video quality assessment task is reduced to a set of visual comparisons between video and reference image quality. We describe how to adapt the original quality ruler methodology to video quality assessment, and we compare the proposed methodology with two other, widely used experimental methodologies: the single stimulus (SS) and the double stimulus (DS) method. Our results show that video quality ruler is a reliable method to assess video quality according to a multitude of criteria.

Citation Download Citation

Pedro Garcia Freitas, Alexandre Fieno Silva, Judith A. Redi, and Mylène C. Q. Farias "Performance analysis of a video quality ruler methodology for subjective quality assessment," Journal of Electronic Imaging 27(5), 053020 (26 September 2018). https://doi.org/10.1117/1.JEI.27.5.053020

Received: 18 March 2018; Accepted: 28 August 2018; Published: 26 September 2018

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available