23 September 2014 Crowdsourcing evaluation of high dynamic range image compression
Author Affiliations +
Abstract
Crowdsourcing is becoming a popular cost effective alternative to lab-based evaluations for subjective quality assessment. However, crowd-based evaluations are constrained by the limited availability of display devices used by typical online workers, which makes the evaluation of high dynamic range (HDR) content a challenging task. In this paper, we investigate the feasibility of using low dynamic range versions of original HDR content obtained with tone mapping operators (TMOs) in crowdsourcing evaluations. We conducted two crowdsourcing experiments by employing workers from Microworkers platform. In the first experiment, we evaluate five HDR images encoded at different bit rates with the upcoming JPEG XT coding standard. To find best suitable TMO, we create eleven tone-mapped versions of these five HDR images by using eleven different TMOs. The crowdsourcing results are compared to a reference ground truth obtained via a subjective assessment of the same HDR images on a Dolby `Pulsar' HDR monitor in a laboratory environment. The second crowdsourcing evaluation uses semantic differentiators to better understand the characteristics of eleven different TMOs. The crowdsourcing evaluations show that some TMOs are more suitable for evaluation of HDR image compression.
© (2014) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Philippe Hanhart, Philippe Hanhart, Pavel Korshunov, Pavel Korshunov, Touradj Ebrahimi, Touradj Ebrahimi, "Crowdsourcing evaluation of high dynamic range image compression", Proc. SPIE 9217, Applications of Digital Image Processing XXXVII, 92170D (23 September 2014); doi: 10.1117/12.2065560; https://doi.org/10.1117/12.2065560
PROCEEDINGS
12 PAGES


SHARE
Back to Top