21 December 2000 Error simulation of paired-comparison-based scaling methods
Author Affiliations +
Subjective image quality measurement usually resorts to psycho physical scaling. However, it is difficult to evaluate the inherent precision of these scaling methods. Without knowing the potential errors of the measurement, subsequent use of the data can be misleading. In this paper, the errors on scaled values derived form paired comparison based scaling methods are simulated with randomly introduced proportion of choice errors that follow the binomial distribution. Simulation results are given for various combinations of the number of stimuli and the sampling size. The errors are presented in the form of average standard deviation of the scaled values and can be fitted reasonably well with an empirical equation that can be sued for scaling error estimation and measurement design. The simulation proves paired comparison based scaling methods can have large errors on the derived scaled values when the sampling size and the number of stimuli are small. Examples are also given to show the potential errors on actually scaled values of color image prints as measured by the method of paired comparison.
© (2000) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Chengwu Cui, "Error simulation of paired-comparison-based scaling methods", Proc. SPIE 4300, Color Imaging: Device-Independent Color, Color Hardcopy, and Graphic Arts VI, (21 December 2000); doi: 10.1117/12.410820; https://doi.org/10.1117/12.410820


Toward quantifying the amount of style in a dataset
Proceedings of SPIE (January 16 2006)
In search of Leonardo computer based facial image analysis...
Proceedings of SPIE (February 20 2012)
Jackknife free-response ROC methodology
Proceedings of SPIE (May 04 2004)
Anchored paired comparisons
Proceedings of SPIE (January 28 2008)

Back to Top