Relationship of subjective ratings of image quality and observer performance

Howard E. Rockette; Christopher M. Johns; Jane L. Weissman; J. Michael Holbert; Jules H. Sumkin M.D.; Jill L. King; David Gur

doi:10.1117/12.271287

16 April 1997 Relationship of subjective ratings of image quality and observer performance

Howard E. Rockette, Christopher M. Johns, Jane L. Weissman, J. Michael Holbert, Jules H. Sumkin M.D., Jill L. King, David Gur

Author Affiliations +

Proceedings Volume 3036, Medical Imaging 1997: Image Perception; (1997) https://doi.org/10.1117/12.271287
Event: Medical Imaging 1997, 1997, Newport Beach, CA, United States

Abstract

The relationship between radiologists' perception of image quality and their actual performance was assessed. If the two variables are strongly correlated, the easier obtained perception of quality index might be used as a prerequisite test to determine if a ROC study is justified. One-hundred seventy cases were evaluated for the presence or absence of interstitial disease and nodules by nine readers using seven display modes. Each reader also assigned each image a mode- specific perceived quality rating using a 5-category ordinal scale. Average perceived quality was highest for conventional film. It was slightly poorer for the subsets of cases with interstitial disease and for cases classified independently as 'subtle.' Trend tests indicated a relationship between area under the ROC curves (A_z) and perceived image quality for nodules. For interstitial disease, the relationship was weaker and of borderline statistical significance. The subjective image quality index was related to the area under the ROC curve, but the average difference between pairs of display modes was not a good predictor of difference in actual observer performances. A subjective quality index may have limited usefulness in screening differences between modalities prior to the performance of a ROC study.

Citation Download Citation

Howard E. Rockette, Christopher M. Johns, Jane L. Weissman, J. Michael Holbert, Jules H. Sumkin M.D., Jill L. King, and David Gur "Relationship of subjective ratings of image quality and observer performance", Proc. SPIE 3036, Medical Imaging 1997: Image Perception, (16 April 1997); https://doi.org/10.1117/12.271287

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available