Multitask convolutional neural network for no-reference image quality assessment

Yuge Huang; Xiang Tian; Yaowu Chen; Rongxin Jiang

doi:10.1117/1.JEI.27.6.063033

27 December 2018 Multitask convolutional neural network for no-reference image quality assessment

Yuge Huang, Xiang Tian, Yaowu Chen, Rongxin Jiang

Author Affiliations +

Journal of Electronic Imaging, Vol. 27, Issue 6, 063033 (December 2018). https://doi.org/10.1117/1.JEI.27.6.063033

Abstract

We propose a multitask convolutional neural network (CNN) for general no-reference image quality assessment (NR-IQA). We decompose the task of rating image quality into two subtasks, namely distortion identification and distortion-level estimation, and then combine the results of the two subtasks to obtain a final image quality score. Unlike conventional multitask convolutional networks, wherein only the early layers are shared and the subsequent layers are different for each subtask, our model shares almost all the layers by integrating a dictionary into the CNN. Moreover, it is trained in an end-to-end manner, and all the parameters, including the weights of the convolutional layers and the codewords of the dictionary, are simultaneously learned from the loss function. We test our method on widely used image quality databases and show that its performance is comparable with those of state-of-the-art general-purpose NR-IQA algorithms.

Citation Download Citation

Yuge Huang, Xiang Tian, Yaowu Chen, and Rongxin Jiang "Multitask convolutional neural network for no-reference image quality assessment," Journal of Electronic Imaging 27(6), 063033 (27 December 2018). https://doi.org/10.1117/1.JEI.27.6.063033

Received: 9 June 2018; Accepted: 3 December 2018; Published: 27 December 2018

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available