RGB-NIR image fusion: metric and psychophysical experiments

Alex E. Hayes; Graham D. Finlayson; Roberto Montagna

doi:10.1117/12.2079224

8 February 2015 RGB-NIR color image fusion: metric and psychophysical experiments

Alex E. Hayes, Graham D. Finlayson, Roberto Montagna

Proceedings Volume 9396, Image Quality and System Performance XII; 93960U (2015) https://doi.org/10.1117/12.2079224
Event: SPIE/IS&T Electronic Imaging, 2015, San Francisco, California, United States

Abstract

In this paper, we compare four methods of fusing visible RGB and near-infrared (NIR) images to produce a color output image, using a psychophysical experiment and image fusion quality metrics. The results of the psychophysical experiment show that two methods are significantly preferred to the original RGB image, and therefore RGB-NIR image fusion may be useful for photographic enhancement in those cases. The Spectral Edge method is the most preferred method, followed by the dehazing method of Schaul et al. We then investigate image fusion metrics which give results correlated with the psychophysical experiment results. We extend several existing metrics from 2 to 1 to M to N channel image fusion, as well as introducing new metrics based on output image colorfulness and contrast, and test them on our experimental data. While none of the individual metrics gives a ranking of the algorithms which exactly matches that of the psychophysical experiment, through a combination of two metrics we accurately rank the two leading fusion methods.

Citation Download Citation

Alex E. Hayes, Graham D. Finlayson, and Roberto Montagna "RGB-NIR color image fusion: metric and psychophysical experiments", Proc. SPIE 9396, Image Quality and System Performance XII, 93960U (8 February 2015); https://doi.org/10.1117/12.2079224

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available