Multimodel fusion method via sparse representation at pixel-level and feature-level

Shuai Zhang; Bingqi Liu; Fuyu Huang

doi:10.1117/1.OE.58.6.063105

17 June 2019 Multimodel fusion method via sparse representation at pixel-level and feature-level

Shuai Zhang, Bingqi Liu, Fuyu Huang

Author Affiliations +

Optical Engineering, Vol. 58, Issue 6, 063105 (June 2019). https://doi.org/10.1117/1.OE.58.6.063105

Abstract

In current fusion methods based on sparse representation (SR) and different frequency, the SR is usually applied to fusion of the low-frequency components. In contrast, the direct fusion is usually adopted for high-frequency components due to their significant diversity. However, the effect of the direct fusion is degraded by the redundant information resulting from the correlation between original signals. A multimodel fusion framework is proposed by applying the SR to low-frequency fusion at pixel-level and high-frequency fusion at feature-level, respectively. First, the multimodal images are decomposed into high-frequency and low-frequency components by nonsubsampled contourlet transform (NSCT). Second, the universal high-frequency dictionary is constructed by using the fast independent component analysis (ICA) of the source high-frequency and its subband images. They represent the general feature part and unique feature part for the high-frequency signals, respectively. The universal low-frequency dictionary is constructed by using the original low-frequency signals. Third, the direct fusion of the high-frequency is converted into sparse coefficients fusion in fast ICA domain. Moreover, the multiple directive contrasts by modifying sum-modified Laplacian are taken as the fusion rule. The low-frequency signals are fused by using an activity measure based on weights. Finally, the fused image is obtained by inverse NSCT on the merged components. The experiments are conducted on three types of image pairs, and the results demonstrate that the proposed method outperforms seven state-of-the-art methods, in terms of four subjective and objective evaluations.

Citation Download Citation

Shuai Zhang, Bingqi Liu, and Fuyu Huang "Multimodel fusion method via sparse representation at pixel-level and feature-level," Optical Engineering 58(6), 063105 (17 June 2019). https://doi.org/10.1117/1.OE.58.6.063105

Received: 19 February 2019; Accepted: 30 May 2019; Published: 17 June 2019

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available