Multifocus image fusion method based on a convolutional neural network

Hao Zhai; Yi Zhuang

doi:10.1117/1.JEI.28.2.023018

20 March 2019 Multifocus image fusion method based on a convolutional neural network

Hao Zhai, Yi Zhuang

Author Affiliations +

Journal of Electronic Imaging, Vol. 28, Issue 2, 023018 (March 2019). https://doi.org/10.1117/1.JEI.28.2.023018

Abstract

The aim of multifocus image fusion technology is to produce an all-in-focus image, in which clear parts of different source images are integrated to a single image. Traditional image fusion methods usually suffer from some problems, such as block artifacts, artificial edges, halo effects, contrast reduction, and sharpness reduction. To address these problems, a multifocus image fusion method based on a convolutional neural network (CNN) is proposed. First, the CNN is trained using a large number of multifocus image samples to obtain a model that can correctly distinguish between clear and blurred pixels. Then the sharpness of the image to be detected is predicted using the model to form a focus map. After small-region filtering and guided filtering, a final decision map is formed. Finally, the multifocus source images are fused into a fully focused image according to the final decision map. Experimental results show that the proposed image fusion method outperforms other ones in terms of visual effects and objective evaluation.

Citation Download Citation

Hao Zhai and Yi Zhuang "Multifocus image fusion method based on a convolutional neural network," Journal of Electronic Imaging 28(2), 023018 (20 March 2019). https://doi.org/10.1117/1.JEI.28.2.023018

Received: 1 November 2018; Accepted: 1 March 2019; Published: 20 March 2019

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available