An improved method based on TwIST and dual-camera design for hyperspectral image reconstruction

Xinyu Liu; Chenning Tao; Qin Xie; Yan Sun; Jinlei Zhang; Qiangbo Zhang; Chang Wang; Zhenrong Zheng

doi:10.1117/12.2601359

15 October 2021 An improved method based on TwIST and dual-camera design for hyperspectral image reconstruction

Xinyu Liu, Chenning Tao, Qin Xie, Yan Sun, Jinlei Zhang, Qiangbo Zhang, Chang Wang, Zhenrong Zheng

Proceedings Volume 11897, Optoelectronic Imaging and Multimedia Technology VIII; 118970T (2021) https://doi.org/10.1117/12.2601359
Event: SPIE/COS Photonics Asia, 2021, Nantong, JS, China

Conference Poster

Abstract

Coded aperture snap shot spectral imager (CASSI) is a potential method to get hyperspectral images. One of the latest designs of CASSI is a dual-camera design, which adds a grayscale camera to capture the same scene. In this paper, an improved method based on two-step iterative shrinkage thresholding algorithms (TwIST) is proposed to utilize the images containing the information of the structure of the objects from the grayscale camera more efficiently. The information come from the auxiliary camera and the CASSI detector is used to construct an estimated 3D hyperspectral data. Then we use TwIST and TV regularization to reconstruct the residual image based on the residual data. The final reconstructed hyperspectral image equals the sum of the estimated image and the reconstruct residual image. This method ensures that the result is more similar to the structure of the original image. The simulation results show that our method improves the image quality of the reconstructed hyperspectral images for all the data we have tried. The simulation results show that our method improves the image quality of the reconstructed hyperspectral images and use less run time compared to the original method. The corresponding peak signal-to-noise ratio (PSNR) is increased by 8.99 dB. The structural similarity (SSIM) is increased by 0.0757. The spectrum angular mapper (SAM) is reduced by 0.1987.

Citation Download Citation

Xinyu Liu, Chenning Tao, Qin Xie, Yan Sun, Jinlei Zhang, Qiangbo Zhang, Chang Wang, and Zhenrong Zheng "An improved method based on TwIST and dual-camera design for hyperspectral image reconstruction", Proc. SPIE 11897, Optoelectronic Imaging and Multimedia Technology VIII, 118970T (15 October 2021); https://doi.org/10.1117/12.2601359

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available