Robust speckle-autocorrelation non-line-of-sight imaging with generative adversarial networks

Yue Chen; Bo Qu; Xiaoqiang Lu

doi:10.1117/12.2623424

16 February 2022 Robust speckle-autocorrelation non-line-of-sight imaging with generative adversarial networks

Yue Chen, Bo Qu, Xiaoqiang Lu

Proceedings Volume 12083, Thirteenth International Conference on Graphics and Image Processing (ICGIP 2021); 120830B (2022) https://doi.org/10.1117/12.2623424
Event: Thirteenth International Conference on Graphics and Image Processing (ICGIP 2021), 2021, Kunming, China

Abstract

Non-line-of-sight (NLOS) imaging, which utilizes weak photons that diffusely reflect from the visible surfaces (e.g., diffuse walls), can reconstruct hidden objects around the corner. Recently, lots of non-line-of-sight imaging methods have been proposed, such as time-of-flight (ToF)-based methods, coherence-based methods, and intensity-based methods. However, most of these methods are time-consuming for data acquisition and have poor robustness in the reconstruction process. In this paper, the novel application of Generative Adversarial Network is introduced to NLOS imaging. A robust, real-time NLOS imaging method based on autocorrelation mapping Generative Adversarial Network (AMGAN) is proposed, which reconstructs hidden scenes by learning the autocorrelation mapping from speckle-autocorrelation to the hidden target. In order to train the proposed AMGAN, we also analyze the principles of speckle-autocorrelation NLOS imaging and the noise model of the imaging process. Then a speckle-autocorrelation NLOS imaging dataset SANLOS is synthesized in this paper. Finally, our method is compared with other methods based on deep learning quantitatively and qualitatively. The experimental results demonstrate that the proposed approach achieves better NLOS reconstruction quality and is more robust under different exposure times compared with state-of-art methods

Citation Download Citation

Yue Chen, Bo Qu, and Xiaoqiang Lu "Robust speckle-autocorrelation non-line-of-sight imaging with generative adversarial networks", Proc. SPIE 12083, Thirteenth International Conference on Graphics and Image Processing (ICGIP 2021), 120830B (16 February 2022); https://doi.org/10.1117/12.2623424

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
12 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Non-line-of-sight propagation

Speckle imaging

Photons

Speckle pattern

Reconstruction algorithms

Imaging systems

Data modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years