InSPIRED: single pixel imaging regularized by EBS data

Anthony Giljum; Zachry Theis

doi:10.1117/12.2676398

3 October 2023 InSPIRED: single pixel imaging regularized by EBS data

Anthony Giljum, Zachry Theis

Proceedings Volume 12693, Unconventional Imaging, Sensing, and Adaptive Optics 2023; 126930X (2023) https://doi.org/10.1117/12.2676398
Event: SPIE Optical Engineering + Applications, 2023, San Diego, California, United States

Abstract

Single-pixel cameras (SPCs) and event-based sensors (EBS) are two technologies representing two different yet complementary sensing paradigms. Whereas single-pixel cameras make global measurements, from which local information is inferred, EBS cameras measure only local intensity variations and cannot naturally measure the global light level. In standard SPC systems, local information must be inferred from many global measurements and the total resolution of the camera is limited by the resolution of the random patterns displayed on the DMD. Event Based Sensors, however, measure the outlines of moving objects at a higher spatial resolution than the DMD patterns. By allowing the reconstruction to incorporate this extra edge information, super-resolution with respect to the DMD patterns can be achieved. The same idea holds in the time domain - the EBS camera is able to measure scene changes that occur faster than the DMD pattern display rate. In a traditional SPC, fast scene motion would lead to motion blur. The InSPIRED camera, however, can likely reconstruct crisp, high-framerate video by combining the low-resolution intensity information given by the SPC with the high-resolution edge-information given by the EBS camera. By marrying the sparse sampling of an SPC with the high temporal feature map that results from an EBS we will be able to define a new image sampling technique that will yield the low SWaP-C benefits of each while interrogating scene dynamics in a manner that the fields of compressive sensing and event based sensing cannot accomplish in isolation.

Conference Presentation

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Anthony Giljum and Zachry Theis "InSPIRED: single pixel imaging regularized by EBS data", Proc. SPIE 12693, Unconventional Imaging, Sensing, and Adaptive Optics 2023, 126930X (3 October 2023); https://doi.org/10.1117/12.2676398

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available