14 May 2018 Hardware based spatio-temporal neural processing backend for imaging sensors: towards a smart camera
Author Affiliations +
Abstract
In this work we show how we can build a technology platform for cognitive imaging sensors using recent advances in recurrent neural network architectures and training methods inspired from biology. We demonstrate learning and processing tasks specific to imaging sensors, including enhancement of sensitivity and signal-to-noise ratio (SNR) purely through neural filtering beyond the fundamental limits sensor materials, and inferencing and spatio-temporal pattern recognition capabilities of these networks with applications in object detection, motion tracking and prediction. We then show designs of unit hardware cells built using complementary metal-oxide semiconductor (CMOS) and emerging materials technologies for ultra-compact and energy-efficient embedded neural processors for smart cameras.
Conference Presentation
© (2018) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Samiran Ganguly, Samiran Ganguly, Yunfei Gu, Yunfei Gu, Mircea R. Stan, Mircea R. Stan, Avik W. Ghosh, Avik W. Ghosh, } "Hardware based spatio-temporal neural processing backend for imaging sensors: towards a smart camera", Proc. SPIE 10656, Image Sensing Technologies: Materials, Devices, Systems, and Applications V, 106560Z (14 May 2018); doi: 10.1117/12.2305137; https://doi.org/10.1117/12.2305137
PROCEEDINGS
11 PAGES + PRESENTATION

SHARE
Back to Top