Short wave infrared (SWIR) sensors are becoming more common in DoD imaging systems because of their haze penetration capabilities and spectral properties of materials in this waveband. Typical SWIR systems have provided either full motion video (FMV) with framing panchromatic systems or multi-spectral or hyperspectral imagery with line-scanning systems. The system described here bridges these modalities, providing FMV with nine discrete spectral bands. Nine pixel sized SWIR filters are arranged in a repeating 3x3 pattern and mounted on top of a COTS, 2D staring focal plane array (FPA). We characterize the spectral response of the filter and integrated sensor. Spot-scan measurements and data collected with this camera using narrow band sources reveals crosstalk induced nonlinearity in the sensor response. We demonstrate a simple approach to reduce the impact of this nonlinearity on collected imagery.
Short wave infrared (SWIR) spectral imaging systems are vital for Intelligence, Surveillance, and Reconnaissance (ISR)
applications because of their abilities to autonomously detect targets and classify materials. Typically the spectral
imagers are incapable of providing Full Motion Video (FMV) because of their reliance on line scanning. We enable
FMV capability for a SWIR multi-spectral camera by creating a repeating pattern of 3x3 spectral filters on a staring focal
plane array (FPA). In this paper we present the imagery from an FMV SWIR camera with nine discrete bands and
discuss image processing algorithms necessary for its operation. The main task of image processing in this case is
demosaicking of the spectral bands i.e. reconstructing full spectral images with original FPA resolution from spatially
subsampled and incomplete spectral data acquired with the choice of filter array pattern. To the best of author's
knowledge, the demosaicking algorithms for nine or more equally sampled bands have not been reported before.
Moreover all existing algorithms developed for demosaicking visible color filter arrays with less than nine colors assume
either certain relationship between the visible colors, which are not valid for SWIR imaging, or presence of one color
band with higher sampling rate compared to the rest of the bands, which does not conform to our spectral filter pattern.
We will discuss and present results for two novel approaches to demosaicking: interpolation using multi-band edge
information and application of multi-frame super-resolution to a single frame resolution enhancement of multi-spectral
spatially multiplexed images.