CONFERENCE PROCEEDINGS
Advanced Search
Home > Journals > Opt. Eng. > Volume 55 > Issue 7 > Article
Open Access
19 July 2016 Distributed adaptive framework for multispectral/hyperspectral imagery and three-dimensional point cloud fusion
Robert S. Rand, Timothy S. Khuon, Eric Truslow
Author Affiliations +
Optical Engineering, Vol. 55, Issue 7, 073101 (July 2016). https://doi.org/10.1117/1.OE.55.7.073101
Abstract
A proposed framework using spectral and spatial information is introduced for neural net multisensor data fusion. This consists of a set of independent-sensor neural nets, one for each sensor (type of data), coupled to a fusion net. The neural net of each sensor is trained from a representative data set of the particular sensor to map to a hypothesis space output. The decision outputs from the sensor nets are used to train the fusion net to an overall decision. During the initial processing, three-dimensional (3-D) point cloud data (PCD) are segmented using a multidimensional mean-shift algorithm into clustered objects. Concurrently, multiband spectral imagery data (multispectral or hyperspectral) are spectrally segmented by the stochastic expectation–maximization into a cluster map containing (spectral-based) pixel classes. For the proposed sensor fusion, spatial detections and spectral detections complement each other. They are fused into final detections by a cascaded neural network, which consists of two levels of neural nets. The success of the approach in utilizing sensor synergism for an enhanced classification is demonstrated for the specific case of classifying hyperspectral imagery and PCD extracted from LIDAR, obtained from an airborne data collection over the campus of University of Southern Mississippi, Gulfport, Mississippi.
CC BY: © The Authors. Published by SPIE under a Creative Commons Attribution 4.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.
Citation Download Citation
Robert S. Rand, Timothy S. Khuon, and Eric Truslow "Distributed adaptive framework for multispectral/hyperspectral imagery and three-dimensional point cloud fusion," Optical Engineering 55(7), 073101 (19 July 2016). https://doi.org/10.1117/1.OE.55.7.073101
Published: 19 July 2016
JOURNAL ARTICLE
 14 PAGES
DOWNLOAD PAPER SAVE TO MY LIBRARY
GET CITATION
Lens.org Logo
CITATIONS
Cited by 2 scholarly publications.
Advertisement
Advertisement
KEYWORDS
Neural networks
Image segmentation
Sensors
Scanning electron microscopy
LIDAR
Expectation maximization algorithms
Image fusion
RELATED CONTENT
Subscribe to Digital Library
Receive Erratum Email Alert
Back to Top