KEYWORDS: RGB color model, Pose estimation, Polarimetry, Polarization, Light sources and illumination, Network architectures, Data modeling, Feature extraction, Deep learning
Object pose estimation is an important problem in the field of remote sensing that provides valuable information for target identification tasks. Polarization is a fundamental property of light that contains useful information about the physical properties of an object, such as shape and surface material properties. Polarization imaging has been shown to have advantages over conventional imaging techniques for object detection and feature extraction in a variety of challenging scenarios, including low light, high background clutter, and low visibility conditions. In this work, we investigate using polarimetric imaging to improve the performance of deep learning approaches to object pose estimation on a range of model target vehicles. We collect polarimetric imaging data and labeled ground truth pose data on the target vehicles in a controlled solar simulation laboratory environment under precise sensor, object, and solar source geometries. We first establish baseline performance of our approach by training our network using conventional visible RGB s0 images under favorable lighting conditions. We then make use of the full linear Stokes images for each color channel in various configurations, retrain our network, and compare performance. We furthermore propose an ensemble method to combine features obtained from convolutional neural networks trained on both conventional RGB and Stokes-vector images. These obtained ensemble features are then used to train a multi-layer perceptron. Experimental results demonstrate that combining polarization imaging with conventional imaging can improve feature extraction and the accuracy of deep learning-based approaches to pose estimation.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.