At present, most of the deep learning target detection methods based on multimodal information fusion are integrated, which makes the fusion image quality cannot be directly controlled. It is not conducive to strengthening the target detection of the network in principle. A multimodal information fusion detection method based on generative countermeasure network (FusionGAN-Detection) is proposed, which is composed of GAN and a target detection network. Aiming at the uncontrollability and blindness of existing information fusion detection algorithms, the new method introduces generative countermeasure network for information fusion. It uses loss function and dual discriminator to provide controllable guidance for generator. In the process of information fusion using GAN, the loss function of traditional thought can extract the information which is beneficial to target recognition to the maximum extent, and avoid the loss of channel information. The detector acts as a discriminator during the training process to guide image fusion and promote the improvement of image quality. Meanwhile, it acts as a target detector for target detection during testing. In order to verify the effectiveness of the method, KITTI data sets are used for training and testing. The experimental results show that new method is better than the existing advanced methods in AP.
Selecting a reliability matching area as template is one of the key issues to vision navigation. This paper proposes a metric for matching area selection based on line feature extraction and connection. Firstly, a new line feature is introduced to approximate the reliability information about matching area, which is called saliency line feature. Then, extracting method of these line features is put forward based on monogenic phase congruency model. Secondly, a convex shape descriptor is proposed to represent the spatial distribution characteristic of the line features by connection. Finally, a measure method is defined by merging the quantity and spatial distribution characteristic of the saliency line features, which can guide to select better matching area. The experimental results show that the proposed metric is valid and effective.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.