Optical-to-SAR image registration using a combination of CNN descriptors and cross-correlation coefficient

Akhmedkhan Shabanov; Sergey Gladilin; Evgeny Shvets

doi:10.1117/12.2558414

31 January 2020 Optical-to-SAR image registration using a combination of CNN descriptors and cross-correlation coefficient

Akhmedkhan Shabanov, Sergey Gladilin, Evgeny Shvets

Author Affiliations +

Proceedings Volume 11433, Twelfth International Conference on Machine Vision (ICMV 2019); 114331M (2020) https://doi.org/10.1117/12.2558414
Event: Twelfth International Conference on Machine Vision, 2019, Amsterdam, Netherlands

Abstract

Image registration is a problem of aligning two or more images of the same scene or object. The case when images are taken using different sensors - multimodal image registration - has applications in medical imaging and remote sensing. Unfortunately, many of the existing image registration methods operate under crude assumptions (i.e., the intensities of images are linearly correlated), which makes them inapplicable for the accurate multimodal registration. One approach to this task is to use deep learning to capture the complex intensity dependencies between images of different modalities. However, while deep learning methods produce good results, most of them are trained end-to-end and do not utilize the accumulated body of knowledge about image registration using “classic” information-theoretic and statistical methods. In this paper we consider the specific case of multimodal image registration - of optical and synthetic aperture radar (SAR) images. We use classic feature-based registration pipeline (first, corresponding feature points are found, then RANSAC is used as the transform estimator). Within this method we compare the effectiveness of various feature point detection and correspondence methods - both neural network-based and traditional. We find that Siamese network outperforms (but only slightly) the classic cross-entropy-based method for finding correspondences. Finally, we propose a hybrid method and show that it outperforms both “classic” method and an end-to-end network by a significant margin.

Citation Download Citation

Akhmedkhan Shabanov, Sergey Gladilin, and Evgeny Shvets "Optical-to-SAR image registration using a combination of CNN descriptors and cross-correlation coefficient", Proc. SPIE 11433, Twelfth International Conference on Machine Vision (ICMV 2019), 114331M (31 January 2020); https://doi.org/10.1117/12.2558414

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image registration

Synthetic aperture radar

Detection and tracking algorithms

Sensors

Image sensors

Atmospheric optics

Chemical elements

Show All Keywords

Keywords/Phrases

Search In:

Publication Years