An FFT-based CNN-transformer encoder for semantic segmentation of radar sounder signal

Raktim Ghosh; Francesca Bovolo

doi:10.1117/12.2636693

26 October 2022 An FFT-based CNN-transformer encoder for semantic segmentation of radar sounder signal

Raktim Ghosh, Francesca Bovolo

Proceedings Volume 12267, Image and Signal Processing for Remote Sensing XXVIII; 122670R (2022) https://doi.org/10.1117/12.2636693
Event: SPIE Remote Sensing, 2022, Berlin, Germany

Abstract

Radar Sounders (RSs) are sensors operating in the nadir-looking geometry (with HF or VHF bands) by transmitting modulated electromagnetic (EM) pulses and receiving the backscattering response from different subsurface targets. Recently, convolutional neural network (CNN) architectures were established for characterizing RS signals under the semantic segmentation framework. In this paper, we design a Fast Fourier Transform (FFT) based CNN-Transformer encoder to effectively capture the long-range contexts in the radargram. In our hybrid architecture, CNN models the high-dimensional local spatial contexts, and the Transformer establishes the global spatial contexts between the local spatial ones. To overcome Transformer complex self-attention layers by reducing learnable parameters; - we replace the self-attention mechanism of the Transformer with unparameterized FFT modules as depicted in FNet architecture for Natural Language Processing (NLP). The experimental results on the MCoRDS dataset indicate the capability of the CNN-Transformer encoder along with the unparameterized FFT modules to characterize the radargram with limited accuracy cost and by reducing the time consumption. A comparative analysis is carried out with the state-of-the-art Transformer-based architecture.

Conference Presentation

Citation Download Citation

Raktim Ghosh and Francesca Bovolo "An FFT-based CNN-transformer encoder for semantic segmentation of radar sounder signal", Proc. SPIE 12267, Image and Signal Processing for Remote Sensing XXVIII, 122670R (26 October 2022); https://doi.org/10.1117/12.2636693

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available