17 October 2024 TSSA-Net: two-stream self-attention network for hyperspectral image super-resolution
Jin Xu, Yuanchao Su, Sheng Li, He Sun, Ke Zheng, Mengying Jiang
Author Affiliations +
Abstract

Hyperspectral image super-resolution (HI-SR) can improve hyperspectral images’ spatial resolution to capture more spatial details from the observed scenario. Recently, fusing multispectral and hyperspectral images to implement HI-SR has become a hot topic in remote sensing. Moreover, the development of deep learning has further promoted the advancement of HI-SR over the past few years, bringing many specific HI-SR networks. However, for most HI-SR networks, it is challenging to obtain global features from different images, which limits the reliability of results. We propose a new HI-SR method that adopts a two-stream self-attention network (TSSA-Net) to address the above issues. The proposed deep network consists of two coupled encoders for acquiring the abundance and endmembers from multispectral and hyperspectral images, respectively. Each encoder has a self-attention mechanism to acquire global features and use a convolutional layer to aggregate local features. Meanwhile, cross-stream self-attention is designed for information exchange among different streams, enhancing the robustness of TSSA-Net. Several experiments are conducted to verify the effectiveness and competitiveness of TSSA-Net.

© 2024 Society of Photo-Optical Instrumentation Engineers (SPIE)
Jin Xu, Yuanchao Su, Sheng Li, He Sun, Ke Zheng, and Mengying Jiang "TSSA-Net: two-stream self-attention network for hyperspectral image super-resolution," Journal of Applied Remote Sensing 18(4), 042605 (17 October 2024). https://doi.org/10.1117/1.JRS.18.042605
Received: 31 May 2024; Accepted: 13 September 2024; Published: 17 October 2024
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Hyperspectral imaging

Convolution

Matrices

Image restoration

Super resolution

Visualization

Associative arrays

Back to Top