Remote sensing images often contain a significant amount of clouds, which can result in substantial resource costs during transmission and storage. Cloud detection can reduce these costs. Although current cloud detection methods perform well in extracting large and thick clouds, there are still some issues, such as missed detection of small and thin clouds and false detection in non-cloud areas. Therefore, we propose a deep learning framework called DB-Net. It consists of three main modules: feature extraction module (FEM), cascaded feature enhancement module (CFEM), and feature fusion module (FFM). In the FEM, we leverage the advantages of both convolutional neural network and Transformer by utilizing two branches to reduce the loss of semantic information. To enhance the acquisition capability of multi-scale semantic information, in the CFEM, regular convolutions are replaced with deformable convolutions to adaptively capture cloud features of various sizes, and a cascaded structure is designed to enhance the interaction of information among different scales. Furthermore, to focus on small and thin cloud information and suppress non-cloud background information, we designed the FFM using attention mechanisms to enhance the target information in the features extracted by FEM and CFEM. Extensive experiments were conducted on the GF1-WHU dataset, and comparisons were made with mainstream cloud detection networks. The experimental results indicate that the proposed DB-Net method reduces cloud information omission, effectively focuses on thin clouds and small clouds, and improves overall cloud detection performance.
Most remote sensing sea ice classification methods use single-source remote sensing data, such as synthetic aperture radar (SAR) data and optical remote sensing data. SAR data contain rich sea ice texture information, but the data are relatively single, making it difficult to distinguish detailed sea ice categories. Optical data include abundant spatial-spectral information, but they are often affected by clouds, fog, and severe weather. Hence, given the limitations of single-source data, the remote sensing sea ice classification accuracy cannot be further improved. A sea ice classification method based on deep learning and multisource remote sensing data fusion is proposed utilizing an improved densely connected convolutional neural network (DenseNet) to mine and fuse the multilevel features of sea ice. According to the characteristics of SAR data and optical data, a dual-branch network structure based on an improved DenseNet is employed for feature extraction, and a squeeze-and-excitation attention mechanism is introduced to weight the fusion features to further enhance the feature weights that can effectively distinguish different types of sea ice. The fully connected network is used to perform the deep fusion of features and classify sea ice. To verify the effectiveness of the proposed method, two sets of sea ice data are utilized for sea ice classification. The experimental results show that the proposed method fully excavates and fuses the multilevel characteristics of heterogeneous data using the improved dual-branch network structure, leverages the complementary characteristics of SAR data and optical data, significantly increases the sea ice classification accuracy, and effectively improves the influence of cloud cover on the sea ice classification accuracy. Compared with the typical single-source data classification method and other heterogeneous data fusion classification methods, the proposed method achieves superior overall classification accuracy (98.49% and 98.58%).
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.