Next Article in Journal
Improving Mineral Classification Using Multimodal Hyperspectral Point Cloud Data and Multi-Stream Neural Network
Previous Article in Journal
Life Cycle Mining Deformation Monitoring and Analysis Using Sentinel-1 and Radarsat-2 InSAR Time Series
Previous Article in Special Issue
A Daily High-Resolution Sea Surface Temperature Reconstruction Using an I-DINCAE and DNN Model Based on FY-3C Thermal Infrared Data
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
This is an early access version, the complete PDF, HTML, and XML versions will be available soon.
Article

SAM-CFFNet: SAM-Based Cross-Feature Fusion Network for Intelligent Identification of Landslides

1
School of Earth Sciences and Resources, China University of Geosciences, Beijing 100083, China
2
China Aero Geophysical Survey and Remote Sensing Center for Natural Resources, Beijing 100083, China
3
School of Geosciences and Surveying Engineering, China University of Mining and Technology, Beijing 100083, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2024, 16(13), 2334; https://doi.org/10.3390/rs16132334
Submission received: 23 February 2024 / Revised: 20 May 2024 / Accepted: 28 May 2024 / Published: 26 June 2024

Abstract

Landslides are common hazardous geological events, and accurate and efficient landslide identification methods are important for hazard assessment and post-disaster response to geological disasters. Deep learning (DL) methods based on remote sensing data are currently widely used in landslide identification tasks. The recently proposed segment anything model (SAM) has shown strong generalization capabilities in zero-shot semantic segmentation. Nevertheless, SAM heavily relies on user-provided prompts, and performs poorly in identifying landslides on remote sensing images. In this study, we propose a SAM-based cross-feature fusion network (SAM-CFFNet) for the landslide identification task. The model utilizes SAM’s image encoder to extract multi-level features and our proposed cross-feature fusion decoder (CFFD) to generate high-precision segmentation results. The CFFD enhances landslide information through fine-tuning and cross-fusing multi-level features while leveraging a shallow feature extractor (SFE) to supplement texture details and improve recognition performance. SAM-CFFNet achieves high-precision landslide identification without the need for prompts while retaining SAM’s robust feature extraction capabilities. Experimental results on three open-source landslide datasets show that SAM-CFFNet outperformed other comparative models in terms of landslide identification accuracy and achieved an intersection over union (IoU) of 77.13%, 55.26%, and 73.87% on the three datasets, respectively. Our ablation studies confirm the effectiveness of each module designed in our model. Moreover, we validated the justification for our CFFD design through comparative analysis with diverse decoders. SAM-CFFNet achieves precise landslide identification using remote sensing images, demonstrating the potential application of the SAM-based model in geohazard analysis.
Keywords: landslide identification; SAM; deep learning; remote sensing; semantic segmentation; cross-feature fusion landslide identification; SAM; deep learning; remote sensing; semantic segmentation; cross-feature fusion

Share and Cite

MDPI and ACS Style

Xi, L.; Yu, J.; Ge, D.; Pang, Y.; Zhou, P.; Hou, C.; Li, Y.; Chen, Y.; Dong, Y. SAM-CFFNet: SAM-Based Cross-Feature Fusion Network for Intelligent Identification of Landslides. Remote Sens. 2024, 16, 2334. https://doi.org/10.3390/rs16132334

AMA Style

Xi L, Yu J, Ge D, Pang Y, Zhou P, Hou C, Li Y, Chen Y, Dong Y. SAM-CFFNet: SAM-Based Cross-Feature Fusion Network for Intelligent Identification of Landslides. Remote Sensing. 2024; 16(13):2334. https://doi.org/10.3390/rs16132334

Chicago/Turabian Style

Xi, Laidian, Junchuan Yu, Daqing Ge, Yunxuan Pang, Ping Zhou, Changhong Hou, Yichuan Li, Yangyang Chen, and Yuanbiao Dong. 2024. "SAM-CFFNet: SAM-Based Cross-Feature Fusion Network for Intelligent Identification of Landslides" Remote Sensing 16, no. 13: 2334. https://doi.org/10.3390/rs16132334

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop