Next Article in Journal
Vertical Variability of Temperature and Moisture in a Compound Dust-Heatwave Scenario at South-Western Iberian Peninsula: Implications for Surface Thermal Stress and CCN Predictions
Previous Article in Journal
Computationally Efficient Robust Information Filtering for In-Flight GNSS/SINS Tightly Coupled Navigation with High-Dimensional Observations on Small UAVs
Previous Article in Special Issue
Use of PSInSAR for Long-Term Surface Displacement Monitoring as a Complement to the Official Landslide Susceptibility Map in the Saguenay–Lac-Saint-Jean Region, Quebec
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

DIGSFNet: Deformation-Integrity-Guided Symmetric Fusion Network for High-Risk Landslide Extraction from Multi-Source Remote Sensing Images

1
State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, 129 Luoyu Road, Wuhan 430079, China
2
School of Civil Engineering and Architecture, Wuhan Institute of Technology, 693 Xiongchu Avenue, Hongshan District, Wuhan 430073, China
3
Department of Mechanical Engineering, National University of Singapore, Singapore 117576, Singapore
4
Department of Computer Science, Aberystwyth University, Penglais, Aberystwyth SY23 3DB, UK
*
Author to whom correspondence should be addressed.
Remote Sens. 2026, 18(16), 2692; https://doi.org/10.3390/rs18162692
Submission received: 15 June 2026 / Revised: 30 July 2026 / Accepted: 4 August 2026 / Published: 11 August 2026

Highlights

What are the main findings?
  • DIGSFNet treats InSAR deformation data and optical imagery as equal information sources through symmetric, dynamically sparse cross-modal fusion. When trained separately on the Nanning-HHLS dataset and the public HAEFNet benchmark, it achieved mIoU values of 83.57 percent and 78.92 percent, outperforming the strongest comparison methods by 2.63 and 3.68 percentage points, respectively.
  • The deformation-integrity decoder incorporates deformation continuity and boundary-gradient consistency into the segmentation process, producing more complete and physically consistent landslide masks and improving the Boundary F1 score by 5.52 percentage points over symmetric fusion alone.
What are the implications of the main findings?
  • Explicitly embedding InSAR deformation physics improves the reliability and interpretability of high-risk landslide mapping by reducing missed landslides and helping suppress false alarms caused by non-landslide deformation.
  • The INT8 lightweight student model achieves 79.24 percent mIoU at 218 FPS, with a latency of 4.6 ms and GPU memory consumption of only 0.54 GB, supporting efficient operational surveys over large mountainous areas.

Abstract

High-risk landslide extraction from remote sensing imagery is a fundamental task for geological disaster prevention, emergency response, and land-use planning in mountainous regions. Although deep-learning semantic segmentation has substantially advanced landslide detection from optical imagery, existing methods still suffer from three critical limitations: (i) Interferometric Synthetic Aperture Radar (InSAR) deformation data are treated as auxiliary channels and dominated by optical features during fusion; (ii) predicted masks exhibit fragmented boundaries and incomplete delineation due to the absence of deformation continuity constraints reflecting the physical coherence of slope movements; and (iii) heavy Transformer backbones hinder practical deployment over large areas. To address these issues, we propose a Deformation-Integrity-Guided Symmetric Fusion Network (DIGSFNet) for high-risk landslide extraction from InSAR and optical imagery. The framework consists of three components: a Symmetric Deformation-Aware Encoder (SDAE) that treats InSAR and optical modalities as equal information sources through modality-aware adapters and dynamic sparse cross-modal fusion; a Deformation Integrity Prior Decoder (DIPD) that imposes deformation continuity and boundary-gradient consistency as physical priors to enforce mask completeness and boundary accuracy; and a Lightweight Deployable Student Network (LDSN) obtained via cross-modal knowledge distillation and INT8 quantization for efficient inference. Experiments on the Nanning High-Hazard Landslide Segmentation (Nanning-HHLS) dataset and the public HAEFNet benchmark covering the Qinghai–Tibet–Sichuan landslide-prone regions show that the full DIGSFNet achieves state-of-the-art extraction accuracy, reaching 83.57% and 78.92% mIoU on the two datasets and surpassing the strongest competing method by 2.63 and 3.68 percentage points with a Recall of 91.48% on Nanning-HHLS, while its distilled lightweight student retains 79.24% mIoU at 218 frames per second after INT8 quantization, enabling efficient large-area operational deployment.

1. Introduction

Landslide hazards are among the most devastating geological disasters in mountainous regions worldwide [1,2], posing severe threats to human life, infrastructure integrity, and sustainable economic development. Mountainous terrains are inherently susceptible to slope instability due to steep gradients, complex lithological structures, intense precipitation, and seismic activity [3]. Among the broad spectrum of landslide phenomena, a particularly critical yet underexplored category is high-risk landslides: slopes that have already undergone measurable but often subtle deformation and exhibit precursory signs of instability, yet have not fully developed into catastrophic failures [1,4]. In this work, we adopt an explicit, criteria-based working definition: a high-risk landslide is a slope that simultaneously (i) exhibits spatially coherent InSAR-measured line-of-sight (LOS) deformation exceeding | v L O S |     10 mm/yr (equivalently, cumulative LOS displacement 20 mm over the 2020–2023 observation window), indicating ongoing movement; (ii) presents corroborating morphological or spectral instability evidence in optical imagery (e.g., scarps, tension cracks, vegetation anomalies); and (iii) has not yet undergone complete catastrophic failure. This category overlaps with, but is not identical to, the terms “active landslide” [5] and “latent/incipient landslide” used in previous studies; hereinafter these terms are used only when referring to the corresponding external datasets or cited works, and we note that “risk” is used here in the operational sense of a slope threatening lives or infrastructure rather than in the formal hazard–vulnerability–exposure sense of quantitative risk assessment. The definition excludes both post-failure deposits without present-day motion, which fail criterion (i), and landslide-susceptible yet currently stable slopes. The early identification and precise delineation of such high-risk landslides constitute a fundamental task for proactive disaster prevention, early warning, emergency response planning, and rational land-use regulation. In this context, the synergistic combination of Synthetic Aperture Radar Interferometry (InSAR), which captures millimeter-level surface deformation indicative of slow and progressive slope movement [4,6,7], and high-resolution optical remote sensing imagery, which provides rich spectral and textural information about surface morphology, offers an ideal multi-source data foundation for high-risk landslide extraction.
In recent years, deep learning-based semantic segmentation methods have demonstrated remarkable success in automated landslide detection from remote sensing images [8,9]. Encoder–decoder architectures such as U-Net [10], DeepLabV3+ [11], and SegFormer [12] have established strong baselines for pixel-wise landslide mapping by hierarchically extracting multi-scale contextual features. Various attention mechanisms, including channel attention, spatial attention, and self-attention modules, have been incorporated to enhance the discriminative capacity of landslide features against complex background environments [13,14]. Multi-scale feature fusion strategies, such as Feature Pyramid Networks and Atrous Spatial Pyramid Pooling, further improve the representation of landslides with varying spatial extents [15,16]. Moreover, recent studies have begun to explore InSAR–optical fusion approaches for landslide identification, recognizing that deformation signals provide critical evidence for distinguishing high-risk landslides exhibiting ongoing creep from stable terrain and historical landslide deposits [4,17,18,19,20].
However, existing methods still suffer from several critical failure modes that limit their practical applicability in high-risk landslide extraction. First, current multi-source fusion methods predominantly adopt an asymmetric modality treatment strategy, where InSAR deformation maps are simply concatenated as additional input channels to an optical-dominant backbone network [21,22]. This concatenation-based approach inherently constrains the deformation modality to a subordinate role, causing the network to inadequately learn and represent the unique displacement patterns, velocity gradients, and spatial clustering characteristics embedded within InSAR data—features that are essential for distinguishing slowly deforming high-risk slopes from optically similar but stable terrain. Second, predicted landslide masks frequently exhibit fragmented boundaries and incomplete interior delineation, particularly for large-scale or slowly creeping high-risk landslides whose surface manifestations are subtle and diffuse. This deficiency arises because conventional segmentation losses (cross-entropy, Dice [23]) lack explicit spatial consistency constraints derived from deformation physics; in reality, a high-risk landslide body typically displays continuous and coherent displacement fields, and its boundaries correspond to distinct deformation gradient discontinuities—information that remains unexploited in existing frameworks. Third, state-of-the-art methods increasingly rely on heavy Transformer backbones [12,24] with substantial parameter counts and computational overhead, rendering them impractical for the massive data volumes required in large-area landslide hazard surveys covering thousands of square kilometers.
We deliberately scope this work to high-risk landslide extraction rather than general landslide identification: the former targets slopes where intervention can still precede failure, and it is the sub-problem in which InSAR deformation constitutes decisive rather than auxiliary evidence. General landslide identification, which additionally includes historical and stabilized landslide bodies, weakens the role of the kinematic criterion, since stabilized deposits produce no present-day deformation; the proposed framework remains applicable in principle, but its deformation-centered design advantages would be diluted. Likewise, the emphasis on mountainous regions reflects the setting of both study areas and of the operational surveys motivating this work, not an intrinsic architectural limit: the framework applies wherever co-registered InSAR–optical pairs are available.
To address the above challenges, we propose a novel Deformation-Integrity-Guided Symmetric Fusion Network (DIGSFNet) for high-risk landslide extraction from multi-source remote sensing images in mountainous regions. The core idea of DIGSFNet is to establish a symmetric and balanced multi-modal learning paradigm that elevates InSAR deformation data from an auxiliary channel to an equal information source, while simultaneously embedding deformation integrity priors into the decoding process to enforce physically consistent landslide mask predictions. The proposed framework comprises three synergistic components: a Symmetric Deformation-Aware Encoder that achieves modality-equitable feature extraction through dedicated adapters and dynamic sparse cross-modal interaction, a Deformation Integrity Prior Decoder that incorporates InSAR-derived physical constraints for complete and boundary-accurate mask generation, and a Lightweight Deployable Student Network that enables efficient large-area inference through knowledge distillation and post-training quantization.
The main contributions of this paper are summarized as follows:
  • Symmetric Deformation-Aware Encoder (SDAE). We design a symmetric dual-branch encoder with modality-aware adapters and a dynamic sparse cross-modal fusion mechanism, which treats InSAR and optical data as equal information sources and enables comprehensive cross-modal feature interaction while preserving modality-specific characteristics.
  • Deformation Integrity Prior Decoder (DIPD). We propose a decoder that explicitly leverages InSAR deformation continuity and boundary gradient consistency as physical prior constraints, guiding the network to produce spatially coherent masks with accurate and complete boundaries that align with the underlying deformation mechanics.
  • Lightweight Deployable Student Network (LDSN). We develop a lightweight student network trained through cross-modal knowledge distillation from the full DIGSFNet teacher, combined with INT8 post-training quantization, achieving a favorable accuracy–efficiency trade-off suitable for operational high-risk landslide surveys.

2. Related Work

2.1. Landslide Detection from Remote Sensing Images

Landslide detection from remote sensing imagery has undergone a significant paradigm shift over the past two decades, transitioning from manual visual interpretation toward automated and semi-automated extraction approaches. Early efforts predominantly relied on traditional machine learning classifiers, such as support vector machines (SVM) [25] and random forests (RF) [26], operating on handcrafted spectral, textural, and morphological features derived from optical satellite images. While these methods achieved reasonable accuracy in specific study areas, their performance was highly dependent on the quality of feature engineering and often degraded under complex terrain conditions or heterogeneous land cover backgrounds [8]. Object-based image analysis (OBIA) combined with rule-based classification further improved landslide mapping by incorporating spatial context and shape attributes [27], yet the transferability of such rule sets across different geographic regions remained limited.
The advent of deep learning has substantially advanced the state of the art in landslide detection. Convolutional neural networks (CNNs), particularly encoder–decoder architectures such as U-Net [10] and DeepLab [11], have demonstrated strong capability in pixel-level landslide segmentation from high-resolution optical imagery [9,28]. Several studies have extended these architectures with attention mechanisms [14] or multi-scale feature aggregation modules [29] to better capture the irregular morphology of landslide bodies. More recently, transformer-based models have also been explored for landslide mapping, leveraging global contextual modeling to distinguish landslides from spectrally similar disturbed surfaces [12,24]. Beyond optical data, synthetic aperture radar (SAR) imagery has been employed for landslide detection owing to its all-weather and day-and-night acquisition capability [21]. A few studies have attempted to combine optical and SAR data for improved detection performance [30], and interferometric SAR (InSAR) techniques have proven effective in measuring slow surface deformation that serves as a precursor signal of landslide activity [6,7].
The integration of optical and SAR/InSAR observations for landslide studies has itself developed into a substantial body of work [3,31]. Amplitude-based optical–SAR fusion has been used primarily for post-event landslide mapping under cloud cover [30], while multi-temporal interferometric techniques have supported landslide inventory updating and motion monitoring at regional scales [4,7,17]. More recently, deep-learning methods have begun to consume InSAR deformation products directly: multi-channel CNNs fusing InSAR, optical, and topographic inputs for active-landslide detection [18], wide-area InSAR-based landslide detection considering topographic features [19], hybrid self-distillation architectures for InSAR deformation detection [20], and the evidence-theoretic InSAR–optical–DEM fusion of HAEFNet [5].
Despite these advances, existing InSAR-aware deep-learning methods remain dominated by asymmetric fusion designs in which deformation enters as an auxiliary channel of an optical-centric network, and the majority of general-purpose landslide extraction methods are still designed primarily for optical imagery. How to effectively fuse the information contained in optical imagery—geometric cues, i.e., the shape, texture, and morphological patterns of slope surfaces (scarps, tension cracks, hummocky terrain, displaced masses), and spectral cues, i.e., the multi-band reflectance signatures revealing exposed soil, vegetation removal or stress, and moisture variation—with the displacement signals from InSAR to achieve accurate extraction of high-risk landslides remains an open and challenging problem.

2.2. Multi-Modal Fusion for Remote Sensing Segmentation

Multi-modal data fusion is a central topic in remote sensing image analysis, as the complementary information carried by different sensor modalities can substantially enhance the discriminability and robustness of segmentation models. Existing fusion strategies are generally categorized into three levels: early fusion, middle fusion, and late fusion. Early fusion, typically realized through channel-wise concatenation of multi-source inputs before feeding them into a shared encoder [22], is straightforward to implement but implicitly assumes that heterogeneous modalities share a common feature space, which may not hold for physically distinct data types. Late fusion, in contrast, processes each modality with an independent branch and merges predictions at the decision level [32], preserving modality-specific representations but potentially missing fine-grained cross-modal interactions. Middle fusion, also termed feature-level fusion, strikes a balance by exchanging information at intermediate layers through mechanisms such as cross-attention [33], gated fusion modules [34], or bi-directional feature propagation [35].
In the broader computer vision community, symmetric dual-encoder architectures have gained popularity for RGB+X semantic segmentation tasks, where X denotes a complementary modality such as depth, thermal, or event data. Representative works include CMX [36], which introduces a cross-modal feature rectification module within a symmetric transformer backbone, and TokenFusion [37], which dynamically exchanges tokens between parallel branches. Asymmetric designs, where a lightweight auxiliary branch processes the secondary modality, have also been proposed to reduce computational overhead while retaining fusion benefits [38]. Parameter-efficient fusion strategies, such as adapter-based and prompt-tuning approaches, have further emerged as attractive alternatives that avoid retraining large backbones from scratch [39].
Beyond fusion architectures, spatial-prior-guided decoding has proven effective when one modality carries strong structural regularity. In particular, PDFNet [40] introduced a depth integrity-prior together with a fine-grained patch strategy for high-precision dichotomous image segmentation, exploiting the spatial coherence of scene depth to enforce complete and boundary-accurate masks. This design philosophy directly inspired the decoder proposed in this work; Section 4.3.1 details what is inherited from PDFNet and what is specific to the InSAR deformation domain.
Within the remote sensing domain, multi-modal fusion methods have been extensively studied for RGB combined with digital surface models (DSM) or digital elevation models (DEM) in urban scene parsing [41], and for optical–SAR fusion in land cover classification [30]. However, there is a notable scarcity of methods specifically designed to address the fusion of InSAR deformation maps with optical imagery for landslide extraction. The InSAR deformation modality presents unique challenges: it exhibits sparse and noisy spatial patterns, possesses fundamentally different physical semantics compared to optical reflectance, and its informative regions may be spatially misaligned with the visible boundaries of landslide bodies. These characteristics call for dedicated fusion architectures that can selectively leverage deformation integrity cues while preserving the fine-grained spatial details available in optical data.

2.3. Lightweight and Efficient Segmentation Networks

The deployment of semantic segmentation models in operational landslide monitoring scenarios imposes stringent requirements on computational efficiency and memory footprint, particularly when large-area mapping or near-real-time processing is desired. Lightweight backbone architectures, such as MobileNetV2 [42], EfficientNet [43], and the recently proposed LSNet [44], have been developed to achieve competitive accuracy with significantly reduced parameters and floating-point operations through design principles including depthwise separable convolutions, inverted residuals, and neural architecture search. These backbones have been integrated into segmentation frameworks such as DeepLabV3+ [11] and BiSeNet [45] for efficient remote sensing scene parsing.
Beyond architecture design, knowledge distillation has emerged as a powerful model compression strategy, wherein a compact student network is trained to mimic the output or intermediate representations of a larger teacher model [46]. This paradigm has been successfully applied to single-modality remote sensing segmentation tasks, yielding substantial speedups with marginal accuracy degradation [47]. Model quantization techniques, including INT8 and FP16 mixed-precision inference, provide an orthogonal avenue for acceleration by reducing the numerical precision of network weights and activations [48]. Nevertheless, the vast majority of existing lightweight segmentation works focus on single-modality inputs and do not consider the unique challenges associated with cross-modal distillation in multi-source fusion settings. In particular, how to distill knowledge from a dual-branch multi-modal teacher into a compact student that preserves cross-modal complementarity for InSAR–optical landslide extraction has yet to be systematically explored.

3. Data

3.1. Dataset Overview

We evaluate DIGSFNet on two multi-modal landslide segmentation datasets that pair InSAR deformation products with optical satellite imagery, covering geographically and geomorphologically distinct regions.
Nanning High-Hazard Landslide Segmentation (Nanning-HHLS). This dataset targets the Nanning municipality (administrative area approximately 22,112 km2) in Guangxi Zhuang Autonomous Region, southern China, spanning approximately 107.75°E–108.85°E and 22.22°N–23.53°N over karst-dominated subtropical terrain. Ten-band Sentinel-2 Level-2A surface-reflectance imagery (B2–B4, B5–B8A, B11–B12; resampled to 10 m) provides the optical modality, and Sentinel-1 SBAS-InSAR cumulative line-of-sight (LOS) deformation maps (January 2020–December 2023, 96 ascending-track acquisitions, geocoded to 10 m) provide the InSAR modality. The optical layer is a cloud-free composite generated from 34 Sentinel-2 scenes acquired during the dry seasons (October–March) of 2021–2023, chosen to be temporally consistent with the InSAR observation window. We emphasize that the task is not post-event landslide mapping: the targets are slopes under ongoing, pre-failure deformation, so there is no discrete failure event partitioning the data into before/after epochs; the InSAR modality summarizes a continuous observation window and the multi-temporality of the dataset resides entirely in the 96-acquisition InSAR stack. The two modalities are co-registered to sub-pixel accuracy. High-risk landslide areas were identified through a multi-source protocol combining field survey records, historical inventory databases, InSAR deformation thresholds (cf. criterion (i) in Section 1), and expert visual interpretation; three geologists annotated each site independently and consensus labels were established by majority voting. The pixel-level inter-rater agreement over the three independent annotations is Fleiss’ κ = 0.79 , and boundary disagreements exceeding 2 pixels along the perimeter were resolved in joint re-inspection sessions using the InSAR deformation gradient as the arbitration reference; historical-inventory polygons without a present-day InSAR signal were labeled as background. The dataset comprises 3842 512 × 512 patches extracted with an overlapping sliding window, containing 467 pixel-level annotated high-risk landslide instances and a landslide-to-background pixel ratio of approximately 1:18. Annotated instance areas range from 3200 m2 to 2.8 km2, with a median of 21,400 m2, and the land cover of the deforming slopes is dominated by forest/shrub (62%), cropland (21%), and bare karst rock (15%) (ESA WorldCover 10 m); because the targets have not failed, these figures describe the current cover of the deforming slopes rather than pre-/post-event states. The dataset is split into training (60%), validation (20%), and testing (20%) subsets using spatially stratified random sampling.
HAEFNet Multi-Modal Active-Landslide Dataset. This publicly available benchmark accompanies the HAEFNet framework [5] and covers active-landslide-prone regions in the Qinghai–Tibet Plateau and Sichuan, western China. It provides spatially co-registered Sentinel-1 InSAR mean LOS deformation rate maps, Sentinel-2 RGB imagery (10 m), and Copernicus GLO-30 DEM (30 m). Following the design rationale discussed in Section 6.2, the DEM channel is not used by DIGSFNet so that the experimental configuration on the two datasets remains identical. Expert annotations of active landslides were guided by InSAR deformation signals, optical textures, and topographic context. The released dataset contains 8440 sample pairs (resampled to 512 × 512 px) with 1013 annotated active landslide instances and a positive-to-negative sample ratio of approximately 1:1.5. We adopt the official 7:1:2 train/validation/test split.

3.2. Dataset Comparison

Table 1 summarizes the key attributes of both datasets. The two benchmarks differ substantially in climate, lithology, and landslide mechanism—Nanning-HHLS covers humid subtropical karst terrain with dense vegetation, whereas the HAEFNet dataset spans high-altitude, sparsely vegetated alpine environments—making them complementary testbeds for evaluating how well the architecture generalizes when independently trained on geomorphologically distinct regions. Crucially, both datasets provide spatially co-registered InSAR–optical pairs, permitting the full dual-branch fusion pipeline of DIGSFNet (SDAE + DIPD) to be evaluated without architectural simplification.
Two further differences between the benchmarks deserve explicit discussion. First, the class balance differs sharply: Nanning-HHLS has a landslide-to-background pixel ratio of about 1:18, whereas the HAEFNet benchmark is comparatively balanced (1:1.5). During training, the Dice component of the segmentation loss and the overlap-based evaluation metrics (IoU, F1, BF1) are insensitive to the dominance of background pixels, and no re-weighting or over-sampling was applied; the fact that the relative ranking of all compared methods is consistent across the two imbalance regimes (reported in Section 5.3) indicates that our conclusions are not artifacts of a particular class balance, and this is also why accuracy-type metrics are avoided throughout. Second, the released InSAR products differ—cumulative LOS displacement for Nanning-HHLS versus mean LOS velocity for the HAEFNet benchmark. Both are single-channel scalar summaries and are z-score normalized per scene before being fed to the network; since every model is trained and evaluated independently on each dataset and no cross-dataset transfer is claimed, all methods see the identical InSAR product within each comparison, and the product difference does not confound any reported result. For quasi-linear motion the two quantities are related by an approximately constant factor over a fixed observation window, while they diverge for strongly non-linear motion—one more respect in which the two datasets form complementary testbeds.

4. Methodology

4.1. Overall Architecture

The proposed Deformation-Integrity-Guided Symmetric Fusion Network (DIGSFNet) establishes a unified framework for high-risk landslide extraction from multi-source remote sensing imagery, integrating interferometric synthetic aperture radar (InSAR) deformation measurements with high-resolution optical observations. The overall architecture, illustrated in Figure 1, consists of three principal components arranged in a sequential pipeline.
First, the Symmetric Deformation-Aware Encoder (SDAE) receives co-registered InSAR line-of-sight (LOS) deformation maps and optical imagery as parallel inputs, treating both modalities with equal representational status through shared backbone weights augmented by modality-specific adapters, and progressively fuses complementary features via dynamic sparse cross-modal attention at each hierarchical stage. Then, the Deformation Integrity Prior Decoder (DIPD) leverages the physical constraint that high-risk landslide bodies exhibit spatially continuous deformation fields, incorporating this prior knowledge into a coarse-to-fine prediction strategy with dedicated loss functions that enforce intra-region consistency and boundary–deformation alignment. Finally, the Lightweight Deployable Student Network (LDSN) distills the knowledge encoded in the full teacher model (SDAE + DIPD) into a compact inference network suitable for operational deployment, employing cross-modal knowledge distillation at multiple granularities and structural reparameterization for efficient execution on edge devices.
The synergistic design of these three components enables DIGSFNet to achieve both high extraction accuracy and practical deployability, addressing the dual challenges of multi-modal fusion complexity and real-time monitoring requirements in landslide hazard assessment.

4.2. Symmetric Deformation-Aware Encoder (SDAE)

4.2.1. Motivation for Symmetric Modality Treatment

Existing multi-modal fusion approaches for landslide detection typically adopt asymmetric architectures that designate one modality (usually optical imagery) as the primary stream and relegate supplementary modalities (e.g., InSAR) to auxiliary roles through late fusion or simple concatenation. Such asymmetric treatment introduces representational bias: the auxiliary branch receives weaker gradient signals during training and consequently fails to develop discriminative features. For high-risk landslide extraction, InSAR deformation measurements carry irreplaceable physical significance—they directly quantify surface displacement rates that constitute the fundamental criterion for risk classification. Therefore, we argue that a symmetric encoder architecture that assigns equal representational capacity and learning priority to both modalities is essential for fully exploiting the complementary strengths of deformation-based and appearance-based observations. Throughout this paper, “symmetric” refers to this equal representational treatment—identical backbone capacity, identical adapter capacity, and a role-reversible fusion operator (Equation (3))—rather than to fully independent per-modality weights; the backbone weights are shared between the two branches and modality specificity is carried by the adapters, as detailed next. The detailed architecture of the proposed SDAE is illustrated in Figure 2.

4.2.2. Modality-Aware Parameter-Efficient Adapters

To achieve symmetric yet computationally efficient dual-modal feature extraction, SDAE adopts a shared pre-trained backbone augmented with modality-specific lightweight adapters. Specifically, we employ a Swin Transformer [24] pre-trained on ImageNet [49] as the shared feature extractor, which provides rich hierarchical representations while maintaining parameter efficiency through weight sharing. For each modality branch, a set of bottleneck adapters [39] is inserted after each transformer block, enabling modality-specific feature refinement without modifying the shared parameters.
The adapter module follows a bottleneck architecture consisting of a down-projection layer that compresses the feature dimension to a bottleneck dimension r, a nonlinear activation function, and an up-projection layer that restores the original dimensionality. Formally, given an input feature x R d , the adapter forward pass is defined as
Adapter ( x ) = x + W u p · GELU ( W d o w n · x + b d o w n ) + b u p
where W d o w n R r × d and W u p R d × r are learnable projection matrices ( r < d is the adapter bottleneck dimension), GELU ( · ) denotes the Gaussian Error Linear Unit activation, and the residual connection preserves the pre-trained representations. We use r = 64 (selected by the sensitivity analysis in Section 5.6); adapters are inserted after every Swin Transformer block in both branches, and the total adapter parameter count is 1.53 M, i.e., 1.7% of the full model. This hybrid shared-backbone-plus-adapters design is preferred over the two alternatives—a fully shared encoder without adapters and fully independent dual encoders—for both empirical and conceptual reasons: the shared ImageNet-pretrained weights supply common low-level visual statistics, while the adapters absorb modality-specific refinement at a small fraction of the cost of duplicating the backbone. A direct comparison of the three options confirms this: a fully shared encoder without adapters attains 81.05% mIoU at 85.34 M parameters, fully independent dual encoders attain 83.31% mIoU at 158.9 M parameters, and the proposed hybrid attains 83.57% mIoU at 88.46 M parameters—i.e., the hybrid matches the independent-encoder accuracy at little more than half the encoder parameters. The optical adapter is trained to capture spectral–textural patterns including vegetation anomalies, terrain morphology, and surface roughness variations, while the InSAR adapter specializes in learning deformation-temporal patterns such as displacement velocity gradients, coherence degradation signatures, and phase unwrapping artifacts.

4.2.3. Dynamic Sparse Cross-Modal Fusion

While the parallel adapter branches extract modality-specific features independently, effective landslide extraction requires exploiting inter-modal complementarity. We introduce a Dynamic Sparse Cross-Modal Fusion (DSCF) module at each encoder stage to achieve selective information exchange between the two branches. The core mechanism employs a learnable gating function that dynamically identifies spatially informative locations where cross-modal fusion is most beneficial, thereby avoiding indiscriminate feature mixing that may introduce noise.
Given optical features F l O R C × H × W and InSAR features F l I R C × H × W at encoder stage l, the dynamic sparse gating function computes a binary selection mask:
A l = σ Conv 1 × 1 ( [ F l O ; F l I ] ) , G l = 1 A l > τ
where [ · ; · ] denotes channel-wise concatenation, σ ( · ) is the sigmoid function, τ is an adaptive threshold determined by the top-k percentile of activation values, and 1 [ · ] is the indicator function. The soft sparsity regularizer is defined as L s p a r s e = A l 1 / ( H × W ) and therefore acts on the pre-threshold sigmoid activations rather than on the binary gate. Concretely, the hard gate retains the top- ρ fraction of activations with a single global ratio ρ = 0.3 , selected by the sensitivity analysis in Section 5.6 and kept identical across all four encoder stages; τ is not a free hyperparameter but is recomputed per feature map as the ( 1 ρ ) -quantile. Thus, the top- ρ rule fixes the retained fraction of G l , whereas L s p a r s e regularizes the magnitudes of A l before thresholding. Since the indicator function is non-differentiable, training uses a straight-through estimator (hard top-k selection in the forward pass and sigmoid gradients in the backward pass).
The cross-modal fusion operation is then formulated as
F ^ l O = F l O + G l MHA ( F l O , F l I , F l I )
where MHA ( · ) denotes multi-head cross-attention [33] with the first argument as query and the remaining as key-value pairs, and ⊙ represents element-wise multiplication with the sparse gate. The symmetric counterpart F ^ l I is computed analogously with reversed roles.

4.2.4. Dual-Modal Self-Teaching

To further strengthen the discriminative capacity of each individual modality branch, we introduce a dual-modal self-teaching mechanism. The fused dual-modal prediction, generated from the combined features [ F ^ l O ; F ^ l I ] , serves as a soft supervision signal for each single-modal branch. This self-teaching loss is formulated as
L s t = 1 2 [ KL sg ( p f u s e d ) p O + KL sg ( p f u s e d ) p I ]
where p f u s e d , p O , and p I denote the softmax probability distributions from the fused, optical-only, and InSAR-only predictions, respectively, sg ( · ) denotes the stop-gradient operation, and KL ( · · ) is the Kullback–Leibler divergence. The stop-gradient breaks the potential circular dependency between the fused teacher signal and the single-modal branches from which it is derived: gradients of L s t flow only into the single-modal predictions, while the fused branch is trained solely by the segmentation supervision, i.e., p f u s e d is detached before being used as the self-teaching target. This mechanism ensures that each single-modal branch progressively learns to approximate the richer fused representation, thereby improving robustness when one modality is degraded or unavailable during inference.

4.3. Deformation Integrity Prior Decoder (DIPD)

4.3.1. Motivation for the Deformation Integrity Prior

The design of DIPD is inspired by the depth integrity-prior and fine-grained patch strategy of PDFNet [40], which exploits the spatial coherence of depth maps for dichotomous image segmentation. DIPD transfers this design philosophy from scene depth to InSAR surface deformation, which entails three substantive differences. First, the prior is grounded in landslide kinematics rather than scene geometry: deformation coherence reflects the mechanical coupling of a sliding mass, and deformation-gradient discontinuities correspond to physical shear boundaries. Second, the loss formulation differs: DIPD combines a deformation-affinity-weighted intra-region consistency term (Equation (7)) with a boundary-gradient cosine alignment term (Equation (8)), whereas PDFNet enforces its depth integrity-prior through a structural consistency objective on depth-derived cues together with a patch-level refinement loss. Third, DIPD operates inside a symmetric cross-modal fusion framework in which the prior-carrying modality (InSAR) is itself a learned input branch rather than an auxiliary map, and the patch-selection criterion (Equation (6)) jointly uses prediction entropy and deformation-gradient magnitude. The head-to-head comparison with PDFNet adapted to our task (reported in Section 5.3) isolates the benefit of these deformation-specific designs.
The concept of “deformation integrity prior” is rooted in the geophysical observation that high-risk landslide bodies exhibit spatially continuous and coherent deformation patterns in InSAR time-series measurements [4,6]. Unlike vegetation changes or shadow artifacts that may create discontinuous optical signatures, the mechanical coupling within a landslide mass ensures that adjacent pixels within the unstable region share similar displacement velocities and deformation directions. This physical property provides a powerful constraint for segmentation: predicted landslide masks should respect the spatial continuity of the underlying deformation field. Conventional semantic segmentation decoders lack mechanisms to enforce such domain-specific priors, often producing fragmented predictions that violate the physical integrity of deformation zones. The DIPD addresses this limitation by explicitly encoding the deformation integrity constraint into both the decoding architecture and the loss function design. The detailed structure of the proposed DIPD is illustrated in Figure 3.

4.3.2. Coarse-to-Fine Prediction with Fine-Grained Patch Strategy

The DIPD adopts a coarse-to-fine prediction paradigm that progressively refines landslide boundaries while maintaining global deformation consistency. In the coarse prediction stage, the decoder generates an initial probability map P c o a r s e [ 0 , 1 ] H × W from the deepest encoder features:
P c o a r s e = σ Conv 1 × 1 ( Up ( F 4 ) )
where F 4 denotes the stage-4 encoder output and Up ( · ) represents bilinear upsampling to the full spatial resolution.
Subsequently, a fine-grained patch resampling strategy is applied to refine predictions in uncertain boundary regions. Candidate patches are selected based on a composite criterion that jointly considers prediction uncertainty and deformation gradient magnitude:
S p a t c h = { ( i , j ) H ( P c o a r s e ( i , j ) ) > θ H and D ( i , j )   >   θ D }
where H ( · ) denotes the binary entropy function measuring prediction uncertainty, D is the spatial gradient of the InSAR LOS deformation field, and θ H , θ D are adaptive thresholds: θ H is the 80th percentile of the per-image entropy map and θ D is the 70th percentile of the per-image deformation-gradient magnitude; i.e., both are computed adaptively per image rather than fixed globally, which makes the selection robust to scene-dependent deformation dynamic ranges. Selected patches are processed at higher resolution with full multi-scale feature aggregation, enabling precise boundary delineation at deformation transition zones.

4.3.3. Deformation Integrity Loss

The deformation integrity loss enforces two complementary physical constraints on the predicted landslide mask. The first component, the intra-region consistency term, penalizes prediction discontinuities within regions of coherent deformation:
L d e f o r m = 1 | Ω | ( i , j ) Ω exp D ( i , j ) D ( m , n ) 2 2 σ D 2 · | p ( i , j ) p ( m , n ) |
where Ω denotes the set of spatially adjacent pixel pairs ( i , j ) , ( m , n ) , ( m , n ) being a spatial neighbor of ( i , j ) under 8-connectivity (all first-order neighbors), D ( i , j ) is the LOS deformation value at location ( i , j ) , and the exponential weighting ensures that prediction consistency is enforced most strongly between pixels sharing similar deformation characteristics. The bandwidth σ D is estimated per batch as the standard deviation of neighboring-pixel LOS deformation differences. Formally, Equation (7) is a deformation-affinity-weighted pairwise smoothness term, analogous to the intensity-weighted pairwise potentials of conditional random fields but with the affinity defined in the deformation domain and optimized end-to-end; it is a physically motivated regularizer encoding the quasi-coherent motion of a mechanically coupled sliding mass, rather than a constraint derived from first principles.
The second component, the boundary gradient alignment term, encourages predicted mask boundaries to coincide with sharp transitions in the deformation field:
L b o u n d a r y = 1 P p r e d , D P p r e d · D + ϵ
where P p r e d is the spatial gradient of the predicted probability map and ϵ is a small constant for numerical stability. This term maximizes the cosine similarity between prediction boundaries and deformation boundaries. We note that Equation (8) by itself cannot identify the origin of a deformation discontinuity; the discrimination between landslide boundaries and other deformation edges (e.g., mining subsidence rims) is performed jointly with the learned cross-modal features and the segmentation supervision, which determine where landslide predictions appear in the first place. Because the term is only active where P p r e d is non-negligible, it refines the boundaries of regions the network already considers landslide candidates instead of attracting predictions toward every deformation edge in the scene (see also Section 6.2).
The total training loss integrates segmentation supervision with the physical constraints:
L t o t a l = L s e g + λ 1 L b o u n d a r y + λ 2 L d e f o r m + λ 3 L s s i m + λ 4 L s t + λ 5 L s p a r s e
where L s e g combines binary cross-entropy and Dice loss [23], L s s i m is the structural similarity loss that preserves local structural patterns, computed as the standard single-scale SSIM with an 11 × 11 Gaussian window ( σ = 1.5 ) between the single-channel predicted probability map and the ground-truth mask at full output resolution, and L s t and L s p a r s e are the dual-modal self-teaching loss and the cross-modal sparsity regularization defined earlier in this section. The coefficients λ 1 , λ 2 , λ 3 are empirically set to 0.5, 1.0, and 0.2, respectively, based on the sensitivity analysis reported in Section 5.6, while λ 4 and λ 5 , which weight the auxiliary self-teaching and sparsity-regularization terms, are fixed to 0.5 and 0.01, respectively. To make the balance among the terms transparent, Table 2 reports the typical magnitude of each weighted component at the beginning, middle, and end of training, confirming that the physics-based terms act as regularizers of comparable but sub-dominant magnitude relative to the segmentation loss.

4.3.4. Integration with Multi-Scale Features

The DIPD integrates hierarchical features { F 1 , F 2 , F 3 , F 4 } from the encoder through skip connections equipped with attention-weighted fusion. At each decoder level, the skip-connected encoder feature is re-weighted by a channel attention module that evaluates its relevance to the current decoding context. This selective integration mechanism prevents irrelevant low-level details from contaminating the physically constrained predictions while preserving fine-grained spatial information necessary for accurate boundary recovery. The attention weights are jointly learned with the decoder parameters, enabling adaptive feature selection across different landslide scales and deformation patterns.

4.4. Lightweight Deployable Student Network (LDSN)

4.4.1. Teacher–Student Framework

While the full DIGSFNet model (SDAE + DIPD) achieves superior extraction accuracy through its dual-modal symmetric encoder and physically constrained decoder, its computational complexity presents challenges for operational deployment scenarios requiring real-time processing or execution on resource-constrained edge platforms. To bridge this gap, we design a Lightweight Deployable Student Network that inherits the representational knowledge of the full model through systematic knowledge distillation. The overall teacher–student distillation pipeline is illustrated in Figure 4.
The teacher network comprises the complete DIGSFNet with a Swin-B backbone, dual-branch SDAE with cross-modal fusion modules, and the full DIPD with coarse-to-fine refinement. The student network adopts a significantly more compact architecture that, by default, uses LSNet-T [44]—the tiny variant of the LSNet lightweight backbone family—as the backbone encoder (MobileNetV4 [50] can serve as an alternative), paired with a lightweight single-stream decoder with depth-wise separable convolutions. The student receives both modalities as a channel-concatenated input and relies primarily on distilled knowledge rather than heavy dual-branch fusion modules to achieve effective multi-modal understanding. To enable explicit alignment of deformation-aware reasoning between the teacher and the student, a single lightweight deformation-aware attention head is retained at the deepest decoder stage of the student. This head consists of a depth-wise 3 × 3 convolution followed by a 1 × 1 convolution and a sigmoid activation operating on the deepest decoder features, producing a spatial response map that serves as the alignment target for the deformation-prior distillation described below. The total parameter count of this attention head accounts for less than 0.4% of the student model and does not affect the overall lightweight property. Specifically, the head maps the C = 256 -channel deepest decoder feature to a single-channel response map (≈2.6k parameters in total); it is used solely as the alignment target of Equation (12), does not gate the segmentation path, and is retained at inference (though it can be removed without affecting the segmentation output).

4.4.2. Cross-Modal Knowledge Distillation

The knowledge distillation framework operates at three complementary levels to transfer the teacher’s multi-modal reasoning capability to the compact student. The mask-level distillation aligns the student’s output probability distribution with the teacher’s soft predictions:
L m a s k - K D = KL softmax ( z T / T ) softmax ( z S / T )
where z T and z S are the teacher and student logits, T is the temperature parameter, and softmax ( · ) denotes the softmax function.
The feature-level distillation transfers intermediate representational knowledge through projection-aligned feature matching:
L f e a t - K D = l = 1 L ϕ l ( F l S ) sg ( F l T ) 2 2
where ϕ l ( · ) is a learnable projection head that aligns the student feature dimensions with the teacher, and sg ( · ) denotes the stop-gradient operation.
The deformation-prior distillation specifically transfers the teacher’s learned understanding of deformation integrity constraints:
L p r i o r - K D = A d e f o r m S sg ( A d e f o r m T ) F 2
where A d e f o r m T denotes the deformation-aware attention map from the teacher’s DIPD (i.e., the attention-weighted skip-connection response at the deepest decoder stage), A d e f o r m S is the response map produced by the lightweight deformation-aware attention head retained in the student decoder as described in Section 4.4.1, and · F denotes the Frobenius norm. Bilinear interpolation is applied to align the spatial resolution between the teacher and student attention maps before computing the distance.
The total student training loss combines task supervision with all distillation objectives:
L s t u d e n t = L s e g + α 1 L m a s k - K D + α 2 L f e a t - K D + α 3 L p r i o r - K D
where α 1 = 1.0 , α 2 = 0.5 , and α 3 = 0.8 are determined through grid search on the validation set, over the ranges α 1 { 0.5 , 1.0 , 2.0 } , α 2 { 0.1 , 0.5 , 1.0 } , and α 3 { 0.2 , 0.5 , 0.8 , 1.0 } .

4.4.3. Deployment Optimization

To maximize inference efficiency for operational deployment, the trained student network undergoes several post-training optimizations. First, structural reparameterization [51] converts multi-branch training-time architectures (e.g., residual connections in adapter blocks) into equivalent single-path inference architectures, eliminating memory access overhead. Subsequently, the model is exported to the ONNX intermediate representation format for cross-platform compatibility. For GPU-based deployment, TensorRT optimization is applied with layer fusion, kernel auto-tuning, and precision calibration. Both FP16 mixed-precision and INT8 post-training quantization are supported, with INT8 calibration performed on a representative subset of 500 samples from the training set to minimize quantization error, using TensorRT entropy (KL-divergence) calibration over the 500 samples in 63 batches of 8, with per-channel quantization for weights and per-tensor quantization for activations, and the first and last layers kept in FP16. These optimizations collectively reduce inference latency by approximately 11.8× for the INT8 student compared to the full teacher model, while the FP32 student preserves about 95.6% of the teacher’s mIoU and the INT8-quantized student still retains over 94.8% (see Section 5.5 for full numerical details), enabling real-time landslide monitoring at regional scales.

5. Experiments and Results

5.1. Experimental Settings

The proposed DIGSFNet was implemented using the PyTorch 2.1 deep learning framework and all experiments were conducted on a workstation equipped with four NVIDIA RTX 4090 GPUs (24 GB VRAM each; NVIDIA Corporation, Santa Clara, CA, USA). The AdamW optimizer [52] was employed for model parameter optimization with an initial learning rate of 6 × 10 5 and a weight decay coefficient of 5 × 10 4 . The learning rate followed a cosine annealing schedule with linear warm-up over the first five epochs to stabilize the early training dynamics. The teacher model (Swin-B backbone with SDAE and DIPD) was trained for 120 epochs with a batch size of 8, while the student model (LSNet-T backbone with the simplified decoder) was trained for 80 epochs under the knowledge distillation framework with a batch size of 16. Input images were cropped into non-overlapping patches of 512 × 512 pixels during training. Extensive online data augmentation strategies were adopted to mitigate overfitting, including random horizontal flipping, random vertical flipping, random rotation (0, 90, 180, 270), and random color jitter (brightness ± 0.2 , contrast ± 0.2 , saturation ± 0.2 , hue ± 0.05 ) for the optical modality. The corresponding spatial transforms (flipping and rotation) were applied identically to the InSAR modality to maintain strict spatial alignment, while color jitter was not applied to InSAR features since deformation values carry physical meaning. Regarding the interaction between rotation and radar geometry: the stored InSAR modality is a scalar per-pixel LOS displacement (or velocity) map rather than a vector field, so spatial rotation permutes pixel locations without altering the scalar values, and no re-projection of the LOS vector is required for the stored quantity to remain well-defined. What rotation does alter is the statistical relationship between the orientation of the deformation pattern and the (implicit) radar viewing geometry and slope aspect. We treat this as a deliberate trade-off: restricting rotations to multiples of 90 preserves the raster structure, and the augmentation encourages the network to rely on rotation-covariant deformation coherence and gradient cues rather than absolute orientation, which is desirable for cross-track generalization. A control experiment without rotation augmentation yields 83.39% mIoU (a 0.18-point drop), indicating the augmentation is mildly beneficial. The Swin-B backbone was initialized with ImageNet-22K pre-trained weights [49], while the modality-specific adapters, dynamic sparse fusion modules, and decoder components were initialized with Kaiming uniform initialization [53]. Because the residual formulation of Equation (1) keeps each adapter close to an identity mapping when its output branch is small, the randomly initialized adapters perturb the pretrained backbone representations only mildly at the start of training; combined with the five-epoch linear learning-rate warm-up, we observed no divergence or feature collapse in the early phase. Mixed-precision training (FP16) was enabled via PyTorch’s automatic mixed-precision module to accelerate training throughput.

5.2. Evaluation Metrics

To comprehensively evaluate segmentation accuracy and practical utility, we adopt the following evaluation metrics: mean Intersection over Union (mIoU), F1-score (harmonic mean of Precision and Recall), Precision, Recall, Area Under the ROC Curve (AUC), and Boundary F1-score (BF1, computed at a two-pixel tolerance threshold) for assessing segmentation quality. Additionally, Missing Rate (defined as 1 Recall ) and False Alarm Rate (defined as 1 Precision ) are reported to quantify the practical reliability of landslide detection. For computational efficiency, we report model parameters (Params, M), floating-point operations (FLOPs, G), inference speed (FPS), ONNX inference latency (ms), and INT8 inference latency (ms), all measured on a single RTX 4090 GPU with 512 × 512 input resolution. FPS and latency denote pure model inference (batch size 1), excluding data loading and preprocessing, measured with CUDA event timing after 200 warm-up iterations and averaged over 1000 timed iterations. The two-pixel tolerance of BF1 (20 m at the 10 m ground sampling distance) is chosen to match the boundary uncertainty of the reference annotations themselves—the mean inter-annotator boundary deviation on Nanning-HHLS is 1.7 pixels—so that stricter tolerances would penalize deviations smaller than the label noise; BF1 at one- and three-pixel tolerances is additionally reported in Supplementary Table S2, with unchanged method ranking. For high-risk landslide extraction, Recall and Missing Rate are particularly critical: in practical disaster prevention, it is preferable to tolerate a small number of false alarms rather than miss high-risk landslides that may pose direct threats to human lives and infrastructure.

5.3. Comparison with State-of-the-Art Methods

To validate the effectiveness of the proposed DIGSFNet, we conduct comprehensive comparisons with nine state-of-the-art semantic segmentation, multi-modal fusion, and dedicated active-landslide detection methods. The comparison methods include four single-modal architectures—U-Net [10], DeepLabV3+ [11], SegFormer [12], and Swin-UNet [54]—that were originally designed for single-modality input and were adapted to accept concatenated optical–InSAR input along the channel dimension. Additionally, four advanced fusion-capable architectures are compared: UNetFormer [55], SegMAN [56] (adapted for dual-modal input by replacing its RGB-only encoder with symmetric dual-modal branches), KTB [57] (adapted for InSAR–optical fusion following its balanced multi-modal fusion paradigm), and PDFNet [40] (adapted for the landslide extraction task by modifying its input interface). For each adapted baseline, Supplementary Table S1 specifies the exact modification performed: which encoder consumes which modality, how the input stems were reshaped, and which auxiliary branches were removed; the parameter counts reported in Table 3 and Table 4 were re-measured on the adapted variants actually trained, using the same profiler as for our model. To establish a strong landslide-specific baseline on the public benchmark, we additionally include HAEFNet [5], the reliability-aware evidence-theoretic InSAR–optical–DEM fusion network that originally accompanies the HAEFNet dataset. For a fair head-to-head comparison on Nanning-HHLS, the DEM-dependent branch of HAEFNet is disabled and the network is re-trained with InSAR + optical inputs only. All comparison methods were retrained on the same training data using their officially released code with recommended hyperparameters, and the best-performing checkpoints on the validation set were selected for fair comparison.

5.3.1. Results on the Nanning-HHLS Dataset

The quantitative evaluation results on the Nanning-HHLS dataset are presented in Table 3. Consistent with the operational priority argued in Section 5.2, we discuss Recall first: DIGSFNet achieves the highest Recall of 91.48% with a Missing Rate of only 8.52%—2.05 percentage points higher Recall than the strongest baseline HAEFNet—which is the metric of primary consequence for disaster prevention, where a missed high-risk landslide can be catastrophic while a false alarm merely costs verification effort (at the instance level this corresponds to six fewer missed high-risk landslides on the test set). Overall, the proposed DIGSFNet achieves the best performance across all accuracy-related metrics, attaining an mIoU of 83.57%, outperforming the second-best method HAEFNet (re-trained with InSAR + optical inputs) by 2.63% in terms of mIoU and 1.64% in terms of F1-score. The superior Boundary F1-score of 82.34% further demonstrates the effectiveness of the deformation integrity prior in the DIPD module for producing boundary-accurate landslide masks that faithfully delineate the extent of the sliding body. All headline results are reported as the mean over three independent runs with different random seeds; standard deviations and paired significance tests against HAEFNet are given in Section 5.7.
Among the single-modal architectures adapted for dual-modal input, U-Net and DeepLabV3+ achieve moderate performance, yet they fail to detect landslides on vegetated slopes where spectral changes are subtle but deformation signals are prominent. SegFormer and Swin-UNet improve upon the CNN-based methods by capturing longer-range spatial dependencies through self-attention, yet they still suffer from fragmented predictions and elevated false alarm rates due to the lack of deformation-aware constraints. The multi-modal fusion methods—SegMAN, KTB, PDFNet, and HAEFNet—demonstrate improved performance over single-modal baselines by incorporating InSAR information, confirming the value of deformation data for landslide identification. Among them, HAEFNet, which is specifically tailored for active-landslide detection through evidence-theoretic InSAR–optical fusion, ranks second on the Nanning-HHLS dataset, validating its strong design but also revealing that its reliability-aware fusion paradigm is still vulnerable to the karstic, densely-vegetated subtropical terrain that characterizes Guangxi. The asymmetric or insufficiently exploitative fusion strategies of the remaining baselines lead to sub-optimal deformation feature utilization, resulting in lower Recall and higher Missing Rate compared with the proposed symmetric fusion approach. DIGSFNet outperforms HAEFNet by 2.05% in Recall and 4.48% in BF1, indicating that the symmetric modality treatment and deformation integrity constraints provide substantial advantages for identifying complete and accurately bounded landslide regions.

5.3.2. Results on the Public Dataset

To further validate that the architectural design of the proposed method is not specific to a single geomorphological setting, we conduct additional experiments on the publicly available HAEFNet benchmark [5], which covers active-landslide-prone regions in the Qinghai–Tibet Plateau and Sichuan—geological environments that differ substantially from the karstic, subtropical Nanning study area in terms of lithology, vegetation cover, slope failure mechanisms, and climatic forcing. The HAEFNet dataset provides spatially co-registered Sentinel-1 InSAR mean LOS rate, Sentinel-2 RGB imagery, and Copernicus GLO-30 DEM. To keep the experimental protocol consistent with the Nanning-HHLS experiments and with the rationale in Section 6.2, the DEM channel is ignored, and DIGSFNet is independently trained and evaluated on this benchmark under its full dual-modal (InSAR + optical) configuration; the only architectural change is that the first input convolution of the optical stem is reshaped from 10 to 3 channels to match the RGB input of the HAEFNet dataset, while all other modules remain unchanged. All baselines that originally consume DEM (i.e., HAEFNet) are likewise re-trained without the DEM branch, while all other baselines use InSAR + optical inputs identical to the Nanning-HHLS setup, ensuring a strictly head-to-head comparison. We emphasize that this protocol evaluates how well the architecture generalizes when retrained on each region in turn, rather than a single-model zero-shot transfer between regions; a true cross-region transfer experiment is left as future work.
The corresponding results are presented in Table 4. DIGSFNet maintains its superior performance on this geomorphologically distinct benchmark, achieving 78.92% mIoU and 88.14% F1-score, which surpass the second-best method HAEFNet by 3.68% mIoU and 2.30% F1-score. The consistent performance advantage observed when the same architecture is independently trained on two datasets with substantially different geological and climatic conditions indicates that the architectural inductive biases of DIGSFNet—symmetric modality treatment and deformation-integrity priors—are not tied to any single region. In particular, the gap between DIGSFNet and HAEFNet on the HAEFNet benchmark is even larger than on Nanning-HHLS, suggesting that the symmetric deformation-aware encoder and the deformation integrity prior remain effective when applied to high-altitude, sparsely vegetated terrain where the InSAR signal-to-noise characteristics, optical reflectance statistics, and landslide morphology all differ from the Nanning study area. Importantly, the absolute mIoU lead of DIGSFNet over the runner-up method actually widens on the more challenging benchmark—from 2.63% on Nanning-HHLS (against HAEFNet) to 3.68% on the HAEFNet benchmark (also against HAEFNet)—and the lead in BF1 likewise grows from 4.48% to 5.27%. This indicates that the deformation-integrity prior and the symmetric encoder both contribute to robustness when the network is retrained on regions of varying difficulty, while all methods reach a lower absolute mIoU on the HAEFNet benchmark, which is consistent with its larger spectral and geomorphological diversity.

5.3.3. Qualitative Comparison

The qualitative comparison results are visualized in Figure 5, where we present the segmentation outputs of all compared methods on several representative challenging scenes drawn from both datasets. On densely vegetated subtropical slopes of Nanning-HHLS where the optical appearance is highly ambiguous, single-modal methods (U-Net, DeepLabV3+) produce significant false-negative errors, missing large portions of the high-risk landslide area. In contrast, DIGSFNet accurately delineates these regions by effectively leveraging InSAR deformation information through the symmetric fusion mechanism. On the high-altitude, sparsely-vegetated slopes of the HAEFNet Qinghai–Tibet scenes, the dominant failure mode shifts to false alarms triggered by glacial moraine textures, periglacial scree, and non-landslide creep; DIGSFNet correctly suppresses these false detections owing to the deformation-integrity constraint that decouples landslide-style continuous deformation from broader-scale periglacial signals. Small isolated target landslides that occupy only a few dozen pixels are completely missed by most comparison methods on both datasets, whereas DIGSFNet successfully detects them. Existing methods also produce pronounced false alarms in regions with non-landslide deformation sources such as construction activities and mining subsidence, while DIGSFNet correctly suppresses these false detections. Furthermore, existing fusion methods (SegMAN, KTB) generate fragmented masks with broken boundaries and even HAEFNet, despite its evidence-theoretic reliability weighting, occasionally produces over-confident yet boundary-inaccurate masks at the periphery of the sliding body; in contrast, DIGSFNet produces spatially complete and boundary-accurate predictions on both datasets, demonstrating the effectiveness of the boundary gradient alignment constraint in the DIPD.

5.4. Ablation Studies

To systematically validate the effectiveness and necessity of each proposed component, we conduct comprehensive ablation studies on the Nanning-HHLS dataset. Both “progressive addition” and “component removal” strategies are employed to provide a thorough analysis. The eleven ablation configurations and their corresponding results are presented in Table 5, with representative qualitative improvements across configurations visualized in Figure 6.
Single-modal baselines (Configs 1–2). The optical-only baseline (Config 1) achieves 74.12% mIoU, providing a strong baseline due to the rich spectral-textural information available in the optical modality. The InSAR-only baseline (Config 2) achieves 71.85% mIoU, which is lower than the optical baseline but still demonstrates meaningful landslide identification capability, confirming the intrinsic value of deformation information for this task. The performance gap between the two single-modal baselines motivates the design of a fusion framework that can fully exploit the complementary strengths of both modalities.
Fusion strategy comparison (Configs 3–5). Direct concatenation of optical and InSAR inputs along the channel dimension (Config 3) improves upon the optical-only baseline by 2.30% in mIoU, demonstrating the basic benefit of incorporating InSAR data. Asymmetric fusion (Config 4), where InSAR features are fed as auxiliary inputs to the optical backbone through a cross-attention mechanism, achieves a further improvement of 2.14% over direct concatenation. The proposed symmetric fusion with SDAE (Config 5) yields the most substantial improvement, surpassing direct concatenation by 4.61% in mIoU and surpassing asymmetric fusion by 2.47%. Notably, the improvement in Recall is particularly pronounced (3.15% over asymmetric fusion), confirming that symmetric modality treatment enables more effective exploitation of deformation signals for detecting high-risk landslides that might otherwise be missed when InSAR features are suppressed by the dominant optical branch.
DIPD decoder component analysis (Configs 5–7, 9). Comparing Config 5 (SDAE only, without DIPD) with Config 9 (full DIGSFNet), the addition of the DIPD module brings an improvement of 2.54% in mIoU and a particularly significant 5.52% improvement in BF1, validating the effectiveness of deformation integrity priors for boundary refinement. Removing the deformation integrity loss (i.e., setting λ 1 = λ 2 = 0 while keeping L s e g and L s s i m , Config 6) causes a 1.71% drop in mIoU and a 4.22% drop in BF1 compared with the full model, demonstrating its critical role in ensuring spatial completeness and boundary accuracy. Removing the fine-grained patch decoder (Config 7) results in a 2.89% decrease in BF1, confirming its targeted effectiveness for local boundary refinement in regions with high prediction uncertainty and strong deformation gradients. We further note that the cumulative impact of removing individual DIPD sub-components (1.71% + 0.93% in mIoU) is larger than the single-step DIPD-overall improvement (2.54%), indicating positive interaction effects among modules.
SDAE auxiliary mechanism analysis (Config 8). Removing the dual-modal self-teaching mechanism (which is part of the SDAE encoder rather than the DIPD decoder) leads to a 1.42% decrease in mIoU compared with the full model. This degradation is qualitatively most apparent in scenes containing degraded InSAR coherence or partial cloud cover in the optical modality, validating its contribution to cross-modal robustness when one modality is partially corrupted.
Knowledge distillation evaluation (Configs 9–11). The LDSN student model trained without knowledge distillation (Config 10) achieves 76.48% mIoU with only 12.8% of the teacher’s parameters and 12.8% of the FLOPs, representing a baseline for the lightweight architecture. With full cross-modal knowledge distillation (Config 11), the student model’s mIoU improves to 79.92%, recovering approximately 95.63% of the teacher’s performance.
Contribution of individual distillation levels. To attribute the distillation gain to its three components, Table 6 ablates the mask-level, feature-level, and deformation-prior terms individually and in combination. Each level contributes positively; deformation-prior distillation yields the largest single-term BF1 gain ( + 3.32 points over the no-distillation baseline), and the three levels are complementary, the full combination recovering 95.63% of the teacher mIoU.
Architectural merit versus model capacity. To distinguish architectural effects from capacity effects, we consider three observations. First, the capacity gap to the strongest baselines is moderate (HAEFNet: 76.32 M; PDFNet: 71.85 M), yet the accuracy gap widens rather than narrows on the benchmark for which HAEFNet was designed (Table 4). Second, Configs 3–9 in Table 5 constitute a capacity-controlled comparison: all share the same Swin-B backbone with nearly identical parameter counts (85.42–88.46 M), yet span 76.42–83.57% mIoU; a 7.15-point spread produced at essentially constant capacity, with the entire increment from Config 3 to Config 9 costing only +3.04 M parameters (+3.6%), is attributable to the architectural mechanisms rather than to size. Third, the distilled student (11.32 M, smaller than every compared baseline) still reaches 79.92% mIoU, within 1.02 points of the strongest 76 M-scale baseline (HAEFNet, 80.94%), which would not be possible if the improvements were primarily a capacity effect.

5.5. Lightweight Deployment Evaluation

To demonstrate the practical deployability of the proposed method for large-area landslide hazard surveys, we conduct a systematic efficiency comparison between the teacher model and the student model under different optimization configurations. The results are presented in Table 7.
The efficiency comparison results demonstrate that the LDSN student model achieves a highly favorable accuracy–efficiency trade-off suitable for practical deployment. The Student (FP32) model reduces the parameter count by 7.81× and FLOPs by 7.82× compared with the teacher model, with an mIoU degradation of only 3.65%. After FP16 optimization, the inference speed is further improved to 142 FPS with negligible accuracy loss (about 0.06% mIoU drop). The fully optimized Student (INT8) model achieves the most aggressive compression, reducing inference latency by 11.78× (comparing the FP32 teacher’s ONNX latency with the INT8 student’s TensorRT latency) compared with the teacher while maintaining 79.24% mIoU. We note that this 11.78× end-to-end latency reduction is not expected to be proportional to the 7.82× FLOPs reduction: FLOPs is a precision-independent operation count comparing architectures, whereas the latency figure compounds three multiplicative factors—the architectural FLOPs reduction, the higher throughput of INT8 integer arithmetic, and TensorRT graph optimizations (layer fusion and reduced memory traffic); latency on modern GPUs is, moreover, partly memory-bandwidth-bound rather than purely compute-bound. The like-for-like architectural comparison at equal precision is FP32 teacher (54.2 ms, ONNX) versus FP32 student (13.2 ms, ONNX), i.e., 4.1×. At 218 FPS with 4.6 ms per-frame latency and only 0.54 GB GPU memory consumption, the INT8 student model enables rapid inference across large areas, meeting the practical requirements for operational landslide hazard surveys where thousands of square kilometers must be processed within constrained time budgets. These results confirm that the proposed cross-modal knowledge distillation and quantization pipeline successfully preserves the teacher’s deformation-aware segmentation capability in a deployment-ready lightweight model.

5.6. Sensitivity Analysis

We conduct a sensitivity analysis on six key hyperparameters to provide practical guidance for model configuration. The hyperparameters examined include the loss weights ( λ 1 , λ 2 , λ 3 ) controlling the contribution of the boundary gradient alignment loss, intra-region consistency loss, and structural similarity loss, respectively; the adapter bottleneck dimension (r); the sparsity ratio ( ρ ) in the dynamic sparse cross-modal fusion module; and the fine-grained patch size in the DIPD. Each hyperparameter is varied independently while keeping all others fixed at their default values, and both mIoU and F1-score are recorded.
The sensitivity analysis results presented in Figure 7 indicate that DIGSFNet exhibits robust and stable performance across a reasonable range of hyperparameter values for all six parameters. The scans cover λ 1 { 0.01 , 0.05 , 0.1 , 0.2 , 0.5 , 1.0 , 2.0 } and λ 2 { 0.01 , 0.05 , 0.1 , 0.2 , 0.5 , 1.0 , 2.0 , 5.0 } . As shown in Figure 7a,b, mIoU peaks at λ 1 = 0.5 (83.57%) and declines to 83.31% and 82.87% at λ 1 = 1.0 and 2.0 , and peaks at λ 2 = 1.0 (83.57%), decreasing to 83.29% and 82.61% at λ 2 = 2.0 and 5.0 ; the adopted defaults are therefore interior optima. Within the explored ranges, mIoU varies by less than 0.85% for λ 1 , λ 2 [ 0.05 , 0.5 ] . For λ 3 , the curve is comparatively flat over [ 0.1 , 0.5 ] —the mIoU variation across this interval is 0.12 points (83.45 at λ 3 = 0.1 , 83.57 at the peak, 83.50 at λ 3 = 0.5 ; Figure 7c)—and reaches its peak at λ 3 = 0.2 , which is therefore adopted as the default; this confirms that the structural similarity constraint provides a stable regularization effect without requiring careful tuning. The adapter bottleneck dimension r = 64 provides the best accuracy–efficiency trade-off: smaller values ( r 32 ) lead to insufficient modality-specific adaptation capacity, while larger values ( r 128 ) yield marginal accuracy gains at the cost of increased parameters. The sparsity ratio ρ = 0.3 achieves the highest mIoU by balancing effective cross-modal information exchange and noise suppression; setting ρ = 1.0 (no sparsity, full dense fusion) results in a 1.46% mIoU drop, confirming the importance of selective fusion for suppressing noise from contradictory cross-modal signals. The fine-grained patch size of 64 achieves the best boundary refinement performance, as smaller patches (16) lack sufficient spatial context while larger patches (128) dilute the local refinement focus.

5.7. Statistical Significance, Instance-Level Detection, and Uncertainty Analysis

We conducted three complementary analyses of statistical robustness, instance-level detection, and predictive uncertainty. (1) Repeated-run statistics and significance tests. All DIGSFNet and HAEFNet results were re-run with three random seeds; Table 8 reports mean ± standard deviation on both datasets, together with paired two-sided t-tests over per-image IoU between DIGSFNet and HAEFNet. DIGSFNet attains 83.57 ± 0.18 vs. 80.94 ± 0.21 mIoU on Nanning-HHLS ( p < 0.01 ), and 78.92 ± 0.24 vs. 75.24 ± 0.27 on the HAEFNet benchmark ( p < 0.01 ). (2) Instance-level detection analysis. Complementing the pixel-level metrics, a landslide instance is counted as detected if its instance-level IoU exceeds 0.5; the instance-level analysis shows that DIGSFNet detects 87/94 test instances (92.6%) versus 81/94 (86.2%) for HAEFNet on Nanning-HHLS, with instance-level false-discovery rates of 7.4% and 11.8%, respectively. (3) Confidence and uncertainty maps. Figure 8 visualizes predicted probability maps and Monte-Carlo-dropout uncertainty maps for representative ambiguous scenes (densely vegetated slopes, mining areas, small landslides). As shown in Figure 8, uncertainty concentrates at boundary transition zones and at non-landslide deformation sources, while landslide interiors are predicted with high confidence, consistent with the intended effect of the deformation-integrity priors.

6. Discussion

6.1. Advantages of Symmetric Fusion over Asymmetric Approaches

The ablation study results (Configs 4 vs. 5 in Table 5) quantitatively demonstrate the advantage of symmetric modality treatment over asymmetric fusion, with the proposed SDAE yielding a 2.47% higher mIoU and a 3.15% higher Recall than the asymmetric baseline. The pronounced gain in Recall—which corresponds to a substantial reduction in missed high-risk landslides—is particularly significant for high-risk landslide extraction, where undetected hazards can lead to severe consequences.
This advantage can be attributed to two complementary design choices in SDAE. First, the modality-aware parameter-efficient adapters allocate dedicated learnable capacity to each modality, ensuring that the InSAR branch develops specialized representations of displacement velocity gradients, coherence degradation signatures, and phase anomaly patterns rather than being implicitly forced to mimic the optical branch’s pre-trained feature hierarchy. Under an asymmetric architecture, in contrast, the InSAR auxiliary branch receives weaker gradient signals during training and tends to converge to a feature distribution that is dominated by the optical stream, thereby diluting the diagnostic value of deformation observations. Second, the dynamic sparse cross-modal fusion (DSCF) selectively exchanges complementary information only at spatially informative locations through a symmetric query–key–value formulation, preventing the optical features—which possess richer pre-trained statistics—from overwhelming the InSAR features during fusion. Together, these two mechanisms elevate InSAR from an auxiliary channel to an equal information source, allowing the network to exploit deformation signals that are essential for distinguishing actively deforming slopes from optically similar but stable terrain. The empirical recall improvement observed on the Nanning-HHLS dataset is fully consistent with this design rationale.

6.2. Effectiveness of Deformation Integrity Prior

The deformation integrity prior introduced in the DIPD addresses a critical weakness of existing segmentation methods: the production of spatially fragmented and boundary-inaccurate landslide masks. The ablation results (Configs 6–7 in Table 5) confirm the quantitative contribution of this design, with the deformation integrity loss contributing 1.71% improvement in mIoU and 4.22% in Boundary F1. Qualitatively, the deformation integrity loss serves two complementary functions. First, the intra-region consistency constraint penalizes high deformation variance within predicted landslide regions, effectively merging fragmented patches that belong to the same landslide body into spatially complete masks. Second, the boundary gradient alignment constraint guides the predicted boundaries toward deformation field discontinuities, producing physically meaningful delineation that aligns with actual geomorphological boundaries. A particularly important benefit is the suppression of false alarms from non-landslide deformation sources. Mining subsidence typically exhibits concentric deformation patterns with sharp circular boundaries, construction activities produce spatially confined and temporally abrupt deformation, and agricultural land settlement presents low-coherence diffuse patterns. These deformation signatures differ fundamentally from the continuous, gradient-consistent patterns of coherent landslide motion. The deformation integrity constraints implicitly encode these physical differences, enabling the network to correctly reject non-landslide deformation regions without requiring explicit negative class annotations. This physical interpretability distinguishes our approach from purely data-driven boundary refinement methods.
The deformation signals of potential and already-occurred landslides can be separated into three cases. (i) Post-failure deposits that have stabilized no longer produce coherent present-day deformation and are excluded by criterion (i) of the definition in Section 1; during annotation, historical-inventory polygons without a current InSAR signal were labeled as background. (ii) Reactivated old landslide bodies undergoing renewed creep satisfy all three criteria and are legitimately labeled as high-risk targets. (iii) Non-landslide deformation sources are distinguished jointly by the supervised segmentation objective and the learned cross-modal features, while the deformation-integrity regularizers refine spatial coherence and boundaries. Supplementary Figure S1 illustrates the InSAR-branch feature responses, dynamic sparse gate maps G l , and prediction evolution with and without the deformation-integrity loss for representative scenes; together with the ablation path in Table 5 (Configs 1→3→5→9: 74.12→76.42→81.03→83.57 mIoU), these results connect each performance increment to its architectural cause.
The same physical rationale informs our exclusion of DEM inputs, for two core reasons. First, for high-risk landslide extraction—as opposed to susceptibility mapping—dynamic deformation evidence of ongoing movement carries greater diagnostic value than static terrain attributes describing predisposition. Second, DEM quality is a practical concern: in Guangxi’s densely vegetated mountains, freely available DEMs suffer from substantial canopy-induced errors and temporal mismatch with the observation period. In a controlled ablation on the HAEFNet benchmark, we appended GLO-30 DEM as an extra input channel to DIGSFNet. The resulting mIoU of 79.05% (vs. 78.92% without DEM) is within the run-to-run standard deviation reported in Table 8, and the DEM ablation of the re-trained HAEFNet reported in Table 4 points in the same direction.

6.3. Limitations and Future Work

Despite the encouraging results achieved by DIGSFNet, several limitations warrant acknowledgment. First, the Nanning-HHLS dataset is geographically confined to a single region characterized by karst topography, subtropical monsoon climate, and specific landslide types. Although the experiments on the HAEFNet public benchmark—covering the Qinghai–Tibet Plateau and Sichuan active-landslide regions—show that the architecture, when independently retrained, also performs well on a geomorphologically distinct region, comprehensive validation across additional geological environments (e.g., loess plateau, volcanic terrain, coastal cliff systems) and a true zero-shot cross-region transfer experiment remain necessary to fully establish the method’s robustness. Second, the current approach represents the temporal InSAR record by a single line-of-sight summary map (cumulative displacement for Nanning-HHLS and mean velocity for the HAEFNet benchmark) rather than the full displacement time series, which may sacrifice valuable temporal dynamics of the deformation evolution process. Concretely, this compression discards acceleration signatures of progressive failure, seasonal and rainfall-driven periodicity, and the ability to distinguish steady creep from transient motion; it was nevertheless adopted here to provide a uniform input interface across datasets whose released products differ and to retain single-epoch inference for operational surveys. Modeling the full displacement time series through temporal query propagation or temporal attention mechanisms could potentially capture deformation acceleration patterns indicative of impending slope failure. Third, the proposed method performs binary segmentation (landslide vs. non-landslide) and does not predict landslide risk levels or activity stages. Future work will address these limitations through three directions: (1) temporal-aware architectures that model displacement time-series evolution for early warning applications; (2) multi-class risk-level segmentation that distinguishes low-risk, moderate-risk, and high-risk landslides; and (3) integration of geological prior knowledge graphs to enhance cross-region transferability.

7. Conclusions

This paper proposes DIGSFNet, a novel Deformation-Integrity-Guided Symmetric Fusion Network for high-risk landslide extraction from multi-source remote sensing images, which explicitly addresses the modality imbalance, spatial fragmentation, and computational efficiency challenges that hamper existing InSAR–optical fusion methods. The proposed framework introduces three key innovations: (1) the Symmetric Deformation-Aware Encoder (SDAE) treats InSAR and optical modalities as equal information sources through parameter-efficient symmetric adapters and dynamic sparse cross-modal fusion, effectively alleviating the representational imbalance inherent in asymmetric fusion approaches; (2) the Deformation Integrity Prior Decoder (DIPD) leverages InSAR deformation continuity and boundary gradient consistency as physically interpretable constraints, enabling the network to produce spatially complete and boundary-accurate landslide masks while suppressing false alarms from non-landslide deformation sources; (3) the Lightweight Deployable Student Network (LDSN) achieves efficient large-area deployment through cross-modal knowledge distillation and INT8 quantization with minimal accuracy degradation. Extensive experiments on the Nanning-HHLS dataset and the public HAEFNet multimodal active-landslide benchmark [5] covering the Qinghai–Tibet Plateau and Sichuan demonstrate that DIGSFNet consistently achieves state-of-the-art performance across mIoU, F1-score, Recall, and Boundary F1 metrics when independently trained on each of these geomorphologically distinct regions, while the lightweight student model enables practical deployment for large-area landslide hazard surveys. In future work, we will extend DIGSFNet to incorporate temporal InSAR time-series modeling and multi-class risk-level prediction, aiming toward a comprehensive landslide hazard assessment framework with enhanced temporal awareness and geological knowledge integration.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/rs18162692/s1.

Author Contributions

Conceptualization, Z.N. and H.S.; methodology, Z.N.; software, Z.N. and L.H.; validation, L.H., H.W. and F.L.; formal analysis, Z.N. and M.T.; investigation, Z.N., L.H. and H.W.; resources, G.M. and H.S.; data curation, L.H. and G.M.; writing—original draft preparation, Z.N.; writing—review and editing, H.W., F.L., M.T., G.M. and H.S.; visualization, Z.N. and F.L.; supervision, G.M. and H.S.; project administration, H.S.; funding acquisition, H.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (NSFC) General Program (42271416) and the Hubei Provincial Technical Innovation Plan Project (2024BCB103).

Data Availability Statement

The Nanning-HHLS dataset generated and analyzed during the current study is available from the corresponding author upon reasonable request. The public HAEFNet multimodal active-landslide benchmark used in this work is available from the cited source [5] and at https://github.com/SAR-Disaster/HAEFNet (accessed on 30 July 2026).

Acknowledgments

The authors thank the providers of Sentinel-1 and Sentinel-2 observations and the geological interpreters who supported annotation quality control.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Hungr, O.; Leroueil, S.; Picarelli, L. The Varnes Classification of Landslide Types, an Update. Landslides 2014, 11, 167–194. [Google Scholar]
  2. Cruden, D.M.; Varnes, D.J. Landslide Types and Processes. In Landslides: Investigation and Mitigation; Turner, A.K., Schuster, R.L., Eds.; Transportation Research Board Special Report 247; National Academy Press: Washington, DC, USA, 1996; pp. 36–75. [Google Scholar]
  3. Casagli, N.; Intrieri, E.; Tofani, V.; Gigli, G.; Raspini, F. Landslide Detection, Monitoring and Prediction with Remote-Sensing Techniques. Nat. Rev. Earth Environ. 2023, 4, 51–64. [Google Scholar] [CrossRef]
  4. Wasowski, J.; Bovenga, F. Investigating Landslides and Unstable Slopes with Satellite Multi Temporal Interferometry: Current Issues and Future Perspectives. Eng. Geol. 2014, 174, 103–138. [Google Scholar] [CrossRef]
  5. Fan, Y.; Zhang, H.; Xu, Z.; Zhang, Y.; Guo, Z.; Guan, S.; Duan, H.; Tang, Y. Reliability-Aware Multimodal Detection of Active Landslides via Evidence-Theoretic Fusion of InSAR, Optical, and DEM Data. Comput. Geosci. 2026, 211, 106139. [Google Scholar] [CrossRef]
  6. Berardino, P.; Fornaro, G.; Lanari, R.; Sansosti, E. A New Algorithm for Surface Deformation Monitoring Based on Small Baseline Differential SAR Interferograms. IEEE Trans. Geosci. Remote Sens. 2002, 40, 2375–2383. [Google Scholar] [CrossRef]
  7. Crosetto, M.; Monserrat, O.; Cuevas-González, M.; Devanthéry, N.; Crippa, B. Persistent Scatterer Interferometry: A Review. ISPRS J. Photogramm. Remote Sens. 2016, 115, 78–89. [Google Scholar] [CrossRef]
  8. Mohan, A.; Singh, A.K.; Kumar, B.; Dwivedi, R. Review on Remote Sensing Methods for Landslide Detection Using Machine and Deep Learning. Trans. Emerg. Telecommun. Technol. 2021, 32, e3998. [Google Scholar]
  9. Ghorbanzadeh, O.; Blaschke, T.; Gholamnia, K.; Meena, S.R.; Tiede, D.; Aryal, J. Evaluation of Different Machine Learning Methods and Deep-Learning Convolutional Neural Networks for Landslide Detection. Remote Sens. 2019, 11, 196. [Google Scholar] [CrossRef]
  10. Ronneberger, O.; Fischer, P.; Brox, T. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Proceedings of the Medical Image Computing and Computer-Assisted Intervention (MICCAI), Munich, Germany, 5–9 October 2015; pp. 234–241. [Google Scholar]
  11. Chen, L.-C.; Zhu, Y.; Papandreou, G.; Schroff, F.; Adam, H. Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. In Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany, 8–14 September 2018; pp. 801–818. [Google Scholar]
  12. Xie, E.; Wang, W.; Yu, Z.; Anandkumar, A.; Alvarez, J.M.; Luo, P. SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers. In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Online, 6–14 December 2021; pp. 12077–12090. [Google Scholar]
  13. Hu, J.; Shen, L.; Sun, G. Squeeze-and-Excitation Networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA, 18–22 June 2018; pp. 7132–7141. [Google Scholar]
  14. Woo, S.; Park, J.; Lee, J.-Y.; Kweon, I.S. CBAM: Convolutional Block Attention Module. In Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany, 8–14 September 2018; pp. 3–19. [Google Scholar]
  15. Lin, T.-Y.; Dollár, P.; Girshick, R.; He, K.; Hariharan, B.; Belongie, S. Feature Pyramid Networks for Object Detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017; pp. 2117–2125. [Google Scholar]
  16. Chen, L.-C.; Papandreou, G.; Kokkinos, I.; Murphy, K.; Yuille, A.L. DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 2018, 40, 834–848. [Google Scholar] [CrossRef] [PubMed]
  17. Zhao, C.; Lu, Z.; Zhang, Q.; de la Fuente, J. Large-Area Landslide Detection and Monitoring with ALOS/PALSAR Imagery Data over Northern California and Southern Oregon, USA. Remote Sens. Environ. 2012, 124, 348–359. [Google Scholar] [CrossRef]
  18. Wang, J.; Fan, H.; Tuo, W.; Ren, Y. A Multi-Channel Convolutional Neural Network Model for Detecting Active Landslides Using Multi-Source Fusion Images. Remote Sens. 2026, 18, 126. [Google Scholar]
  19. Li, N.; Feng, G.; Zhao, Y.; Xiong, Z.; He, L.; Wang, X.; Wang, W.; An, Q. A Deep-Learning-Based Algorithm for Landslide Detection over Wide Areas Using InSAR Images Considering Topographic Features. Sensors 2024, 24, 4583. [Google Scholar] [CrossRef] [PubMed]
  20. Zhao, W.; Zhang, J.; Cai, J.; Ming, D. Hybrid-SegUFormer: A Hybrid Multi-Scale Network with Self-Distillation for Robust Landslide InSAR Deformation Detection. Remote Sens. 2025, 17, 3514. [Google Scholar] [CrossRef]
  21. Ji, S.; Yu, D.; Shen, C.; Li, W.; Xu, Q. Landslide Detection from an Open Satellite Imagery and Digital Elevation Model Dataset Using Attention Boosted Convolutional Neural Networks. Landslides 2020, 17, 1337–1352. [Google Scholar] [CrossRef]
  22. Hazirbas, C.; Ma, L.; Domokos, C.; Cremers, D. FuseNet: Incorporating Depth as Input and Output. In Proceedings of the Asian Conference on Computer Vision (ACCV), Taipei, Taiwan, 20–24 November 2016; pp. 213–228. [Google Scholar]
  23. Milletari, F.; Navab, N.; Ahmadi, S.-A. V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation. In Proceedings of the International Conference on 3D Vision (3DV), Stanford, CA, USA, 25–28 October 2016; pp. 565–571. [Google Scholar]
  24. Liu, Z.; Lin, Y.; Cao, Y.; Hu, H.; Wei, Y.; Zhang, Z.; Lin, S.; Guo, B. Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada, 11–17 October 2021; pp. 10012–10022. [Google Scholar]
  25. Pradhan, B. A Comparative Study on the Predictive Ability of the Decision Tree, Support Vector Machine and Neuro-Fuzzy Models in Landslide Susceptibility Mapping Using GIS. Comput. Geosci. 2013, 51, 350–365. [Google Scholar] [CrossRef]
  26. Catani, F.; Lagomarsino, D.; Segoni, S.; Tofani, V. Landslide Susceptibility Estimation by Random Forests Technique: Sensitivity and Scaling Issues. Nat. Hazards Earth Syst. Sci. 2013, 13, 2815–2831. [Google Scholar] [CrossRef]
  27. Martha, T.R.; Kerle, N.; Jetten, V.; van Westen, C.J.; Kumar, K.V. Characterising Spectral, Spatial and Morphometric Properties of Landslides for Semi-Automatic Detection Using Object-Oriented Methods. Geomorphology 2010, 116, 24–36. [Google Scholar] [CrossRef]
  28. Yi, Y.; Zhang, W. A New Deep-Learning-Based Approach for Earthquake-Triggered Landslide Detection from Single-Temporal RapidEye Satellite Imagery. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2020, 13, 6166–6176. [Google Scholar] [CrossRef]
  29. Zhao, H.; Shi, J.; Qi, X.; Wang, X.; Jia, J. Pyramid Scene Parsing Network. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017; pp. 2881–2890. [Google Scholar]
  30. Schmitt, M.; Zhu, X.X. Data Fusion and Remote Sensing: An Ever-Growing Relationship. IEEE Geosci. Remote Sens. Mag. 2016, 4, 6–23. [Google Scholar] [CrossRef]
  31. Mondini, A.C.; Guzzetti, F.; Chang, K.-T.; Monserrat, O.; Martha, T.R.; Manconi, A. Landslide Failures Detection and Mapping Using Synthetic Aperture Radar: Past, Present and Future. Earth-Sci. Rev. 2021, 216, 103574. [Google Scholar] [CrossRef]
  32. Valada, A.; Mohan, R.; Burgard, W. Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. Int. J. Comput. Vis. 2020, 128, 1239–1285. [Google Scholar] [CrossRef]
  33. Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, Ł.; Polosukhin, I. Attention Is All You Need. In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Long Beach, CA, USA, 4–9 December 2017; pp. 5998–6008. [Google Scholar]
  34. Park, S.-J.; Hong, K.-S.; Lee, S. RDFNet: RGB-D Multi-Level Residual Feature Fusion for Indoor Semantic Segmentation. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 22–29 October 2017; pp. 4980–4989. [Google Scholar]
  35. Seichter, D.; Köhler, M.; Lewandowski, B.; Wengefeld, T.; Gross, H.-M. Efficient RGB-D Semantic Segmentation for Indoor Scene Analysis. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China, 30 May–5 June 2021; pp. 13525–13531. [Google Scholar]
  36. Zhang, J.; Liu, H.; Yang, K.; Hu, X.; Liu, R.; Stiefelhagen, R. CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers. IEEE Trans. Intell. Transp. Syst. 2023, 24, 14679–14694. [Google Scholar] [CrossRef]
  37. Wang, Y.; Chen, X.; Cao, L.; Huang, W.; Sun, F.; Wang, Y. Multimodal Token Fusion for Vision Transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 19–24 June 2022; pp. 12186–12195. [Google Scholar]
  38. Sun, Y.; Zuo, W.; Liu, M. RTFNet: RGB-Thermal Fusion Network for Semantic Segmentation of Urban Scenes. IEEE Robot. Autom. Lett. 2019, 4, 2576–2583. [Google Scholar] [CrossRef]
  39. Houlsby, N.; Giurgiu, A.; Jastrzebski, S.; Morrone, B.; de Laroussilhe, Q.; Gesmundo, A.; Attariyan, M.; Gelly, S. Parameter-Efficient Transfer Learning for NLP. In Proceedings of the International Conference on Machine Learning (ICML), Long Beach, CA, USA, 9–15 June 2019; pp. 2790–2799. [Google Scholar]
  40. Liu, X.; Fu, K.; Zhao, Q. High-Precision Dichotomous Image Segmentation via Depth Integrity-Prior and Fine-Grained Patch Strategy. arXiv 2025, arXiv:2503.06100. [Google Scholar]
  41. Audebert, N.; Le Saux, B.; Lefèvre, S. Beyond RGB: Very High Resolution Urban Remote Sensing with Multimodal Deep Networks. ISPRS J. Photogramm. Remote Sens. 2018, 140, 20–32. [Google Scholar] [CrossRef]
  42. Sandler, M.; Howard, A.; Zhu, M.; Zhmoginov, A.; Chen, L.-C. MobileNetV2: Inverted Residuals and Linear Bottlenecks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA, 18–22 June 2018; pp. 4510–4520. [Google Scholar]
  43. Tan, M.; Le, Q.V. EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. In Proceedings of the International Conference on Machine Learning (ICML), Long Beach, CA, USA, 9–15 June 2019; pp. 6105–6114. [Google Scholar]
  44. Wang, A.; Chen, H.; Lin, Z.; Han, J.; Ding, G. LSNet: See Large, Focus Small. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 11–15 June 2025. [Google Scholar]
  45. Yu, C.; Gao, C.; Wang, J.; Yu, G.; Shen, C.; Sang, N. BiSeNet V2: Bilateral Network with Guided Aggregation for Real-Time Semantic Segmentation. Int. J. Comput. Vis. 2021, 129, 3051–3068. [Google Scholar] [CrossRef]
  46. Hinton, G.; Vinyals, O.; Dean, J. Distilling the Knowledge in a Neural Network. arXiv 2015, arXiv:1503.02531. [Google Scholar]
  47. Liu, Y.; Chen, K.; Liu, C.; Qin, Z.; Luo, Z.; Wang, J. Structured Knowledge Distillation for Semantic Segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 15–20 June 2019; pp. 2604–2613. [Google Scholar]
  48. Jacob, B.; Kligys, S.; Chen, B.; Zhu, M.; Tang, M.; Howard, A.; Adam, H.; Kalenichenko, D. Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA, 18–22 June 2018; pp. 2704–2713. [Google Scholar]
  49. Deng, J.; Dong, W.; Socher, R.; Li, L.-J.; Li, K.; Fei-Fei, L. ImageNet: A Large-Scale Hierarchical Image Database. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA, 20–25 June 2009; pp. 248–255. [Google Scholar]
  50. Qin, D.; Leichner, C.; Delakis, M.; Fornoni, M.; Luo, S.; Yang, F.; Wang, W.; Banbury, C.; Ye, C.; Akin, B.; et al. MobileNetV4: Universal Models for the Mobile Ecosystem. In Proceedings of the European Conference on Computer Vision (ECCV), Milan, Italy, 29 September–4 October 2024; pp. 78–96. [Google Scholar]
  51. Ding, X.; Zhang, X.; Ma, N.; Han, J.; Ding, G.; Sun, J. RepVGG: Making VGG-Style ConvNets Great Again. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 20–25 June 2021; pp. 13733–13742. [Google Scholar]
  52. Loshchilov, I.; Hutter, F. Decoupled Weight Decay Regularization. In Proceedings of the International Conference on Learning Representations (ICLR), New Orleans, LA, USA, 6–9 May 2019. [Google Scholar]
  53. He, K.; Zhang, X.; Ren, S.; Sun, J. Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 7–13 December 2015; pp. 1026–1034. [Google Scholar]
  54. Cao, H.; Wang, Y.; Chen, J.; Jiang, D.; Zhang, X.; Tian, Q.; Wang, M. Swin-Unet: Unet-Like Pure Transformer for Medical Image Segmentation. In Proceedings of the European Conference on Computer Vision (ECCV) Workshops, Tel Aviv, Israel, 23–27 October 2022; pp. 205–218. [Google Scholar]
  55. Wang, L.; Li, R.; Zhang, C.; Fang, S.; Duan, C.; Meng, X.; Atkinson, P.M. UNetFormer: A UNet-Like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagery. ISPRS J. Photogramm. Remote Sens. 2022, 190, 196–214. [Google Scholar] [CrossRef]
  56. Fu, Y.; Lou, M.; Yu, Y. SegMAN: Omni-Scale Context Modeling with State Space Models and Local Attention for Semantic Segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 11–15 June 2025. [Google Scholar]
  57. Cai, J.; Su, J.; Li, Q.; Yang, W.; Wang, S.; Zhao, T.; He, S.; Liu, W. Keep the Balance: A Parameter-Efficient Symmetrical Framework for RGB+X Semantic Segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 11–15 June 2025; pp. 10587–10598. [Google Scholar]
Figure 1. Overall architecture of DIGSFNet, illustrating the three-component pipeline comprising the Symmetric Deformation-Aware Encoder (SDAE), Deformation Integrity Prior Decoder (DIPD), and Lightweight Deployable Student Network (LDSN). Arrows indicate data flow from dual-modal inputs through hierarchical feature extraction, physically-constrained decoding, and knowledge distillation to the final lightweight model.
Figure 1. Overall architecture of DIGSFNet, illustrating the three-component pipeline comprising the Symmetric Deformation-Aware Encoder (SDAE), Deformation Integrity Prior Decoder (DIPD), and Lightweight Deployable Student Network (LDSN). Arrows indicate data flow from dual-modal inputs through hierarchical feature extraction, physically-constrained decoding, and knowledge distillation to the final lightweight model.
Remotesensing 18 02692 g001
Figure 2. Detailed structure of the Symmetric Deformation-Aware Encoder (SDAE), showing the shared Swin Transformer backbone with modality-specific adapters, the Dynamic Sparse Cross-Modal Fusion modules at each hierarchical stage, and the dual-modal self-teaching supervision pathways.
Figure 2. Detailed structure of the Symmetric Deformation-Aware Encoder (SDAE), showing the shared Swin Transformer backbone with modality-specific adapters, the Dynamic Sparse Cross-Modal Fusion modules at each hierarchical stage, and the dual-modal self-teaching supervision pathways.
Remotesensing 18 02692 g002
Figure 3. Detailed structure of the Deformation Integrity Prior Decoder (DIPD), illustrating the coarse-to-fine prediction pipeline, fine-grained patch selection based on uncertainty and deformation gradients, multi-scale feature integration with attention-weighted skip connections, and the deformation integrity loss components.
Figure 3. Detailed structure of the Deformation Integrity Prior Decoder (DIPD), illustrating the coarse-to-fine prediction pipeline, fine-grained patch selection based on uncertainty and deformation gradients, multi-scale feature integration with attention-weighted skip connections, and the deformation integrity loss components.
Remotesensing 18 02692 g003
Figure 4. Teacher–student distillation pipeline of the Lightweight Deployable Student Network (LDSN), showing the three-level knowledge transfer (mask-level, feature-level, deformation-prior distillation), the compact student architecture, and the deployment optimization workflow including structural reparameterization, ONNX (opset 17) export, and TensorRT (v8.6) acceleration.
Figure 4. Teacher–student distillation pipeline of the Lightweight Deployable Student Network (LDSN), showing the three-level knowledge transfer (mask-level, feature-level, deformation-prior distillation), the compact student architecture, and the deployment optimization workflow including structural reparameterization, ONNX (opset 17) export, and TensorRT (v8.6) acceleration.
Remotesensing 18 02692 g004
Figure 5. Qualitative comparison visualization across representative challenging scenes from both the Nanning-HHLS and HAEFNet benchmarks. From left to right, each row shows the InSAR LOS deformation map, the optical/RGB context, the ground-truth mask, and the prediction maps from U-Net, DeepLabV3+, SegFormer, Swin-UNet [54], UNetFormer [55], SegMAN [56], KTB, PDFNet, HAEFNet [5], and DIGSFNet. All predictions are presented as binary masks (white: predicted landslide, black: background). The rightmost column, outlined in red, corresponds to the proposed DIGSFNet.
Figure 5. Qualitative comparison visualization across representative challenging scenes from both the Nanning-HHLS and HAEFNet benchmarks. From left to right, each row shows the InSAR LOS deformation map, the optical/RGB context, the ground-truth mask, and the prediction maps from U-Net, DeepLabV3+, SegFormer, Swin-UNet [54], UNetFormer [55], SegMAN [56], KTB, PDFNet, HAEFNet [5], and DIGSFNet. All predictions are presented as binary masks (white: predicted landslide, black: background). The rightmost column, outlined in red, corresponds to the proposed DIGSFNet.
Remotesensing 18 02692 g005
Figure 6. Ablation visualization on challenging scenes. Each scene shows the progressive improvement from (a) InSAR LOS deformation map, (b) optical image, (c) ground truth, (d) optical-only prediction (Config 1), (e) direct concatenation (Config 3), (f) symmetric fusion without DIPD (Config 5), and (g) full DIGSFNet (Config 9).
Figure 6. Ablation visualization on challenging scenes. Each scene shows the progressive improvement from (a) InSAR LOS deformation map, (b) optical image, (c) ground truth, (d) optical-only prediction (Config 1), (e) direct concatenation (Config 3), (f) symmetric fusion without DIPD (Config 5), and (g) full DIGSFNet (Config 9).
Remotesensing 18 02692 g006
Figure 7. Hyperparameter sensitivity curves. Six subplots arranged in a 2 × 3 grid. Each subplot shows mIoU (solid line with circle markers, left y-axis) and F1 (dashed line with square markers, right y-axis) versus one hyperparameter value; the dotted vertical guide marks the best-performing configuration. (a) λ 1 varied over { 0.01 , 0.05 , 0.1 , 0.2 , 0.5 , 1.0 , 2.0 } ; (b) λ 2 varied over { 0.01 , 0.05 , 0.1 , 0.2 , 0.5 , 1.0 , 2.0 , 5.0 } ; (c) λ 3 varied over { 0.05 , 0.1 , 0.2 , 0.5 , 1.0 } ; (d) adapter bottleneck dimension r varied over { 16 , 32 , 64 , 128 , 256 } ; (e) sparsity ratio ρ varied over { 0.1 , 0.2 , 0.3 , 0.5 , 0.7 , 1.0 } ; (f) fine-grained patch size varied over { 16 , 32 , 64 , 128 } .
Figure 7. Hyperparameter sensitivity curves. Six subplots arranged in a 2 × 3 grid. Each subplot shows mIoU (solid line with circle markers, left y-axis) and F1 (dashed line with square markers, right y-axis) versus one hyperparameter value; the dotted vertical guide marks the best-performing configuration. (a) λ 1 varied over { 0.01 , 0.05 , 0.1 , 0.2 , 0.5 , 1.0 , 2.0 } ; (b) λ 2 varied over { 0.01 , 0.05 , 0.1 , 0.2 , 0.5 , 1.0 , 2.0 , 5.0 } ; (c) λ 3 varied over { 0.05 , 0.1 , 0.2 , 0.5 , 1.0 } ; (d) adapter bottleneck dimension r varied over { 16 , 32 , 64 , 128 , 256 } ; (e) sparsity ratio ρ varied over { 0.1 , 0.2 , 0.3 , 0.5 , 0.7 , 1.0 } ; (f) fine-grained patch size varied over { 16 , 32 , 64 , 128 } .
Remotesensing 18 02692 g007
Figure 8. Confidence and uncertainty visualization for representative ambiguous scenes. From left to right, each row shows the InSAR LOS deformation map, the optical context, the predicted probability (confidence) map, and the Monte-Carlo-dropout uncertainty map (30 stochastic forward passes); the figure three rows correspond to a densely vegetated slope, a mining-subsidence area, and a small landslide. Uncertainty concentrates along boundary transition zones and over the non-landslide (mining) deformation source, whereas landslide interiors are predicted with high confidence—consistent with the intended effect of the deformation-integrity priors.
Figure 8. Confidence and uncertainty visualization for representative ambiguous scenes. From left to right, each row shows the InSAR LOS deformation map, the optical context, the predicted probability (confidence) map, and the Monte-Carlo-dropout uncertainty map (30 stochastic forward passes); the figure three rows correspond to a densely vegetated slope, a mining-subsidence area, and a small landslide. Uncertainty concentrates along boundary transition zones and over the non-landslide (mining) deformation source, whereas landslide interiors are predicted with high confidence—consistent with the intended effect of the deformation-integrity priors.
Remotesensing 18 02692 g008
Table 1. Comparison of the Nanning-HHLS and HAEFNet datasets used in this study.
Table 1. Comparison of the Nanning-HHLS and HAEFNet datasets used in this study.
AttributeNanning-HHLS
(This Work)
HAEFNet (Public Benchmark) [5]
Geographic regionNanning, Guangxi, S ChinaQinghai–Tibet Plateau and Sichuan, W China
TaskHigh-risk landslide segmentationActive landslide detection
Input modalitiesOptical + InSAROptical + InSAR (+DEM, not used)
Optical sourceSentinel-2 L2A, 10 bands (10 m)Sentinel-2 RGB (10 m)
InSAR source/productSentinel-1 SBAS-InSAR, cumulative LOS displacementSentinel-1, mean LOS deformation rate
Spatial resolution10 m10 m
Patch size512 × 512 px512 × 512 px
Total patches38428440
Landslide instances4671013
Annotation typePixel-level binary maskPixel-level binary mask
Train/Val/Test split60/20/20 (spatially stratified)7:1:2 (official split)
Table 2. Typical magnitude of each weighted loss component at three training stages on Nanning-HHLS (running-average weighted terms).
Table 2. Typical magnitude of each weighted loss component at three training stages on Nanning-HHLS (running-average weighted terms).
Weighted TermEpoch 1Epoch 60Epoch 120
L s e g 0.8120.2140.128
λ 1 L b o u n d a r y 0.3410.1120.068
λ 2 L d e f o r m 0.2870.0930.051
λ 3 L s s i m 0.1240.0470.029
λ 4 L s t 0.1960.0610.033
λ 5 L s p a r s e 0.0210.0090.006
Table 3. Quantitative comparison on the Nanning-HHLS dataset. The best results are marked in bold and the second-best results underlined. Bold and underline apply to the accuracy metrics only; the last column (model parameters) is an efficiency measure for which a smaller value is preferable and is therefore left unmarked.
Table 3. Quantitative comparison on the Nanning-HHLS dataset. The best results are marked in bold and the second-best results underlined. Bold and underline apply to the accuracy metrics only; the last column (model parameters) is an efficiency measure for which a smaller value is preferable and is therefore left unmarked.
MethodmIoU (%)F1 (%)Precision (%)Recall (%)AUC (%)BF1 (%)Miss. (%)FA (%)Params (M)
U-Net71.2482.4583.1281.7991.5668.3218.2116.8831.04
DeepLabV3+72.8683.6784.2283.1392.3169.7816.8715.7841.26
SegFormer74.5385.0185.6784.3693.1271.4515.6414.3347.28
Swin-UNet75.1285.4286.0484.8193.4772.1115.1913.9659.84
UNetFormer76.3886.3286.9185.7493.9273.2814.2613.1011.69
SegMAN77.9287.4287.8387.0194.5674.8612.9912.1852.37
KTB79.1488.2988.5288.0695.0376.0411.9411.4864.22
PDFNet80.2689.0689.3188.8195.4777.1211.1910.7071.85
HAEFNet80.9489.5289.6289.4395.7877.8610.5710.3876.32
DIGSFNet (Ours)83.5791.1690.8491.4896.8282.348.529.1688.46
Miss. = Missing Rate; FA = False Alarm Rate.
Table 4. Quantitative comparison on the public HAEFNet benchmark [5]. Same format and methods as Table 3; the DEM channel is disabled for all methods. The best results are marked in bold and the second-best results underlined. Bold and underline apply to the accuracy metrics only; the last column (model parameters, an efficiency measure) is not marked.
Table 4. Quantitative comparison on the public HAEFNet benchmark [5]. Same format and methods as Table 3; the DEM channel is disabled for all methods. The best results are marked in bold and the second-best results underlined. Bold and underline apply to the accuracy metrics only; the last column (model parameters, an efficiency measure) is not marked.
MethodmIoU (%)F1 (%)Precision (%)Recall (%)AUC (%)BF1 (%)Miss. (%)FA (%)Params (M)
U-Net67.1279.8480.4279.2789.8464.1820.7319.5831.04
DeepLabV3+68.8381.0581.6280.4990.5165.7419.5118.3841.26
SegFormer70.6282.3882.8981.8891.2767.4318.1217.1147.28
Swin-UNet71.4582.9283.5182.3491.6868.2117.6616.4959.84
UNetFormer72.3483.5984.0883.1192.0669.2716.8915.9211.69
SegMAN73.5884.4284.8184.0492.7170.6215.9615.1952.37
KTB74.6285.1385.4284.8593.1871.8515.1514.5864.22
PDFNet75.1885.5185.7485.2893.4672.4314.7214.2671.85
HAEFNet75.2485.8485.9285.7693.6273.1814.2414.0876.32
DIGSFNet (Ours)78.9288.1487.9588.3495.0478.4511.6612.0588.46
Miss. = Missing Rate; FA = False Alarm Rate. The HAEFNet results listed here are re-produced under the InSAR + optical setting with the DEM branch removed. For reference, the original HAEFNet paper reports 75.2% IoU/85.8% F1 (single landslide class) using its full InSAR + optical + DEM input; although that single-class IoU is not strictly comparable to the mIoU reported here, our DEM-free re-implementation attains a similar accuracy level, suggesting that the DEM branch contributes only a marginal gain on this benchmark—consistent with our decision to exclude DEM (Section 6.2). For a like-for-like check under the original paper’s metric, our DEM-free re-trained HAEFNet attains 74.6% single-class landslide IoU on this benchmark, i.e., 0.6 points below the original DEM-inclusive result.
Table 5. Ablation study results on the Nanning-HHLS dataset. Within the teacher variants (Configs 1–9) and the student variants (Configs 10–11), the best value in each accuracy column is shown in bold; the parameters and FLOPs columns (efficiency measures) are not marked.
Table 5. Ablation study results on the Nanning-HHLS dataset. Within the teacher variants (Configs 1–9) and the student variants (Configs 10–11), the best value in each accuracy column is shown in bold; the parameters and FLOPs columns (efficiency measures) are not marked.
ConfigurationmIoU (%)F1 (%)Recall (%)BF1 (%)Params (M)FLOPs (G)
(1) Optical only74.1285.1882.1566.4885.34197.6
(2) InSAR only71.8583.5679.4262.7885.34197.6
(3) Optical + InSAR direct concatenation76.4286.6483.6868.9285.42198.9
(4) Asymmetric fusion (InSAR as auxiliary)78.5687.9285.4171.3486.78208.3
(5) Symmetric fusion (SDAE, w/o DIPD)81.0389.5388.5676.8287.62211.2
(6) Full model w/o deformation integrity loss81.8689.9889.8778.1288.46215.8
(7) Full model w/o fine-grained patch decoder82.6490.5290.6879.4587.85211.2
(8) Full model w/o self-teaching82.1590.2690.2381.0888.46215.8
(9) Full DIGSFNet (teacher)83.5791.1691.4882.3488.46215.8
(10) LDSN (student, w/o distillation)76.4886.6884.1272.5811.3227.6
(11) LDSN (student, with full distillation)79.9288.7987.9677.8411.3227.6
Table 6. Ablation of the three distillation levels on the Nanning-HHLS dataset (student = LSNet-T). The best value in each column is shown in bold.
Table 6. Ablation of the three distillation levels on the Nanning-HHLS dataset (student = LSNet-T). The best value in each column is shown in bold.
Distillation ConfigurationmIoU (%)F1 (%)Recall (%)BF1 (%)
None (Config 10)76.4886.6884.1272.58
Mask-level only77.8187.4185.6374.06
Feature-level only77.9587.5385.8174.39
Deformation-prior only78.1687.6685.4475.90
Mask + feature78.8488.2186.9975.60
Full three-level (Config 11)79.9288.7987.9677.84
Table 7. Efficiency comparison between teacher and student models. All inference metrics measured on a single RTX 4090 GPU with 512 × 512 input.
Table 7. Efficiency comparison between teacher and student models. All inference metrics measured on a single RTX 4090 GPU with 512 × 512 input.
ModelParams (M)FLOPs (G)FPSONNX (ms)INT8 (ms)GPU Mem. (GB)mIoU (%)F1 (%)
DIGSFNet Teacher (FP32)88.46215.81854.24.8583.5791.16
LDSN Student (FP32)11.3227.67613.21.2479.9288.79
LDSN Student (FP16)11.3227.61427.10.8279.8688.74
LDSN Student (INT8)11.3227.62184.60.5479.2488.31
Table 8. Repeated-run statistics (mean ± std over 3 seeds) and significance of the DIGSFNet–HAEFNet comparison.
Table 8. Repeated-run statistics (mean ± std over 3 seeds) and significance of the DIGSFNet–HAEFNet comparison.
DatasetDIGSFNet mIoU (%)HAEFNet mIoU (%)p-Value
Nanning-HHLS83.57 ± 0.1880.94 ± 0.21<0.01
HAEFNet benchmark78.92 ± 0.2475.24 ± 0.27<0.01
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ni, Z.; Hu, L.; Wang, H.; Li, F.; Tang, M.; Ma, G.; Sui, H. DIGSFNet: Deformation-Integrity-Guided Symmetric Fusion Network for High-Risk Landslide Extraction from Multi-Source Remote Sensing Images. Remote Sens. 2026, 18, 2692. https://doi.org/10.3390/rs18162692

AMA Style

Ni Z, Hu L, Wang H, Li F, Tang M, Ma G, Sui H. DIGSFNet: Deformation-Integrity-Guided Symmetric Fusion Network for High-Risk Landslide Extraction from Multi-Source Remote Sensing Images. Remote Sensing. 2026; 18(16):2692. https://doi.org/10.3390/rs18162692

Chicago/Turabian Style

Ni, Zixuan, Lieyun Hu, Huini Wang, Fengxiaoxiao Li, Meng Tang, Guorui Ma, and Haigang Sui. 2026. "DIGSFNet: Deformation-Integrity-Guided Symmetric Fusion Network for High-Risk Landslide Extraction from Multi-Source Remote Sensing Images" Remote Sensing 18, no. 16: 2692. https://doi.org/10.3390/rs18162692

APA Style

Ni, Z., Hu, L., Wang, H., Li, F., Tang, M., Ma, G., & Sui, H. (2026). DIGSFNet: Deformation-Integrity-Guided Symmetric Fusion Network for High-Risk Landslide Extraction from Multi-Source Remote Sensing Images. Remote Sensing, 18(16), 2692. https://doi.org/10.3390/rs18162692

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop