This section presents the proposed Difference-Gated Interaction and Change-Aware Cross-Temporal Fusion Network for remote sensing image change detection. We first describe the overall architecture, followed by detailed explanations of each component: the feature extraction backbone, the Difference-Gated Feature Interaction module, the Change-Aware Cross-Temporal Fusion module, and the loss function.
3.1. Setup
The overall architecture of DCAFNet is illustrated in
Figure 2. The proposed network adopts a two-stage coarse-to-fine framework that progressively refines change predictions, and mainly consists of three parts: the feature extraction backbone network, the Difference-Gated Feature Interaction module, and the Change-Aware Cross-Temporal Fusion module.
We employ MobileNetV2 [
41] as the feature extraction backbone based on the performance-efficiency analysis in
Section 5.5. In our Siamese configuration, both temporal images
and
share identical encoder weights. This process yields four pairs of multi-level feature maps:
and
(for
), which we denote as
and
, respectively. These extracted feature levels correspond to spatial resolutions of 64 × 64, 32 × 32, 16 × 16, and 8 × 8. The algorithm flow proceeds as follows: the bitemporal features are first processed through the DGFI module to produce
, which are then upsampled, concatenated, and decoded to generate the coarse change map
. Subsequently, the original backbone features
and
, together with
, are refined through the CCTF module to yield
, which are decoded to produce the final refined change map
. Algorithm 1 summarizes this process, where GCCM and GRCM denote the coarse and refined change map generation stages, respectively.
| Algorithm 1 Inference of DCAFNet. |
Require: a pair of bitemporal remote sensing images: Ensure: (a change map)
- 1:
Extract multiscale feature group from - 2:
Extract multiscale feature group from - 3:
Perform bitemporal feature fusion through the DGFI module. - 4:
Process through the GCCM step to generate a coarse change map. - 5:
Combine the feature map and the coarse change map, refining the feature map using the CGFR module. - 6:
Perform adaptive feature fusion on the refined features using CTAF module. - 7:
Process through the GRCM step to generate the predicted refined change map.
|
This coarse-to-fine architecture enables DCAFNet to simultaneously facilitate pseudo-change suppression (through the DGFI module) and missed detection reduction (through the CCTF module) within a unified framework.
3.2. Difference-Gated Feature Interaction Module
Motivation. To mitigate pseudo-changes in change detection, researchers have developed various feature-interaction strategies, including element-wise subtraction (FC-Siam-diff [
10]), channel-wise concatenation (FC-Siam-conc [
10], SNUNet [
11]), and attention-guided approaches (DGANet [
21], BiFA [
22], among others). However, these paradigms exhibit distinct limitations. Static operations fail to adaptively filter environmental noise, while dynamic attention mechanisms typically act as general-purpose enhancers without explicitly modeling the magnitude of temporal differences. Consequently, neither can robustly discriminate genuine changes from pseudo-change interference. To overcome these limitations, we propose a Difference-Gated Adaptive Fusion mechanism that generates spatially varying gating signals based on difference magnitude. For unchanged regions, it performs weighted averaging to smooth spectral fluctuations; for changed regions, it provides a bounded positive residual bias to preserve genuine change signals.
The DGFI module consists of three stages: (1) change magnitude computation via channel-wise mean absolute difference, (2) change correlation gate generation through nonlinear transformation, and (3) adaptive fusion with learnable weights modulated by the gating signal.
As illustrated in
Figure 3, let
and
denote the feature maps extracted from the Siamese encoder at level
i (where
). Unlike conventional approaches that employ static subtraction or concatenation, we first compute the channel-wise mean absolute difference to capture the global intensity of spectral variations at each spatial position:
where
C is the number of feature channels and
is a single-channel spatial map assigning a scalar difference magnitude to every position of the co-registered feature pair. It shares the spatial shape of
with one channel, and in the adaptive fusion of Equation (
6), it is broadcast across the
C channels through the element-wise product ⊙. Averaging over channels yields a change-magnitude estimate that is robust to channel-specific noise.
To enhance the signal-to-noise ratio and facilitate discrimination between genuine changes and pseudo-changes, we apply an element-wise squaring of
followed by a scalar normalization by the factor
:
The parentheses make explicit that
is a positive scalar applied uniformly at every position and is not part of the exponentiation, so
inherits the shape
of
. This channel-dependent factor also keeps the pre-activation input bounded, preventing saturation of the subsequent sigmoid.
The choice of a quadratic transformation over a linear mapping is mathematically motivated by the residual behavior of the resulting gate in unchanged regions. Consider an unchanged pixel with a small residual difference
, arising from sensor noise, minor misregistration, or subtle photometric variations. The first-order Taylor expansion of
around zero,
for small
x, yields
The quadratic gate therefore produces a residual response one order of magnitude smaller than the linear counterpart for small
. This behavior implements an
implicit soft threshold: minor pseudo-changes are aggressively suppressed without requiring any explicit thresholding hyperparameter or external regularizer, while the response to progressively larger
remains smoothly differentiable. This squared-magnitude formulation is aligned with classical signal-processing precedents where the squared magnitudes of a residual are used as the primary detection statistic [
42]. An empirical comparison between the quadratic and linear scaling is provided in
Section 5.2, and the effectiveness of the implicit soft threshold is quantitatively verified in
Section 5.9.
The enhanced difference map
is then mapped to a normalized gating signal
via a shifted Sigmoid function:
where
represents the Sigmoid function. Since
, the term
lies in the range
. The transformation
rescales this to approximately
. Consequently,
indicates high confidence in an unchanged state, while
indicates a changed state.
Finally, we fuse the bitemporal features using learnable weights
and
to construct an optimized background representation. This representation is then modulated by the change correlation gate:
where ⊙ denotes element-wise multiplication, and
,
are learnable scalar parameters initialized to 1.0.
This formulation achieves a dual effect that distinguishes it from prior feature interaction methods:
For Unchanged Regions (): The module outputs approximately . By learning optimal and , the network effectively performs weighted averaging of the bitemporal features. This cancels out random spectral fluctuations caused by pseudo-changes (e.g., illumination differences, seasonal variations), stabilizing the background representation and reducing false alarms.
For Changed Regions: The modulation factor
produces a bounded, monotonically increasing residual response with respect to the local difference magnitude
. This provides a systematic positive bias in genuine change regions while, by construction, remaining conservative in absolute magnitude (the implicit soft-threshold behavior derived above). The effect is to preserve subtle change signals from being overwhelmed by background features during subsequent downsampling operations, without introducing excessive amplification that could destabilize training. Statistical verification of this behavior across three benchmarks is presented in
Section 5.9.
Theoretical properties of the gate operator. The bounded and monotone behavior invoked above, together with the second-order noise attenuation derived earlier, can be established formally. Since every operation involved is element-wise, we regard
here as a scalar function of
at a single spatial position. First, because
, we have
and therefore
: the gate amplifies the fused background
by at most a factor of two and never attenuates it, so no element of
can exceed twice the corresponding fused background value (
boundedness ⇒
forward stability). Second,
is the composition of the monotonically increasing map
on
, the positive rescaling by
, and
; it is therefore non-decreasing in
, i.e., an order-preserving mapping from difference magnitude to change confidence (
monotonicity). Third, direct differentiation yields
which is continuous, vanishes at
, and decays exponentially as
; it is thus globally bounded, making
globally Lipschitz in
. Bounded input perturbations (such as sensor noise or slight misregistration) therefore produce bounded gate perturbations (
Lipschitz continuity ⇒
robustness). Together with the
attenuation established above, these properties provide a formal, operator-level justification of the stability and robustness of the DGFI design; empirical verification across three benchmarks is presented in
Section 5.2 and
Section 5.9.
Behaviour under varying sensor noise levels. Sensor noise contributes to the small residual
at an unchanged pixel, so the quadratic scaling gives
: the gate response grows quadratically, not linearly, with the noise standard deviation, and remains bounded to a negligible residual within the second-order Taylor regime (i.e., moderate noise levels). Empirically, the mean amplification
over unchanged pixels stays within
across the three benchmarks (
Section 5.9), confirming this graceful degradation.
After obtaining the four levels of DGFI-processed features
(
), we first apply convolutional layers to refine features at each level:
where
represents sequential BasicConv2d blocks (each comprising a
convolution, batch normalization, and ReLU activation). We then upsample all feature maps to match the spatial resolution of
using bilinear interpolation and concatenate them along the channel dimension:
The concatenated features are processed through the coarse decoder, which progressively reduces channel dimensionality through a series of BasicConv2d layers, culminating in a final convolutional layer that produces the two-channel coarse change map
.
Remarks. Unlike static operators (FC-Siam-diff, FC-Siam-conc [
10], SNUNet [
11]) that apply uniform feature interaction without explicit change modeling, DGFI generates a change correlation gate
providing spatially varying modulation based on change magnitude;
Section 3.4 further contrasts this design with attention-based interaction. The ablation results in
Section 5.2 validate its effectiveness.
3.3. Change-Aware Cross-Temporal Fusion Module
Motivation. Existing remedies for missed detections include cross-layer fusion (CLNet [
26]), multiscale Transformer fusion (M-Swin [
27]), mask classification (MaskCD [
28]) and coarse-to-fine refinement [
29]. In these frameworks, the coarse prediction is largely propagated rather than used as explicit semantic feedback that recalibrates backbone features before temporal interaction. CCTF therefore comprises CGFR, which modulates backbone features through learnable foreground–background weighting driven by the coarse prediction, and CTAF, which performs bidirectional cross-temporal attention with adaptive fusion to cope with unequal image quality. Its architecture is shown in
Figure 4.
(1) Change-Guided Feature Refinement Module
The CGFR module recalibrates the original backbone features based on the preliminary change predictions. This design is motivated by the observation that existing refinement strategies operate independently of initial detection results, missing the opportunity to use coarse predictions as semantic guidance for targeted enhancement.
First, the change probability map is extracted and normalized from the coarse prediction:
where
represents the change channel of the two-class coarse prediction, and
is the Sigmoid function that produces probability values in the range
.
We then explicitly model the contributions of both the foreground (potential changes) and the background (unchanged areas) using four learnable scalar parameters for each feature level: and for temporal branch A, and and for temporal branch B. Let denote the level-i convolutional projection and the bilinear upsampling to the resolution of , and write (and analogously).
The refined features
and
are computed as follows:
where
denotes a tensor of ones with the same spatial dimensions as
. Both
and
have shape
; each of the four scalar-weighted combinations therefore also has shape
and is broadcast across the
C channels of the projected feature
or
during the element-wise product ⊙.
This mechanism is critical for recovering missed detections. Consider the scenario where the coarse map misses a subtle change (i.e., is low in a genuine change region). During training, the network can learn larger weights for or (the background-associated weights) to amplify features in regions initially predicted as unchanged, providing subsequent layers a second opportunity to detect the subtle signal that was initially overlooked. Conversely, in regions where is high, the foreground weights and can emphasize change-related features. This adaptive weighting scheme enables the network to differentially process features based on their predicted change status, facilitating the correction of localized false positives, confirmation of genuine changes, and recovery of subtle missed ones.
(2) Cross-Temporal Adaptive Fusion module
The CTAF module employs a multi-head cross-attention mechanism to model inter-temporal dependencies, followed by learnable adaptive fusion for robust feature synthesis. Unlike self-attention, which models intra-image context, we design a bidirectional cross-attention mechanism to capture cross-temporal relationships. The refined features and are first reshaped from to and then projected into Query (), Key (), and Value () spaces through learnable linear transformations.
The crucial design choice is that we use features from one temporal phase to query the other, rather than performing self-attention within each temporal branch. For temporal branch A, we compute the attention map using and , and aggregate global context from . This operation effectively highlights features in image A that are semantically relevant or distinct with respect to image B. To ensure numerical stability, we apply normalization to the query and key vectors before computing attention scores.
The cross-attention operation is formulated as
where the subscripts
s and
g denote
source and
guide, respectively, and
denotes the dimension per attention head. Applying this operation bidirectionally yields two interaction-enhanced feature maps:
This bidirectional design enables comprehensive cross-temporal modeling:
encodes features from
that are relevant to changes observed from the perspective of
, while
captures the complementary relationship. This mutual information exchange facilitates the identification of subtle changes that might be apparent only when considering both temporal contexts simultaneously.
To synthesize the processed bitemporal information into a unified feature representation for decoding, we propose a learnable adaptive fusion strategy. In contrast to static fusion schemes (e.g., concatenation or element-wise addition) that assume equal contributions from both temporal branches, we define level-specific learnable weights
and
. The final output of the CCTF module is computed as:
This adaptive weighting mechanism is particularly important for handling varying image quality conditions. When one temporal image is degraded by clouds, shadows, or sensor noise, the network can automatically assign lower weights to features from the degraded image, ensuring robust feature synthesis. The weights are initialized to 1.0 and learned jointly with other network parameters during end-to-end training.
The refined decoder follows an analogous structure. The CCTF-processed features
are concatenated and decoded:
The refined decoder processes to produce the final two-channel refined change map . Both and are upsampled to the original input resolution using bilinear interpolation before loss computation.
Remarks. CCTF implements a predict-then-refine paradigm in which the coarse prediction actively recalibrates backbone features before cross-temporal interaction. Its distinction from conventional refinement and self-attention designs is analyzed in
Section 3.4, and the ablation results in
Section 5.4 validate the synergistic effect of its components.
3.4. Distinction from Existing Mechanisms
DCAFNet builds on established paradigms (feature differencing, attention, coarse-to-fine refinement, and cross-temporal interaction) which we adopt without claiming them as novel. What we claim are four mechanism-level design choices, each isolated by a dedicated ablation.
DGFI vs. adaptive weighting on difference features. Adaptive weighting (e.g., AbsDiff+CBAM [
43], DGANet [
21], BiFA [
22]) re-scales the difference tensor as a feature without modeling the mapping from difference
magnitude to change
probability. DGFI derives its gate solely from
through
, whose expansion in
Section 3.2 gives an
residual response, one order below the
of a linear-magnitude gate, suppressing pseudo-changes without any thresholding hyperparameter, following the squared-magnitude detection principle of CFAR [
42]. Accordingly, DGFI exceeds AbsDiff+CBAM by
F1 (
Section 5.2), and the gate alone attains a pixel-wise ROC-AUC of
(
Section 5.9.1).
CGFR vs. coarse-mask-guided refinement. Direct masking
suppresses features wherever the coarse map reads “unchanged”, discarding precisely the evidence required to recover missed detections, whereas the re-weighting of Equation (
11) retains and re-amplifies them through learned
. Direct masking underperforms CGFR by
F1 and inverse masking falls below the “w/o CGFR” baseline (
Section 5.3), while the learned background weights remain consistently non-negligible (
Section 5.9.3).
CTAF vs. standard cross-temporal interaction. Because change is defined only through cross-temporal correspondence, CTAF replaces the intra-temporal self-attention of BIT [
13] and ChangeFormer [
14] with bidirectional cross-attention, fused by level-specific learnable weights instead of fixed concatenation. The ablation in
Section 5.4 isolates both choices: +0.13/+0.22/+0.14 F1 and +0.11/+0.11/+0.13 F1, respectively.
Coarse map as an active prior rather than a supervision target. Existing coarse-to-fine methods use mainly as a deep-supervision target, whereas DCAFNet feeds it back through CGFR to recalibrate backbone features. The leave-one-out ablation shows that removing any single module costs –% average F1, indicating that the gains arise from complementary mechanisms rather than from stacked parameters.