3.1. Overview of ABG
ABG is designed for source-supervised cross-scene hyperspectral band selection. Each gate output corresponds directly to an original spectral band and is applied channel-wise to the FDDEM representation. The source domain contains labeled samples; no target samples or labels are used for selector learning, hyperparameter selection, checkpoint selection, score aggregation, or top-K ranking.
Reliability is evaluated at task level through two source-target pairs, repeated band budgets, component ablations, class-level results, and frozen-selector label-fraction controls. These complementary analyses quantify how effectively the learned ranking transfers across scenes, band budgets, model components, land-cover classes, and downstream supervision levels.
Figure 1 summarizes the source-only workflow. FDDEM produces enhanced features; the adaptive gate fuses global and sample-specific scores; source-side expansion constructs label-preserving gated views; and the dual-head evaluator provides classification and contrastive representations. The resulting source scores are averaged to obtain the final ranking. Target labels appear only after the selector is frozen, inside the downstream SVM evaluation area.
The design connects training-time representation expansion with evaluation-time transfer evidence. Frequency and spatial operations broaden the source representation, while the cross-scene results and controls reported in
Section 5.1,
Section 5.2,
Section 5.3 and
Section 5.4 provide external task-level validation of the learned ranking.
3.2. Frequency-Domain Decoupling Enhancement
FDDEM uses complementary spectral and spatial-frequency operations to form a band-aligned representation before gating. A one-dimensional transform captures smooth inter-band trends, while two-dimensional amplitude and phase decomposition exposes frequency energy and spatial organization. Guided by a Sobel structural prior, their joint refinement yields a band-aligned representation that coordinates radiometric and structural cues before adaptive gating.
An input batch of hyperspectral cubes is denoted as , where is the batch size, is the number of spectral bands, and is the spatial dimension.
For a spectral vector
at spatial position
, a one-dimensional Fourier transform is first applied along the spectral dimension:
A low-pass mask
keeps the first
low-frequency coefficients and attenuates rapidly oscillating components that are often associated with noise or unstable spectral fluctuations. The smoothed spectral component is reconstructed by
The cutoff controls the number of retained low-frequency coefficients, and denotes element-wise multiplication. The low-pass component provides a smooth inter-band reference rather than assuming that every high-frequency component is noise; residual fusion with the original feature keeps localized discriminative responses available to the downstream gate and task losses.
To guide the subsequent enhancement with spatially stable structure, FDDEM computes an all-band mean image and extracts a Sobel edge prior:
where
is the all-band mean image,
and
are horizontal and vertical Sobel operators, respectively, and
denotes convolution. The low-frequency cube
is mapped by a
convolution
from
input bands to
feature channels;
is used so that the mapped feature channels remain one-to-one with the original spectral bands before gating. The operator
then applies a two-dimensional Fourier transform along the spatial dimensions.
The amplitude spectrum tends to be more sensitive to energy distribution, radiometric scale, and illumination-dependent variations, whereas the phase spectrum tends to preserve spatial layout and edge-related structural information. FDDEM therefore combines amplitude reweighting with structure-aware phase refinement, allowing the gate to assess each original band from a representation that jointly encodes radiometric energy and spatial organization.
After Equation (4),
, whereas the Sobel prior is single-channel,
. The channel counts therefore differ even when the spatial supports already match. If the spatial support of
differs from that of
and
because the Sobel and Fourier paths use different preprocessing, padding, or resampling,
first resizes
to the common spatial support of
and
; when the supports already match, the interpolation is the identity. Channel alignment is then performed as specified in Equation (5).
In Equation (5), denotes spatial interpolation to the size of and , and denotes channel-wise replication. With , the aligned prior satisfies ; consequently, and each have shape . The first concatenation is mapped from input channels to output channels by the 1 × 1 amplitude-weighting convolution in Equation (6), whereas the second supplies the structural context used to construct the query and key in Equations (7) and (8). This alignment is non-parametric and introduces no additional learnable parameters.
The amplitude path uses the structure prior to reweight frequency responses:
In Equation (6), denotes channel-wise concatenation, Conv is the learnable 1 × 1 projection from concatenated channels to output channels, and is the sigmoid function. The resulting map has the same shape as , and denotes element-wise multiplication; thus, reweights to obtain . This operation coordinates frequency energy with the aligned spatial-boundary prior before adaptive gating.
The phase path performs structure-aware refinement with attention. The operators
,
, and
are learnable projections. Equation (7) constructs the query
and key
from the concatenated phase and aligned structural prior, while the value
is projected from the phase tensor:
In Equation (8), is the key dimension used to scale the dot product, and softmax normalizes the attention weights over key positions. The resulting tensor retains the channel and spatial dimensions of . Structure-aware attention therefore emphasizes phase responses supported by coherent spatial boundaries, while residual recombination keeps the enhanced representation connected to the original feature stream.
Finally, the enhanced amplitude and phase are recombined into a complex feature and transformed back to the spatial domain:
In Equation (9),
forms the complex unit-phase term,
denotes the inverse two-dimensional Fourier transform,
retains its real component, and
is a learnable residual mapping of the low-frequency feature. The reconstructed branch and residual branch are added to produce the enhanced output shown in
Figure 2.
3.3. Adaptive Band Gating
In cross-scene hyperspectral band selection, a subset that is discriminative in the source scene may lose utility in an unseen target scene because sensor spectral-response functions, atmospheric transmission, and illumination conditions change the observed spectra. Within a scene, local shadowing, mixed pixels, occlusion, and band-dependent noise can also change which channels are informative for an individual patch. A static global ranking cannot represent both scene-level spectral priorities and sample-level spectral-spatial variation. The adaptive band gate therefore combines a source-level global prior with patch-dependent channel reweighting, allowing less-supported bands to be softly suppressed while task-relevant channels remain active.
Global branch. This branch learns a scene-level spectral prior shared by all samples:
where
is the global gate-logit vector defined as an internal trainable parameter of the band-gating module. It is initialized as a zero vector before training, so all bands have the same initial global activation of 0.5 after the sigmoid mapping. Since
is shared by all input patches and updated by back-propagation with the overall objective, it represents a source-level global spectral prior rather than a feature computed from a particular sample. The sigmoid function
maps these logits into
, so each element of
represents a soft global activation score for one spectral band.
Sample branch. This branch predicts patch-dependent band importance by applying global average pooling followed by a lightweight multilayer perceptron:
Here, outputs sample-specific band logits, and the sigmoid function maps them into to obtain a soft importance vector for each input patch.
The global branch encodes a shared source prior, while the sample branch responds to patch context. Their fusion combines scene-level spectral priorities with patch-specific modulation, allowing the ranking to retain a coherent global structure while adapting to local spectral-spatial variation.
The two gates are fused by a learnable scalar
:
The fusion scalar is initialized at zero before sigmoid parameterization, producing equal initial branch weights. The fused coefficient has the same channel count as the FDDEM output and is applied element-wise.
The final band score is the source-sample average of
.
Figure 3 shows
,
,
,
, and the top-K ranking interface.
3.4. Domain Expansion Module
The domain-expansion module begins from
and constructs label-preserving source-derived views. Its spectral, spatial, morphology-inspired, and sensor-noise operations expose the gated representation to complementary variations in spectral statistics, local texture and structure, and measurement noise. This structured expansion broadens source support for classification and contrastive learning and encourages transfer-oriented band rankings.
The ordering is intentional: the task losses are evaluated on representations derived from the gated features, so gradients propagate through the post-gate transformations to the adaptive gate. Classification, band-level contrastive, full-to-gated consistency, and sparsity supervision therefore optimize the gate within the end-to-end computation graph, while the domain-diversity term prevents the source-derived views from collapsing to a single representation. Sensor-noise perturbation acts as an auxiliary stochastic source view with band-wise signal-to-noise variation.
This view strengthens the retention of classification and contrastive structure under band-wise measurement-noise variation and contributes directly to the joint source objective.
Spectral randomization branch. The spectral branch models the fact that the same land-cover class may exhibit shifted spectra under different sensors or atmospheric conditions. A spectral convolution first maps the gated input to a spectral feature tensor,
The global mean and standard deviation of the spectral embedding are computed as
To generate a controllable spectral style shift, the statistics of sample
are mixed with those of another sample
through a learnable coefficient
:
The perturbed spectral feature is then obtained by normalization and statistic injection:
The statistics-exchange operation is class-conditioned to preserve source labels while varying class-consistent spectral style. It therefore enriches radiometric and sensor-response diversity at the feature-statistics level while maintaining semantic supervision.
Spatial randomization branch. The spatial branch simulates texture degradation and contrast distortion. Given the spatial feature
the branch computes sample-wise spatial statistics
and
, mixes them with another sample to obtain
and
, and injects the mixed statistics into the normalized feature to obtain a perturbed spatial feature:
Spatial statistic exchange varies local contrast and texture strength, complementing spectral perturbation with diversity in spatial context.
Multi-scale morphological branch. The morphology branch applies differentiable local structural transforms to
. A
convolution followed by a ReLU activation first compresses the
-channel hyperspectral feature into a single-channel structural response
, providing a common intensity-like input for morphological processing. Multi-scale opening, closing, top-hat, and black-hat transformations then expose gate-derived features to systematic variations in connectivity, boundaries, and bright/dark details that characterize local land-cover structure across scenes.
where
denotes convolution,
and
are learnable parameters, and
. For each structuring-element size
, opening, closing, top-hat, and black-hat responses are computed; dilation and erosion are implemented with differentiable pooling operations:
where
,
,
, and
denote opening, closing, top-hat, and black-hat responses at scale
, respectively. Opening suppresses bright details and smooths boundaries, closing fills dark gaps and strengthens connectivity, top-hat highlights bright small structures, and black-hat enhances dark details. To aggregate the multi-scale morphology, the responses are averaged across
scales. In implementation, dilation and erosion are implemented by max-pooling and min-pooling operations, respectively, which are compatible with back-propagation in modern deep-learning frameworks.
The multi-scale morphological representation is formed by channel-wise concatenation,
The multi-scale responses are concatenated and diversified through adaptive normalization [
32,
33], enriching the source representation with scale-aware structural variations. This process is summarized in
Figure 4.
Finally, the spectral, spatial, and morphological features are concatenated and decoded to produce an expanded-domain sample:
An interpolated-domain sample is also constructed:
All original, gated, expanded, interpolated, and stochastic views preserve the source label and remain inside source-only selector training. Target samples and labels are absent from view construction.
3.5. Dual-Head Evaluator and Losses
The dual-head evaluator maps each source-derived view to class probabilities and a normalized contrastive embedding. For source sample i,
contains the original, gated, expanded, interpolated, and stochastic views. The optimization uses classification, supervised contrastive, adversarial domain-diversity contrastive, band contrastive, full-to-gated consistency, and sparse-gate terms.
A shared spectral-spatial encoder feeds a classification head and a projection head. Classification is applied to every view
, while the normalized projection embeddings support the contrastive objectives [
26,
27].
The classification objective averages cross-entropy over the mini-batch and all evaluator views:
where
is the mini-batch size,
is the number of evaluator views for sample
,
is the number of classes,
is the one-hot label, and
is the predicted probability for class
under view
.
For a minibatch collection
of normalized embedding–label pairs,
contains all non-anchor indices whose supervision label matches that of anchor
. The following set-level supervised contrastive operator is shared by the semantic, domain-diversity, and full-to-gated consistency objectives:
In Equation (30), every embedding acts as an anchor, same-label embeddings form its positive set, and all remaining embeddings in
form the denominator. The label attached to each pair is the source class for semantic objectives and the class-conditioned pseudo-domain label for the domain-diversity objective. The temperature
is fixed at 0.07 for all contrastive objectives on both benchmarks and is not tuned with target data.
Equation (31) applies Equation (30) to the evaluator views
using their source class labels. For the class-conditioned domain-diversity term,
is the set of source classes present in the mini-batch. Within each class, the gated embedding receives pseudo-domain label 0, while one virtual embedding
sampled from the expanded, interpolated, or stochastic view receives label 1:
Because Equation (32) is evaluated separately within each source class, it preserves source-derived view diversity without replacing semantic supervision. Classification, supervised contrastive learning, band-level contrast, and full-to-gated consistency jointly maintain class-discriminative structure.
The band contrastive term uses the full-spectrum source representation as an anchor, the gated representation as a positive, and a random-band representation as a negative:
The full-to-gated consistency term applies the same operator to paired full-spectrum and gated embeddings carrying the same source label, thereby preserving class-relevant relationships after spectral gating:
Sparse activation is imposed on the sample-specific fused gates and on the shared global gate. Because the global gate is independent of sample index i, its contribution is written outside the mini-batch summation:
The overall ABG criterion combines the classification, contrastive, consistency, and sparse-gate terms as
During training, the evaluator and the FDDEM–gate–expansion pathway are updated with the terms relevant to their respective optimization steps. The adaptive gate remains inside the differentiable post-gate computation graph, and the sparse term acts directly on the fused and global gate activations.
The complete source-only training and band-selection procedure is summarized in Algorithm 1.
| Algorithm 1. Source-Only ABG Training and Band Selection |
| Line | Operation |
| 1 | Input source patches Xs, source labels ys, band count B, band budget K, τ = 0.07, and fixed loss coefficients. |
| 2 | Set the FDDEM feature width to the original spectral-band count. |
| 3 | For each source mini-batch, compute |
| 4 | Compute and in and fuse them as |
| 5 | Form multiplied channel-wise by |
| 6 | Construct spectral, spatial, morphology-inspired, and sensor-noise source views from |
| 7 | Evaluate original, gated, expanded, interpolated, and stochastic views with both heads. |
| 8 | Compute Lcls and Lsupcon over the evaluator views. |
| 9 | Compute Lcon,adv, Lcon,band, and Lcons using τ. |
| 10 | Compute the sparse-gate term Lsparse. |
| 11 | Update the evaluator and the FDDEM–gate–expansion pathway with the corresponding terms of LABG; post-gate task gradients propagate to the gate parameters. |
| 12 | Repeat for 400 epochs using source data only. |
| 13 | Aggregate the fused gate over source samples to obtain one score per original band. |
| 14 | Rank the B scores and retain the top-K original bands. |
| 15 | Freeze the selector before any target sample or label is used. |
| 16 | Restrict the downstream data to the selected channels and fit/evaluate the specified SVM protocol. |