Next Article in Journal
DA-GDNet: A Data-Augmented Gather-and-Distribute Network for Robust SAR Target Detection
Previous Article in Journal
Development and Verification of an Automatic Tower-Based SIF Observation System Based on Narrow Field-of-View Scanning and DOAS Atmospheric Correction
Previous Article in Special Issue
SR-YOLO: Spatial-to-Depth Enhanced Multi-Scale Attention Network for Small Target Detection in UAV Aerial Imagery
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Hyper-VMIL: Topology-Aware Variational Hypergraph Multiple-Instance Learning for Weakly Supervised Hyperspectral Target Detection

1
School of Future Transportation, Chang’an University, Xi’an 710064, China
2
School of Information Engineering, Chang’an University, Xi’an 710064, China
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Remote Sens. 2026, 18(16), 2838; https://doi.org/10.3390/rs18162838
Submission received: 23 July 2026 / Revised: 15 August 2026 / Accepted: 19 August 2026 / Published: 21 August 2026

Highlights

What are the main findings?
  • A topology-conditioned variational inference framework (Hyper-VMIL) resolves bag-level label ambiguity by coupling high-order spatial–spectral hypergraphs with Bernoulli posterior variance regularization derived from the variational ELBO.
  • Continuous posterior refinement (CTPR) over the probability simplex avoids the confirmation bias of hard pseudo-labeling, smoothly recovering occluded subpixel targets and achieving superior operational accuracy ( NAUC FPR 10 3 = 0.577 ).
  • Confidence-weighted topological knowledge distillation successfully internalizes high-order contextual manifold constraints into a lightweight single-spectrum student network, retaining 96.4% of the contextual teacher’s detection capability.
What are the implications of the main findings?
  • A rigorous generative variational foundation for weakly supervised hyperspectral detection is established, preventing error propagation and posterior drift under weak bag-level supervision.
  • The gap between high-order topological modeling and real-time onboard remote sensing is bridged, enabling microsecond-level streaming line-scan detection without test-time graph construction.

Abstract

Region-level weakly supervised hyperspectral target detection (HTD) using multiple-instance learning (MIL) reduces annotation costs but encounters challenges such as bag label ambiguity, boundary over-smoothing, and test-time computational latency. To address these issues, we propose Hyper-VMIL, a spatial–spectral topology-regularized variational hypergraph network. Hyper-VMIL formulates latent target localization as variational inference over dual-path hypergraphs: a boundary-aware spatial hypergraph modeling geometric patch continuity and a dynamic spectral-manifold hypergraph capturing non-local material similarity. Node-adaptive gating dynamically balances spatial and spectral evidence to mitigate over-smoothing near target boundaries. Furthermore, a confidence-aware continuous posterior refinement (CTPR) mechanism reduces the confirmation bias associated with conventional hard pseudo-label binarization. Finally, a teacher–student distillation strategy transfers contextual topology into a lightweight single-spectrum student detector. Benchmark experiments on simulated ASTER and airborne MUUFL Gulfport and Avon datasets show that Hyper-VMIL achieves competitive performance against 15 baseline methods. Notably, Hyper-VMIL supports dual inference modes: Context Mode provides improved detection accuracy (+4.6% average NAUC over VMIL-ECM on MUUFL), while Pixel Mode enables single-spectrum inference ( 1.25 μ s single-instance latency and an amortized streaming throughput of 0.015 μ s per pixel) suitable for onboard real-time deployment.

1. Introduction

Hyperspectral images (HSIs) consist of tens or hundreds of contiguous narrow spectral bands and provide detailed representations of the physical and chemical properties of land-cover materials. They have therefore been widely used in mineral exploration, environmental monitoring, precision agriculture, disaster assessment, and defense applications [1]. Hyperspectral target detection (HTD) aims to identify pixels containing materials of interest from complex scenes by exploiting the subtle spectral differences between targets and backgrounds. Recent advances in deep representation learning, Transformers, generative modeling, and joint spectral–spatial analysis have considerably improved HTD performance [2,3,4,5,6,7,8,9,10,11,12]. Nevertheless, real-world targets are often small and may occupy only a fraction of a pixel because of limited spatial resolution, occlusion, spectral variability, illumination changes, atmospheric effects, and background mixing. Consequently, their spectral responses can be severely diluted by surrounding materials, making weak-target representation and background suppression particularly challenging.
Conventional HTD methods generally require one or more predefined target signatures and calculate detection statistics through matched filtering, background modeling, sparse representation, or subspace projection [1]. Although these methods usually possess clear physical interpretations, their performance strongly depends on the consistency between the reference signatures and the targets observed in the current scene. Laboratory spectra or signatures acquired from other scenes cannot fully represent changes caused by illumination, atmospheric transmission, sensor responses, and material mixing. Deep models improve nonlinear feature representation, but they commonly require accurate target signatures, artificially generated target samples, or pixel-level annotations.
Region-level weak labels can instead be obtained relatively easily from coarse GPS coordinates, field records, or manually selected regions. Multiple-instance learning (MIL) therefore provides an attractive solution for reducing the annotation cost of HTD. With the MIL setting, a positive bag contains at least one target instance, whereas all instances in a negative bag are regarded as background. The exact locations of target instances remain unavailable during training. Recent studies have explored region-level weakly supervised HTD through metric learning, spectral–spatial similarity modeling, weak-label semantic learning, latent target-location inference, and prototype memory [13,14,15,16,17]. These studies demonstrate that an instance detector can be learned without precise pixel annotations. However, recovering a reliable pixel-level target distribution from bag-level supervision remains a fundamentally underconstrained problem. Correct bag prediction does not necessarily imply correct identification of the target instances, and instance-level learnability generally requires stronger conditions than bag-level learnability [18].
More specifically, region-level weakly supervised HTD involves the following three fundamental challenges.
1. The ambiguity between limited bag supervision and reliable instance inference. A positive bag only indicates the presence of at least one target and provides no information about its number, location, or mixing proportion. For a region containing numerous background pixels and only a few weak targets, different instance-response configurations may result in the same bag prediction. Existing methods commonly convert instance confidence scores into hard pseudo-labels. However, fixed thresholds or thresholds derived from within-bag extrema cannot consistently accommodate variations in target size, abundance, and background complexity. Incorrect high-confidence predictions may also be reinforced during alternating optimization, whereas hard binarization discards the confidence and uncertainty information contained in continuous posteriors.
2. Target inference depends on spectral–spatial structures, but these structures are high-order, heterogeneous, and not uniformly reliable. An isolated spectrum is often insufficient for identifying weak targets, necessitating the joint exploitation of local spatial continuity and non-local spectral manifolds. However, existing paradigms face intrinsic limitations under region-level weak supervision: conventional graph neural networks decompose collective multi-pixel (k-ary) interactions into independent pairwise links, distorting the true manifold topology and rapidly over-smoothing weak target nodes into the background. Meanwhile, Transformer self-attention computes dense pairwise correlations without geometric inductive bias, easily causing attention distraction toward dominant background clutter with severe target dilution and lacking explicit graph Laplacian regularizers ( z i L i z i ) for posterior refinement. While hypergraphs resolve these dilemmas by connecting arbitrary numbers of vertices simultaneously [19] to preserve high-order structures, structural proximity does not strictly imply class consistency. Unconstrained message passing can still suppress subpixel targets or propagate background noise, demanding selective, boundary-aware topology regularization rather than uniform structural propagation.
3. There is a gap between contextual inference and flexible pixel-level deployment. Region-based models can exploit spatial neighborhoods and spectral relationships to improve target localization, but their inference usually requires multiple pixels and reconstructed scene topology. In contrast, single-pixel detectors are more suitable for large-scale scanning, streaming processing, and resource-limited platforms, but they cannot directly access spatial context at test time. A structural regularizer used during training does not itself enable a pixel detector to perceive the topology of a new test scene. Knowledge distillation offers a possible means of transferring contextual knowledge to lightweight hyperspectral models [20]; however, transferring continuous instance posteriors and their reliability under region-level weak supervision remains insufficiently studied.
To address these challenges, we propose a Spatial–Spectral Topology-Regularized Variational Hypergraph Multiple-Instance Learning Network, termed Hyper-VMIL, for region-level weakly supervised HTD. Hyper-VMIL formulates latent target localization as a variational inference problem and represents each hyperspectral bag using two complementary hypergraphs. A boundary-aware spatial hypergraph organizes local neighborhoods according to two-dimensional coordinates and adjusts their propagation strengths using spectral differences. A dynamic spectral-manifold hypergraph connects spatially separated pixels with similar material characteristics in a learned embedding space. Unlike pairwise representations, each hyperedge can jointly associate an entire spatial patch or a group of spectrally similar instances, thereby capturing high-order spatial and spectral dependencies.
A dual-branch hypergraph neural network is used to parameterize the topology-conditioned mean-field posterior. The spatial and spectral branches propagate node information over their respective hypergraphs and are integrated through node-adaptive gates. The model can thus determine whether local spatial continuity or non-local spectral similarity provides more reliable evidence for each instance. Boundary-aware hyperedge weighting, residual propagation, and adaptive gating are introduced to prevent weak targets from being excessively smoothed into the background. The spatial–spectral hypergraph Laplacian is further incorporated into a regularized variational objective so that latent target posteriors remain consistent over reliable manifolds while preserving target boundaries and isolated target responses.
To mitigate the risk of information loss and error propagation (confirmation bias) often induced by premature hard pseudo-label binarization, we designed a confidence-aware topological posterior refinement mechanism as a principled motivation. Instead of enforcing rigid binary decisions at early optimization stages, the method preserves continuous target probabilities and estimates node-level confidence from posterior uncertainty. The latent target distribution is then refined under posterior-fidelity, spectral–spatial topology, and bag-label consistency constraints, which is intended to prevent ambiguous predictions from being prematurely reinforced as false positive supervision. High-confidence instances mainly retain their original predictions, whereas uncertain instances receive additional evidence from reliable topological neighbors, thereby theoretically limiting uncontrolled error accumulation.
Finally, a topology-teacher and pixel-student learning strategy was developed to bridge contextual inference and flexible deployment. The variational hypergraph network acts as a contextual teacher that estimates continuous instance posteriors from complete bags and their spectral–spatial structures. A pixel-level student detector takes only an individual spectrum as input and learns the teacher’s structured knowledge through confidence-weighted soft supervision, manifold consistency, and spectral perturbation consistency. The student does not directly perceive spatial topology at test time; instead, it learns a spectral decision function that approximates the topology-conditioned posterior. Consequently, Hyper-VMIL supports both a Context Mode, which explicitly constructs test hypergraphs for refined detection, and a Pixel Mode, which provides efficient and flexible single-spectrum inference. The main contributions of this work are summarized as follows:
  • We propose a topology-regularized variational hypergraph multiple-instance framework that integrates region-level labels, high-order spectral–spatial structures, and instance-level target posteriors within a unified probabilistic learning formulation.
  • We developed a boundary-aware dual-path hypergraph representation that characterizes local spatial continuity and non-local spectral manifolds. Node-adaptive gating, boundary-sensitive weights, and residual propagation jointly balance structural consistency and weak-target preservation.
  • We developed confidence-aware continuous posterior refinement and topology-teacher–pixel-student collaborative learning. This strategy is specifically formulated to alleviate information loss and confirmation bias stemming from conventional hard pseudo-labeling, with its empirical effectiveness in stabilizing optimization and preventing error accumulation validated through ablation and dynamic trajectory experiments.
The remainder of this paper is organized as follows. Section 2 reviews recent studies on weakly supervised HTD, spectral–spatial representation, hypergraph learning, and knowledge distillation. Section 3 presents the proposed Hyper-VMIL framework and its optimization procedure. Section 4 reports comparative, ablation, and robustness experiments. Section 5 concludes the paper.

2. Related Work

2.1. Weakly Supervised Hyperspectral Target Detection

Recent HTD methods have employed spectral aggregation, Transformer-based dependency modeling, interpretable representation learning, variational background modeling, and self-supervised learning to improve target–background separation [2,3,4,5,6,7,8]. Graph-based fusion, spatial–spectral sparse encoding, and point-object detection architectures have further enhanced the representation of small targets and heterogeneous backgrounds [9,10,11]. However, many of these methods still rely on predefined target signatures, synthetic target samples, or accurate pixel-level annotations.
MIL provides a region-level weakly supervised alternative. With the MIL setting, a positive bag contains at least one target instance, whereas a negative bag contains only background instances. Recent weakly supervised HTD methods have explored metric learning, weak-label semantic modeling, spectral–spatial similarity-guided selection, latent target-location inference, and prototype memory [13,14,15,16,17]. These studies demonstrate that pixel detectors can be learned without precise instance annotations.
Nevertheless, correct bag prediction does not necessarily imply accurate instance localization, and instance-level learnability generally requires stronger conditions than bag-level classification [18,21]. Structure-aware MIL methods have shown that dependencies among instances can improve fine-grained prediction [22,23,24]. However, existing weakly supervised HTD methods mainly infer target locations from spectral embeddings, attention scores, or prototypes. The explicit two-dimensional organization of pixels is rarely incorporated into the latent posterior, while continuous instance scores are often converted into hard pseudo-labels. Hyper-VMIL instead introduces high-order spectral–spatial topology into variational instance inference and preserves continuous posterior information during optimization.

2.2. Spectral–Spatial Graph and Hypergraph Learning

Joint spectral–spatial modeling is important for detecting weak and subpixel targets. Transformer and self-supervised networks capture long-range spectral dependencies and neighborhood consistency [2,4,7,8]. Graph-based HTD methods further encode explicit relationships among pixels through graph convolution, feature fusion, sparse priors, or generative representation learning [9,10,25].
Specifically, hyperspectral spatial–spectral structures embody joint, multi-body (k-ary, k 3 ) correlations that cannot be faithfully captured by conventional pairwise graphs or attention-based models. Standard graph neural networks model only dyadic (1-to-1) edges; decomposing an entire k-pixel spatial patch or a non-local spectral cluster into k 2 independent pairwise links introduces spurious intermediate interactions, distorts collective manifold geometry, and accelerates subpixel target over-smoothing across material boundaries. Meanwhile, Transformer-based self-attention computes dense, unconstrained pairwise token affinities without explicit geometric structure; under region-level weak supervision where subpixel targets are heavily diluted, all-to-all attention is readily swamped by redundant background tokens and cannot construct a closed-form graph Laplacian operator for topological posterior regularization. In contrast, hypergraphs uniquely represent non-decomposable group-level information: a single spatial hyperedge preserves the collective spatial co-occurrence of a patch, while a dynamic spectral hyperedge encapsulates non-local material manifold clusters simultaneously [19,26,27,28]. Furthermore, the resulting hypergraph Laplacian L = I D v 1 / 2 H W D e 1 H D v 1 / 2 provides a mathematically rigorous manifold regularizer ( z i L i z i ) to constrain uncertain instance posteriors during weakly supervised optimization.
Most existing hypergraph methods are designed for supervised classification and use hypergraphs as deterministic feature extractors. Their direct application to weakly supervised HTD is limited because instance labels in positive bags are unobserved. Moreover, uniform topology propagation may smooth isolated targets into the background or connect target-like background pixels incorrectly. Hyper-VMIL therefore incorporates boundary-aware spatial and spectral hypergraphs into latent posterior inference. The two topologies are modeled separately and fused through node-adaptive gates, while boundary-sensitive weights and residual connections alleviate unreliable propagation and over-smoothing.

2.3. Posterior Refinement and Knowledge Transfer

Weakly supervised HTD methods commonly generate instance supervision using attention responses, similarity measures, dynamic thresholds, or prototype assignments [14,15,16,17]. Although these strategies reduce label ambiguity, their performance depends strongly on early predictions. Incorrect high-confidence instances may be repeatedly used as supervision and reinforced during alternating optimization. In addition, binary pseudo-labels discard the distinction between confident targets, mixed pixels, and uncertain background responses.
Continuous posterior refinement provides a more informative alternative. Rather than immediately assigning hard labels, instance probabilities can be corrected according to their uncertainty and surrounding structure. Confident instances should largely preserve their original predictions, whereas ambiguous instances can receive additional evidence from reliable spectral and spatial neighbors. This selective refinement is particularly important for avoiding uncontrolled error propagation and excessive smoothing of weak targets.
Knowledge distillation has also been used to transfer spectral–spatial representations to lightweight HSI models [20,29,30]. However, most existing approaches address supervised classification, where teacher predictions are supported by reliable instance labels. In region-level weak supervision, the teacher itself estimates uncertain latent labels. Hyper-VMIL therefore refines the topology-conditioned teacher posterior using confidence, bag consistency, and boundary-aware topology before transferring it to a single-spectrum student. This design supports both topology-aware contextual detection and efficient pixel-level deployment.

3. Proposed Method

3.1. Overview and Problem Formulation

Given only region-level annotations, weakly supervised hyperspectral target detection aims to recover pixel-level target responses from bags containing both target and background instances. This problem is highly ambiguous because a positive bag only indicates the existence of at least one target, without revealing its location, number, or abundance. Moreover, weak and mixed targets may be difficult to distinguish from spectrally similar backgrounds when each pixel is considered independently.
To address this problem, as shown in Figure 1, Hyper-VMIL combines contextual instance inference and deployable pixel detection in a unified framework. It first constructs complementary spatial and spectral hypergraphs to describe high-order relations among pixels. A dual-branch hypergraph network then estimates a topology-conditioned variational posterior over the unknown instance labels. The posterior is further refined in a continuous form according to its confidence, bag-level consistency, and spectral–spatial topology. Finally, the refined contextual knowledge is transferred to a single-spectrum detector, enabling efficient pixel-level inference without requiring a hypergraph at deployment time.
Let the training set be
D = ( B i , y i ) i = 1 N ,
where N is the number of bags and y i { 0 , 1 } is the region-level label of the ith bag. Each bag is represented as
B i = ( x i j , r i j ) j = 1 n i ,
where x i j R B denotes the spectrum of the jth pixel, r i j R 2 is its spatial coordinate, B is the number of spectral bands, and n i is the number of instances in the bag.
Under the standard multiple-instance learning assumption,
y i = 1 , j , z i j = 1 , 0 , z i j = 0 , j ,
where z i j { 0 , 1 } is the unknown instance label. Thus, negative bags provide relatively reliable background information, whereas the target locations within positive bags must be inferred during training.
Hyper-VMIL models the latent instance distribution using a topology-conditioned mean-field posterior:
q ϕ z i B i , G i = j = 1 n i Bernoulli ( z i j ; π i j ) ,
where z i = [ z i 1 , , z i n i ] , π i j denotes the contextual target probability, and G i represents the spectral–spatial topology of the bag.
In parallel, a single-spectrum detector produces
s i j = p θ ( z i j = 1 x i j ) = D θ ( x i j ) .
In a probabilistic variational inference setting (Empirical Bayes framework), s i j serves as a parameterized empirical spectral prior (or context-free spectral prior). It represents the instance-level target probability conditioned strictly on the individual spectrum x i j prior to incorporating the high-order spatial–spectral hypergraph topology G i . During training, s i j provides an instance-level spectral prior for variational inference. During testing, D θ can independently evaluate each spectrum without reconstructing the contextual topology. Therefore, π i j represents a context-aware estimate, whereas s i j represents a context-free spectral estimate.
To ground this probabilistic relationship within a rigorous variational inference framework, we formalize region-level weakly supervised HTD as a latent-variable generative model. For a bag B i = { ( x i j , r i j ) } j = 1 n i with spatial–spectral hypergraph topology G i = { G i spa , G i spe } , the joint generative distribution over the unobserved binary instance labels z i = [ z i 1 , , z i n i ] { 0 , 1 } n i and the observed bag label y i { 0 , 1 } is factorized as
p θ ( y i , z i X i , G i ) = p ( y i z i ) p θ ( z i X i , G i ) .
Under the multiple-instance learning principle with label relaxation ϵ ( 0 , 1 ) , the bag-level likelihood p ( y i z i ) conditioned on latent instance labels z i is defined by a Bernoulli distribution:
p ( y i z i ) = 1 ( 1 ϵ ) j = 1 n i ( 1 z i j ) y i ( 1 ϵ ) j = 1 n i ( 1 z i j ) 1 y i .
Rather than assuming independent and identically distributed instances, the prior distribution p θ ( z i X i , G i ) over latent variables z i is formulated as a Hypergraph Markov Random Field (Hypergraph MRF) Gibbs distribution conditioned on the single-spectrum detector D θ and the dual hypergraph Laplacians L i spa , L i spe :
p θ ( z i X i , G i ) = 1 Z ( θ , G i ) exp ( j = 1 n i z i j log s i j 1 s i j + log ( 1 s i j ) λ spa 2 z i L i spa z i λ spe 2 z i L i spe z i ) ,
where Z ( θ , G i ) is the partition function. This Hypergraph MRF prior explicitly anchors the context-free spectral detector s i j = D θ ( x i j ) alongside spatial–spectral hypergraph Laplacians L i spa and L i spe , ensuring that spectrally similar and spatially adjacent instances are encouraged to maintain consistent target states prior to contextual variational inference.

3.2. Dual-Path Spatial–Spectral Hypergraph

A target pixel may receive useful evidence from both its local spatial neighborhood and spectrally similar pixels at distant locations. However, these two relations have different meanings and may not always be equally reliable. Hyper-VMIL therefore represents each bag using two complementary hypergraphs:
G i = G i spa , G i spe .
The spatial hypergraph models local geometric continuity, whereas the spectral hypergraph describes non-local material similarity. Unlike ordinary graphs that connect pairs of nodes, a hyperedge can jointly associate a group of pixels and is therefore suitable for representing spatial patches and spectral-neighbor groups.

3.2.1. Boundary-Aware Spatial Hypergraph

For each center node c, its k spa spatially nearest pixels form a hyperedge e c spa . A topology constructed only from coordinates may connect a weak target with many surrounding background pixels. To suppress unreliable cross-boundary propagation, the soft incidence value is defined jointly by spatial distance and spectral difference:
H j , e c spa = I j N spa ( c ) exp r i j r i c 2 2 2 σ r 2 × exp x i j x i c 2 2 2 σ x 2 ,
where N spa ( c ) denotes the spatial neighborhood of node c. The coordinate kernel favors local interactions, while the spectral kernel reduces the membership of pixels with strong spectral discontinuities.
It is worth clarifying the fundamental distinction between this formulation and conventional boundary-aware pairwise graph weighting methods. Traditional boundary-aware graphs define scalar affinities over independent dyadic edges ( W j k ), which decomposes a local spatial patch into pairwise interactions and discards collective multi-pixel geometry. In contrast, Equation (10) defines a continuous hyperedge incidence entry H j , e c spa [ 0 , 1 ] that characterizes the continuous membership degree of node j within the collective, non-dyadic hyperedge e c . With the normalized hypergraph operator A spa = D v 1 / 2 H W D e 1 H D v 1 / 2 , this formulation enforces a two-stage message-passing mechanism (node-to-hyperedge aggregation followed by hyperedge-to-node broadcast). Consequently, spectrally inconsistent boundary pixels are quadratically attenuated in both aggregation and broadcasting phases, effectively preventing cross-boundary noise leakage while preserving the holistic spatial support of homogeneous interior patches. Furthermore, the resulting hypergraph Laplacian L spa = I A spa is directly integrated into the variational objective to penalize topological inconsistency under Bernoulli posterior uncertainty conditions.

3.2.2. Dynamic Spectral-Manifold Hypergraph

The spatial hypergraph cannot directly associate pixels belonging to the same material when they are spatially separated. A spectral hypergraph is therefore constructed in a learned embedding space:
h i j = E ψ ¯ ( x i j ) ,
where E ψ ¯ is an exponential-moving-average encoder. Its parameters are updated as
ψ ¯ m ψ ¯ + ( 1 m ) ψ ,
where ψ denotes the online encoder parameters and m is the momentum coefficient. The slowly varying encoder produces more stable feature neighborhoods than directly using rapidly updated online embeddings.
For each center node, its k spe nearest neighbors in the embedding space form a spectral hyperedge. The corresponding incidence value is
H j , e c spe = I j N spe ( c ) exp h i j h i c 2 2 2 σ h 2 .
This topology connects spatially distant pixels with similar material characteristics and complements the local spatial structure. Since the embedding space gradually evolves during training, the spectral hypergraph is reconstructed every R iterations rather than after every gradient update, thereby reducing oscillations in neighborhood assignments.
For either hypergraph, the normalized propagation operator is
A = D v 1 2 H W D e 1 H D v 1 2 ,
where H R n i × n i denotes the soft incidence matrix. The diagonal node-degree matrix D v R n i × n i and hyperedge-degree matrix D e R n i × n i are explicitly defined by D v ( j , j ) = e = 1 n i H j , e and D e ( e , e ) = j = 1 n i H j , e , respectively. Following the standard hypergraph spectral formulation, the hyperedge weight matrix is set to the identity matrix W = I n i . The corresponding normalized Laplacian is
L = I A .

3.3. Topology-Conditioned Variational Inference

The spatial and spectral hypergraphs are processed by two independent branches so that their distinct relational properties can be retained. For a hyperspectral bag B i with spectral matrix X i = [ x i 1 , , x i n i ] R n i × B , the initial node representations are initialized via the online spectral encoder: U spa ( 0 ) = U spe ( 0 ) = E ψ ( X i ) R n i × d 0 . For t { spa , spe } , the lth hypergraph layer is defined as
U t ( l + 1 ) = σ A t U t ( l ) W t ( l ) + U t ( l ) R t ( l ) ,
where W t ( l ) is the contextual transformation matrix and R t ( l ) is a residual projection. The first term aggregates features through hypergraph connectivity, while the residual term retains instance-specific spectral information and reduces over-smoothing. Let u i j spa and u i j spe denote the final representations of the two branches. Because spatial continuity and spectral similarity may have different reliability for different pixels, they are fused through a node-adaptive gate:
g i j = σ MLP g u i j spa ; u i j spe ,
u i j = g i j u i j spa + ( 1 g i j ) u i j spe ,
π i j ( ϕ ) = σ w q u i j + b q .
The gate allows the model to emphasize spatial evidence in homogeneous regions and spectral evidence near boundaries or within spatially discontinuous target regions. Here, we collect all learnable parameters of the contextual posterior branch into ϕ = { ψ , { W t ( l ) , R t ( l ) } l , t , Θ g , w q , b q } , where Θ g denotes the weights of MLP g .
To optimize the parameters ϕ of the topology-conditioned posterior q ϕ ( z i X i , G i ) = j = 1 n i Bernoulli ( z i j ; π i j ( ϕ ) ) , evaluating the exact log marginal likelihood log p θ ( y i X i , G i ) = log z i p θ ( y i , z i X i , G i ) directly is computationally intractable due to the combinatorial summation over 2 n i latent states. We therefore construct the Evidence Lower Bound (ELBO) on the marginal log-likelihood as follows:
log p θ ( y i X i , G i ) E q ϕ ( z i ) log p θ ( y i , z i X i , G i ) q ϕ ( z i X i , G i ) = E q ϕ ( z i ) log p ( y i z i ) Term I : Expected Log-Likelihood D KL q ϕ ( z i X i , G i ) p θ ( z i X i , G i ) Term II : Prior KL Divergence .
Equivalence of Term I to L bag q : With the mean-field Bernoulli posterior q ϕ , the expectation of the product term in Equation (7) is evaluated analytically:
E q ϕ j = 1 n i ( 1 z i j ) = j = 1 n i E q ϕ [ 1 z i j ] = j = 1 n i ( 1 π i j ( ϕ ) ) .
Defining the variational bag target prediction as y ^ i q = 1 ( 1 ϵ ) j = 1 n i ( 1 π i j ( ϕ ) ) , the expected log-likelihood expands strictly to
E q ϕ ( z i ) log p ( y i z i ) = y i log y ^ i q + ( 1 y i ) log ( 1 y ^ i q ) = L bag q .
This proves that the bag-level loss L bag q is strictly derived from the expected log-likelihood of the variational ELBO.
Equivalence of Term II to Topology Regularization and L KL : Substituting the Hypergraph MRF prior (Equation (8)) and the mean-field posterior into the KL divergence term yields
D KL q ϕ p θ = E q ϕ log q ϕ ( z i ) log p θ ( z i X i , G i ) = j = 1 n i D KL Bern ( π i j ( ϕ ) ) Bern ( s i j ) + λ spa 2 E q ϕ z i L i spa z i + λ spe 2 E q ϕ z i L i spe z i + log Z ( θ , G i ) .
Under the Bernoulli posterior variance expansion with diagonal covariance matrix Cov q ϕ ( z i ) = Diag ( π i ( ϕ ) ( 1 π i ( ϕ ) ) ) , the expected topology terms expand analytically as
E q ϕ z i L i t z i = π i ( ϕ ) L i t π i ( ϕ ) + tr L i t Diag ( π i ( ϕ ) ( 1 π i ( ϕ ) ) ) R t , t { spa , spe } .
Here, the expansion reveals two distinct physical mechanisms: the quadratic term π i ( ϕ ) L i t π i ( ϕ ) enforces topological smoothness across hypergraph hyperedges by penalizing differences between connected posterior means, whereas the trace term tr [ L i t Diag ( π i ( ϕ ) ( 1 π i ( ϕ ) ) ) ] = j = 1 n i ( L i t ) j j π i j ( ϕ ) ( 1 π i j ( ϕ ) ) acts as an instance-level variance penalty. Because the diagonal elements of the normalized hypergraph Laplacian are positive ( ( L i t ) j j > 0 ), minimizing this trace term explicitly penalizes instance-level Bernoulli uncertainty, thereby driving the posterior predictions π i j ( ϕ ) toward confident binary decisions (0 or 1).

3.4. Confidence-Aware Posterior Refinement

Although the variational posterior integrates multiple sources of evidence, some predictions may remain ambiguous because of mixed spectra, noisy embeddings, or imperfect hyperedges. Directly converting π i j into a hard pseudo-label would discard uncertainty and may reinforce early errors. Hyper-VMIL therefore refines the posterior while retaining its continuous probability form.
The confidence of an instance is estimated from normalized Bernoulli entropy:
H ( π i j ) = π i j log π i j ( 1 π i j ) log ( 1 π i j ) ,
c i j = 1 H ( π i j ) log 2 .
Predictions near zero or one receive high confidence, whereas predictions near 0.5 are considered uncertain and can be corrected more strongly.
For each bag, the refined posterior f i [ 0 , 1 ] n i is obtained by
f i * = arg min f i ( f i π i ) C i ( f i π i ) + μ spa f i L i spa f i + μ spe f i L i spe f i + ξ L bag ( f i , y i ) , f i [ 0 , 1 ] n i ,
where
C i = Diag ( c i 1 + δ , , c i n i + δ )
and δ is a small positive constant.
It is important to emphasize the functional distinction of Equation (27) between the training and testing phases. During model training, weak bag labels y i are available, and setting ξ > 0 provides a weak bag-level consistency constraint to prevent refined posteriors from drifting away from observed annotations. Conversely, during test-time inference on unseen scenes, ground-truth bag labels y i are strictly unavailable. Therefore, for all test evaluations, we strictly set ξ = 0 , removing the term ξ L bag ( f i , y i ) completely. In this label-free test mode, Equation (27) functions purely as an unsupervised manifold-regularized probability refinement process.
The first term preserves reliable posterior predictions. The spatial and spectral Laplacian terms provide complementary corrections to uncertain instances, while the final term maintains consistency with the observed bag label. The bag probability associated with the refined posterior is
y ^ i f = 1 ( 1 ϵ ) j = 1 n i ( 1 f i j ) .
To solve the constrained convex optimization problem in Equation (27) efficiently, we employ Projected Gradient Descent (PGD) with analytical gradient evaluation. Denoting the objective in Equation (27) by J ( f i ) , its exact gradient with respect to f i is derived as
f i J ( f i ) = 2 C i ( f i π i ) + 2 μ spa L i spa + μ spe L i spe f i + ξ g bag ( f i ) ,
where the j-th entry of the bag loss gradient vector g bag ( f i ) R n i evaluates analytically to
[ g bag ( f i ) ] j = L bag ( f i , y i ) f i j = y ^ i f y i y ^ i f ( 1 y ^ i f ) · ( 1 ϵ ) k j n i ( 1 f i k ) .
Starting from the initial contextual posterior f i ( 0 ) = π i , the refined posterior is updated iteratively over T refine = 10 steps with a fixed step size η = 0.05 using Euclidean projection onto the probability simplex [ 0 , 1 ] n i :
f i ( t + 1 ) = clip f i ( t ) η f i J ( f i ( t ) ) , 0 , 1 , t = 0 , , T refine 1 .
Equation (27) can be solved using a small number of projected-gradient iterations. Unlike conventional hard pseudo-labeling, the result retains both target probability and uncertainty information. Moreover, the confidence-weighted fidelity term prevents topology regularization from uniformly smoothing all nodes.
While the confidence-weighted fidelity term ( f i π i ) C i ( f i π i ) prevents uniform over-smoothing, entropy-based confidence measures predictive certainty rather than ground-truth correctness. If left unconstrained, an isolated false-positive prediction with high certainty ( π i j 1 , c i j 1 ) could receive a large fidelity weight and risk entrenching confirmation bias. In Hyper-VMIL, such confidently incorrect predictions are systematically rectified through two mathematically coupled mechanisms: collective topological overruling and orthogonal spectral prior anchoring.
First, CTPR performs a globally coupled optimization over the entire bag manifold in Equation (27). When an isolated background pixel j yields an erroneous high-confidence posterior π i j 0.95 , its surrounding spatial neighbors and spectral k-NN peers within the incident hyperedges remain predominantly background ( π i k 0 ). In this setting, maintaining a large refined value f i j * 0.95 creates steep gradients across incident hyperedges, incurring an extreme quadratic energy penalty f i ( μ spa L i spa + μ spe L i spe ) f i = e w ( e ) u , v e ( f i u f i v ) 2 δ ( e ) . Because the topological penalty scales quadratically with the discrepancy across all hyperedge members, the collective consensus of the entire hyperedge neighborhood mathematically overrules the single-node fidelity weight c i j , pulling f i j * back down toward the true background manifold.
Second, the contextual posterior π i ( ϕ ) is strictly anchored to the single-spectrum detector prior s i j = D θ ( x i j ) via mode-seeking forward KL divergence in Equation (23). The detector D θ evaluates the physical spectrum x i j on a single-pixel basis, free from spatial neighborhood context. With the zero-forcing property of forward KL divergence ( lim s i j 0 D KL ( Bern ( π i j ) Bern ( s i j ) ) = + if π i j > 0 ), any spurious contextual activation on a background pixel ( s i j 0 ) is heavily penalized during the alternating E-step, forcing π i j 0 in subsequent GEM iterations and breaking the confirmation bias feedback loop.

3.5. Topology-Teacher and Pixel-Student Learning

The hypergraph posterior uses the complete bag and its spatial–spectral relations and is therefore regarded as a contextual teacher. The single-spectrum detector acts as a pixel student. Since the teacher itself is learned from weak labels, its predictions are not treated as equally reliable ground truth. Instead, the refined posterior is transferred according to its confidence.
The confidence of the refined posterior is
c ˜ i j = 1 H ( f i j ) log 2 ,
and the confidence-weighted soft supervision is
L soft = i , j w i j f i j log s i j + ( 1 f i j ) log ( 1 s i j ) ,
where
w i j = τ + ( 1 τ ) c ˜ i j , 0 < τ < 1 .
The lower bound τ > 0 plays a vital role in preventing confirmation bias against weakly expressed targets. For heavily mixed or subpixel targets where spectral overlap induces moderate posterior uncertainty ( f i j 0.5 , c ˜ i j 0 ), setting τ > 0 guarantees that genuine target responses retain a non-zero distillation gradient ( w i j τ ), preventing faint target features from being completely discarded during student training.
The student is additionally constrained by the original bag labels:
y ^ i s = 1 ( 1 ϵ ) j = 1 n i ( 1 s i j ) ,
L bag s = i y i log y ^ i s + ( 1 y i ) log ( 1 y ^ i s ) .
Crucially, the direct bag-level supervision L bag s provides an indispensable safety net that prevents the student from unconditionally memorizing incorrect teacher predictions. For negative bags ( y i = 0 ), L bag s enforces j = 1 n i ( 1 s i j ) 1 , which strictly penalizes all instance responses s i j 0 . Even if the contextual teacher momentarily transfers a false-positive pseudo-label on a negative bag, the loss L bag s acts as a hard constraint anchored to the ground-truth weak supervision, directly suppressing student false alarms and preventing error accumulation across M-step optimization.
To transfer structural information during training, the student predictions are regularized over the two hypergraphs:
L man = i s i L i spa + L i spe s i .
This regularizer encourages the student decision function to approximate the topology-conditioned teacher along reliable training manifolds. It is used only during training and does not imply that the student directly observes test-scene topology.
We further impose prediction consistency under weak spectral perturbation conditions:
L aug = i , j D SKL D θ ( x i j ) , D θ ( x ˜ i j ) ,
where D SKL ( u , v ) = D KL ( Bern ( u ) Bern ( v ) ) + D KL ( Bern ( v ) Bern ( u ) ) is the symmetric Kullback–Leibler divergence between two scalar Bernoulli probabilities u = D θ ( x i j ) and v = D θ ( x ˜ i j ) , expanding analytically to
D SKL ( u , v ) = ( u v ) log u ( 1 v ) v ( 1 u ) .
The perturbed spectrum x ˜ i j is generated via stochastic spectral transformations: zero-mean Gaussian noise injection ϵ N ( 0 , σ noise 2 I ) with σ noise = 0.02 , random band erasure with masking probability p mask = 0.15 , and random global intensity scaling with multiplicative factor ρ scale U ( 0.9 , 1.1 ) .
The complete student objective is
L M = L soft + α L bag s + ρ L man + κ L aug .

3.6. Optimization and Inference

The overall optimization is formulated as a Generalized Variational Expectation-Maximization (GEM) framework [31]. Rather than alternating between heuristic discriminative networks, the algorithm alternately optimizes the variational posterior parameters ϕ and the generative student detector parameters θ to optimize the regularized ELBO bound. The exact parameter partitioning and gradient update schedule per mini-batch are detailed below:
  • Variational E-Step (Updating Contextual Posterior ϕ ): With the student detector parameters θ held fixed, the empirical spectral prior s i j = D θ ( x i j ) is evaluated as a detached constant tensor ( detach ( s i j ) ). We perform K E = 1 mini-batch gradient step on teacher parameters ϕ = { ψ , { W t ( l ) , R t ( l ) } l , t , Θ g , w q , b q } to minimize the negative Evidence Lower Bound ( ELBO ( ϕ ) , derived in Equations (20)–(24)) using Adam.
  • Continuous Posterior Refinement (Solving f i * ): Given the inferred posterior probabilities π i ( ϕ ) as detached inputs, the continuous refined posterior f i * is solved via T refine = 10 iterations of Projected Gradient Descent (PGD) according to Equation (32). This step executes non-parametric manifold smoothing on the simplex [ 0 , 1 ] n i without updating any neural network weights.
  • Generalized M-Step (Updating Single-Spectrum Student θ ): With teacher parameters ϕ held fixed, the refined posterior targets f i * and confidence weights c ˜ i j are treated as detached supervision constants ( detach ( f i * ) , detach ( c ˜ i j ) ). We execute K M = 1 mini-batch gradient step on student detector parameters θ to minimize L M (Equation (41)).
  • EMA Encoder and Hypergraph Updates: Following each mini-batch, the momentum encoder parameters are updated via ψ ¯ m ψ ¯ + ( 1 m ) ψ ( m = 0.99 ). The dynamic spectral-manifold hypergraph G i spe is reconstructed every R = 5 epochs in the 64-D embedding space, ensuring topological stability.
Hyper-VMIL supports two complementary inference modes. In Pixel Mode, only the student detector is used:
d j pix = D θ ( x j ) .
This mode requires neither spatial coordinates nor test-scene hypergraph construction and is suitable for fast or resource-constrained deployment.
In Context Mode, spatial and spectral hypergraphs are constructed for the test region, and the refined teacher posterior f j is combined with the student prediction s j :
d j ctx = γ f j + ( 1 γ ) s j ,
where γ [ 0 , 1 ] balances contextual and single-spectrum evidence.
Crucially, to enforce a strictly label-free testing protocol and eliminate any possibility of test-label leakage, posterior refinement during context-mode inference is performed by setting ξ = 0 in Equation (27). With this setting, the test-time continuous posterior refinement reduces to solving the following unsupervised optimization problem without relying on any test bag annotations:
f i * = arg min f i [ 0 , 1 ] n i ( f i π i ) C i ( f i π i ) + μ spa f i L i spa f i + μ spe f i L i spe f i .
This optimization relies exclusively on the model’s predicted posterior fidelity, posterior confidence C i , and the unsupervised spatial–spectral hypergraph Laplacians ( L i spa and L i spe ) constructed from the test scene.

4. Experiments

To comprehensively evaluate the performance, robustness, and computational efficiency of the proposed Hyper-VMIL framework, extensive experiments were conducted on three benchmark hyperspectral detection datasets, including one simulated dataset and two complex real-world airborne datasets.

4.1. Datasets and Bag Construction

  • Simulated ASTER Dataset: Following the standard simulation protocol in weakly supervised hyperspectral target detection (HTD), six endmembers were selected from the USGS/ASTER spectral library [32]. Red Slate was designated as the target material, while the remaining five were used as backgrounds. Hyperspectral mixtures were synthesized using the Linear Mixing Model (LMM) [33] with Dirichlet-distributed abundances, and 30 dB Gaussian white noise was added. To evaluate detection performance at varying target strengths, three sub-datasets were generated with average target abundances p ¯ t { 0.1 , 0.2 , 0.3 } . Each sub-dataset consisted of 1000 bags (300 positive bags containing subpixel targets and 700 negative background bags), with a bag size of n i = 25 ( 5 × 5 spatial patches).
  • MUUFL Gulfport Dataset [34]: Collected over the Gulfport campus of the University of Southern Mississippi, this dataset comprises 330 × 340 pixels across 64 clean spectral bands after removing water-absorption channels. It contains four distinct color fabric targets (Brown, Dark Green, Faux Vineyard Green, and Pea Green) ranging in size from 0.25 m 2 to 9 m 2 , many of which are heavily occluded by tree canopies. To simulate region-level weak supervision with positional uncertainty, positive bags ( 5 × 5 regions) were formed centered around coarse target GPS coordinates with 1–2 pixel random spatial offsets, while background patches formed negative bags.
  • Avon Dataset [35]: The Avon dataset contains two airborne hyperspectral images captured over Avon, New York, at different times of the day (Avon-AM and Avon-PM). Each scene consists of 1635 × 302 pixels with 360 spectral bands, featuring Blue and Brown fabric targets. To evaluate cross-scene and cross-temporal generalization, a 2-fold cross-validation scheme was adopted: training on Avon-AM and testing on Avon-PM, and vice versa.

4.2. Baseline Algorithms

To comprehensively demonstrate the detection capability and superiority of Hyper-VMIL, 15 baseline methods were selected for comparison, categorized into four groups:
  • Traditional Prior-Based Detectors: Matched Filter (MF) [36], Adaptive Coherence Estimator (ACE) [37], Reed-Xiaoli Detector (RX) [38], and Subspace Matched Filter (SMF) [39].
  • Concept/Instance-Level MIL Methods: MI-ACE [40], MI-SMF [41], and MILES [42].
  • Multiple-Instance Neural Networks (MINNs): Attention-DMIL [43], L1-attention MINN [44], CS-attention MINN [13], and HTD-TS3 [14].
  • Advanced Deep Detectors: SSBDM [12] (spectral–spatial bilinear decomposition model), SpecDETR [11] (spectral–spatial Transformer point object detector), Proxy-PMMN [16] (proxy-enhanced prototype memory network), and VMIL-ECM [15] (variational multiple-instance learning with embedding correlation modeling).

4.3. Evaluation Metrics

The performance was quantitatively evaluated using Receiver Operating Characteristic (ROC) curves and the corresponding Area Under the Curve (AUC) metrics:
  • Global AUC ( AUC ( D , F ) ): Calculated over the full False Positive Rate (FPR) range [ 0 , 1 ] .
  • Normalized Low-FPR AUC ( NAUC FPR 10 3 ): In real-world HTD applications, suppressing false alarms at extremely low FPR thresholds is crucial. Following the standard evaluation protocol, low-FPR AUC is integrated over FPR [ 0 , 10 3 ] and normalized by 10 3 :
    NAUC FPR 10 3 = 1 10 3 0 10 3 P d ( P f ) d P f ,
    where P d and P f denote the probability of detection and false alarm rate, respectively.
  • Target-Background Separability: Illustrated via box plots to evaluate background suppression and target response isolation.

4.4. Implementation Details and Hyperparameter Settings

To ensure rigorous reproducibility, this section provides explicit details regarding spectral preprocessing, network architectures, dataset bag partition statistics, optimization protocols, hyperparameter search grids, and execution environments.

4.4.1. Spectral Preprocessing and Dataset Bag Statistics

For all hyperspectral scenes, noisy and water-absorption bands were removed prior to modeling (retaining 64 clean bands for MUUFL Gulfport and 360 bands for Avon). Each spectral vector x R B was normalized via channel-wise Z-score standardization: x norm = ( x μ ) σ , where μ and σ represent the band-wise mean and standard deviation computed exclusively over the training set.
To construct region-level weakly supervised bags, each hyperspectral scene was partitioned into regular spatial blocks of size 5 × 5 ( n i = 25 ) using a non-overlapping grid tiling strategy with spatial stride S = 5 . This strictly ensured zero pixel overlap between any two bags ( B i B j = , i j ). A bag was labeled as positive ( y i = 1 ) if it contained at least one target pixel and negative ( y i = 0 ) otherwise. Crucially, all spatial and spectral hypergraphs G i were constructed strictly within the n i = 25 local instances of each individual bag. No cross-bag or cross-subset topological edges were created, completely preventing inter-bag topological leakage during training and test inference.
To strictly rule out spatial autocorrelation and target-object leakage between training, validation, and test subsets, we enforced a Target-Isolated Spatially Disjoint Block Partitioning protocol rather than uniform bag-level random shuffling. For MUUFL Gulfport, physical target objects and their surrounding background neighborhoods were grouped geographically into contiguous spatial regions. All positive and negative bags associated with a specific physical target object were assigned en bloc to either the training (60%), validation (20%), or test (20%) set, ensuring that no physical target object spanned across dataset splits. Furthermore, spatial guard bands of d guard = 10 pixels ( 10 m ) were established between geographically partitioned blocks, and bags within buffer zones were excluded to eliminate background spatial autocorrelation contamination. For the cross-temporal Avon dataset, models were trained on Avon-AM and evaluated on Avon-PM (and vice versa) over separate airborne flight passes, intrinsically guaranteeing complete spatial, target-object, and temporal domain isolation.
The detailed bag construction parameters and positive-to-negative bag ratios under target-isolated spatial block partitioning conditions across benchmark datasets are summarized in Table 1.
Statistical Evaluation Protocol: To eliminate randomness stemming from bag sampling, dynamic hypergraph construction, and EMA updates, all quantitative results across all benchmark datasets are reported as the mean ± standard deviation over 5 independent runs with distinct random seeds ( 42 , 100 , 2024 , 3407 , 8888 ). All metrics are reported to three decimal places. Paired two-tailed t-tests are conducted to verify statistical significance, with p < 0.01 marked as statistically significant (*).

4.4.2. Detailed Network Architectures and Layer Configurations

The proposed Hyper-VMIL framework consists of four main sub-networks: the exponential-moving-average (EMA) spectral encoder E ψ ¯ , the dual-path hypergraph neural network (HGNN), the node-adaptive fusion gate MLP g , and the lightweight student detector D θ . The explicit layer specifications, hidden dimensions, activation functions, and regularization layers are detailed in Table 2.

4.4.3. Optimization Protocol and Hyperparameter Tuning

The framework was optimized using Adam with an initial learning rate of 1 × 10 3 , weight decay of 1 × 10 4 , and a cosine annealing learning rate schedule ( η min = 1 × 10 6 ) over 200 epochs. Training was conducted with a mini-batch size of 32 bags. The warm-up phase spanned E warm = 20 epochs.
All hyperparameter values were selected based on grid search cross-validation on the validation set. The search ranges and finalized default values across all experiments are detailed below:
  • Hypergraph Construction Parameters: Spatial bandwidth σ r = 3.0 ( σ r [ 1.0 , 5.0 ] ), spectral difference bandwidth σ x = 0.5 ( σ x [ 0.1 , 1.0 ] ), embedding manifold bandwidth σ h = 1.0 ( σ h [ 0.2 , 2.0 ] ). Spatial neighborhood size k spa = 8 ( k spa { 2 , 4 , 8 , 12 , 16 } ) using 2D k-d trees; spectral neighborhood size k spe = 10 ( k spe { 5 , 10 , 15 , 20 } ) using L 2 distance in 64-D embedding space reconstructed every R = 5 epochs ( R { 1 , 3 , 5 , 10 } ). The EMA momentum was m = 0.99 ( m [ 0.9 , 0.999 ] ).
  • Variational E-Step Objectives: Noisy-OR label relaxation parameter ϵ = 1 × 10 4 . KL prior penalty β = 0.1 ( β [ 0.01 , 0.5 ] ). Spatial and spectral topology regularization weights λ spa = λ spe = 0.05 ( λ [ 0.01 , 0.2 ] ).
  • Continuous Posterior Refinement (CTPR): The optimization problem in Equation (27) was solved using Projected Gradient Descent (PGD) with T refine = 10 iterations and a constant step size η = 0.05 . Confidence weighting offset δ = 1 × 10 4 , smoothing weights μ spa = μ spe = 0.1 ( μ [ 0.01 , 0.5 ] ), and bag consistency weight ξ = 1.0 ( ξ [ 0.1 , 2.0 ] ).
  • Training vs. Testing Protocol for ξ : During the training stage, the bag consistency weight was set to ξ = 1.0 ( ξ [ 0.1 , 2.0 ] ) to enforce weak bag label alignment. Crucially, during the testing/inference stage on unseen scenes, test bag labels were strictly unavailable; thus, we strictly enforced ξ = 0 for all test evaluations across all benchmark datasets. This ensured a fully label-free inference process without any test-label leakage.
  • Student M-Step Distillation: Distillation confidence lower bound τ = 0.2 ( τ [ 0.05 , 0.5 ] ), student bag loss weight α = 1.0 , student manifold regularization ρ = 0.01 ( ρ [ 0.001 , 0.05 ] ), and spectral augmentation weight κ = 0.05 ( κ [ 0.01 , 0.1 ] ). Spectral augmentations comprised additive Gaussian noise ( σ noise = 0.02 ), random band masking ( p mask = 0.15 ), and random intensity scaling ( [ 0.9 , 1.1 ] ). Context Mode inference score fusion weight was γ = 0.5 ( γ [ 0 , 1 ] ).

4.5. Experimental Results and Analysis

In this section, we present a comprehensive quantitative and qualitative evaluation of the proposed Hyper-VMIL framework on the simulated ASTER dataset and two real-world airborne datasets (MUUFL Gulfport and Avon). Both Hyper-VMIL (Pixel Mode) and Hyper-VMIL (Context Mode) are benchmarked against 15 state-of-the-art detection algorithms.

4.5.1. Quantitative Performance Comparison

To eliminate stochasticity stemming from weak bag sampling, network initialization, and dynamic hypergraph updates, all quantitative outcomes reported in Table 3, Table 4 and Table 5 represent the mean ± standard deviation evaluated across 5 independent random seeds ( 42 , 100 , 2024 , 3407 , 8888 ). All numerical results are rounded strictly to three decimal places. Furthermore, two-tailed paired t-tests were conducted between Hyper-VMIL and the best baseline (VMIL-ECM) to verify statistical significance.
On the simulated ASTER dataset (Table 3), target spectral signatures are heavily diluted by background endmembers at low target abundance ( p ¯ t = 0.1 ). Traditional methods struggle due to severe endmember mismatch, while standard MINNs lack high-order spatial modeling. Advanced deep baselines exhibit distinct performance characteristics: SpecDETR benefits from global token interactions at high target abundance, reaching 0.978 at p ¯ t = 0.3 , but degrades sharply to 0.892 at p ¯ t = 0.1 due to background attention distractions with weak signals. Conversely, Proxy-PMMN leverages robust prototype representations to achieve 0.916 at p ¯ t = 0.1 yet plateaus at 0.969 when abundance increases. In contrast, Hyper-VMIL (Context Mode) consistently outperforms all competing baselines across all abundance levels, reaching 0.938 at p ¯ t = 0.1 ( + 2.6 % over VMIL-ECM, + 3.1 % over SSBDM, and + 4.6 % over SpecDETR). Crucially, Hyper-VMIL (Pixel Mode) reaches 0.925 at p ¯ t = 0.1 , proving that distilling hypergraph manifold topology into single-spectrum student weights effectively preserves weak target discrimination under severe abundance dilution conditions.
Table 4 reports the normalized low-FPR detection metrics ( NAUC FPR 10 3 , Mean ± Std over 5 independent random runs) on the real-world MUUFL Gulfport dataset. With severe tree canopy occlusions and background clutter, traditional prior detectors yield average NAUC scores below 0.330 with minor partition variances ( ± 0.002 ± 0.003 ), while deep MINNs (e.g., HTD-TS3 at 0.507 ± 0.009 ) offer moderate improvements. Advanced deep detectors exhibit distinct trade-offs: SpecDETR performs well on prominent targets like Dark Green ( 0.636 ± 0.007 ) but degrades on subpixel targets like Pea Green ( 0.409 ± 0.009 ), whereas Proxy-PMMN ( 0.528 ± 0.007 ) and VMIL-ECM ( 0.531 ± 0.008 ) maintain better subpixel stability. In contrast, Hyper-VMIL (Context Mode) achieves the highest detection performance across all fabric target classes with an overall average NAUC of 0.577 ± 0.005 , delivering statistically significant margins over Proxy-PMMN ( + 0.049 ) and VMIL-ECM ( + 0.046 , p = 0.0004 < 0.01 ). Specifically, on heavily occluded subpixel targets such as Faux Vineyard Green ( 0.531 ± 0.006 vs. 0.482 ± 0.009 ) and Pea Green ( 0.465 ± 0.005 vs. 0.418 ± 0.008 ), Hyper-VMIL establishes substantial gains of + 0.049 and + 0.047 , respectively. Crucially, Hyper-VMIL (Pixel Mode) reaches an average NAUC of 0.556 ± 0.006 , consistently surpassing all competing advanced deep baselines under single-spectrum inference conditions ( + 0.025 over VMIL-ECM, p = 0.0031 < 0.01 ). Furthermore, Hyper-VMIL exhibits tight standard deviations across all seeds ( σ 0.006 ), noticeably lower than those of standard MINNs ( σ 0.011 ) and advanced deep baselines ( σ 0.008 ), confirming that confidence-aware continuous posterior refinement (CTPR) and the momentum-updated EMA encoder effectively stabilize optimization against stochastic fluctuations.
For cross-temporal transfer evaluation on the Avon dataset (Table 5), significant solar zenith shifts, atmospheric turbulence, and shadow variations between morning (AM) and afternoon (PM) acquisitions present severe domain shift challenges. Traditional prior detectors suffer substantial performance drops across flight lines, yielding cross-fold mean NAUC scores around 0.400 . Advanced deep baselines exhibit contrasting cross-temporal behaviors: SpecDETR achieves a competitive 0.634 on AM PM where illumination is bright but drops to 0.592 on PM AM due to token attention instability with complex shadow boundaries (yielding a cross-fold mean of 0.613 ). In contrast, Proxy-PMMN demonstrates robust reverse transfer capability on PM AM ( 0.636 ), achieving a cross-fold mean of 0.627 . Hyper-VMIL (Context Mode) achieves the highest performance across both transfer directions ( 0.681 on AM PM and 0.665 on PM AM ), reaching a cross-fold mean NAUC of 0.673 and delivering an absolute gain of + 4.5 % over VMIL-ECM and + 6.0 % over SpecDETR. Furthermore, Hyper-VMIL (Pixel Mode) reaches a cross-fold mean of 0.650 , surpassing all competing advanced deep baselines under single-spectrum inference conditions, which confirms that our momentum-updated EMA encoder and confidence-aware posterior refinement provide superior robustness against temporal illumination and atmospheric variations.

4.5.2. Low-FPR ROC Performance

In real-world HTD applications, target detection probability with extremely low false positive rates ( FPR 10 3 ) is the primary operational criterion. Figure 2 illustrates the ROC curves truncated at FPR = 1 × 10 3 for four target classes in the MUUFL Gulfport dataset.
As shown in Figure 2, traditional prior methods (e.g., ACE and SMF) exhibit steep performance degradation with low FPR thresholds because background clutter induces false alarms. While VMIL-ECM improves low-FPR detection, its dynamic hard binarization occasionally misclassifies ambiguous background pixels as targets, leading to early false alarm rate spikes. In contrast, Hyper-VMIL maintains the highest True Positive Rate (TPR) across FPR [ 0 , 10 3 ] . This advantage is particularly pronounced on subpixel targets (Faux Vineyard Green and Pea Green), where the boundary-aware hypergraph prevents weak target signals from being absorbed into adjacent vegetation backgrounds.

4.5.3. Target-Background Separability Analysis

To evaluate background suppression capability and feature separability, Figure 3 depicts box plots of normalized detection statistics for target and background pixels across all four target classes on the MUUFL Gulfport dataset. For all evaluated detectors, raw detection scores d R M over the test scene are mapped into the unit interval [ 0 , 1 ] using scene-wide min–max normalization: d ˜ j = ( d j min k d k ) / ( max k d k min k d k ) .
As illustrated in Figure 3, traditional detectors such as ACE exhibit substantial distributional overlap between target (red) and background (blue) scores, resulting in poor separability and elevated false alarm rates. VMIL-ECM widens the gap between distribution medians but suffers from a broad background spread with frequent upper-tail outliers reaching d ˜ j 0.60 . In contrast, Hyper-VMIL achieves superior target–background margin separation: background responses are tightly compressed into a low score regime (median 0.07 , IQR [ 0.03 , 0.12 ] ), while target medians are elevated to ≈0.72.
Crucially, the distributions in Figure 3c physically reconcile with our reported low-FPR detection performance ( NAUC FPR 10 3 = 0.577 ). In real-world airborne scenarios, subpixel targets occluded by tree canopies (Faux Vineyard Green and Pea Green) generate heavy lower tails extending into [ 0.35 , 0.50 ] due to severe spectral mixing. Concurrently, spectrally anomalous background clutter (such as artificial roof materials) produces sparse upper-tail outliers extending to [ 0.25 , 0.40 ] . Because the NAUC FPR 10 3 metric evaluates the detection rate when the background false alarm count is strictly bounded to the top 0.1 % of pixels, these upper-tail outliers set the operational threshold, yielding a realistic detection probability of 55–65% at ultra-low FPR thresholds while avoiding over-optimistic separation artifacts.

4.6. Computational Complexity and Inference Efficiency Analysis

To evaluate the computational footprint and deployment feasibility of Hyper-VMIL for practical airborne and spaceborne line-scan platforms, we conducted a comprehensive efficiency analysis on an NVIDIA RTX 4090 GPU (24 GB VRAM) and an Intel Xeon Gold 6330 CPU.

4.6.1. Experimental Measurement Protocol

All runtime and throughput metrics are benchmarked with single-precision floating-point (FP32) arithmetic. To provide an objective evaluation, we strictly distinguished between two operational paradigms:
  • Single-Instance Latency (B = 1): Evaluated by processing a single spectrum or patch ( B = 1 ), fully accounting for GPU kernel launch overhead, memory allocation, and CPU–GPU data transfer.
  • Amortized Streaming Throughput (B = 10,000): Evaluated by processing parallel streaming batches ( B = 10 , 000 ) and dividing total execution time by the pixel count, faithfully simulating continuous airborne line-scan scanning.
Execution time was recorded via CUDA hardware event timers with explicit stream synchronization barriers after 50 warm-up iterations and averaged over 500 independent experimental runs.

4.6.2. Accuracy–Efficiency Trade-Off Analysis

As reported in Table 6, the experimental benchmark highlights the distinct operational trade-offs of the two inference modes in Hyper-VMIL:
  • Context Mode (Accuracy-Prioritized): Context Mode yields the highest detection performance ( 0.577 NAUC) but incurs a single-patch latency of 240.00 μ s ( 1.150 μ s /pixel under streaming throughput conditions). This computational overhead is primarily attributed to online spatial–spectral hypergraph construction and CTPR matrix inversion. Consequently, Context Mode is best suited for offline verification or high-precision scenarios where execution time is secondary.
  • Pixel Mode (Deployment-Prioritized): In sharp contrast, Pixel Mode completely eliminates test-time graph construction by deploying only the lightweight 3-layer MLP student detector ( D θ ). Requiring merely 0.08 M parameters (< 5 % of Context Mode and < 6 % of VMIL-ECM) and 45 MB peak VRAM, Pixel Mode achieves an end-to-end single-spectrum latency of 1.25 μ s ( B = 1 , including I/O). With continuous streaming batching ( B = 10 , 000 ), its amortized throughput reaches 0.015 μ s /pixel (∼ 80 × faster than Context Mode and ∼ 56 × faster than VMIL-ECM). By preserving 96.4 % of the Context Mode NAUC ( 0.556 vs. 0.577 ), Pixel Mode successfully bridges the gap between complex offline topological modeling and real-time onboard detection.

4.7. Ablation Study

To systematically evaluate the mathematical formulations and architectural choices introduced in Section 3, we decomposed the ablation study into three functional categories: Topological and Architectural Representation, Variational Inference and Continuous Refinement, and Teacher–Student Distillation. Table 7, Table 8, Table 9 and Table 10 and Figure 4, Figure 5 and Figure 6 summarize the quantitative and qualitative ablation results on the MUUFL Gulfport and Avon datasets.

4.7.1. Analysis of Topological and Architectural Representation

Table 7 reports performance variations when disabling or modifying the dual-path hypergraph construction, dynamic update rules, or network fusion strategies.
  • Boundary-Aware Spatial Hypergraph (Variant 1): Removing the spectral difference kernel from Equation (10) (relying solely on 2D spatial coordinates) results in a 2.9 % drop in average NAUC on MUUFL. As visually evidenced in Figure 4, coordinate-only spatial hyperedges forcefully connect the target node with adjacent tree canopy and soil background pixels, causing severe message-passing leakage that dilutes weak subpixel target signatures. In contrast, Hyper-VMIL’s spectral difference kernel sharply attenuates incidence weights across spectral discontinuities, confining spatial message passing within homogeneous material boundaries.
  • Dynamic Spectral Manifold and EMA Encoder (Variants 2–3): Fixing the initial spectral hypergraph (Variant 2) decreases performance by 3.6 % , proving that static spectral embeddings cannot adapt to the evolving latent space. Replacing the EMA encoder ( E ψ ¯ in Equation (12)) with a rapidly updated online encoder (Variant 3) leads to a 2.4 % drop. Rapidly fluctuating node neighborhoods induce optimization instability, confirming that momentum updating provides indispensable manifold stability.
  • HGNN Residual Propagation and Gating (Variants 4–5): Omitting the residual projection term R t ( l ) in Equation (16) (Variant 4) degrades performance by 3.3 % . The residual path preserves raw single-pixel spectral identity during hypergraph message passing. Furthermore, replacing node-adaptive gating (Equation (17), Variant 5) with equal fusion drops average NAUC by 1.9 % , proving that dynamic spatial-versus-spectral weighting is essential for handling heterogeneous spatial patches.

4.7.2. Analysis of Variational Inference and Continuous Refinement

Table 8 evaluates the impact of variational probabilistic formulation and posterior refinement objectives.
  • Bernoulli Expected Topology Regularization (Variant 6): Substituting the expected topology energy (Equation (24)) with conventional deterministic smoothness ( π i L i t π i ) decreases average NAUC by 2.6 % . This verifies that explicitly modeling the Bernoulli posterior variance π i ( 1 π i ) prevents over-confident, smooth predictions on uncertain mixed boundary pixels.
  • Posterior-Prior KL Constraint (Variant 7): Setting β = 0 in Equation (23) causes a 3.9 % performance drop. The single-spectrum detector prior s i j acts as an anchor that prevents contextual variational inference from overfitting to noisy bag-level labels or misleading hyperedges.
  • Continuous Refinement vs. Hard Pseudo-Labeling (Variant 8): Replacing continuous posterior refinement (CTPR, Equation (27)) with iterative hard pseudo-label binarization ( f i ( t + 1 ) = I ( clip ( f i ( t ) η f i J ( f i ( t ) ) , 0 , 1 ) τ hard ) with τ hard = 0.50 , as in [15]) induces a significant 3.5 % degradation in average NAUC ( 0.542 vs. 0.577 ). To rigorously diagnose the underlying physical and mathematical causes of this degradation, Figure 5 tracks the dynamic trajectory evolution of three diagnostic pixel subsets ( N = 50 each, sampled strictly post hoc using ground-truth abundance and canopy metadata without exposing labels during training or inference):
    (i)
    High-Confidence Targets ( a j 0.70 , initial variational posterior π i j ( 0 ) 0.68 );
    (ii)
    Occluded Subpixel Targets ( 0.15 a j 0.45 , initial posterior π i j ( 0 ) 0.43 );
    (iii)
    Confusing Background Pixels ( π i j ( 0 ) 0.22 ).
    As quantitatively evidenced in Figure 5a, although both methods initialize from identical continuous posteriors at t = 1 , Variant 8’s hard decision threshold τ hard = 0.50 triggers an irreversible error propagation loop: because occluded subpixel targets exhibit initial probabilities slightly below threshold ( π i j ( 0 ) 0.43 < 0.50 ) due to heavy canopy mixing, iterative hard truncation progressively forces their values downward over iterations t = 2 ∼4 ( 0.43 0.18 0.00 ). Once clamped to zero, these genuine subpixel targets enter an absorbing state where gradient updates vanish ( f i j J 0 ), permanently discarding weak targets and reinforcing confirmation bias during alternating optimization.
    In sharp contrast, Figure 5b demonstrates the smooth recovery dynamics of our continuous CTPR solver on [ 0 , 1 ] n i . Because continuous probabilities retain non-zero directional gradients, non-local topological diffusion from surrounding spatial and spectral hyperedges continuously injects positive affinity energy into occluded target nodes. Over iterations t = 2 ∼8, the refined posterior f i j ( t ) for occluded targets smoothly climbs from ≈0.43 to ≈0.80, while spectrally confusing background false alarms are progressively attenuated from ≈0.22 to ≈0.03. This validates that continuous variational smoothing over the probability simplex is mathematically indispensable for rescuing weak subpixel targets without confirmation bias.
  • Label-Free Testing vs. Oracle Upper Bound Analysis: To strictly prevent data leakage, all the reported Context Mode results utilize CTPR in a strictly label-free manner ( ξ = 0 in Equation (44)). To evaluate the upper performance bound of CTPR if test-level bag annotations were hypothetically available during testing, we also benchmark an Oracle Reference setting ( ξ = 1.0 ). As shown in Table 8, fraudulently incorporating ground-truth test bag labels boosts the average NAUC on MUUFL from 0.577 to 0.685 . The significant margin ( + 0.108 NAUC) between the Oracle reference and our reported score ( 0.577 ) strictly verifies that our experimental evaluation protocol is completely label-free and free of test-label leakage.

4.7.3. Sensitivity and Comparative Analysis of Divergence Functions

To empirically validate the theoretical superiority of forward KL divergence D KL ( q p ) in Equation (23), we benchmark four distinct divergence formulations under identical training protocols: Forward KL D KL ( q p ) , Reverse KL D KL ( p q ) , Symmetric KL D SKL ( q , p ) , and Jensen–Shannon Divergence JSD ( q , p ) . The quantitative comparative results are summarized in Table 9.
As reported in Table 9, Forward KL D KL ( q p ) achieves the best detection accuracy ( 0.577 average NAUC on MUUFL). In contrast, Reverse KL D KL ( p q ) triggers a substantial 0.035 performance drop ( 0.542 ). This degradation occurs because the mean-seeking property forces posterior probabilities to spread over ambiguous background clutter, increasing false alarms at low FPR thresholds. Symmetric KL ( 0.553 ) and JSD ( 0.561 ) also underperform Forward KL due to gradient attenuation near distribution boundaries, confirming that mode-seeking Forward KL is mathematically and empirically optimal for weak target detection.

4.7.4. Analysis of Collaborative Teacher–Student Distillation

Table 10 summarizes the distillation loss terms and confidence weighting mechanisms used to train the single-spectrum student detector.
  • Confidence-Weighted Distillation (Variant 10): Setting τ = 1.0 (uniform distillation weighting in Equation (35)) drops student performance from 0.556 to 0.533 ( 2.3 % ). Weighting soft targets by posterior confidence c ˜ i j prevents noisy teacher predictions on mixed pixels from corrupting student gradient updates.
  • Student Manifold and Augmentation Constraints (Variants 11–12): Removing the student hypergraph Laplacian regularizer ( L man in Equation (38), Variant 11) results in a severe 3.1 % drop. As depicted in the t-SNE embedding visualizations in Figure 6, L man successfully transfers complex test-scene manifold structures to the student parameter weights during training, forming tight clusters for targets. Disabling spectral augmentation consistency ( κ = 0 , Variant 12) causes a 1.0 % drop, verifying its role in enhancing spectral decision boundary robustness.

4.7.5. Core Contribution Isolation and Synergy Analysis

To rigorously isolate the individual contributions of our core algorithmic designs—specifically addressing the necessity of high-order hypergraphs over pairwise graphs, the impact of spatial versus spectral topologies, the exact gain of continuous posterior refinement, and the efficacy of teacher–student distillation—we conducted comprehensive factorial isolation experiments on the MUUFL Gulfport dataset. The quantitative isolation results across all four target classes over 5 independent random seeds are systematically summarized in Table 11.
As quantitatively evidenced in Table 11, the ablation study systematically isolates the specific empirical contributions across three functional tiers:
  • Isolation Tier 1: Topological Representation and High-Order Hypergraph Advantage: Completely removing spatial and spectral graph topologies (Variant 1a, pure MIL baseline) drops detection performance to merely 0.498 NAUC, confirming that isolated spectral vectors cannot resolve severe bag-label ambiguity. Replacing our hypergraph operators with conventional pairwise graphs (Variant 1b, standard 2-node GCN with 8-NN spatial and k-NN spectral links) yields 0.538 NAUC. Our full dual-path hypergraph (Variant 1f) outperforms the pairwise graph baseline by a substantial + 0.039 NAUC margin ( 0.577 vs. 0.538 ). This validates that decomposing k-pixel patches into k 2 independent pairwise edges distorts manifold geometry and accelerates cross-boundary over-smoothing, whereas high-order hyperedges preserve multi-body spatial co-occurrence and spectral homogeneity simultaneously. Furthermore, isolating spatial hypergraphs alone ( 0.549 NAUC) and spectral hypergraphs alone ( 0.556 NAUC) reveals their individual limitations, while our node-adaptive fusion gate g i j achieves a + 0.012 NAUC gain over static averaging ( 0.565 NAUC) by dynamically arbitrating local spatial smoothness versus non-local spectral consistency.
  • Isolation Tier 2: Posterior Refinement Paradigm (CTPR vs. Baselines): Evaluating the model without continuous posterior refinement (Variant 2a, directly utilizing the unrefined variational posterior π i ) achieves 0.546 NAUC. Enabling full CTPR (Variant 2d) elevates the detection score to 0.577 NAUC (a statistically significant + 0.031 improvement). This proves that non-parametric topological manifold smoothing on the probability simplex [ 0 , 1 ] n i actively rectifies ambiguous subpixel instances that neural feedforward passes fail to resolve. In contrast, replacing CTPR with hard pseudo-label binarization (Variant 2b) degrades performance to 0.542 NAUC due to early confirmation bias. Furthermore, removing variational confidence weights (Variant 2c, uniform fidelity C i = I ) causes an identical drop to 0.546 NAUC, proving that Bernoulli posterior uncertainty anchoring c i j = 1 4 π i j ( 1 π i j ) is strictly required to prevent indiscriminate over-smoothing across background clutter.
  • Isolation Tier 3: Collaborative Teacher–Student Knowledge Distillation: A standalone 3-layer MLP student trained directly on weak bag labels without distillation (Variant 3a) achieves only 0.491 NAUC due to the lack of spatial context. Implementing uniform distillation (Variant 3b, τ = 1.0 ) improves performance to 0.533 NAUC, while confidence-weighted topological distillation (Variant 3c, Pixel Mode) achieves 0.556 NAUC (a massive + 0.065 boost over standalone training). This demonstrates that our distillation loss successfully internalizes high-order topological manifold constraints into single-spectrum student weights, retaining 96.4 % of the Context Teacher’s capacity ( 0.577 NAUC) while delivering a 1.25 μ s single-pixel inference speed.

4.7.6. Robustness Evaluation on Spatially Disjoint Geographical Partitions

To rigorously assess whether spatial autocorrelation between adjacent bags could induce over-optimistic performance, we evaluated Hyper-VMIL and representative baselines across all categories under a strictly spatially disjoint block partitioning protocol. For the single-scene MUUFL Gulfport dataset, the scene is divided into two geographically disjoint halves separated by a 10-pixel spatial guard band (buffer zone) to eliminate spatial proximity leakage between training and testing sets. For the Avon dataset, we adhere to the cross-flightline protocol where models are trained on Flightline 1 and tested on Flightline 2 (and vice versa) over geographically separated acquisition passes. The comparative results are reported in Table 12.
As evidenced in Table 12, transitioning from random bag partitioning to spatially disjoint block partitioning induces a slight performance decrease across all benchmarked methods due to regional spectral shifts. However, Hyper-VMIL maintains a distinct performance lead over the strongest competing baseline (Proxy-PMMN [16]) by + 0.020 NAUC on MUUFL and + 0.020 NAUC on Avon for the disjoint setting. Furthermore, the Pixel Mode operates on isolated individual spectra during inference, inherently guaranteeing zero spatial leakage. These results confirm that the performance gains of Hyper-VMIL originate from high-order topological manifold modeling and continuous posterior refinement rather than spatial autocorrelation artifacts.

5. Conclusions

In this paper, we presented Hyper-VMIL, a spatial–spectral topology-regularized variational hypergraph network for region-level weakly supervised hyperspectral target detection. By integrating boundary-aware spatial hypergraphs and dynamic spectral-manifold hypergraphs into a variational framework with continuous posterior refinement (CTPR), Hyper-VMIL captures high-order spatial–spectral dependencies while addressing confirmation bias associated with hard pseudo-label binarization. Furthermore, a collaborative distillation mechanism transfers contextual topological knowledge into a single-spectrum student detector. Experiments on simulated and real airborne datasets indicate that Hyper-VMIL achieves competitive detection metrics against 15 baseline methods, providing two inference modes: Context Mode for higher detection accuracy, and Pixel Mode for single-spectrum inference ( 1.25 μ s latency per spectrum) suitable for onboard applications.
Notwithstanding its demonstrated effectiveness, several theoretical and practical boundaries warrant future investigation. Although CTPR substantially suppresses error accumulation and confirmation bias compared to conventional hard pseudo-labeling, it does not provide an unconditional guarantee against early error reinforcement in extreme corner cases. Specifically, when a non-target clutter instance simultaneously possesses an anomalous spectral signature that deceives the single-spectrum detector s i j and forms a cohesive spatial cluster that misleads the topological hypergraph L i , the model may assign it high confidence and retain it across iterative optimization. Completely eliminating such structured false alarms under bag-level weak supervision remains an open challenge, motivating our future exploration into self-correcting hard negative mining, open-set spectral uncertainty modeling, and multimodal contrastive grounding.

Author Contributions

Conceptualization, Z.Y.; methodology, Z.Y.; software, H.H., W.H. and C.D.; validation, W.H. and C.D.; resources, C.D.; data curation, H.H., W.H. and C.D.; writing—original draft preparation, H.H. and W.H.; writing—review and editing, Z.Y.; visualization, H.H. and W.H.; funding acquisition, Z.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Key R&D Program of China (No. 2024YFB4303400), the Natural Science Basic Research Plan in Shaanxi Province of China (Program No. 2025JC-YBQN-811), and the Key Science and Technology Program of Shaanxi Province, China (Grant No. 2025CY-YBXM-197).

Data Availability Statement

Data are available in a publicly accessible repository. The datasets supporting the findings of this study are publicly available in Zenodo at https://doi.org/10.5281/zenodo.21534371.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Chen, B.; Liu, L.; Zou, Z.; Shi, Z. Target Detection in Hyperspectral Remote Sensing Image: Current Status and Challenges. Remote Sens. 2023, 15, 3223. [Google Scholar] [CrossRef] [Scilit]
  2. Li, Y.; Qin, H.; Xie, W. HTDFormer: Hyperspectral Target Detection Based on Transformer with Distributed Learning. IEEE Trans. Geosci. Remote Sens. 2023, 61, 5524715. [Google Scholar] [CrossRef] [Scilit]
  3. Gao, H.; Zhang, Y.; Chen, Z.; Xu, F.; Hong, D.; Zhang, B. Hyperspectral Target Detection via Spectral Aggregation and Separation Network with Target Band Random Mask. IEEE Trans. Geosci. Remote Sens. 2023, 61, 5515516. [Google Scholar] [CrossRef] [Scilit]
  4. Jiao, J.; Gong, Z.; Zhong, P. Triplet Spectralwise Transformer Network for Hyperspectral Target Detection. IEEE Trans. Geosci. Remote Sens. 2023, 61, 5519817. [Google Scholar] [CrossRef] [Scilit]
  5. Shen, D.; Ma, X.; Kong, W.; Liu, J.; Wang, J.; Wang, H. Hyperspectral Target Detection Based on Interpretable Representation Network. IEEE Trans. Geosci. Remote Sens. 2023, 61, 1–16. [Google Scholar] [CrossRef] [Scilit]
  6. Tian, Q.; He, C.; Xu, Y.; Wu, Z.; Wei, Z. Hyperspectral Target Detection: Learning Faithful Background Representations via Orthogonal Subspace-Guided Variational Autoencoder. IEEE Trans. Geosci. Remote Sens. 2024, 62, 5516714. [Google Scholar] [CrossRef] [Scilit]
  7. Chen, X.; Zhang, Y.; Dong, Y.; Du, B. Spatial–Spectral Contrastive Self-Supervised Learning with Dual Path Networks for Hyperspectral Target Detection. IEEE Trans. Geosci. Remote Sens. 2024, 62, 5515612. [Google Scholar] [CrossRef] [Scilit]
  8. Chen, X.; Zhang, Y.; Dong, Y.; Du, B. Generative Self-Supervised Learning with Spectral–Spatial Masking for Hyperspectral Target Detection. IEEE Trans. Geosci. Remote Sens. 2024, 62, 5522713. [Google Scholar] [CrossRef] [Scilit]
  9. Xu, S.; Geng, S.; Xu, P.; Chen, Z.; Gao, H. Cognitive Fusion of Graph Neural Network and Convolutional Neural Network for Enhanced Hyperspectral Target Detection. IEEE Trans. Geosci. Remote Sens. 2024, 62, 5515915. [Google Scholar] [CrossRef] [Scilit]
  10. Dong, W.; Wu, X.; Qu, J.; Gamba, P.; Xiao, S.; Vizziello, A.; Li, Y. Deep Spatial–Spectral Joint-Sparse Prior Encoding Network for Hyperspectral Target Detection. IEEE Trans. Cybern. 2024, 54, 7780–7792. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  11. Li, Z.; An, W.; Guo, G.; Wang, L.; Wang, Y.; Lin, Z. SpecDETR: A Transformer-Based Hyperspectral Point Object Detection Network. ISPRS J. Photogramm. Remote Sens. 2025, 226, 221–246. [Google Scholar] [CrossRef] [Scilit]
  12. Shen, D.; Kong, W.; Xiao, X.; Liu, J.; Du, Z.; Ma, X.; Zhao, W.; Wang, H. SSBDM: A Spectral–Spatial Bilinear Decomposition Model with Adaptive Multikernel Dictionary for Hyperspectral Target Detection. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2026, 19, 9347–9365. [Google Scholar] [CrossRef] [Scilit]
  13. Yang, B.; He, Y.; Jiao, C.; Pan, X.; Wang, G.; Wang, L.; Wu, J. Multiple-Instance Metric Learning Network for Hyperspectral Target Detection. IEEE Trans. Geosci. Remote Sens. 2023, 61, 5516016. [Google Scholar] [CrossRef] [Scilit]
  14. Qin, H.; Xie, W.; Li, Y.; Du, Q. HTD-TS3: Weakly Supervised Hyperspectral Target Detection Based on Transformer via Spectral–Spatial Similarity. IEEE Trans. Neural Netw. Learn. Syst. 2024, 35, 16816–16830. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  15. Yang, B.; Jiao, C.; Wu, J.; Li, L. Variational Multiple-Instance Learning with Embedding Correlation Modeling for Hyperspectral Target Detection. IEEE Trans. Neural Netw. Learn. Syst. 2025, 36, 13953–13967. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  16. Yang, B.; Wu, J.; Jiao, C. Proxy-Enhanced Prototype Memory Network for Weakly Supervised Hyperspectral Target Detection. IEEE Trans. Geosci. Remote Sens. 2025, 63, 5512514. [Google Scholar] [CrossRef] [Scilit]
  17. Jiao, C.; Yang, B.; Liu, L.; Chen, C.; Chen, X.; Yang, W.; Jiao, L. Semantic Modeling of Hyperspectral Target Detection with Weak Labels. Signal Process. 2023, 209, 109016. [Google Scholar] [CrossRef] [Scilit]
  18. Jang, J.; Kwon, H.-Y. Are Multiple Instance Learning Algorithms Learnable for Instances? In Proceedings of the Advances in Neural Information Processing Systems 37 (NeurIPS 2024); Curran Associates, Inc.: Red Hook, NY, USA, 2024; Volume 37. [Google Scholar]
  19. Wang, Q.; Liu, F.; Wang, M.; Wang, L.; Huang, J.; Shen, T. Spectral–Spatial Hypergraph Convolutional Network for Hyperspectral Image Classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2025, 18, 23744–23756. [Google Scholar] [CrossRef] [Scilit]
  20. Xie, W.; Zhang, Z.; Jiao, L.; Wang, J. Decoupled Knowledge Distillation via Spatial Feature Blurring for Hyperspectral Image Classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2024, 17, 8938–8955. [Google Scholar] [CrossRef] [Scilit]
  21. Waqas, M.; Ahmed, S.U.; Tahir, M.A.; Wu, J.; Qureshi, R. Exploring Multiple Instance Learning (MIL): A Brief Survey. Expert Syst. Appl. 2024, 250, 123893. [Google Scholar] [CrossRef] [Scilit]
  22. Huang, S.; Liu, Z.; Jin, W.; Mu, Y. Superpixel-Based Multi-Scale Multi-Instance Learning for Hyperspectral Image Classification. Pattern Recognit. 2024, 149, 110257. [Google Scholar] [CrossRef] [Scilit]
  23. Chen, X.; Qiu, P.; Zhu, W.; Li, H.; Wang, H.; Sotiras, A.; Wang, Y.; Razi, A. TimeMIL: Advancing Multivariate Time Series Classification via a Time-Aware Multiple Instance Learning. In Proceedings of the 41st International Conference on Machine Learning (ICML), Vienna, Austria, 21–27 July 2024; pp. 7190–7206. [Google Scholar]
  24. Shao, D.; Chen, R.J.; Song, A.H.; Runevic, J.; Lu, M.Y.; Ding, T.; Mahmood, F. Do Multiple Instance Learning Models Transfer? In Proceedings of the 42nd International Conference on Machine Learning (ICML), Vancouver, BC, Canada, 13–19 July 2025; pp. 54219–54238. [Google Scholar]
  25. Li, Y.; Zhong, J.; Xie, W.; Gamba, P. A Representation-Learning-Based Graph and Generative Network for Hyperspectral Small Target Detection. Remote Sens. 2024, 16, 3638. [Google Scholar] [CrossRef] [Scilit]
  26. Wang, Q.; Huang, J.; Shen, T.; Gu, Y. EHGNN: Enhanced Hypergraph Neural Network for Hyperspectral Image Classification. IEEE Geosci. Remote Sens. Lett. 2024, 21, 5504405. [Google Scholar] [CrossRef] [Scilit]
  27. Wang, Y.; Xue, Z.; Jia, M.; Liu, Z.; Su, H. Hypergraph Convolutional Network with Multiple Hyperedges Fusion for Hyperspectral Image Classification under Limited Samples. IEEE Trans. Geosci. Remote Sens. 2024, 62, 5526318. [Google Scholar] [CrossRef] [Scilit]
  28. Zhao, X.; Ma, J.; Wang, L.; Zhang, Z.; Ding, Y.; Xiao, X. A Review of Hyperspectral Image Classification Based on Graph Neural Networks. Artif. Intell. Rev. 2025, 58, 172. [Google Scholar] [CrossRef] [Scilit]
  29. Li, Z.; Xia, S.; Yue, J.; Fang, L. HyperKD: Lifelong Hyperspectral Image Classification with Cross-Spectral–Spatial Knowledge Distillation. IEEE Trans. Geosci. Remote Sens. 2025, 63, 5509017. [Google Scholar] [CrossRef] [Scilit]
  30. Xie, W.; Zhang, Z.; Jiao, L.; Hua, W. Curriculum Preview and Review Based on Knowledge Distillation for Hyperspectral Image Classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2025, 18, 18165–18180. [Google Scholar] [CrossRef] [Scilit]
  31. Neal, R.M.; Hinton, G.E. A View of the EM Algorithm that Justifies Incremental, Sparse, and Other Variants. In Learning in Graphical Models; Jordan, M.I., Ed.; Kluwer Academic Publishers: Dordrecht, The Netherlands, 1998; pp. 355–368. [Google Scholar]
  32. Baldridge, A.M.; Hook, S.J.; Grove, C.I.; Rivera, G. The ASTER Spectral Library Version 2.0. Remote Sens. Environ. 2009, 113, 711–715. [Google Scholar] [CrossRef] [Scilit]
  33. Bioucas-Dias, J.M.; Plaza, A.; Dobigeon, N.; Parente, M.; Du, Q.; Gader, P.; Chanussot, J. Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Unmixing-Based Approaches. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2012, 5, 354–379. [Google Scholar] [CrossRef] [Scilit]
  34. Gader, P.; Zare, A.; Close, R.; Aitken, J.; Tuell, G. MUUFL Gulfport Hyperspectral and LiDAR Airborne Data Set; Technical Report REP-2013-570; University of Florida: Gainesville, FL, USA, 2013. [Google Scholar]
  35. Snyder, D.; Kerekes, J.; Fairweather, I.; Crabtree, R.; Shainman, J.; Smith, S.; Schlamm, A. Performance Comparison of Hyperspectral Target Detection Algorithms on Airborne Data. In Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XIV; SPIE: Orlando, FL, USA, 2008; Volume 6966, p. 69660N. [Google Scholar]
  36. Manolakis, D.; Shaw, G. Detection Algorithms for Hyperspectral Imaging Applications. IEEE Signal Process. Mag. 2002, 19, 29–43. [Google Scholar] [CrossRef] [Scilit]
  37. Kraut, S.; Scharf, L.L.; McWhorter, L.T. Adaptive Subspace Detectors. IEEE Trans. Signal Process. 2001, 49, 1–16. [Google Scholar] [CrossRef] [Scilit]
  38. Reed, I.S.; Yu, X. Adaptive Multiple-Band CFAR Detection of an Optical Pattern with Unknown Spectral Distribution. IEEE Trans. Acoust. Speech Signal Process. 1990, 38, 1760–1770. [Google Scholar] [CrossRef] [Scilit]
  39. Schlamm, A.; Messinger, D.; Basener, B. Subspace Matched Filter for Target Detection in Hyperspectral Imagery. Opt. Eng. 2010, 49, 057002. [Google Scholar] [CrossRef] [Scilit]
  40. Jiao, L.; Zare, A. Multiple-Instance Adaptive Coherence Estimator for Hyperspectral Target Detection. IEEE Trans. Geosci. Remote Sens. 2015, 53, 6157–6168. [Google Scholar]
  41. Broadwater, J.; Banerjee, A. Multiple Instance Learning for Hyperspectral Target Detection. In IEEE International Geoscience and Remote Sensing Symposium (IGARSS); IEEE: Barcelona, Spain, 2007; pp. 2221–2224. [Google Scholar]
  42. Chen, Y.; Bi, J.; Wang, J.Z. MILES: Multiple-Instance Learning via Embedded Instance Selection. IEEE Trans. Pattern Anal. Mach. Intell. 2006, 28, 1931–1947. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  43. Ilse, M.; Tomczak, J.; Welling, M. Attention-based Deep Multiple Instance Learning. In Proceedings of the 35th International Conference on Machine Learning (ICML); PMLR: Stockholm, Sweden, 2018; pp. 2127–2136. [Google Scholar]
  44. Jiao, C.; Chen, C.; Gou, S.; Wang, X.; Yang, B.; Chen, X.; Jiao, L. L1 Sparsity-Regularized Attention Multiple-Instance Network for Hyperspectral Target Detection. IEEE Trans. Cybern. 2023, 53, 124–137. [Google Scholar] [CrossRef] [Scilit] [PubMed]
Figure 1. Overview of Hyper-VMIL. (a) Overall variational E-step and generalized M-step workflow. (b) Dual-path spatial–spectral hypergraph construction. (c) Topology-conditioned variational HGNN with node-adaptive fusion.
Figure 1. Overview of Hyper-VMIL. (a) Overall variational E-step and generalized M-step workflow. (b) Dual-path spatial–spectral hypergraph construction. (c) Topology-conditioned variational HGNN with node-adaptive fusion.
Remotesensing 18 02838 g001
Figure 2. Low-FPR ROC curves ( FPR [ 0 , 1 × 10 3 ] ) on the MUUFL Gulfport dataset for (a) Brown, (b) Dark Green, (c) Faux Vineyard Green, and (d) Pea Green targets. Hyper-VMIL (Context Mode) is highlighted as a solid red curve, demonstrating consistent better probability of detection at extremely low false alarm thresholds.
Figure 2. Low-FPR ROC curves ( FPR [ 0 , 1 × 10 3 ] ) on the MUUFL Gulfport dataset for (a) Brown, (b) Dark Green, (c) Faux Vineyard Green, and (d) Pea Green targets. Hyper-VMIL (Context Mode) is highlighted as a solid red curve, demonstrating consistent better probability of detection at extremely low false alarm thresholds.
Remotesensing 18 02838 g002
Figure 3. Target–background separability comparison across four target classes on the MUUFL Gulfport dataset: (a) ACE (Traditional prior detector), (b) VMIL-ECM (Direct SOTA baseline), and (c) Proposed Hyper-VMIL. Detection statistics are normalized per scene via min–max scaling to [ 0 , 1 ] . Red and blue boxes represent target and background distributions, respectively, depicting the median (center line), interquartile range (IQR box: Q 1 to Q 3 ), 1.5 × IQR whiskers, and flier points (outliers). Hyper-VMIL substantially widens the target–background median margin while compressing background variance. The presence of subpixel target lower tails ( 0.35 d ˜ 0.50 ) and sparse background upper-tail outliers ( 0.25 d ˜ 0.40 ) physically reconciles with the low-FPR NAUC FPR 10 3 metric of 0.577 .
Figure 3. Target–background separability comparison across four target classes on the MUUFL Gulfport dataset: (a) ACE (Traditional prior detector), (b) VMIL-ECM (Direct SOTA baseline), and (c) Proposed Hyper-VMIL. Detection statistics are normalized per scene via min–max scaling to [ 0 , 1 ] . Red and blue boxes represent target and background distributions, respectively, depicting the median (center line), interquartile range (IQR box: Q 1 to Q 3 ), 1.5 × IQR whiskers, and flier points (outliers). Hyper-VMIL substantially widens the target–background median margin while compressing background variance. The presence of subpixel target lower tails ( 0.35 d ˜ 0.50 ) and sparse background upper-tail outliers ( 0.25 d ˜ 0.40 ) physically reconciles with the low-FPR NAUC FPR 10 3 metric of 0.577 .
Remotesensing 18 02838 g003
Figure 4. Visualization of measured spatial hyperedge incidence weight propagation across target–background material boundaries on the MUUFL Gulfport scene ( 15 × 15 patch, 64 spectral bands): (a) false-color image patch (Bands 45–25–5 as RGB) showing an occluded Pea Green fabric target at the center surrounded by tree canopy and soil/pavement boundaries; (b) measured spatial hyperedge membership with Variant 1 (Coordinate-Only, H j , e c spa = exp ( r j r c 2 / 2 σ r 2 ) ), displaying isotropic over-smoothing across material boundaries; (c) boundary-aware spatial hyperedge membership with Hyper-VMIL (Equation (10), incorporating 64-band spectral difference exp ( x j x c 2 / 2 σ x 2 ) ). Incorporating the spectral difference kernel cuts off message passing at physical material transitions.
Figure 4. Visualization of measured spatial hyperedge incidence weight propagation across target–background material boundaries on the MUUFL Gulfport scene ( 15 × 15 patch, 64 spectral bands): (a) false-color image patch (Bands 45–25–5 as RGB) showing an occluded Pea Green fabric target at the center surrounded by tree canopy and soil/pavement boundaries; (b) measured spatial hyperedge membership with Variant 1 (Coordinate-Only, H j , e c spa = exp ( r j r c 2 / 2 σ r 2 ) ), displaying isotropic over-smoothing across material boundaries; (c) boundary-aware spatial hyperedge membership with Hyper-VMIL (Equation (10), incorporating 64-band spectral difference exp ( x j x c 2 / 2 σ x 2 ) ). Incorporating the spectral difference kernel cuts off message passing at physical material transitions.
Remotesensing 18 02838 g004
Figure 5. Empirical posterior probability trajectory evolution across T refine = 10 iterations on the MUUFL Gulfport dataset (Pea Green target class). Three representative pixel categories ( N = 50 each) were sampled post hoc for diagnostic tracking: (1) high-confidence target ( a j 0.70 , π i j ( 0 ) 0.60 ), (2) occluded subpixel target ( 0.15 a j 0.45 , 0.35 π i j ( 0 ) 0.50 ), and (3) confusing background clutter ( 0.15 π i j ( 0 ) 0.35 ). Both methods initialized from identical continuous variational posteriors f i ( 0 ) = π i at t = 1 . Solid curves denote the empirical mean across 10 independent experimental runs (seeds 42, 100, 2024, 3407, 8888, 101, 555, 1234, 7777, 9999), with shaded bands representing ± 1 σ standard deviations: (a) Variant 8 (Iterative Hard Binarization with τ hard = 0.50 ) progressively forces occluded subpixel targets below threshold downward over iterations t = 2 ∼4, trapping them in an absorbing zero state and reinforcing confirmation bias; (b) continuous posterior refinement (Hyper-VMIL CTPR) preserves smooth probability gradients on [ 0 , 1 ] n i , enabling spatial–spectral hypergraph diffusion to steadily elevate occluded target posteriors from 0.43 to 0.80 while compressing background clutter toward 0.03 .
Figure 5. Empirical posterior probability trajectory evolution across T refine = 10 iterations on the MUUFL Gulfport dataset (Pea Green target class). Three representative pixel categories ( N = 50 each) were sampled post hoc for diagnostic tracking: (1) high-confidence target ( a j 0.70 , π i j ( 0 ) 0.60 ), (2) occluded subpixel target ( 0.15 a j 0.45 , 0.35 π i j ( 0 ) 0.50 ), and (3) confusing background clutter ( 0.15 π i j ( 0 ) 0.35 ). Both methods initialized from identical continuous variational posteriors f i ( 0 ) = π i at t = 1 . Solid curves denote the empirical mean across 10 independent experimental runs (seeds 42, 100, 2024, 3407, 8888, 101, 555, 1234, 7777, 9999), with shaded bands representing ± 1 σ standard deviations: (a) Variant 8 (Iterative Hard Binarization with τ hard = 0.50 ) progressively forces occluded subpixel targets below threshold downward over iterations t = 2 ∼4, trapping them in an absorbing zero state and reinforcing confirmation bias; (b) continuous posterior refinement (Hyper-VMIL CTPR) preserves smooth probability gradients on [ 0 , 1 ] n i , enabling spatial–spectral hypergraph diffusion to steadily elevate occluded target posteriors from 0.43 to 0.80 while compressing background clutter toward 0.03 .
Remotesensing 18 02838 g005
Figure 6. t-SNE visualization of single-spectrum student embedding space on test scenes: (a) Variant 13 (direct training with bag labels) results in cluttered target-background overlap; (b) Variant 11 (w/o student manifold regularization L man ) forms loose clusters with ambiguous decision boundaries; (c) Hyper-VMIL Student (with L man and soft distillation) successfully mimics the teacher’s topological manifold, yielding compact target clusters and clear target–background separation.
Figure 6. t-SNE visualization of single-spectrum student embedding space on test scenes: (a) Variant 13 (direct training with bag labels) results in cluttered target-background overlap; (b) Variant 11 (w/o student manifold regularization L man ) forms loose clusters with ambiguous decision boundaries; (c) Hyper-VMIL Student (with L man and soft distillation) successfully mimics the teacher’s topological manifold, yielding compact target clusters and clear target–background separation.
Remotesensing 18 02838 g006
Table 1. Detailed dataset partitioning (target-isolated spatially disjoint split), spatial patch size, bag counts, and positive/negative bag ratios.
Table 1. Detailed dataset partitioning (target-isolated spatially disjoint split), spatial patch size, bag counts, and positive/negative bag ratios.
Dataset/Sub-ScenePatch Size (ni)Total Bags (N)Positive BagsNegative BagsPos:Neg Ratio
ASTER ( p ¯ t = 0.1 , 0.2 , 0.3 ) 5 × 5 ( n i = 25 )10003007001:2.33
MUUFL Gulfport (per target class) 5 × 5 ( n i = 25 )150045010501:2.33
Avon-AM/Avon-PM (per scene) 5 × 5 ( n i = 25 )200060014001:2.33
Table 2. Detailed layer configurations, input/output dimensions, activations, and regularization layers for Hyper-VMIL modules (B denotes the number of spectral bands).
Table 2. Detailed layer configurations, input/output dimensions, activations, and regularization layers for Hyper-VMIL modules (B denotes the number of spectral bands).
ModuleLayer Index and TypeInput DimOutput DimActivationRegularization
Spectral Encoder E ψ ¯ Layer 1: Linear + LNB128GELULayerNorm + Dropout ( 0.1 )
Layer 2: Linear12864IdentityNone
Dual HGNN ( t { spa , spe } )Layer 1: HypergraphConv6464GELUResidual Linear (64, 64)
Layer 2: HypergraphConv6432GELUResidual Linear (64, 32)
Output Projection3232IdentityDropout ( 0.1 )
Adaptive Gate MLP g Layer 1: Linear 64 ( 32 × 2 ) 32GELUNone
Layer 2: Linear321SigmoidNone
Student Detector D θ Layer 1: Linear + LNB128GELULayerNorm + Dropout ( 0.1 )
Layer 2: Linear12864GELUNone
Layer 3: Linear641SigmoidNone
Table 3. Quantitative detection performance ( AUC ( D , F ) ) on simulated ASTER dataset at varying target abundance levels ( p ¯ t ). The best and second-best results are highlighted in bold and underlined, respectively.
Table 3. Quantitative detection performance ( AUC ( D , F ) ) on simulated ASTER dataset at varying target abundance levels ( p ¯ t ). The best and second-best results are highlighted in bold and underlined, respectively.
CategoryAlgorithm p ¯ t = 0.1 p ¯ t = 0.2 p ¯ t = 0.3
Traditional PriorMF0.7820.8350.884
ACE0.7950.8420.891
RX0.6510.7120.768
SMF0.7880.8380.887
Concept-MILMI-ACE0.8120.8650.910
MI-SMF0.8060.8590.905
MILES0.8310.8820.924
MINNsAttention-DMIL0.8640.9120.948
L1-attention MINN0.8750.9230.957
CS-attention MINN0.8810.9280.961
HTD-TS30.8950.9360.968
Advanced Deep Detectors SSBDM [12] 0.907 0.935 0.972
SpecDETR [11] 0.892 0.951 0.978
Proxy-PMMN [16] 0.916 0.941 0.969
VMIL-ECM [15]0.9120.9480.975
OursHyper-VMIL (Pixel Mode)0.9250.9600.983
Hyper-VMIL (Context Mode)0.9380.9710.990
Table 4. Quantitative detection results ( NAUC FPR 10 3 , mean ± Std over 5 random seeds) on real-world MUUFL Gulfport dataset. All metrics are retained to three decimal places. Best and second-best results are highlighted in bold and underlined, respectively. * indicates statistically significant improvement over the best baseline ( p < 0.01 ).
Table 4. Quantitative detection results ( NAUC FPR 10 3 , mean ± Std over 5 random seeds) on real-world MUUFL Gulfport dataset. All metrics are retained to three decimal places. Best and second-best results are highlighted in bold and underlined, respectively. * indicates statistically significant improvement over the best baseline ( p < 0.01 ).
CategoryAlgorithmBrownDark GreenFaux VineyardPea GreenAverage
Traditional PriorMF 0.385 ± 0.002 0.412 ± 0.003 0.215 ± 0.002 0.228 ± 0.003 0.310 ± 0.002
ACE 0.402 ± 0.002 0.428 ± 0.002 0.231 ± 0.003 0.245 ± 0.002 0.327 ± 0.002
RX 0.281 ± 0.003 0.305 ± 0.003 0.162 ± 0.002 0.178 ± 0.003 0.232 ± 0.003
SMF 0.391 ± 0.002 0.419 ± 0.003 0.224 ± 0.002 0.236 ± 0.003 0.318 ± 0.002
Concept-MILMI-ACE 0.428 ± 0.010 0.461 ± 0.011 0.285 ± 0.012 0.292 ± 0.009 0.367 ± 0.010
MI-SMF 0.415 ± 0.011 0.450 ± 0.010 0.274 ± 0.013 0.281 ± 0.011 0.355 ± 0.011
MILES 0.452 ± 0.012 0.489 ± 0.010 0.321 ± 0.015 0.315 ± 0.014 0.394 ± 0.012
MINNsAttention-DMIL 0.512 ± 0.009 0.554 ± 0.008 0.398 ± 0.011 0.342 ± 0.010 0.452 ± 0.009
L1-attention MINN 0.531 ± 0.008 0.578 ± 0.009 0.415 ± 0.010 0.360 ± 0.009 0.471 ± 0.009
CS-attention MINN 0.542 ± 0.008 0.590 ± 0.007 0.428 ± 0.010 0.371 ± 0.008 0.483 ± 0.008
HTD-TS3 0.565 ± 0.008 0.612 ± 0.009 0.456 ± 0.011 0.395 ± 0.010 0.507 ± 0.009
Advanced Deep Detectors SSBDM [12] 0.574 ± 0.009 0.619 ± 0.008 0.461 ± 0.010 0.412 ± 0.011 0.517 ± 0.009
SpecDETR [11] 0.584 ± 0.008 0.636 ± 0.007 0.469 ± 0.008 0.409 ± 0.009 0.525 ± 0.008
Proxy-PMMN [16] 0.579 ± 0.008 0.631 ± 0.007 0.478 ± 0.007 0.424 ± 0.008 0.528 ± 0.007
VMIL-ECM [15] 0.586 ± 0.007 0.638 ± 0.008 0.482 ± 0.009 0.418 ± 0.008 0.531 ± 0.008
OursHyper-VMIL (Pixel Mode) 0.612 ± 0.005 * 0.661 ± 0.006 * 0.510 ± 0.007 * 0.442 ± 0.006 * 0.556 ± 0.006 *
Hyper-VMIL (Context Mode) 0.630 ± 0.004 * 0.682 ± 0.005 * 0.531 ± 0.006 * 0.465 ± 0.005 * 0.577 ± 0.005 *
Table 5. Cross-temporal evaluation results ( NAUC FPR 10 3 ) on Avon dataset (AM ↔ PM transfer).
Table 5. Cross-temporal evaluation results ( NAUC FPR 10 3 ) on Avon dataset (AM ↔ PM transfer).
CategoryAlgorithmAM → PM (Avg.)PM → AM (Avg.)Cross-Fold Mean
Traditional PriorACE0.4120.3980.405
SMF0.4010.3870.394
Concept-MILMILES0.4850.4680.477
MINNsHTD-TS30.5920.5780.585
Advanced Deep Detectors SSBDM [12] 0.616 0.608 0.612
SpecDETR [11] 0.634 0.592 0.613
Proxy-PMMN [16] 0.618 0.636 0.627
VMIL-ECM [15]0.6350.6210.628
OursHyper-VMIL (Pixel Mode)0.6580.6420.650
Hyper-VMIL (Context Mode)0.6810.6650.673
Table 6. Quantitative comparison of test input dependency, model complexity, inference latency, amortized throughput, and detection performance ( NAUC FPR 10 3 on MUUFL dataset). All metrics are benchmarked on an NVIDIA RTX 4090 GPU with FP32 precision.
Table 6. Quantitative comparison of test input dependency, model complexity, inference latency, amortized throughput, and detection performance ( NAUC FPR 10 3 on MUUFL dataset). All metrics are benchmarked on an NVIDIA RTX 4090 GPU with FP32 precision.
Model/Evaluation ModeTest InputOnline GraphParams (M)FLOPs/PixelPeak VRAMLatency (B = 1)Throughput (B = 104)MUUFL NAUC
HTD-TS3 [14] 5 × 5 PatchNo (MINN)0.420.85 G180 MB45.20 μ s 0.180 μ s /pixel 0.507 ± 0.009
SpecDETR [11] 5 × 5 PatchNo (Transformer)2.154.20 G710 MB310.00 μ s 1.420 μ s /pixel 0.525 ± 0.008
VMIL-ECM [15] 5 × 5 PatchNo (Transformer)1.522.80 G480 MB185.00 μ s 0.850 μ s /pixel 0.531 ± 0.008
Hyper-VMIL (Context Mode) 5 × 5 BagYes (Hypergraph)1.853.10 G620 MB240.00 μ s 1.150 μ s /pixel 0.577 ± 0.005
Hyper-VMIL (Pixel Mode)Single SpectrumNone0.080.02 G45 MB1.25 μ s 0.015 μ s /pixel 0.556 ± 0.006
Table 7. Ablation study on topological and architectural components ( NAUC FPR 10 3 ).
Table 7. Ablation study on topological and architectural components ( NAUC FPR 10 3 ).
Variant/Model DescriptionMUUFL Gulfport Target ClassesMUUFL AverageAvon Cross-Fold
BrownDark GreenFaux VineyardPea Green
Variant 1 (Coordinate-Only Spatial HG, w/o Spectral Kernel in Equation (10))0.6050.6540.4980.4350.5480.642
Variant 2 (Static Spectral HG, Fixed Initial Embeddings)0.5980.6480.4900.4260.5410.635
Variant 3 (Online Encoder, w/o EMA Momentum in Equation (12))0.6080.6590.5050.4380.5530.649
Variant 4 (Pure HGNN Aggregation, w/o Residual R t ( l ) in Equation (16))0.6010.6520.4930.4300.5440.638
Variant 5 (Equal Fusion, w/o Adaptive Gate g i j in Equation (17))0.6120.6650.5110.4450.5580.652
Hyper-VMIL (Pixel Mode)0.6120.6610.5100.4420.5560.650
Hyper-VMIL (Context Mode)0.6300.6820.5310.4650.5770.673
Table 8. Ablation study on variational inference and posterior refinement ( NAUC FPR 10 3 ).
Table 8. Ablation study on variational inference and posterior refinement ( NAUC FPR 10 3 ).
Variant/Model DescriptionMUUFL Gulfport Target ClassesMUUFL AverageAvon Cross-Fold
BrownDark GreenFaux VineyardPea Green
Variant 6 (Deterministic Smoothness, w/o Bernoulli Variance)0.6060.6580.5020.4360.5510.646
Variant 7 (w/o Posterior-Prior KL Constraint, β = 0 )0.5950.6450.4880.4220.5380.630
Variant 8 (Hard Pseudo-Labeling, Dynamic Binarization as in [15])0.5980.6510.4920.4280.5420.636
Variant 9 (Unrefined Teacher Posterior, w/o CTPR Refinement π i )0.6020.6550.4980.4300.5460.640
Hyper-VMIL (Context Mode, Strictly Label-Free ξ = 0 )0.6300.6820.5310.4650.5770.673
Oracle Reference (Test Label Leakage Upper Bound, ξ = 1.0 )0.7350.7810.6320.5920.6850.771
Table 9. Quantitative ablation comparison of divergence functions ( NAUC FPR 10 3 , mean ± Std over 5 Seeds) for posterior–prior regularization.
Table 9. Quantitative ablation comparison of divergence functions ( NAUC FPR 10 3 , mean ± Std over 5 Seeds) for posterior–prior regularization.
Divergence FormulationOptimization PropertyMUUFL Avg. NAUCAvon Cross-Fold NAUC
Reverse KL D KL ( p q ) Mean-Seeking (Zero-avoiding for q) 0.542 ± 0.007 0.635
Symmetric KL D SKL ( q , p ) Mixed Mode/Mean-Seeking 0.553 ± 0.006 0.648
Jensen–Shannon Divergence JSD ( q , p ) Bounded Gradient Smoothness 0.561 ± 0.005 0.654
Forward KL D KL ( q p ) (Ours)Mode-seeking (Zero-avoiding for p) 0.577 ± 0.005 0.673
Table 10. Ablation study on teacher–student knowledge distillation ( NAUC FPR 10 3 ).
Table 10. Ablation study on teacher–student knowledge distillation ( NAUC FPR 10 3 ).
Variant/Model DescriptionMUUFL Gulfport Target ClassesMUUFL AverageAvon Cross-Fold
BrownDark GreenFaux VineyardPea Green
Variant 10 (Uniform Distillation Weighting, τ = 1.0 in Equation (35))0.5900.6380.4850.4190.5330.628
Variant 11 (w/o student manifold regularization, ρ = 0 in Equation (41))0.5820.6300.4780.4100.5250.618
Variant 12 (w/o Spectral Perturbation Consistency, κ = 0 in Equation (41))0.6020.6500.4980.4320.5460.639
Variant 13 (Direct Student Training, w/o Contextual Teacher Guidance)0.5410.5890.4320.3800.4860.582
Hyper-VMIL (Pixel Mode)0.6120.6610.5100.4420.5560.650
Hyper-VMIL (Context Mode)0.6300.6820.5310.4650.5770.673
Table 11. Quantitative isolation and synergy ablation analysis ( NAUC FPR 10 3 , mean ± Std over 5 seeds) of core functional contributions on MUUFL Gulfport dataset.
Table 11. Quantitative isolation and synergy ablation analysis ( NAUC FPR 10 3 , mean ± Std over 5 seeds) of core functional contributions on MUUFL Gulfport dataset.
Ablation TierIsolated Model ConfigurationBrownDark GreenFaux VineyardPea GreenAverage
Tier 1: Topological Representation and Hypergraph Isolation(a) No Spatial or Spectral Topology (Pure MIL Baseline, A = I , L = 0 ) 0.558 ± 0.008 0.605 ± 0.009 0.442 ± 0.010 0.388 ± 0.009 0.498 ± 0.008
(b) Pairwise Spatial/Spectral Graphs (Standard 2-node GCN) 0.596 ± 0.007 0.645 ± 0.007 0.486 ± 0.008 0.425 ± 0.007 0.538 ± 0.007
(c) Spatial Hypergraph Only ( H spa ) 0.608 ± 0.006 0.655 ± 0.007 0.498 ± 0.008 0.435 ± 0.007 0.549 ± 0.006
(d) Spectral Hypergraph Only ( H spe ) 0.615 ± 0.005 0.662 ± 0.006 0.505 ± 0.007 0.440 ± 0.006 0.556 ± 0.005
(e) Dual-Path w/ Static Averaging ( g i j = 0.5 ) 0.620 ± 0.005 0.671 ± 0.006 0.518 ± 0.007 0.450 ± 0.006 0.565 ± 0.005
(f) Full Dual-Path Hypergraph w/ Adaptive Gate g i j 0.630 ± 0.004 0.682 ± 0.005 0.531 ± 0.006 0.465 ± 0.005 0.577 ± 0.005
Tier 2: Posterior Estimation and Refinement Isolation(a) No Posterior Refinement (Raw Variational Posterior π i , w/o CTPR) 0.602 ± 0.006 0.655 ± 0.007 0.498 ± 0.008 0.430 ± 0.007 0.546 ± 0.006
(b) Hard Pseudo-Label Binarization (Dynamic Thresholding) 0.598 ± 0.007 0.651 ± 0.008 0.492 ± 0.009 0.428 ± 0.008 0.542 ± 0.007
(c) CTPR w/ Uniform Fidelity ( C i = I , w/o c i j ) 0.604 ± 0.006 0.652 ± 0.007 0.495 ± 0.008 0.432 ± 0.007 0.546 ± 0.006
(d) Full CTPR w/ Variational Anchor ( C i = Diag ( c i j ) ) 0.630 ± 0.004 0.682 ± 0.005 0.531 ± 0.006 0.465 ± 0.005 0.577 ± 0.005
Tier 3: Collaborative Teacher–Student Distillation Isolation(a) Pixel Student w/o Knowledge Distillation (Direct Bag Training) 0.552 ± 0.008 0.598 ± 0.009 0.435 ± 0.010 0.380 ± 0.009 0.491 ± 0.008
(b) Pixel Student w/ Uniform Distillation ( τ = 1.0 , w/o c ˜ i j ) 0.590 ± 0.006 0.638 ± 0.007 0.485 ± 0.008 0.419 ± 0.007 0.533 ± 0.006
(c) Pixel Student w/ Topological Distillation (Pixel Mode) 0.612 ± 0.005 0.661 ± 0.006 0.510 ± 0.007 0.442 ± 0.006 0.556 ± 0.006
(d) Context Teacher Network (Context Mode) 0.630 ± 0.004 0.682 ± 0.005 0.531 ± 0.006 0.465 ± 0.005 0.577 ± 0.005
Table 12. Detection performance ( NAUC FPR 10 3 , mean ± Std over 5 seeds) for random bag partitioning vs. spatially disjoint block partitioning (with 10-pixel guard band).
Table 12. Detection performance ( NAUC FPR 10 3 , mean ± Std over 5 seeds) for random bag partitioning vs. spatially disjoint block partitioning (with 10-pixel guard band).
Method/ArchitectureMUUFL GulfportAvon Dataset
Random SplitSpatially DisjointRandom SplitCross-Flightline (Disjoint)
ACE [37] 0.412 ± 0.000 0.408 ± 0.000 0.485 ± 0.000 0.482 ± 0.000
MI-ACE [40] 0.482 ± 0.008 0.461 ± 0.009 0.562 ± 0.007 0.548 ± 0.008
HTD-TS3 [14] 0.518 ± 0.006 0.490 ± 0.007 0.612 ± 0.006 0.595 ± 0.007
SSBDM [12] 0.530 ± 0.006 0.505 ± 0.007 0.630 ± 0.005 0.612 ± 0.006
VMIL-ECM [15] 0.536 ± 0.005 0.512 ± 0.006 0.638 ± 0.005 0.621 ± 0.006
SpecDETR [11] 0.549 ± 0.006 0.520 ± 0.007 0.645 ± 0.005 0.628 ± 0.006
Proxy-PMMN [16] 0.556 ± 0.005 0.531 ± 0.006 0.652 ± 0.005 0.636 ± 0.005
Hyper-VMIL (Pixel Mode) 0.562 ± 0.005 0.538 ± 0.006 0.658 ± 0.004 0.642 ± 0.005
Hyper-VMIL (Context Mode) 0.577 ± 0.005 0.551 ± 0.006 0.673 ± 0.004 0.656 ± 0.005
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Hu, H.; Hu, W.; Duan, C.; Yang, Z. Hyper-VMIL: Topology-Aware Variational Hypergraph Multiple-Instance Learning for Weakly Supervised Hyperspectral Target Detection. Remote Sens. 2026, 18, 2838. https://doi.org/10.3390/rs18162838

AMA Style

Hu H, Hu W, Duan C, Yang Z. Hyper-VMIL: Topology-Aware Variational Hypergraph Multiple-Instance Learning for Weakly Supervised Hyperspectral Target Detection. Remote Sensing. 2026; 18(16):2838. https://doi.org/10.3390/rs18162838

Chicago/Turabian Style

Hu, Haoran, Weiyi Hu, Chengkang Duan, and Zhao Yang. 2026. "Hyper-VMIL: Topology-Aware Variational Hypergraph Multiple-Instance Learning for Weakly Supervised Hyperspectral Target Detection" Remote Sensing 18, no. 16: 2838. https://doi.org/10.3390/rs18162838

APA Style

Hu, H., Hu, W., Duan, C., & Yang, Z. (2026). Hyper-VMIL: Topology-Aware Variational Hypergraph Multiple-Instance Learning for Weakly Supervised Hyperspectral Target Detection. Remote Sensing, 18(16), 2838. https://doi.org/10.3390/rs18162838

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop