Next Article in Journal
Physics-Informed Residual Learning for Vertical Profile Reconstruction of Atmospheric Optical Turbulence from Tethered UAV Observations over the Ngari Plateau
Previous Article in Journal
A Spectral–Spatial Decoupling and Fusion Network with Multi-Scale Perception for Multispectral Image Compression
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Preprocessing Mismatch and Input Normalisation in Transferring a Multispectral Foundation Model to Marine Surface Segmentation

by
Christos G. E. Anagnostopoulos
1,
Konstantinos Vlachos
1,*,
Anastasia Moumtzidou
1,
Ilias Gialampoukidis
1,
Stefanos Vrochidis
1,
Ariane Müting
2,
Ana Sofia Oliveira
2,
Dimitris Bliziotis
3 and
Katerina Kikaki
3
1
CDXi Solutions P.C., 54621 Thessaloniki, Greece
2
ESTEC—European Space Research and Technology Centre, Keplerlaan 1, 2200 AG Noordwijk, The Netherlands
3
Hellenic Space Center, Ministry of Digital Governance, 15342 Agia Paraskevi, Greece
*
Author to whom correspondence should be addressed.
Remote Sens. 2026, 18(17), 2905; https://doi.org/10.3390/rs18172905
Submission received: 9 July 2026 / Revised: 21 August 2026 / Accepted: 25 August 2026 / Published: 29 August 2026
(This article belongs to the Section Environmental Remote Sensing)

Highlights

What are the main findings?
  • Where the pretraining and target datasets are produced by different atmospheric correction algorithms, test-time normalisation mismatch is the dominant source of performance degradation, reducing the mean Intersection over Union (mIoU) by 0.458 in the Hydro-to-MADOS transfer.
  • A zero-parameter Frobenius-matched column crop of the pretrained patch embedding adapts the 12-band Hydro encoder to the 11-band MADOS target at least as effectively as any learnt adapter tested.
  • Under limited target supervision, freezing the encoder outperforms both fine-tuning in full and training from scratch.
  • With matched preprocessing, the frozen Hydro encoder matches the published MariNeXt baseline within seed variability.
  • Band-occlusion attribution shows that input normalisation determines which spectral bands the encoder uses, with the importance shift correlated to the per-band source–target gap.
What are the implications of the main findings?
  • In the transfer settings examined (frozen multispectral encoder, limited target supervision), preprocessing alignment rather than architectural modification carries most of the practical effort.
  • Operational pipelines should enforce consistency between the atmospheric correction chain at inference and the chain implicit in the encoder’s pretraining statistics. The cross-pipeline failure mode is qualitatively distinct from routine radiometric variability and is not flagged by standard quality checks.
  • A frozen encoder with a zero-parameter input adapter is a competitive, low-cost baseline that should be evaluated before any learnt adapter or partial unfreezing strategy.
  • Band-occlusion attribution, combined with feature-space separability, offers a tractable mechanistic diagnostic for evaluating preprocessing choices in multispectral remote sensing pipelines.

Abstract

Foundation models for Earth observation are commonly transferred to downstream tasks without explicit attention to the preprocessing mismatch between pretraining and target distributions. This study isolates preprocessing mismatch as a controlled experimental factor in transferring the Hydro multispectral foundation model, a Swin Transformer V2 Base encoder pretrained with SimMIM on Sentinel-2 Level-2A water-body imagery, to the Marine Debris and Oil Spill (MADOS) marine pollution benchmark dataset, processed through ACOLITE Rayleigh reflectance and providing 11 of the 12 spectral bands used during pretraining. The two datasets are therefore produced by different atmospheric correction algorithms under different reflectance conventions, and the resulting per-band statistical discrepancy is quantified as the starting point of the analysis. Three preprocessing dimensions are then systematically varied while all other settings are held constant: input normalisation, spectral band adaptation for the missing B09, and encoder transfer mode. From this, four findings emerge. Normalisation mismatch between training and inference is the single largest source of performance degradation, reducing the mean Intersection over Union (mIoU) by 0.458, more than seven times the largest radiometric perturbation tested. A zero-parameter Frobenius-matched column crop of the patch embedding adapts the 12-band pretrained encoder to the 11-band target, at least as effectively as any learnt linear or nonlinear adapter, at a lower cross-seed variance. Under limited target supervision (1433 training patches against an 87.9 million-parameter encoder), freezing the encoder outperforms both fine-tuning in full and random initialisation training from scratch. The gains of partial unfreezing are attributable to augmented training (very simple copy–paste (VSCP) augmentation, exponential moving average (EMA), and test-time augmentation (TTA)) rather than to encoder adaptation. With matched preprocessing, the frozen encoder reaches 0.600 mIoU and matches the published MariNeXt baseline within seed variability. Mechanistic analysis via band-occlusion attribution and feature-space separability shows that input normalisation determines which spectral bands the encoder relies upon, with the magnitude of the shift correlated to the per-band gap between the source and target distributions. Operationally, preprocessing alignment, rather than architectural modification, carries most of the practical effort in transferring a multispectral foundation model to marine surface segmentation. These results are established for a single encoder–benchmark pair under limited target supervision. The mechanism they identify is more portable than the magnitude reported. A frozen encoder’s representations remain bound to the normalisation statistics of its pretraining dataset, so any transfer that departs from these statistics at inference is predicted to degrade sharply in proportion to the per-band distance between the two distributions.

1. Introduction

Foundation models are increasingly used in Earth observation research. These models are usually pretrained on large image datasets with self-supervised learning and then adapted to downstream tasks. Recent examples include SatMAE [1], Prithvi [2], Prithvi EO 2.0 [3], SkySense [4], Clay [5], SpectralGPT [6], and Hydro [7]. They have been used in land cover mapping, segmentation, change detection, crop monitoring, and disaster-related applications [1,2,3,4,6,8,9,10]. Recent surveys have shown the fast growth of this research area and the increasing diversity of remote sensing foundation models [8,9,10].
A practical issue in transferring these models is the mismatch between the pretraining data and the downstream dataset. In Earth observation, model inputs depend strongly on the preprocessing chain. Different atmospheric correction (AC) methods, reflectance conventions, and band configurations can produce different input distributions. For Sentinel-2 imagery, widely used preprocessing approaches include ACOLITE, Sen2Cor, and LaSRC [11,12,13] for generic scene AC, as well as water-dedicated ones. The choice of AC should not be treated as a trivial matter, as the theoretical principles of each algorithm, as well as its implementation and parameterisation, have an impact on a given scene, which, among others, depends on the depicted land/water surface features (clean water, turbid water, algal bloom, etc.). These methods can produce noticeable differences in per-band statistics and the dynamic range. As a result, two datasets acquired by the same sensor may still differ substantially at the model input level.
This matters for pretrained encoders. During pretraining, the model is optimised on data with a specific statistical structure. Theoretically, if the downstream data follow a different statistical distribution, the first layers will receive inputs that differ from those seen during pretraining. This can reduce the quality of the extracted features and the final task performance, which however depends on the level of differences in these distributions. A second issue appears when the target dataset does not contain the same spectral bands as the pretraining dataset. In that case, the input embedding layer must be modified. In practice, both issues are often handled with task-specific solutions, and the exact choices are rarely analysed in detail. Recent work on parameter-efficient fine-tuning has shown that foundation models can be adapted effectively to geospatial tasks, but preprocessing and the methods used for band adaptation to the pretrained encoder are still not usually examined as controlled experimental factors [14,15].
These issues are relevant for marine pollution mapping from multispectral satellite data. In this setting, target classes may have weak spectral contrast, variable spatial extent, and strong dependence on acquisition conditions. The task is also affected by class imbalance, as water-related classes occupy larger areas than pollutants or other rare water surface features. In addition, annotation is challenging because several categories co-occur, class boundaries are often diffused, and some targets are hard to distinguish from others that have similar properties and characteristics under realistic sea states and atmospheric conditions [16,17,18,19]. For this reason, marine pollution benchmark datasets include confidence-aware and sparse annotation strategies to reduce potentially noisy labels [20]. These characteristics make marine pollution datasets suitable for studying how pretrained encoders on multispectral data behave under preprocessing mismatch.
This study examines this problem using the Hydro foundation model [7] and the MADOS benchmark dataset [20]. Hydro is a water-focused foundation model based on a Swin Transformer V2 encoder [21] pretrained with SimMIM [22] on Sentinel-2 Level-2A water-body imagery [7]. This transfer setting includes two mismatches. The first is spectral, because the B09 water vapour band is absent from MADOS. The second is radiometric, because the target data follow a different preprocessing chain and reflectance convention from the Hydro pretraining dataset.
The present work addresses these issues by treating normalisation, band adaptation, and encoder transfer mode as separate but interacting experimental factors within a single controlled framework. All other settings are kept fixed. This design makes it possible to isolate the effect of each factor and to avoid confounding between preprocessing, architecture adaptation, and training strategy.
The main contributions of this work are as follows.
  • The discrepancy in atmospheric correction algorithm and reflectance convention between the Hydro pretraining dataset and the MADOS target is documented and quantified band by band, establishing the preprocessing gap within which transfer is attempted.
  • Normalisation mismatch between training and inference is shown to be the dominant source of performance degradation in this setting, exceeding the largest radiometric perturbation tested.
  • A zero-parameter weight adaptation is shown to match or exceed every learnt adapter tested for mapping the 12-band pretrained encoder onto the 11-band target dataset with no parameter cost.
  • Partial encoder unfreezing is shown not to improve performance under matched controlled settings.
  • Under matched settings, the pretrained frozen Hydro encoder is shown to match the MariNeXt baseline on MADOS within seed variability.

2. Related Work

2.1. Marine Pollution Detection on Sentinel-2 Imagery

Remote sensing for marine pollution detection has been studied for many years. Most early and operational work focused on synthetic aperture radar (SAR) data, as it supports day and night acquisitions and is far less affected by cloud cover and atmospheric conditions [16]. SAR remains the main source for large-scale oil spill monitoring in operational settings.
Multispectral imagery provides complementary information. Unlike SAR, multispectral data contain spectral information that can help distinguish between different surface materials and water-related phenomena [17,18,19]. This is useful in marine environments, where oil spills, floating debris, algae, foam, wakes, and different water types may show similar spatial patterns but different spectral behaviours. For this reason, Sentinel-2 has been used in several studies for oil spill detection with spectral indices, band ratios, thresholding, and supervised machine learning methods [18,19,23,24].
Most of these studies were limited in at least one of three ways. First, many focused on a single class, usually oil spills or floating debris. Second, several were based on local-scale studies rather than globally distributed datasets. Third, the evaluation protocols were often not standardised across scenes and target types. These limitations made it difficult to assess generalisation across different marine conditions and to draw broadly applicable conclusions.
A major step toward benchmark-based evaluation was the introduction of MARIDA [25]. MARIDA provided a globally distributed Sentinel-2 dataset with 11 marine surface classes and enabled the systematic comparison of machine learning and deep learning methods. MADOS [20] extended this line of work by increasing the label space to 15 classes, including oil spills, floating debris, vessels, wakes, and several water categories across 174 scenes. The accompanying MariNeXt model combined a Multi-Scale Convolutional Attention Network (MSCAN) encoder with a Hamburger-based decoder and a stronger training configuration, which included very simple copy–paste (VSCP) augmentation, exponential moving average (EMA), and test-time augmentation (TTA) [20]. To date, the reported MADOS results are based on models trained from scratch on the target dataset.

2.2. Foundation Models for Remote Sensing

Self-supervised pretraining has produced several foundation models for remote sensing. SatMAE [1] applied masked autoencoding to temporal and multispectral Sentinel-2 data. Prithvi [2] used a temporal Vision Transformer trained on Harmonised Landsat-Sentinel imagery. Prithvi EO 2.0 [3] extended this direction with larger models and a broader evaluation. SkySense [4] moved toward multimodal and large-scale pretraining on optical and SAR data. SpectralGPT [6] focused on spectral remote sensing imagery through a three-dimensional generative transformer design. Clay [5] provided an openly available Earth observation foundation model. Hydro [7] differs from these more general models because it was developed specifically for water-body scenes.
Although these models are often grouped together, they differ in important ways. They use different sensors, pretraining objectives, input resolutions, temporal settings, and band configurations. They also rely on different preprocessing assumptions. For multispectral data, these assumptions include atmospheric correction algorithms, reflectance scaling, cloud and invalid pixel masking, and the exact set of spectral bands. These factors affect the input distribution and the features learnt during pretraining.
A pretrained encoder is shaped not only by the semantic content of the source data but also by the statistical properties of the inputs used during pretraining, which matters for transfer learning. If the downstream dataset follows a different preproceessing chain, transfer performance may depend as much on input compatibility as it does on the architecture quality or fine-tuning strategy. However, most benchmark comparisons of Earth observation foundation models treat preprocessing as fixed, and do not analyse their effects separately [8,9,10,14,15].
This gap is especially relevant for multispectral models. Unlike three-band (red, green, blue) models, multispectral encoders depend directly on band identity and per-band statistics. A change in the number of bands, the scaling of the inputs, or the radiometric distribution can alter the behaviour of the first layers. These considerations suggest that preprocessing mismatch should be treated as a model adaptation issue rather than a minor implementation detail.

2.3. Transfer Learning and Domain Adaptation for Multispectral Data

Parameter-efficient adaptation methods are widely used in large pretrained models. Common approaches include low-rank adaptation, visual prompts, and adapter layers [26,27,28]. These methods aim to reduce the number of trainable parameters while preserving most of the pretrained model. In Earth observation, this is useful because foundation models are often large and expensive to fine-tune fully.
Recent studies have started to evaluate such methods for geospatial foundation models [15] by comparing parameter-efficient fine-tuning strategies for foundation models on several Earth observation benchmark datasets. Their results showed that parameter-efficient methods can approach or exceed full fine-tuning while reducing memory costs [14]. Studies have also evaluated Prithvi across several benchmark datasets and proposed strategies to improve transferability under spectral mismatch [29]. Moreover, an embedding deflection approach for adapting geospatial foundation models to new multispectral settings has been proposed.
The problem of spectral mismatch between a pretrained model and a target dataset has also been addressed in other ways. Missing bands can be handled through direct band removal, remapping, or intermediate projection layers [14,29]. Similar ideas have also been used when transferring models across spectral domains with different numbers of input bands [6]. However, these studies do not isolate the effects of radiometric preprocessing from the effects of the architectural adaptation itself.
This question is closely related to domain adaptation. CORAL aligns the covariance of source and target feature distributions by minimising the Frobenius distance between their covariance matrices [30]. Adaptive batch normalisation updates internal feature statistics using target domain data [31]. In remote sensing, domain adaptation studies have repeatedly shown that changes in acquisition conditions, atmospheric states, and sensor properties can reduce model generalisation [32]. Similar conclusions have been reported in the atmospheric correction literature, where different preprocessing chains can produce different reflectance distributions even for the same scene [11,12,13].

3. Materials and Methods

3.1. Data

3.1.1. MADOS

The MADOS dataset [20] was developed for semantic segmentation of marine pollutants and sea surface features on Sentinel-2 imagery. It consists of 2803 image patches extracted from 174 globally distributed scenes acquired between 2015 and 2022. Level-1C products were processed to Rayleigh reflectance using the ACOLITE water-focused atmospheric processor [11]. Eleven spectral bands are provided, which include three visible (B02, B03, B04) bands and one near-infrared (NIR) band (B08) at 10 m spatial resolution, four red-edge/narrow NIR bands at 20 m (B05, B06, B07, B8A), two shortwave infrared (SWIR) bands at 20 m (B11, B12), and one coastal aerosol band at 60 m (B01). The water vapour band B09 is not retained by the ACOLITE Rayleigh processing chain and is absent from the dataset.
The label space comprises 15 thematic classes: Marine Debris, Dense Sargassum, Sparse Floating Algae, Natural Organic Material, Ship, oil spill, Marine Water, Sediment-Laden Water, foam, turbid water, Shallow Water, Waves and Wakes, Oil Platform, Jellyfish, and Sea Snot. The class distribution is heavily imbalanced. Unannotated pixels are assigned a label of −1 and are excluded from training loss computations and evaluations. The dataset is divided into training (1433 patches), validation (642 patches), and test (728 patches) splits, as reported by [20], and constructed by the authors to be representative of the full dataset in terms of patch and pixels statistics.
The MADOS annotations are sparse. Only a subset of pixels in each scene is labelled, and the remaining pixels are marked unannotated and excluded from training and evaluation. Residual label noise near class boundaries cannot be excluded, and the absolute mIoU values reported should be read based on this limitation. Because every configuration in this study is trained and evaluated on the identical annotation set, this does not affect the relative comparisons that constitute the paper’s findings.

3.1.2. Hydro Pretraining Dataset

The Hydro foundation model [7] was pretrained on globally distributed Sentinel-2 Level-2A patches sampled to contain water bodies, drawn from the Microsoft Planetary Computer Sentinel-2 Level-2A STAC Collection. The collection provides bottom-of-atmosphere reflectance imagery generated by ESA’s Sen2Cor processor [12], which are terrain corrected and distributed as cloud-optimised GeoTIFFs. The pretraining set consists of approximately 100,000 patches of 256 × 256 pixels and twelve spectral bands (B01, B02, B03, B04, B05, B06, B07, B08, B8A, B09, B11, B12). The cirrus band B10 is excluded. The patch sampling was driven by a water-presence criterion and was not class balanced, and no thematic labels are associated with the patches. Pretraining was performed with SimMIM masked image modelling [22] on a Swin Transformer V2 Base encoder for 800 epochs. Two checkpoints are available: a three-band RGB variant and the twelve-band multispectral variant used in this study.
Two properties of this pretraining set are relevant to the present transfer setting of this work. First, the atmospheric correction is Sen2Cor [12], which is parameterised primarily for land surfaces and is known to produce different reflectance distributions over water better than water-dedicated processors, such as ACOLITE [11]. Second, the patch selection contains predominantly clear-water inland and coastal scenes without the marine surface features that constitute the majority of MADOS non-water classes. Both factors contribute to the per-band statistical gap quantified in Section 3.2.
The per-band statistics used as the Hydro reference in Section 3.2 are the normalisation constants applied during Hydro pretraining, as retrieved from the released configuration file in the authors’ GitHub repository (commit hash: abaec2d) [7]. The values are stored in raw Sentinel-2 Level-2A reflectance digital counts (scaled reflectance × 10,000) and are converted to reflectance values through division by 10,000 for comparability with the MADOS statistics in Table 1. These constants define the input distributions under which the encoder weights were optimised and constitute the correct radiometric references for assessing transfer comparability. The raw digital count values are reported for completeness in Appendix D.

3.2. Preprocessing Mismatch

Table 1 presents the per-band means and standard deviations for both distributions. The normalised mean gap δ μ is defined as
δ μ ( c ) = μ M A D O S ( c ) μ H y d r o ( c ) σ H y d r o ( c )
and expresses how far the MADOS pixel distribution lies from the Hydro reference in units of the pretraining standard deviation. Negative values indicate that MADOS reflectance values are lower than the Hydro reference. In the visible range (B01 through B04), δ μ ranges from +0.44 to −0.34. In the red-edge and NIR range (B05 through B8A), the gap deepens substantially, with δ μ reaching −1.30 to −1.38. In the SWIR range (B11 and B12), the gap is −1.23 and −0.99, respectively.
These discrepancies reflect both the atmospheric correction method and surface composition of the two datasets. The Hydro pretraining set was sampled by a water-presence criterion without curation for surface composition, drawing scenes processed through the Sen2Cor pipeline. The MADOS dataset was curated for marine pollution events and is processed through ACOLITE to Rayleigh reflectance. The statistical shift in the two datasets is a result of the varying atmospheric conditions during imagery acquisition, the selection of different preprocessing algorithms for radiometric correction, and the prevalence of non-water surface targets. The B01 band shows a higher Hydro standard deviation than MADOS despite a lower mean. This reflects the heavy-tailed distribution produced by Hydro’s water-presence sampling. B01 is the most sensitive Sentinel-2 band to atmospheric aerosols and to subpixel cloud or non-water contamination, all of which are more variable across the broad Hydro sampling than across the curated MADOS marine targets.

3.3. Architecture

The segmentation model used in this study combines a pretrained Swin Transformer V2 encoder with a Hamburger decoder, following a standard encoder–decoder layout for dense prediction. The same decoder architecture is used in the MariNeXt baseline [20], enabling the direct comparison of encoder representations. Figure 1 illustrates the overall architecture and the position of the band adaptation within the processing pipeline.

3.3.1. Encoder: Swin Transformer V2

The encoder is a Swin Transformer V2 Base [21] initialised from the Hydro pretrained weights [7]. Its configuration is summarised in Table 2. The architecture consists of four hierarchical stages that produce feature maps at progressively reduced spatial resolutions (1/4, 1/8, 1/16, and 1/32 of the input). Each stage applies shifted window self-attention with a window size of 16 tokens. The patch embedding layer at the input projects the spectral bands into a 128-dimensional token space through a convolutional operation with kernel and stride of 4. In its pretrained form, this layer expects 12 input bands that correspond to the Sentinel-2 bands B01 through B12 (excluding B10). The adaptation of this layer to the 11-band MADOS input is the subject of the band adaptation experiments described in Section 3.4. The encoder contains approximately 87.9 million parameters.

3.3.2. Decoder: Hamburger

The decoder follows the Hamburger design introduced by [33], which applies non-negative matrix factorisation (NMF) as a global context aggregation mechanism. The same decoder architecture is used in MariNeXt [20]. Feature maps from all four encoder stages are resized to the spatial dimensions of the first stage (64 × 64 for the 256 × 256 padded input) using bilinear interpolation and then concatenated along the band dimension. A squeeze convolution reduces the concatenated representations to 256 bands. The resulting feature map is processed by the Hamburger module, which decomposes the spatial features into a low-rank basis and coefficient matrices through iterative NMF updates. The decomposition uses a rank of 16, with 6 iterations during training and 7 during evaluation. Group normalisation with 32 groups is applied throughout the decoder. A final 1 × 1 convolution produces per-pixel logits for the 15 output classes. The decoder contains approximately 694,000 parameters, bringing the total model size to approximately 88.6 million parameters.

3.3.3. Reference Baseline: MariNeXt

MariNeXt [20] serves as the from-scratch baseline. It replaces the Swin Transformer encoder with a MSCAN, a four-stage convolutional encoder that employs cascaded dilated convolutions with kernel sizes of 5, 7, 11, and 21 to capture multi-scale spatial context. The authors trained the MSCAN encoder end-to-end alongside the Hamburger decoder. Both MariNeXt and the Swin V2 hybrid feed all four encoder stages into the decoder. Neither discards the first-stage features. An inverse-logarithmic class weighting constant of c = 1.02 is used in loss weighting.
In its published configuration, MariNeXt includes VSCP augmentation, EMA weight averaging with a decay of 0.999, and TTA via eight geometric transformations with majority voting. For controlled comparisons in this study, MariNeXt was retrained using the present training and evaluation pipelines without these enhancements.

3.4. Strategies for the Preprocessing Mismatch

Three aspects of the preprocessing mismatch issue are treated as experimental variables: the spectral band adaptation, the input normalisation, and the encoder transfer mode. Each addresses a different aspect of the mismatch characterised in Section 3.2.
  • The spectral band adaptation handles the missing band.
  • The input normalisation determines the statistical reference frame in which the encoder operates.
  • The encoder transfer mode controls whether the pretrained weights are preserved, partially adapted, or fully retrained.
The following paragraphs describe the options considered for each aspect and the reasoning behind them.
The spectral band adaptation addresses the 12-to-11 band mismatch. The pretrained patch embedding layer is a convolution with weight tensor of shape ( C o u t ,   12 ,   k ,   k ) with k = 4 that projects the 12 input bands into a 128-dimensional token space. Two families of adaptation are considered. Direct weight adaptation modifies the weight tensor to operate on 11 bands, preserving the pretrained mapping for the shared bands and adding no parameters. Learnt input adapters leave the patch embedding unchanged and prepend a trainable module that maps the 11 input bands to the 12 bands as the patch embedding layer expects. The five strategies are compared in Table 3.
D1 (direct crop) removes the B09 column from the weight tensor without further modification. D2 (Frobenius-matched crop) removes the column and rescales each filter so that its Frobenius norm matches the original 12-band value. This compensates for the magnitude reduction caused by the lost dot-product term and preserves the activation configuration under which the downstream layer normalisation and self-attention blocks were optimised. D3 (linear adapter) prepends a 1 × 1 convolution from 11 to 12 bands, which is initialised so that the 11 shared bands pass through unchanged to their corresponding positions in the 12-band patch embedding, and the missing B09 band is seeded from the spectrally adjacent B8A band (detailed below). This adds 144 trainable parameters. D4 (adapter with partial unfreezing) extends D3 by unfreezing the last encoder stage at epoch 40 with a learning-rate scale of 0.05 times the decoder rate. D5 (nonlinear adapter) replaces the linear mapping with a two-layer perceptron with GELU activation and a hidden width of 24, as detailed below. The total parameter count is 588.
In particular, regarding variant D3, it uses a 1 × 1 convolution implemented as a linear projection from 11 input bands to 12 output bands, acting on the input band vector at each spatial location. The weight matrix is initialised so that each of the 11 MADOS bands passes through unchanged to its corresponding position in the 12-band patch embedding, and the missing B09 output band is initialised by copying the spectrally adjacent B8A band (864 nm and 945 nm). The bias vector is initialised to zero. The adapter contributes 144 trainable parameters (132 weight entries plus 12 biases), which are refined by a gradient descent during training.
In addition, the variant D5 replaces the linear projection with a two-layer perceptron. The first layer is a linear projection of R 11 to R 24 with bias, followed by GELU activation. The second layer is a linear projection of R 24 to R 12 with bias and no output activation. The parameter count is (11 × 24 + 24) + (24 × 12 + 12) = 588. All parameters are trainable from random initialisation (Kaiming uniform for the linear weights, zero for the biases).
The input normalisation determines the per-band affine transformation applied to the raw reflectance values before they reach the band adaptation. Two competing objectives exist. The first is encoder compatibility: feeding the encoder inputs whose statistics match the pretraining dataset (Hydro z-score) preserves the operating configuration for which its weights were optimised. The second is decoder consistency: feeding the encoder inputs whose statistics match the downstream training set (MADOS z-score) ensures that the decoder learns representations under the same distribution it will encounter at test time. These two objectives conflict when the pretraining and downstream distributions differ (see Table 1).
The affine MADOS-to-Hydro (M2H) attempts to satisfy both objectives by mapping MADOS statistics onto Hydro statistics, though in practice this produces a third distribution that satisfies neither objective fully. The learnable affine strategy allows the network to discover the optimal mapping, but it may overfit with only 22 parameters and limited training data. The five strategies are compared and summarised in Table 4.
The encoder transfer mode controls whether the pretrained weights are updated during training. With 1433 training patches and an encoder containing 87.9 million parameters, the ratio of supervised pixels to encoder parameters is low. Full fine-tuning in this configuration risks overwriting the general spectral and spatial features learnt during pretraining with noisy gradients derived from a small dataset. Freezing the encoder avoids this risk entirely. Only the 694,000-parameter decoder is trained. Partial unfreezing offers a middle ground: the encoder begins frozen, and only the last transformer stage becomes trainable after a specified number of epochs with a reduced learning rate. This limits the number of updated parameters and delays adaptation until the decoder has stabilised. The three modes are compared: frozen, partial unfrozen, and fully fine-tuned.

3.5. Analysis Methods

3.5.1. Feature-Space Separability

The primary source of classification errors in the MADOS task is the confusion between oil spill and Marine Water. In the published confusion matrix [20], 28.3% of oil spill test pixels are misclassified as Marine Water. To measure this effect, feature vectors are extracted at two points in the decoder: before the Hamburger NMF (pre-HAM) and after it (post-HAM). For each class, a centroid is computed as the mean feature vector over all annotated test pixels of that class. The cosine distance between oil spill and Marine Water centroids quantifies how well the decoder separates these two classes in its internal representation. Comparing this distance across normalisation strategies reveals whether the selection of input statistics affects the decoder’s ability to distinguish oil from water.

3.5.2. Band-Occlusion Attribution

To determine which spectral bands contribute most to each class prediction, a leave-one-out occlusion protocol is applied, following the permutation importance framework of [34] and the occlusion sensitivity analysis of [35], with per-class IoU as the scoring function. For each of the 11 bands in turn, all input values for each band are set to zero across the full test set, and the complete evaluation is repeated. The importance of band b for class c is defined as
I b , c = I o U c I o U c ( b )
where I o U c is the class IoU with all bands present, and I o U c ( b ) is the IoU when band b is set to zero. A positive value indicates that removing band b reduces segmentation accuracy for class c. Because inputs are normalised using MADOS per-band statistics, setting a band to zero in the network input corresponds to replacing the physical reflectance with the MADOS per-band mean.
The protocol is applied to matched pairs of normalisation strategies (B1 with MADOS z-score and B2 with Hydro z-score) using identical architecture and training. The shift in per-band importance between the two strategies is then correlated with the absolute normalised mean gap δ μ from Table 1 using the Spearman rank coefficient, which measures monotonic associations without assuming linearity and is robust to outliers in the per-patch metric. A strong positive correlation would indicate that the bands most affected by the preprocessing mismatch are the same bands whose utilisation changes when the normalisation is switched.

3.5.3. Patch-Level Radiometric Analysis

To assess whether normalisation sensitivity varies across the test set, a patch-level analysis is conducted. For each of the 728 test patches, the spectral distance to the normalisation reference distribution is computed. Performance is evaluated twice for each patch: once with matched normalisation (the statistics used during training) and once with mismatched normalisation (the alternative set of statistics). The per-patch performance drop, defined as the matched-condition metric minus the mismatched-condition metric, is compared with the spectral distance using the Spearman rank coefficient. This analysis tests whether patches whose radiometric properties deviate more from the training-time reference undergo greater degradation under normalisation mismatch.

3.6. Experimental Protocol

3.6.1. Training Configuration

All experiments follow a common training configuration unless otherwise specified. The 11-band MADOS patches are loaded as per-band GeoTIFF files at their native spatial resolutions (10 m, 20 m, 60 m), upsampled to a common 10 m grid via nearest-neighbour interpolation, and stacked into tensors of shape (11, 240, 240). Pixels containing missing values (NaN) are replaced with per-band global means derived from the MADOS training set [20]. Normalisation is then applied according to the strategy under evaluation (Section 3.4). Finally, images are centre-padded to 256 × 256 using the constant zero fill to match the Hydro encoder expected input dimensions. The corresponding mask positions are filled with 1 so that padded pixels are excluded from the loss and all other evaluation metrics. The padded border is visible to the encoder during the forward pass and contributes to spatial context, but it does not generate supervised gradients or affect reported scores.
Models are trained for 80 epochs using the Adam optimiser with an initial learning rate of 2 × 10−4 and no weight decay. A multistep schedule reduces the learning rate by a factor of 10 at epochs 45 and 65. The batch size is 5. The loss function is the cross-entropy with inverse-logarithmic class weighting, which is computed as
w i = 1 l o g ( c + p i )
where p i is the pixel fraction of class i in the training set and c   = 1.02. No label smoothing is applied.
Data augmentation in the controlled blocks consists of random horizontal flips, random vertical flips, and random rotations (90°, 180°, or 270°) applied with 80% probability. VSCP augmentation [20], EMA, and TTA are all disabled in the controlled blocks. Model selection retains the checkpoint with the highest validation mIoU across the 80-epoch run. The last-epoch checkpoint is also stored but is not used for test evaluation in the controlled blocks. Validation mIoU trajectories across the 80-epoch experiments are provided in Appendix E. Each configuration is trained with two random seeds (0 and 1). These seeds control the weight initialisation, data loader shuffling, and augmentation randomness. The results are reported as the mean and standard deviation over seeds. The limited number of seeds is a constraint imposed by the available compute and is acknowledged in Section 5.7.

3.6.2. Encoder Transfer Mode Settings

In the frozen configuration, all encoder parameters are set to evaluation mode and receive no gradients. In the fully fine-tuned configuration, all parameters are trainable from epoch 1 at the same learning rate. In the partially unfrozen configuration, the encoder begins frozen, and the last k stages become trainable at a specified epoch. The encoder learning rate is scaled relative to the decoder rate. The specific settings vary by block. Block A3 uses a scale of 0.10, with the last stage unfrozen from epoch 1. Block D4 uses a scale of 0.05, with the last stage unfrozen from epoch 40. The bridge ablation configurations use a scale of 0.10, with the last stage unfrozen from epoch 1. Throughout this work, partial unfreezing denotes any configuration in which the last k encoder stages become trainable while the remainder stay frozen. As such, each configuration is specified by three quantities: the number of unfrozen stages, the epoch from which they are trainable, and the encoder learning-rate scale relative to the decoder. No separate term is used for configurations whose unfreezing is delayed, as the epoch parameter carries this information. The partially unfrozen blocks (P1 through P4) use a scale of 0.05, with the last stage unfrozen at epoch 40 (P1, P2, P4) or epoch 25 (P3).

3.6.3. Controlled Block Configurations

The experiments in this study are organised into six groups, referred to here as experimental blocks, each of which isolates a single variable while holding all others fixed. Each block is a set of training or evaluation runs. The term “block” denotes an experimental grouping and is unrelated to the transformer blocks of the encoder architecture. The six blocks are: block A (encoder transfer mode), block B (input normalisation strategy), block C (test-time perturbation robustness), block D (spectral band adaptation), block H (label-free harmonisation), and block P (augmented training extension framework). Within each block, individual configurations are identified by the block letter and an index. For example, A2 denotes the second configuration of block A. The band adaptation configurations of D1–D5 introduced in Section 3.4 correspond to the rows of block D. Table 5a specifies the configurations for blocks A, B, and D. Block C and block H configurations are reported in Table 5b and Table 5c, respectively.
Block A evaluates the four encoder transfer modes (random initialisation with full training, Hydro with full fine-tuning, partial unfreezing, and frozen encoder), all using MADOS normalisation with no spectral adapter. Block B compares the five normalisation strategies with a frozen Hydro encoder and no adapter. Block D compares the five band adaptation strategies with a frozen Hydro encoder and MADOS normalisation. Block C evaluates the B1 checkpoint under six perturbation conditions at the test time without additional training. These perturbations simulate operational scenarios: multiplicative gain simulates sensor calibration drift or atmospheric transmittance variation, additive bias simulates path radiance offset, Gaussian noise simulates detector noise, and wrong normalisation simulates deployment on data processed through a different atmospheric correction pipeline.
Block H evaluates three label-free harmonisation transforms as candidate mitigations for the normalisation mismatch identified in Block C. Each row of block H trains a model from scratch on the D2 architecture, with the harmoniser substituted for the per-band MADOS z-score in the input pipeline. The four rows of block H (baseline plus H1, H2, and H3) differ only in this input normalisation. Each harmoniser is fitted from the MADOS training split (H1, H2) or on a per-scene basis at inference (H3) and requires no access to target-class labels. H1 performs a per-band 2nd–98th percentile stretch followed by an additive re-standardisation using the post-clip mean and standard deviation. H2 applies a diagonal CORAL alignment in which each band is rescaled by the ratio of the Hydro-to-MADOS standard deviations and re-centred to the Hydro mean, producing an output in the raw Hydro reflectance space that the encoder was pretrained on. H3 replaces the dataset’s global gain and bias of H2 with a per-scene calibration, in which the scene median and interquartile range (IQR) are matched to the Hydro target statistics, with the multiplicative gain bounded to [0.8, 1.2] and the additive bias bounded to ±0.25 times the target IQR to prevent overcorrection on patches dominated by a single material. Full specifications of H1, H2, and H3 are given in Appendix C.

3.6.4. Extension Frameworks

The extension frameworks depart from the controlled setup to quantify the contributions of individual training enhancements. Table 5d specifies each extension’s configuration.
The ceiling framework trains D2 using VSCP and EMA (decay 0.999) with the encoder frozen, as evaluated with TTA. The partially unfrozen sweep (P1 through P4) combines partial unfreezing with VSCP. P1 through P3 additionally enable EMA and TTA. P4 serves as a no-EMA and no-TTA control. VSCP operates within each training batch by replacing annotated pixels from one image with annotated pixels from another, synthesising additional training samples without external data [20]. TTA applies eight geometric transformations (four rotations combined with horizontal flipping) and aggregates predictions by majority voting.
For each partially unfrozen configuration, a frozen mirror counterpart is trained with identical settings (same seeds, epochs, learning rate schedule, augmentation, EMA, TTA). The only difference is that the encoder remains frozen throughout. This paired design isolates the contribution of encoder unfreezing from the effect of the augmented training configuration.

3.6.5. Evaluation

Evaluation is performed at the pixel level on the 728-patch test set. During inference, the model produces logits at the decoder output resolution, which are cropped to the original 240 × 240 pixel size. Class predictions are obtained through the argmax over the band dimension. Only pixels with valid ground-truth labels (label ≠ 1 ) contribute to the metrics. Padded border pixels and unannotated regions are excluded. Three primary metrics are reported: mean Intersection over Union (mIoU), macro-averaged F1 score (macro F1), and overall accuracy (OA). Inference in this implementation is not deterministic by default, as the LightHam decoder head initialises its non-negative matrix factorisation bases randomly at each forward pass, so repeated evaluations of a single checkpoint yield slightly different predictions unless the random-number stream is fixed. All results reported here were produced with a fixed evaluation seed, unit batch size and fixed dataset ordering; under this protocol every configuration reproduces its reported mIoU exactly. Reported cross-seed standard deviations therefore reflect training stochasticity alone. All configurations are trained with two random seeds (0 and 1). This reflects a deliberate allocation of a fixed compute budget: the full experimental programme comprises 92 training runs across six controlled blocks, and seed replication was traded against coverage of the preprocessing factor space. Cross-seed standard deviations are reported throughout, and differences smaller than the relevant standard deviation are reported as indistinguishable rather than as clear rankings. Because test patches drawn from the same Sentinel-2 scene are not independent, uncertainty attributable to test-set sampling is estimated by a scene-level bootstrap: the 42 test scenes are resampled with replacement over 10,000 iterations, per-scene confusion matrices are summed within each resample, and mIoU is recomputed under the reduction defined above. Intervals are reported for the mean-over-seed statistic used throughout the manuscript. The results are given in Appendix H.

3.6.6. Computational Resources

Training and evaluation were conducted on a workstation equipped with an NVIDIA GeForce RTX 4060 Ti GPU, using CUDA 12.4 and PyTorch 2.5.1 under Python 3.10. A single 80-epoch training run requires approximately 1 h for frozen encoder configurations and approximately 2 h for full fine-tuning. All metrics are computed using scikit-learn 1.6.0 and pooled across the full test set.

4. Results

4.1. Transfer Strategy

Table 6 summarises the results for block A, which compares four encoder transfer modes, together with the D2 band adaptation configuration and the MariNeXt baseline. Among the Hydro-initialised configurations, the frozen encoder (A2) achieves the highest mIoU at 0.574, followed by partial unfreezing (A3, 0.540) and full fine-tuning (A4, 0.489). The full fine-tuned Hydro encoder performs worse than a randomly initialised encoder trained from scratch (A1, 0.527). The frozen configuration also exhibits the lowest inter-seed variance ( σ = 0.005).
Adding the D2 band adaptation (Frobenius-matched weight crop) to the frozen encoder raises performance to 0.600 mIoU, which exceeds the MariNeXt baseline retrained in the present codebase without training enhancements (0.559 mIoU) by 4.1%. When engineering enhancements are enabled, the frozen Hydro encoder (P1 frozen mirror, 0.660 mIoU with VSCP, EMA, and TTA) reaches a mean mIoU 1.7% above the published MariNeXt result (0.643 mIoU with VSCP, EMA, and TTA). Given σ = 0.024 for P1 frozen mirror, the matched comparison falls within seed variability ( Δ = 0.017 < σ ). The two configurations are therefore reported as a match rather than as an improvement of one over another. It is also noted that the published MariNeXt achieves the highest overall accuracy (0.891) in Table 6, while the frozen Hydro configurations achieve the highest mIoU and macro F1. This pattern is expected on a heavily imbalanced dataset. A classifier that performs slightly better on the dominant water classes can score higher on the pixel-pooled overall accuracy, while macro-averaged mIoU and F1, which weight all classes equally, favour configurations that improve on the minority classes.
To verify whether the gains observed in the extension frameworks originate from encoder unfreezing or from the augmented training techniques, two complementary comparisons were performed: a bridge ablation between matched frozen and partially unfrozen configurations under controlled conditions (no VSCP, EMA, and TTA), and a frozen mirror set under the augmented recipe (VSCP, EMA, and TTA enabled). Three matched bridge ablation pairs are derivable from the controlled blocks: A2 (frozen, no adapter) versus A3 (partial unfreezing from epoch 1, no adapter); D2 (frozen, Frobenius-matched crop) versus D4 (partial unfreezing from epoch 40, D3 adapter); and D3 (frozen, D3 adapter) versus D4 (partial unfreezing from epoch 40, D3 adapter). In all three pairs, the frozen configuration outperforms the partially unfrozen counterpart: A2 (0.574)—A3 (0.540) = +0.034; D2 (0.600)—D4 (0.575) = +0.025; D3 (0.582)—D4 (0.575) = +0.006. The first two differences exceed the cross-seed standard deviation of the partially unfrozen variant ( σ = 0.022 for A3, σ = 0.033 for D4) and are therefore robust. The third is within seed variability. In the frozen mirror experiments, the same training conditions were applied (including VSCP, EMA, and TTA) with and without encoder unfreezing. Across the four matched extension framework pairs, the frozen mirror clearly exceeds the partially unfrozen counterpart in two cases (P2: 0.611 versus 0.590, Δ = +0.022; P4: 0.620 versus 0.593, Δ = +0.027). In the remaining two cases, the direction is reversed: P1 partial (0.663) marginally beats P1 frozen mirror (0.660) by Δ = +0.003, well within the frozen mirror standard deviation of σ = 0.024; and P3 partial (0.662) beats P3 frozen mirror (0.631) by Δ = +0.031, comparable to the partially unfrozen standard deviation of σ = 0.048. Across all four pairs, partial unfreezing produces no statistically robust gain over frozen encoder training under matched VSCP + EMA + TTA conditions: when partial wins, the margin is within seed variability, whereas when frozen mirror wins, the margins (0.022 and 0.027) are larger than typical seed dispersion. The frozen encoder configuration is therefore as good as or better than the partially unfrozen one in every pair tested modulo cross-seed noise.

4.2. Band Adaptation

Table 7 presents the results for block D, which compares five strategies for adapting the 12-band pretrained patch embeddings to the 11 MADOS bands. All configurations use a frozen encoder with MADOS normalisation.
The Frobenius-matched crop (D2) achieves the highest mean mIoU (0.600) and the lowest cross-seed deviation (0.004). The direct crop without rescaling (D1) reaches 0.553, indicating that the Frobenius norm compensation in D2 accounts for a gain of 4.7%. The learnt linear adapter (D3) reaches 0.582 with substantially higher variance ( σ = 0.043). Adding partial encoder unfreezing from epoch 40 (D4, 0.575) does not improve over D3 and increases instability. The nonlinear MLP adapter (D5) yields the lowest performance across all variants (0.509). Across the five strategies, the zero-parameter weight adaptation (D2) attains the highest mean mIoU and the lowest cross-seed dispersion. Its margin over the learnt linear adapter (D3, Δ = 0.018) falls within D3’s inter-seed variability, so D3 cannot be declared inferior in mean; thus, the comparison establishes that the learnt adapter delivers no demonstrable benefit over the zero-parameter alternative while introducing 144 trainable parameters and markedly higher run-to-run variance. Against the direct crop (D1, Δ = 0.047) and the MLP adapter (D5, Δ = 0.091), the advantage of D2 exceeds inter-seed variability. A paired scene-level bootstrap over the 42 test scenes places the D2—D3 difference at +0.019 with a 95% interval of [−0.012, +0.052]; the sign is preserved in 89% of resamples, so the ordering is directionally consistent but not resolvable against scene-level sampling noise.

4.3. Normalisation

4.3.1. Matched Normalisation

Table 8 reports the results for block B, in which the five normalisation strategies are compared using a frozen Hydro encoder without a spectral adapter.
The MADOS z-score (B1, 0.571) and Hydro z-score (B2, 0.560) both yield higher mIoU than the remaining alternatives. A paired scene-level bootstrap resampling the 42 test scenes gives a difference of +0.011 with a 95% interval of [−0.019, +0.081]. The sign is preserved in 82% of resamples whereas the interval includes zero. The difference between B1 and B2 is small (0.011 mIoU) and falls within the range of inter-seed variability for B2 ( σ = 0.027). MADOS normalisation is marginally preferred for this task. Patch z-score (B3, 0.478) performs worse. The per-patch statistics are noisy and vary with scene composition, resulting in inconsistent input distributions across the training and test samples. The explicit domain alignment strategies, affine M2H (B4, 0.404) and learnable affine (B5, 0.386), yield the lowest accuracy. Although designed to reduce distributional divergence, they produce a synthetic distribution that matches neither dataset. The encoder performs best when it receives globally consistent statistics from either reference rather than a statistical compromise.

4.3.2. Normalisation Mismatch

Table 9 reports the perturbation robustness results from block C. The B1 checkpoint (frozen encoder, MADOS normalisation) was evaluated under six perturbation conditions applied to the test inputs, without additional training.
Multiplicative gain perturbations of ±5% produce mIoU changes of +0.017 (gain = 0.95) and −0.021 (gain = 1.05). Additive bias perturbations of ±0.005 produce changes of +0.004 and −0.024. Gaussian noise ( σ = 0.005) reduces mIoU by 0.064. Applying the wrong normalisation statistics (Hydro z-score applied to a model trained with MADOS z-score) reduces mIoU from 0.571 to 0.113. This degradation is an order of magnitude larger than any of the radiometric perturbations tested.
The reverse direction was evaluated to establish whether this collapse depends on which set of statistics is substituted. The B2 checkpoint, trained under Hydro statistics, was evaluated on the same test data with MADOS statistics applied at inference (C6). That is, performance falls from 0.560 to 0.241 mIoU, a loss of 0.319, with overall accuracy declining from 0.858 to 0.661 and macro F1 from 0.674 to 0.327. Mismatched normalisation is therefore catastrophic in either direction, and the effect reported above is not an artefact of the direction tested. The magnitudes are not equal, as the forward direction loses 80.2% of its clean mIoU against 57.0% in the reverse at a ratio of 0.70. Per-class behaviour is correspondingly uneven. Under C6, Oil Platform loses 0.68 IoU, Jellyfish 0.50 (to exactly zero), turbid water 0.46, and foam 0.44, whereas Marine Water loses 0.16 and Sediment-Laden Water 0.21. The rare classes that the Hydro-normalised pipeline recovers are also the first to disappear when the normalisation is mismatched.
Table 10 reports the block H results, in which three label-free harmonisation transforms are evaluated as candidate mitigations for the normalisation mismatch revealed in block C. Each row was trained from scratch on the D2 architecture with the harmoniser substituted for MADOS z-score. The baseline row uses the same architecture with MADOS z-score retained. None of the three transforms recovers the matched normalisation performance: H1 (percentile stretch with post-clip re-standardisation) reaches 0.514, H2 (diagonal CORAL alignment to Hydro reflectance) reaches 0.409, and H3 (constrained per-patch affine to Hydro) reaches 0.345 mIoU. All three fall below the D2 configuration (0.600) and below the unmodified MADOS z-score baseline of this block (0.566). The relative ordering baseline > H1 > H2 > H3 is preserved across the two seeds.

4.4. Mechanism: Normalisation Controls Band Utilisation

The results in the preceding sections indicate that MADOS and Hydro normalisation produce similar aggregate performance (0.571 versus 0.560) while the mismatch at test time is catastrophic. This section examines the internal mechanism through which normalisation affects the pretrained encoder.

4.4.1. Feature-Space Separability

Table 11 reports the cosine distance between oil spill and Marine Water class centroids in the decoder feature space, measured at two hook points. Under MADOS normalisation (B1), the pre-Hamburger (pre-HAM) cosine distance between the two classes is 0.079. Under Hydro normalisation (B2), this increases to 0.117, representing a factor of 1.5. After the Hamburger NMF module, the separation grows from 0.194 (B1) to 0.388 (B2) at a factor of 2.0. The NMF module amplifies the normalisation-induced separability advantage: the ratio of post-Hamburger (post-HAM) to pre-HAM distance is 2.5 under MADOS normalisation and 3.3 under Hydro normalisation. Figure 2 shows the corresponding UMAP projection of the pre-HAM decoder features for the B1, B2, and D2 configurations.
These measurements indicate that, although the aggregate mIoU difference between B1 and B2 is only 0.011, the decoder’s internal geometry for the oil spill versus Marine Water boundary differs substantially. Hydro normalisation produces a feature space in which the two most confused classes are better separated, when this advantage is diluted in the 15-class macro-averaged metric.

4.4.2. Band-Occlusion Attribution

To determine whether the separability difference reflects a change in spectral band utilisation, a band-occlusion analysis was conducted on the B1 versus B2 pair. Figure 3 shows the per-band importance for oil spill under both normalisation strategies.
Under MADOS normalisation (B1), oil spill importance is distributed relatively evenly across all 11 bands, with the highest values in the visible range (B01 through B04) and moderate contributions from the near-infrared and shortwave infrared bands B06 (739 nm), B07 (780 nm), B8A (864 nm), and B11 (1610 nm). These are spectral regions where oil films modify the Fresnel surface through capillary wave damping [17] and where the SWIR bands bracket the diagnostic C-H stretch hydrocarbon absorption features near 1730 nm and 2300 nm [36]. Simultaneously, the importance of the red band (B04, 665 nm) decreases, indicating that the model reduces its reliance on a spectrally less diagnostic wavelength.
Table 12 reports the Spearman rank correlation between the per-band importance shift (Hydro minus MADOS importance) and the absolute normalised mean gap δ μ from Table 1. For oil spill, the correlation is 0.836 ( p = 0.001). For Marine Water, it is 0.791 ( p = 0.004). These values confirm that the bands most affected by the preprocessing mismatch are the same bands whose utilisation changes most when the normalisation is switched.

4.5. Spatial Structure of Normalisation Fragility

The normalisation mismatch effect reported in Section 4.3.2 represents an aggregate over all 728 test patches. To assess whether the degradation varies spatially, a patch-level analysis was conducted for the D2 configuration. For each test patch, the mIoU was evaluated under both matched (MADOS) and mismatched (Hydro) normalisation, and the drop was correlated with the spectral distance of that patch to the MADOS reference distribution.
Table 13 reports the Spearman correlation for the marine patch subset (n = 669), which excludes patches dominated by land cover or coastal features. A positive correlation between the Euclidean distance to the MADOS reference mean ( D M A D O S ) and the mIoU drop is observed ( ρ = 0.105, p = 0.007), indicating that patches whose spectral statistics deviate more from the MADOS training distribution experience greater degradation under mismatched normalisation, though the effect size is small. The spectral angle to the MADOS reference (SAM-to-MADOS) shows a similar trend ( ρ = 0.080, p = 0.038), again with a small effect magnitude. The Mahalanobis distance shows the opposite sign ( ρ = −0.088, p = 0.022). Mahalanobis whitens by the inverse MADOS covariance and therefore emphasises deviations along low-variance directions of the training distribution, whereas the failure mode under mismatched normalisation is driven by the systematic per-band mean offset between MADOS and Hydro, which is largely orthogonal to those low-variance directions. The three distance metrics therefore identify partially disjoint subsets of at-risk patches, with small effect sizes across the board, indicating that input radiometric statistics alone are weakly predictive of patch-level susceptibility to normalisation mismatch.
Unsupervised clustering of the test patches based on 28 radiometric descriptors (per-band medians, interquartile ranges, spectral indices, and water-pixel fractions) identifies two latent radiometric configurations within the marine partition ( k = 2, silhouette coefficient = 0.67). These clusters correspond to patches with different brightness profiles and water composition, indicating that MADOS is not radiometrically homogenous.

5. Discussion

5.1. Preprocessing Mismatch as the Dominant Factor in Transfer Performance

Across all controlled blocks, the configurations that most strongly affect performance are those that alter the statistical relationship between the input distribution and the encoder’s pretrained operating configuration. Block C demonstrates this most directly, as applying the wrong normalisation statistics at test time reduces mIoU by 0.458, roughly an order of magnitude larger than the largest radiometric perturbation tested. This dominance of normalisation over other preprocessing perturbations indicates that the encoder’s representations are tightly bound to the statistical distribution under which they were learnt, and that recovery from a mismatched distribution does not occur within the downstream layers.
Two observations support the framing of preprocessing mismatch as a transfer-level problem rather than a per-pixel calibration problem. First, the explicit domain alignment strategies (B4, B5) underperform in contrast to the simple z-score strategies (B1, B2). The encoder benefits from globally consistent statistics from either reference distribution, but not from a synthesised intermediate distribution that satisfies neither. Second, the label-free harmonisation transforms in block H (H1, H2, H3) also fall below B1, indicating that purely statistical alignment of source-to-target distributions is insufficient when the encoder’s internal feature distribution is the actual referent. None of the three block H transforms recovers the matched normalisation performance, even though all three reduce the marginal distance between source and target band statistics by design.
A distinction should be drawn between the preprocessing discrepancy documented in Section 3.1 and the mechanism established in block C. Hydro and MADOS differ in their atmospheric correction algorithm and reflectance convention, but they also differ in scene composition, geographic and temporal sampling, class definitions, and label distribution. The present design does not separate these sources, and the degradation reported here is therefore not attributed to atmospheric correction as such. What block C establishes is narrower and does not depend on that attribution, whereby holding the model, the imagery, and the labels as fixed and altering only the normalisation statistics applied at inference reproduces a collapse of 0.458 mIoU. The operative variable is the statistical correspondence between the input and the encoder’s pretrained operating point, irrespective of what produced the discrepancy. Isolating the contribution of atmospheric correction specifically would require the same imagery processed through several correction algorithms and evaluated under an otherwise identical protocol; this is identified as a direction for future work in Section 6.

5.2. Why Direct Weight Adaptation Outperforms Learnt Adapters

The band adaptation results in block D show that the zero-parameter Frobenius-matched crop (D2) exceeds the direct crop (D1) and the nonlinear MLP adapter (D5) by margins larger than inter-seed variability, and matches the learnt linear adapter (D3) at a tenth of its cross-seed dispersion and at zero-parameter cost. Two factors plausibly drive this. First, D2 preserves the exact pretrained mapping for the eleven shared bands and applied a closed-form magnitude correction. It introduces no degrees of freedom that can drift during training. Second, the learnt adapters operate before a frozen encoder whose weights were optimised under the original input configuration. Gradients flowing into the adapter must compensate not only for the missing band but also for any deviation between the encoder’s expected input geometry and the adapter’s output. With 144 (D3) or 588 (D5) parameters, this is a fragile optimisation, and the elevated cross-seed variance for D3 and D5 ( σ = 0.034 to 0.043) is consistent with this interpretation.
The 4.7% gain of D2 over D1 isolates the magnitude-compensation effect specifically. Removing one input band without rescaling reduces the per-filter dot-product magnitude by approximately one twelfth, which propagates as a distributional shift through the subsequent layer normalisation and self-attention blocks. The encoder’s downstream layers were not optimised under this shifted setting. The Frobenius rescaling in D2 restores the per-filter weight norm to the original 12-band value, eliminating this shift. The result is consistent with prior observations that activation-scale preservation matters when modifying the input layer of a pretrained network [14,29]. The distribution of per-filter Frobenius norms before and after this rescaling is reported in Appendix F.

5.3. Encoder Freezing Under Limited Target Data

The ratio of supervised pixels to encoder parameters in this transfer setting is low: 1433 training patches against an 87.9-million-parameter encoder. Under these conditions, full fine-tuning of the pretrained encoder (A4, 0.489 mIoU) underperforms not only with the frozen encoder (A2, 0.574) but also with a randomly initialised encoder trained from scratch (A1, 0.527). The from-scratch random model carries no prior assumptions about its representations and is therefore not at risk of overwriting useful structures. However, the fully fine-tuned pretrained model is. This pattern is consistent with the framing in Section 3.4.
The bridge ablation and frozen mirror experiments further indicate that the performance gains in the extension frameworks (P1–P4) originate from the augmented training setting (VSCP, EMA, TTA) rather than from encoder unfreezing. Across the four matched extension framework pairs, the frozen mirror clearly exceeds the partially unfrozen counterpart in two cases (P2, P4). In the remaining two (P1, P3), the direction is reversed but the partial advantage is within seed variability ( Δ = 0.003, σ = 0.024; Δ = 0.031, σ = 0.048). Across all four pairs, partial unfreezing never produces a statistically robust gain over frozen encoder training under matched augmented training conditions. For practitioners working under similar data constraints, freezing the encoder remains the safer default.
It is noted that the choice of D3 rather than D2 for the block P configurations reflects an interaction between adapter complexity and augmented training. The D2 ceiling experiment (Table A4) trains D2 with the fully augmented settings (VSCP, EMA, TTA) under MADOS normalisation and reaches 0.600 mIoU, the same as D2 alone. Augmentation under D2 redistributes per-class accuracy but cannot lift the aggregate, because D2 is a closed-form, zero-parameter operation with no degrees of freedom for the augmented gradient signal to exploit. D3, with its 144 trainable parameters, retains an adaptation surface that augmented training can use, and under matched conditions (Hydro normalisation, frozen encoder, VSCP, EMA, TTA) lifts performance to 0.660 mIoU (P1 frozen mirror). The two adapters therefore serve different roles: D2 is the preferred zero-cost solution under controlled (non-augmented) conditions, and D3 is the preferred adapter when the augmented training setting is enabled. The same logic explains the absence of a separate Hydro plus D2 plus augmented configuration in block P. The D2 ceiling result establishes that augmentation does not lift D2’s mIoU under MADOS normalisation, and there is no mechanism by which switching to Hydro normalisation would create augmentation headroom in a zero-parameter adapter.

5.4. Normalisation as the Driver of Band Usage by the Encoder

Section 4.4.1 and Section 4.4.2 together provide a mechanistic account of how input normalisation affects performance. The feature-space separability analysis shows that the decoder’s internal geometry for the oil spill versus Marine Water boundary differs substantially between B1 and B2 despite a small aggregate mIoU difference. Hydro normalisation produces a feature space in which the two most confused classes are better separated, even when the advantage is diluted in the 15-class macro-averaged metric.
The band-occlusion analysis explains where this separability advantage comes from. Under Hydro normalisation, the encoder’s reliance shifts toward the NIR and SWIR bands (B06, B07, B8A, B11) and away from the red band (B04), targeting the physically diagnostic spectral regions identified in Section 4.4.2. The Spearman rank correlations between the per-band importance shift and the absolute normalised mean gap δ μ ( ρ = 0.836 for oil spill, ρ = 0.791 for Marine Water) confirm that the bands most affected by the preprocessing mismatch are the same bands whose utilisation changes most when the normalisation is switched. The mechanism is therefore not a generic loss of accuracy but a targeted reweighting of band importance.
The two directions are not mirror images of one another, and the asymmetry between them follows from that. The imagery is MADOS in both cases; only the constants change. Because the Hydro per-band standard deviations exceed the MADOS values by factors of 1.6 to 1.7 (Table 1), substituting Hydro statistics at test time compresses the input distribution relative to the range under which the encoder was trained, whereas substituting MADOS statistics into a model trained under Hydro statistics expands it. Compression is the more destructive of the two operations, as it reduces the effective dynamic range presented to the patch embedding, and the subsequent layer normalisation rescales the diminished signal together with whatever noise accompanies it, while expansion preserves the relative structure and is partially absorbed by the same normalisation layers. This account is consistent with the ordering observed, but the present design does not isolate compression as the mechanism; doing so would require sweeping the ratio between the train-time and test-time scales independently from the mean offset.

5.5. Spatial Structure and Operational Implications

The patch-level analysis in Section 4.5 indicates that normalisation-induced degradation varies systematically across the test set. Patches whose spectral statistics deviate more from the MADOS training reference experience greater mIoU drops under mismatched normalisation. While the correlation magnitudes are small, they are statistically significant and persist across two complementary distance metrics (Euclidean and SAM), suggesting that radiometric distance to the training distribution is one of the factors governing per-patch sensitivity. The small effect size also implies that distance to the training distribution alone is not a sufficient predictor of per-patch degradation. Additional factors not captured by simple band-wise distance metrics likely contribute.
The negative correlation observed for the Mahalanobis distance ( ρ = −0.088, p = 0.022) is in the opposite direction from the Euclidean and SAM results. A plausible explanation is that the Mahalanobis distance, by inverting the training covariance, downweights variance directions that are aligned with the training distribution and upweights those that are orthogonal to it. Patches with a high Mahalanobis distance may therefore be those whose deviation from the training reference is dominated by underrepresented variance directions, which the encoder is comparatively less reliant on. The negative correlation should be interpreted with caution given the small effect size.
The patch-level analysis quantifies a statistically detectable weak relationship between a patch’s input radiometric distance to the MADOS training reference and the magnitude of its mIoU drop under normalisation mismatch. The effect size is too small to support reliable per-patch flagging in deployment, and the result is better read as evidence of dataset-level radiometric heterogeneity than as a per-patch risk-prediction tool. The presence of two latent radiometric clusters in the test set ( k = 2, silhouette = 0.67) nonetheless confirms that the test imagery is not radiometrically homogenous. Operational pipelines ingesting imagery from multiple atmospheric correction chains should therefore expect a heterogeneous rather than uniform degradation under preprocessing mismatch.

5.6. Comparison with the MariNeXt Baseline

The frozen Hydro encoder with the D2 band adaptation reaches 0.600 mIoU under matched conditions, exceeding the MariNeXt baseline retrained without engineering enhancements (0.559) by 4.1%. When VSCP, EMA, and TTA are enabled for both model families, the frozen Hydro encoder reaches 0.660 mIoU compared with 0.643 for the published MariNeXt. The 0.017 mIoU difference is within the cross-seed variability of P1 frozen mirror ( σ = 0.024), so the two configurations are reported as comparable rather than a claim that one outperforms the other.
The substantive contribution is not a new state of the art on MADOS. It is the demonstration that a pretrained foundation model encoder, adapted to the target preprocessing chain through a single principled weight tensor operation and used with its weights frozen, achieves performance comparable to end-to-end training of a state-of-the-art convolutional baseline. Under this framing, careful preprocessing alignment, not deeper architectural changes, accounts for most of the practical adaptation effort needed to transfer a multispectral foundation model onto a marine surface segmentation task.
The confusion matrix analysis in Appendix B sharpens this comparison. The published MariNeXt confusion matrix [20] reports 28.3% of oil spill test pixels misclassified as Marine Water. The D2 configuration in the present study reduces this confusion to 5.30%. The opposite direction confusion (Marine Water as oil spill) is 19.8% under D2, indicating that the residual oil spill–Marine Water confusion in the present setting is asymmetric. The model underpredicts oil spill less frequently than it overpredicts it. This is consistent with the band utilisation shift observed in Section 4.4.2, in which Hydro normalisation routes more decision weight to the NIR and SWIR bands where oil–water contrast is largest. Qualitative segmentation outputs for eight representative test patches across the two latent radiometric settings of Section 4.5 are provided in Appendix G, and they visually corroborate the confusion pattern differences quantified above.

5.7. Limitations

Several limitations of the present study should be acknowledged. First, all configurations are trained with two random seeds, and standard deviations computed from two runs carry limited statistical power. The conclusions reported here rest on margins between 0.046 and 0.458 mIoU against cross-seed standard deviations between 0.004 and 0.038; comparisons with smaller margins are reported as indistinguishable throughout. The scene-level bootstrap in Appendix H indicates that the bootstrap standard error exceeds the cross-seed standard deviation in eleven of the twelve configurations examined and is within three per cent of it in the twelfth, so the precision of the reported estimates is limited principally by the number of independent test scenes rather than by seed count. The two comparisons closest to the resolution limit illustrate this directly: paired bootstraps place B1–B2 at +0.011 (95% interval [−0.019, +0.081]) and D2–D3 at +0.019 (95% interval [−0.012, +0.052]), with the sign preserved in 82% and 89% of resamples, respectively. Both orderings are directionally consistent and neither is resolvable against scene-level noise. Replication with additional seeds and evaluation on a larger independent test partition would strengthen the individual comparisons.
Second, while the normalisation mismatch directions have been reported (Section 4.3.2 and Section 5.4), the asymmetry between them is not yet mechanistically resolved. The forward direction loses 80.2% of its clean mIoU against 57.0% in the reverse, and the compression account offered in Section 5.4 is consistent with that ordering without isolating it experimentally. Separating the effect of scale contraction from that of mean offset would require a sweep over the ratio between train-time and test-time normalisation constants, which is left for future work. Third, the MADOS splits were verified to be disjointed at the scene level for the present study; the 174 scenes partition into 96 training, 36 validation, and 42 test scenes, with no scene appearing in more than one split, so the results are not affected by cross-split scene leakage. The test partition is nonetheless small in terms of independent units. Its 42 scenes contribute between two and 48 patches each (median 14.5), and no single scene contains more than eight of the fifteen classes. This is the principal reason the intervals in Appendix H are wide, and it bounds the precision attainable on this benchmark irrespective of training protocol.
Fourth, the spectral importance attribution in Section 4.4.2 uses a zero occlusion (equivalent to MADOS-mean replacement) as the baseline. Alternative baselines such as noise injection may yield different importance rankings. The conclusions drawn here pertain to relative shifts in band utilisation between normalisation strategies, which are less sensitive to the choice of baseline than absolute importance values.
Fifth, the experiments use only the Hydro foundation model and the MADOS dataset. Generalisation of these findings to other foundation models (e.g., Prithvi, SatMAE, SpectralGPT) and multispectral benchmark datasets is not established and is a natural direction for follow-up work.

6. Conclusions

This study examined preprocessing mismatch as a controlled experimental factor in transferring a multispectral foundation model to a marine surface segmentation task. Using the Hydro Swin Transformer V2 encoder and the MADOS benchmark dataset, three preprocessing dimensions (input normalisation, band adaptation, and encoder transfer mode) were systematically varied while all other settings were held constant.
The two datasets are produced by different atmospheric correction algorithms under different reflectance conventions, and the per-band statistical discrepancy that follows is documented in Section 3.1. The controlled experiments were conducted within that setting. Four findings emerge from them. First, the normalisation mismatch between training and inference is the single largest source of performance degradation observed, exceeding all other radiometric perturbations by an order of magnitude. Second, a zero-parameter Frobenius-matched weight crop adapts the 12-band pretrained patch embedding to the 11-band target dataset more effectively than any learnt adapter tested. Third, under limited target data, freezing the encoder outperforms both the fine-tuning in full of the pretrained encoder and the full training from a random initialisation. The gains observed under partially unfrozen configurations are attributable to the augmented training configuration (VSCP, EMA, TTA) rather than to encoder adaptation itself. Fourth, with matched preprocessing, the frozen pretrained encoder matches the published MariNeXt baseline on MADOS within seed variability, demonstrating that careful preprocessing alignment carries most of the practical adaptation effort.
Mechanistic analysis shows that input normalisation alters which spectral bands the encoder relies on, with the magnitude of the shift correlated with the per-band gap between the source and target distributions. This indicates that preprocessing mismatch is not a generic accuracy loss but a structured reweighting of the encoder’s spectral utilisation pattern.
These findings are established for a single encoder–benchmark pair under limited target supervision, and the magnitudes reported should not be read as general constants. The mechanism they identify is the more portable result, whereby a frozen encoder’s representations remain bound to the normalisation statistics of the dataset on which it was pretrained, so any transfer that departs from those statistics at inference should be expected to degrade sharply, and the degradation should scale with the per-band distance between the two distributions. This is testable on any pretrained multispectral encoder with a documented normalisation convention, and it is offered as the generalisable claim of the present work.
Three directions for future work follow. First, the scope of the present study should be extended to additional foundation models and additional multispectral benchmark datasets, in order to establish whether the dominance of normalisation observed here generalises beyond the Hydro–MADOS pair. Second, label-aware harmonisation strategies that explicitly use a small set of target labels to align source and target statistics, rather than the label-free transforms tested on block H, may close more of the mismatch gap. Third, the operational implications of patch-level normalisation fragility (the ability to flag at-risk patches from input statistics alone) warrant integration into deployed marine pollution monitoring pipelines. Fourth, the contribution of atmospheric correction specifically, as distinct from the other differences between the two datasets, could be isolated by processing a common set of scenes through several correction algorithms and repeating the controlled protocol on each.

Author Contributions

Conceptualisation, K.V. and C.G.E.A.; methodology, C.G.E.A.; formal analysis, C.G.E.A.; investigation, C.G.E.A. and K.V.; resources, A.M. (Anastasia Moumtzidou), I.G. and S.V.; data curation, C.G.E.A.; writing—original draft preparation, C.G.E.A.; writing—review and editing, K.V. and A.M. (Ariane Müting); visualisation, C.G.E.A.; supervision, K.V.; project administration, K.V., A.S.O., A.M. (Ariane Müting), K.K. and D.B.; funding acquisition, K.V., A.M. (Anastasia Moumtzidou), I.G. and S.V. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Greek National Satellite Space Project: Axis 3 Water Monitoring Service, ESA Contract No. 4000145363/24/NL/Ffi.

Data Availability Statement

The data presented in this study are openly available. The MADOS (Marine Debris and Oil Spill) dataset is publicly available at https://doi.org/10.5281/zenodo.10664073 (accessed on 20 August 2026), with the accompanying code at https://github.com/gkakogeorgiou/mados (accessed on 20 August 2026). The Hydro foundation model and its pretrained weights are publicly available at https://github.com/isaaccorley/hydro-foundation-model (accessed on 20 August 2026). No new data were created. All datasets and models are subject to the licences specified by their corresponding providers.

Acknowledgments

The research was carried out under an ESA Contract in the frame of the Greek National Satellite Space Project. The Project: Small-Satellites (Measure ID 16855) is implemented by the Hellenic Ministry of Digital Governance with the European Space Agency (ESA) Assistance in the Management and Implementation. The project is part of the National Recovery and Resilience Plan ‘Greece 2.0’, which is funded by the Recovery and Resilience Facility (RRF), a core programme of the European Union-NextGenerationEU. The authors would also like to thank TotalView as the coordinator of the project. The authors have reviewed and edited the output and take full responsibility for the content of this publication.

Conflicts of Interest

Authors Christos G. E. Anagnostopoulos, Konstantinos Vlachos, Anastasia Moumtzidou, Ilias Gialampoukidis and Stefanos Vrochidis were employed by the company CDXi Solutions P.C. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
ACAtmospheric Correction
CORALCorrelation Alignment
DNDigital Number
EMAExponential Moving Average
FMFoundation Model
GELUGaussian Error Linear Unit
IoUIntersection Over Union
MADOSMarine Debris and Oil Spill
MARIDAMarine Debris Archive
mIoUMean Intersection Over Union
MLPMulti-Layer Perceptron
NIRNear-Infrared
NMFNon-Negative Matrix Factorisation
OAOverall Accuracy
RGBRed, Green, Blue
SAMSpectral Angle Mapper
SimMIMSimple Framework for Masked Image Modelling
SWIRShortwave Infrared
TTATest-Time Augmentation
UMAPUniform Manifold Approximation and Projection
VSCPVery Simple Copy–Paste

Appendix A

This appendix reports the per-class IoU on the 728-patch MADOS test set for every configuration evaluated in this study. Table A1 presents a compact comparison across ten headline configurations selected to support the main text claims. Table A2, Table A3, Table A4, Table A5 and Table A6 provide the complete per-class breakdown for all configurations across the six experimental blocks (A, B, C, D, H, P), which are organised by block to support direct cross-referencing with Table 5, Table 6, Table 7, Table 8, Table 9 and Table 10. All values are means over two random seeds (0 and 1) except for the block H rows, wherein each seed is reported separately.
Two general patterns are visible across the full set. First, the dominant water classes achieve high IoU under almost every configuration and contribute little to differences observed in the aggregate mIoU. The rare classes (Natural Organic Material, Jellyfish, Sea Snot, foam) carry the substantive across-configuration variation. Second, several aggregate-equivalent configurations produce strikingly different per-class profiles (most clearly the B1 versus B2 pair), reinforcing Section 4.4.1’s finding that input normalisation reroutes the encoder’s decision boundaries when its aggregate accuracy is similar.
Class abbreviations used in the following tables: MD (Marine Debris), DSg (Dense Sargassum), SFA (Sparse Floating Algae), NOM (Natural Organic Material), Sh (Ship), OS (oil spill), MW (Marine Water), SLW (Sediment-Laden Water), Fm (foam), TW (turbid water), ShW (Shallow Water), WW (Waves and Wakes), OP (Oil Platform), Jf (Jellyfish), and SnS (Sea Snot).

Appendix A.1

Table A1. Per-class IoU (means over seeds 0 and 1) for the ten headline configurations referenced throughout the main text. Bold marks the best value per class across the ten configurations.
Table A1. Per-class IoU (means over seeds 0 and 1) for the ten headline configurations referenced throughout the main text. Bold marks the best value per class across the ten configurations.
ClassA1A2A3A4B1B2D1D2D3P1
MD0.3330.3900.3150.3010.3400.1650.3280.3390.3370.291
DSg0.6530.7350.7400.6920.7520.7740.7700.7580.7310.786
SFA0.3540.5130.5060.2520.5250.3690.5610.5100.5760.670
NOM0.0460.4840.1300.3210.1290.0550.3280.3580.5490.475
Sh0.4370.4560.4440.3630.4690.4610.4690.5040.4960.606
OS0.5750.5690.5830.5830.5990.5920.5640.5920.5670.619
MW0.7320.7060.7170.7240.7280.7280.7150.7380.7320.739
SLW0.9720.9740.9920.9920.9940.9980.9900.9510.9890.998
Fm0.3790.0920.2590.0380.0670.4660.0560.3040.0510.868
TW0.7720.7120.8090.6820.7660.8580.7400.7660.7280.847
ShW0.6700.7220.8010.7100.8010.7200.6810.8350.7260.700
WW0.4220.3450.3090.3150.3490.2820.3930.4110.3670.278
OP0.6920.6730.6900.5800.7030.6980.6830.7510.7090.787
Jf0.2840.3740.0020.2680.4850.4960.2610.3650.3850.436
SnS0.5930.8620.8030.5070.8530.7360.7560.8180.7810.842
Mean (mIoU)0.5280.5740.5400.4890.5710.5600.5530.6000.5820.663
Three observations are worth highlighting. First, P1 achieves the highest mean mIoU and wins or ties on eight of the 15 classes. B2 (Hydro normalisation) wins on turbid water (0.858) and Jellyfish (0.496). D2 retains the lead on Shallow Water (0.835). Second, the class on which configurations differ most is foam, where IoU ranges from 0.038 (A4) to 0.868 (P1). This reflects both the small support of the class (387 pixels in the test set) and the impact of synthetic minority augmentation in the P1 VSCP configuration. Third, A3 wins on no individual class despite reaching an aggregate mIoU of 0.540, and its near-zero IoU on Jellyfish (0.002) illustrates that partial encoder unfreezing under limited target data can produce per-class collapse that is hidden by macro-averaging, an outcome that none of the frozen encoder configurations exhibits.

Appendix A.2

Table A2, Table A3, Table A4, Table A5 and Table A6 report the per-class IoU for every configuration evaluated in this study. Configurations are grouped by experimental block. Rows within a block follow the order in which the configuration is introduced in Section 3.6. Class names are abbreviated in column headers. The full names and the abbreviation key are given below. To accommodate the full width on a page, values are reported to two decimal places in Table A2, Table A3, Table A4, Table A5 and Table A6. Three decimal-place precision is preserved in the headline of Table A1 above and in the main text tables.
Table A2. Per-class IoU for blocks A and B (encoder transfer modes and normalisation strategies). All values are means over seeds 0 and 1. Bold marks the best value per column within this table.
Table A2. Per-class IoU for blocks A and B (encoder transfer modes and normalisation strategies). All values are means over seeds 0 and 1. Bold marks the best value per column within this table.
ConfigurationMDDSgSFANOMShOSMWSLWFmTWShWWWOPJfSnSmIoU
A10.330.650.350.050.440.570.730.970.380.770.670.420.690.280.590.53
A20.390.730.510.480.460.570.710.970.090.710.720.340.670.370.860.57
A30.320.740.510.130.440.580.720.990.260.810.800.310.690.000.800.54
A40.300.690.250.320.360.580.720.990.040.680.710.320.580.270.510.49
B10.340.750.530.130.470.600.730.990.070.770.800.350.700.480.850.57
B20.170.770.370.060.460.590.731.000.470.860.720.280.700.500.740.56
B30.130.390.500.280.350.640.810.860.660.630.520.320.640.000.450.48
B40.150.530.220.000.360.420.680.900.480.680.560.090.550.000.440.40
B50.130.510.150.000.330.420.680.920.540.680.460.080.490.000.400.39
A10.330.650.350.050.440.570.730.970.380.770.670.420.690.280.590.53
A20.390.730.510.480.460.570.710.970.090.710.720.340.670.370.860.57
Block A confirms Section 4.1’s mIoU ranking (A2 > A3 > A1 > A4) but exposes per-class structure. A3 dominates Sediment-Laden Water (0.992), turbid water (0.809), and Shallow Water (0.801) within block A yet collapses on Jellyfish (0.002). A4 (full fine-tuning) is the weakest configuration overall and loses to A1 (random and full fine-tuning) on nine of the 15 classes, a signature of catastrophic forgetting on a small target set. Block B reveals the per-class trade-off between MADOS and Hydro normalisation. B1 wins on six classes while B2 wins on four. The patch z-score variant B3 produces an unusually high IoU on oil spill (0.643) and Marine Water (0.814) at the cost of complete failure on Jellyfish, indicating that per-patch standardisation routes the model towards dominant-class predictions. The synthesised distribution strategies B4 and B5 are the only block B configurations that fail to learn at least one class entirely (Natural Organic Material, Jellyfish).
Table A3. Per-class IoU for block C (perturbation robustness, applied to the B1 checkpoint at test time). All values are means over seeds 0 and 1. Bold marks the best value per column.
Table A3. Per-class IoU for block C (perturbation robustness, applied to the B1 checkpoint at test time). All values are means over seeds 0 and 1. Bold marks the best value per column.
ConfigurationMDDSgSFANOMShOSMWSLWFmTWShWWWOPJfSnSmIoU
C1 clean0.340.750.530.130.470.600.730.990.070.770.800.350.700.480.850.57
C2 gain 0.950.340.770.570.170.480.590.730.990.070.790.840.350.730.530.850.59
C2 gain 1.050.340.730.470.120.450.600.710.990.070.730.760.350.660.390.860.55
C3 bias −0.0050.260.710.560.250.440.590.730.990.050.760.840.310.640.630.840.57
C3 bias +0.0050.380.740.460.060.420.610.750.990.080.790.740.360.700.310.810.55
C4 noise σ = 0.0050.160.770.410.130.460.470.540.990.050.730.710.190.690.430.860.51
C5 wrong normalisation0.000.000.000.000.190.340.390.260.000.350.110.040.000.000.010.11
The per-class breakdown sharpens Section 4.3.2’s finding that wrong normalisation (C5) is qualitatively different from the radiometric perturbations. Multiplicative gain, additive bias, and Gaussian noise produce per-class IoU profiles that remain qualitatively similar to the clean condition (C1), with the largest individual-class drops appearing on Sea Snot, Marine Water, and Jellyfish under the noise perturbation. The wrong-normalisation condition (C5), by contrast, drives ten of the fifteen classes to exactly zero IoU. The model produces no correct predictions for Marine Debris, Dense Sargassum, Sparse Floating Algae, Natural Organic Material, foam, Oil Platform, Jellyfish, and Sea Snot. Partial recall is preserved only for Ship, oil spill, Marine Water, Sediment-Laden Water, turbid water, Shallow Water, and Waves and Wakes. This is consistent with a complete reorganisation of the decoder’s decision geometry rather than a graceful degradation.
Table A4. Per-class IoU for block D (band adaptation strategies) and the D2 ceiling framework. All values are means over seeds 0 and 1. Bold marks the best value per column.
Table A4. Per-class IoU for block D (band adaptation strategies) and the D2 ceiling framework. All values are means over seeds 0 and 1. Bold marks the best value per column.
ConfigurationMDDSgSFANOMShOSMWSLWFmTWShWWWOPJfSnSmIoU
D10.330.770.560.330.470.560.710.990.060.740.680.390.680.260.760.55
D20.340.760.510.360.500.590.740.950.300.770.830.410.750.360.820.60
D30.340.730.580.550.500.570.730.990.050.730.730.370.710.390.780.58
D40.360.790.640.330.460.590.730.940.340.720.710.330.680.180.840.57
D50.270.780.560.070.330.530.730.940.600.700.550.260.490.140.670.51
D2 ceiling0.440.800.730.380.530.580.730.990.040.710.770.400.740.340.810.60
The D2 ceiling framework (D2 + VSCP + EMA + TTA) matches D2 in aggregate mIoU (0.600 versus 0.600) but reorganises its per-class profile. It gains on Marine Debris (0.444 versus 0.339), Sparse Floating Algae (0.731 versus 0.510), and Ship (0.527 versus 0.504), and loses on foam (0.040 versus 0.304). The fact that the ceiling does not lift the aggregate is informative. Under the D2 band adaptation, the available headroom from augmentation and EMA is consumed by per-class rebalancing rather than by a uniform accuracy gain. The MLP adapter D5 produces an outlier per-class profile, with foam at 0.602 mIoU (highest in block D) but Natural Organic Material at 0.065 and Oil Platform at 0.494 mIoU (both lowest).
Table A5. Per-class IoU for block H (label-free harmonisation transforms). Each row trains a model from scratch on the D2 architecture with the harmoniser substituted for MADOS z-score. The baseline rows retain MADOS z-score. Block H runs were exported per seed. Both seed 0 and 1 values are shown. Bold marks the best value per column.
Table A5. Per-class IoU for block H (label-free harmonisation transforms). Each row trains a model from scratch on the D2 architecture with the harmoniser substituted for MADOS z-score. The baseline rows retain MADOS z-score. Block H runs were exported per seed. Both seed 0 and 1 values are shown. Bold marks the best value per column.
ConfigurationMDDSgSFANOMShOSMWSLWFmTWShWWWOPJfSnSmIoU
Baseline (no transform), seed 00.320.770.500.080.460.590.730.970.070.730.790.450.660.440.630.55
Baseline (no transform), seed 10.320.760.550.480.540.580.730.980.060.770.740.270.750.470.780.59
H1 percentile + re-standardisation, seed 00.320.730.620.010.200.580.730.970.160.730.680.360.710.320.550.51
H1 percentile + re-standardisation, seed 10.390.710.650.050.440.530.680.960.110.680.560.290.770.360.540.52
H2 diagonal CORAL, seed 00.160.560.160.010.340.480.740.920.590.650.500.100.520.000.510.42
H2 diagonal CORAL, seed 10.140.320.240.000.350.430.680.920.640.670.560.070.540.000.470.40
The H1–H3 transforms produce qualitatively different failure modes that the aggregate Table 10 numbers conceal. H1 retains the same overall structure as the baseline but loses heavily on Natural Organic Material (0.01–0.05 versus 0.08–0.48 for the baseline) and on Ship (0.20–0.44 versus 0.46–0.54). H2 and H3 systematically improve foam (0.59–0.64 and 0.29–0.40 versus 0.06–0.07 in the baseline) by re-routing weight onto SWIR-distinctive classes, but at the cost of complete failure on Jellyfish across both seeds. H3 further loses heavily on the smaller-area classes (Marine Debris, Sparse Floating Algae, Waves and Wakes). These per-class profiles indicate that the label-free transforms partially correct in the direction of Hydro reflectance space but introduce class-specific failures that do not appear when the matched MADOS z-score is retained.
Table A6. Per-class IoU for the partially unfrozen extension framework (block P, configurations P1–P4). All values are means over seeds 0 and 1. Bold marks the best value per column.
Table A6. Per-class IoU for the partially unfrozen extension framework (block P, configurations P1–P4). All values are means over seeds 0 and 1. Bold marks the best value per column.
ConfigurationMDDSgSFANOMShOSMWSLWFmTWShWWWOPJfSnSmIoU
P1 partial0.290.790.670.470.610.620.741.000.870.850.700.280.790.440.840.66
P2 partial0.410.770.690.440.420.590.730.990.060.690.810.440.750.350.700.59
P3 partial0.290.790.710.420.620.600.731.000.720.870.760.310.820.400.860.66
P4 partial0.290.820.700.270.520.580.721.000.400.810.650.250.770.270.850.59
Block P presents the four partially unfrozen extension framework configurations. P1 and P3 (with Hydro normalisation and the D3 adapter) reach the highest aggregate mIoU in this study (0.663 and 0.662, respectively). P2 (MADOS normalisation, D2 adapter) and P4 (Hydro, D3, no EMA, no TTA) reach lower aggregates (0.590 and 0.593). The foam class produces the largest within-block spread, from 0.06 (P2 partial) to 0.87 (P1 partial), reflecting the strong sensitivity of small-support classes to the specific choice of normalisation, adapter, and EMA configuration. The pair-wise comparisons against the frozen mirror counterparts are reported in Table A7.
Table A7. Aggregate comparisons between the partially unfrozen and frozen mirror variants of each block P configuration. All values are means and standard deviations computed over seeds 0 and 1. The Δ mIoU column reports frozen mirror minus partial unfreezing.
Table A7. Aggregate comparisons between the partially unfrozen and frozen mirror variants of each block P configuration. All values are means and standard deviations computed over seeds 0 and 1. The Δ mIoU column reports frozen mirror minus partial unfreezing.
ConfigurationmIoU ± σ Macro F1 ± σ OA ± σ Δ mIoU (FM−P)
P1 (Hydro + D3 + VSCP + EMA + TTA, unfreeze ep. 40)
P1 partial0.663 ± 0.0070.775 ± 0.0060.871 ± 0.002
P1 frozen mirror0.660 ± 0.0240.772 ± 0.0200.867 ± 0.010−0.003
P2 (MADOS + D2 + VSCP + EMA + TTA, unfreeze ep. 40)
P2 partial0.590 ± 0.0200.710 ± 0.0200.850 ± 0.001
P2 frozen mirror0.611 ± 0.0140.726 ± 0.0130.848 ± 0.009+0.022
P3 (Hydro + D3 + VSCP + EMA + TTA, unfreeze ep. 25)
P3 partial0.662 ± 0.0480.772 ± 0.0400.871 ± 0.002
P3 frozen mirror0.631 ± 0.0270.746 ± 0.0270.869 ± 0.004−0.031
P4 (Hydro + D3 + VSCP, no EMA, no TTA, unfreeze ep. 40)
P4 partial0.593 ± 0.0530.704 ± 0.0440.854 ± 0.019
P4 frozen mirror0.620 ± 0.0180.731 ± 0.0120.871 ± 0.001+0.027
Two patterns are visible in the aggregate comparison. First, the frozen mirror clearly exceeds the partial variant for P2 ( Δ = +0.022) and P4 ( Δ = +0.027), with both Δ values larger than the standard deviation of either matched variant. Second, the partial variant marginally beats the frozen mirror for P1 ( Δ = −0.003) and beats it more substantially for P3 ( Δ = −0.031). The P1 difference is small relative to either variant’s standard deviation ( σ = 0.007 for partial, σ = 0.024 for frozen mirror) and should be regarded as a tie. The P3 difference (0.031) is comparable to the partial variant standard deviation ( σ = 0.048), so it is also within seed variability rather than a reliable advantage. The macro F1 and overall accuracy columns reproduce the mIoU ordering in every case, indicating that the conclusions drawn from mIoU alone are not artefacts of the chosen aggregate metric.

Appendix B

This appendix reports the confusion behaviour of every configuration evaluated in this study. Appendix B.1 reports the Oil Spill versus Marine Water submatrix (the main source of segmentation error in MADOS) across all 25 configurations for which 15-class confusion matrices were computed. Appendix B.2 reports the full 15 × 15 confusion matrix of the D2 configuration (referenced in Section 5.6 of the main text) as the headline confusion analysis. Appendix B.3 reports the full 15 × 15 matrix of the C5 wrong normalisation condition, which illustrates the failure mode underlying the order-of-magnitude mIoU drop reported in Section 4.3.2. All values are row-normalised percentages averaged over seeds 0 and 1 (block H configurations are averaged across the seed-separated runs).

Appendix B.1

Table A8 reports four quantities for every configuration whose 15-class confusion matrix was computed: the recall of oil spill, the percentage of oil spill pixels misclassified as Marine Water (Oil-to-Marine), the percentage Marine Water misclassified as oil spill (Marine-to-Oil), and the recall of Marine Water. The published MariNeXt confusion [20] reports Oil-to-Marine at 28.30%, which serves as the comparator.
Table A8. Oil spill versus Marine Water confusion (row-normalised percentages, means over seeds 0 and 1), reporting the lowest Oil-to-Marine within each block. Bold marks the lowest Oil-to-Marine value within each block.
Table A8. Oil spill versus Marine Water confusion (row-normalised percentages, means over seeds 0 and 1), reporting the lowest Oil-to-Marine within each block. Bold marks the lowest Oil-to-Marine value within each block.
ConfigurationOil Spill Recall (%)Oil-to-Marine Water (%)Marine Water-to-Oil (%)Marine Water Recall (%)
A190.107.7019.7576.15
A294.354.6522.8072.95
A393.904.4521.4574.15
A490.855.1020.1074.65
B194.453.3020.4574.55
B293.452.7519.7574.15
B392.153.5512.3583.50
B466.6029.6517.8077.00
B566.4029.7019.8576.75
C1 clean94.453.3020.4574.55
C2 gain 0.9592.954.5020.0575.70
C2 gain 1.0595.602.3521.0572.75
C3 bias −0.00591.454.0020.0575.40
C3 bias +0.00595.602.9020.0076.35
C4 noise σ = 0.00590.853.3533.3055.15
C5 wrong normalisation96.053.3055.9544.05
D191.707.0021.8074.60
D292.305.3019.8076.25
D391.206.5020.9076.15
D493.553.9020.6574.75
D582.057.7519.6576.60
H baseline91.993.5720.0474.66
H1 percentile90.625.1521.9673.15
H2 CORAL62.9832.7612.5282.19
H3 patch affine43.6251.355.6789.82
MariNeXt [20]70.6028.302.6095.70
The full table strengthens Section 5.6’s finding. Across all 25 trained configurations, the no-Hydro frozen variant exceeds 8% of the Oil-to-Marine confusion. The published MariNeXt 28.30% is exceeded only by blocks B4 and B5 (the synthetic distribution normalisations that fail to learn properly), as well as the H2 and H3 harmonisation transforms (which oversupress oil spill in favour of Marine Water). The lowest Oil-to-Marine value appears under B2 (2.75%) with Hydro normalisation. The C2 gain of 1.05 perturbation produces a similarly low value (2.35%) by sharpening oil spill recall at the cost of a small Marine Water drop. The Marine-to-Oil column behaves differently. The lowest values appear in conditions that overpredict Marine Water (H3, B3, C5), trading off in the opposite direction. The asymmetric confusion structure documented for D2 in Section 5.6 is therefore not specific to D2. It is the residual confusion pattern that every successful configuration in this study shares.

Appendix B.2

Table A9 reports the complete 15 × 15 confusion matrix of the D2 configuration. Rows are ground-truth class labels. Columns are predicted labels. Diagonal entries (per-class recall) are shown in bold. The matrix is row-normalised. Rows sum to approximately 100%, subject to rounding.
Table A9. Confusion matrix of the D2 configuration on the MADOS test set (row-normalised percentages, means over seeds 0 and 1). Bold marks the diagonal (correctly classified) entries.
Table A9. Confusion matrix of the D2 configuration on the MADOS test set (row-normalised percentages, means over seeds 0 and 1). Bold marks the diagonal (correctly classified) entries.
GT\PredMDDSgSFANOMShOSMWSLWFmTWShWWWOPJfSnSRecall
MD75.050.001.701.4011.900.455.550.000.250.200.003.450.000.000.0075.05
DSg0.1592.606.600.400.000.000.000.000.000.000.000.000.000.000.3592.60
SFA21.2516.4555.000.900.001.303.850.000.000.000.000.150.000.001.0555.00
NOM20.302.902.2040.4528.600.004.150.000.000.900.000.550.000.000.0040.45
Sh1.350.000.000.0062.850.350.150.200.000.750.001.8030.052.550.1062.85
OS0.100.000.000.000.2592.305.300.000.000.150.501.350.050.000.0092.30
MW0.100.000.000.000.0019.8076.250.000.002.050.201.600.000.000.0076.25
SLW0.000.000.000.000.000.000.00100.000.000.000.000.000.000.000.00100.00
Fm0.150.000.000.001.400.000.150.0086.052.050.0010.200.000.000.0086.05
TW0.000.000.000.000.000.001.7511.652.6082.351.450.200.000.000.0082.35
ShW0.000.000.000.000.053.550.350.000.401.3592.901.400.000.000.0092.90
WW2.350.000.000.003.108.5516.300.000.002.654.5562.450.000.000.0062.45
OP0.000.000.000.005.951.200.150.000.000.000.000.1592.550.000.0092.55
Jf3.100.000.000.003.1043.600.000.000.000.000.000.002.9047.250.0047.25
SnS15.500.000.000.000.050.500.000.000.000.000.001.050.050.0082.8082.80
Beyond the oil spill–Marine Water boundary, two further structural patterns emerge. First, Ship is heavily confused with Oil Platform (30.05%), reflecting the shared structural and spectral signatures of small metallic targets at the 10 m Sentinel-2 resolution. Second, Jellyfish is confused with oil spill (43.60%) more frequently than it is correctly classified (47.25%). The two classes share a similar surface signature and tend to be small relative to the patch. Sea Snot is confused with Marine Debris (15.50%), consistent with their visual similarity as floating organic material. These three confusions (Ship-to-Oil Platform, Jellyfish-to-oil spill, Sea Snot-to-Marine Debris) are not unique to D2 and persist across the headline configurations in this study.

Appendix B.3

Table A10 reports the complete 15 × 15 confusion matrix of the C5 condition (B1 checkpoint evaluated with Hydro normalisation statistics at test time). This matrix illustrates the failure mode underlying the order-of-magnitude mIoU drop reported in Section 4.3.2 (0.571 to 0.113). The diagonal entries are bolded.
Table A10. Confusion matrix of the C5 configuration on the MADOS test set (row-normalised percentages, means over seeds 0 and 1). Bold marks the diagonal (correctly classified) entries.
Table A10. Confusion matrix of the C5 configuration on the MADOS test set (row-normalised percentages, means over seeds 0 and 1). Bold marks the diagonal (correctly classified) entries.
GT\PredMDDSgSFANOMShOSMWSLWFmTWShWWWOPJfSnSRecall
MD0.000.000.000.005.4054.0536.050.000.000.200.004.350.000.000.000.00
DSg42.400.000.000.000.0045.350.350.000.000.000.000.000.000.0011.900.00
SFA0.100.000.000.000.0064.1535.700.000.000.000.000.000.000.000.050.00
NOM0.700.000.000.000.0086.709.550.000.000.000.003.050.000.000.000.00
Sh0.400.000.000.0023.4015.154.850.000.000.750.0055.450.000.000.0023.40
OS0.050.000.000.000.0096.053.300.000.000.000.000.650.000.000.0096.05
MW0.000.000.000.000.0055.9544.050.000.000.000.000.000.000.000.0044.05
SLW0.000.000.000.000.003.650.0025.850.0570.450.000.000.000.000.0025.85
Fm0.000.000.000.001.401.304.900.000.0040.300.0052.100.000.000.000.00
TW0.000.000.000.000.000.257.850.000.0091.850.000.000.000.000.0091.85
ShW0.000.000.000.000.001.7074.450.000.0012.2510.700.950.000.000.0010.70
WW0.000.000.000.000.1050.6039.850.000.000.750.458.300.000.000.008.30
OP0.000.000.000.0010.3544.951.250.000.000.000.0043.450.000.000.000.00
Jf0.000.000.000.002.0074.250.000.000.000.000.0023.700.000.000.000.00
SnS0.650.000.000.000.4575.551.100.003.250.000.0018.450.000.000.600.60
The C5 matrix reveals that wrong normalisation produces degradation. Eight classes (Marine Debris, Dense Sargassum, Sparse Floating Algae, Natural Organic Material, foam, Oil Platform, Jellyfish, and Sea Snot) have effectively zero recall (the diagonal entries are 0.00 or near it), with their mass dispersed across multiple predicted classes rather than concentrating on a single misclassification. Two classes survive with high recall but for the wrong reason. Oil spill (96.05%) and turbid water (91.85%) become attractor classes that the model overpredicts at the expense of every other category. The Marine Water row makes this explicit. In total, 55.95% of Marine Water pixels are predicted as oil spill, dropping Marine Water recall from 74.55% (clean) to 44.05%. The remaining surviving classes (Ship 23.40%, Sediment-Laden Water 25.85%, Shallow Water 10.70%, Waves and Wakes 8.30%) retain partial recall but lose most of their mass to the two attractor classes. The contrast in Table A9, in which D2 achieves 75–100% recall on most classes, illustrates that the wrong normalisation failure mode is qualitatively distinct from the per-class trade-offs visible elsewhere in this Appendix. The decoder’s decision geometry collapses onto a small set of dominant predictions instead of degrading uniformly.

Appendix C

This appendix describes the three label-free harmonisation transforms referenced in Section 3.6.3 and Section 4.3.2. Each transform replaces the per-band MADOS z-score in the input pipeline. The “baseline” row in Table 10 uses the same architecture with the MADOS z-score retained. The four rows of block H therefore differ only in this input normalisation. Pixels with non-finite reflectance are excluded from every fitting step, and the numerical floor ε = 10−7 is applied to all denominators. The notation in this Appendix uses μ M ( c ) , σ M ( c ) for the MADOS train split per-band mean and standard deviation, and μ H ( c ) , σ H ( c ) for the corresponding Hydro pretraining statistics.

Appendix C.1

H1 replaces the per-band z-score with a percentile-based stretch followed by an additive re-standardisation. The second and 98th percentiles of each band, q { 0.02 } ( c ) and q { 0.98 } ( c ) , are estimated from a stratified random sample of 1024 finite pixels per patch over the MADOS training split with a fixed seed. Each input pixel is linearly mapped from the per-band percentile range into [0, 1] and clipped to that interval. The clipped values are then re-standardised using their post-clip empirical mean and standard deviation, yielding a zero-mean, unit-variance output. The intent of the clip step is to bound the influence of outlier pixels (clouds, sun glint, saturated pixels) without discarding them, while the re-standardisation keeps the output compatible with the per-band z-score setting expected by the encoder. H1 has 44 fitted scalars (four per band).

Appendix C.2

H2 aligns the per-band mean and standard deviation of the MADOS train distribution to those of the Hydro pretraining distribution through a band-diagonal affine map. For each band c , the gain is a c = σ H ( c ) σ M ( c ) and the bias is b c = μ H c a ( c ) · μ M ( c ) . The transform is x = a c + b ( c ) applied independently to each band. By construction, the output has the per-band mean and standard deviation of the Hydro distribution. The output lives in the raw Hydro reflectance space (no further standardisation is applied, because the downstream encoder was pretrained to consume that space directly). This is the diagonal restriction of CORAL [30]. The full recolouring transform reduces to per-band gains when off-diagonal covariances are unavailable, which is the case here because the full Hydro covariance is not redistributed with the pretrained checkpoint. H2 has 22 fitted scalars.

Appendix C.3

H3 replaces the dataset-global gain and bias of H2 with a per-patch calibration, recomputed for every input image. For each input and each band, the patch median and interquartile range (IQR) are computed over the finite pixels of that band. The target median and interquartile range are taken from the Hydro pretraining statistics, with the IQR computed via the Gaussian identity I Q R = 1.349 · σ H ( c ) . The per-patch gain and bias are then set so that, in the unconstrained case, the post-transform scene median and IQR would match the Hydro targets. To prevent overcorrection on patches dominated by a single feature, the gain is clipped to the interval [ 0.8 ,   1.2 ] and the bias is clipped to [ 0.25 · r c ,   + 0.25 · r c ] , where r ( c ) is the Hydro target IQR. H3 stores 44 fitted scalars and four hyperparameters. The per-image gain and bias are recomputed at inference.

Appendix D

Table A11 reports the Hydro pretraining normalisation constants, as released in the project configuration file [7], in raw Sentinel-2 Level-2A-scaled reflectance digital counts. Division by 10,000 reproduces the reflectance-scale values reported in Table 1 of the main text. The B09 row is reported for completeness. B09 is absent from the MADOS dataset and is dropped at the band adaptation stage in this study (Section 3.4).
Table A11. Hydro pretraining normalisation constants in raw Level-2A digital counts.
Table A11. Hydro pretraining normalisation constants in raw Level-2A digital counts.
Band μ H y d r o (DN) σ H y d r o (DN)
B01340.77554.81
B02429.94572.42
B03614.22582.88
B04590.24675.89
B05950.68729.90
B061792.461096.01
B072075.471273.45
B082218.951365.46
B8A2266.461356.14
B092246.061302.33
B111594.431079.19
B121009.33818.87

Appendix E

Figure A1 reports validation mIoU as a function of training epochs for five configurations: A1 (random initialisation, full fine-tuning), A2 (Hydro encoder, frozen), A3 (Hydro encoder, partial unfreezing from epoch 1), A4 (Hydro encoder, full fine-tune), and D2 (Hydro encoder, frozen, Frobenius-matched crop). Three trajectory patterns are visible.
First, the two frozen configurations (A2, D2) reach the plateau region earliest and exhibit the lowest cross-seed dispersion. This is consistent with the low inter-seed variance reported for these configurations in Table 6 and Table 7. Second, full fine-tuning (A4) plateaus at a lower mIoU than every other configuration and shows the largest epoch-to-epoch oscillations, consistent with the framing of Section 5.3, in which gradients flowing through the 87.9-million-parameter encoder under 1433 training patches are noisy enough to overwrite pretrained structures. Third, the random initialisation baseline (A1) and the partially unfrozen configuration (A3) follow intermediate trajectories that converge toward the frozen configurations, but do not exceed them. The step in the learning rate schedule at epoch 45 is followed by a reduction in oscillation amplitude for all configurations and confirms that the multistep decay successfully stabilises the late training setting.
The choice of 80 epochs for training is sufficient for every configuration to enter a plateau before the run terminates. No configuration shows a sustained upward trend during the final 15 epochs, indicating that additional training would not materially change the reported results.
Figure A1. Validation mIoU versus epochs for A1, A2, A3, A4, and D2. Solid lines represent the means over seeds and shaded bands for ±σ.
Figure A1. Validation mIoU versus epochs for A1, A2, A3, A4, and D2. Solid lines represent the means over seeds and shaded bands for ±σ.
Remotesensing 18 02905 g0a1

Appendix F

Figure A2 visualises the distribution of per-filter Frobenius norms in the patch-embedded convolution of the Swin Transformer V2 Base encoder under three conditions: the original 12-band pretrained weights, the 11-band weights produced by direct column crop of the B09 band (D1), and the 11-band weights produced by the Frobenius-matched crop (D2).
Two quantitative observations follow from the figure. First, the median per-filter Frobenius norm is 0.421 under both the original 12-band pretrained weights and the D2-adapted 11-band weights, while D1 produces a systematically smaller median of 0.395. The full distribution under D2 reproduces the location and spread of the original pretrained distribution, whereas the D1 distribution is shifted toward smaller norms and is narrower. Second, the side panel shows the per-band L2 contributions to the filter norm for the original 12-band weights. The B09 band, which is the band dropped during the transfer to MADOS, contributes approximately 11.9% of the per-filter energy in the pretrained patch embedding. Removing this column without rescaling therefore removes a substantial and non-trivial fraction of the per-filter activation magnitude, propagating as a distributional shift through the layer normalisation and self-attention blocks downstream. The Frobenius rescaling in D2 restores the per-filter norm to the original 12-band setting without modifying the pretrained mapping for the 11 shared bands.
Figure A2. Violin plot of per-filter Frobenius norms for the 128 filters under D1 (b), D2 (c), and the original 12-band pretrained weights (a). Side panels present per-band L2 contributions to the norm.
Figure A2. Violin plot of per-filter Frobenius norms for the 128 filters under D1 (b), D2 (c), and the original 12-band pretrained weights (a). Side panels present per-band L2 contributions to the norm.
Remotesensing 18 02905 g0a2

Appendix G

Figure A3 presents qualitative segmentation outputs for representative test patches (oil spill, Sediment-Laden Water, turbid water) drawn from the two latent radiometric settings identified in Section 4.5. Each row shows the input RGB composite, the MADOS ground-truth annotation (unannotated pixels in grey), and the predictions of six configurations: A1 (random, full fine-tune), A2 (Hydro, frozen encoder, no adapter), D2 (Hydro, frozen encoder, Frobenius-matched crop), P1 (D2 with VSCP, EMA, TTA), MariNeXt, and MariNeXt with enhancements (VSCP, EMA, TTA). Three patterns are visible.
First, the comparison between A2 and D2 shows the visual signature of the magnitude-compensation effect quantified in Section 5.2. On the oil spill patches, A2 overpredicts the oil spill class along the spill margin and into the surrounding Marine Water, produced extended halos that are absent from the ground truth. D2 recovers a tighter, more localised footprint on the same patches without losing the spill body. Both configurations use the same frozen pretrained encoder and the same MADOS normalisation. The only difference is the per-filter Frobenius rescaling applied in D2. The reduction in oil spill area is consistent with the 4.7 percentage point mIoU gain of D2 over D1 reported in Table 7.
Second, the comparison between D2 and MariNeXt sharpens the confusion matrix analysis in Section 5.6 and Appendix B.2. On the oil spill patches, the published MariNeXt configuration tends to fragment and under-predict the spill body, with several detached predicted segments inside what the ground truth annotates as a single continuous oil feature. D2 produces a more contiguous prediction on the same patches. This is the qualitative counterpart of the reduction in Oil-to-Marine Water confusion from 28.30% for the published MariNeXt to 5.30% for D2, documented in Table A8. P1 further smooths the prediction boundaries without changing the qualitative outcome. Third, on the Sediment-Laden Water and turbid water patches, every configuration converges on the correct dominant class label across the full patch, which is consistent with the near-perfect per-class IoU on these classes in Table A1, and confirms that the configuration differences are concentrated on oil spill and the rarer minority classes rather than on the dominant water categories.
Figure A3. Segmentation predictions from modelling configurations: A1 (random, full fine-tuning), A2 (Hydro, frozen encoder, no adapter), D2 (Hydro, frozen encoder, Frobenius-matched crop), P1 (D2 with VSCP, EMA, TTA), MariNeXt, and MariNeXt with enhancements (VSCP, EMA, TTA).
Figure A3. Segmentation predictions from modelling configurations: A1 (random, full fine-tuning), A2 (Hydro, frozen encoder, no adapter), D2 (Hydro, frozen encoder, Frobenius-matched crop), P1 (D2 with VSCP, EMA, TTA), MariNeXt, and MariNeXt with enhancements (VSCP, EMA, TTA).
Remotesensing 18 02905 g0a3

Appendix H

Table A12 covers the controlled-condition configurations of blocks A, B, C and D, in which preprocessing is the only factor varied and no augmented training is applied. The block P extension frameworks combine preprocessing choices with VSCP, exponential moving averaging, and test-time augmentation, and are therefore not directly comparable under a single evaluation protocol; they are discussed separately in Section 4.1 and Section 5.6. Because test patches drawn from a single Sentinel-2 acquisition are spatially autocorrelated, uncertainty was estimated by resampling at the level of the parent scene rather than the patch or pixel. The 42 test scenes were verified to be disjointed from the training and validation partitions (Section 5.7). For each configuration and seed, a per-scene confusion matrix was accumulated over the test split; the per-seed matrices were then treated as a single pool of scene-level units. Each of the 10,000 bootstrap iterations draws that number of units with replacement, sums the drawn confusion matrices, and recomputes mIoU under the reduction defined in Section 3.6.5. Because mIoU is a ratio of accumulated counts, pooling scenes across seeds before computing the metric is not equivalent to averaging per-seed mIoU values; intervals are therefore reported for the mean-over-seed statistic used in the main text, and the pooled-estimator intervals are available in the accompanying data.
Two features of the table bear on the interpretation of the main results. First, the bootstrap standard error exceeds the cross-seed standard deviation in eleven of the twelve configurations by factors ranging between 1.14 and 12.89, and is within three per cent of this in the twelfth (D3). Uncertainty attributable to test-set sampling is therefore comparable to or larger than uncertainty attributable to training stochasticity throughout, and the precision of the estimates reported in this study is limited principally by the number of independent test scenes. Second, the intervals for the two mismatch configurations (C5 and C6) are disjointed from those of every matched configuration by a wide margin, so the normalisation mismatch result is not sensitive to which scenes happen to fall in the test partition.
Table A12. Scene-level bootstrap confidence intervals for the headline configurations. The 42 test scenes are resampled with replacement over 10,000 iterations; per-scene confusion matrices are summed within each resample and mIoU recomputed. Intervals are given for the mean-over-seed statistics reported in the main text. SE denotes the bootstrap standard error, and Ratio denotes its quotient with the cross-seed standard deviation.
Table A12. Scene-level bootstrap confidence intervals for the headline configurations. The 42 test scenes are resampled with replacement over 10,000 iterations; per-scene confusion matrices are summed within each resample and mIoU recomputed. Intervals are given for the mean-over-seed statistics reported in the main text. SE denotes the bootstrap standard error, and Ratio denotes its quotient with the cross-seed standard deviation.
ConfigurationmIoUσ (Seeds)95% CI (Scenes)SE (Scenes)Ratio
A1 (from scratch, full FT)0.5270.030[0.447, 0.617]0.0431.42
A2 (frozen)0.5740.005[0.478, 0.650]0.0448.34
A3 (partial unfreezing)0.5400.022[0.463, 0.621]0.0401.78
A4 (full fine-tuning)0.4890.037[0.426, 0.591]0.0421.14
B1 (MADOS z-score)0.5710.016[0.477, 0.671]0.0503.17
B2 (Hydro z-score)0.5600.027[0.473, 0.617]0.0371.37
D1 (direct crop)0.5530.034[0.469, 0.641]0.0441.29
D2 (Frobenius-matched)0.6000.004[0.504, 0.682]0.04512.89
D3 (linear adapter)0.5820.043[0.494, 0.656]0.0420.97
D5 (MLP adapter)0.5090.038[0.409, 0.601]0.0491.28
C5 (forward mismatch)0.1130.009[0.088, 0.145]0.0151.65
C6 (reverse mismatch)0.2410.006[0.189, 0.271]0.0213.38

References

  1. Cong, Y.; Khanna, S.; Meng, C.; Liu, P.; Rozi, E.; He, Y.; Burke, M.; Lobell, D.B.; Ermon, S. SatMAE: Pre-Training Transformers for Temporal and Multi-Spectral Satellite Imagery. In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS 2022), New Orleans, LA, USA, 28 November–9 December 2022. [Google Scholar]
  2. Jakubik, J.; Roy, S.; Phillips, C.E.; Fraccaro, P.; Godwin, D.; Zadrozny, B.; Szwarcman, D.; Gomes, C.; Nyirjesy, G.; Edwards, B.; et al. Foundation Models for Generalist Geospatial Artificial Intelligence. arXiv 2023, arXiv:2310.18660. [Google Scholar] [CrossRef] [Scilit]
  3. Szwarcman, D.; Roy, S.; Fraccaro, P.; Gislason, T.E.; Blumenstiel, B.; Ghosal, R.; de Oliveira, P.H.; de Sousa Almeida, J.L.; Sedona, R.; Kang, Y.; et al. Prithvi-EO-2.0: A Versatile Multitemporal Foundation Model for Earth Observation Applications. IEEE Trans. Geosci. Remote Sens. 2026, 64, 4400120. [Google Scholar] [CrossRef] [Scilit]
  4. Guo, X.; Lao, J.; Dang, B.; Zhang, Y.; Yu, L.; Ru, L.; Zhong, L.; Huang, Z.; Wu, K.; Hu, D.; et al. SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagery. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 17–21 June 2024; pp. 27672–27683. [Google Scholar]
  5. Clay Foundation. Clay Foundation Model: An Open Source AI Foundation Model for Earth. Available online: https://github.com/Clay-foundation/model (accessed on 1 June 2026).
  6. Hong, D.; Zhang, B.; Li, X.; Li, Y.; Li, C.; Yao, J.; Yokoya, N.; Li, H.; Ghamisi, P.; Jia, X.; et al. SpectralGPT: Spectral Remote Sensing Foundation Model. IEEE Trans. Pattern Anal. Mach. Intell. 2024, 46, 5227–5244. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  7. Corley, I.; Robinson, C. Hydro Foundation Model. 2024. Available online: https://github.com/isaaccorley/hydro-foundation-model (accessed on 1 June 2026).
  8. Huo, C.; Chen, K.; Zhang, S.; Wang, Z.; Yan, H.; Shen, J.; Hong, Y.; Qi, G.; Fang, H.; Wang, Z. When Remote Sensing Meets Foundation Model: A Survey and Beyond. Remote Sens. 2025, 17, 179. [Google Scholar] [CrossRef] [Scilit]
  9. Zhou, G.; Qian, L.; Gamba, P. Advances on Multimodal Remote Sensing Foundation Models for Earth Observation Downstream Tasks: A Survey. Remote Sens. 2025, 17, 3532. [Google Scholar] [CrossRef] [Scilit]
  10. Wang, Y.; Braham, N.A.A.; Xiong, Z.; Liu, C.; Albrecht, C.M.; Zhu, X.X. SSL4EO-S12: A Large-Scale Multi-Modal, Multi-Temporal Dataset for Self-Supervised Learning in Earth Observation. IEEE Geosci. Remote Sens. Mag. 2023, 11, 98–106. [Google Scholar] [CrossRef] [Scilit]
  11. Vanhellemont, Q.; Ruddick, K. Atmospheric Correction of Metre-Scale Optical Satellite Data for Inland and Coastal Water Applications. Remote Sens. Environ. 2018, 216, 586–597. [Google Scholar] [CrossRef] [Scilit]
  12. Main-Knorn, M.; Pflug, B.; Louis, J.; Debaecker, V.; Müller-Wilm, U.; Gascon, F. Sen2Cor for Sentinel-2. In Proceedings of the SPIE Image and Signal Processing for Remote Sensing XXIII, Warsaw, Poland, 4 October 2017; Volume 10427, p. 1042704. [Google Scholar] [CrossRef] [Scilit]
  13. Vermote, E.; Justice, C.; Claverie, M.; Franch, B. Preliminary Analysis of the Performance of the Landsat 8/OLI Land Surface Reflectance Product. Remote Sens. Environ. 2016, 185, 46–56. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  14. Hsu, C.-Y.; Li, W.; Wang, S. Geospatial Foundation Models for Image Analysis: Evaluating and Enhancing NASA-IBM Prithvi’s Domain Adaptability. Int. J. Geogr. Inf. Sci. 2025, 39, 2096–2125. [Google Scholar] [CrossRef] [Scilit]
  15. Marti-Escofet, F.; Blumenstiel, B.; Scheibenreif, L.; Fraccaro, P.; Schindler, K. Fine-Tune Smarter, Not Harder: Parameter-Efficient Fine-Tuning for Geospatial Foundation Models. In Machine Learning and Knowledge Discovery in Databases; Ribeiro, R.P., Ed.; Research Track. ECML PKDD 2025; Lecture Notes in Computer Science; Springer: Cham, Switzerland, 2025; Volume 16018, pp. 359–375. [Google Scholar] [CrossRef] [Scilit]
  16. Al-Ruzouq, R.; Gibril, M.B.A.; Shanableh, A.; Kais, A.; Hamed, O.; Al-Mansoori, S.; Khalil, M.A. Sensors, Features, and Machine Learning for Oil Spill Detection and Monitoring: A Review. Remote Sens. 2020, 12, 3338. [Google Scholar] [CrossRef] [Scilit]
  17. Fingas, M.; Brown, C.E. A Review of Oil Spill Remote Sensing. Sensors 2018, 18, 91. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  18. Garcia-Pineda, O.; Staples, G.; Jones, C.E.; Hu, C.; Holt, B.; Kourafalou, V.; Graettinger, G.; DiPinto, L.; Ramirez, E.; Streett, D.; et al. Classification of Oil Spill by Thicknesses Using Multiple Remote Sensors. Remote Sens. Environ. 2020, 236, 111421. [Google Scholar] [CrossRef] [Scilit]
  19. Sun, S.; Hu, C.; Garcia-Pineda, O.; Kourafalou, V.; Le Hénaff, M.; Androulidakis, Y. Remote Sensing Assessment of Oil Spills near a Damaged Platform in the Gulf of Mexico. Mar. Pollut. Bull. 2018, 136, 141–151. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  20. Kikaki, K.; Kakogeorgiou, I.; Hoteit, I.; Karantzalos, K. Detecting Marine Pollutants and Sea Surface Features with Deep Learning in Sentinel-2 Imagery. ISPRS J. Photogramm. Remote Sens. 2024, 210, 39–54. [Google Scholar] [CrossRef] [Scilit]
  21. Liu, Z.; Hu, H.; Lin, Y.; Yao, Z.; Xie, Z.; Wei, Y.; Ning, J.; Cao, Y.; Zhang, Z.; Dong, L.; et al. Swin Transformer V2: Scaling Up Capacity and Resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 18–24 June 2022; pp. 12009–12019. [Google Scholar] [CrossRef] [Scilit]
  22. Xie, Z.; Zhang, Z.; Cao, Y.; Lin, Y.; Bao, J.; Yao, Z.; Dai, Q.; Hu, H. SimMIM: A Simple Framework for Masked Image Modeling. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 18–24 June 2022; pp. 9643–9653. [Google Scholar] [CrossRef] [Scilit]
  23. Kolokoussis, P.; Karathanassi, V. Oil Spill Detection and Mapping Using Sentinel 2 Imagery. J. Mar. Sci. Eng. 2018, 6, 4. [Google Scholar] [CrossRef] [Scilit]
  24. Rajendran, S.; Sadooni, F.N.; Al-Kuwari, H.-A.-S.; Oleg, A.; Govil, H.; Nasir, S.; Vethamony, P. Monitoring Oil Spill in Norilsk, Russia Using Satellite Data. Sci. Rep. 2021, 11, 3817. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  25. Kikaki, K.; Kakogeorgiou, I.; Mikeli, P.; Raitsos, D.E.; Karantzalos, K. MARIDA: A Benchmark for Marine Debris Detection from Sentinel-2 Remote Sensing Data. PLoS ONE 2022, 17, e0262247. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  26. Hu, E.J.; Shen, Y.; Wallis, P.; Allen-Zhu, Z.; Li, Y.; Wang, S.; Wang, L.; Chen, W. LoRA: Low-Rank Adaptation of Large Language Models. In Proceedings of the International Conference on Learning Representations (ICLR), Virtual, 25–29 April 2022. [Google Scholar]
  27. Jia, M.; Tang, L.; Chen, B.-C.; Cardie, C.; Belongie, S.; Hariharan, B.; Lim, S.-N. Visual Prompt Tuning. In Computer Vision—ECCV 2022; Avidan, S., Brostow, G., Cissé, M., Farinella, G.M., Hassner, T., Eds.; Lecture Notes in Computer Science; Springer: Cham, Switzerland, 2022; Volume 13693, pp. 709–727. [Google Scholar] [CrossRef] [Scilit]
  28. Houlsby, N.; Giurgiu, A.; Jastrzebski, S.; Morrone, B.; De Laroussilhe, Q.; Gesmundo, A.; Attariyan, M.; Gelly, S. Parameter-Efficient Transfer Learning for NLP. In Proceedings of the International Conference on Machine Learning (ICML), Long Beach, CA, USA, 9–15 June 2019; pp. 2790–2799. [Google Scholar]
  29. Thoreau, R.; Marsocci, V.; Derksen, D. Parameter-Efficient Adaptation of Geospatial Foundation Models through Embedding Deflection. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Honolulu, HI, USA, 19–25 October 2025. [Google Scholar] [CrossRef] [Scilit]
  30. Sun, B.; Saenko, K. Deep CORAL: Correlation Alignment for Deep Domain Adaptation. In Computer Vision—ECCV 2016 Workshops; Hua, G., Jégou, H., Eds.; Lecture Notes in Computer Science; Springer: Cham, Switzerland, 2016; Volume 9915, pp. 443–450. [Google Scholar] [CrossRef] [Scilit]
  31. Li, Y.; Wang, N.; Shi, J.; Liu, J.; Hou, X. Revisiting Batch Normalization for Practical Domain Adaptation. In Proceedings of the International Conference on Learning Representations (ICLR) Workshop, Toulon, France, 24–26 April 2017. [Google Scholar]
  32. Tuia, D.; Persello, C.; Bruzzone, L. Domain Adaptation for the Classification of Remote Sensing Data: An Overview of Recent Advances. IEEE Geosci. Remote Sens. Mag. 2016, 4, 41–57. [Google Scholar] [CrossRef] [Scilit]
  33. Geng, Z.; Guo, M.-H.; Chen, H.; Li, X.; Wei, K.; Lin, Z. Is Attention Better Than Matrix Decomposition? In Proceedings of the International Conference on Learning Representations (ICLR), Virtual, 25–29 April 2022. [Google Scholar]
  34. Breiman, L. Random Forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef] [Scilit]
  35. Zeiler, M.D.; Fergus, R. Visualizing and Understanding Convolutional Networks. In Computer Vision—ECCV 2014; Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T., Eds.; Lecture Notes in Computer Science; Springer: Cham, Switzerland, 2014; Volume 8689, pp. 818–833. [Google Scholar] [CrossRef] [Scilit]
  36. Asadzadeh, S.; de Souza Filho, C.R. Investigating the Capability of WorldView-3 Superspectral Data for Direct Hydrocarbon Detection. Remote Sens. Environ. 2016, 173, 162–173. [Google Scholar] [CrossRef] [Scilit]
Figure 1. Architecture diagram.
Figure 1. Architecture diagram.
Remotesensing 18 02905 g001
Figure 2. UMAP projection of pre-HAM decoder features (seed 0). Three panels: B1 (MADOS normalisation, no adapter), B2 (Hydro normalisation, no adapter), and D2 (MADOS normalisation, Frobenius-matched crop). Four classes are highlighted: oil spill (red), Marine Water (blue), Shallow Water (purple), Waves and Wakes (green). Axes are UMAP dimension components 1 and 2 in arbitrary units.
Figure 2. UMAP projection of pre-HAM decoder features (seed 0). Three panels: B1 (MADOS normalisation, no adapter), B2 (Hydro normalisation, no adapter), and D2 (MADOS normalisation, Frobenius-matched crop). Four classes are highlighted: oil spill (red), Marine Water (blue), Shallow Water (purple), Waves and Wakes (green). Axes are UMAP dimension components 1 and 2 in arbitrary units.
Remotesensing 18 02905 g002
Figure 3. Per-band-occlusion importance for oil spill, seed 0, in three settings: top, frozen Hydro encoder without adapter (B1 versus B2); middle, frozen Hydro encoder with D3 linear adapter (E2 versus G2 mirror); bottom, evaluation under both normalisation strategies. Blue bars: MADOS normalisation. Red bars: Hydro normalisation. The NIR-SWIR region is shaded.
Figure 3. Per-band-occlusion importance for oil spill, seed 0, in three settings: top, frozen Hydro encoder without adapter (B1 versus B2); middle, frozen Hydro encoder with D3 linear adapter (E2 versus G2 mirror); bottom, evaluation under both normalisation strategies. Blue bars: MADOS normalisation. Red bars: Hydro normalisation. The NIR-SWIR region is shaded.
Remotesensing 18 02905 g003
Table 1. Per-band statistical comparison between the MADOS training set and the Hydro pretraining dataset.
Table 1. Per-band statistical comparison between the MADOS training set and the Hydro pretraining dataset.
Band λ (nm) μ M A D O S σ M A D O S μ H y d r o σ H y d r o δ μ σ Ratio
B014420.05830.03240.03410.0555+0.441.71
B024920.05220.03430.04300.0572+0.161.67
B035590.04380.03550.06140.0583−0.301.64
B046650.03570.03760.05900.0676−0.341.80
B057040.03410.03790.09510.0730−0.841.93
B067390.03680.04990.17920.1096−1.302.20
B077800.04000.05880.20750.1273−1.322.16
B088330.03570.05550.22190.1366−1.362.46
B8A8640.03970.06420.22660.1356−1.382.11
B1116100.02680.04210.15940.1079−1.232.56
B1221860.01980.03020.10090.0819−0.992.71
Table 2. Swin Transformer V2 Base encoder configuration.
Table 2. Swin Transformer V2 Base encoder configuration.
ParameterValue
Embedding dimension128
Stage depths[2, 2, 18, 2]
Attention heads per stage[4, 8, 16, 32]
Window size16
Pretrained input bands12
Target input bands11
Table 3. Spectral band adaptation variants for mapping the 12-band pretrained patch embedding onto the 11 available MADOS bands. All variants use a frozen Hydro encoder with MADOS normalisation.
Table 3. Spectral band adaptation variants for mapping the 12-band pretrained patch embedding onto the 11 available MADOS bands. All variants use a frozen Hydro encoder with MADOS normalisation.
VariantMethodParametersEncoder
D1Direct column crop0Frozen
D2Crop + Frobenius rescaling0Frozen
D31 × 1 convolution (11-to-12)144Frozen
D4D3 + partially unfrozen (ep. 40)144Partial
D5MLP (11, 24, 11, GELU)588Frozen
Table 4. Normalisation strategies.
Table 4. Normalisation strategies.
StrategyTransformationParameters
MADOS z-score x μ M A D O S σ M A D O S Fixed (training set)
Hydro z-score x μ H y d r o σ H y d r o Fixed (pretraining)
Patch z-score x μ P a t c h σ P a t c h Per patch
Affine M2H α x + β , α = σ H y d r o σ M A D O S Fixed (derived)
Learnable affine α x + β , optimised22 trainable
Table 5. (a) Controlled block configurations for blocks A, B, and D. All blocks use the Hamburger decoder, 80 epochs, Adam optimiser, c = 1.02, no VSCP, no EMA, and no TTA. (b) Block C perturbation conditions. All applied to the B1 checkpoint at test time. (c) Block H label-free harmonisation transforms. All applied to the B1 checkpoint at test time. (d) Extension framework configurations. All use the Hydro encoder. Frozen mirror rows duplicate the settings of their partially unfrozen counterpart (same seeds, epochs, learning rate schedule, VSCP, EMA, and TTA), differing only in that the encoder remains frozen throughout training. This paired design isolates the contribution of encoder unfreezing from the contribution of the augmented training configuration.
Table 5. (a) Controlled block configurations for blocks A, B, and D. All blocks use the Hamburger decoder, 80 epochs, Adam optimiser, c = 1.02, no VSCP, no EMA, and no TTA. (b) Block C perturbation conditions. All applied to the B1 checkpoint at test time. (c) Block H label-free harmonisation transforms. All applied to the B1 checkpoint at test time. (d) Extension framework configurations. All use the Hydro encoder. Frozen mirror rows duplicate the settings of their partially unfrozen counterpart (same seeds, epochs, learning rate schedule, VSCP, EMA, and TTA), differing only in that the encoder remains frozen throughout training. This paired design isolates the contribution of encoder unfreezing from the contribution of the augmented training configuration.
(a)
ConfigurationBlockEncoder InitialisationTransfer ModeNormalisationAdapter
A1ARandomFullMADOSNone
A2AHydroFrozenMADOSNone
A3AHydroPartial (last stage = 1, ep. 1, lr × 0.10)MADOSNone
A4AHydroFullMADOSNone
B1BHydroFrozenMADOS z-scoreNone
B2BHydroFrozenHydro z-scoreNone
B3BHydroFrozenPatch z-scoreNone
B4BHydroFrozenAffine M2HNone
B5BHydroFrozenLearnable affineNone
D1DHydroFrozenMADOSDirect crop
D2DHydroFrozenMADOSFrobenius-matched crop
D3DHydroFrozenMADOS1 × 1 adapter
D4DHydroPartial (last stage = 1, ep. 40, lr × 0.05)MADOS1 × 1 adapter
D5DHydroFrozenMADOSMLP adapter
(b)
ConditionPerturbationOperational Analogue
C1 (clean)None (reference)-
C2 (gain 0.95)All bands × 0.95Sensor calibration drift
C2 (gain 1.05)All bands × 1.05Atmospheric transmittance shift
C3 (bias −0.005)All bands − 0.005Dark current offset
C3 (bias +0.005)All bands + 0.005Path radiance increase
C4 (noise)Gaussian, σ = 0.005Detector noise
C5 (wrong normalisation)Hydro stats at test timeDifferent atmospheric correction pipeline
C6 (reverse normalisation)MADOS stats at test time, model trained under Hydro statsReverse-direction normalisation mismatch
(c)
TransformDescriptionReference Distribution
H1Robust per-band percentile stretch (2–98%) + post-clip re-standardisationMADOS train split
H2Diagonal CORAL: per-band rescaling σ H y d r o σ M A D O S , re-centring to μ H y d r o Hydro pretraining statistics
H3Per-patch affine to Hydro median/IQR (gain bounded to [0.8, 1.2])Hydro pretraining statistics
(d)
ConfigurationTransfer ModeNormalisationAdaptationVSCPEMATTA
D2 ceilingFrozenMADOSD2On0.999On
P1Partial (ep. 40, lr × 0.05)HydroD3On0.999On
P1 frozen mirrorFrozenHydroD3On0.999On
P2Partial (ep. 40, lr × 0.05)MADOSD2On0.999On
P2 frozen mirrorFrozenMADOSD2On0.999On
P3Partial (ep. 25, lr × 0.05)HydroD3On0.999On
P3 frozen mirrorFrozenHydroD3On0.999On
P4Partial (ep. 40, lr × 0.05)HydroD3OnOffOff
P4 frozen mirrorFrozenHydroD3OnOffOff
Table 6. Transfer strategy comparison. P1 frozen mirror uses VSCP, EMA, and TTA with a frozen encoder and D3 adapter under Hydro normalisation. Bold marks the best value per column. MariNeXt (ctrl) refers to the experiment without the training enhancements and retrained with the present settings.
Table 6. Transfer strategy comparison. P1 frozen mirror uses VSCP, EMA, and TTA with a frozen encoder and D3 adapter under Hydro normalisation. Bold marks the best value per column. MariNeXt (ctrl) refers to the experiment without the training enhancements and retrained with the present settings.
ConfigurationEncoderTransfer ModemIoU σ Macro F1Overall Accuracy
A4HydroFull fine-tune0.4890.0370.6180.833
A1RandomFull (scratch)0.5280.0300.6520.850
A3HydroPartial0.5400.0220.6490.855
MariNeXt (ctrl)MSCANFull (scratch)0.559-0.6840.896
A2HydroFrozen0.5740.0050.6990.838
D2HydroFrozen + D20.6000.0040.7260.858
MariNeXt [20]MSCANFull (scratch)0.643-0.7600.891
P1 frozen mirrorHydroFrozen + D30.6600.0240.7720.867
Table 7. Band adaptation comparison. All bands use the frozen Hydro encoder with MADOS normalisation. Bold marks the best value per column.
Table 7. Band adaptation comparison. All bands use the frozen Hydro encoder with MADOS normalisation. Bold marks the best value per column.
VariantMethodParametersmIoU σ
D1Direct column crop00.5530.034
D2Crop + Frobenius rescaling00.6000.004
D31 × 1 convolution (11-to-12)1440.5820.043
D4D3 + partial unfreeze1440.5750.033
D5 MLP (11, 24, 12)5880.5090.038
Table 8. Normalisation strategy comparison. All strategies use the frozen Hydro encoder without spectral adapter. Bold marks the best value per column.
Table 8. Normalisation strategy comparison. All strategies use the frozen Hydro encoder without spectral adapter. Bold marks the best value per column.
ConfigurationStrategymIoU σ
B1MADOS z-score0.5710.016
B2Hydro z-score0.5600.027
B3Patch z-score0.4780.026
B4Affine M2H0.4040.007
B5Learnable affine0.3860.003
Table 9. Block C perturbation robustness. Δ denotes change relative to the clean condition.
Table 9. Block C perturbation robustness. Δ denotes change relative to the clean condition.
ConfigurationmIoU Δ
Clean0.571-
Gain 0.950.588+0.017
Gain 1.050.550−0.021
Bias −0.0050.574+0.004
Bias +0.0050.547−0.024
Noise σ = 0.0050.507−0.064
Wrong normalisation (Hydro)0.113−0.458
B2 clean (Hydro normalisation)0.560-
C6 reverse (MADOS stats at test)0.241−0.319
Table 10. Block H label-free harmonisation transforms. Each row trains a model from scratch on the D2 architecture with the harmoniser substituted for MADOS z-score. The baseline retains MADOS z-score. Values are mean mIoU across two seeds. Bold marks the best value in the column.
Table 10. Block H label-free harmonisation transforms. Each row trains a model from scratch on the D2 architecture with the harmoniser substituted for MADOS z-score. The baseline retains MADOS z-score. Values are mean mIoU across two seeds. Bold marks the best value in the column.
TransformmIoU σ
Baseline (no transform)0.5660.029
H1 (percentile + re-standardisation)0.5140.003
H2 (diagonal CORAL)0.4090.010
H3 (per-patch affine)0.3450.008
Table 11. Decoder feature-space separability of oil spill versus Marine Water class centroids, measured cosine distance.
Table 11. Decoder feature-space separability of oil spill versus Marine Water class centroids, measured cosine distance.
ConfigurationNormalisationHookCosine Distance
B1MADOSpre-HAM0.079
B2Hydropre-HAM0.117
D2MADOSpre-HAM0.092
B1MADOSpost-HAM0.194
B2Hydropost-HAM0.388
D2MADOSpost-HAM0.252
Table 12. Spearman rank correlation between the per-band importance shift under mismatched normalisation and the absolute normalised per-band mean gap between the MADOS and Hydro distributions.
Table 12. Spearman rank correlation between the per-band importance shift under mismatched normalisation and the absolute normalised per-band mean gap between the MADOS and Hydro distributions.
ClassSpearman ρ p -Value
Oil Spill0.8360.001
Marine Water0.7910.004
Table 13. Patch-level Spearman correlations between spectral distance to the MADOS reference and the mIoU drop under mismatched normalisation (D2 configuration, marine patches, n = 669).
Table 13. Patch-level Spearman correlations between spectral distance to the MADOS reference and the mIoU drop under mismatched normalisation (D2 configuration, marine patches, n = 669).
Distance MetricSpearman ρ p -Value
D M A D O S (Euclidean)0.1050.007
SAM-to-MADOS0.0800.038
Δ Mahalanobis−0.0880.022
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Anagnostopoulos, C.G.E.; Vlachos, K.; Moumtzidou, A.; Gialampoukidis, I.; Vrochidis, S.; Müting, A.; Oliveira, A.S.; Bliziotis, D.; Kikaki, K. Preprocessing Mismatch and Input Normalisation in Transferring a Multispectral Foundation Model to Marine Surface Segmentation. Remote Sens. 2026, 18, 2905. https://doi.org/10.3390/rs18172905

AMA Style

Anagnostopoulos CGE, Vlachos K, Moumtzidou A, Gialampoukidis I, Vrochidis S, Müting A, Oliveira AS, Bliziotis D, Kikaki K. Preprocessing Mismatch and Input Normalisation in Transferring a Multispectral Foundation Model to Marine Surface Segmentation. Remote Sensing. 2026; 18(17):2905. https://doi.org/10.3390/rs18172905

Chicago/Turabian Style

Anagnostopoulos, Christos G. E., Konstantinos Vlachos, Anastasia Moumtzidou, Ilias Gialampoukidis, Stefanos Vrochidis, Ariane Müting, Ana Sofia Oliveira, Dimitris Bliziotis, and Katerina Kikaki. 2026. "Preprocessing Mismatch and Input Normalisation in Transferring a Multispectral Foundation Model to Marine Surface Segmentation" Remote Sensing 18, no. 17: 2905. https://doi.org/10.3390/rs18172905

APA Style

Anagnostopoulos, C. G. E., Vlachos, K., Moumtzidou, A., Gialampoukidis, I., Vrochidis, S., Müting, A., Oliveira, A. S., Bliziotis, D., & Kikaki, K. (2026). Preprocessing Mismatch and Input Normalisation in Transferring a Multispectral Foundation Model to Marine Surface Segmentation. Remote Sensing, 18(17), 2905. https://doi.org/10.3390/rs18172905

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop