Next Article in Journal
Long-Term Variability of Surface Albedo and Its Correlation with Climatic Variables over Antarctica
Previous Article in Journal
Land Cover Mapping in Northern High Latitude Permafrost Regions with Satellite Data: Achievements and Remaining Challenges
Previous Article in Special Issue
Scaling of FAPAR from the Field to the Satellite
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Validation of Regional-Scale Remote Sensing Products in China: From Site to Network

1
School of Geography, Geomatics and Planning, Jiangsu Normal University, No. 101 Shanghai Road, Xuzhou 221116, China
2
Key Laboratory of Remote Sensing of Gansu Province, Cold and Arid Regions Environmental and Engineering Research Institute, Chinese Academy of Sciences, No. 320 Donggang West Road, Lanzhou 730000, China
3
Center for Excellence in Tibetan Plateau Earth Sciences, Chinese Academy of Sciences, Beijing 100101, China
4
University of Chinese Academy of Sciences, Beijing 100049, China
5
State Key Laboratory of Resources & Environmental Information System, Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, No. 11A Datun Road, Beijing 100101, China
6
School of Geographical Sciences, Southwest University, No. 2 Tiansheng Road, Chongqing 400715, China
7
State Key Laboratory of Remote Sensing Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, No. 20A Datun Road, Beijing 100101, China
8
State Key Laboratory of Remote Sensing Science, School of Geography, Beijing Normal University, No. 19, Xinjiekouwai Street, Beijing 100875, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2016, 8(12), 980; https://doi.org/10.3390/rs8120980
Submission received: 20 September 2016 / Revised: 20 November 2016 / Accepted: 21 November 2016 / Published: 26 November 2016

Abstract

:
Validation is mandatory to quantify the reliability of remote sensing products (RSPs). However, this process is not straightforward and usually presents formidable challenges in terms of both theory and real-world operations. In this context, a dedicated validation initiative was launched in China, and we identified a validation strategy (VS). This overall VS focuses on validating regional-scale RSPs with a systematic site-to-network concept, consisting of four main components: (1) general guidelines and technical specifications to guide users in validating various land RSPs, particularly aiming to further develop in situ sampling schemes and scaling approaches to acquire ground truth at the pixel scale over heterogeneous surfaces; (2) sound site-based validation activities, conducted through multi-scale, multi-platform, and multi-source observations to experimentally examine and improve the first component; (3) a national validation network to allow for comprehensive assessment of RSPs from site or regional scales to the national scale across various zones; and (4) an operational RSP evaluation system to implement operational validation applications. Research progress on the development of these four components is described in this paper. Some representative research results, with respect to the development of sampling methods and site-based validation activities, are also highlighted. The development of this VS improves our understanding of validation issues, especially to facilitate validating RSPs over heterogeneous land surfaces both at the pixel scale level and the product level.

Graphical Abstract

1. Introduction

In recent decades, unprecedented advances in characterising land surface parameters from satellite platforms have been achieved, boosting the development and a wide usage of numerous remote sensing products (RSPs) (e.g., [1,2,3,4,5,6,7,8,9,10,11,12,13]). Although these products provide reasonable spatial and temporal coverage, their accuracies and precisions should be independently assessed with reference data prior to utilisation. This process is well known as validation [14,15]. In practice, validation generally refers to assessing the uncertainties in remote-sensing-derived results (e.g., RSPs) via comparison with ground truth or inter-comparison with other alternative information that presumably represents the true state of a target.
Since validation is essential in various remote sensing applications, over the past two decades, huge efforts have been devoted internationally to address this issue in depth. These activities include the establishment of validation sites and networks as well as the contribution of large field campaigns and observation programmes to the topic of validation.
  • Many core sites have been identified, such as the La Crau site for high-resolution SPOT data calibration/validation activities [16]; soil moisture (SM) observatories located in the Tibetan Plateau [17,18]; and numerous enhanced Earth Observing System (EOS) land validation core sites [19] recommended by the Committee on Earth Observation (CEOS) Land Product Validation (LPV) sub-group [20].
  • Heavily instrumented observation networks have been established on scales ranging from regional to continental. These networks, such as the FLUXNET [21], the International Soil Moisture Network (ISMN) [22] and the Soil Climate Analysis Network (SCAN) [23], have paved the way towards meeting a broad range of national and international requirements for validation by continuously observing terrestrial variables.
  • Intensive land surface/remote sensing experiments and field campaigns as well as research/observation plans/programmes can also greatly contribute to addressing validation issues, such as the Boreal Ecosystem–Atmosphere Study (BOREAS) [24], Cold Land Processes Field Experiment (CLPX) [25], the Complicate Observations and Multi-Parameter Land Information Constructions on Allied Telemetry Experiment (COMPLICATE) [26], Hydrological and Atmospheric Pilot Experiment in the Sahel (HAPEX) [27], First International Satellite Land Surface Climatology Project Field Experiment (FIFE) [28], Soil Moisture Experiment (SMEX) [29], Validation of the Land European Remote Sensing Instruments (VALERI) [30], Heihe Watershed Allied Telemetry Experimental Research (HiWATER) [31], the Global Climate Observing System (GCOS) [32], Critical Zone Observatory (CZO) [33], Terrestrial Environmental Observatories (TERENO) [34], Coordinated Enhanced Observing Period (CEOP) [35] and BigFoot [36].
It can be clearly seen that there has been a consensus to use diverse observatories converted from the site-to-network scale as a promising way to provide insight into the validation process. As a result, substantial outcomes, such as the establishment of a validation framework [19,37] and multi-scale sampling strategy in validation [38] as well as concrete validation activities concerning various land surface variables, were extensively reported (Table 1).
However, previous investigations have also demonstrated that at least two challenges remain in the validation process. First, in existing validation exercises, homogeneous land surfaces are a focus and are commonly selected as a validation field to deploy in situ measurements, while heterogeneous scenes are rarely discussed [39]. This type of validation scheme may be disputable since an intrinsic characteristic of land surface is heterogeneity, as opposed to homogeneity. Therefore, the validation approach and/or scheme fitted to homogeneous conditions may not be suitable to heterogeneous land surfaces. This could potentially lead to an unreliable assessment of the performance of an RSP. Second, although ground instrumentation is typically assumed to deliver reliable direct measurements on small scales, whether in situ measurements have reasonable spatial representativeness remains questionable. Biased estimation of ground truth at the pixel scale may be obtained due to inherent heterogeneity and the mismatch of scales between ground measurements and satellite footprint (e.g., [40]). This situation can notably worsen if point-based measurement is compared against RSPs with coarse resolution, particularly over extreme environments, e.g., cold and arid regions, where in situ measurements are sparsely distributed. Even when point-scale ground measurements are aggregated, the yielded pixel scale value may still not be reliable. This can be attributed to a lack of dense or better-distributed ground sampling, and, moreover, to deficiency in terms of scaling methods that are unable to account for the various characteristics of different RSPs and land surface heterogeneity [39,41]. As a result, this clearly limits the ability of obtaining trustworthy estimates of variables with strong spatial–temporal variability at the satellite pixel scale and often impedes the performance of direct validation between in situ measurements and RSPs.
The abovementioned research suggests that a framework to develop, design, and perform reasonable validation schemes and activities to acquire ground truth at the pixel scale over heterogeneous land surfaces is urgently needed. We must first ask, how do we integrate and get the utmost out of various ground observations collected at multiple scales to validate different RSPs, especially for those variables with strong heterogeneity? Second, can scale approaches be further developed to aggregate point-scale ground measurements to the pixel scale, and can such approaches improve spatial and temporal representativeness of heterogeneous land surfaces? These research questions are not yet fully understood. With the support of a Chinese national validation initiative, these questions, together with validation-related theories, methods, metrics, and scale effects, are intensively investigated.
The objective of this study is to present our research progress on the development of a validation strategy (VS) and some representative validation activities. The VS is composed of four main components, namely, general guidelines and technical specifications, site-based validation activities, a prototype of a Chinese national validation network, and an operational RSP validation system. Validation activities are conducted over reference sites dependent on multi-scale observations collected from multi-platform and multi-source experiments, such as HiWATER [31]. The remainder of the paper is organised as follows: Section 2 provides an introduction to the overall VS, which can be viewed as a general roadmap for the validation efforts we conceived and performed. In Section 3, the validation guidelines and technical specifications are elaborated in association with pertinent improvements in sampling design and scaling methods. Section 4 describes experimental validation exercises that have been undertaken over reference sites. Section 5 illustrates a networking validation attempt in China and an operational validation system before providing conclusions in the last section.

2. Validation Strategy

As mentioned earlier, validation is not a straightforward task. In contrast, in addition to inherent heterogeneity of land surfaces, validation is generally recognised as a challenging issue because RSPs may not be spatially and/or temporally consistent. In addition, as is well known, validation commonly comprises several key components, ranging from in situ measurements collection, modelling, and retrieval of land surface variables to scale-related analyses [15]. All these factors complicate the validation issue, calling for a better understanding of validation practice, including quantitative evaluation of uncertainties within the validation process.
Against this background, in 2011, the Ministry of Science and Technology of the People’s Republic of China (MOST) launched an initiative focused on the development and validation of regional-scale RSPs for terrestrial hydrological and ecological applications. The core mission of this programme is to derive long-term regional-scale land RSPs (listed in Table 1) and to investigate the validity of these developed products based on integrated airborne, satellite-based and ground-based measurements. Under this circumstance, validation-related theories, methods, evaluation scores, and scale effects can therefore be substantially studied.
Based on previous research achievements (e.g., [19,20,41,42,43]), an overall validation strategy (Figure 1) was identified. The VS aims at validating regional-scale RSPs with systematic site-to-network concept consisting of (1) general validation guidelines and technical specifications; (2) site-based field campaigns and intensive observations; (3) a national validation network; and (4) an operational validation system.
(1) As shown in Figure 1, validation guidelines and technical specifications constitute the first component of the VS, which can be regarded as a top-layer design to drive the whole VS. The validation guidelines provide universal principles and methodologies that can be applied to steer validation activities for diverse land RSPs, in which sampling design and scaling methods are stressed. In contrast, validation technical specifications are a set of dedicated implementation protocols towards 16 RSPs/variables of interest (as shown in Table 1). Each individual variable has a unique technical specification. Pertinent details about validation guidelines and technical specifications will be given in Section 3.2.
It is also worth mentioning that in this component, validation activity is essentially dependent on a priori knowledge of the reference site, such as its meteorology, topography, plant type, agricultural activity, and other site parameters. Then, we can better integrate and utilise diverse observations to further develop sampling design and scale methods. In this case, observations are mainly dependent on ground measurements acquired at conventional point scale or from a source of wireless sensor network (WSN) and footprint dimension as well as airborne remotely sensed imagery with high resolution (on the order of sub-meters and/or meters). Some research efforts related to this component will be highlighted in Section 3.3.
(2) The validity of proposed guidelines and specifications needs to be experimentally evaluated. Therefore, Component 2, i.e., field campaigns and intensive observations, is subsequently proposed in the VS. As depicted in Figure 1, activities in this component are to validate RSPs over well-established observation fields/sites, which links theories and methodologies to real-world validation exercises. On the one hand, in situ measurements (e.g., WSN) can be deployed based on a sampling scheme proposed in Component 1 to collect ground data. On the other hand, upscaling these measurements to the pixel scale value also relies on scaling approaches. As feedback, simultaneous satellite, airborne and ground-based remote sensing experiments (e.g., HiWATER) occurring at some key experimental areas (KEAs) can greatly contribute to inspect the validity and effectiveness of Component 1 by primarily validating relatively higher resolution (on the order of tens of meters) RSPs at site/local to watershed scale. Progress with respect to this aspect will be given in Section 4.
(3) However, readily available RSPs are usually presented at lower spatial resolution (of the order of kilometers to tens of kilometers) and with larger spatial coverage or even on a global scale basis. To validate this kind of products requires ground measurements to be collected across different climate zones, which depends on joint site-based validation efforts rather than merely over limited spatial extents/reference sites (e.g., within a river basin), as considered in Component 2. Such activities would make it possible to facilitate the establishment of a national validation network, as we accordingly proposed in Component 3.
In this context, at the prototype stage of this validation network, several anchor sites located at different climate zones and landscapes with sound observational facilities are initially selected. Synergetic multi-platform intensive observations or comprehensive remote sensing experiments are performed at these sites to discern and further rectify the weaknesses of the developed validation guidelines and specifications. Then, the amended Component 1 can be inspected by well-studied validation exercises again. Such a reiterative procedure is conducive to progressively improving and maturing the guidelines to make them more robust and standardised, with wider applicability and firm validity at the national scale. This provides possibilities to coordinate more validation test fields in the future, extending operational validation efforts to meet continental or global range application requirements. Details of this validation network can be found in Section 5.1.
(4) Technically, the above three components are integrated and realised by Component 4, i.e., an operational validation system. As a service portal, the functionalities and algorithms embedded in this system are designed to use multi-scale in situ and remote sensing data to validating quantitative RSPs at the regional or global scales. As shown in Figure 1, this system includes three parts related to data sets, accuracy evaluation and scale effect analysis. This setup facilitates the implementation of desired functions ranging from data host to product accuracy assessment. Being compliant with Component 1, scale effect can also be investigated in this process. The introduction of this system can be found in Section 5.2.
In conclusion, with commitment of continuous data collection over nationally representative sites, the conceived overall VS and involved work packages are expected to help us gain additional insight into validation issues and especially address the immediate scientific question of how to acquire representative ground truth in remote sensing validation (including modelling) over heterogeneous landscapes.

3. Validation Guidelines and Technical Specifications

This section describes the details of the first component of the VS, and presents the progress we have made pertinent to sampling design and scaling methods. However, before presenting these materials, the RSPs to be validated are identified.

3.1. Products of Interest

Currently, we focus on 16 land surface variables, as summarised in Table 1. For each variable, typical remote sensing observation methods and previous validation studies as well as our validation activities are presented. Based on discrepancies in spatial sampling and aggregation methods used in validation, the 16 variables can be grouped into the following two types (the first column in Table 1).
  • Continuous product. This type of variable features continuously varying values in time and space at each grid. Aggregating ground measurements into the satellite pixel scale can be performed using conventional spatial sampling methods (such as simple random sampling, systematic sampling, and stratified sampling). In addition, the aggregated value is a weighted sum of all samples, in which the sample weight is determined by the sampling method.
  • Categorical product. The value of each grid of this type of product is usually assigned as a group name instead of magnitudes and numbers in order or size. Pixel scale values can also be validated by ground-based spatial sampling, while the aggregation methods differ from those used for the continuous products.
Most of the variables in this table are usually observed on the ground at the point scale. However, different RSPs characterise varying spatial resolutions (e.g., soil moisture and LAI products), ground measurements are unable to cover all of these scales. Therefore, point-scale measurements (by fixed station or mobile device) must be rationally deployed with an appropriate sampling scheme. On this basis, the collected ground measurements can then be aggregated into the pixel scale to validate corresponding RSPs with the aid of upscaling approaches, particularly against coarse-scale products (e.g., [44]).

3.2. Validation Guidelines and Technical Specifications

3.2.1. Validation Guidelines

Validation guidelines and technical specifications are the cornerstones of the validation framework [161]. The latter focuses on detailed validation protocols towards each specific land surface RSPs of interest, as described in Section 3.2.2. In contrast, the former is a baseline document that provides general considerations and basic procedures/approaches used in validating various land surface RSPs, and the content is roughly shown as follows:
  • Validation criteria include accuracy, precision, completeness, temporal variation, spatial pattern, spatial and temporal consistency.
  • Validation metrics, such as bias, mean absolute error (MAE), root mean square error (RMSE), mean absolute percent error (MAPE) and correlation coefficient R.
  • Basic procedures and approaches used to validate either continuous or categorical RSPs are provided at the pixel scale level and at the product level, as illustrated in Figure 2.
    -
    Basic procedures and approaches used to validate continuous RSPs at the pixel scale level. In this aspect, direct validation can capitalise on in situ measurements collected at the point scale and/or footprint scale (e.g., EC system). Because both the location and number of sampling points can directly affect the reliability of pixel scale representative estimates, ground sampling design is conducted based on variables characteristics with the aid of geostatistical methods, such as the mean of the surface with non-homogeneity (MSN) [162,163]. In the upscaling process, ground truth at the pixel scale is derived through integrating in situ measurements, such as various kriging models. Then, the upscaled ground measurements can be used to compare against RSP.
    -
    Basic procedures and approaches used to validate categorical land RSPs at the pixel scale level are similar to the ones validating continuous RSPs. Ground sampling design also plays an important role in this process. For instance, in direct validation, ground measurements acquired at sampling points can be used to compare against remote sensing estimates.
    -
    Basic procedures and approaches used to validate land RSPs at the product level. The first is to select typical sites, pixels and time periods across different biomes and landscapes. Next, in temporal, product accuracy should be assessed via comparison against time series reference data at the pixel scale over each specific site. On this basis, in spatial, product accuracy should be further assessed over a widely distributed set of locations. Finally, overall evaluation of an RSP can be achieved by combining the assessed results acquired at both time and space. The spatial and temporal consistency and uncertainty of a product can then be well evaluated and quantified via independent measurements over wildly representative locations and time periods.
  • General guidance on field site selection and corresponding ground instrumentation. This aspect suggests detailed criteria on how to choose or build a proper validation site and how to deploy various instruments to acquire high-quality ground measurements. Primarily, a site should be spatially representative of a given biome/ecosystem, considering national physiographic conditions. Basic observation facilities are also needed, including meteorology (e.g., precipitation and air temperature), eco-hydrological elements (e.g., soil temperature and moisture) and flux measurements. Other selection principles should be considered, e.g., accessibility, site extent, ambient environment, and commitment to long-term scientific study.

3.2.2. Validation Technical Specifications

As shown in Table 1, it is well known that different RSPs can be preferably derived using different remote sensing methods, such as LAI or soil moisture, which are observed via optical or microwave remote sensing. In this case, related validation efforts such as ground sampling design, site selection, site extent, validation method (direct/indirect/inter-comparison) and specific evaluation metrics to be used are varied. Compared to the validation guidelines providing general conditions and universal methodologies, technical specifications of validation are more specific and technical. These specifications refer to a set of procedures/protocols that benchmark for implementing validation exercises towards 16 RSPs/variables of interest (as shown in Table 1). Each individual RSP/variable has one dedicated technical specification. Here, we give an example of validation technical specification of ET. The content is as follows:
  • Validation criteria are data completeness, product accuracy, spatial and temporal variation, spatial and temporal consistency.
  • Validation metrics are bias, RMSE, MAPE, mean relative error (MRE) and R.
  • Procedures and approaches used in direct validation include the following: The first step is the acquisition of ground truth. At the watershed/regional scale, based on the measurements of water budget components (e.g., precipitation, runoff), water balance equation can be used to calculate yearly averaged ET result as ground truth. At small (point-, footprint- and pixel-) scales, direct flux measurements from Lysimeter, EC system and LAS, etc. are recommended. In the second step, at the river basin/watershed scale, spatial and temporal characteristics of long-term ET estimates are evaluated. At small scales, the accuracy of remotely sensed ET with instantaneous and daily/monthly averaged values as well as temporal variability are evaluated. Error sources and uncertainties are quantitatively assessed.
  • Procedures and approaches used in indirect validation are the following: The goal of indirect validation is to validate ET estimates derived from low resolution (e.g., MODIS, NOAA/AVHRR pixel level) satellite observations. This involves using ground-based measurements and multi-source remote sensing information with different levels of spatial resolution, which is capitalised on a step-by-step concept, ranging from high resolution (e.g., airborne mission), medium resolution (e.g., Landsat, ASTER pixel level) to low spatial resolution, considering scaling effect correction in the upscaling process.
  • Procedures and approaches used in inter-comparison are the following: Given multiple ET products, well-studied products can be used to evaluate others in need of validation. Evaluation process biases are observed when assessing product accuracy and consistency, spatial and temporal characteristics and regional applicability. In terms of multiple ET estimation models, the same input data (e.g., RS observations and forcing data) are used to drive different ET estimation models. Apart from assessing the accuracy and spatial-temporal characteristic of derived results, the validation process also compares the impact caused by diverse model structures, mechanisms and parameterization schemes, etc., to acquire knowledge regarding the applicability, limitation, and uncertainty of different models.
  • Ground instruments are recommended, such as Lysimeter, EC system, and LAS as well as related measuring protocols and data processing instructions.
  • Finally, an evaluation report should be generated with respect to the above validation efforts and product performance.

3.3. Progress on the Development of Sampling Design and Scale Approach

Obtaining ground truth at the pixel scale requires a well-designed sampling scheme, high quality data sets and rational statistical inference of measured samples. For homogeneous pixels, a few samples are adequate for capturing the dominant information for a pixel grid. If a heterogeneous pixel is presented, additional samples are usually desired to reach an unbiased estimation with a satisfactory accuracy [161]. Hence, how to use a limited number of sampling points to optimise their spatial distribution and therefore acquire reliable ground truth at the pixel scale is a question to be answered. This topic is investigated based on the characteristics of land surface, e.g., spatial autocorrelation and homogeneity. In general, if there is a lack of spatial autocorrelation of ground objects, classical sampling methods (e.g., simple random sampling, systematic sampling, and stratified sampling) can be used. Otherwise, more complicated spatial sampling methods, such as the MSN spatial sampling optimisation scheme [162,163], are recommended. The following section focuses on the progress of the development of the sampling design and upscaling approach over heterogeneous land surfaces, as this issue is considered in Component 1 in Figure 1.

3.3.1. Sampling Design

Wang et al. [112] presented a geostatistical-model-based method to optimise the spatial sampling design for estimating GPP. This investigation occurred in the Babao River Basin, located upstream of the Heihe River Basin (HRB) over grassland. Sampling locations were optimised based on a stratified block kriging (StrBK) approach, taking the heterogeneity (represented by stratification and anisotropy) into account. The error variance of regional GPP estimation decreased by 10.1% compared with a sampling scheme without considering land surface heterogeneity. Over the same watershed, Ge et al. [164] reported a universal co-kriging (UCK) model-based sampling design optimisation. This scheme was embodied in the design of a WSN that monitored three eco-hydrological variables (LST, precipitation, and soil moisture). The results demonstrated that the proposed sampling method could consider the relationship of target variables and environmental covariates as well as other spatial statistics. Compared with a sampling scheme without consideration of the multivariate correlation, the proposed design performed better by reducing prediction error variance. Another study occurred in the midstream of the HRB, as reported in [88], an efficient and robust LAI sampling strategy was developed based on multi-temporal prior knowledge (SMP) for long-term, fixed-position LAI observations. The proposed SMP-based sampling scheme was compared with another four methods, including random sampling, systematic sampling, sampling based on the land-cover map, and sampling based on vegetation index prior knowledge, using the PROSAIL model-based simulation analysis. The results indicated that the average RMSE of the LAI reference maps decreased from 0.12 to 0.05, and the relative error can be reduced from 6.1% to 2.2%.

3.3.2. Scaling Methods

From the perspective of the upscaling issue, variables with strong heterogeneity (e.g., ET and soil moisture) were intensively investigated. Ge et al. [71] proposed an area-to-area regression kriging (ATARK) method to upscale sensible heat flux observations from EC scale to LAS footprints. Observations sourced from the footprints of 17 EC and four LAS systems were analysed. The results revealed the proposed ATARK was capable of delivering accurate predictions, with a high R2 value (≥0.9) acquired for the comparison between upscaled EC and LAS measured flux. Furthermore, Liu et al. [72] compared five upscaling methods and developed a combined method to acquire ET ground truth at the satellite pixel scale. Based on multi-site measurements from 11 EC systems and four groups of LASs in the HRB, the authors indicated that three simple upscaling methods—namely, the arithmetic average method, area-weighted method, and footprint-weighted method—showed promise when used over homogenous surfaces, with an average error of approximately 6%. However, for heterogeneous landscapes, auxiliary variables should be introduced to characterise heterogeneity, such as the integrated Priestley-Taylor equation method or the ATARK method, and can be used to improve the upscaled ET results. On this basis, a combined method was proposed to acquire both instantaneous and daily ET ground truth at the satellite pixel scale with the moment of MODIS overpass.
Kang et al. [140] analysed regression kriging (RK)-based upscaling scheme for soil moisture observed via WSN with three types of remote sensing information. Compared with the ordinary kriging method, the derived spatial inferences showed that the RK method was able to decrease the RMSE by approximately 5%. Wang et al. [141] proposed a geostatistical approach to upscale soil moisture observations with unequal precisions. This approach considered random measurement errors and a Monte Carlo simulation in association with a block kriging (BK) upscaling strategy. When comparing the three upscaling approaches (simple average, error-free BK, and error-perturbed BK), the results showed that the aggregated soil moisture estimates were comparable, while the error-perturbed BK approach outperformed, with a minimum error standard deviation (<0.01 m3∙m−3).
In addition, as shown in Component 1 in Figure 1, airborne mission is included. Using the observations acquired from a compact airborne spectrographic imager (CASI) aboard aircraft, a land-cover-based Linear Bi-directional Reflectance Distribution Function (BRDF) unmixing (LLBU) algorithm was proposed to estimate albedo over farmland in the HRB. The retrieved CASI albedo with 5 m resolution showed promising high accuracy, with an RMSE of 0.013 compared against in situ measurements. In addition, good performance was observed when the CASI albedo was upscaled to a 500 m pixel scale, with an RMSE of 0.019 compared with MODIS products [165].
The abovementioned research progress lays the foundation for answering several scientific questions; i.e., how could scale approaches be further developed to aggregate point-scale ground measurements to the satellite pixel scale, and how could the generated values improve spatial and temporal representativeness of heterogeneous land surfaces? In this case, there is an article [166] summarising our various upscaling research.

4. Validation Activities at Reference Sites

As shown in previously reviewed studies, a key component of a validation framework has been substantial short-term and large-scale intensive field campaigns. In addition, in our VS, to experimentally evaluate the validity of Component 1 in Figure 1 requires considerable validation efforts, with various measurements jointly collected through multi-source and multi-platform venues. In this section, we focus on site-based validation activities (presented as Component 2 in Figure 1) in a twofold manner: validation efforts in HiWATER and validation experiments over other places.

4.1. Validation Efforts in HiWATER

HiWATER was a watershed-scale remote sensing experiment conducted in the HRB in Northwest China [31]. It greatly supported validation studies. This is because first, the HRB has a unique natural environment, which spans the mountain cryosphere (upstream), coexisting forest, irrigated oasis and farmland (midstream), and natural oasis, semi-desert, and desert areas (downstream). Such diverse landscapes allow us to validate different ecological and hydrological RSPs. Second, numerous experimental activities that concern remote sensing and land surface processes have been implemented in this river basin, resulting in robust research achievements and datasets as well as sound observation facilities [167]. Finally, remote sensing validation and its related issues were highly emphasised in HiWATER, reflected by the implementation of specific experimental configuration and observatory deployment that can contribute to validation activities.
In HiWATER, ground truth is not limited to being collected at the point scale; there is also the pixel scale based on WSN and the footprint scale based on EC system and LAS measurements.
Two ground-based WSNs were established over heterogeneous farmland in the middle stream of the HRB in 2012. One WSN was an eco-hydrological WSN (EHWSN) designed to capture spatial-temporal variations of soil moisture, soil temperature, and LST (Figure 3) [138,139]. It is worth mentioning in Figure 3 that a flux observation matrix (the oblique red domain) was identified in HiWATER. Because this area is heterogeneous, a 4 km × 4 km site was further identified (blue box) that can then be used to validate various MODIS products to minimise the PSF effect and geo-location uncertainties of sensors. The other WSN was LAINet, with each node equipped with light sensors to provide continuous measurements on corn LAI in growing season [89]. Such ground-based facilities can provide a priori spatial distribution information on eco-hydrological variables and can be used to evaluate corresponding RSPs on the order of a kilometer, i.e., approximately the MODIS pixel size. The utilisation of these WSNs in validation is highlighted by several case studies, as described in more detail below.
(1) Validating LST and soil moisture using the EHWSN. Yu and Ma [95], investigated the scale mismatch between in situ and remotely sensed LST. Two types of ground-based observations were obtained from a CNR4 net radiometer and an SI-111 infrared radiometer. Then, these two ground-based measurements were compared with MODIS LST products (MOD11A1) with 1 km resolution, while an LST retrieval of 3 m resolution derived from airborne thermal-infrared observations was used to assess land heterogeneity. Based on a semi-variance analysis, the results suggested that it was not reliable to directly use ground-based LSTs to represent their located MODIS pixel value. Surface heterogeneity triggered strong spatial variations of LST and pronounced errors in the validation process. Han et al. [168] estimated soil moisture at the footprint scale using a novel Cosmic-ray Soil Moisture Observing System (COSMOS) over heterogeneous farmland, and in situ measurements acquired by the EHWSN were used to calibrate and validate soil moisture estimates.
(2) Validating vegetation index products using LAINet. The primary objective of LAINet was to collect continuous corn LAI measurements using 42 in situ WSN nodes. Thus, a comparative analysis was conducted among different ground measurements and MODIS observations [89]. This study included a direct comparison between LAINet measurements and data collected by LAI-2000. Daily and 5-day integrated times series analysis and aggregated ground LAINet LAI values were compared with satellite remotely sensed data. In [148], an evaluation of the MODIS NDVI products (MOD09GQ and MYD09GQ) was performed across six land use types over nearly one complete growing season. The spatial heterogeneity and scale effects of the NDVI were investigated. The study reported that spatial heterogeneity was commonly found in MODIS data at a resolution of 250 m for different land types. Upscaling of in situ NDVI data based on high spatial resolution satellite imagery can noticeably enhance the validation accuracy of NDVI estimates at the pixel level.
In addition to the WSNs, a thematic experiment within HiWATER was the multi-scale observation experiment on evapotranspiration (MUSOEXE), which established a flux observation matrix in the middle reaches of the HRB from May to September 2012. This observation matrix was composed of 22 EC systems, eight LAS systems and 21 automatic meteorological stations (AMS) that were used to deliver footprint-scale measurements (Figure 3) [68,72]. Multi-scale (e.g., on the order of 100 m to 1–2 km) observations of meteorological elements and land surface parameters were collected for validating regional ET over heterogeneous surfaces. In addition, these comprehensive measurements were beneficial for identifying scale effects and providing ground truth that coincides with the development of the remote sensing models and scaling approaches for validation purposes. As demonstrated in [69,70], Song et al. validated corn transpiration and soil evaporation estimated by the two-source energy balance model (TSEB) at site and field scales based on the EC and stable oxygen and hydrogen isotope measurements. In [73], an innovative validation framework including quantification of the spatial heterogeneity, optimisation of the ground sampling strategy, multi-scale measurements, upscaling theory, uncertainty analyses, and validation method (direct validation, indirect validation and cross validation) was proposed to validate ET RSPs at different scales. In conclusion, as a comprehensive remote sensing experiment, HiWATER felicitously connects validation theories with detailed validation exercises.

4.2. Other Validation Experiments

Validation activities were also performed in study sites other than HiWATER. A typical study included observing fluxes using EC and LAS systems to validate the ET product in the Hai River Basin, across typical underlying surfaces of the northern mountains (Miyun), croplands in the central suburbs (Daxing) and croplands in the southern plains (Guantao) [66,67]. Jia et al. [67] proposed an innovative validation method based on multi-source ET measurements. The validation results included accuracy assessment, analysis of error source and uncertainty within the validation process at the basin and local scales. Both scales showed a good agreement between the estimated and observed ET. Bai et al. [74] investigated the effect of footprint characteristics for validating satellite-based surface fluxes in two river basins. The results showed that the footprint is crucial in defining a consistent spatial scale between ground measurements and satellite-based surface flux estimates in validation, particularly for heterogeneous surfaces and high-resolution remote sensing data.
A study of accuracy assessment of multi-scale LAI observations occurred in a meadow steppe of Hulunber, Inner Mongolia, China [86]. Datasets involved were ground-based measurements, MODIS C5 LAI and land cover type products with 1 km and 500 m resolution, respectively, as well as LAI maps derived from Environment and Disaster Monitoring Small Satellite Constellation of China (HJ)-1A/1B CCD images with 30 m resolution. A slight overestimation in the averaged magnitude of 0.4 was found for the MODIS LAI product compared with the HJ-retrieved LAI maps, and the relative absolute errors of the product ranged from 10% to 50%. Ding et al. [149] introduced a concept of mean length variability to be used as an index to quantify spatial heterogeneity over croplands for multi-temporal NDVI, near-infrared, and red reflectance. This investigation suggested that the spatial heterogeneity varied with the changes in the fraction of vegetation cover, and a spatial resolution larger than 120 m could effectively limit the difference of spatial heterogeneity among different remote sensing observation methods.
In addition to these individual activities, other field campaigns and intensive observations have been performed, particularly at anchor sites within a national validation network being coordinated (see Section 5). As a result, we are highly confident that the validation experience learned from local-scale validation is rewarding to leverage validation exercises to be practiced at larger scales.

5. A National Validation Network and an Operational Validation System

This Section describes the last two components proposed in the overall VS. To some extent, the role of these two parts can be regarded as a further operational usage stage beyond the first two components in Figure 1.

5.1. National Network for Validating RSP

As stated earlier, multi-platform and multi-scale validation activities allow for systematically verifying and improving the proposed validation guidelines and technical specifications. In the meantime, uncertainties in various RSPs can be quantitatively evaluated using diverse validation metrics. Experience obtained from such validation exercises is helpful for establishing a Chinese national validation network. Such a network is being coordinated as a prototype by initially selecting typical stations/sites with sound observational foundations. Currently, 12 anchor stations are chosen over seven representative regions in China [169]. The distribution of these sites as well as each dominant landscape is illustrated in Figure 4. In addition, four of these stations—namely, the Huailai Station, the Hulunber Station, the Jingyuetan Station, and the Heihe Station—have been selected as core observation sites. Basic information about the former three stations is described in Table 2. For the most heavily instrumented Heihe Station, a very detailed description can be found in [169].
Over the past few years, various validation experiments, including dedicated ground-based remote sensing experiments and intensive field campaigns, were individually and/or jointly conducted. Datasets are collected at these four sites for investigating remote sensing and validation mechanisms and theories. Because each station features distinct local landscapes, specific validation target variables are therefore identified [169]. Validation activities over such diverse environments can still help further improve the validation guidelines and specifications developed in Component 1. This procedure can be progressively performed until it fulfils the validation requirement over various surface conditions and multiple scales. Meanwhile, principles on the establishment of observation fields, deployment of instrumentation, data processing procedures, data quality control, data sharing and product evaluation metrics, etc. can be standardised. Accordingly, more sites and stations can be united to form a recognisable nationwide remote sensing validation network.

5.2. An Operational RSP Validation System

As the last Component in Figure 1, a web-based land surface remote sensing product validation system (LAPVAS) is designed to use multi-scale in situ and remote sensing data for validating RSPs at regional and/or global scales. This system facilitates functionalities in data host and validation execution. The latter is performed based on single-point and multi-location comparisons in the case of homogenous and heterogeneous land surfaces, respectively. As shown in Figure 5, this system includes three key elements: (1) A validation database subsystem contains an original database that hosts ground measurements and, a validation data repository that stores the pixel scale reference data. Various analysis tools used to generate spatial-temporal scale matched validation data from the original database are also included in this subsystem; (2) an RSP accuracy evaluation subsystem to quantify the uncertainties and consistency of a product, with accuracy, precision, completeness, spatial and temporal consistency, etc. are used as validation criteria; (3) an inter-external interface exchanges information among the validation database subsystem, the evaluation subsystem, and the RSP data flow.
The original data in the validation database subsystem are collected from in situ measurements and/or from well-qualified high-resolution products for indirect validation purposes. The preprocessing of spatial scale transformation and temporal-scale matching are implemented to generate spatial-temporal matches among validation datasets and RSPs to be validated. The candidate RSP is preferred to be spatially and temporally consistent with reference data, which is processed by the inter-external interface to generate comparable data in the matched table (i.e., the data from candidate RSP and the counterparts from the validation data). Subsequently, the evaluation subsystem provides three methods in validating: direct validation, indirect validation and inter-comparison, according to the land cover heterogeneity. Finally, an evaluation report can provide validation results, particularly the data information, validation method, and accuracy of the RSP being validated.
The above three parts of LAPVAS are built using various essential service modules, such as data-read service modules, data-insert service modules, data-associated service modules and evaluation-analysis service modules, packaged by a standard web-service description language. Users can flexibly choose these service modules and combine them through the user interface to form a user-defined programme according to validation requirements. Technically, a framework called a service-oriented architecture (SOA) is adopted in LAPVAS. One promising feature of this SOA is the ability to modularise LAPVAS using low cohesion and loose coupling. In this sense, the modularised system can be managed in an operational way, which places less importance on the sequence of service modules in LAPVAS.

6. Conclusions

In this study, we introduce an overall validation strategy with a site-to-network concept. The VS comprises four main components: (1) general guidelines and technical specifications that can guide users to validate various land RSPs; (2) substantial validation activities to experimentally examine and improve the first Component; (3) a national validation network to allow comprehensive assessment of RSPs from site or regional scales to the national scale across various zones; and (4) an RSP evaluation system to implement operational validation applications. The proposed VS systematically focuses on various aspects of validation issues, including its measures, approaches, and real-world application.
Validation guidelines and a series of technical specifications are proposed. The former provides general conditions and universal methodologies to validate either continuous or categorical RSPs both at the pixel scale level and at the product level. Validation technical specifications focus on validation protocols towards 16 land surface RSPs of interest. Research outcomes related to ground sampling design and scaling method demonstrated that these investigations have been beneficial in quantitatively calculating various statistical indicators for evaluating RSPs, optimising the spatial layout of sampling points, and obtaining unbiased and representative aggregated ground truth data at the pixel scale.
Substantial intensive observations and field campaigns performed from site to local to regional scales greatly supported validation activities. The HiWATER experiment occurred in the HRB, as well as other experiments conducted in China, these studies successfully collected high-quality datasets at multiple scales using WSNs, field measurements with footprint dimensions, airborne remote sensing, and other intensive in situ measurements. The utilised sampling schemes and deployment of ground instrumentation, etc., are compliant with the first component of the VS. In this context, considerable research results have already been yielded, including validation efforts addressed soil moisture, LST, ET and vegetation index, etc.
In addition, within this strategy, we are coordinating a national-scale validation network in China. The prototype of this network has been established; 12 anchor stations over seven representative regions were chosen as basic observatories. Over the past few years, various ground-based remote sensing experiments and intensive field campaigns were individually and/or jointly conducted at four core sites, in order to investigate remote sensing and validation mechanisms and theories. To facilitate the operational validation task, a web-based validation system (LAPVAS) is designed to use multi-scale in situ and remote sensing data for validating quantitative RSPs at a regional or global scale. This system is built with assembled modules and contains a validation database subsystem, an RSP accuracy evaluation subsystem, and an inter-external interface.
Research progress related to each component of the proposed VS is rewarding, as it improves our understanding of challenging issues in validation, especially in answering the question of how to acquire reliable ground truth at the pixel scale over heterogeneous land surfaces for validating RSPs. Future research should first further explore the validation methodologies, including validation metrics, the quantitative assessment of land heterogeneity, and uncertainty occurring during the validation process. Great importance could be attached to scaling approaches, which could facilitate ground truth acquisition at the pixel scale and provide the essential information required for remote sensing retrieval and validation. Second, more reference sites could be included in the validation network in order to improve the network to be more applicable for large-scale validation practice. Finally, joint efforts involving the international community are anticipated to deliver international specifications for validating land RSPs, to better fulfil the requirements of the validation activities of global-scale RSPs.

Acknowledgments

This research was supported by the Natural Science Foundation of China projects (grant numbers: 91425303 and 41101320), the National Key project by MOST (grant number: 2016YFC0500100), and the inter-disciplinary Innovation Team of the Chinese Academy of Science. We would also like to thank three anonymous reviewers and the editors for their constructive comments and suggestions.

Author Contributions

Shuguo Wang, Xin Li, and Yong Ge conceived the structure of this paper. Shuguo Wang prepared the manuscript. Xin Li supervised the work. Yong Ge was responsible for the development of validation approaches. Rui Jin, Mingguo Ma, and Shaomin Liu conducted various validation activities and provided related materials, and were involved in coordinating the prototype of the national-scale validation network with Xin Li. Qinhuo Liu and Jianguang Wen designed and established the operational validation system. All authors approved the final manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. National Research Council (NRC); Committee on Scientific Accomplishments of Earth Observations from Space. Earth Observations from Space: The First 50 Years of Scientific Achievements; National Academies Press: Washington, DC, USA, 2008; p. 142.
  2. De Jeu, R.A.M.; Wagner, W.; Holmes, T.R.H.; Dolman, A.J.; van de Giesen, N.C.; Friesen, J. Global soil moisture patterns observed by space borne microwave radiometers and scatterometers. Surv. Geophys. 2008, 29, 399–420. [Google Scholar] [CrossRef] [Green Version]
  3. Zhao, X.; Liang, S.; Liu, S.; Yuan, W.; Xiao, Z.; Liu, Q.; Cheng, J.; Zhang, X.; Tang, H.; Zhang, X.; et al. The Global Land Surface Satellite (GLASS) remote sensing data processing system and products. Remote Sens. 2013, 5, 2436–2450. [Google Scholar] [CrossRef]
  4. Field, C.B.; Randerson, J.T.; Malmstrom, C.M. Global net primary production: Combining ecology and remote sensing. Remote Sens. Environ. 1995, 51, 74–88. [Google Scholar] [CrossRef]
  5. Running, S.W.; Nemani, R.R.; Heinsch, F.A.; Zhao, M.; Reeves, M.; Hashimoto, H. A continuous satellite-derived measure of global terrestrial primary production. Bioscience 2004, 54, 547–560. [Google Scholar] [CrossRef]
  6. Baret, F.; Hagolle, O.; Geiger, B.; Bicheron, P.; Miras, B.; Huc, M.; Berthelot, B.; Nino, F.; Weiss, M.; Samain, O.; et al. LAI, fAPAR and fCover CYCLOPES global products derived from VEGETATION—Part 1: Principles of the algorithm. Remote Sens. Environ. 2007, 110, 275–286. [Google Scholar] [CrossRef] [Green Version]
  7. Justice, C.O.; Townshend, J.R.G.; Vermote, E.F.; Masuoka, E.; Wolfe, R.E.; Saleous, N.; Roy, D.P.; Morisette, J.T. An overview of MODIS Land data processing and product status. Remote Sens. Environ. 2002, 83, 3–15. [Google Scholar] [CrossRef]
  8. Ganguly, S.; Nemani, R.R.; Zhang, G.; Hashimoto, H.; Milesi, C.; Michaelis, A.; Wang, W.L.; Votava, P.; Samanta, A.; Melton, F.; et al. Generating global Leaf Area Index from Landsat: Algorithm formulation and demonstration. Remote Sens. Environ. 2012, 122, 185–202. [Google Scholar] [CrossRef]
  9. Mu, Q.Z.; Zhao, M.S.; Running, S.W. Improvements to a MODIS global terrestrial evapotranspiration algorithm. Remote Sens. Environ. 2011, 115, 1781–1800. [Google Scholar] [CrossRef]
  10. Myneni, R.B.; Hoffman, S.; Knyazikhin, Y.; Privette, J.L.; Glassy, J.; Tian, Y.; Wang, Y.; Song, X.; Zhang, Y.; Smith, G.R.; et al. Global products of vegetation leaf area and fraction absorbed PAR from year one of MODIS data. Remote Sens. Environ. 2002, 83, 214–231. [Google Scholar] [CrossRef]
  11. Wan, Z. New refinements and validation of the MODIS land surface temperature/emissivity products. Remote Sens. Environ. 2008, 112, 59–74. [Google Scholar] [CrossRef]
  12. Hall, D.K.; Riggs, G.A.; Salomonson, V.V.; DiGirolamob, N.E.; Bayrd, K.J. MODIS snow-cover products. Remote Sens. Environ. 2002, 83, 181–194. [Google Scholar] [CrossRef]
  13. Schaaf, C.B.; Gao, F.; Strahler, A.H.; Lucht, W.; Li, X.; Tsang, T.; Strugnell, N.C.; Zhang, X.; Jin, Y.; Muller, J.P.; et al. First operational BRDF, albedo and nadir reflectance products from MODIS. Remote Sens. Environ. 2002, 83, 135–148. [Google Scholar] [CrossRef]
  14. Justice, C.O.; Belward, A.; Morisette, J.; Lewis, P.; Baret, F. Developments in the ‘validation’ of satellite sensor products for the study of the land surface. Int. J. Remote Sens. 2000, 21, 3382–3390. [Google Scholar] [CrossRef]
  15. Zhang, R.H.; Tian, J.; Li, Z.L.; Su, H.B.; Chen, S.H.; Tang, X.Z. Principles and methods for the validation of quantitative remote sensing products. Sci. China Earth Sci. 2010, 53, 741–751. [Google Scholar] [CrossRef]
  16. Rondeaux, G.; Steven, M.D.; Clark, J.A.; Mackay, G. La Crau: A European test site for remote sensing validation. Int. J. Remote Sens. 1998, 19, 2775–2788. [Google Scholar] [CrossRef]
  17. Su, Z.; Wen, J.; Dente, L.; van der Velde, R.; Wang, L.; Ma, Y.M.; Yang, K.; Hu, Z.Y. The Tibetan Plateau observatory of plateau scale soil moisture and soil temperature (Tibet-Obs) for quantifying uncertainties in coarse resolution satellite and model products. Hydrol. Earth Syst. Sci. 2011, 15, 2303–2316. [Google Scholar] [CrossRef]
  18. Yang, K.; Qin, J.; Zhao, L.; Chen, Y.Y.; Tang, W.J.; Han, M.L.; Lazhu; Chen, Z.Q.; Lv, N.; Ding, B.H.; et al. A multiscale soil moisture and freeze–thaw monitoring network on the third pole. Bull. Am. Meteorl. Soc. 2013, 94, 1907–1916. [Google Scholar] [CrossRef]
  19. Morisette, J.T.; Privette, J.L.; Justice, C.O. A framework for the validation of MODIS land products. Remote Sens. Environ. 2002, 83, 77–96. [Google Scholar] [CrossRef]
  20. CEOS Land Product Validation Web Site. Available online: http://lpvs.gsfc.nasa.gov/ (accessed on 2 May 2014).
  21. Baldocchi, D.; Falge, E.; Gu, L.H.; Olson, R.; Hollinger, D.; Running, S.; Anthoni, P.; Bernhofer, C.; Davis, K.; Evans, R.; et al. FLUXNET: A new tool to study the temporal and spatial variability of ecosystem–scale carbon dioxide, water vapor, and energy flux densities. Bull. Am. Meteorl. Soc. 2001, 82, 2415–2434. [Google Scholar] [CrossRef]
  22. Dorigo, W.A.; Wagner, W.; Hohensinn, R.; Hahn, S.; Paulik, C.; Xaver, A.; Gruber, A.; Drusch, M.; Mecklenburg, S.; van Oevelen, P.; et al. The International Soil Moisture Network: A data hosting facility for global in situ soil moisture measurements. Hydrol. Earth Syst. Sci. 2011, 15, 1675–1698. [Google Scholar] [CrossRef]
  23. Schaefer, G.L.; Cosh, M.H.; Jackson, T.J. The USDA natural resources conservation service soil climate analysis network (SCAN). J. Atmos. Ocean. Technol. 2007, 24, 2073–2077. [Google Scholar] [CrossRef]
  24. Sellers, P.; Hall, F.; Margolis, H.; Kelly, B.; Baldocchi, D.; Denhartog, G.; Cihlar, J.; Ryan, M.G.; Goodison, B.; Crill, P.; et al. The Boreal Ecosystem–Atmosphere Study (BOREAS): An overview and early results from the 1994 field year. Bull. Am. Meteorl. Soc. 1995, 76, 1549–1577. [Google Scholar] [CrossRef]
  25. Cline, D.; Davis, R.E.; Edelstein, W.; Hilland, J.; McDonald, K.; Running, S.; Way, J.; van Zyl, J. Cold Land Processed Mission (EX-7) Technology Implementation Plan. In Proceedings of the NASA Post-2002 Land Surface Hydrology Planning Workshop, Irvine, CA, USA, 12–14 April 1999.
  26. Tian, X.; Li, Z.Y.; Chen, E.X.; Liu, Q.H.; Yan, G.J.; Wang, J.D.; Niu, Z.; Zhao, S.J.; Li, X.; Pang, Y.; et al. The Complicate Observations and Multi-Parameter Land Information Constructions on Allied Telemetry Experiment (COMPLICATE). PLoS ONE 2015, 10, e0137545. [Google Scholar] [CrossRef] [PubMed]
  27. Goutorbe, J.P.; Lebel, T.; Tinga, A.; Bessemoulin, P.; Brouwer, J.; Dolman, A.J.; Engman, E.T.; Gash, J.; Hoepffner, M.; Kabat, P.; et al. HAPEX-SAHEL: A large-scale study of land-atmosphere interactions in the semiarid tropics. Ann. Geophys. 1994, 12, 53–64. [Google Scholar] [CrossRef]
  28. Sellers, P.J.; Hall, F.G.; Asrar, G.; Strebel, D.E.; Murphy, R.E. An overview of the 1st international satellite land surface climatology project (ISLSCP) field experiment (FIFE). J. Geophys. Res. 1992, D17, 18345–18371. [Google Scholar] [CrossRef]
  29. Jackson, T.J.; Bindlish, R.; Gasiewski, A.J.; Stankov, B.; Klein, M.; Njoku, E.G.; Bosch, D.; Coleman, T.L.; Laymon, C.; Starks, P. Polarimetric scanning radiometer C and X band microwave observations during SMEX03. IEEE Trans. Geosci. Remote Sens. 2005, 43, 2418–2430. [Google Scholar] [CrossRef]
  30. Baret, F.; Weiss, M.; Leroy, M.; Allard, D.; Garrigues, S.; Bohbot, H.; Bosseno, R.; Bella, C.D.; Espana, M.; Gond, V.; et al. VALERI: A Network of Sites and a Methodology for the Validation of Land Satellite Products [Online]. 2003. Available online: http://w3.avignon.inra.fr/valeri/documents/ (accessed on 13 March 2013).
  31. Li, X.; Cheng, G.D.; Liu, S.M.; Xiao, Q.; Ma, M.G.; Jin, R.; Che, T.; Liu, Q.H.; Wang, W.Z.; Qi, Y.; et al. Heihe watershed allied telemetry experimental research (HiWATER): Scientific objectives and experimental design. Bull. Am. Meteorol. Soc. 2013, 94, 1145–1160. [Google Scholar] [CrossRef]
  32. Houghton, J.; Townshend, J.; Dawson, K.; Mason, P.; Zillman, J.; Simmons, A. The GCOS at 20 years: The origin, achievement and future development of the Global Climate Observing System. Weather 2012, 67, 227–235. [Google Scholar] [CrossRef]
  33. Anderson, S.A.; Bales, R.C.; Duffy, C.J. Critical Zone Observatories: Building a network to advance interdisciplinary study of Earth surface processes. Mineral. Mag. 2008, 72, 7–10. [Google Scholar] [CrossRef]
  34. Bogena, H.; Schulz, K.; Vereecken, H. Towards a network of observatories in terrestrial environmental research. Adv. Geosci. 2006, 9, 109–114. [Google Scholar] [CrossRef]
  35. Nickeson, J.E.; Morisette, J.T.; Privette, J.L.; Justice, C.O.; Wickland, D.E. Coordinating Earth observing system land validation. Eos. Trans. AGU 2007, 88, 81–82. [Google Scholar] [CrossRef]
  36. Turner, D.P.; Cohen, W.B.; Kennedy, R.E.; Fassnacht, K.S.; Briggs, J.M. Relationships between leaf area index and Landsat TM spectral vegetation indices across three temperate zone sites. Remote Sens. Environ. 1999, 70, 52–68. [Google Scholar] [CrossRef]
  37. Baret, F.; Morissette, J.T.; Fernandes, R.A.; Champeaux, J.L.; Myneni, R.B.; Chen, J.; Plummer, S.; Weiss, M.; Bacour, C.; Garrigues, S.; et al. Evaluation of the representativeness of networks of sites for the global validation and intercomparison of land biophysical products: Proposition of the CEOS-BELMANIP. IEEE Trans. Geosci. Remote Sens. 2006, 44, 1794–1803. [Google Scholar] [CrossRef]
  38. Tian, Y.H.; Woodcock, C.E.; Wang, Y.J.; Privette, J.L.; Shabanova, N.V.; Zhou, L.M.; Zhang, Y.; Buermann, W.; Dong, J.R.; Veikkanen, B.; et al. Multiscale analysis and validation of the MODIS LAI product—II. Sampling strategy. Remote Sens. Environ. 2002, 83, 431–441. [Google Scholar] [CrossRef]
  39. Burakowski, E.A.; Ollinger, S.V.; Lepine, L.; Schaaf, C.B.; Wang, Z.S.; Dibb, J.E.; Hollinger, D.Y.; Kim, J.; Erb, A.; Martin, M. Spatial scaling of reflectance and surface albedo over a mixed-use, temperate forest landscape during snow-covered periods. Remote Sens. Environ. 2015, 158, 465–477. [Google Scholar] [CrossRef]
  40. Jackson, T.J.; Bindlish, R.; Cosh, M.H.; Zhao, T.J.; Starks, P.J.; Bosch, D.D.; Seyfried, M.; Moran, M.S.; Goodrich, D.C.; Kerr, Y.H.; et al. Validation of soil moisture and ocean salinity (SMOS) soil moisture over watershed networks in the U.S. IEEE Trans. Geosci. Remote Sens. 2012, 50, 1530–1543. [Google Scholar] [CrossRef] [Green Version]
  41. Baret, F.; Camacho, F.; Fang, H.; Garrigues, S.; Gobron, N.; Lang, M.; Lacaze, R.; LeBlanc, S.; Meroni, M.; Martinez, B.; et al. Global Leaf Area Index Product Validation Good Practices; Version 2.0; Fernandes, R., Plummer, S., Nightingale, J., Eds.; Satellite-Derived Land Product Validation, Land Product Validation Subgroup (WGCV/CEOS): Zurich, Switzerland, 2014; p. 76. [Google Scholar] [CrossRef]
  42. Held, A.; Phinn, S.; Soto-Berelov, M.; Jones, S. (Eds.) AusCover Good Practice Guidelines: A Technical Handbook Supporting Calibration and Validation Activities of Remotely Sensed Data Products; Version 1.2; TERN AusCover: Canberra, Australia, 2015.
  43. Morisette, J.T.; Baret, F.; Privette, J.L.; Myneni, R.B.; Nickeson, J.E.; Garrigues, S.; Shabanov, N.V.; Weiss, M.; Fernandes, R.A.; Leblanc, S.G.; et al. Validation of global moderate resolution LAI Products: A framework proposed within the CEOS Land Product Validation subgroup. IEEE Trans. Geosci. Remote Sens. 2006, 44, 1804–1817. [Google Scholar] [CrossRef]
  44. Crow, W.T.; Berg, A.A.; Cosh, M.H.; Loew, A.; Mohanty, B.P.; Panciera, R.; de Rosnay, P.; Ryu, D.; Walker, J.P. Upscaling sparse ground-based soil moisture observations for the validation of coarse-resolution satellite soil moisture products. Rev. Geophys. 2012, 50, RG2002. [Google Scholar] [CrossRef]
  45. Cescatti, A.; Marcolla, B.; Vannan, S.K.S.; Pan, J.Y.; Román, M.O.; Yang, X.Y.; Ciais, P.; Cook, R.B.; Law, B.E.; Matteucci, G.; et al. Intercomparison of MODIS albedo retrievals and in situ measurements across the global FLUXNET network. Remote Sens. Environ. 2012, 121, 323–334. [Google Scholar] [CrossRef]
  46. Liang, S.; Fang, H.; Chen, M.; Shuey, C.; Walthall, C.; Daughtry, C.; Morisette, J.; Schaaf, C.; Strahler, A. Validating MODIS land surface reflectance and albedo products: Methods and preliminary results. Remote Sens. Environ. 2002, 83, 149–162. [Google Scholar] [CrossRef]
  47. Stroeve, J.; Box, J.E.; Gao, F.; Liang, S.; Nolin, A.; Schaaf, B.C. Accuracy assessment of the MODIS 16-day snow albedo product: Comparisons with Greenland in situ measurements. Remote Sens. Environ. 2005, 94, 46–60. [Google Scholar] [CrossRef]
  48. Stroeve, J.; Box, J.E.; Wang, Z.S.; Schaaf, C.; Barrett, A. Re-evaluation of MODIS MCD43 Greenland albedo accuracy and trends. Remote Sens. Environ. 2013, 138, 199–214. [Google Scholar] [CrossRef]
  49. Wang, K.; Liu, J.; Zhou, X.; Sparrow, M.; Ma, M.; Sun, Z.; Jiang, W. Validation of the MODIS global land surface albedo product using ground measurements in a semidesert region on the Tibetan Plateau. J. Geophys. Res. 2004, 109, D05107. [Google Scholar] [CrossRef]
  50. Wang, Z.; Schaaf, C.B.; Strahler, A.H.; Chopping, M.J.; Román, M.O.; Shuai, Y.; Woodcock, C.E.; Hollinger, D.Y.; Fitzjarrald, D.R. Evaluation of MODIS albedo product (MCD43A) over grassland, agriculture and forest surface types during dormant and snow-covered periods. Remote Sens. Environ. 2014, 140, 60–77. [Google Scholar] [CrossRef]
  51. Wang, Z.; Schaaf, C.B.; Chopping, M.J.; Strahler, A.H.; Wang, J.; Román, M.O.; Rocha, A.V.; Woodcock, C.E.; Shuai, Y. Evaluation of Moderate-resolution Imaging Spectroradiometer (MODIS) snow albedo product (MCD43A) over tundra. Remote Sens. Environ. 2012, 117, 264–280. [Google Scholar] [CrossRef]
  52. Wright, P.; Bergin, M.; Dibb, J.; Lefer, B.; Domine, F.; Carman, T.; Carmagnola, C.; Dumont, M.; Courville, Z.; Schaaf, C.; et al. Comparing MODIS daily snow albedo to spectral albedo field measurements in Central Greenland. Remote Sens. Environ. 2014, 140, 118–129. [Google Scholar] [CrossRef]
  53. Peng, J.J.; Liu, Q.; Wen, J.G.; Liu, Q.H.; Tang, Y.; Wang, L.Z.; Dou, B.C.; You, D.Q.; Sun, C.K.; Zhao, X.J. Multi-scale validation strategy for satellite albedo products and its uncertainty analysis. Sci. China Earth Sci. 2015, 58, 573–588. [Google Scholar] [CrossRef]
  54. Wu, X.; Xiao, Q.; Wen, J.; Liu, Q.; You, D.; Dou, B.; Tang, Y.; Li, X. Optimal nodes selectiveness from WSN to fit field scale albedo observation and validation in long time series in the FOCI experiment areas, Heihe. Remote Sens. 2015, 7, 14757–14780. [Google Scholar] [CrossRef]
  55. Hulley, G.C.; Hook, S.J. Intercomparison of versions 4, 4.1 and 5 of the MODIS land surface temperature and emissivity products and validation with laboratory measurements of sand samples from the Namib desert, Namibia. Remote Sens. Environ. 2009, 113, 1313–1318. [Google Scholar] [CrossRef]
  56. Hulley, G.C.; Hook, S.J.; Baldridge, A.M. Validation of the North American ASTER Land Surface Emissivity Database (NAALSED) version 2.0 using pseudo-invariant sand dune sites. Remote Sens. Environ. 2009, 113, 2224–2233. [Google Scholar] [CrossRef]
  57. Li, Z.L.; Becker, F.; Stoll, M.P.; Wan, Z.M. Evaluation of six methods for extracting relative emissivity spectra from thermal infrared images. Remote Sens. Environ. 1999, 69, 197–214. [Google Scholar] [CrossRef]
  58. Wan, Z.M. New refinements and validation of the collection-6 MODIS land-surface temperature/emissivity product. Remote Sens. Environ. 2014, 140, 36–45. [Google Scholar] [CrossRef]
  59. Wang, K.C.; Liang, S.L. Evaluation of ASTER and MODIS land surface temperature and emissivity products using long-term surface longwave radiation observations at SURFRAD sites. Remote Sens. Environ. 2009, 113, 1556–1565. [Google Scholar] [CrossRef]
  60. Wang, K.; Wan, Z.; Wang, P.; Sparrow, M.; Liu, J.; Haginoya, S. Evaluation and improvement of the MODIS land surface temperature/emissivity products using ground-based measurements at a semi-desert site on the western Tibetan Plateau. Int. J. Remote Sens. 2007, 28, 2549–2565. [Google Scholar] [CrossRef]
  61. Kim, H.W.; Hwang, K.; Mu, Q.; Lee, S.O.; Choi, M. Validation of MODIS 16 global terrestrial evapotranspiration products in various climates and land cover types in Asia. KSCE J. Civ. Eng. 2012, 16, 229–238. [Google Scholar] [CrossRef]
  62. Mueller, B.; Seneviratne, S.I.; Jimenez, C.; Corti, T.; Hirschi, M.; Balsamo, G.; Ciais, P.; Dirmeyer, P.; Fisher, J.B.; Guo, Z. Evaluation of global observations-based evapotranspiration datasets and IPCC AR4 simulations. Geophys. Res. Lett. 2011, 38. [Google Scholar] [CrossRef]
  63. Tang, R.L.; Li, Z.L.; Tang, B.H. An application of the Ts–VI triangle method with enhanced edges determination for evapotranspiration estimation from MODIS data in arid and semi-arid regions: Implementation and validation. Remote Sens. Environ. 2010, 114, 540–551. [Google Scholar] [CrossRef]
  64. Tang, R.L.; Shao, K.; Li, Z.L.; Wu, H.; Tang, B.H.; Zhou, G.Q.; Zhang, L. Multiscale validation of the 8-day MOD16 evapotranspiration product using flux data collected in China. IEEE J. Sel. Top. Appl. Remote Sens. 2015, 8, 1478–1486. [Google Scholar] [CrossRef]
  65. Tang, R.L.; Li, Z.L.; Chen, K.S. Validating MODIS-derived land surface evapotranspiration with in situ measurements at two AmeriFlux sites in a semiarid region. J. Geophys Res. 2011, 116. [Google Scholar] [CrossRef]
  66. Liu, S.M.; Xu, Z.W.; Zhu, Z.L.; Jia, Z.Z.; Zhu, M.J. Measurements of evapotranspiration from eddy-covariance systems and large aperture scintillometers in the Hai River Basin, China. J. Hydrol. 2013, 487, 24–38. [Google Scholar] [CrossRef]
  67. Jia, Z.Z.; Liu, S.M.; Xu, Z.W.; Chen, Y.J.; Zhu, M.J. Validation of remotely sensed evapotranspiration over the Hai River Basin, China. J. Geophys. Res. 2012, 117, D13113. [Google Scholar] [CrossRef]
  68. Xu, Z.W.; Liu, S.M.; Li, X.; Shi, S.J.; Wang, J.M.; Zhu, Z.L.; Xu, T.R.; Wang, W.Z.; Ma, M.G. Intercomparison of surface energy flux measurement systems used during the HiWATER-MUSOEXE. J. Geophys. Res. 2013, 118, 13140–13157. [Google Scholar] [CrossRef]
  69. Song, L.S.; Liu, S.M.; Zhang, X.; Zhou, J.; Li, M.S. Estimating and validating soil evaporation and crop transpiration during the HiWATER-MUSOEXE. IEEE Geosci. Remote Sens. Lett. 2015, 12, 334–338. [Google Scholar] [CrossRef]
  70. Song, L.S.; Liu, S.M.; Kustas, W.P.; Zhou, J.; Xu, Z.W.; Xia, T.; Li, M.S. Application of remote sensing-based two source energy balance model for mapping field surface fluxes with composite and component surface temperatures. Agric. For. Meteorol. 2016, 230–231, 8–19. [Google Scholar] [CrossRef]
  71. Ge, Y.; Liang, Y.Z.; Wang, J.H.; Zhao, Q.Y.; Liu, S.M. Upscaling sensible heat fluxes with area-to-area regression kriging. IEEE Geosci. Remote Sens. Lett. 2015, 12, 656–660. [Google Scholar]
  72. Liu, S.M.; Xu, Z.W.; Song, L.S.; Zhao, Q.Y.; Ge, Y.; Xu, T.R.; Ma, Y.F.; Zhu, Z.L.; Jia, Z.Z.; Zhang, F. Upscaling evapotranspiration measurements from multi-site to the satellite pixel scale over heterogeneous land surfaces. Agric. For. Meteorol. 2016, 230–231, 97–113. [Google Scholar]
  73. Liu, S.M.; Xu, Z.W.; Song, L.S.; Zhang, Y.; Zhu, Z.L. A framework for validating remotely sensed evapotranspiration. In Proceedings of the IGARSS 2016, Beijing, China, 10–15 July 2016.
  74. Bai, J.; Jia, L.; Liu, S.M.; Xu, Z.W.; Hu, G.C.; Zhu, M.J.; Song, L.S. Characterizing the footprint of eddy covariance system and large aperture scintillometer measurements to validate satellite-based surface fluxes. IEEE Geosci. Remote Sens. Lett. 2015, 12, 943–947. [Google Scholar]
  75. Bacour, C.; Baret, F.; Beal, D.; Weiss, M.; Pavageau, K. Neural network estimation of LAI, fAPAR, fCover and LAIxC(ab), from top of canopy MERIS reflectance data: Principles and validation. Remote Sens. Environ. 2006, 105, 313–325. [Google Scholar] [CrossRef]
  76. Baret, F.; Weiss, M.; Lacaze, R.; Camacho, F.; Makhmara, H.; Pacholcyzk, P.; Smets, B. GEOV1: LAI and FAPAR essential climate variables and FCOVER global time series capitalizing over existing products. Part1: Principles of development and production. Remote Sens. Environ. 2013, 137, 299–309. [Google Scholar] [CrossRef]
  77. Camacho, F.; Cernicharo, J.; Lacaze, R.; Baret, F.; Weiss, M. GEOV1: LAI, FAPAR essential climate variables and FCOVER global time series capitalizing over existing products. Part 2: Validation and intercomparison with reference products. Remote Sens. Environ. 2013, 137, 310–329. [Google Scholar] [CrossRef]
  78. Weiss, M.; Baret, F.; Garrigues, S.; Lacaze, R.; Bicheron, P. LAI, fAPAR and fCover CYCLOPES global products derived from VEGETATION. Part 2: Validation and comparison with MODIS Collection 4 products. Remote Sens. Environ. 2007, 110, 317–331. [Google Scholar] [CrossRef]
  79. Steinberg, D.C.; Goetz, S.J.; Hyer, E. Validation of MODIS FAPAR products in boreal forests of Alaska. IEEE Trans. Geosci. Remote Sens. 2006, 44, 1818–1828. [Google Scholar] [CrossRef]
  80. Weiss, M.; Baret, F.; Block, T.; Koetz, B.; Burini, A.; Scholze, B.; Lecharpentier, P.; Brockmann, C.; Fernandes, R.; Plummer, S.; et al. On line validation exercise (OLIVE): A web based service for the validation of medium resolution land products. Application to FAPAR products. Remote Sens. 2014, 6, 4190–4216. [Google Scholar] [CrossRef]
  81. Wang, L.; Fan, W.J.; Xu, X.R.; Liu, Y. Scaling transform method for remotely sensed FAPAR based on FAPAR-P model. IEEE Geosci. Remote Sensing Lett. 2015, 12, 706–710. [Google Scholar] [CrossRef]
  82. Wang, Y.; Xie, D.; Liu, S.; Hu, R.; Li, Y.; Yan, G. Scaling of FAPAR from the field to the satellite. Remote Sens. 2016, 8, 310. [Google Scholar] [CrossRef]
  83. Mu, X.; Hu, M.; Song, W.; Ruan, G.; Ge, Y.; Wang, J.; Huang, S.; Yan, G. Evaluation of sampling methods for validation of remotely sensed fractional vegetation cover. Remote Sens. 2015, 7, 16164–16182. [Google Scholar] [CrossRef]
  84. Garrigues, S.; Lacaze, R.; Baret, F.; Morisette, J.T.; Weiss, M.; Nickeson, J.E.; Fernandes, R.; Plummer, S.; Shabanov, N.V.; Myneni, R.B.; et al. Validation and intercomparison of global Leaf Area Index products derived from remote sensing data. J. Geophys. Res. 2008, 113, G02028. [Google Scholar] [CrossRef]
  85. Yang, W.; Tan, B.; Huang, D.; Rautiainen, M.; Shabanov, N.V.; Wang, Y.; Privette, J.L.; Huemmrich, K.F.; Fensholt, R.; Sandholt, I.; et al. MODIS leaf area index products: From validation to algorithm improvement. IEEE Trans. Geosci. Remote Sens. 2006, 44, 1885–1898. [Google Scholar] [CrossRef]
  86. Li, Z.W.; Tang, H.; Xin, X.P.; Zhang, B.H.; Wang, D.L. Assessment of the MODIS LAI product using ground measurement data and HJ-1A/1B imagery in the meadow steppe of Hulunber, China. Remote Sens. 2014, 6, 6242–6265. [Google Scholar] [CrossRef]
  87. Zeng, Y.L.; Li, J.; Liu, Q.H.; Li, L.H.; Xu, B.D.; Yin, G.F.; Peng, J.J. A sampling strategy for remotely sensed LAI product validation over heterogeneous land surface. IEEE J. Sel. Top. Appl. Remote Sens. 2014, 7, 3128–3142. [Google Scholar] [CrossRef]
  88. Zeng, Y.L.; Li, J.; Liu, Q.; Qu, Y.H.; Huete, A.R.; Xu, B.D.; Yin, G.F.; Zhao, J. An optimal sampling design for observing and validating long-term leaf area index with temporal variations in spatial heterogeneities. Remote Sens. 2015, 7, 1300–1319. [Google Scholar] [CrossRef]
  89. Qu, Y.H.; Zhu, Y.Q.; Han, W.C.; Wang, J.D.; Ma, M.G. Crop leaf area index observations with a wireless sensor network and its potential for validating remote sensing products. IEEE J. Sel. Top. Appl. Remote Sens. 2014, 7, 431–444. [Google Scholar] [CrossRef]
  90. Shi, Y.C.; Wang, J.D.; Qin, J.; Qu, Y.H. An upscaling algorithm to obtain the representative ground truth of LAI time series in heterogeneous land surface. Remote Sens. 2015, 7, 12887–12908. [Google Scholar] [CrossRef]
  91. Coll, C.; Wan, Z.; Galve, J.M. Temperature-based and radiance-based validations of the V5 MODIS land surface temperature product. J. Geophys. Res. 2009, 114, D20102. [Google Scholar] [CrossRef]
  92. Wan, Z.; Zhang, Y.; Zhang, Q.; Li, Z.L. Quality assessment and validation of the MODIS global land surface. Int. J. Remote Sens. 2004, 25, 261–274. [Google Scholar] [CrossRef]
  93. Wan, Z.; Zhang, Y.; Zhang, Q.; Li, Z.L. Validation of the land surface temperature products retrieved from Terra Moderate Resolution Imaging Spectroradiometer data. Remote Sens. Environ. 2002, 83, 163–180. [Google Scholar] [CrossRef]
  94. Jiang, J.; Li, H.; Liu, Q.; Wang, H.; Du, Y.; Cao, B.; Zhong, B.; Wu, S. Evaluation of land surface temperature retrieval from FY-3B/VIRR data in an arid area of northwestern China. Remote Sens. 2015, 7, 7080–7104. [Google Scholar] [CrossRef]
  95. Yu, W.P.; Ma, M.G. Scale mismatch between in situ and remote sensing observations of land surface temperature: Implications for the validation of remote sensing LST products. IEEE Geosci. Remote Sens. Lett. 2015, 12, 497–501. [Google Scholar]
  96. Yu, W.P.; Ma, M.G.; Wang, X.F.; Tan, J.L. Validation of the MODIS LST products using long wave radiation ground measurements in the north arid region of China. Remote Sens. 2014, 6, 11494–11517. [Google Scholar] [CrossRef]
  97. Li, H.; Sun, D.L.; Yu, Y.Y.; Wang, H.Y.; Liu, Y.L.; Liu, Q.H.; Du, Y.M.; Wang, H.S.; Cao, B. Evaluation of the VIIRS and MODIS LST products in an arid area of Northwest China. Remote Sens. Environ. 2014, 142, 111–121. [Google Scholar] [CrossRef]
  98. Zhou, J.; Li, M.; Liu, S.M.; Jia, Z.Z.; Ma, Y.F. Validation and performance evaluations of methods for estimating land surface temperatures from ASTER data in the middle reach of the Heihe River Basin, Northwest China. Remote Sens. 2015, 7, 7126–7156. [Google Scholar] [CrossRef]
  99. Jiang, B.; Liang, S.L.; Ma, H.; Zhang, X.T.; Xiao, Z.Q.; Zhao, X.; Jia, K.; Yao, Y.J.; Jia, A.L. GLASS daytime all-wave net radiation product: Algorithm development and preliminary validation. Remote Sens. 2016, 8, 222. [Google Scholar] [CrossRef]
  100. Jia, A.L.; Jiang, B.; Liang, S.L.; Zhang, X.T.; Ma, H. Validation and Spatiotemporal Analysis of CERES Surface Net Radiation Product. Remote Sens. 2016, 8, 90. [Google Scholar] [CrossRef]
  101. Inamdar, A.K.; Guillevic, P.C. Net surface shortwave radiation from GOES imagery-product evaluation using ground-based measurements from SURFRAD. Remote Sens. 2015, 7, 10788–10814. [Google Scholar] [CrossRef]
  102. Pan, X.; Liu, Y.B.; Fan, X.W. Comparative assessment of satellite-retrieved surface net radiation: An examination on CERES and SRB datasets in China. Remote Sens. 2015, 7, 4899–4918. [Google Scholar] [CrossRef]
  103. Mira, M.; Olioso, A.; Gallego-Elvira, B.; Courault, D.; Garrigues, S.; Marloie, O.; Hagolle, O.; Guillevic, P.; Boulet, G. Uncertainty assessment of surface net radiation derived from Landsat images. Remote Sens. Environ. 2016, 175, 251–270. [Google Scholar] [CrossRef]
  104. Huang, G.H.; Li, X.; Huang, C.L.; Liu, S.M.; Ma, Y.F.; Chen, H. Representativeness errors of point-scale ground-based solar radiation measurements in the validation of remote sensing products. Remote Sens. Environ. 2016, 181, 198–206. [Google Scholar] [CrossRef]
  105. Huang, G.H.; Li, X.; Ma, M.G.; Li, H.Y.; Huang, C.L. High resolution surface radiation products for studies of regional energy, hydrologic and ecological processes over Heihe River Basin, northwest China. Agric. For. Meteorol. 2016. [Google Scholar] [CrossRef]
  106. Reich, P.B.; Turner, D.P.; Bolstad, P. An approach to spatially distributed modeling of net primary production (NPP) at the landscape scale and its application in validation of EOS NPP products. Remote Sens. Environ. 1999, 70, 69–81. [Google Scholar] [CrossRef]
  107. Turner, D.P.; Ritts, W.D.; Cohen, W.B.; Gower, S.T.; Zhao, M.; Running, S.W.; Wofsy, S.C.; Urbanski, S.; Dunn, A.L.; Munger, J.W. Scaling gross primary production (GPP) over boreal and deciduous forest landscapes in support of MODIS GPP product validation. Remote Sens. Environ. 2003, 88, 256–270. [Google Scholar] [CrossRef]
  108. Turner, D.P.; Ollinger, S.; Smith, M.L.; Krankina, O.; Gregory, M. Scaling net primary production to a MODIS footprint in support of Earth observing system product validation. Int. J. Remote Sens. 2004, 25, 1961–1979. [Google Scholar] [CrossRef]
  109. Turner, D.P.; Ritts, W.D.; Cohen, W.B.; Maeirsperger, T.K.; Gower, S.T.; Kirschbaum, A.A.; Running, S.W.; Zhao, M.S.; Wofsy, S.C.; Dunn, A.L. Site-level evaluation of satellite-based global terrestrial gross primary production and net primary production monitoring. Glob. Chang. Biol. 2005, 11, 666–684. [Google Scholar] [CrossRef]
  110. Clark, D.A.; Brown, S.; Kicklighter, D.W.; Chambers, J.Q.; Thomlinson, J.R.; Ni, J.; Holland, E.A. Net primary production in tropical forests: An evaluation and synthesis of existing field data. Ecol. Appl. 2001, 11, 371–384. [Google Scholar] [CrossRef]
  111. Wang, X.F.; Ma, M.G.; Li, X. Validation of MODIS GPP product at ten flux sites in northern China. Int. J. Remote Sens. 2013, 34, 587–599. [Google Scholar] [CrossRef]
  112. Wang, J.H.; Ge, Y.; Heuvelink, G.B.M.; Zhou, C.H. Spatial sampling design for estimating regional GPP with spatial heterogeneities. IEEE Geosci. Remote Sens. Lett. 2014, 11, 539–543. [Google Scholar] [CrossRef]
  113. Ran, Y.H.; Li, X.; Zhang, L.; Kljun, N.; Sun, R.; Wang, X.F.; Zhu, G.F. Spatial representativeness and uncertainty of eddy covariance carbon flux measurement for upscaling net ecosystem productivity to field scale. Agric. For. Meteorol. 2016, in press. [Google Scholar]
  114. Calders, K.; Schenkels, T.; Bartholomeus, H.; Armston, J.; Verbesselt, J.; Herold, M. Monitoring spring phenology with high temporal resolution terrestrial LiDAR measurements. Remote Sens. Environ. 2015, 203, 158–168. [Google Scholar] [CrossRef]
  115. Klosterman, S.T.; Hufkens, K.; Gray, J.M.; Melaas, E.; Sonnentag, O.; Lavine, I.; Mitchell, L.; Norman, R.; Friedl, M.A.; Richardson, A.D. Evaluating remote sensing of deciduous forest phenology at multiple spatial scales using PhenoCam imagery. Biogeosciences 2014, 11, 4305–4320. [Google Scholar] [CrossRef]
  116. Sakamoto, T.; Yokozawa, M.; Toritani, H.; Shibayama, M.; Ishitsuka, N.; Ohno, H. A crop phenology detection method using time-series MODIS data. Remote Sens. Environ. 2005, 96, 366–374. [Google Scholar] [CrossRef]
  117. Zhang, X.Y.; Friedl, M.A.; Schaaf, C.B.; Strahler, A.H.; Hodges, J.C.F.; Gao, F.; Reed, B.C.; Huete, A. Monitoring vegetation phenology using MODIS. Remote Sens. Environ. 2003, 84, 471–475. [Google Scholar] [CrossRef]
  118. Parajka, J.; Bloschl, G. Validation of MODIS snow cover images over Austria. Hydrol. Earth Syst. Sci. 2006, 10, 679–689. [Google Scholar] [CrossRef]
  119. Klein, A.G.; Barnett, A.C. Validation of daily MODIS snow cover maps of the Upper Rio Grande River Basin for the 2000–2001 snow year. Remote Sens. Environ. 2003, 86, 162–176. [Google Scholar] [CrossRef]
  120. Salomonson, V.V.; Appel, I. Development of the Aqua MODIS NDSI fractional snow cover algorithm and validation results. IEEE Trans. Geosci. Remote Sens. 2006, 44, 1747–1756. [Google Scholar] [CrossRef]
  121. Simic, A.; Fernandes, R.; Brown, R.; Romanov, P.; Park, W. Validation of VEGETATION, MODIS, and GOES + SSM/I snow-cover products over Canada based on surface snow depth observations. Hydrol. Process. 2004, 18, 1089–1104. [Google Scholar] [CrossRef]
  122. Hall, D.K.; Riggs, G.A. Accuracy assessment of the MODIS snow cover products. Hydrol. Process. 2007, 21, 1534–1547. [Google Scholar] [CrossRef]
  123. Maurer, E.P.; Rhoads, J.D.; Dubayah, R.O.; Lettenmaier, D.P. Evaluation of the snow-covered area data product from MODIS. Hydrol. Process. 2003, 17, 59–71. [Google Scholar] [CrossRef]
  124. Bi, Y.; Xie, H.; Huang, C.; Ke, C. Snow cover variations and controlling factors at upper Heihe River Basin, Northwestern China. Remote Sens. 2015, 7, 6741–6762. [Google Scholar] [CrossRef]
  125. Hou, J.L.; Huang, C.L. Improving mountainous snow cover fraction mapping via artificial neural networks combined with MODIS and ancillary topographic data. IEEE Trans. Geosci. Remote Sens. 2014, 52, 5601–5611. [Google Scholar]
  126. Li, H.Y.; He, Y.Q.; Hao, X.H.; Che, T.; Wang, J.; Huang, X.D. Downscaling snow cover fraction data in mountainous regions based on simulated inhomogeneous snow ablation. Remote Sens. 2015, 7, 8995–9019. [Google Scholar] [CrossRef]
  127. Bavera, D.; De Michele, C. Snow water equivalent estimation in the Mallero basin using snow gauge data and MODIS images and fieldwork validation. Hydrol. Process. 2009, 23, 1961–1972. [Google Scholar] [CrossRef]
  128. Anderton, S.P.; White, S.M.; Alvera, B. Evaluation of spatial variability in snow water equivalent for a high mountain catchment. Hydrol. Process. 2004, 18, 435–453. [Google Scholar] [CrossRef]
  129. Derksen, C.; Walker, A.; Goodison, B. Evaluation of passive microwave snow water equivalent retrievals across the boreal forest/tundra transition of western Canada. Remote Sens. Environ. 2005, 96, 315–327. [Google Scholar] [CrossRef]
  130. Derksen, C.; Toose, P.; Lemmetyinen, J.; Pulliainen, J.; Langlois, A.; Rutter, N.; Fuller, M.C. Evaluation of passive microwave brightness temperature simulations and snow water equivalent retrievals through a winter season. Remote Sens. Environ. 2012, 117, 236–248. [Google Scholar] [CrossRef]
  131. Dressler, K.A.; Leavesley, G.H.; Bales, R.C.; Fassnacht, S.R. Evaluation of gridded snow water equivalent and satellite snow cover products for mountain basins in a hydrologic model. Hydrol. Process. 2006, 20, 673–688. [Google Scholar] [CrossRef]
  132. Che, T.; Dai, L.Y.; Wang, J.; Zhao, K.; Liu, Q. Estimation of snow depth and snow water equivalent distribution using airborne microwave radiometry in the Binggou Watershed, the upper reaches of the Heihe River Basin. Int. J. Appl. Earth Obs. 2012, 17. [Google Scholar] [CrossRef]
  133. Brocca, L.; Hasenauer, S.; Lacava, T.; Melone, F.; Moramarco, T.; Wagner, W.; Dorigo, W.; Matgen, P.; Martinez-Fernandez, J.; Llorens, P. Soil moisture estimation through ASCAT and AMSR-E sensors: An intercomparison and validation study across Europe. Remote Sens. Environ. 2011, 115, 3390–3408. [Google Scholar] [CrossRef]
  134. Dorigo, W.A.; Gruber, A.; de Jeu, R.A.M.; Wagner, W.; Stacke, T.; Loew, A.; Albergel, C.; Brocca, L.; Chung, D.; Parinussa, R.M.; et al. Evaluation of the ESA CCI soil moisture product using ground-based observations. Remote Sens. Environ. 2015, 162, 380–395. [Google Scholar] [CrossRef]
  135. Jackson, T.J.; Cosh, M.H.; Bindlish, R.; Starks, P.J.; Bosch, D.D.; Seyfried, M.; Goodrich, D.C.; Moran, M.S.; Du, J. Validation of advanced microwave scanning radiometer soil moisture products. IEEE Trans. Geosci. Remote Sens. 2010, 48, 4256–4272. [Google Scholar] [CrossRef]
  136. Wagner, W.; Hahn, S.; Kidd, R.; Melzer, T.; Bartalis, Z.; Hasenauer, S.; Figa-Saldaña, J.; de Rosnay, P.; Jann, A.; Schneider, S.; et al. The ASCAT soil moisture product: A review of its specifications, validation results, and emerging applications. Meteorol. Z. 2013, 22, 5–33. [Google Scholar] [CrossRef]
  137. Feng, H.; Liu, Y.; Wu, G. Temporal variability of uncertainty in pixel-wise soil moisture: Implications for satellite validation. Remote Sens. 2015, 7, 5398–5415. [Google Scholar] [CrossRef]
  138. Jin, R.; Li, X.; Yan, B.P.; Li, X.H.; Luo, W.M.; Ma, M.G.; Guo, J.W.; Kang, J.; Zhu, Z.L.; Zhao, S.J. A nested ecohydrological wireless sensor network for capturing the surface heterogeneity in the midstream areas of the Heihe River Basin, China. IEEE Geosci. Remote Sens. Lett. 2014, 11, 2015–2019. [Google Scholar] [CrossRef]
  139. Kang, J.; Li, X.; Jin, R.; Ge, Y.; Wang, J.F.; Wang, J.H. Hybrid optimal design of the eco-hydrological wireless sensor network in the middle reach of the Heihe River Basin, China. Sensors 2014, 14, 19095–19114. [Google Scholar] [CrossRef] [PubMed]
  140. Kang, J.; Jin, R.; Li, X. Regression kriging-based upscaling of soil moisture measurements from a wireless sensor network and multiresource remote sensing information over heterogeneous cropland. IEEE Geosci. Remote Sens. Lett. 2015, 12, 92–96. [Google Scholar] [CrossRef]
  141. Wang, J.H.; Ge, Y.; Song, Y.Z.; Li, X. A geostatistical approach to upscale soil moisture with unequal precision observations. IEEE Geosci. Remote Sens. Lett. 2014, 11, 2125–2129. [Google Scholar] [CrossRef]
  142. Wang, J.H.; Ge, Y.; Heuvelink, G.B.M.; Zhou, C. Upscaling in situ soil moisture observations to pixel averages with spatio-temporal geostatistics. Remote Sens. 2015, 7, 11372–11388. [Google Scholar] [CrossRef]
  143. Chander, G.; Groeneveld, D.P. Intra-annual NDVI validation of the Landsat 5 TM radiometric calibration. Int. J. Remote Sens. 2009, 30, 1621–1628. [Google Scholar] [CrossRef]
  144. Simoniello, T.; Cuomo, V.; Lanfredi, M.; Lasaponara, R.; Macchiato, M. On the relevance of accurate correction and validation procedures in the analysis of AVHRR-NDVI time series for long-term monitoring. J. Geophys. Res. 2004, 109. [Google Scholar] [CrossRef]
  145. Haboudane, D.; Miller, J.R.; Pattey, E.; Zarco-Tejada, P.J.; Strachan, I. Hyperspectral vegetation indices and novel algorithms for predicting green LAI of crop canopies: Modeling and validation in the context of precision agriculture. Remote Sens. Environ. 2004, 90, 337–352. [Google Scholar] [CrossRef]
  146. Gao, X.; Huete, A.R.; Didan, K. Multisensor comparisons and validation of MODIS vegetation indices at the semiarid Jornada experimental range. IEEE Trans. Geosci. Remote Sens. 2003, 41, 2368–2381. [Google Scholar]
  147. Meng, J.H.; Wu, B.F.; Chen, X.Y.; Du, X.; Niu, L.M.; Zhang, F.F. Validation of HJ-1 B charge-coupled device vegetation index products with spectral reflectance of Hyperion. Int. J. Remote Sens. 2011, 32, 9051–9070. [Google Scholar] [CrossRef]
  148. Geng, L.Y.; Ma, M.G.; Yu, W.P.; Wang, X.F.; Jia, S.Z. Validation of the MODIS NDVI products in different land-use types using in situ measurements in the Heihe River Basin. IEEE Geosci. Remote Sens. Lett. 2014, 11, 1649–1653. [Google Scholar] [CrossRef]
  149. Ding, Y.L.; Zhao, K.; Zheng, X.M.; Jiang, T. Temporal dynamics of spatial heterogeneity over cropland quantified by time-series NDVI, near infrared and red reflectance of Landsat 8 OLI imagery. Int. J. Appl. Earth Obs. 2014, 30, 139–145. [Google Scholar] [CrossRef]
  150. Wulder, M.A.; White, J.C.; Magnussen, S.; McDonald, S. Validation of a large area land cover product using purpose-acquired airborne video. Remote Sens. Environ. 2007, 106, 480–491. [Google Scholar] [CrossRef]
  151. Foody, G.M.; Boyd, D.S. Using volunteered data in land cover map validation: Mapping west African forests. IEEE J. Sel. Top. Appl. Remote Sens. 2013, 6, 1305–1312. [Google Scholar] [CrossRef]
  152. Bai, Y.; Feng, M.; Jiang, H.; Wang, J.L.; Liu, Y.Z. Validation of land cover maps in China using a sampling-based labeling approach. Remote Sens. 2015, 7, 10589–10606. [Google Scholar] [CrossRef]
  153. Shi, W.Z.; Zhang, X.K.; Hao, M.; Shao, P.; Cai, L.P.; Lyu, X.Z. Validation of land cover products using reliability evaluation methods. Remote Sens. 2015, 7, 7846–7864. [Google Scholar] [CrossRef]
  154. Ran, Y.H.; Li, X.; Lu, L. Evaluation of four remote sensing based land cover products over China. Int. J. Remote Sens. 2010, 31, 391–401. [Google Scholar] [CrossRef]
  155. Hu, X.L.; Lu, L.; Li, X.; Wang, J.H.; Guo, M. Land use/cover change in the middle reaches of the Heihe River Basin over 2000–2011 and its implications for sustainable water resource management. PLoS ONE 2015, 10. [Google Scholar] [CrossRef] [PubMed]
  156. Zhong, B.; Yang, A.X.; Nie, A.H.; Yao, Y.J.; Zhang, H.; Wu, S.L.; Liu, Q.H. Finer resolution land-cover mapping using multiple classifiers and multisource remotely sensed data in the Heihe River Basin. IEEE J. Sel. Top. Appl. Remote Sens. 2015, 8, 4973–4992. [Google Scholar] [CrossRef]
  157. Zhang, T.; Armstrong, R.L.; Smith, J. Investigation of the near-surface soil freeze-thaw cycle in the contiguous United States: Algorithm development and validation. J. Geophys. Res. 2003, 108. [Google Scholar] [CrossRef]
  158. Eitzinger, J.; Parton, W.J.; Hartman, M. Improvement and validation of a daily soil temperature submodel for freezing/thawing periods. Soil Sci. 2000, 165, 525–534. [Google Scholar] [CrossRef]
  159. Entekhabi, D.; Njoku, E.G.; Houser, P.; Spencer, M.; Doiron, T.; Kim, Y.J.; Smith, J.; Girard, R.; Belair, S.; Crow, W. The hydrosphere state (Hydros) satellite mission: An earth system pathfinder for global mapping of soil moisture and land freeze/thaw. IEEE Trans. Geosci. Remote Sens. 2004, 42, 2184–2195. [Google Scholar] [CrossRef]
  160. Han, M.L.; Yang, K.; Qin, J.; Jin, R.; Ma, Y.M.; Wen, J.; Chen, Y.Y.; Zhao, L.; Zhu, L.; Tang, W.J. An algorithm based on the standard deviation of passive microwave brightness temperatures for monitoring soil surface freeze/thaw state on the Tibetan Plateau. IEEE Trans. Geosci. Remote Sens. 2015, 53, 2775–2783. [Google Scholar] [CrossRef]
  161. Ge, Y.; Li, X.; Hu, M.G.; Wang, J.H.; Jin, R.; Wang, J.F.; Zhang, R.H. Technical specification for the validation of remote sensing products. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2013, XL-2/W1, 13–17. [Google Scholar] [CrossRef]
  162. Wang, J.F.; Christakos, G.; Hu, M.G. Modeling spatial means of surfaces with stratified non-homogeneity. IEEE Trans. Geosci. Remote Sens. 2009, 47, 4167–4174. [Google Scholar] [CrossRef]
  163. Hu, M.G.; Wang, J.F. A spatial sampling optimization package using MSN theory. Environ. Model. Softw. 2011, 26, 546–548. [Google Scholar] [CrossRef]
  164. Ge, Y.; Wang, J.H.; Heuvelink, G.B.M.; Jin, R.; Li, X.; Wang, J.F. Sampling design optimization of a wireless sensor network for monitoring ecohydrological processes in the Babao River basin, China. Int. J. Geogr. Inf. Sci. 2014. [Google Scholar] [CrossRef]
  165. You, D.; Wen, J.; Xiao, Q.; Liu, Q.; Liu, Q.; Tang, Y.; Dou, B.; Peng, J. Development of a high resolution BRDF/Albedo product by fusing airborne CASI reflectance with MODIS daily reflectance in the oasis area of the Heihe River Basin, China. Remote Sens. 2015, 7, 6784–6807. [Google Scholar] [CrossRef]
  166. Li, X.; Jin, R.; Liu, S.M.; Ge, Y.; Xiao, Q.; Liu, Q.H.; Ma, M.G.; Ran, Y.H. Upscaling researches in HiWATER: Progresses and prospects. J. Remote Sens. 2016. [Google Scholar] [CrossRef]
  167. Cheng, G.D.; Li, X.; Zhao, W.Z.; Xu, Z.M.; Feng, Q.; Xiao, S.C.; Xiao, H.L. Integrated study of the water-ecosystem-economy in the Heihe River Basin. Natl. Sci. Rev. 2014, 1, 413–428. [Google Scholar] [CrossRef]
  168. Han, X.J.; Jin, R.; Li, X.; Wang, S.G. Soil moisture estimation using Cosmic-Ray soil moisture sensing at heterogeneous farmland. IEEE Geosci. Remote Sens. Lett. 2014, 11, 1659–1663. [Google Scholar]
  169. Ma, M.G.; Che, T.; Li, X.; Xiao, Q.; Zhao, K.; Xin, X.P. A prototype network for remote sensing validation in China. Remote Sens. 2015, 7, 5187–5202. [Google Scholar] [CrossRef]
Figure 1. The overall validation strategy. WSN stands for wireless sensor network.
Figure 1. The overall validation strategy. WSN stands for wireless sensor network.
Remotesensing 08 00980 g001
Figure 2. Sketch map of the two levels of validation considered in the validation guidelines [161].
Figure 2. Sketch map of the two levels of validation considered in the validation guidelines [161].
Remotesensing 08 00980 g002
Figure 3. The setup of the EHWSN deployed in the Yingke and Daman irrigation districts in the middle stream of the HRB. The left panel shows the location, KEAs, and validation sites identified of the HRB. The right panel shows the EHWSN.
Figure 3. The setup of the EHWSN deployed in the Yingke and Daman irrigation districts in the middle stream of the HRB. The left panel shows the location, KEAs, and validation sites identified of the HRB. The right panel shows the EHWSN.
Remotesensing 08 00980 g003
Figure 4. Sketch map of anchor sites in the validation network [169].
Figure 4. Sketch map of anchor sites in the validation network [169].
Remotesensing 08 00980 g004
Figure 5. The structure and workflow of the validation system of the LAPVAS.
Figure 5. The structure and workflow of the validation system of the LAPVAS.
Remotesensing 08 00980 g005
Table 1. Land surface variables to be validated. The RS observation method refers to the commonly used satellite-based technique.
Table 1. Land surface variables to be validated. The RS observation method refers to the commonly used satellite-based technique.
Types of RSPsVariablesRS Observation MethodSpatial ResolutionPrevious StudiesOur Validation Efforts (Basic Information and References)
Continuous productAlbedoVNIR *30 m–1 km[39,45,46,47,48,49,50,51,52]Multi-scale validation strategy for satellite albedo products [53];
Optimal nodes selectiveness from WSN to fit field scale albedo observation and validation [54]
EmissivityTIR90 m–1 km[11,55,56,57,58,59,60]N/A
ETVNIR, TIR30 m–1 km[61,62,63,64,65]Measurements of ET from EC and LAS systems [66] and validation of remotely sensed ET [67] in the Hai River Basin;
A flux observation matrix was established over the HRB [68];
Estimating and validating soil evaporation and crop transpiration [69,70];
Upscaling ET measurements from the field to larger scales [71,72];
A framework for validating remotely sensed ET [73];
Characterising the footprint of EC and LAS measurements to validate satellite-based surface fluxes [74]
FAPARVNIR30 m–1 km[75,76,77,78,79,80]Scaling of remotely sensed and measured FAPAR [81,82]
FCoverVNIR30 m–1 km[75,76,77,78]Evaluation of sampling methods for validation of remotely sensed FCover [83]
LAIVNIR, LiDAR30 m–1 km[43,75,76,77,78,84,85]Assessment of the MODIS LAI product in the meadow steppe [86];
Sampling strategy for observing and validating remotely sensed LAI product over heterogeneous land surface [87,88];
Development of a WSN used for validating LAI products [89];
Upscaling algorithm to obtain ground truth of LAI time series over heterogeneous land surface [90]
LSTTIR90 m–1 km[11,55,58,60,91,92,93]Evaluation of LST retrieval from FY-3B/VIRR data [94];
Analysis of scale mismatch between in situ and remote sensing LST product [95];
Evaluation and validation of the MODIS LST in arid regions of China [96,97];
Validation of LST estimated from ASTER data in the HRB [98]
Net radiationVNIR, TIR30 m–1 km[99,100,101,102,103]Analysis of representativeness errors of point-scale ground-based solar radiation measurements in the validation of RSPs [104];
A framework to obtain high resolution surface radiation products [105]
Continuous productNPPVNIR, LiDAR30 m–1 km[106,107,108,109,110]Validation of MODIS GPP product at ten flux sites in northern China [111];
Spatial sampling design for estimating regional GPP [112];
Analysis of spatial representativeness and uncertainty of flux measurement for upscaling ecosystem productivity to field scale [113]
PhenologyVNIR, LiDAR30 m–1 km[114,115,116,117]N/A
Snow cover areaVNIR30 m–1 km[118,119,120,121,122,123]Analysis of snow cover variations and controlling factors at upper HRB [124];
Improving mountainous snow cover fraction mapping [125];
Downscaling snow cover fraction data in mountainous regions [126]
Snow water equivalentPassive microwave1–25 km[127,128,129,130,131]Estimation of snow depth and snow water equivalent distribution using airborne microwave radiometry [132]
Soil moistureActive/passive microwave1–25 km[17,23,40,133,134,135,136]Analysis of temporal variability of uncertainty in pixel-wise soil moisture [137];
Design and establishment of WSN for capturing soil moisture over heterogeneous land surface [138,139];
Upscaling in situ soil moisture observations to pixel averages [140,141,142]
Vegetation indexVNIR30 m–1 km[143,144,145,146,147]Validation of the MODIS NDVI products in the HRB [148];
Analysis of temporal dynamics of spatial heterogeneity of NDVI [149]
Categorical productLUCCVNIR30 m–1 km[150,151,152,153,154]LUCC in the middle reaches of the HRB over 2000-2011 [155];
Finer resolution land-cover mapping in the HRB [156]
Soil freeze/thaw statusActive/passive microwave1–25 km[18,157,158,159]Monitoring soil surface freeze/thaw state on the Tibetan Plateau [160]
* VNIR: visible and near infrared; TIR: thermal infrared; ET: evapotranspiration; EC: eddy covariance; LAS: large aperture scintillometer; HRB: Heihe River Basin; FAPAR: fraction of photosynthetically active radiation; FY: Fengyun meteorological satellite; LAI: leaf area index; LiDAR: light detection and ranging; LST: land surface temperature; NPP: net primary product; GPP: gross primary product; NDVI: normalised difference vegetation index; and LUCC: land use and land cover change.
Table 2. Summary information of core observation stations in the validation network [169].
Table 2. Summary information of core observation stations in the validation network [169].
Station NameCore Site and SizeLocationMeteorologyLand CoverScientific Aims
Huailai StationEast garden controlled experimental site
100 m × 100 m
Prov.: Hebei;
Long.: 115.783;
Lat.: 40.349;
Ele.: 488
Precip.: 650; Temp.: 10Type: Cropland; LAI: 6.5Remote sensing mechanism; scale approach
East garden
1.5 km × 2 km
Prov.: Hebei;
Long.: 115.783;
Lat.: 40.349;
Ele.: 488
Precip.: 650; Temp.: 10Type: Cropland; LAI: 6.5Remote sensing mechanism; ecological protection; crop growth simulation model
Guanting reservoir
2 km × 2 km
Prov.: Hebei;
Long.: 115.740;
Lat.: 40.352;
Ele.: 475
Precip.: 650; Temp.: 9Type: Water; LAI: 0Ecological protection; water resource utilization
Jingyuetan StationTaipingpu controlled experimental site
200 m × 200 m
Prov.: Jilin;
Long.: 125.401;
Lat.: 43.998;
Ele.: 211
Precip.: 520; Temp.: 4.4Type: Cropland; LAI: 4Radiative transfer theory; soil freeze/thaw process; scale approach
Dehui corn
2 km × 2 km
Prov.: Jilin;
Long.: 125.360;
Lat.: 44.119;
Ele.: 207
Precip.: 604; Temp.: 4.8Type: Cropland; LAI: 5Validation; water balance; crop simulation growth model
Hulunber StationStipa baicalensis site
3 km × 3 km
Prov.: Inner Mongolia;
Long.: 120.087;
Lat.: 49.342;
Ele.: 642
Precip.: 380; Temp.: −1.0Type: Temperate meadow steppe; LAI: 2.5Validation; grassland ecosystem process model
Cropland site
3 km × 3 km
Prov.: Inner Mongolia;
Long.: 120.034;
Lat.: 49.308;
Ele.: 638
Precip.: 380; Temp.: −1.0Type: Cropland; LAI: 4Validation; crop simulation growth model
Precip.: Annual averaged precipitation (mm); Temp.: Annual averaged temperature (°C); Prov.: Province; Long.: Longitude (°E); Lat.: Latitude (°N); Ele.: Elevation (m).

Share and Cite

MDPI and ACS Style

Wang, S.; Li, X.; Ge, Y.; Jin, R.; Ma, M.; Liu, Q.; Wen, J.; Liu, S. Validation of Regional-Scale Remote Sensing Products in China: From Site to Network. Remote Sens. 2016, 8, 980. https://doi.org/10.3390/rs8120980

AMA Style

Wang S, Li X, Ge Y, Jin R, Ma M, Liu Q, Wen J, Liu S. Validation of Regional-Scale Remote Sensing Products in China: From Site to Network. Remote Sensing. 2016; 8(12):980. https://doi.org/10.3390/rs8120980

Chicago/Turabian Style

Wang, Shuguo, Xin Li, Yong Ge, Rui Jin, Mingguo Ma, Qinhuo Liu, Jianguang Wen, and Shaomin Liu. 2016. "Validation of Regional-Scale Remote Sensing Products in China: From Site to Network" Remote Sensing 8, no. 12: 980. https://doi.org/10.3390/rs8120980

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop