Next Article in Journal
3D Digitisation of Large-Scale Unstructured Great Wall Heritage Sites by a Small Unmanned Helicopter
Previous Article in Journal
Estimating FAPAR of Rice Growth Period Using Radiation Transfer Model Coupled with the WOFOST Model for Analyzing Heavy Metal Stress
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluation of the Latest MODIS GPP Products across Multiple Biomes Using Global Eddy Covariance Flux Data

1
Laboratory of Critical Zone Evolution, School of Earth Sciences, China University of Geosciences, Wuhan 430074, China
2
School of Resource and Environmental Science, Wuhan University, Wuhan 430079, China
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Remote Sens. 2017, 9(5), 418; https://doi.org/10.3390/rs9050418
Submission received: 22 March 2017 / Revised: 17 April 2017 / Accepted: 27 April 2017 / Published: 29 April 2017

Abstract

:
The latest MODIS GPP (gross primary productivity) product, MOD17A2H, has great advantages over the previous version, MOD17A2, because the resolution increased from 1000 m to 500 m. In this study, MOD17A2H GPP was assessed using the latest eddy covariance (EC) flux data (FLUXNET2015 Dataset) at eighteen sites in six ecosystems across the globe. The sensitivity of MOD17A2H GPP to the meteorology dataset and the fractional photosynthetically- active radiation (FPAR) product was explored by introducing site meteorology observations and improved Global Land Surface Satellite (GLASS) Leaf Area Index (LAI) products. The results showed that MOD17A2H GPP underestimated flux-derived GPP at most sites. Its performance in estimating annual GPP was poor (R2 = 0.62) and even worse over eight days (R2 = 0.52). For the MOD17A2H algorithm, replacing the reanalysis meteorological datasets with the site meteorological measurements failed to improve the estimation accuracies. However, great improvements in estimating the site-based GPP were gained by replacing MODIS FPAR with GLASS FPAR. This indicated that in the existing MOD17A2H product, the errors were originated more from FPAR than the meteorological data. We further examined the potential error contributions from land cover classification and maximum light use efficiency (εmax). It was found that the current land cover classification scheme exhibited frequent misclassification errors. Moreover, the εmax value assigned in MOD17A2H was much smaller than the inferred εmax value. Therefore, the qualities of FPAR and land cover classification datasets should be upgraded, and the εmax value needs to be adjusted to provide more accurate GPP estimates using MOD17A2H for global ecosystems.

Graphical Abstract

1. Introduction

GPP, the total photosynthetic uptake of carbon by vegetation, plays a key role in understanding the carbon balance between the atmosphere and biosphere [1,2]. The magnitude of GPP also defines the ability to produce critical ecosystem services, notably fuel, food, fiber and materials for the construction industry [3]. Therefore, quantifying of the spatial-temporal characteristics of GPP has received great attention in the field of global change studies [4,5,6].
GPP values can be estimated from satellite remote sensing products [7,8,9]. The first consistent, near-real-time GPP dataset allowing the estimation of global vegetation in an eight-day interval at 1-km resolution is the MOD17A2 MODIS product [10,11]. The MODIS GPP data correlated well with the GPP records from twelve flux towers across North America, indicating that MOD17A2 is a reliable data source [12]. Even so, there are still many potential error sources in MODIS GPP products arising from input data, the parameters describing the biophysical properties of vegetation and the algorithm itself [13,14]. Firstly, the spatial resolution of meteorological reanalysis data is quite different from that of MODIS products, which introduces inaccuracies in estimating atmospheric conditions at a scale that matches heterogeneities in the land surface [15]. Secondly, estimation of the FPAR cannot be accurately achieved because the MODIS Leaf Area Index (LAI) is poorly correlated with ground measurements of the vegetation canopy [16]. Thirdly, the land cover classification provided by MODIS is not always accurate, and the misclassifications are quite common for similar land cover classes [17]. Finally, the use of a constant value attributed to the maximum value for light use efficiency (LUE) cannot be justified for the same biome type [18]. All sources of error mentioned above (meteorological data, FPAR product, land cover classification result and LUE value) require separate examination on an individual basis [19].
The analysis of errors arising from the MODIS GPP product is difficult because of inherent limitations in directly measuring GPP values. For the present, the eddy covariance (EC) technique is the frequently-used approach [20,21,22]. By performing comparisons between MODIS GPP products and EC flux-derived GPP measurements, much validation work has been conducted to evaluate the accuracies of previous MOD17A2 products [23,24]. GPP values from MOD17A2 were comprehensively compared with GPP measurements from flux towers at fifteen research sites across North America by Heinsch et al. (2006) [25]. Their results showed that MOD17A2 GPP on average overestimated the site-based GPP by 20–30%. Moreover, the effectiveness of MOD17A2 GPP in Africa was also evaluated by using site meteorological measurements and flux-derived GPP at twelve flux tower sites. The results suggested that GPP values from MOD17A2 agreed with those from the flux towers in wet sites, but were much smaller in dry sites [26].
For MODIS GPP products, many validation efforts have promoted updates and continuous improvements to MOD17A2 [27]. Note that the latest MOD17A2H product has essential advantages over the previous version (MOD17A2) because the resolution increased for the first time from 1000 m to 500 m. The major feature of MOD17A2H is its innovation in two sources of input data: meteorological data and FPAR products [28]. Firstly, GMAO (Global Modeling and Assimilation Office) reanalysis data substitutes DAO (Data Assimilation Office) reanalysis data to estimate the actual values of meteorological elements. Secondly, the latest MODIS FPAR product, MOD15A2H, substitutes the previous version, MOD15A2, to estimate the actual values of FPAR and to enable improvement in spatial resolution from 1000 m to 500 m.
It was uncertain whether the improvements of MOD17A2H over MO17A2 could estimate GPP more accurately, which will attract great attention from researchers around the world. In this context, the evaluation of MOD17A2H GPP becomes an essential work. Currently, FLUXNET has released the latest global flux dataset, FLUXNET2015 [29]. It is clear that the latest EC flux dataset can provide a more accurate reference standard for the validation of MOD17A2H GPP. Therefore, it is of great significance to verify the latest MOD17A2H product using the latest FLUXNET2015 dataset.
In this study, we evaluated MOD17A2H GPP using the FLUXNET2015 dataset at eighteen sites in six biome types around the world (Table 1). Not only the eight-day and annual MODIS GPP values were systematically verified against the flux-derived GPP measurements, but also the role of each input variable was carefully analyzed. The objectives of this study were to assess the performance of MOD17A2H on a global scale by comparisons with EC flux-derived GPP measurements and to explore sources of error among all input parameters (meteorological data, FPAR product, land cover classification result and LUE value).

2. Materials and Methods

2.1. Materials

2.1.1. MOD17A2H GPP Algorithm

Based on the rationale originally described by Monteith (1972) [30], the MOD17A2H GPP algorithm can be expressed as:
GPP = ε × FPAR × PAR
where FPAR is the fraction of PAR (MJ·m−2·d−1), and PAR can be calculated from the total shortwave solar radiation (SWRad, MJ·m−2·d−1):
PAR = 0.45 × SWRad
The magnitude of LUE ε (gC·m−2·d−1·MJ−1) in Equation (1) is calculated as:
ε = εmax × Ts × VPDs
where εmax (gC·m−2·d−1·MJ−1) is the maximum LUE specified by the Biome Properties Look-Up Table (BPLUT) based on biome type, and Ts and VPDs are the attenuation scalars influenced by daily minimum temperature (Tmin, °C) and daytime vapor pressure deficit (VPDavg, Pa), respectively [31,32,33].
The MODIS images from 2001–2014 were downloaded from the NASA Land Processes Distributed Active Archive Center [34]. Based on the geographical coordinates of the flux tower sites, 5 km × 5 km cut-outs centered over every site location were extracted to represent: (1) land cover classification (MCD12Q1, Collection 5.1, annual product with 500-m spatial resolution); (2) FPAR (MOD15A2H, Collection 6, eight-day product with 500-m spatial resolution); and (3) GPP (MOD17A2H, Collection 6, eight-day product with 500-m spatial resolution).

2.1.2. GMAO Meteorological Reanalysis Data

The MODIS GPP Collection 6 (MOD17A2H, C6) data used in this paper implement Global Modeling and Assimilation Office (GMAO) Reanalysis data for direct meteorological inputs. The current version of GMAO is an hourly time step dataset with 0.5 latitude degree by 0.625 longitude degree resolution. For every flux tower site, hourly meteorological data including air temperature (Tair, °C), specific humidity (SH, kg·kg−1), surface pressure (Pres, Pa) and SWRad (W·m−2) during 2001–2014 were downloaded from NASA Goddard Space Flight Center [35]. Through data preprocessing, key parameters including the daily average air temperature (Tavg, °C), daily minimum air temperature (Tmin, °C), daytime average VPD (VPDavg, Pa) and daily total SWRad (MJ·m−2·d−1) were obtained at a 0.5° × 0.625° spatial resolution. Using a spatial nonlinear interpolation scheme developed by Zhao et al. (2005) [12], we further interpolated the GMAO data down to the 500-m MOD17A2H pixel spatial resolution. In order to make comparisons between reanalysis meteorological data and observed meteorological data, the same spatial nonlinear interpolation method was also employed to interpolate the GMAO data to EC flux tower locations [36].

2.1.3. GLASS LAI Data

FPAR is a critical component of the MOD17A2H GPP algorithm. In this study, we introduced the GLASS LAI product to assess the influences of FPAR on the effectiveness of MO17A2H GPP. In previous studies [37,38,39], it had been proven that the GLASS LAI product could provide better estimates of LAI than existing MODIS and CYCLOPES LAI datasets. For each EC flux tower site, the GLASS LAI subsets (eight-day interval at a spatial resolution of 0.05° ×0.05°) during 2001–2014 were downloaded from the Generation and Applications of Global Products of Essential Land Variables website [40]. We interpolated the GLASS LAI product down to the 500-m MOD15A2H pixel spatial resolution using a spatial nonlinear interpolation method (the same as the GMAO data). Based on the Beer’s law approach, we converted GLASS LAI (m2·m−2) to GLASS FPAR by following equation:
FPAR = 1 − e(−K)×LAI
where K is the light extinction coefficient of canopy, which is set to 0.5 [41].

2.1.4. EC Flux Data

The performance of MOD17A2H GPP on eighteen EC flux tower sites, including evergreen needleleaf forests (ENF), evergreen broadleaf forests (EBF), deciduous broadleaf forests (DBF), mixed forests (MF), croplands (CRO) and grasslands (GRA), was evaluated in this study (Table 1). These eighteen sites are Virasoro (AR-Vir), Alice Springs (AU-ASM), Riggs Creek (AU-Rig), Whroo (AU-Whr), Lonzee (BE-Lon), Vielsalm (BE-Vie), Santarem-Km83-Logged Forest (BR-Sa3), Ontario- Groundhog River (CA-Gro), Bily Kriz-grassland (CZ-BK2), Hainich (DE-Hai), Soroe-LilleBogeskov (DK-Sor), Grignon (FR-Gri), Puechabon (FR-Pue), Ankasa (GH-Ank), Renon/Ritten (IT-Ren), Sardinilla Pasture (PA-SPs), Curtice Walter-Berger cropland (US-CRT) and Walnut Gulch Kendall Grasslands (US-Wkg). The detailed information for each site is available at the FLUXNET-Fluxdata website [42].
From the FLUXNET-Fluxdata website, we downloaded the newest FLUXNET2015 dataset to obtain site meteorological data and GPP measurements during 2001–2014 for each flux tower site. The daily meteorological data (Tavg, Tmin, PAR and VPDavg) were calculated from the half-hourly site meteorological measurements, and the daily GPP values were calculated from the half-hourly flux-derived GPP. We then obtained the eight-day site-based GPP by accumulating the daily calculations to ensure that our data remained consistent with the 8-day interval of the MOD17A2H GPP products.

2.2. Methods

2.2.1. Experimental Design

To distinguish the impacts of meteorological data and FPAR on MOD17A2H GPP, we conducted the following four groups of experiments to recalculate GPP under dissimilar circumstances: (1) GMAO meteorology data and MOD15A2H FPAR were chosen as meteorology inputs and FPAR inputs, respectively (MOD_GMAO GPP) (the same as the standard MOD17A2H algorithm); (2) using site meteorological data as meteorology inputs and MOD15A2H FPAR as FPAR inputs (MOD_Tower GPP); (3) GMAO meteorology data were used as meteorology inputs, and GLASS FPAR were introduced as FPAR inputs (GMAO_GLASS GPP); (4) using site meteorological data and GLASS FPAR to estimate GPP (Tower_GLASS GPP). At last, the four types of GPP estimates were compared with GPP values measured by EC flux tower sites (Flux_Tower GPP), respectively.

2.2.2. Analytical Methods

Three statistical indices, including the coefficient of determination (R2), bias and root mean square error (RMSE, %), were calculated to assess accuracies and uncertainties. The value of R2 denoted the amount of variation in the measurements that could be predicted by the estimates, and the value of bias expresses the differences between the estimates and the measurements. The value of RMSE was computed by:
RMSE   ( % ) = 1 M ¯ × 1 n × i = 1 n ( E i M i ) 2 × 100
where M ¯ was the mean value of the measurements and Ei and Mi are the estimated and measured values, respectively.

3. Results

3.1. GPP Validation

3.1.1. Eight-Day GPP

The eight-day Flux_Tower GPP were compared with the results of MOD_GMAO GPP, MOD_Tower GPP, GMAO_GLASS GPP and Tower_GLASS GPP (Figure 1, Table 2). In general, the MOD_Tower GPP algorithm (R2 = 0.52) did not result in obvious improvements in fitting the Flux_Tower GPP when comparing with the MOD_GMAO GPP algorithm (R2 = 0.52). However, the GMAO_GLASS GPP algorithm (R2 = 0.63) and the Tower_GLASS GPP algorithm (R2 = 0.65) made considerable improvements, and the Tower_GLASS GPP algorithm exhibited the best estimating effectiveness. It should be noted that all of the above four algorithms underestimated the Flux_Tower GPP to varying degrees. The degrees of underestimation by the MOD_GMAO GPP (−11 gC·m−2·8-d−1), MOD_Tower GPP (−13 gC·m−2·8-d−1) and Tower_GLASS GPP (−11 gC·m−2·8-d−1) algorithms were larger than that by the GMAO_GLASS GPP algorithm (−8 gC·m−2·8-d−1).
From the perspective of individual sites, the four algorithms (MOD_GMAO GPP, MOD_Tower GPP, GMAO_GLASS GPP and Tower_GLASS GPP) underestimated the Flux_Tower GPP more obviously (Figure 2). The Flux_Tower GPPs were underestimated by above four algorithms at 15 of the 18 sites. For the remaining three sites (AU-ASM, AU-Whr and US-Wkg), GMAO_GLASS GPP and the Tower_GLASS GPP algorithms still underestimated the site-based GPP. In detail, AR-Vir, BR-Sa3 and PA-SPs suffered the highest degree of underestimation by the four algorithms (Figure 2a,g,p, respectively), and CA-Gro, CZ-BK2 and FR-Pue suffered the lowest degree of underestimation (Figure 2h,I,m, respectively). With respect to the estimating effectiveness of the four algorithms, the MOD_GMAO GPP, MOD_Tower GPP, GMAO_GLASS GPP and Tower_GLASS GPP algorithms fitted relatively effectively for one site (US-Wkg), two sites (AU-Rig and AU-Whr), ten sites (AU-ASM, BE-Lon, BE-Vie, CA-Gro, CZ-BK2, DK-Sor, FR-Gri, FR-Pue, IT-Ren and PA-SPs) and four sites (AR-Vir, DE-Hai, GH-Ank and US-CRT), respectively. None of the four algorithms successfully fitted the Flux_Tower GPP for BR-Sa3 (Figure 2g). The GMAO_GLASS GPP algorithm had a relative advantage in terms of bias (−14 gC·m−2·8-d−1).
The eight-day GPP values of MOD_GMAO GPP, MOD_Tower GPP, GMAO_GLASS GPP and Tower_GLASS GPP were also compared with the Flux_Tower GPP at different biome types (Table 2). As the analyses of individual sites showed, all above algorithms underestimated the Flux_Tower GPP for all six biome types. In detail, deciduous broadleaf forests (DBF) suffered the highest degree of underestimation, mainly because the four algorithms seriously underestimated the Flux_Tower GPP of DE-Hai (Figure 2j) and DK-Sor (Figure 2k). In contrast, the degree of underestimation was low for grasslands (GRA). This could be largely attributed to the fact that the four algorithms effectively estimated the Flux_Tower GPP of CZ-BK2 (Figure 2i) and US-Wkg (Figure 2r). With respect to the estimating effectiveness of the four algorithms, the GMAO_GLASS GPP and Tower_GLASS GPP algorithms were superior to the MOD_GMAO GPP and MOD_Tower GPP algorithms across all six biome types. The GMAO_GLASS GPP algorithm provided the smallest values of bias for all biomes, and the Tower_GLASS GPP algorithm exhibited the highest values of R2 for most biomes, except croplands (CRO); for croplands, no algorithm fitted the Flux_Tower GPP more effectively than the GMAO_GLASS GPP algorithm because it provided the highest value of R2 (0.35) and the lowest values of both bias (−5 gC·m−2·8-d−1) and RMSE (89%).

3.1.2. Annual GPP

The Flux_Tower GPP werecompared with the calculations from MOD_GMAO GPP, MOD_Tower GPP, GMAO_GLASS GPP and Tower_GLASS GPP during 2001–2014. (Figure 3, Table 3). The annual average value of the Flux_Tower GPP and the above four algorithms across all the sites was 1460 gC·m−2·y−1, 976 gC·m−2·y−1, 869 gC·m−2·y−1, 1126 gC·m−2·y−1 and 987 gC·m−2·y−1, respectively. The Flux_Tower GPP for AR-Vir, BR-Sa3, GH-Ank and PA-SPs were especially severely underestimated (Figure 3a,b) by the MOD_GMAO GPP and MOD_Tower GPP algorithms, which led to large biases (−484 gC·m−2·y−1 for MOD_GMAO GPP and −591 gC·m−2·y−1 for MOD_Tower GPP). With respect to the estimating effectiveness, the GMAO_GLASS GPP algorithm showed the greatest performance because it yielded the highest value of R2 (0.79) and the lowest values of bias (−334 gC·m−2·y−1) and RMSE (32%).
The flux derived GPP values (Flux_Tower GPP) at various biome types were also compared with the calculations of the four algorithms (MOD_GMAO GPP, MOD_Tower GPP, GMAO_GLASS GPP and Tower_GLASS GPP) over several years (Table 3). In the case of ENF, the Tower_GLASS GPP algorithm exhibited a significant correlation (R2 = 0.91) and relatively underestimated the Flux_Tower GPP less (bias = −458 gC·m−2·y−1). For EBF and GRA, the GMAO_GLASS GPP was the most effective algorithm and exhibited significant correlations (R2 = 0.91, R2 = 0.95) and the smallest biases (−222 gC·m−2·y−1, −173 gC·m−2·y−1) and RMSEs (21%, 33%). Similarly, for DBF and MF, the GMAO_GLASS GPP algorithm also outperformed the other algorithms because of its most significant correlations (R2 = 0.56, R2 = 0.61), smallest biases (−530 gC·m−2·y−1, −411 gC·m−2·y−1) and RMSEs (31%, 36%). None of the algorithms showed significant correlations for croplands (CRO); however, the GMAO_GLASS GPP algorithm exhibited the smallest bias (−228 gC·m−2·y−1) and RMSE (27%).

3.2. Meteorology

In this study, the MOD_GMAO GPP algorithm followed the standard MOD17A2H GPP algorithm, which used the GMAO meteorology reanalysis data. The GMAO meteorology reanalysis data were replaced with the site meteorological data for the MOD_Tower GPP algorithm. The MOD_GMAO GPP and MOD_Tower GPP algorithms were thus compared to determine the influences of the meteorological data on the GPP estimates. The results showed that the MOD_Tower GPP algorithm did not estimate eight-day GPP more reliably than the MOD_GMAO GPP algorithm (Figure 1a,b; Table 2). Conversely, estimates of annual GPP from the MOD_Tower GPP algorithm were inferior to thoseof the MOD_GMAO algorithm (Figure 3a,b; Table 3).
We directly compared the daily GMAO meteorology reanalysis data and the site meteorological data (Figure 4). The two datasets were highly significantly correlated for Tavg (R2 = 0.97) and Tmin (R2 = 0.94) (Figure 4a,b), which implied that the GMAO meteorology reanalysis data could be reliably used to estimate the on-site temperature conditions. Additionally, VPDavg was also statistically significantly correlated (R2 = 0.88) (Figure 4c), which indicated that the on-site moisture variations could also be dependably estimated from the GMAO meteorology reanalysis datasets. With respect to PAR, the GMAO meteorology reanalysis data generally overestimated the site meteorological data (Figure 4d), and the correlation (R2 = 0.85) was stronger than that of VPDavg, but weaker than those of Tavg and Tmin.

3.3. FPAR

Unlike the MOD_GMAO GPP algorithm, the GMAO_GLASS GPP algorithm followed the MOD17A2H GPP algorithm by substituting GLASS FPAR (derived from GLASS LAI datasets) for MODIS FPAR (derived from MOD15A2H products). Therefore, comparing these two types of algorithms will be helpful for understanding the impacts of FPAR on the GPP estimates. In the case of the eight-day GPP estimates, the effectiveness of the GMAO_GLASS GPP algorithm for estimating the Flux_Tower GPP was much better than that of the MOD_GMAO GPP algorithm (Figure 1a,c; Table 2). Additionally, the GMAO_GLASS GPP algorithm achieved substantial improvements over the MOD_GMAO GPP algorithm for the annual GPP estimates (Figure 3a,c; Table 3). The GMAO_GLASS GPP algorithm estimated the Flux_Tower GPP far more effectively than the MOD_GMAO GPP algorithm for EBF site (Table 2 and Table 3).
In our study, comparisons were made between GLASS FPAR and MODIS FPAR (Figure 5, Table 4). Overall, the correlation between the two types of FPAR was not strong (R2 = 0.45). The correlations between GLASS FPAR and MODIS FPAR were also weak for every single biome type, except ENF; the correlation between them for EBF was lowest (R2 = 0.02). Obviously, GLASS FPAR overestimated MODIS FPAR at most sites. This overestimation problem was most serious at GH-Ank (bias = 0.479), PA-SPs (bias = 0.375) and BR-Sa3 (bias = 0.292). Moreover, GLASS FPAR also overestimated MODIS FPAR for all six biome types.

3.4. Land Cover Classification

We obtained the pixel values within a range of 5 km × 5 km centered over each site, as well as the numbers of corresponding pixel values from the MCD12Q1 image data during 2001–2013. MODIS land cover classification results at each site were then calculated from the statistics of the pixel values. Additionally, the actual land cover type of each site was obtained by consulting site descriptions provided by the FLUXNET2015 dataset.
We also compared MODIS land cover classification results and actual land cover types in this study (Figure 6). It was found that MCD12Q1 misclassified eleven of the eighteen sites. As shown in Figure 6, the misclassified sites included AR-Vir (mistook ENF for savannas), AU-ASM (mistook ENF for open shrublands), AU-Rig (mistook GRA for CRO), AU-Whr (mistook EBF for woody savannas), CZ-BK2 (mistook GRA for ENF), DE-Hai (mistook DBF for MF), DK-Sor (mistook DBF for CRO), FR-Pue (mistook EBF for MF), IT-Ren (mistook ENF for MF), PA-SPs (mistook GRA for savannas) and US-Wkg (mistook GRA for open shrublands).

3.5. Light Use Efficiency

The constant values of εmax used in the MOD17A2H GPP algorithm varied for the different types of land cover; each biome type had an individual εmax value. By using Equations (1) and (3) in Section 2.1.1, we recalculated the inferred εmax for each land cover type and then directly compared them to the MOD17A2H εmax (Figure 7, Table 5). The results showed that the inferred εmax was higher than MOD17A2H εmax by 31% for ENF, 21% for EBF, 72% for DBF, 61% for MF, 31% for GRA and 25% for CRO. Moreover, from the perspective of a single site, the inferred εmax was higher than MOD17A2H εmax at almost all sites except AU-Whr (bias = 0.093).

4. Discussion

In this study, Flux_Tower GPP from eighteen sites were used to verify four groups of GPP estimates recalculated following the MOD17A2H GPP algorithms (i.e., MOD_GMAO GPP, MOD_Tower GPP, GMAO_GLASS GPP and Tower_GLASS GPP). It was found that the four groups of GPP estimates deviated from the flux-derived GPP values to varying degrees. The extent of the deviations varied depending on the site location, the type of biome and the time interval. We can attribute these deviations to different factors. Undoubtedly, the effectiveness of GPP estimation critically depends on the precision of every input data involved in the MOD17A2H GPP algorithm. Therefore, the meteorological data, FPAR product, land cover classification result and εmax value were all potential sources of error [43]. The accuracy of the flux-derived GPP value and the reliability of the MOD17A2H GPP algorithm itself should also be considered [44].

4.1. Impact of Meteorological Data on MODIS GPP

There are three meteorological factors (PAR, Tmin and VPDavg) involved in the MOD17A2H GPP algorithm, which suggests that meteorology reanalysis data could be the main source of error in the GPP estimates [44]. For the previous MOD17A2 GPP product, the meteorological input data were selected from the DAO meteorology dataset (1.00° × 1.25° spatial resolution). In contrast, the latest MOD17A2H product uses an updated version of the GMAO meteorology dataset (0.5° × 0.625° spatial resolution). However, the spatial resolution of GMAO meteorology data is still greatly inferior to that of the MODIS GPP product (500 m). Although a strict interpolation was completed in the data pre-processing stage, the errors caused by the original low resolution could not be eliminated. Moreover, the interpolation process may have resulted in additional uncertainties. Analytic comparisons between the GMAO meteorology reanalysis dataset and the site-based meteorological observations indicated that GMAO data were effective for estimating on-site temperature elements and moisture conditions (Figure 4a–c). Compared with the previous research results about MOD17A2 meteorology data, the GMAO data adopted in the current MOD17A2H product achieved substantial progress in estimating actual values of meteorological elements [45,46]. This demonstrated the considerable effectiveness of the efforts that MODIS GPP has taken in the version upgrading process to reduce the error derived from meteorological data. Note that as the source of original energy for GPP, PAR plays an extremely important role among the four meteorological elements involved in the MOD17A2H algorithm. It can be seen from this work that the effectiveness of GMAO data in estimating PAR was less than that of GMAO data in estimating the temperature and moisture elements (Figure 4d), which is mainly because the GMAO data largely overestimated the site-measured PAR.
In this study, we replaced the GMAO meteorology reanalysis dataset with the site-based meteorological observations to recalculate the MOD17A2H GPP algorithm and gained new GPP estimates (MOD_Tower GPP). Unexpectedly, the eight-day GPP estimates recalculated using the site-based meteorological observations did not result in obvious improvements (Figure 1a,b). Conversely, the annual GPP estimates recalculated using the site-based meteorological observations were not as accurate as those calculated using the GMAO meteorology reanalysis dataset (Figure 3a,b). The implication of these results is that an improvement in meteorological input data will not necessarily improve the reliability of GPP estimation by the MOD17A2H GPP algorithm, emphasizing the requirement of identifying additional sources of uncertainty.

4.2. Impact of FPAR Product on MODIS GPP

To assess the influences of FPAR on the accuracy of GPP estimation, we introduced an improved FPAR dataset (GLASS FPAR) and designed the GMAO_GLASS GPP algorithm. Our results showed that the greatest improvements were gained in estimating the eight-day GPP values when the MODIS FPAR was replaced by the GLASS FPAR (Figure 1a,c). Similarly, the precision in estimating annual GPP was also improved substantially after substituting GLASS FPAR for MODIS FPAR (Figure 3a,c). By comparing two groups of FPAR data, we found that the values of MODIS FPAR were generally smaller than that of GLASS FPAR (Table 4). Indeed, the MOD17A2H GPP (MOD_GMAO GPP algorithm) generally underestimated the flux derived GPP values (Table 2 and Table 3). The improved GLASS FPAR data thus balanced the underestimation resulting from the use of MODIS FPAR to some extent.
Admittedly, GLASS FPAR adopted in the GMAO_GLASS GPP algorithm was improved from the previous MOD15A2 LAI/FPAR product, which had a spatial resolution of 1 km. The MOD_GMAO GPP algorithm adopted the latest MOD15A2H FPAR product, whose spatial resolution increased to 500 m. However, our results showed that the GMAO_GLASS GPP algorithm estimated the site-based GPP much more effectively than the MOD_GMAO GPP algorithm. This indicated that what had been done in MODIS GPP products to reduce the error derived from FPAR during the version upgrading process was still far from sufficient.
The qualities of the meteorological data and the FPAR product were simultaneously improved in the Tower_GLASS GPP algorithm. We simply substituted the site-based meteorological observations for the GMAO meteorology reanalysis dataset and replaced the MODIS FPAR with GLASS FPAR. The results showed that the effectiveness of eight-day GPP estimation had the greatest improvements (Figure 1a,d). However, this replacement strategy did not produce the most effective algorithm in terms of annual GPP estimates (Figure 3a,c,d). This may indicate that the accuracy of GPP estimates could be enhanced by simultaneously improving the qualities of multiple inputs of the MOD17A2H algorithm; but it did not imply that improvements could be gained simply by replacing the input data because the overall gain in algorithm performance was not simply the sum of the individual gains. More detailed analysis needs to be conducted to evaluate the interaction effects of the joint variation of the model inputs in future research [1].
Compared with MOD17A2, MOD17A2H improved in terms of meteorological data and FPAR. Therefore, four groups of experiments (i.e., MOD_GMAO GPP, MOD_Tower GPP, GMAO_GLASS GPP and Tower_GLASS GPP) were designed to verify the contributions of the upgraded meteorology dataset and FPAR product to the estimation accuracy of GPP. It was discovered that the GMAO_GLASS GPP and Tower_GLASS GPP algorithms achieved enormous performance gains over the MOD_GMAO GPP algorithm in terms of flux-derived GPP estimates and that the performance of the GMAO_GLASS GPP algorithm was almost the same as that of the Tower_GLASS GPP algorithm. This may indicate that the error from FPAR was larger than that from the meteorological data in the current version of the MODIS GPP product.

4.3. Impact of Land Cover Classification Result on MODIS GPP

The MOD17A2H GPP algorithm uses the MCD12Q1 product as its land cover classification scheme. The accuracy of the land cover classification directly determines the veracity of εmax and further influences the effectiveness of the GPP estimates. Therefore, the influences of land cover misclassification on GPP estimation are non-negligible.
In our study, we found that MCD12Q1 misclassified most of the sites (Figure 6). These misclassifications directly led to the misestimating FPAR by MOD15A2H and the misjudgments of εmax by BPLUT and thus affected the MOD17A2H GPP estimates for corresponding sites.

4.4. Impact of LUE Value on MODIS GPP

The value of εmax is biomespecific, representing the maximum light use efficiency (LUE) of the corresponding vegetation in the process of photosynthesis. For a given biome type, the value of εmax is constant and assigned by the BPLUT. Although the BPLUT has corrected and updated εmax values, the colossal diversity of terrestrial environments and climatic conditions does not allow a value of εmax at one location to be used reliably in another location, even for the same biome type [47]. The optimized εmax that we deduced for the eighteen sites in this study greatly differed from the MOD17A2H εmax that was specified by the BPLUT (Figure 7, Table 5). Because the εmax value used in the MOD17A2H GPP algorithm sets the foundation for the actual conversion of light energy, the misestimation of its value will inherently reduce the accuracy of GPP estimations.

4.5. Uncertainties, Errors and Accuracies

In this study, our evaluation of MOD17A2H GPP assumed that the values of GPP derived from EC flux tower sites are reliable, even though it is well known that the flux-derived GPP values encompass many uncertainties [48]. The ecosystem respiration (Reco) is an essential variable when the flux-derived GPP value is calculated. However, accurate estimation of Reco is difficult, and misestimation can produce random and systematic errors in estimating GPP. Moreover, mismatches in scale between MODIS pixels and tower flux footprints lead to further uncertainties. Additionally, researchers have discovered structural errors in the MODIS GPP algorithm [49,50,51]. For example, it was found that the MODIS GPP algorithm cannot correctly identify the contribution of leaves in both insolated and shaded locations to the calculation of total GPP when compared with GPP estimates from a two-leaf process-based model [52].

5. Conclusions

In our study, we systematically assessed both eight-day and annual MOD17A2H GPP using the latest FLUXNET2015 dataset at eighteen sites in six different ecosystems across the globe during 2001–2014. The sensitivities of the MOD17A2H algorithm to the meteorology reanalysis dataset and FPAR product was evaluated by introducing site-based meteorological observations and an upgraded GLASS FPAR product. We further explored the potential error contributions from land cover classification and εmax. Our principal conclusions are summarized as follows:
(1)
The effectiveness of the standard MOD17A2H product (i.e., MOD_GMAO GPP) for estimating annual GPP was poor (R2 = 0.62) and even worse over eight days (R2 = 0.52). Replacing the GMAO meteorology reanalysis dataset with the site-based meteorological observations (i.e., MOD_Tower GPP) failed to improve the correlations with the flux-derived eight-day GPP (R2 = 0.52) and annual GPP (R2 = 0.56). However, great improvements in estimating the flux-derived annual GPP (R2 = 0.79) were gained by replacing MODIS FPAR with GLASS FPAR (i.e., GMAO_GLASS GPP). This may indicate that in the current version of the MODIS GPP product, the error from FPAR was larger than that from the meteorological data. When the meteorological dataset and FPAR product were replaced by upgraded data simultaneously (i.e., Tower_GLASS GPP), the accuracy in estimating the flux-derived eight-day GPP (R2 = 0.65) was significantly improved.
(2)
There are four possible sources of error related to the input data of MOD17A2H algorithm: meteorological reanalysis dataset, FPAR product, land cover classification result and the εmax value. The GMAO meteorology reanalysis dataset commonly overestimated the site-measured PAR, and MODIS FPAR underestimated the upgraded FPAR in most flux tower sites. In addition, MCD12Q1 exhibited frequent misclassification errors, and the MOD17A2H εmax values were much smaller than the inferred εmax values for all six ecosystems discussed in our study.
From the above analyses, the latest MODIS GPP product, MOD17A2H, still has some defects in estimating the actual value of GPP. We suggest that FPAR and land cover classification products need to be improved, and εmax should be adjusted in the next versions of datasets for GPP estimation.

Acknowledgments

This work was financially supported by the National Natural Science Foundation of China (No. 41601044) andthe Special Fund for Basic Scientific Research of Central Colleges, China University of Geosciences, Wuhan (No. CUG150631, CUGL170401). We are grateful for the availability of the eddy covariance flux data from FLUXNET. We also acknowledge the Global Modeling and Assimilation Office (GMAO), which provided the meteorological reanalysis datasets, and we would like to thank the Center for Global Change Data Processing and Analysis of Beijing Normal University for providing the GLASS LAI datasets.

Author Contributions

Lunche Wang and Hongji Zhu designed the research. Hongji Zhu performed the experiments. Wenmin Qin and Qiyong Du analyzed the data. Hongji Zhu and Lunche Wang wrote the manuscript. Aiwen Lin and Ling Zou corrected and modified the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Gebremichael, M.; Barros, A. Evaluation of MODIS Gross Primary Productivity (GPP) in tropical monsoon regions. Remote Sens. Environ. 2006, 100, 150–166. [Google Scholar] [CrossRef]
  2. Beer, C.; Reichstein, M.; Tomelleri, E.; Ciais, P.; Jung, M.; Carvalhais, N.; Rodenbeck, C.; Arain, M.A.; Baldocchi, D.; Bonan, G.B.; et al. Terrestrial gross carbon dioxide uptake: Global distribution and covariation with climate. Science 2010, 329, 834–838. [Google Scholar] [CrossRef] [PubMed]
  3. Kotchenova, S.Y.; Song, X.; Shabanov, N.V.; Potter, C.S.; Knyazikhin, Y.; Myneni, R.B. Lidar remote sensing for modeling gross primary production of deciduous forests. Remote Sens. Environ. 2004, 92, 158–172. [Google Scholar] [CrossRef]
  4. Gitelson, A.A.; Viña, A.; Verma, S.B.; Rundquist, D.C.; Arkebauer, T.J.; Keydan, G.; Leavitt, B.; Ciganda, V.; Burba, G.G.; Suyker, A.E. Relationship between gross primary production and chlorophyll content in crops: Implications for the synoptic monitoring of vegetation productivity. J. Geophys. Res. 2006. [Google Scholar] [CrossRef]
  5. Sims, D.; Rahman, A.; Cordova, V.; Elmasri, B.; Baldocchi, D.; Bolstad, P.; Flanagan, L.; Goldstein, A.; Hollinger, D.; Misson, L. A new model of gross primary productivity for North American ecosystems based solely on the enhanced vegetation index and land surface temperature from MODIS. Remote Sens. Environ. 2008, 112, 1633–1646. [Google Scholar] [CrossRef]
  6. Yang, Y.; Shang, S.; Guan, H.; Jiang, L. A novel algorithm to assess gross primary production for terrestrial ecosystems from MODIS imagery. J. Geophys. Res. 2013, 118, 590–605. [Google Scholar] [CrossRef]
  7. Wu, C.; Chen, J.M.; Huang, N. Predicting gross primary production from the enhanced vegetation index and photosynthetically active radiation: Evaluation and calibration. Remote Sens. Environ. 2011, 115, 3424–3435. [Google Scholar] [CrossRef]
  8. Peng, Y.; Gitelson, A.A.; Sakamoto, T. Remote estimation of gross primary productivity in crops using MODIS 250m data. Remote Sens. Environ. 2013, 128, 186–196. [Google Scholar] [CrossRef]
  9. Machwitz, M.; Gessner, U.; Conrad, C.; Falk, U.; Richters, J.; Dech, S. Modelling the Gross Primary Productivity of West Africa with the Regional Biomass Model RBM+, using optimized 250m MODIS FPAR and fractional vegetation cover information. Int. J. Appl. Earth. Obs. 2015, 43, 177–194. [Google Scholar] [CrossRef]
  10. Running, S.W.; Nemani, R.R.; Heinsch, F.A.; Zhao, M.; Reeves, M.; Hashimoto, H. A continuous satellite-derived measure of global terrestrial primary production. BioScience 2004, 54, 547–560. [Google Scholar] [CrossRef]
  11. Lin, A.; Zhu, H.; Wang, L.; Gong, W.; Zou, L. Characteristics of long-term climate change and the ecological responses in central China. Earth Interact. 2016, 20, 1–24. [Google Scholar] [CrossRef]
  12. Zhao, M.; Heinsch, F.A.; Nemani, R.R.; Running, S.W. Improvements of the MODIS terrestrial gross and net primary production global data set. Remote Sens. Environ. 2005, 95, 164–176. [Google Scholar] [CrossRef]
  13. Gao, Y.; Yu, G.; Yan, H.; Zhu, X.; Li, S.; Wang, Q.; Zhang, J.; Wang, Y.; Li, Y.; Zhao, L.; et al. A MODIS-based Photosynthetic Capacity Model to estimate gross primary production in Northern China and the Tibetan Plateau. Remote Sens. Environ. 2014, 148, 108–118. [Google Scholar] [CrossRef]
  14. Chen, J.M.; Mo, G.; Pisek, J.; Liu, J.; Deng, F.; Ishizawa, M.; Chan, D. Effects of foliage clumping on the estimation of global terrestrial gross primary productivity. Glob. Biogeochem. Cycle 2012. [Google Scholar] [CrossRef]
  15. Garbulsky, M.F.; Peñuelas, J.; Papale, D.; Ardö, J.; Goulden, M.L.; Kiely, G.; Richardson, A.D.; Rotenberg, E.; Veenendaal, E.M.; Filella, I. Patterns and controls of the variability of radiation use efficiency and primary productivity across terrestrial ecosystems. Glob. Ecol. Biogeogr. 2010, 19, 253–267. [Google Scholar] [CrossRef]
  16. Turner, D.P.; Ritts, W.D.; Cohen, W.B.; Gower, S.T.; Zhao, M.; Running, S.W.; Wofsy, S.C.; Urbanski, S.; Dunn, A.L.; Munger, J.W. Scaling Gross Primary Production (GPP) over boreal and deciduous forest landscapes in support of MODIS GPP product validation. Remote Sens. Environ. 2003, 88, 256–270. [Google Scholar] [CrossRef]
  17. Zhu, H.; Lin, A.; Wang, L.; Xia, Y.; Zou, L. Evaluation of MODIS gross primary production across multiple biomes in China using eddy covariance flux data. Remote Sens. 2016. [Google Scholar] [CrossRef]
  18. Yuan, W.; Liu, S.; Zhou, G.; Zhou, G.; Tieszen, L.L.; Baldocchi, D.; Bernhofer, C.; Gholz, H.; Goldstein, A.H.; Goulden, M.L.; et al. Deriving a light use efficiency model from eddy covariance flux data for predicting daily gross primary production across biomes. Agric. For. Meteorol. 2007, 143, 189–207. [Google Scholar] [CrossRef]
  19. Propastin, P.; Ibrom, A.; Knohl, A.; Erasmi, S. Effects of canopy photosynthesis saturation on the estimation of gross primary productivity from MODIS data in a tropical forest. Remote Sens. Environ. 2012, 121, 252–260. [Google Scholar] [CrossRef]
  20. Fu, Y.; Yu, G.; Sun, X.; Li, Y.; Wen, X.; Zhang, L.; Li, Z.; Zhao, L.; Hao, Y. Depression of net ecosystem CO2 exchange in semi-arid Leymus chinensis steppe and alpine shrub. Agric. For. Meteorol. 2006, 137, 234–244. [Google Scholar] [CrossRef]
  21. Coops, N.; Black, T.; Jassal, R.; Trofymow, J.; Morgenstern, K. Comparison of MODIS, eddy covariance determined and physiologically modelled gross primary production (GPP) in a Douglas-fir forest stand. Remote Sens. Environ. 2007, 107, 385–401. [Google Scholar] [CrossRef]
  22. Groenendijk, M.; Dolman, A.J.; van der Molen, M.K.; Leuning, R.; Arneth, A.; Delpierre, N.; Gash, J.H.C.; Lindroth, A.; Richardson, A.D.; Verbeeck, H.; et al. Assessing parameter variability in a photosynthesis model within and between plant functional types using global Fluxnet eddy covariance data. Agric. For. Meteorol. 2011, 151, 22–38. [Google Scholar] [CrossRef]
  23. Xiao, J.; Zhuang, Q.; Law, B.E.; Chen, J.; Baldocchi, D.D.; Cook, D.R.; Oren, R.; Richardson, A.D.; Wharton, S.; Ma, S. A continuous measure of gross primary production for the conterminous United States derived from MODIS and AmeriFlux data. Remote Sens. Environ. 2010, 114, 576–591. [Google Scholar] [CrossRef]
  24. John, R.; Chen, J.; Noormets, A.; Xiao, X.; Xu, J.; Lu, N.; Chen, S. Modelling gross primary production in semi-arid Inner Mongolia using MODIS imagery and eddy covariance data. Int. J. Remote Sens. 2013, 34, 2829–2857. [Google Scholar] [CrossRef]
  25. Heinsch, F.A.; Zhao, M.; Running, S.W.; Kimball, J.S.; Nemani, R.R.; Davis, K.J.; Bolstad, P.V.; Cook, B.D.; Desai, A.R.; Ricciuto, D.M.; et al. Evaluation of remote sensing based terrestrial productivity from MODIS using regional tower eddy flux network observations. IEEE Trans. Geosci. Remote Sens. 2006, 7, 1908–1925. [Google Scholar] [CrossRef]
  26. Sjöström, M.; Zhao, M.; Archibald, S.; Arneth, A.; Cappelaere, B.; Falk, U.; de Grandcourt, A.; Hanan, N.; Kergoat, L.; Kutsch, W.; et al. Evaluation of MODIS gross primary productivity for Africa using eddy covariance data. Remote Sens. Environ. 2013, 131, 275–286. [Google Scholar] [CrossRef]
  27. Kanniah, K.D.; Beringer, J.; Hutley, L.B.; Tapper, N.J.; Zhu, X. Evaluation of Collections 4 and 5 of the MODIS Gross Primary Productivity product and algorithm improvement at a tropical savanna site in northern Australia. Remote Sens. Environ. 2009, 113, 1808–1822. [Google Scholar] [CrossRef]
  28. Running, S.W.; M., Q.; Zhao, M. MOD17A2H MODIS/Terra Gross Primary Productivity 8-Day L4 Global 500m SIN Grid V006; USGS: Reston, VA, USA, 2015. [Google Scholar]
  29. Vuichard, N.; Papale, D. Filling the gaps in meteorological continuous data measured at FLUXNET sites with ERA-Interim reanalysis. Earth. Syst. Sci. Data 2015, 7, 157–171. [Google Scholar] [CrossRef]
  30. Monteith, J.L. Solar radiation and production in tropical ecosystems. J. Appl. Ecol. 1972, 9, 747–766. [Google Scholar] [CrossRef]
  31. Running, S.W.; Thornton, P.E.; Nemani, R.R.; Glassy, J.M. Global terrestrial gross and net primary productivity from the Earth observing system. In Methods in Ecosystem Science; Sala, O., Jackson, R., Mooney, H., Eds.; Springer: New York, NY, USA, 2000; pp. 44–57. [Google Scholar]
  32. Heinsch, F.A.; Reeves, M.; Votava, P.; Kang, S.; Milesi, C.; Zhao, M.; Glassy, J.; Jolly, W.M.; Loehman, R.; Bowker, C.F.; et al. User's Guide: GPP and NPP (MOD17A2/A3) Products NASA MODIS Land Algorithm; University of Montana: Missoula, MT, USA, 2003; p. 57. [Google Scholar]
  33. Zhao, M.; Running, S.W. Drought-induced reduction in global terrestrial net primary production from 2000 through 2009. Science 2010, 329, 940–943. [Google Scholar] [CrossRef] [PubMed]
  34. Land Processes Distributed Active Archive Center (LP DAAC). Available online: https://lpdaac.usgs.gov/dataset_discovery/modis (accessed on 13 June 2016).
  35. NASA Goddard Space Flight Center. Available online: https://gmao.gsfc.nasa.gov/GMAO_products (accessed on 23 June 2016).
  36. Zhao, M.; Running, S.W.; Nemani, R.R. Sensitivity of Moderate Resolution Imaging Spectroradiometer (MODIS) terrestrial primary production to the accuracy of meteorological reanalyses. J. Geophys. Res. 2006. [Google Scholar] [CrossRef]
  37. Zhao, X.; Liang, S.; Liu, S.; Yuan, W.; Xiao, Z.; Liu, Q.; Cheng, J.; Zhang, X.; Tang, H.; Zhang, X.; et al. The Global Land Surface Satellite (GLASS) remote sensing data processing system and products. Remote Sens. 2013, 5, 2436–2450. [Google Scholar] [CrossRef]
  38. Liang, S.; Zhao, X.; Liu, S.; Yuan, W.; Cheng, X.; Xiao, Z.; Zhang, X.; Liu, Q.; Cheng, J.; Tang, H.; et al. A long-term Global LAnd Surface Satellite (GLASS) data-set for environmental studies. Int. J. Digit. Earth 2013, 6, 5–33. [Google Scholar] [CrossRef]
  39. Xiao, Z.; Liang, S.; Wang, J.; Chen, P.; Yin, X.; Zhang, L.; Song, J. Use of general regression neural networks for generating the GLASS leaf area index product from time-series MODIS surface reflectance. IEEE Trans. Geosci. Remote Sens. 2014, 52, 209–223. [Google Scholar] [CrossRef]
  40. Generation and Applications of Global Products of Essential Land Variables. Available online: http://glass-product.bnu.edu.cn (accessed on 15 June 2016).
  41. Turner, D.P.; Ritts, W.D.; Cohen, W.B.; Gower, S.T.; Running, S.W.; Zhao, M.; Costa, M.H.; Kirschbaum, A.A.; Ham, J.M.; Saleska, S.R.; et al. Evaluation of MODIS NPP and GPP products across multiple biomes. Remote Sens. Environ. 2006, 102, 282–292. [Google Scholar] [CrossRef]
  42. FLUXNET-Fluxdata. Available online: http://fluxnet.fluxdata.org/about (accessed on 4 July 2016).
  43. Schubert, P.; Lagergren, F.; Aurela, M.; Christensen, T.; Grelle, A.; Heliasz, M.; Klemedtsson, L.; Lindroth, A.; Pilegaard, K.; Vesala, T.; et al. Modeling GPP in the Nordic forest landscape with MODIS time series data—Comparison with the MODIS GPP product. Remote Sens. Environ. 2012, 126, 136–147. [Google Scholar] [CrossRef]
  44. Chen, J.; Zhang, H.; Liu, Z.; Che, M.; Chen, B. Evaluating parameter adjustment in the MODIS gross primary production algorithm based on eddy covariance tower measurements. Remote Sens. 2014, 6, 3321–3348. [Google Scholar] [CrossRef]
  45. Wen, X.; Yu, G.; Sun, X.; Li, Q.; Liu, Y.; Zhang, L.; Ren, C.; Fu, Y.; Li, Z. Soil moisture effect on the temperature dependence of ecosystem respiration in a subtropical Pinus plantation of southeastern China. Agric. For. Meteorol. 2006, 137, 166–175. [Google Scholar] [CrossRef]
  46. Mu, Q.; Zhao, M.; Heinsch, F.A.; Liu, M.; Tian, H.; Running, S.W. Evaluating water stress controls on primary production in biogeochemical and remote sensing based models. J. Geophys. Res. 2007. [Google Scholar] [CrossRef]
  47. Liu, Z.; Wang, L.; Wang, S. Comparison of different GPP models in China using MODIS image and ChinaFLUX data. Remote Sens. 2014, 6, 10215–10231. [Google Scholar] [CrossRef]
  48. Moffat, A.M.; Papale, D.; Reichstein, M.; Hollinger, D.Y.; Richardson, A.D.; Barr, A.G.; Beckstein, C.; Braswell, B.H.; Churkina, G.; Desai, A.R.; et al. Comprehensive comparison of gap-filling techniques for eddy covariance net carbon fluxes. Agric. For. Meteorol. 2007, 147, 209–232. [Google Scholar] [CrossRef]
  49. Nightingale, J.M.; Coops, N.C.; Waring, R.H.; Hargrove, W.W. Comparison of MODIS gross primary production estimates for forests across the U.S.A. with those generated by a simple process model, 3-PGS. Remote Sens. Environ. 2007, 109, 500–509. [Google Scholar] [CrossRef]
  50. He, M.; Ju, W.; Zhou, Y.; Chen, J.; He, H.; Wang, S.; Wang, H.; Guan, D.; Yan, J.; Li, Y.; et al. Development of a two-leaf light use efficiency model for improving the calculation of terrestrial gross primary productivity. Agric. For. Meteorol. 2013, 173, 28–39. [Google Scholar] [CrossRef]
  51. Hashimoto, H.; Wang, W.; Milesi, C.; Xiong, J.; Ganguly, S.; Zhu, Z.; Nemani, R. Structural uncertainty in model-simulated trends of global gross primary production. Remote Sens. 2013, 5, 1258–1273. [Google Scholar] [CrossRef]
  52. Zhang, F.; Chen, J.M.; Chen, J.; Gough, C.M.; Martin, T.A.; Dragoni, D. Evaluating spatial and temporal patterns of MODIS GPP over the conterminous U.S. against flux measurements and a process model. Remote Sens. Environ. 2012, 124, 717–729. [Google Scholar] [CrossRef]
Figure 1. Scatter plots of the eight-day MOD_GMAO GPP vs. the Flux_Tower GPP (a), MOD_Tower GPP vs. the Flux_Tower GPP (b), GMAO_GLASS GPP vs. the Flux_Tower GPP (c) and Tower_GLASS GPP vs. the Flux_Tower GPP (d). Significance levels: ** p < 0.01. GMAO, Global Modeling and Assimilation Office.
Figure 1. Scatter plots of the eight-day MOD_GMAO GPP vs. the Flux_Tower GPP (a), MOD_Tower GPP vs. the Flux_Tower GPP (b), GMAO_GLASS GPP vs. the Flux_Tower GPP (c) and Tower_GLASS GPP vs. the Flux_Tower GPP (d). Significance levels: ** p < 0.01. GMAO, Global Modeling and Assimilation Office.
Remotesensing 09 00418 g001
Figure 2. (ar) Time series of eight-day GPP derived from the tower estimates (i.e., Flux_Tower GPP) and four different experimental groups (i.e., MOD_GMAO GPP, MOD_Tower GPP, GMAO_GLASS GPP and Tower_GLASS GPP) at all eighteen sites. The full name for each site is listed in Table 1. The units of the mean and bias are gC·m−2·8-d−1, and the RMSE is expressed as a percentage. Significance levels: ** p < 0.01.
Figure 2. (ar) Time series of eight-day GPP derived from the tower estimates (i.e., Flux_Tower GPP) and four different experimental groups (i.e., MOD_GMAO GPP, MOD_Tower GPP, GMAO_GLASS GPP and Tower_GLASS GPP) at all eighteen sites. The full name for each site is listed in Table 1. The units of the mean and bias are gC·m−2·8-d−1, and the RMSE is expressed as a percentage. Significance levels: ** p < 0.01.
Remotesensing 09 00418 g002
Figure 3. Comparisons of the annual Flux_Tower GPP with: (a) MOD_GMAO GPP; (b) MOD_Tower GPP; (c) GMAO_GLASS GPP; and (d) Tower_GLASS GPP. Significance levels: ** p < 0.01.
Figure 3. Comparisons of the annual Flux_Tower GPP with: (a) MOD_GMAO GPP; (b) MOD_Tower GPP; (c) GMAO_GLASS GPP; and (d) Tower_GLASS GPP. Significance levels: ** p < 0.01.
Remotesensing 09 00418 g003
Figure 4. Scatter plots of the daily GMAO meteorology data against the daily site meteorology data for: (a) Tavg; (b) Tmin; (c) VPDavg; and (d) PAR. Significance levels: ** p < 0.01.
Figure 4. Scatter plots of the daily GMAO meteorology data against the daily site meteorology data for: (a) Tavg; (b) Tmin; (c) VPDavg; and (d) PAR. Significance levels: ** p < 0.01.
Remotesensing 09 00418 g004
Figure 5. Comparison of the average FPAR from the GLASS LAI datasets (GLASS FPAR) and the MOD15A2H products (MODIS FPAR). Significance levels: ** p < 0.01.
Figure 5. Comparison of the average FPAR from the GLASS LAI datasets (GLASS FPAR) and the MOD15A2H products (MODIS FPAR). Significance levels: ** p < 0.01.
Remotesensing 09 00418 g005
Figure 6. University of Maryland (UMD) land cover classification (MCD12Q1 Collection 5.1, Land Cover Classification Type 2) for the eighteen sites. The red columns indicate the actual land cover at each site.
Figure 6. University of Maryland (UMD) land cover classification (MCD12Q1 Collection 5.1, Land Cover Classification Type 2) for the eighteen sites. The red columns indicate the actual land cover at each site.
Remotesensing 09 00418 g006
Figure 7. Eight-day site estimated GPP (gC·m−2·8-d−1) against the product of GLASS FPAR, tower PAR, VPDs and Ts for (a) ENF, (b) EBF, (c) DBF, (d) MF, (e) GRA and (f) CRO. APAR (absorbed photosynthetic-active radiation) = FPAR × PAR.
Figure 7. Eight-day site estimated GPP (gC·m−2·8-d−1) against the product of GLASS FPAR, tower PAR, VPDs and Ts for (a) ENF, (b) EBF, (c) DBF, (d) MF, (e) GRA and (f) CRO. APAR (absorbed photosynthetic-active radiation) = FPAR × PAR.
Remotesensing 09 00418 g007
Table 1. List of FLUXNET eddy covariance tower sites used in this study. Site descriptions include name (site ID), country, latitude and longitude (lat./lon., decimal degrees), general biome type, mean annual temperature (MAT, °C), mean annual long-term precipitation (MAP, mm) and years of measurements. ENF: evergreen needleleaf forests; EBF: evergreen broadleaf forests; DBF: deciduous broadleaf forests; MF: mixed forests; GRA: grasslands; CRO: croplands.
Table 1. List of FLUXNET eddy covariance tower sites used in this study. Site descriptions include name (site ID), country, latitude and longitude (lat./lon., decimal degrees), general biome type, mean annual temperature (MAT, °C), mean annual long-term precipitation (MAP, mm) and years of measurements. ENF: evergreen needleleaf forests; EBF: evergreen broadleaf forests; DBF: deciduous broadleaf forests; MF: mixed forests; GRA: grasslands; CRO: croplands.
Site NameCountryLat.Lon.Biome TypeMATMAPData Period
Virasoro(AR-Vir)Argentina−28.24−56.19ENF21.614332010–2012
Alice Springs(AU-ASM)Australia−22.28133.25ENF22.23902010–2013
Riggs Creek(AU-Rig)Australia−36.65145.58GRA15.44182011–2013
Whroo(AU-Whr)Australia−36.67145.03EBF15.74112011–2013
Lonzee(BE-Lon)Belgium50.554.75CRO10.08002004–2014
Vielsalm(BE-Vie)Belgium50.316.00MF7.810622001–2014
Santarem-Km83-Logged Forest(BR-Sa3)Brazil−3.02−54.97EBF26.120442001–2004
Ontario-Groundhog River(CA-Gro)Canada48.22−82.16MF1.38312003–2014
Bily Kriz-grassland(CZ-BK2)Czech Republic49.4918.54GRA6.713162006–2011
Hainich(DE-Hai)Germany51.0810.45DBF8.37202001–2012
Soroe-LilleBogeskov(DK-Sor)Denmark55.4911.64DBF8.26602001–2012
Grignon(FR-Gri)France48.841.95CRO12.06502004–2014
Puechabon(FR-Pue)France43.743.60EBF13.58832001–2013
Ankasa(GH-Ank)Ghana5.27−2.69EBF26.019002011–2012, 2014
Renon/Ritten(IT-Ren)Italy46.5911.43ENF4.78092001–2013
Sardinilla Pasture(PA-SPs)Panama9.31−79.63GRA26.523502007–2009
Curtice Walter-Berger cropland(US-CRT)USA41.63−83.35CRO10.18492011–2013
Walnut Gulch Kendall Grasslands(US-Wkg)USA31.74−109.94GRA15.64072004–2014
Table 2. Biome-based comparison of eight-day GPP derived from the site estimates with those derived from the MODIS algorithms (MOD_GMAO GPP, MOD_Tower GPP, GMAO_GLASS GPP and Tower_GLASS GPP). ENF: evergreen needleleaf forests; EBF: evergreen broadleaf forests; DBF: deciduous broadleaf forests; MF: mixed forests; GRA: grasslands; CRO: croplands.
Table 2. Biome-based comparison of eight-day GPP derived from the site estimates with those derived from the MODIS algorithms (MOD_GMAO GPP, MOD_Tower GPP, GMAO_GLASS GPP and Tower_GLASS GPP). ENF: evergreen needleleaf forests; EBF: evergreen broadleaf forests; DBF: deciduous broadleaf forests; MF: mixed forests; GRA: grasslands; CRO: croplands.
Biome TypeComparisonR2Mean (SD) (gC·m−2·8-d−1)Bias (gC·m−2·8-d−1)RMSE (%)n
ENFMOD_GMAO vs. Flux_Tower0.71 **19 (20) vs. 30 (27)−1152920
MOD_Tower vs. Flux_Tower0.72 **19 (19) vs. 30 (27)−1152
GMAO_GLASS vs. Flux_Tower0.75 **21 (22) vs. 30 (27)−947
Tower_GLASS vs. Flux_Tower0.76 **20 (21) vs. 30 (27)−1047
EBFMOD_GMAO vs. Flux_Tower0.14 **29 (20) vs. 40 (24)−11541058
MOD_Tower vs. Flux_Tower0.21 **26 (17) vs. 40 (24)−1451
GMAO_GLASS vs. Flux_Tower0.52 **35 (24) vs. 40 (24)−539
Tower_GLASS vs. Flux_Tower0.73 **31 (19) vs. 40 (24)−933
DBFMOD_GMAO vs. Flux_Tower0.75 **23 (25) vs. 39 (42)−16631104
MOD_Tower vs. Flux_Tower0.77 **19 (20) vs. 39 (42)−2068
GMAO_GLASS vs. Flux_Tower0.86 **27 (28) vs. 39 (42)−1249
Tower_GLASS vs. Flux_Tower0.89 **23 (23) vs. 39 (42)−1655
MFMOD_GMAO vs. Flux_Tower0.73 **22 (24) vs. 33 (30)−11531196
MOD_Tower vs. Flux_Tower0.73 **17 (18) vs. 33 (30)−1665
GMAO_GLASS vs. Flux_Tower0.81 **24 (25) vs. 33 (30)−945
Tower_GLASS vs. Flux_Tower0.81 **18 (18) vs. 33 (30)−1559
GRAMOD_GMAO vs. Flux_Tower0.41 **14 (14) vs. 19 (24)−5981058
MOD_Tower vs. Flux_Tower0.43 **14 (12) vs. 19 (24)−598
GMAO_GLASS vs. Flux_Tower0.56 **15 (17) vs. 19 (24)−483
Tower_GLASS vs. Flux_Tower0.64 **14 (15) vs. 19 (24)−580
CROMOD_GMAO vs. Flux_Tower0.34 **20 (20) vs. 30 (40)−10941150
MOD_Tower vs. Flux_Tower0.32 **18 (19) vs. 30 (40)−1298
GMAO_GLASS vs. Flux_Tower0.35 **25 (23) vs. 30 (40)−589
Tower_GLASS vs. Flux_Tower0.34 **22 (21) vs. 30 (40)−892
AllMOD_GMAO vs. Flux_Tower0.52 **21 (21) vs. 32 (33)−11246486
MOD_Tower vs. Flux_Tower0.52 **19 (18) vs. 32 (33)−1324
GMAO_GLASS vs. Flux_Tower0.63 **24 (24) vs. 32 (33)−823
Tower_GLASS vs. Flux_Tower0.65 **21 (20) vs. 32 (33)−1123
Significance levels: ** p < 0.01.
Table 3. Biome-based comparison of the annual GPP derived from the site estimates with those derived from the MODIS algorithms (MOD_GMAO GPP, MOD_Tower GPP, GMAO_GLASS GPP and Tower_GLASS GPP).ENF: evergreen needleleaf forests; EBF: evergreen broadleaf forests; DBF: deciduous broadleaf forests; MF: mixed forests; GRA: grasslands; CRO: croplands.
Table 3. Biome-based comparison of the annual GPP derived from the site estimates with those derived from the MODIS algorithms (MOD_GMAO GPP, MOD_Tower GPP, GMAO_GLASS GPP and Tower_GLASS GPP).ENF: evergreen needleleaf forests; EBF: evergreen broadleaf forests; DBF: deciduous broadleaf forests; MF: mixed forests; GRA: grasslands; CRO: croplands.
Biome TypeComparisonR2Mean (SD) (gC·m−2·y−1)Bias (gC·m−2·y−1)RMSE (%)n
ENFMOD_GMAO vs. Flux_Tower0.87 **894 (335) vs. 1400 (708)−5064620
MOD_Tower vs. Flux_Tower0.92 **883 (318) vs. 1400 (708)−51747
GMAO_GLASS vs. Flux_Tower0.89 **953 (394) vs. 1400 (708)−44741
Tower_GLASS vs. Flux_Tower0.91 **942 (383) vs. 1400 (708)−45841
EBFMOD_GMAO vs. Flux_Tower0.50 **1312 (300) vs. 1826 (974)−5145123
MOD_Tower vs. Flux_Tower0.50 **1211 (288) vs. 1826 (974)−61554
GMAO_GLASS vs. Flux_Tower0.91 **1604 (826) vs. 1826 (974)−22221
Tower_GLASS vs. Flux_Tower0.92 **1437 (711) vs. 1826 (974)−38928
DBFMOD_GMAO vs. Flux_Tower0.55 **1038 (157) vs. 1773 (192)−7354224
MOD_Tower vs. Flux_Tower0.34 **875 (93) vs. 1773 (192)−89851
GMAO_GLASS vs. Flux_Tower0.56 **1243 (206) vs. 1773 (192)−53031
Tower_GLASS vs. Flux_Tower0.41 **1037 (127) vs. 1773 (192)−73642
MFMOD_GMAO vs. Flux_Tower0.48 **1006 (108) vs. 1509 (444)−5034126
MOD_Tower vs. Flux_Tower0.43 **782 (87) vs. 1509 (444)−72754
GMAO_GLASS vs. Flux_Tower0.61 **1098 (95) vs. 1509 (444)−41136
Tower_GLASS vs. Flux_Tower0.51 **848 (71) vs. 1509 (444)−66151
GRAMOD_GMAO vs. Flux_Tower0.75 **652 (276) vs. 869 (721)−2176123
MOD_Tower vs. Flux_Tower0.83 **629 (202) vs. 869 (721)−24067
GMAO_GLASS vs. Flux_Tower0.95 **696 (532) vs. 869 (721)−17333
Tower_GLASS vs. Flux_Tower0.96 **651 (476) vs. 869 (721)−21840
CROMOD_GMAO vs. Flux_Tower0.06938 (150) vs. 1363 (327)−4253925
MOD_Tower vs. Flux_Tower0.08847 (161) vs. 1363 (327)−51644
GMAO_GLASS vs. Flux_Tower0.15 *1135 (129) vs. 1363 (327)−22827
Tower_GLASS vs. Flux_Tower0.14 *1012 (146) vs. 1363 (327)−35134
AllMOD_GMAO vs. Flux_Tower0.62 **976 (299) vs. 1460 (676)−48447141
MOD_Tower vs. Flux_Tower0.56 **869 (266) vs. 1460 (676)−59153
GMAO_GLASS vs. Flux_Tower0.79 **1126 (509) vs. 1460 (676)−33432
Tower_GLASS vs. Flux_Tower0.76 **987 (445) vs. 1460 (676)−47341
Significance levels: * p < 0.05, ** p < 0.01.
Table 4. Comparison of the FPAR derived from the GLASS LAI datasets (GLASS FPAR) with those from the MOD15A2H products (MODIS FPAR) for various biomes. ENF: evergreen needleleaf forests; EBF: evergreen broadleaf forests; DBF: deciduous broadleaf forests; MF: mixed forests; GRA: grasslands; CRO: croplands.
Table 4. Comparison of the FPAR derived from the GLASS LAI datasets (GLASS FPAR) with those from the MOD15A2H products (MODIS FPAR) for various biomes. ENF: evergreen needleleaf forests; EBF: evergreen broadleaf forests; DBF: deciduous broadleaf forests; MF: mixed forests; GRA: grasslands; CRO: croplands.
Biome (Site)ComparisonR2Mean (SD)BiasRMSE (%)n
ENFGLASS FPAR vs. MODIS FPAR0.72 **0.511 (0.242) vs. 0.463 (0.239)0.04826917
(AR-Vir)GLASS FPAR vs. MODIS FPAR0.61 **0.653 (0.155) vs. 0.615 (0.179)0.03819138
(AU-ASM)GLASS FPAR vs. MODIS FPAR0.44 **0.169 (0.046) vs. 0.236 (0.067)−0.06736184
(IT-Ren)GLASS FPAR vs. MODIS FPAR0.69 **0.584 (0.195) vs. 0.497 (0.239)0.08732595
EBFGLASS FPAR vs. MODIS FPAR0.02 **0.583 (0.237) vs. 0.499 (0.21)0.084391099
(AU-Whr)GLASS FPAR vs. MODIS FPAR0.67 **0.386 (0.204) vs. 0.476 (0.2)−0.0932138
(BR-Sa3)GLASS FPAR vs. MODIS FPAR0.09 **0.925 (0.008) vs. 0.633 (0.315)0.29267182
(FR-Pue)GLASS FPAR vs. MODIS FPAR0.03 **0.437 (0.055) vs. 0.499 (0.083)−0.06222595
(GH-Ank)GLASS FPAR vs. MODIS FPAR-0.864 (0.028) vs. 0.385 (0.288)0.479145184
DBFGLASS FPAR vs. MODIS FPAR0.55 **0.588 (0.213) vs. 0.472 (0.268)0.116391100
(DE-Hai)GLASS FPAR vs. MODIS FPAR0.49 **0.598 (0.19) vs. 0.498 (0.269)0.143550
(DK-Sor)GLASS FPAR vs. MODIS FPAR0.61 **0.578 (0.234) vs. 0.445 (0.264)0.13348550
MFGLASS FPAR vs. MODIS FPAR0.46 **0.608 (0.167) vs. 0.512 (0.271)0.096371193
(BE-Vie)GLASS FPAR vs. MODIS FPAR0.35 **0.606 (0.154) vs. 0.52 (0.282)0.08647641
(CA-Gro)GLASS FPAR vs. MODIS FPAR0.62 **0.611 (0.181) vs. 0.503 (0.256)0.10838552
GRAGLASS FPAR vs. MODIS FPAR0.49 **0.393 (0.308) vs. 0.368 (0.245)0.025571054
(AU-Rig)GLASS FPAR vs. MODIS FPAR0.56 **0.419 (0.223) vs. 0.514 (0.228)−0.09536138
(CZ-BK2)GLASS FPAR vs. MODIS FPAR0.57 **0.619 (0.23) vs. 0.497 (0.312)0.12248276
(PA-SPs)GLASS FPAR vs. MODIS FPAR-0.835 (0.027) vs. 0.46 (0.183)0.37591138
(US-Wkg)GLASS FPAR vs. MODIS FPAR0.46 **0.141 (0.1) vs. 0.231 (0.117)−0.0955502
CROGLASS FPAR vs. MODIS FPAR0.58 **0.552 (0.198) vs. 0.456 (0.219)0.096311148
(BE-Lon)GLASS FPAR vs. MODIS FPAR0.46 **0.537 (0.165) vs. 0.42 (0.194)0.11745505
(FR-Gri)GLASS FPAR vs. MODIS FPAR0.50 **0.614 (0.184) vs. 0.53 (0.211)0.08433505
(US-CRT)GLASS FPAR vs. MODIS FPAR0.84 **0.378 (0.242) vs. 0.314 (0.231)0.06437138
Significance levels: ** p < 0.01.
Table 5. Comparison of the inferred εmax and MOD17A2H εmax for various biomes. ENF: evergreen needleleaf forests; EBF: evergreen broadleaf forests; DBF: deciduous broadleaf forests; MF: mixed forests; GRA: grasslands; CRO: croplands.
Table 5. Comparison of the inferred εmax and MOD17A2H εmax for various biomes. ENF: evergreen needleleaf forests; EBF: evergreen broadleaf forests; DBF: deciduous broadleaf forests; MF: mixed forests; GRA: grasslands; CRO: croplands.
Biome (Site)MOD17A2H εmax (gC·m−2·d−1·MJ−1)Inferred εmax (gC·m−2·d−1·MJ−1)Bias (gC·m−2·d−1·MJ−1)
ENF0.9621.256−0.294
(AR-Vir)0.9621.521−0.559
(AU-ASM)0.9621.225−0.263
(IT-Ren)0.9621.183−0.221
EBF1.2681.539−0.271
(AU-Whr)1.2681.1750.093
(BR-Sa3)1.2681.695−0.427
(FR-Pue)1.2681.418−0.150
(GH-Ank)1.2681.496−0.228
DBF1.1652.008−0.843
(DE-Hai)1.1652.037−0.872
(DK-Sor)1.1651.988−0.823
MF1.0511.692−0.641
(BE-Vie)1.0511.968−0.917
(CA-Gro)1.0511.371−0.320
GRA0.8601.125−0.265
(AU-Rig)0.8601.292−0.432
(CZ-BK2)0.8601.118−0.258
(PA-SPs)0.8601.141−0.281
(US-Wkg)0.8600.869−0.009
CRO1.0441.303−0.259
(BE-Lon)1.0441.655−0.611
(FR-Gri)1.0441.086−0.042
(US-CRT)1.0441.234−0.190

Share and Cite

MDPI and ACS Style

Wang, L.; Zhu, H.; Lin, A.; Zou, L.; Qin, W.; Du, Q. Evaluation of the Latest MODIS GPP Products across Multiple Biomes Using Global Eddy Covariance Flux Data. Remote Sens. 2017, 9, 418. https://doi.org/10.3390/rs9050418

AMA Style

Wang L, Zhu H, Lin A, Zou L, Qin W, Du Q. Evaluation of the Latest MODIS GPP Products across Multiple Biomes Using Global Eddy Covariance Flux Data. Remote Sensing. 2017; 9(5):418. https://doi.org/10.3390/rs9050418

Chicago/Turabian Style

Wang, Lunche, Hongji Zhu, Aiwen Lin, Ling Zou, Wenmin Qin, and Qiyong Du. 2017. "Evaluation of the Latest MODIS GPP Products across Multiple Biomes Using Global Eddy Covariance Flux Data" Remote Sensing 9, no. 5: 418. https://doi.org/10.3390/rs9050418

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop