Next Article in Journal
Human Physical Activity Recognition Using Smartphone Sensors
Next Article in Special Issue
LiDAR-Based 3D Scans of Soil Surfaces and Furrows in Two Soil Types
Previous Article in Journal
Multi-Band MIMO Antenna Design with User-Impact Investigation for 4G and 5G Mobile Terminals
Previous Article in Special Issue
Comparing RGB-D Sensors for Close Range Outdoor Agricultural Phenotyping
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Case Report

Spectral Data Collection by Dual Field-of-View System under Changing Atmospheric Conditions—A Case Study of Estimating Early Season Soybean Populations

by
Ittai Herrmann
1,*,†,
Steven K. Vosberg
2,†,
Philip A. Townsend
3 and
Shawn P. Conley
2
1
The Robert H. Smith Institute of Plant Sciences and Genetics in Agriculture, The Hebrew University of Jerusalem, Rehovot 7610001, Israel
2
Department of Agronomy, University of Wisconsin-Madison, 1575 Linden Drive, Madison, WI 53706, USA
3
Department of Forest & Wildlife Ecology, University of Wisconsin-Madison, 1630 Linden Drive, Madison, WI 53706, USA
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Sensors 2019, 19(3), 457; https://doi.org/10.3390/s19030457
Submission received: 10 November 2018 / Revised: 6 January 2019 / Accepted: 21 January 2019 / Published: 23 January 2019
(This article belongs to the Special Issue Sensors in Agriculture 2018)

Abstract

:
There is an increasing interest in using hyperspectral data for phenotyping and crop management while overcoming the challenge of changing atmospheric conditions. The Piccolo dual field-of-view system collects up- and downwelling radiation nearly simultaneously with one spectrometer. Such systems offer great promise for crop monitoring under highly variable atmospheric conditions. Here, the system’s utility from a tractor-mounted boom was demonstrated for a case study of estimating soybean plant populations in early vegetative stages. The Piccolo system is described and its performance under changing sky conditions are assessed for two replicates of the same experiment. Plant population assessment was estimated by partial least squares regression (PLSR) resulting in stable estimations by models calibrated and validated under sunny and cloudy or cloudy and sunny conditions, respectively. We conclude that the Piccolo system is effective for data collection under variable atmospheric conditions, and we show its feasibility of operation for precision agriculture research and potential commercial applications.

Graphical Abstract

1. Introduction

Hyperspectral sensing is increasingly utilized in precision agriculture research [1,2]. Hyperspectral data (hundreds of narrow bands) can be analyzed as is or used to calculate vegetation indices that simplify the data but lose the depth and richness of analysis [3,4]. Hyperspectral measurements of plant canopy using the sun as the illumination source can be challenging [5], especially under changing atmospheric conditions, requiring frequent reference data collection by the same or another sensor. MacLellan and Malthus [6] presented the concept of a spectrometer with a dual field-of-view which alternately obtains upwelling (radiance) and downwelling (irradiance) measurements using a cosine response fore optic [7] in lieu of the standard white reference. MacArthur et al. [8] designed and presented the Piccolo, an operational dual field-of-view system, and in the current study, it was mounted on a tractor in soybean experimental plots.
Soybean seedling emergence can often be lower than the seeding rate. Thus, there is a need to assess plant populations in early development stages to guide replanting decisions [9]. The current methodology for population assessment generally consists of counting plants within representative quadrats and calculating the mean of these samples to extrapolate plants per unit area [10]. The variation in current methods of determining soybean populations combined with the time-sensitive importance of acquiring this information makes the automation of this task through sensing of crop reflectance an attractive case study. Hyperspectral imaging has been used for maize seedlings density assessment [11]. The objective of the current study was to explore a tractor-mounted Piccolo system performance under changing atmospheric conditions. As a case study to test the system, soybean plant population estimates were evaluated at early development stages when replanting decisions are to be made. In theory, the principle of operation of the Piccolo means measurements and analyses should be consistent regardless of atmospheric and light conditions (i.e., one predictive model incorporating all light conditions).

2. Materials and Methods

2.1. Study Area and Trial Design

Field experiments were conducted during 2016 at the University of Wisconsin Arlington Agriculture Research Station (43°18′8″ N, 89°20′8″ W). Tillage and row spacing treatments were applied for two cultivars (P28T08R—DuPont Pioneer and AG2433—Monsanto). To develop population variability, 14 seeding rates (3.7 to 51.8 seeds × 104 h−1) were applied for each of the main effects. The plots were either four 0.76 m or six 0.38 m rows by 7.6 m in length. Driving alleys planted with soybeans were interspersed throughout the field to allow for passage of the tractor-mounted spectral system (Figure 1a). The trial was replicated, and spectral data were acquired for four early development stages (Table 1). Plant populations were determined (Table 1) per plot by counting the number of plants in 1.5 m of the center rows. The data collection dates were categorized as sunny or cloudy based on the atmospheric conditions (Table 1). Sunny was defined as clear skies and cloudy ranged from scattered to full cloud cover.

2.2. Spectral Data Collection

Canopy spectra of soybean seedlings were obtained using the Piccolo hyperspectral system equipped with a Flame (Ocean Optics, Inc., Dunedin, FL, USA) spectrometer with a spectral range of 340 to 1022 nm and an optical resolution of 1.33 nm full-width half-maximum interpolated to 1 nm spacing. The Piccolo system was tractor-mounted by a hydraulically actuated boom (Figure 1a). The downwelling fiber viewed the sky through a cosine corrected polytetrafluoroethylene fore-optic, while the upwelling bare fiber viewed the target with 25° view angle, both protected by an optical glass domes (Figure 1b) and fitted with shutters. A Raspberry Pi (Raspberry Pi Foundation, Cambridge, UK) single-board computer synchronized shutter activity and integration times [8]. The GPS (Geo 7x, Trimble Inc, Sunnyvale, CA, USA) data were differentially corrected in Pathfinder software (Trimble Inc, Sunnyvale, CA, USA) and the estimated accuracy ranged from 0.05 to 0.15 m for 99.96% of the corrected positions. The GPS data were used to relate spectral data to physical plot locations. The upwelling fiber was centered on a soybean row ~0.60 m above the ground, resulting in a ~0.13 m radius field of view at ground level. Spectral data were collected within two hours of solar noon, and two passes per plot per collection date allowed data collection from the two center rows. The integration times were set to maximize unsaturated signal, with values of 4–6 and 13–15 ms for downwelling and upwelling, respectively. One spectral sample was computed from a four-measurement sequence: (1) upwelling dark current; (2) upwelling target measurement; (3) downwelling target; and (4) downwelling dark current. The spectrometer obtained upwelling and downwelling data almost simultaneously (~0.6 s) using two fiber optics (400 μm and 600 μm, respectively) completely covering the 1000 μm long (25 μm wide) spectrometer slit. Such rapid measurements by the same spectrometer from both fore optics minimized the atmospheric effect on relative reflectance data (Figure 1c–e). Tractor speed was set to 0.22 m s−1 and actual time between the starting points of two successive spectral samples was ~2.6 s, resulting in 13 spectral samples collected per plot row.

2.3. Data Processing and Statistical Analysis

Relative reflectance was obtained by first subtracting dark current from upwelling radiance and downwelling irradiance, then the radiance was divided by the irradiance, while accounting for fiber diameter, integration times, and field of view (Python scripts at https://github.com/prabu-github/tracolo); the equation is presented in [13]. The 1 nm spectra were smoothed by a 2nd order polynomial and 5 nm filter [14] and averaged, resulting in relative reflectance in the range of 400 to 900 nm in 5 nm intervals averaged per plot.
The normalized difference spectral index (NDSI) [15] analysis was applied to explore the quality of correlation of all possible two-bands with the measured plant population. Partial least squares regression (PLSR) [16] a practical predictive tool for spectral reflective data, was used to estimate soybean plant populations as a function of the hyperspectral measurements. Datasets were calibrated, cross validated, and independently validated. Calibration and cross validation was done for 75% of the samples. The calibration and cross validation process was iterated 100 times for random sample distribution of calibration (75%) and cross validation (25%), resulting in 100 models. These models were independently validated for the samples left out of the calibration and cross validation process, resulting in estimated plant population values. The estimated values were averaged to obtain the mean estimated population, and the estimated vs. measured plant population values were regressed to obtain R2 and root mean square error (RMSE) of calibration, cross validation, and validation. The PLSR analyses and results processing were conducted in R 3.3.2 [17].

3. Results and Discussion

Plant population predictions at V1 and V3 development stages using PLSR were obtained under sunny conditions in one trial replicate and under cloudy conditions in the other (Table 1). The quality of predictions was not affected by atmospheric conditions (Figure 2a,b), with no trends in residuals between sunny and cloudy predicted vs. measured plant populations. The later development stages showed higher R2 of independent validation and smaller RMSE, as expected based on the time of population count (Table 1). The V1 predictions were worse than V3, with V1 plant populations overestimated by both sunny and cloudy plots. This was expected since V1 seedlings are smaller and thus less likely to be in the Piccolo field of view. For V3 plots with more than ~30 plants × 104 h−1 (hectare−1), there was some underestimation (Figure 2b). At this development stage, seedling foliage overlaps more than earlier stage plants such that higher populations have an increased probability of overlapping. The prediction vs. measured plant population for development stage (treatments and replicates pooled together) showed that models based on sunny and cloudy data (V1 and V3) have similar prediction qualities as those based on cloudy alone (V2; Figure 2c). The R2 and root mean square error (RMSE) of all calibration cross validation and validation PLSR models down to treatment level (32) as well as development stage models (4) and all-data-together (1) are presented in Table S1. There was no robust advantage for one of the two till treatments. The development stages as well as all-data-together models pooled different row spacing and tillage treatments; this generalization reduces the quality of the models, especially in the RMSE values. The RMSE values for the general models were more than 10 times higher than the RMSE values of the treatment-specific models. The NDSI found 565 and 710 nm in the top 10 band combinations for 15 out of the 32 datasets explored. The importance of green- and red-edge bands in maize stand counts is supported by Thorp, Steward, Kaleita, and Batchelor [11]. The NDSI[565, 710] plant population estimation models further support the ability of the spectral system to provide high quality data under sunny and cloudy conditions. All NDSI[565, 710] models are presented in Table S2 and the figures in Figure S1. The PLSR models resulted in better population assessment than the NDSI, showing the advantage of many narrow bands over a two bands combination.
The Piccolo system provided an efficient method for the collection of plant reflectance by eliminating the need for frequent reference standard measurements. The performance of the system was tested prior to the commencement of the current study by measuring an area of grass near solar noon under sunny and cloudy conditions. To avoid device-induced shade on the target, the fore optics were moved a few centimeters. As expected, the photon counts for downwelling and upwelling were significantly greater under sunny conditions compared to cloudy conditions (Figure 1c–e). However, the relative reflectance spectra were nearly identical in the visible and red-edge wavelengths, with slight divergence in the near infrared bands.

4. Conclusions

The Piccolo dual field-of-view spectrometer system was found effective at data collection under changing atmospheric conditions. This demonstrates the feasibility of its operation for precision agricultural research and potential commercial applications. For the case study of plant population assessment, (1) the best development stages for plant population assessment specifically for treatments (row spacing and tillage; Table S1) are V2 and V3, while for pooling treatments per development stage, V1, V2, and V3 models are of similar quality; and (2) hyperspectral data resulted in better population assessment than NDSI[565, 710]. Although other technologies may be suitable for crop population monitoring, once systems such as the Piccolo become part of the standard suite of crop monitoring instrumentation mounted on tractors or other agricultural implements, it will become essential to test the instrument for a range of uses. Software and hardware modifications would be required to explore aerial implementation and more efficient data collection.

Supplementary Materials

The following are available online at https://www.mdpi.com/1424-8220/19/3/457/s1, Table S1: Results of PLSR calibration and validation plant population prediction models, Table S2: Results of NDSI calibration and validation plant population prediction models, Figure S1: Plant population (plant per h × 104) predicted by NDSI vs. measured. Prediction of plant population for row spacing treatments, 38 and 76 cm, and till treatments NT (no till) and CT (conventional till) under sunny and cloudy conditions for validation dataset of V1 (vegetative 1) development stage (a) and V3 development stage (b). R2 values for NDSI validated by replicate 1 (cloudy) and replicate 2 (sunny) for the row spacing and till treatments are presented as well. Prediction of plant population for development stages VC, V1, V2, and V3 by validation datasets including all treatments and both replicates together (c). R2 values for NDSI validated by development stage.

Author Contributions

I.H., S.K.V., S.P.C., and P.A.T. conceived and designed the experiments; I.H. and S.K.V. performed the experiments and collected spectral data and destructive samples; S.K.V. and S.P.C. obtained agronomic data; I.H. and S.K.V. analyzed spectral data; I.H. and P.A.T. contributed preprocessing and analysis tools for spectral data; I.H., S.K.V., S.P.C., and P.A.T. wrote the paper.

Acknowledgments

Research support for S.P.C, S.K.V., and I.H. was provided by the Wisconsin Soybean Marketing Board (WSMB). Support for P.A.T. was provided by the NASA Advanced Information Systems Technology program (grant NNX15AN25G), USDA Hatch Project WIS01874, with additional support to all researchers from the WSMB. The authors would like to thank Clayton Kingdon for his effort and insights; John Gaska for mounting the system to the tractor; Prabu Ravindran for programming support; Alasdair MacArthur and Iain Robinson for their support of the Piccolo instrumentation; and Aditya Singh for mechanical suggestions and coding. Spectral data and associated metadata for this project can be downloaded from EcoSIS.org (https://ecosis.org/#result/c392172b-0081-4cc2-873f-24099fa8e7a4; DOI in progress). The guidance of the anonymous reviewers is much appreciated.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Lee, W.S.; Alchanatis, V.; Yang, C.; Hirafuji, M.; Moshou, D.; Li, C. Sensing technologies for precision specialty crop production. Comput. Electron. Agric. 2010, 74, 2–33. [Google Scholar] [CrossRef]
  2. Mulla, D.J. Twenty five years of remote sensing in precision agriculture: Key advances and remaining knowledge gaps. Biosyst. Eng. 2013, 114, 358–371. [Google Scholar] [CrossRef]
  3. Herrmann, I.; Pimstein, A.; Karnieli, A.; Cohen, Y.; Alchanatis, V.; Bonfil, D.J. LAI assessment of wheat and potato crops by VENμS and Sentinel-2 bands. Remote Sens. Environ. 2011, 115, 2141–2151. [Google Scholar] [CrossRef]
  4. Nigon, T.J.; Mulla, D.J.; Rosen, C.J.; Cohen, Y.; Alchanatis, V.; Knight, J.; Rud, R. Hyperspectral aerial imagery for detecting nitrogen stress in two potato cultivars. Comput. Electron. Agric. 2015, 112, 36–46. [Google Scholar] [CrossRef]
  5. Anderson, K.; Milton, E.J.; Rollin, E.M. Calibration of dual-beam spectroradiometric data. International J. Remote Sens. 2006, 27, 975–986. [Google Scholar] [CrossRef]
  6. MacLellan, C.J.; Malthus, T.J. High performance dual field of view spectrometer with novel input optics for, autonomous reflectance measurements over an extended spectral range. In Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Cape Town, South Africa, 12–17 July 2009; pp. 2163–2166. [Google Scholar]
  7. Meroni, M.; Barducci, A.; Cogliati, S.; Castagnoli, F.; Rossini, M.; Busetto, L.; Migliavacca, M.; Cremonese, E.; Galvagno, M.; Colombo, R.; et al. The hyperspectral irradiometer, a new instrument for long-term and unattended field spectroscopy measurements. Rev. Sci. Instrum. 2011, 82. [Google Scholar] [CrossRef] [PubMed]
  8. MacArthur, A.; Robinson, I.; Rossini, M.; Davis, N.; Mac Donald, K. A dual-field-of-view spectrometer system for reflectance and fluorescence measurements (Piccolo Doppio) and correction of etaloning. In Proceedings of the 5th International Workshop on Remote Sensing of Vegetation Fluorescence, Paris, France, 22–24 April 2014. [Google Scholar]
  9. Gaspar, A.P.; Conley, S.P. Responses of Canopy Reflectance, Light Interception, and Soybean Seed Yield to Replanting Suboptimal Stands. Crop Sci. 2015, 55, 377–385. [Google Scholar] [CrossRef]
  10. Gaspar, A.P.; Conley, S.P.; Gaska, J.M. Thinking Twice before Replanting Soybeans. Available online: http://www.coolbean.info/library/documents/SoybeanReplant_2014_FINAL.pdf (accessed on 18 May 2017).
  11. Thorp, K.R.; Steward, B.L.; Kaleita, A.L.; Batchelor, W.D. Using aerial hyperspectral remote sensing imagery to estimate corn plant stand density. Trans. Asabe 2008, 51, 311–320. [Google Scholar] [CrossRef]
  12. Fehr, W.R.; Caviness, C.E.; Burmood, D.T.; Pennington, J.S. Stage of development descriptions for soybeans, Glycine max (L.) Merrill. Crop Sci. 1971, 11, 929–931. [Google Scholar] [CrossRef]
  13. Herrmann, I.; Vosberg, S.; Ravindran, P.; Singh, A.; Chang, H.-X.; Chilvers, M.; Conley, S.; Townsend, P. Leaf and Canopy Level Detection of Fusarium Virguliforme (Sudden Death Syndrome) in Soybean. Remote Sens. 2018, 10, 426. [Google Scholar] [CrossRef]
  14. Savitzky, A.; Golay, M. Smoothing and differentiation of data by simplified least squares procedures. Anal. Chem. 1964, 36, 1627–1639. [Google Scholar] [CrossRef]
  15. Inoue, Y.; Penuelas, J.; Miyata, A.; Mano, M. Normalized difference spectral indices for estimating photosynthetic efficiency and capacity at a canopy scale derived from hyperspectral and CO2 flux measurements in rice. Remote Sens. Environ. 2008, 112, 156–172. [Google Scholar] [CrossRef]
  16. Wold, S.; Johansson, E.; Cocchi, M. PLS—partial least squars projections to latent structures. In 3D QSAR in Drug Design: Theory, Methods, and Applications; Kubinyi, H., Ed.; ESCOM: Leiden, The Netherlands, 1993; pp. 523–550. [Google Scholar]
  17. Mevik, B.H.; Wehrens, R.; Liland, K.H. PLS: Partial Least Squares and Principal Component Regression, R Package Version 2.6-0. 2016. Available online: https://CRAN.R-project.org/package=pls (accessed on 25 September 2018).
Figure 1. Spectral data collection under sunny and clouded atmospheric conditions. The tractor and boom deployed over soybean plants (a), zooming to the spectrometer box, fiber optics, shutter tube, and GPS receiver (b). Upwelling and downwelling raw data (counts) collected from a grassy area, obtained in sunny (c) and cloudy (d) conditions, and preprocessing resulted in relative reflectance (e).
Figure 1. Spectral data collection under sunny and clouded atmospheric conditions. The tractor and boom deployed over soybean plants (a), zooming to the spectrometer box, fiber optics, shutter tube, and GPS receiver (b). Upwelling and downwelling raw data (counts) collected from a grassy area, obtained in sunny (c) and cloudy (d) conditions, and preprocessing resulted in relative reflectance (e).
Sensors 19 00457 g001
Figure 2. Plant population (plant × 104 h−1) predicted by partial least squares regression (PLSR) vs. measured. Prediction of plant population for row spacing treatments, 38 and 76 cm, and till treatments NT (no till) and CT (conventional till) under sunny and cloudy conditions for validation dataset of V1 (vegetative) development stage (a) and V3 development stage (b). R2 values for PLSR validated by replicate 1 (cloudy) and replicate 2 (sunny) for the row spacing and till treatments are presented as well. Prediction of plant population, for development stages VC, V1, V2, and V3 by validation datasets including all treatments and both replicates together (c). R2 values for PLSR validated by development stage. Error bars are the standard deviation of 100 cross validation iterations.
Figure 2. Plant population (plant × 104 h−1) predicted by partial least squares regression (PLSR) vs. measured. Prediction of plant population for row spacing treatments, 38 and 76 cm, and till treatments NT (no till) and CT (conventional till) under sunny and cloudy conditions for validation dataset of V1 (vegetative) development stage (a) and V3 development stage (b). R2 values for PLSR validated by replicate 1 (cloudy) and replicate 2 (sunny) for the row spacing and till treatments are presented as well. Prediction of plant population, for development stages VC, V1, V2, and V3 by validation datasets including all treatments and both replicates together (c). R2 values for PLSR validated by development stage. Error bars are the standard deviation of 100 cross validation iterations.
Sensors 19 00457 g002
Table 1. Key dates for agronomical activities and spectral data collection.
Table 1. Key dates for agronomical activities and spectral data collection.
Replicate 1Replicate 2
DateDevelopment StageActivityDateDevelopment StageActivity
31-May-2016 Planting15-Jul-2016-Planting
17-Jun-2016VCSpectra27-Jul-2016VCSpectra
21-Jun-2016V1Spectra *1-Aug-2016V1Spectra
26-Jun-2016V2Population count2-Aug-2016V1Population count
27-Jun-2016V2Spectra4-Aug-2016V2Spectra
29-Jun-2016V3Spectra8-Aug-2016V3Spectra *
1 Development stages are all V (vegetative) with subscripts indicating stage of development. Vc indicates the cotyledon leaf stage; V1 indicates the first completely unrolled true leaf; V2 indicates the second completely unrolled true leaf; V3 indicates the third completely unrolled true leaf on the main stem [12]. * stands for spectral collection under sunny conditions for all data obtained this day.

Share and Cite

MDPI and ACS Style

Herrmann, I.; Vosberg, S.K.; Townsend, P.A.; Conley, S.P. Spectral Data Collection by Dual Field-of-View System under Changing Atmospheric Conditions—A Case Study of Estimating Early Season Soybean Populations. Sensors 2019, 19, 457. https://doi.org/10.3390/s19030457

AMA Style

Herrmann I, Vosberg SK, Townsend PA, Conley SP. Spectral Data Collection by Dual Field-of-View System under Changing Atmospheric Conditions—A Case Study of Estimating Early Season Soybean Populations. Sensors. 2019; 19(3):457. https://doi.org/10.3390/s19030457

Chicago/Turabian Style

Herrmann, Ittai, Steven K. Vosberg, Philip A. Townsend, and Shawn P. Conley. 2019. "Spectral Data Collection by Dual Field-of-View System under Changing Atmospheric Conditions—A Case Study of Estimating Early Season Soybean Populations" Sensors 19, no. 3: 457. https://doi.org/10.3390/s19030457

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop