Next Article in Journal
Relationship between Urine Creatinine and Urine Osmolality in Spot Samples among Men and Women in the Danish Diet Cancer and Health Cohort
Previous Article in Journal
Green Synthesis of Homogeneous Gold Nanoparticles Using Sargassum spp. Extracts and Their Enhanced Catalytic Activity for Organic Dyes
Previous Article in Special Issue
Indoor Air Quality including Respiratory Viruses
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Calibration of Low-Cost NO2 Sensors through Environmental Factor Correction

1
School of Molecular Sciences, Arizona State University, Tempe, AZ 85287, USA
2
Clarity Movement Co., Berkeley, CA 94710, USA
3
Maricopa County Air Quality Department, Phoenix, AZ 85012, USA
4
School of Sustainable Engineering and the Built Environment, Arizona State University, Tempe, AZ 85287, USA
*
Author to whom correspondence should be addressed.
Toxics 2021, 9(11), 281; https://doi.org/10.3390/toxics9110281
Submission received: 24 September 2021 / Revised: 12 October 2021 / Accepted: 25 October 2021 / Published: 28 October 2021
(This article belongs to the Special Issue Analytical Chemistry of Air Pollution)

Abstract

:
Low-cost air quality sensors (LCSs) have become more widespread due to their low cost and increased capabilities; however, to supplement more traditional air quality networks, the performance of these LCSs needs to be validated. This study focused on NO2 measurements from eight Clarity Node-S sensors and used various environmental factors to calibrate the LCSs. To validate the calibration performance, we calculated the root-mean-square error (RMSE), mean absolute error (MAE), R2, and slope compared to reference measurements. Raw results from six of these sensors were comparable to those reported for other NO2 LCSs; however, two of the evaluated LCSs had RMSE values ~20 ppb higher than the other six LCSs. By applying a sensor-specific calibration that corrects for relative humidity, temperature, and ozone, this discrepancy was mitigated. In addition, this calibration improved the RMSE, MAE, R2, and slope of all eight LCS compared to the raw data. It should be noted that relatively stable environmental conditions over the course of the LCS deployment period benefited calibration performance over time. These results demonstrate the importance of developing LCS calibration models for individual sensors that consider pertinent environmental factors.

Graphical Abstract

1. Introduction

Although annual ambient NO2 concentrations have been decreasing in many locations in North America, many East Asian countries are seeing increases in the annual mean NO2 concentration [1]. Studies have shown that exposure to NO2 can lead to increased preterm birth and infant mortality, increased asthma symptoms, allergic rhinitis, and chronic obstructive pulmonary diseases [2,3]. The U.S Environmental Protection Agency’s (EPA) current National Ambient Air Quality Standard (NAAQS) for 1-h NO2 is 100 ppbV, while the World Health Organization’s 2005 1-h NO2 guideline value is 200 μg/m3 [4,5]. Even in areas that meet health-based standards to protect against exposure to NO2, there is still the need to measure ambient NO2 levels, as photochemical reactions of NO2 can result in ground-level ozone and fine particle formation [4]. Anthropogenic NO2 is mainly formed through high-temperature combustion processes from both mobile and stationary sources; the EPA’s 2017 National Emission Inventory reports 52% of NO2 emissions from mobile sources such as cars, trucks, and planes, and 32% from stationary sources such as power plants and cement kilns [6,7].
The main purpose of air monitoring networks is to observe the community’s exposure to air pollutants. In Maricopa County, Arizona, regulatory monitoring includes quantification of ambient levels of NO2, CO, PM10 (particulate matter with an aerodynamic diameter ≤ 10 µm), PM2.5 (particulate matter with an aerodynamic diameter ≤ 2.5 μm), SO2, and O3. This is accomplished by using 29 air monitoring stations spread out across the county that utilize EPA-approved federal reference methods (FRMs) and federal equivalent methods (FEMs), are regularly calibrated, and produce high-quality data. However, not all of these stations measure all regulated pollutants, and the FRM instruments require expensive sensing equipment and intensive calibration and verification. As a result of the comparably high FRM cost of installation and operation, the limited number of stations measuring each pollutant provides a relatively coarse spatial resolution and community coverage, as compared to finer-scale low-cost air quality sensors (LCSs) deployed in a county as large as Maricopa County. For example, the NO2 FRM at West Phoenix collects data, defined by the monitor’s surrounding Thiessen polygon, that is expected to represent the exposure to that pollutant over an area of 1278 km2, which is home to over 1 million people [8]. Zhu et al. demonstrated the importance of increasing spatial coverage of NO2 monitoring, as often these government monitoring stations do not properly cover pollution hot spots [9].
An alternative approach to air monitoring instrumentation are LCSs, which have recently become more popular as their capabilities increase and cost decreases. Often, these sensors can measure several pollutants simultaneously, require minimal setup, can be easily moved, and can cost less than two thousand dollars. These sensors can be used to study small-scale processes or supplement larger air monitoring networks by increasing their spatial resolution [10,11,12]. However, these sensors have been shown to be less accurate and precise compared to FRMs, and often require collocation with a FRM to develop a calibration model [13,14]. In a 2020 report, the U.S. Government Accountability Office highlighted challenges that the nation’s air quality monitoring system is facing, including aging infrastructure and decreasing funding, and recommended a modernization plan that includes further study on the performance and calibration of LCSs [15].
Although the EPA has published Performance Targets and Testing Protocols of LCSs for PM2.5 and O3, it has yet to publish guidance on the appropriate approach to evaluate NO2 LCSs [16,17]. However, the South Coast Air Quality Management District (SCAQMD) has tested a variety of NO2 LCSs and publishes its results online [18]. Table 1 summarizes the testing results of NO2 measured by LCSs that use electrochemical sensors.
While SCAQMD only tests LCSs as-is, there are a variety of published studies that have tested various calibration techniques on similar sensors. Han et al. [20] conducted a 12-month field evaluation of four Alphasense NO2-B43F sensors and tested several linear regression and neural network calibration methods that accounted for temperature and relative humidity. They concluded that the neural network significantly improved the NO2 data compared to the other methods. However, one potential problem in this study is that they used one set of sensors to train the calibration models and the other set to test sensor performance, resulting in questions about the performance between individual LCSs deploying the same sensing technology. Suriano et al. [21] designed and tested a field evaluation system for LCSs, including two Alphasense NO2-B43F sensors, and used linear regression and multivariate linear regression models to calibrate these sensors, considering the interfering effects of relative humidity, temperature, and ozone. Sahu et al. [22] also evaluated Alphasense NO2-B43F sensors and recommended incorporating temperature and relative humidity into calibration models and maximizing the diversity of data used in training; they also concluded that using a local non-parametric calibration method with a learned metric maximized sensor performance. Another study, Masey et al. [23], tested Aeroqual S5000 NO2 sensors and used a linear regression calibration model that included ozone but not temperature and relative humidity. This study analyzed the impact of varying training datasets on calibration performance and concluded that the best performance came from combining data from intermittent periods during the deployment into one training dataset. Lin et al. [24] further studied the impact of ozone on Aeroqual S5000 NO2 sensors and found that the sensor bias was significantly correlated to nearby ozone measurements and saw improved sensor performance after correcting for ozone.
Despite these prior studies, questions remain about the intercomparability of multiple LCSs measuring NO2 using the same sensing approach. In this work, we evaluated the performance of eight NO2 LCSs of the same make and model compared to a FRM instrument over a 4-month period. The number of LCSs used allowed us to better characterize their performance as a cohesive network and identify any outliers. We examined the impact of environmental factors such as temperature, relative humidity, and ozone on the LCSs and developed calibration methods to correct for these potential influences. Additionally, we studied the impact of training data volume on the performance of the calibration, in terms of accuracy and precision among the LCSs.

2. Materials and Methods

2.1. Low-Cost Sensors and Reference Monitoring

The collocation study was conducted in Maricopa County, Arizona, USA for 4 months, from October 2020 to February 2021. One of the largest urban areas in the Southwestern United States, Maricopa County has a growing population of 4.4 million residents with elevated levels of air pollution, exceeding the EPA’s 8-h O3 standard of 70 ppb [25]. Over the study period, the meteorological conditions varied widely, with a temperature range of 2–34 °C and a relative humidity range of 6–97%. Eight LCSs, Clarity Node-S models (Clarity Movement Co., Berkeley, CA, USA), were used in this study. These devices are capable of measuring PM2.5 and NO2 while also containing sensors to track the temperature and relative humidity inside the device. The NO2 measurement is made with an Alphasense NO2-A43F electrochemical cell (Alphasense Ltd., Great Notely, UK) that has an ozone filter at the front end to limit interfering species, as the electrochemical cell has a 100% cross-sensitivity with ozone [26]. These LCSs are solar powered and take and report measurements every 15 min, uploading these data to the Clarity cloud using a cellular connection, where the data are then averaged into hourly measurements.
These LCSs were collocated with a NO2 FRM instrument at Maricopa County Air Quality Department’s West Phoenix monitoring site (AQS ID: 04-013-0019). This air monitoring site operates at a neighborhood scale (radius of 0.5–4 km) while covering a population of over one million individuals [8]. The LCSs were mounted on a fence 2 m above the ground and 10 m away from the FRM inlet as shown in Figure 1. The NO2 FRM instrument at this site is a Thermo Scientific 42iQ NO-NO2-NOx Analyzer (ThermoFisher Scientific, Franklin, MA, USA), while the O3 FEM instrument is a Teledyne-API T400 (Teledyne API, San Diego, CA, USA). Data from these instruments were obtained from MCAQD at a 1-h resolution.

2.2. Calibration Models

Three data series are compared in this study; the raw performance of the sensors based solely on NO2 sensor response; a calibration model applied by the manufacturer to correct bias and account for sensor response to changing temperature and relative humidity; and a calibration model that starts with the manufacturer calibration that further accounts for sensor response to changing ozone concentrations. The training and testing time periods of these calibration models were varied in an attempt to optimize their performance.

2.2.1. Raw Calibration

Raw NO2 concentrations are calculated by Clarity using the potentiostat voltages proportional to the working and auxiliary electrodes (vGas and vAux, respectively) measured from an Alphasense NO2-A43F sensor using Equation (1), where asSensitivity is a sensor-specific value provided by the manufacturer that allows for the conversion from nA to ppb. The 106/499 quantity is specific to the implementation of the potentiostatic circuit and is calculated by solving the circuit (in particular, the current measuring circuit).
NO 2 Raw = ( vGas vAux ) ( 10 6 499 ) as   Sensitivity

2.2.2. Clarity Baseline Calibration Model

The Clarity baseline calibration model uses the electrochemical cell’s working and auxiliary voltage along with the sensor’s internal temperature and relative humidity readings in a multivariate regression model. This model is fit to collocation data for each sensor, which corrects for shifts in the baseline caused by the current temperature and relative humidity changes in the recent past. This calibration model was then compared against the NO2 measurement by the FRM sensor.

2.2.3. Ozone Correction Calibration Model

Initial review of data showed a high correlation between the LCS NO2 measurements and FEM O3 measurements as shown in Table S1. To elucidate the impact of ozone on NO2 measurements, a second calibration model, Equation (2), was applied on top of the Clarity baseline calibration to also incorporate LCS response to changing ozone concentrations. We proceeded with this approach as O3 FEM measurements were available at the West Phoenix collocation site, and in future field deployments, these LCSs will also be collocated with O3 FEM instruments. Figure 2 demonstrates that ozone only has a noticeable effect on the LCS NO2 measurements above a certain threshold value, a, which is reflected in Equation (2). Lab studies performed on the Alphasense NO2-B43F, which has a larger ozone filter than the NO2-A43F model, have shown an O3 cross-sensitivity of 6.6% and warned that this cross-sensitivity could increase over time [27]. This same study found that the NO2-B43F signal was linearly dependent on relative humidity with hysteresis and that six of the LCSs had a direct relationship between temperature and reported NO2 concentrations, but that two sensors showed an inverse relationship between sensor values and temperature. This study was unable to explain this discrepancy and may indicate that LCSs built from the same components may behave differently in field deployments.
The Clarity baseline calibration model used in this study can interpret low NO2 concentrations as zero or negative concentrations; however, when viewed by consumers, the negative concentrations are clipped. The ozone correction calibration model applies a second correction to force all data above zero, as detailed in Equations (3)–(5).
x = [ ( O 3 > a ) ( NO 2 Clarity ( c 1 O 3 ) ) ( ¬ ( O 3 > a ) NO 2 Clarity ) ] + c 2
y = ( x < 0 ) ( x + ( c 3 x ) ) ( ¬ ( x < 0 ) x )
z = ( ( 1 < y < b ) ( y + c 4 y ) ) ( ¬ ( 1 < y < b ) y )
NO 2 Ozone   Corrected = ( ( 0 < z < 1 ) ( z + c 5 z ) ) ( ¬ ( 0 < z < 1 ) z )

2.3. Calibration Evaluation Methods

From the LCS NO2 data, several parameters, including root-mean-square error (RMSE), mean absolute error (MAE), R2, standard deviation, and slope were calculated and used to evaluate the performance of each calibration compared to the FRM NO2 measurements. RMSE and MAE were used to quantify the accuracy of the LCSs, R2 was used to quantify the fit of the data relative to FRM measurements, and standard deviation was used to determine precision among the LCSs. Additionally, slope and the Pearson correlation coefficient were used to quantify the impact of environmental factors such as relative humidity, temperature, and ozone on the LCSs. RMSE was calculated using the procedure documented in the EPA’s Performance Testing Protocols, Metrics, and Target Values for O3 Air Sensors; MAE was calculated using Equation (6), where yi is the LCS measurement and xi is the FRM measurement; and standard deviation was calculated using Equation (7) [17].
MAE = i = 1 n | y i x i | n
SD = i = 1 n ( y i y ¯ ) 2 n 1

3. Results and Discussion

3.1. Raw LCS NO2 Measurements

Figure 3 shows the times series plots for the West Phoenix NO2 FRM instrument and the raw data from LCS #2, while Figure 4 is a scatter plot of LCS #2 raw NO2 vs. West Phoenix NO2 FRM with linear regression parameters. In Figure 3, it is apparent that the raw LCS data under-measure NO2 compared to the FRM and regularly report negative values. Figure 4 indicates that the overall responsiveness of the LCSs reflects changing NO2 concentrations as the slope is close to 1; however, variability, as demonstrated by the data scatter, shows LCS shortcomings. Statistics for the colocation period from all eight LCSs are shown in Table 2. By testing eight LCSs, we demonstrated that not all sensors of the same make and model always behave the same, as we saw that LCS #5 and #11 have substantially larger RMSE values and lower R2 values than the other LCSs. By including the performance of these two outlier LCSs, the standard deviation between all LCSs for the whole period was 8.8 ppb; however, excluding the two outlier LCSs resulted in the standard deviation dropping to 3.2 ppb. Results from the other six LCSs fell in the range of previously studied LCSs shown in Table 1; for example, Sensor 2 had a MAE of 8.7 ppb and a R2 of 0.5974, which were comparable to AQMesh (V5.1) LCS.
As shown in numerous other studies [20,21,22,23,24], the data from LCSs can be improved through calibrations that account for relative humidity, temperature, and ozone, among other factors. Table S1 provides evidence that the raw output from these sensors is affected by these environmental conditions compared to their effect on the FRM instrument. In Table S1, we see that the raw LCS NO2 data was more strongly impacted by environmental parameters such as relative humidity, temperature, and ozone; LCS #2 had a higher Pearson correlation to temperature, relative humidity, and ozone (T: −0.66, RH: 0.52, O3: −0.89) than the FRM data (T: −0.32, RH: 0.14, O3: −0.81). This effect is demonstrated in Figure 5, as the average absolute biases of the LCSs were higher when the relative humidity was greater than 35% and ozone was greater than 40 ppb. Additionally, Figure 5 and Table S1 further highlight the difference between LCSs #5 and #11 and the rest of the sensors, as they typically had absolute biases 20 ppb higher and slopes double those of the other sensors.

3.2. Clarity LCS NO2 Calibration

To correct for varying responses to environmental conditions, Clarity applies a calibration to the raw NO2 concentration that accounts for the impact of temperature and relative humidity on sensor response. To develop their calibration, Clarity recommends collocating their LCSs with a FRM/FEM instrument for at least 2 weeks. This initial calibration was trained using data from a 15-day period (26 October 2020–9 November 2020 LCS #2 n = 361). The time series for the LCS #2 calibrated data is seen in Figure 6 with the scatter plot in Figure 7. After the application of the correction calibration, the LCS data underestimated and overestimated NO2 at times with a decrease in the number of negative values (n = 226) compared to the raw data (n = 366). Summarized statistical results of all sensors for the whole deployment period are in Table 3, while Figure 8 directly compares the raw data to the Clarity calibrated data. Figure 8A clearly shows that the calibration reduced the RMSE from an average of 15 ppb to 9 ppb, and Figure S1 shows a reduction in MAE from 12 ppb to 7 ppb for all LCSs. Additionally, the average standard deviation over the whole deployment period was lowered from 8.8 ppb to 5.5 ppb. However, the scatter in the data was not uniformly improved, as LCS #5 and #11 had lower R2 values (0.35, 0.34) with the Clarity calibration compared to the raw data (0.36, 0.40) (Figure 8B). In terms of slope, the Clarity calibration improved LCS #5 (2.1 to 0.76) and #11 (1.8 to 0.73) with minimal improvements seen in the other sensors (Figure 8C). Additionally, as seen in Figure 6 and Figure 7, the calibration did not completely remove negative or zero values of NO2, leading to larger errors.
In addition to comparing raw and Clarity calibrated data across the whole period, we wanted to compare data excluding the calibration training period and evaluate how the calibration performed over time. By excluding data from the calibration training period during the first 15 days of deployment, we were able to demonstrate the predictive ability of the calibration model. When this analysis was performed (Figure S2), we saw the same trends as when the whole period was evaluated: specifically, a uniform decrease in RMSE and MAE and minimal changes in R2 and slope, indicating that the calibration did improve the data during the test period. To evaluate the calibration over time, the RMSE and R2 values for the LCSs were calculated for 2-week periods, as shown in Figure 9 for both the raw and Clarity calibrated data, to produce a temporal trend. This analysis showed no statistical change in sensor performance over time. This lack of sensor drift can be explained by looking at the environmental parameters experienced by the LCSs over their deployment period. Figure S3 shows that temperature, relative humidity, NO2, and O3 did not substantially differ between the calibration period and the final 15 days of deployment (29 January 2021–12 February 2021), indicating that the training data spanned the range of environmental conditions experienced during the study.

3.3. Impact of Volume of Training Data on Calibration Performance

To investigate possible approaches to improve the calibration process, we tested whether larger training data volume resulted in an improvement of the LCS measurements. For this, we doubled the volume of data the Clarity model was trained on to include data collected between 26 October 2020 and 23 November 2020 (LCS #2 n=721). Figure 10 shows the RMSE (A) and R2 (B) values of the test period for the Clarity calibrated data using 15- and 30-day training periods. By using ~30 days for calibration, the RMSE decreased for all sensors during the test period, there was less scatter in the data except for LCS #7, and the standard deviation decreased to 4.3 ppb. Table 4 and Table S2 summarize the results of the 30-day Clarity calibration for the whole period, including how the data responded to environmental conditions. The 30-day Clarity calibrated data, Table S2, better accounted for environmental biases in the LCSs relative to the NO2 FRM measurement compared to the raw data previously shown in Table S1. For example, LCS #2 with the 30-day Clarity calibration had similar correlations to temperature, relative humidity, and ozone (T: −0.30, RH: 0.03, O3: −0.73) compared to the FRM data (T: −0.32, RH: 0.14, O3: −0.81). The 30-day Clarity calibrated data also had higher correlation coefficients with the FRM data ( 0.66     x     0.89 ) compared to the raw data ( 0.60     x     0.83 ). However, the 30-day Clarity calibration only adjusted for temperature and relative humidity, motivating further investigation of whether there was still room for improvement by accounting for other covariates in the model.

3.4. Ozone Correction for LCS Calibration

The Clarity calibration does not account for the effect of ozone on NO2 measurements because the LCS does not have a built-in O3 sensor even though the electrochemical sensor used to monitor for NO2 is known to also respond to O3 [26]. For this study, the LCSs were collocated at an air quality monitoring site that also had an O3 FEM instrument. In review of the Clarity calibrated data, an initial observation was that elevated ambient levels of ozone impacted LCS NO2 performance, motivating an ozone correction to data collected during high ambient ozone levels. This effect is illustrated in Figure 2. In addition to correcting for the influence of ozone, our supplemental calibration also was designed to eliminate negative values by establishing a baseline. Figure 11 and Figure 12 show the results of these corrections applied to the 30-day Clarity calibrated data on LCS #2. With this correction, the standard deviation between LCSs fell to 3.6 ppb, the RMSE decreased for all LCSs, and the R2 increased for all sensors as shown in Table 5. Compared to results of similar multivariate linear regression model studies [21], our data showed a higher average R2 (0.80) compared to (0.41), an average slope and intercept of (0.989, −0.3) compared to (0.664, 3.0), and a MAE of 4.6 ppb compared to 3.0 ppb.
In addition to improving sensor performance, this calibration also increased the LCS correlation to the FRM NO2 measurements (0.79   x   0.92) and optimized their response to environmental conditions compared to the 30-day Clarity calibration, as shown in Table S3. Furthermore, Figure 2 demonstrates that the impact of high ozone on the LCS NO2 measurements was lessened, as the LCS NO2/FRM NO2 values at ozone concentrations greater than 20 ppb were reduced. Figure 13 illustrates how the impact of environmental conditions on the sensor’s accuracy was reduced, as the absolute sensor biases decreased compared to Figure 5. Looking at the calibration’s performance over time in Figure 14, no temporal trends were observed; however, the ozone corrected data consistently had a RMSE that was lower and a R2 value that was higher than the Raw and Clarity calibrated data.

4. Conclusions

LCSs will continue to become more widespread as sensing technologies advance and the need for high-spatial-resolution air quality data grows. However, with this increased usage comes the necessity of ensuring the LCSs generate high data quality with an optimal approach for calibration and evaluation. This study showed that environmental factors such as relative humidity, temperature, and ozone can affect the raw measurements of these LCSs. However, by accounting for these variables in the LCS calibration, the accuracy and precision of the data can be improved. Additionally, this study demonstrated that increasing the calibration training data volume results in improved calibration performance. It is important to note that relatively steady environmental conditions throughout the deployment period benefited the performance of the LCSs; with rapidly changing environments such as extreme swings in temperature and relative humidity, one would anticipate more variable calibration performance and the need for more regular calibration adjustments. This study also showed the importance of developing a calibration model unique to each LCS, as not every LCS of a given brand and model responds to changing environmental conditions equally. This conclusion is based on the fact that two out of the eight tested sensors showed extraneous behavior demonstrating the importance of the scale of the study.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/toxics9110281/s1, Figure S1: MAE values for raw and Clarity 15-day calibrated LCS data, Figure S2: RMSE, MAE, R2, and slope comparisons for raw and Clarity 15-day calibrated data with training data excluded, Figure S3: Environmental factor comparison for the 15-day calibration period and the final 15 days of LCS deployment. Table S1: Slope and Pearson correlation coefficients of West Phoenix FRM NO2 and raw LCS data, Table S2: Slope and Pearson correlation coefficients of West Phoenix FRM NO2 and Clarity 30-day calibrated LCs data, Table S3: Slope and Pearson correlation coefficients of West Phoenix FRM NO2 and Ozone corrected 30-day calibrated LCs data.

Author Contributions

Conceptualization, J.A.M., M.P.F. and P.H.; methodology, J.A.M., P.M., M.P.F. and P.H.; software, L.S.; formal analysis, J.A.M.; investigation, J.A.M.; data curation, J.A.M. and L.S.; writing—original draft preparation, J.A.M.; writing—review and editing, L.S., J.U., P.M., M.P.F. and P.H.; visualization, J.A.M.; supervision, M.G., M.P.F. and P.H.; project administration, J.U. All authors have read and agreed to the published version of the manuscript.

Funding

This work was funded by the Maricopa County Air Quality Department.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data supporting the reported results will be provided upon reader’s request.

Acknowledgments

The authors would like to thank Kanchana Chandrakanthan, Quincy Stewart, and Megan Gaitan for their support with this project’s field work.

Conflicts of Interest

L.S., P.M. and M.G. are employees of Clarity Movement Co., whose sensors were used and evaluated in this study. J.U. is an employee of Maricopa County Air Quality Department, which provided funding for this work.

References

  1. Geddes, J.A.; Martin, R.V.; Boys, B.L.; van Donkelaar, A. Long-Term Trends Worldwide in Ambient NO2 Concentrations Inferred from Satellite Observations. Environ. Health Perspect. 2016, 124, 281–289. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Patankar, A.M.; Trivedi, P.L. Monetary Burden of Health Impacts of Air Pollution in Mumbai, India: Implications for Public Health Policy. Public Health 2011, 125, 157–164. [Google Scholar] [CrossRef] [PubMed]
  3. World Health Organization. Preventing Disease through Healthy Environments: A Global Assessment of the Burden of Disease from Environmental Risks; World Health Organization: Geneva, Switzerland, 2016. [Google Scholar]
  4. World Health Organization. Air Quality Guidelines Global Update 2005: Particulate Matter, Ozone, Nitrogen Dioxide, and Sulfur Dioxide; World Health Organization: Copenhagen, Denmark, 2006. [Google Scholar]
  5. Environmental Protection Agency. Review of the Primary National Ambient Air Quality Standards for Oxides of Nitrogen; Environmental Protection Agency: Washington, DC, USA, 2018.
  6. Basshuysen, R.; van Schafer, F. Internal Combustion Engine Handbook—Basics Components System and Perspectives, 2nd ed.; 15.1.2 Diesel Four-Stroke Combustion Systems; SAE International: Warrendale, PA, USA, 2016. [Google Scholar]
  7. U.S. Environmental Protection Agency. 2017 National Emissions Inventory: January 2021 Updated Release, Technical Support Document; U.S. Environmental Protection Agency: Research Triangle Park, NC, USA, 2021.
  8. Maricopa County Air Quality Department. Maricopa County Air Monitoring Network Assessment 2015–2019; Maricopa County Air Quality Department: Phoenix, AZ, USA, 2020.
  9. Zhu, Y.; Chen, J.; Bi, X.; Kuhlmann, G.; Chan, K.L.; Dietrich, F.; Brunner, D.; Ye, S.; Wenig, M. Spatial and Temporal Representativeness of Point Measurements for Nitrogen Dioxide Pollution Levels in Cities. Atmos. Chem. Phys. 2020, 20, 13241–13251. [Google Scholar] [CrossRef]
  10. Chatzidiakou, L.; Krause, A.; Popoola, O.A.M.; Di Antonio, A.; Kellaway, M.; Han, Y.; Squires, F.A.; Wang, T.; Zhang, H.; Wang, Q.; et al. Characterising Low-Cost Sensors in Highly Portable Platforms to Quantify Personal Exposure in Diverse Environments. Atmos. Meas. Tech. Discuss. 2019, 12, 4643–4657. [Google Scholar] [CrossRef] [Green Version]
  11. Mead, M.I.; Popoola, O.A.M.; Stewart, G.B.; Landshoff, P.; Calleja, M.; Hayes, M.; Baldovi, J.J.; McLeod, M.W.; Hodgson, T.F.; Dicks, J.; et al. The Use of Electrochemical Sensors for Monitoring Urban Air Quality in Low-Cost, High-Density Networks. Atmos. Environ. 2013, 70, 186–203. [Google Scholar] [CrossRef] [Green Version]
  12. van Zoest, V.; Osei, F.B.; Stein, A.; Hoek, G. Calibration of Low-Cost NO2 Sensors in an Urban Air Quality Network. Atmos. Environ. 2019, 210, 66–75. [Google Scholar] [CrossRef]
  13. Wei, P.; Sun, L.; Anand, A.; Zhang, Q.; Huixin, Z.; Deng, Z.; Wang, Y.; Ning, Z. Development and Evaluation of a Robust Temperature Sensitive Algorithm for Long Term NO2 Gas Sensor Network Data Correction. Atmos. Environ. 2020, 230, 117509. [Google Scholar] [CrossRef]
  14. Mijling, B.; Jiang, Q.; de Jonge, D.; Bocconi, S. Field Calibration of Electrochemical NO2 Sensors in a Citizen Science Context. Atmos. Meas. Tech. 2018, 11, 1297–1312. [Google Scholar] [CrossRef] [Green Version]
  15. U.S. Government Accountability Office. Air Pollution: Opportunities to Better Sustain and Modernize the National Air Quality Monitoring System; GAO-21-38; U.S. Government Accountability Office: Washington, DC, USA, 2020.
  16. Duvall, R.; Clements, A.; Hagler, G.; Kamal, A.; Kilaru, V.; Goodman, L.; Frederick, S.; Johnson Barkjohn, K.; Vonwalk, I.; Green, D.; et al. Performance Testing Protocols, Metrics, and Target Values for Fine Particulate Matter Air Sensors: Use in Ambient, Outdoor, Fixed Sites, Non-Regulatory Supplemental and Informational Monitoring Applications; U.S. EPA Office of Research and Development: Washington, DC, USA, 2021.
  17. Duvall, R.; Clements, A.; Hagler, G.; Kamal, A.; Kilaru, V.; Goodman, L.; Frederick, S.; Johnson Barkjohn, K.; Vonwalk, I.; Green, D.; et al. Performance Testing Protocols, Metrics, and Target Values for Ozone Air Sensors: Use in Ambient, Outdoor, Fixed Site, Non-Regulatory and Informational Monitoring Applications; U.S. EPA Office of Research and Development: Washington, DC, USA, 2021.
  18. South Coast Air Quality Management District. Air Quality Sensor Performance Evaluation Center. Available online: http://www.aqmd.gov/aq-spec (accessed on 8 October 2021).
  19. South Coast Air Quality Management District. Air Quality Sensor Performance Evaluation Center: Gas-Phase Sensors. Available online: http://www.aqmd.gov/aq-spec/evaluations/summary-gas (accessed on 8 May 2021).
  20. Han, P.; Mei, H.; Liu, D.; Zeng, N.; Tang, X.; Wang, Y.; Pan, Y. Calibrations of Low-Cost Air Pollution Monitoring Sensors for CO, NO2, O3, and SO2. Sensors 2021, 21, 256. [Google Scholar] [CrossRef] [PubMed]
  21. Suriano, D.; Cassano, G.; Penza, M. Design and Development of a Flexible, Plug-and-Play, Cost-Effective Tool for on-Field Evaluation of Gas Sensors. J. Sens. 2020, 2020, 8812025. [Google Scholar] [CrossRef]
  22. Sahu, R.; Nagal, A.; Dixit, K.K.; Unnibhavi, H.; Mantravadi, S.; Nair, S.; Simmhan, Y.; Mishra, B.; Zele, R.; Sutaria, R.; et al. Robust Statistical Calibration and Characterization of Portable Low-Cost Air Quality Monitoring Sensors to Quantify Real-Time O3 and NO2 Concentrations in Diverse Environments. Atmos. Meas. Tech. 2021, 14, 37–52. [Google Scholar] [CrossRef]
  23. Masey, N.; Gillespie, J.; Ezani, E.; Lin, C.; Wu, H.; Ferguson, N.S.; Hamilton, S.; Heal, M.R.; Beverland, I.J. Temporal Changes in Field Calibration Relationships for Aeroqual S500 O3 and NO2 Sensor-Based Monitors. Sens. Actuators. B. Chem. 2018, 273, 1800–1806. [Google Scholar] [CrossRef]
  24. Lin, C.; Gillespie, J.; Schuder, M.D.; Duberstein, W.; Beverland, I.J.; Heal, M.R. Evaluation and Calibration of Aeroqual Series 500 Portable Gas Sensors for Accurate Measurement of Ambient Ozone and Nitrogen Dioxide. Atmos. Environ. 2015, 100, 111–116. [Google Scholar] [CrossRef]
  25. 2020 Census Redistricting Data (Public Law 94-171); U.S. Department of Commerce, U.S. Census Bureau: Washington, DC, USA, 2020.
  26. Alphasense Ltd. NO2-A43F Nitrogen Dioxide Sensor 4-Electrode Specification Sheet; Alphasense Ltd.: Great Notley, UK, 2019. [Google Scholar]
  27. Spinelle, L.; Gerboles, M.; Kotsev, A.; Signorini, M. Evaluation of Low-Cost Sensors for Air Pollution Monitoring: Effect of Gaseous Interfering Compounds and Meteorlogical Conditions; Publications Office of the European Union: Luxemborg, 2017. [Google Scholar] [CrossRef]
Figure 1. West Phoenix Air Monitoring Site with the Clarity Node-S LCS.
Figure 1. West Phoenix Air Monitoring Site with the Clarity Node-S LCS.
Toxics 09 00281 g001
Figure 2. Ratio of LCS NO2 values to FRM NO2 values vs. FEM O3 for the Clarity 30-day calibration and the Ozone corrected 30-day calibration.
Figure 2. Ratio of LCS NO2 values to FRM NO2 values vs. FEM O3 for the Clarity 30-day calibration and the Ozone corrected 30-day calibration.
Toxics 09 00281 g002
Figure 3. Time series of hourly West Phoenix FRM NO2 and LCS #2 Raw NO2 values for the entire deployment period.
Figure 3. Time series of hourly West Phoenix FRM NO2 and LCS #2 Raw NO2 values for the entire deployment period.
Toxics 09 00281 g003
Figure 4. Scatter plot of hourly LCS #2 Raw NO2 vs. West Phoenix FRM NO2 with trendline equation and R2, 1:1 line in black.
Figure 4. Scatter plot of hourly LCS #2 Raw NO2 vs. West Phoenix FRM NO2 with trendline equation and R2, 1:1 line in black.
Toxics 09 00281 g004
Figure 5. (A) The average absolute bias of the raw LCS NO2 data binned by internal temperature values. (B) The average absolute bias of the raw LCS NO2 data binned by internal relative humidity values. (C) The average absolute bias of the raw LCS NO2 data binned by West Phoenix FEM O3 values.
Figure 5. (A) The average absolute bias of the raw LCS NO2 data binned by internal temperature values. (B) The average absolute bias of the raw LCS NO2 data binned by internal relative humidity values. (C) The average absolute bias of the raw LCS NO2 data binned by West Phoenix FEM O3 values.
Toxics 09 00281 g005
Figure 6. Time series of hourly West Phoenix FRM NO2 and LCS #2 Clarity 15−Day calibration NO2 values for the entire deployment period.
Figure 6. Time series of hourly West Phoenix FRM NO2 and LCS #2 Clarity 15−Day calibration NO2 values for the entire deployment period.
Toxics 09 00281 g006
Figure 7. Scatter plot of hourly LCS #2 Clarity 15-day calibration NO2 vs. West Phoenix FRM NO2 with trendline equation and R2, 1:1 line in black.
Figure 7. Scatter plot of hourly LCS #2 Clarity 15-day calibration NO2 vs. West Phoenix FRM NO2 with trendline equation and R2, 1:1 line in black.
Toxics 09 00281 g007
Figure 8. (A) A comparison of the RMSE values (ppb) between the raw and Clarity 15-day calibrated data. (B) A comparison of the R2 values between the raw and Clarity 15-day calibrated data. (C) A comparison of the slopes between the raw and Clarity 15-day calibrated data.
Figure 8. (A) A comparison of the RMSE values (ppb) between the raw and Clarity 15-day calibrated data. (B) A comparison of the R2 values between the raw and Clarity 15-day calibrated data. (C) A comparison of the slopes between the raw and Clarity 15-day calibrated data.
Toxics 09 00281 g008
Figure 9. Average RMSE (A) and average R2 (B) between the 8 sensors evaluated biweekly for the whole deployment period for raw NO2 and Clarity 15-day calibration.
Figure 9. Average RMSE (A) and average R2 (B) between the 8 sensors evaluated biweekly for the whole deployment period for raw NO2 and Clarity 15-day calibration.
Toxics 09 00281 g009
Figure 10. Average RMSE (A) and average R2 (B) of the 8 LCSs for the Clarity 30-day and Clarity 15-day calibration from the test period (24 November 2020–12 February 2021).
Figure 10. Average RMSE (A) and average R2 (B) of the 8 LCSs for the Clarity 30-day and Clarity 15-day calibration from the test period (24 November 2020–12 February 2021).
Toxics 09 00281 g010
Figure 11. Time series of hourly West Phoenix FRM NO2 and LCS #2 Ozone corrected 30-day calibrated NO2 values for the entire deployment period.
Figure 11. Time series of hourly West Phoenix FRM NO2 and LCS #2 Ozone corrected 30-day calibrated NO2 values for the entire deployment period.
Toxics 09 00281 g011
Figure 12. Scatter plot of hourly LCS #2 Ozone corrected 30-day calibration NO2 vs. West Phoenix FRM NO2 with trendline equation and R2, 1:1 line in black.
Figure 12. Scatter plot of hourly LCS #2 Ozone corrected 30-day calibration NO2 vs. West Phoenix FRM NO2 with trendline equation and R2, 1:1 line in black.
Toxics 09 00281 g012
Figure 13. (A) The average absolute bias of the Ozone corrected 30-day LCS NO2 data binned by internal temperature values. (B) The average absolute bias of the raw LCS NO2 data binned by internal relative humidity values. (C) The average absolute bias of the raw LCS NO2 data binned by West Phoenix FEM O3 values.
Figure 13. (A) The average absolute bias of the Ozone corrected 30-day LCS NO2 data binned by internal temperature values. (B) The average absolute bias of the raw LCS NO2 data binned by internal relative humidity values. (C) The average absolute bias of the raw LCS NO2 data binned by West Phoenix FEM O3 values.
Toxics 09 00281 g013
Figure 14. Average RMSE (A) and average R2 (B) between the 8 sensors evaluated biweekly for the whole deployment period for raw NO2, Clarity 30-day calibration, and Ozone corrected 30-day calibration.
Figure 14. Average RMSE (A) and average R2 (B) between the 8 sensors evaluated biweekly for the whole deployment period for raw NO2, Clarity 30-day calibration, and Ozone corrected 30-day calibration.
Toxics 09 00281 g014
Table 1. Results summary of NO2 LCSs tested by the South Coast Air Quality Management District [19].
Table 1. Results summary of NO2 LCSs tested by the South Coast Air Quality Management District [19].
Sensor Make (Model)Field R2Field MAE (ppb)
Aeroqual (AQY v0.5)0.77N/A
Aeroqual (AQY v1.0)0.60–0.774.1–5.3
Airly0.54–0.8042.4–48.1
Air Quality Egg (Ver. 2)0.0N/A
APIS0.30–0.446.1–9.4
AQMesh (V4.0)0.0–0.46N/A
AQMesh (V5.1)0.49–0.547.6–8.4
CairPol (Cairsens NO2)0.0–0.126.0–14.6
Igienair (Zaack AQI)0.53–0.587.2–8.0
Kunak (Air A10)0.24–0.326.6–7.4
Magnasci SRL (uRADMonitor INDUSTRIAL HW103)0.00–0.0511.6–24.8
Spec Sensors0.0–0.16N/A
Vaisala (AQT410 Ver. 1.11)0.0N/A
Vaisala (AQT410 Ver. 1.15)0.43–0.6113.0–16.3
Table 2. Data summary for the raw data from the 8 LCSs collocated at West Phoenix over the entire deployment period, calculated using West Phoenix FRM NO2 data.
Table 2. Data summary for the raw data from the 8 LCSs collocated at West Phoenix over the entire deployment period, calculated using West Phoenix FRM NO2 data.
SensorRMSE (ppb)MAE (ppb)R2Slope [95% CI]
LCS #210.58.70.59741.13 [1.10–1.17]
LCS #39.98.10.58031.03 [0.99–1.06]
LCS #49.88.10.59511.05 [1.02–1.09]
LCS #532.726.60.36452.05 [1.95–2.15]
LCS #713.210.00.52231.17 [1.12–1.21]
LCS #106.75.40.69350.90 [0.87–0.92]
LCS #1126.221.20.40391.79 [1.71–1.88]
LCS #128.06.70.66570.91 [0.88–0.93]
Table 3. Data summary for the Clarity 15-day calibration data from the 8 LCS collocated at West Phoenix over the entire deployment period, calculated using West Phoenix FRM NO2 data.
Table 3. Data summary for the Clarity 15-day calibration data from the 8 LCS collocated at West Phoenix over the entire deployment period, calculated using West Phoenix FRM NO2 data.
SensorRMSE (ppb)MAE (ppb)R2Slope [95% CI]
LCS #27.05.40.74951.09 [1.06–1.11]
LCS #38.56.70.58100.85 [0.82–0.87]
LCS #48.56.60.62660.98 [0.95–1.01]
LCS #513.210.40.34850.76 [0.72–0.80]
LCS #78.06.20.69960.96 [0.94–0.99]
LCS #108.26.50.74261.07 [1.05–1.09]
LCS #1113.210.60.33710.73 [0.69–0.77]
LCS #126.14.70.79531.08 [1.06–1.10]
Table 4. Data summary for the Clarity 30-day calibration data from the 8 LCSs collocated at West Phoenix over the entire deployment period, calculated using West Phoenix FRM NO2 data.
Table 4. Data summary for the Clarity 30-day calibration data from the 8 LCSs collocated at West Phoenix over the entire deployment period, calculated using West Phoenix FRM NO2 data.
SensorRMSE (ppb)MAE (ppb)R2Slope [95% CI]
LCS #25.34.00.79790.93 [0.91–0.95]
LCS #36.24.90.68930.75 [0.73–0.77]
LCS #46.24.80.73010.90 [0.88–0.92]
LCS #510.18.10.43000.69 [0.66–0.72]
LCS #76.65.00.69330.85 [0.83–0.87]
LCS #107.25.90.76370.98 [0.96–1.00]
LCS #119.27.70.46940.61 [0.59–0.64]
LCS #125.84.50.79560.97 [0.95–0.99]
Table 5. Data summary for the Ozone corrected 30-day calibration data from the 8 LCSs collocated at West Phoenix over the entire deployment period, calculated using West Phoenix FRM NO2 data.
Table 5. Data summary for the Ozone corrected 30-day calibration data from the 8 LCSs collocated at West Phoenix over the entire deployment period, calculated using West Phoenix FRM NO2 data.
SensorRMSE (ppb)MAE (ppb)R2Slope [95% CI]
LCS #24.63.60.84661.04 [1.02–1.06]
LCS #35.03.80.83880.98 [0.97–1.00]
LCS #45.44.10.83371.07 [1.05–1.09]
LCS #57.96.10.62960.82 [0.80–0.84]
LCS #75.13.90.82000.96 [0.95–0.98]
LCS #106.85.30.84251.18 [1.16–1.20]
LCS #117.35.80.69660.76 [0.74–0.78]
LCS #125.44.20.85541.10 [1.08–1.12]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Miech, J.A.; Stanton, L.; Gao, M.; Micalizzi, P.; Uebelherr, J.; Herckes, P.; Fraser, M.P. Calibration of Low-Cost NO2 Sensors through Environmental Factor Correction. Toxics 2021, 9, 281. https://doi.org/10.3390/toxics9110281

AMA Style

Miech JA, Stanton L, Gao M, Micalizzi P, Uebelherr J, Herckes P, Fraser MP. Calibration of Low-Cost NO2 Sensors through Environmental Factor Correction. Toxics. 2021; 9(11):281. https://doi.org/10.3390/toxics9110281

Chicago/Turabian Style

Miech, Jason A., Levi Stanton, Meiling Gao, Paolo Micalizzi, Joshua Uebelherr, Pierre Herckes, and Matthew P. Fraser. 2021. "Calibration of Low-Cost NO2 Sensors through Environmental Factor Correction" Toxics 9, no. 11: 281. https://doi.org/10.3390/toxics9110281

APA Style

Miech, J. A., Stanton, L., Gao, M., Micalizzi, P., Uebelherr, J., Herckes, P., & Fraser, M. P. (2021). Calibration of Low-Cost NO2 Sensors through Environmental Factor Correction. Toxics, 9(11), 281. https://doi.org/10.3390/toxics9110281

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop