Next Article in Journal
Causes of Moderate and Severe Anaemia in a High-HIV and TB-Prevalent Adult Population in the Eastern Cape Province, South Africa
Previous Article in Journal
Correlation between Generic and Disease-Specific Quality of Life Questionnaires in Patients with Venous Ulcerations: A Cross-Sectional Study Carried out in a Primary Health Care Setting in Brazil
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Neighborhood Deprivation, Indoor Chemical Concentrations, and Spatial Risk for Childhood Leukemia

1
Department of Biostatistics, School of Medicine, Virginia Commonwealth University, One Capitol Square, 830 East Main Street, Richmond, VA 23298, USA
2
Occupational and Environmental Epidemiology Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, Rockville, MD 20850, USA
3
School of Public Health, University of California Berkeley, Berkeley, CA 94704, USA
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2023, 20(4), 3582; https://doi.org/10.3390/ijerph20043582
Submission received: 31 December 2022 / Revised: 10 February 2023 / Accepted: 15 February 2023 / Published: 17 February 2023
(This article belongs to the Section Environmental Health)

Abstract

:
Leukemia is the most common childhood cancer in industrialized countries, and the increasing incidence trends in the US suggest that environmental exposures play a role in its etiology. Neighborhood socioeconomic status (SES) has been found to be associated with many health outcomes, including childhood leukemia. In this paper, we used a Bayesian index model approach to estimate a neighborhood deprivation index (NDI) in the analysis of childhood leukemia in a population-based case-control study (diagnosed 1999 to 2006) in northern and central California, with direct indoor measurements of many chemicals for 277 cases and 306 controls <8 years of age. We considered spatial random effects in the Bayesian index model approach to identify any areas of significantly elevated risk not explained by neighborhood deprivation or individual covariates, and assessed if groups of indoor chemicals would explain any elevated spatial risk areas. Due to not all eligible cases and controls participating in the study, we conducted a simulation study to add non-participants to evaluate the impact of potential selection bias when estimating NDI effects and spatial risk. The results in the crude model showed an odds ratio (OR) of 1.06 and 95% credible interval (CI) of (0.98, 1.15) for a one unit increase in the NDI, but the association became slightly inverse when adjusting for individual level covariates in the observed data (OR = 0.97 and 95% CI: 0.87, 1.07), as well as when using simulated data (average OR = 0.98 and 95% CI: 0.91, 1.05). We found a significant spatial risk of childhood leukemia after adjusting for NDI and individual-level covariates in two counties, but the area of elevated risk was partly explained by selection bias in simulation studies that included more participating controls in areas of lower SES. The area of elevated risk was explained when including chemicals measured inside the home, and insecticides and herbicides had greater effects for the risk area than the overall study. In summary, the consideration of exposures and variables at different levels from multiple sources, as well as potential selection bias, are important for explaining the observed spatial areas of elevated risk and effect estimates.

1. Introduction

Leukemia is the most common childhood cancer, and its etiology is likely multifactorial [1,2]. Acute lymphocytic leukemia (ALL) accounts for about 80% of childhood leukemias in most Western countries [3,4,5]. Incidence peaks at 2–5 years of age, indicating that early-life exposures are important. The incidence of ALL is highest in industrialized countries [2], and incidence rose significantly over the period 1975–2004 in the United States, Japan, and Europe [3,4,5,6]. More recent papers also show increases in childhood leukemia in some areas [7,8,9,10]. The incidence trends suggest that environmental exposures or lifestyle changes play a role in the etiology of childhood leukemia. Epidemiologic studies have implicated residential and parental exposure to chemicals such as pesticides, paints, solvents, and air pollution as risk factors for childhood leukemia [1,2]. Most studies have relied primarily on self-reports and do not identify specific compounds [1,2].
In contrast, the California Childhood Leukemia Study (CCLS) evaluated residential exposure to specific persistent chemicals measured in house dust and found significant positive associations between the concentration of individual and/or total polychlorinated biphenyls (PCBs) [11], polybrominated biphenyl ether (PBDEs) flame retardants [12], specific herbicides [13], and polycyclic aromatic hydrocarbons (PAHs) [14], and childhood leukemia risk. In our previous CCLS analyses, we also assessed simultaneous exposures to six or seven groups of chemicals measured in house dust using Bayesian group index models [15,16] and found a significant positive association for PAHs and childhood leukemia overall [15], as well as for herbicides among children who were born and raised in the home where the dust samples were taken [16]. Many of the chemicals in the CCLS data, especially congeners within chemical groups, are strongly correlated (r > 0.6), and thus, they cannot be analyzed together with traditional regression methods. Bayesian group index regression is well-suited for mixture analyses of groups of correlated exposures. The variables included in our analysis with Bayesian grouped index models were all measured within the household or determined for the individual child. These include the chemical concentrations in the different indices and the covariates such as age, ethnicity, parents’ education, and household income.
However, there could be additional risk factors from the environment outside the home. For example, geographic differences in socioeconomic status (SES) could be related to the risk of childhood leukemia. Neighborhood SES has been studied for many health outcomes, including childhood leukemia [17,18,19,20,21,22]. Area deprivation was not found to be associated with acute lymphoblastic leukemia (ALL) [22], and childhood leukemia was also not associated with area SES in some studies [19,20]. However, lowest area SES was found to be associated with lower ALL risk compared with highest area SES [21], and childhood leukemia incidence in England and Wales was higher in relatively affluent communities [18]. Using a neighborhood SES or deprivation index estimation approach, we previously found neighborhood SES to be significantly and positively associated with colorectal cancer screening adherence [23]. Neighborhood deprivation was found to be significantly and positively associated with elevated blood lead levels in children [24] and with prenatal smoke exposure [25]. An association between area SES or deprivation and childhood leukemia could exist beyond the household level in this study. In addition, unmeasured environmental factors beyond SES could lead to an increased risk for childhood leukemia.
In this paper, we used a Bayesian index model approach to estimate a neighborhood deprivation index (NDI) and its association with childhood leukemia in the CCLS. We also considered spatial random effects in the Bayesian index modeling approach to identify any areas of significantly elevated childhood leukemia risk not explained by neighborhood deprivation or individual covariates, as well as indoor chemical concentrations. Given the differential participation by SES, especially among controls, we also conducted, for the first time, simulation studies for both the NDI and spatial risk effects to address possible selection bias.

2. Materials and Methods

2.1. Study Data

The CCLS is a population-based case-control study in 35 counties in California, including 17 counties in the San Francisco Bay area and 18 in the Central Valley [11,26]. Between 1995 and 2012, cases ≤14 years old were ascertained within 72 h of diagnosis from nine major pediatric clinical centers in the study area. Using California birth certificate information, controls were matched to cases on the basis of date of birth, sex, Hispanic ethnicity, and maternal race. Parents of both case and control participants were initially interviewed to gather information about their child’s exposure to suspected leukemia risk factors. Families who had not moved since the child’s diagnosis date (reference date for controls) were eligible for a second interview (Tier 2), during which carpet dust samples were collected and information about pesticide use was obtained. The second interview and dust sampling were limited to cases and controls <8 years old (diagnosed December 1999 to June 2006) to ensure the samples reflected early-life chemical exposure of the child. Case-control matching was not maintained due to residential eligibility criteria and voluntary participation. There were 731 participants for the Tier 2 interviews (324 cases and 407 controls). Of these, 296 cases (91%) and 333 controls (82%) agreed to participate. Due to insufficient dust or interferences in the chemical analyses, some samples were not quantified, leading to a final 277 cases and 306 controls (n = 583) [13].
The dust samples were collected using either a high-volume small surface sampler (HVS3) or a household vacuum cleaner. As described previously [26], concentrations of 64 organic chemicals (ng/g dust) were measured using gas chromatography/mass spectrometry (GC/MS) in multiple ion-monitoring mode after extraction with three different extraction methods. Nine metals were measured using microwave-assisted acid digestion combined with inductively coupled plasma/mass spectrometry (ICP/MS).
Our analysis investigated the association of 67 chemicals with the risk of childhood leukemia. Out of the entire CCLS dataset, only chemical exposure variables with at least 20% non-missing observations were included, as past experience has shown that higher levels of missingness contribute negligible information on potential relations with an outcome. We organized exposures into seven chemical class indices: polychlorinated biphenyls (PCBs), polycyclic aromatic hydrocarbons (PAHs), insecticides, herbicides, metals, tobacco exposure markers of nicotine and cotinine, and polybrominated diphenyl ethers (PBDEs). The reason for these groupings was that the chemicals share a structural similarity (e.g., PCBs, PAHs, metals) or usage (e.g., herbicides, insecticides). Most missing data were the result of findings below a chemical’s detection limit. Additionally, there were missing data in the PBDE chemicals due to insufficient levels of house dust for analysis. Both types of missing observations were imputed with log-normal distributions, as previously described [15].
The interviewers took a global positioning system reading of the residence coordinates, which were linked to census data for the computation of the neighborhood deprivation index and used to evaluate spatial random effects for unexplained spatial heterogeneity in leukemia risk.

2.2. Neighborhood Data

We used American Community Survey (ACS) 2005–2009 five-year estimates for neighborhood variables at the census block group level related to housing, income, poverty, education, and race/ethnicity. Specifically, the variables used in the deprivation index were Black segregation, Hispanic segregation, percent of households with a ratio of income to poverty <1 (below the poverty threshold), percent receiving public assistance income, percent of renters, percent with no high school diploma, percent in a different house than 1 year ago, percent foreign born, per capita income, median house value, and median gross rent. We reversed the order of per capita income, median house value, and median gross rent to achieve a direction of association similar to the other variables and increasing with increased deprivation. We applied ACS data for the census block groups containing the residence of each study participant.

2.3. Statistical Models

We first used a Bayesian index model to estimate a neighborhood deprivation index and its association with childhood leukemia. We modeled the probability of childhood leukemia as
logit ( p i ) = β 0 + β 1 ( j = 1 C 1 w j 1 q i j 1 ) ,
where β 1 is the neighborhood deprivation effect for the index with C l = 11 of SES-related neighborhood variables, w j 1 is the weight for the jth variable in the index, q i j 1 is the quantile for the jth variable in the index for the ith subject. We used quantiles to account for different scaling of the variables and used deciles as the quantiles (ten equally-sized groups). This approach reveals the relative importance of each area variable used in the index for childhood leukemia.
We next adjusted for the individual covariates of child age, child sex, child race/ethnicity, household income, mother’s education, mother’s age, and an indicator if residence of sampling was the residence since birth. The model was
logit ( p i ) = β 0 + β 1 ( j = 1 C 1 w j 1 q i j 1 ) + z i T ϕ ,
where z i is the vector of covariates for the ith subject with associated vector of effects ϕ . The race/ethnicity variables were Hispanic, non-Hispanic other, and non-Hispanic White as the reference. The education variables were high school or similar, some college or similar, Bachelor's degree or higher, and none or elementary school as the reference. The income variables were $15,000–$29,999, $30,000–$44,999, $45,000–$59,999, $60,000–$74,999, $75,000+, missing, and <$15,000 as the reference.
We next included chemical concentrations measured inside the home of each participant. The model was
logit ( p i ) = β 0 + β 1 ( j = 1 C 1 w j 1 q i j 1 ) + k = 1 K β k ( j = 1 C k w j k q i j k ) + z i T ϕ ,
where there were K = 7 groups of chemical exposures defined above in the Bayesian group index model, with each having health effect   β k . This extends the Bayesian grouped index model to include a neighborhood deprivation index along with multiple household-level chemical exposure groups, and allows for the development of different complex indices measured at different data scales (e.g., SES index at the neighborhood spatial scale and seven chemical indices at the household scale). This approach will reveal the relative importance of neighborhood deprivation compared with indoor chemical exposure effects.
To consider the spatial risk of childhood leukemia, we added n individual-level spatial random effects and exchangeable random effects to Equation (2) for unexplained spatial risk beyond what the neighborhood deprivation explains. The model was
logit ( p i ) = β 0 + β 1 ( j = 1 C 1 w j 1 q i j 1 ) + z i T ϕ + u i + v i ,
where the individual-level random effects u i and v i are for spatially unstructured and spatially structured heterogeneity, respectively, and spatial random effects are based on where the ith subject resides at the time of study enrollment.
We also added the indoor chemical groups to this model to determine if chemical concentrations measured inside the home would explain any spatial areas of elevated risk from the more common spatial risk model in Equation (4). This model was
logit ( p i ) = β 0 + β 1 ( j = 1 C 1 w j 1 q i j 1 ) + k = 1 K β k ( j = 1 C k w j k q i j k ) + z i T ϕ + u i + v i ,
where the chemical groups were as defined above for the model in Equation (3). We also used univariate Firth regressions [27,28] to explore the differences in explanatory variable effects for cancer status inside an elevated risk area versus the variable effects for being inside the elevated risk area for the complete study sample. Firth penalized regression was developed to mitigate the small sample bias found in traditional maximum likelihood logistic regression.
The models were completed with prior distributions for the parameters. The assumption of spatial correlation in area random effects was implemented through an n-dimensional multivariate normal prior v ~ M V N ( 0 , ) , where is an n × n positive definite matrix with elements defined as i j = exp ( ψ d i j ) based on distance d i j between residential locations for different subjects. The parameter ψ controls the rate of decline of correlation based on distance and had a prior of ψ = U n i f o r m ( 0.1 , 1 ) , where the unit for this parameter is a scaling factor that acts on distances. The unstructured random effects received a standard prior of u m ~ N o r m a l ( 0 ,   τ u ) with precision τ u = 1 / σ u 2 and σ u ~ U n i f o r m ( 0 , 100 ) . The index effect and covariate effect parameters also received noninformative normal priors, β k ~ N o r m a l ( 0 , τ k ) with precision τ k = 1 / σ k 2 and σ k ~ U n i f o r m ( 0 , 100 ) . For any given index, the weights w 1 k , , w C k k were assigned a Dirichlet prior with parameters α j k = ( α 1 k , , α C k k ) . This choice of prior ensures that the weights w j k ( 0 , 1 ) and j = 1 C k w j k = 1 to aid in the interpretation of the index. Inference on health effects and the relative importance of exposure indices is carried out through joint posterior distribution.
The Markov chain Monte Carlo (MCMC) method was used for model parameter estimation, and convergence to the posterior was assessed through the Gelman–Rubin diagnostic statistic using two chains in the R computing environment. We identified areas as being significantly elevated in risk using exceedance probabilities, which estimate how frequently the spatial odds at the ith location, θ i = exp ( v i ) , exceeded the null value of 1. The estimate of this probability uses the posterior distribution of the spatial odds at the location ( θ i , m + 1 , , θ i , m + G ) , where m represents the burn-in and G represents the number of posterior samples after the burn-in, and is calculated as q i , U ^ = 1 G g = m + 1 m + G I ( θ i , g > 1 ) . Random effects with an exceedance probability of q i , U ^ 0.90 were considered to be of significantly elevated risk.

2.4. Selection Bias Sensitivity Analysis

As has been described previously, not all eligible cases and controls participated in the CCLS [11,13,26]. It has been noted that the controls participated at a lower rate than did cases and were less likely to participate in lower SES areas [29,30]. Therefore, we conducted a simulation study to evaluate the prospect that selection bias could lead to an observed area of significantly elevated childhood leukemia risk. We assessed the persistence of any observed spatial cluster by adding simulated participants to the set of study participants, in order to reach the full participation of eligible cases and controls. As there were 324 eligible cases and 277 participating cases with valid chemical measurements, we added n c a s e = 324 277 = 47 simulated cases. Similarly, there were 407 eligible controls and 306 participating controls with valid measurements; therefore, we added n c o n t r o l = 407 306 = 101 simulated controls. We generated locations for the simulated participants using a two-step process. In the first step, we randomly sampled one census tract within the counties participating in the CCLS based on sampling weights we calculated to represent the population distribution. In the second step, we randomly sampled a location within the tract to represent a participant residence. For simulated cases, we weighted census tracts for sampling based only on population size, where the sampling weight was the population of the census tract divided by the total population of the census tracts within the study area. For simulated controls, in addition to population, we weighted census tracts according to two schemes that considered two SES variables previously used to represent SES [29]. In the first scheme, the tract weight was the product of its deciles for population, income deprivation (measured by inverse median household income [max(income)-income]), and education deprivation (measured by the percent of residents without a college degree). Specifically, the sampling weight for the i t h tract was w i = i n c i × e d u i × p o p i j = 1 J i n c j × e d u j × p o p j , where i n c i is the decile for income deprivation, e d u i is the decile for education deprivation, p o p i is the decile for population, and there are J census tracts. We obtained tract-level covariate information from the American Community Survey, using five-year estimates for the period 2005–2009. In the second scheme, we preferentially sampled tracts with greater socioeconomic deprivation by applying the constants ( 1 , 1.5 , 1.5 ) to the deciles for population, income deprivation, and education deprivation, respectively. Specifically, the sampling weight for the i t h tract in this scheme was w i = ( 1.5 × i n c i ) × ( 1.5 × e d u i ) × ( 1 × p o p i ) j = 1 J ( 1.5 × i n c j ) × ( 1.5 × e d u j ) × ( 1 × p o p j ) .
We created 100 simulated datasets using the two weighting schemes for controls, and then tested for the occurrence of a spatial cluster using the commonly used methods of the local spatial scan and a Bayesian hierarchical spatial regression model. We used these approaches without any covariates, NDI, or chemical concentrations because covariates and chemical concentrations were not available for simulated participants, and the local spatial scan does not consider any covariates or risk factors. This meant that we had to first use the two approaches with the observed data to detect an observed cluster as a reference for comparison with the simulated datasets.
The first method of the local spatial scan used the SaTScan software and the rsatscan package in R, which assumes a Bernoulli distribution for case membership. The local spatial scan evaluates the likelihood ratio comparing the rates of cases and controls inside and outside a series of circles that are centered at each participant location. The likelihood ratio is constructed assuming an equal disease risk inside and outside the circle, and the circle's range in radius. The test identifies as the most likely cluster the circle with the maximum likelihood ratio test statistic, and performs inference using this circle and many Monte Carlo randomizations of case and control labels, producing a p-value of the rank of the most likely cluster over all randomizations.
The second method was the Besag–York–Mollie (BYM) Bayesian spatial regression model using the OpenBUGS software and the R2OpenBUGS package in R. This model assumes that for outcome variable Y i taking values of 1 or 0 for cases and controls, Y i B e r n o u l l i ( p i ) , where l o g ( p i 1 p i ) = β 0 + u i + v i . We assigned a flat prior to the intercept β 0 , a normal prior to the spatially unstructured random effect u i with mean 0 and precision τ u , where τ u = 1 σ u 2 and σ u U n i f ( 0 , 10 ) , and an intrinsic Gaussian conditional autoregressive (CAR) prior to the spatially structured random effect v i with precision parameter τ v G a m m a ( 0.001 , 0.001 ) . For the CAR prior, we defined adjacency for the spatially structured random effects using Voronoi polygons defined by participant locations. We used two chains to fit the model, burning in 15,000 iterations and sampling another 20,000 iterations from the joint posterior distribution.
For each dataset, we first recorded whether the model identified a spatial cluster. For the spatial scan model, this was defined as a p-value below 0.05 of observing the distribution of cases and controls in a circular window, under the null hypothesis of no difference in risk inside and outside the circle. For the BYM model, this was defined as a posterior exceedance probability of greater than 90 percent for the spatially structured random effect, specifically if q v i ^ = g = m + 1 m + G I ( v i ( g ) > 0 ) G > 0.90 , where m iterations are burned in and G iterations are sampled after the burn-in. If a cluster existed, we calculated the size of its convex hull in square kilometers, determined if it overlapped with the observed cluster, and calculated the percentage of its overlap. For each of the approaches, we compared the spatial cluster findings from the simulated datasets to those from the same approach with the observed dataset.
To assess potential selection bias on the NDI effect, we fitted the crude NDI model in Equation (1) to the same 100 datasets generated from the first scheme. It was not possible to fit any of the adjusted NDI models due to a lack of individual-level covariates for generated subjects. Therefore, this sensitivity analysis assessed the crude NDI effect after considering adding participants to overcome selection bias.

3. Results

3.1. Neighborhood Deprivation

In the crude model, there was a positive but not significant association with neighborhood deprivation and childhood leukemia, with an odds ratio (OR) of 1.06 and 95% credible interval (CI) of (0.98, 1.15) for a one-unit increase in the NDI. The NDI was dominated by Hispanic segregation with a weight of 0.43, while the other variables had much smaller weights (Figure 1). In the covariate-adjusted model (Table 1), the NDI OR was 0.97 with a 95% CI of (0.87, 1.07). After adjusting for covariates, the importance of Hispanic segregation decreased substantially to a weight of 0.10, and per capita income had the highest weight of 0.14 (Figure 2). The reduction in the Hispanic weight is explained by the adjustment of Hispanic ethnicity at the individual level. In the model that also adjusted for the groups of chemical exposures (Table 2), the NDI OR was 0.95 with a 95% CI of (0.85, 1.06). The adjusted models suggest an inverse association between NDI and childhood leukemia, but not a statistically significant one. Insecticides had a significant inverse association with an OR of 0.58 (0.35, 0.94).

3.2. Selection Bias Sensitivity Analysis for Neighborhood Deprivation

Using the selected participants from the first sampling scheme, we found overall an inverse association of NDI and childhood leukemia in crude models over the 100 simulated datasets, with an average OR of 0.98 and 95% CI of (0.91, 1.05). The 95% credible intervals for each dataset always contained 1, while almost all OR estimates were less than 1 (Figure 3). The overall estimate was similar to that found in the adjusted NDI models for the observed CCLS dataset. The distribution of the NDI component weights from the 100 datasets show that per capita income had the highest weight overall (Figure 4), which is similar to the result for the covariate-adjusted NDI model for the observed data.

3.3. Spatial Risk

The Bayesian index model with individual-level spatial random effects and exchangeable random effects (Equation (4)) found one area of elevated spatial risk based on 90% exceedance probabilities of the spatial random effects. There were 15 subjects located in the area of elevated risk, with 14 cases and one control. Of the 14 cases, 9 were Hispanic. The area of significantly elevated risk is illustrated in red in Fresno County and Kings County (Figure 5). The census block groups containing the 15 observations generally have high percentages of Hispanic population, with a mean of 66% and a range of 37% to 99% Hispanic. This elevated risk area was explained by adjusting for the chemical exposure groups (Equation (5)), as the exceedance probabilities of the spatial random effects for this area were no longer large. To explore this result, we examined the chemical group exposures for this area versus the entire study sample with univariate Firth regressions. We found much higher exposure coefficients for both insecticides and herbicides in the elevated exposure area (Supplemental Material Table S1) than in the entire study area (Supplemental Material Table S2), which could explain the relatively large number of cases in the area of elevated risk.

3.4. Selection Bias Sensitivity Analysis for Spatial Risk

The two methods for cluster detection without covariates found a similar area as the model in Equation (4) for the observed data, albeit slightly larger and including Tulare County illustrated in red (Figure 6). However, the simulation study bias analysis results (Table 3) provided reduced evidence for the existence of the observed cluster when adding participants to achieve the full participation of eligible cases and controls. When using the local spatial scan statistic, a cluster was identified in 37 and 30 of the 100 datasets using the first and second weighting schemes for control participants, but only 20 and 12 of the 100 datasets produced a cluster that overlapped with the observed cluster from the same method. When using the BYM model, a spatial cluster was identified more frequently in 55 and 41 of the datasets using the first and second selection approach, but only 23 and 12 of the datasets had a cluster overlapping the observed one. As expected, both detection methods were less likely to find the observed cluster if controls had a higher probability of selection in lower SES areas. However, even in this participant selection approach the observed cluster was detected in 12 of the 100 datasets after overcoming selection bias, meaning that selection bias did not completely explain the observed spatial cluster. The maps of the number of times areas were detected as significantly elevated risk over the 100 datasets from the first scheme show two areas (Figure 7). One is the observed cluster area in Fresno and Kings Counties as well as Tulare County, depending on the method, and the other area is the south of San Francisco and overlapping with a spatial–temporal cluster that was previously detected in a California statewide analysis of childhood cancers including leukemia [31].

4. Discussion

In this study, we found that neighborhood deprivation was not positively associated with childhood leukemia after adjusting for individual level covariates in the observed data, and in sensitivity analysis for selection bias through sampling additional participants. We also found a significant spatial risk of childhood leukemia after adjusting for neighborhood deprivation and individual covariates in two counties in the observed data. However, the area of elevated risk was partly explained by selection bias in simulation studies that included more participating controls in geographic areas of lower SES. Interestingly, apart from selection bias, the area of elevated risk was explained when including groups of a large number of chemicals measured inside the home, and insecticides and herbicides had greater effects in the cluster area than overall.
In the CCLS, socioeconomic status was positively associated with likelihood of participation, and particularly so for controls [29]. This relationship is supported by a review of studies of childhood cancer that found that White control subjects were more likely to participate in interview-based case-control studies than non-White controls [32], as White participants tend to experience greater socioeconomic status than participants of other races [33]. In general, the finding of a spatial cluster that could be partly explained by selection bias has implications for spatial analyses that are subject to non-participation. Factors including SES, language differences, or lack of personal investment in a study, which may be more likely for eligible controls who may not have a personal connection to the disease under study, can drive non-response in eligible participants [29,34]. Interviews in the CCLS were conducted in English and Spanish per the eligibility criteria in the study, so speaking a language other than these two languages could increase the likelihood of non-participation. A recent review has suggested that this problem is more severe for controls than cases in studies of occupational risk factors [35]. In our study, non-participation of controls in a low-SES area contributed to identifying a spatial cluster of leukemia risk using several spatial statistical methods, whereas the addition of simulated controls led to not identifying the observed cluster in many datasets. In addition, preferentially sampling low-SES census tracts for controls led to less frequent identification of a cluster overlapping the observed one, compared to sampling controls with equal weights for population and SES factors. Thus, these findings suggest that spatial analyses should seek to evaluate the effect of selection bias on their results. This can occur by maximizing the likelihood of participation through offering financial incentives for participation, providing an accessible study experience that allows for participation in several languages and minimizes the time and effort required, or by assessing the effects of selection bias through adding simulated pseudo-participants in a manner similar to our own, or conducting registry-based analyses [31]. However, our approach of simulating participants does not allow for adjustment for important covariates or measured risk factors such as exposures within the home. Additionally, we note that it is possible to simulate participants on a variety of spatial scales, such as block groups.
Another factor not typically used in spatial analyses of cancer risk is exposure to a large number of chemicals inside the home. In our study, measured exposures to a large number of chemicals explained the observed spatial cluster that was not explained by neighborhood deprivation and individual covariates. While it is uncommon to measure so many exposures for individuals within the home, it explained the significant area of elevated risk even though the chemical groups did not have significant positive effects overall. However, it is more common in spatial analyses to identify patterns and significant unexplained risk areas that lead to follow-up studies to determine more individual-level exposures that could be related to the health outcome [36,37].

5. Conclusions

Our Bayesian analysis of childhood leukemia in the CCLS did not support a significant neighborhood deprivation effect in various models using observed and simulated data. In addition, an area of significantly elevated cancer risk in models of neighborhood deprivation and covariates was explained by higher effects of herbicides and insecticides among the seven chemical exposure groups inside the home. Selection bias was found to partially impact the detection of spatial areas of significant risk. The consideration of exposures and variables at different levels from multiple sources as well as potential selection bias are important for explaining observed spatial areas of elevated risk.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/ijerph20043582/s1, Table S1: Univariate Firth regressions when the outcome was childhood leukemia among the subjects in the spatial area of elevated risk (n = 15); Table S2: Univariate Firth regressions when the outcome was childhood leukemia in the spatial area of elevated risk among all subjects in the analysis (n = 577).

Author Contributions

Data curation, M.H.W. and C.M.; Formal analysis, D.C.W., M.C. and J.B.; Funding acquisition, C.M. and D.C.W.; Investigation, D.C.W.; Methodology, D.C.W., M.C. and J.B.; Project administration, D.C.W.; Resources, M.H.W. and C.M.; Software, D.C.W. and J.B.; Supervision, D.C.W.; Writing—original draft, D.C.W. and J.B.; Writing—review and editing, D.C.W., M.H.W. and C.M. All authors have read and agreed to the published version of the manuscript.

Funding

Research reported in this publication was supported by the National Cancer Institute of the National Institutes of Health under Award Number R21CA238370 (Wheeler). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The CCLS Tier 2 study was financially supported by subcontracts 7590-S-04 (University of California, Berkeley) and 7590-S-01 (Battelle Memorial Institute) under National Cancer Institute (NCI) contract N02-CP-11015 (Westat); and National Institute of Environmental Health Sciences grants R01ES009137, R24ES028524, and P-42-ES-04705-18 (University of California, Berkeley). This research was also supported by the Intramural Research Program of the National Institutes of Health and the NCI (Project Z01 CP01012522).

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board of Virginia Commonwealth University (HM20002035, 31 January 2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The CCLS data presented in this study are available on request from the senior author. The data are not publicly available due to privacy restrictions.

Acknowledgments

We thank the CCLS families for their participation. We also thank the clinical investigators at the following collaborating hospitals for help in recruiting patients: University of California Davis Medical Center (Jonathan Ducore), University of California San Francisco (Mignon Loh and Katherine Matthay), Children’s Hospital of Central California (Vonda Crouse), Lucile Packard Children’s Hospital (Gary Dahl), Children’s Hospital Oakland (James Feusner), Kaiser Perma-nente Oakland (Daniel Kronish and Stacy Month), Kaiser Permanente Roseville (Kent Jolly and Vincent Kiley), Kaiser Permanente Santa Clara (Carolyn Russo, Denah Taggart, and Alan Wong), and Kaiser Permanente San Francisco (Kenneth Leung). Finally, we acknowledge the entire California Childhood Leukemia Study staff for their effort and dedication.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Whitehead, T.P.; Metayer, C.; Wiemels, J.L.; Singer, A.W.; Miller, M.D. Childhood Leukemia and Primary Prevention. Curr. Probl. Pediatr. Adolesc. Health Care 2016, 46, 317–352. [Google Scholar] [CrossRef] [Green Version]
  2. Onyije, F.M.; Olsson, A.; Baaken, D.; Erdmann, F.; Stanulla, M.; Wollschläger, D.; Schüz, J. Environmental Risk Factors for Childhood Acute Lymphoblastic Leukemia: An Umbrella Review. Cancers 2022, 14, 382. [Google Scholar] [CrossRef] [PubMed]
  3. Dalmasso, P.; Pastore, G.; Zuccolo, L.; Maule, M.M.; Pearce, N.; Merletti, F.; Magnani, C. Temporal trends in the incidence of childhood leukemia, lymphomas and solid tumors in north-west Italy, 1967–2001. A report of the Childhood Cancer Registry of Piedmont. Haematologica 2005, 90, 1197–1204. [Google Scholar] [PubMed]
  4. Kroll, M.; Draper, G.; Stiller, C.; Murphy, M. Childhood leukemia incidence in Britain, 1974–2000: Time trends and possible relation to influenza epidemics. J. Natl. Cancer Inst. 2006, 98, 417–420. [Google Scholar] [CrossRef] [Green Version]
  5. Ries, L.; Melbert, D.; Krapcho, M.; Mariotto, A.; Miller, B.; Freuer, E.; Clegg, L.X.; Eisner, M.P.; Horner, M.J.; Howlader, N.; et al. SEER Cancer Statistics Review: 1975–2004. Available online: https://seer.cancer.gov/csr/1975_2004 (accessed on 14 February 2023).
  6. Nishi, M.; Miyake, H.; Takeda, T.; Shimada, M. Epidemiology of childhood leukemia in Hokkaido, Japan. Int. J. Cancer 1996, 67, 323–326. [Google Scholar] [CrossRef]
  7. Giddings, B.M.; Whitehead, T.P.; Metayer, C.; Miller, M.D. Childhood leukemia incidence in California: High and rising in the Hispanic population. Cancer 2016, 122, 2867–2875. [Google Scholar] [CrossRef] [Green Version]
  8. Barrington-Trimis, J.L.; Cockburn, M.; Metayer, C.; Gauderman, W.J.; Wiemels, J.; McKean-Cowdin, R. Trends in childhood leukemia incidence over two decades from 1992 to 2013. Int. J. Cancer 2017, 140, 1000–1008. [Google Scholar] [CrossRef] [Green Version]
  9. Steliarova-Foucher, E.; Fidler, M.M.; Colombet, M.; Lacour, B.; Kaatsch, P.; Piñeros, M.; Soerjomataram, I.; Bray, F.; Coebergh, J.W.; Peris-Bonet, R.; et al. Changing geographical patterns and trends in cancer incidence in children and adolescents in Europe, 1991–2010 (Automated Childhood Cancer Information System): A population-based study. Lancet Oncol. 2018, 19, 1159–1169. [Google Scholar] [CrossRef] [Green Version]
  10. Steliarova-Foucher, E.; Colombet, M.; Ries, L.A.G.; Moreno, F.; Dolya, A.; Bray, F.; Hesseling, P.; Shin, H.Y.; Stiller, C.A.; IICC-3 Contributors. International incidence of childhood cancer, 2001–2010: A population-based registry study. Lancet Oncol. 2017, 18, 719–731. [Google Scholar] [CrossRef]
  11. Ward, M.; Colt, J.; Metayer, C.; Gunier, R.; Lubin, J.; Crouse, V.; Nishioka, M.G.; Reynolds, P.; Buffler, P.A. Residential exposure to polychlorinated biphenyls and organochlorine pesticides and risk of childhood leukemia. Environ. Health Perspect. 2009, 117, 1007–1013. [Google Scholar] [CrossRef] [Green Version]
  12. Ward, M.H.; Colt, J.S.; Deziel, N.C.; Whitehead, T.P.; Reynolds, P.; Gunier, R.B.; Nishioka, M.; Dahl, G.V.; Rappaport, S.M.; Buffler, P.A.; et al. Residential levels of polybrominated diphenyl ethers and risk of childhood acute lymphoblastic leukemia in California. Environ. Health Perspect. 2014, 122, 1110–1116. [Google Scholar] [CrossRef]
  13. Metayer, C.; Colt, J.S.; Buffler, P.A.; Reed, H.D.; Selvin, S.; Crouse, V.; Ward, M.H. Exposure to herbicides in house dust and risk of childhood acute lymphoblastic leukemia. J. Expo. Sci. Environ. Epidemiol. 2013, 23, 363–370. [Google Scholar] [CrossRef] [PubMed]
  14. Deziel, N.C.; Rull, R.P.; Colt, J.S.; Reynolds, P.; Whitehead, T.P.; Gunier, R.B.; Month, S.R.; Taggart, D.R.; Buffler, P.; Ward, M.H.; et al. Polycyclic aromatic hydrocarbons in residential dust and risk of childhood acute lymphoblastic leukemia. Environ. Res. 2014, 133, 388–395. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Carli, M.; Ward, M.; Metayer, C.; Wheeler, D. Imputation of below detection limit missing data in chemical mixture analysis with Bayesian group index regression. Int. J. Environ. Res. Public Health 2022, 19, 1369. [Google Scholar] [CrossRef]
  16. Wheeler, D.; Rustom, S.; Carli, M.; Whitehead, T.; Ward, M.H.; Metayer, C. Bayesian group index regression for modeling chemical mixtures and cancer risk. Int. J. Environ. Res. Public Health 2021, 18, 3486. [Google Scholar] [CrossRef] [PubMed]
  17. Kehm, R.D.; Spector, L.G.; Poynter, J.N.; Vock, D.M.; Osypuk, T.L. Socioeconomic Status and Childhood Cancer Incidence: A Population-Based Multilevel Analysis. Am. J. Epidemiol. 2018, 187, 982–991. [Google Scholar] [CrossRef] [PubMed]
  18. Kroll, M.E.; Stiller, C.A.; Murphy, M.F.; Carpenter, L.M. Childhood leukaemia and socioeconomic status in England and Wales 1976–2005: Evidence of higher incidence in relatively affluent communities persists over time. Br. J. Cancer 2011, 105, 1783–1787. [Google Scholar] [CrossRef] [Green Version]
  19. Erdmann, F.; Hvidtfeldt, U.A.; Feychting, M.; Sørensen, M.; Raaschou-Nielsen, O. Is the risk of childhood leukaemia associated with socioeconomic measures in Denmark? A nationwide register-based case-control study. Int. J. Cancer 2021, 148, 2227–2240. [Google Scholar] [CrossRef]
  20. Adam, M.; Kuehni, C.E.; Spoerri, A.; Schmidlin, K.; Gumy-Pause, F.; Brazzola, P.; Probst-Hensch, N.; Zwahlen, M. Socioeconomic Status and Childhood Leukemia Incidence in Switzerland. Front. Oncol. 2015, 5, 139. [Google Scholar] [CrossRef] [Green Version]
  21. Ribeiro, K.B.; Buffler, P.A.; Metayer, C. Socioeconomic status and childhood acute lymphocytic leukemia incidence in São Paulo, Brazil. Int. J. Cancer 2008, 123, 1907–1912. [Google Scholar] [CrossRef]
  22. Smith, A.; Roman, E.; Simpson, J.; Ansell, P.; Fear, N.T.; Eden, T. Childhood leukaemia and socioeconomic status: Fact or artefact? A report from the United Kingdom childhood cancer study (UKCCS). Int. J. Epidemiol. 2006, 35, 1504–1513. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Wheeler, D.; Czarnota, J.; Jones, R. Estimating an areal-level socioeconomic status index and its association with colonoscopy screening adherence. PLoS ONE 2017, 12, e0179272. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Wheeler, D.; Jones, R.; Schootman, M.; Nelson, E. Explaining variation in elevated blood lead levels among children in Minnesota using neighborhood socioeconomic variables. Sci. Total Environ. 2019, 650 Pt 1, 970–977. [Google Scholar] [CrossRef] [PubMed]
  25. Wheeler, D.; Boyle, J.; Barsell, J.; Maguire, R.; Dahman, B.; Murphy, S.; Hoyo, C.; Zhang, J.; Oliver, J.; McClernon, J.; et al. Neighborhood deprivation is associated with increased risk of prenatal smoke exposure. Prev. Sci. 2022, 23, 1078–1089. [Google Scholar] [CrossRef]
  26. Colt, J.S.; Gunier, R.B.; Metayer, C.; Nishioka, M.G.; Bell, E.M.; Reynolds, P.; Buffler, P.A.; Ward, M.H. Household vacuum cleaners vs. the high-volume surface sampler for collection of carpet dust samples in epidemiologic studies of children. Environ. Health 2008, 7, 6. [Google Scholar] [CrossRef] [Green Version]
  27. Firth, D. Bias reduction of maximum likelihood estimates. Biometrika 1993, 80, 27–38. [Google Scholar] [CrossRef]
  28. Heinze, G.; Schemper, M. A solution to the problem of separation in logistic regression. Stat. Med. 2002, 21, 2409–2419. [Google Scholar] [CrossRef]
  29. Slusky, D.A.; Does, M.; Metayer, C.; Mezei, G.; Selvin, S.; Buffler, P.A. Potential role of selection bias in the association between childhood leukemia and residential magnetic fields exposure: A population-based assessment. Cancer Epidemiol. 2014, 38, 307–313. [Google Scholar] [CrossRef] [Green Version]
  30. Bartley, K.; Metayer, C.; Selvin, S.; Ducore, J.; Buffler, P. Diagnostic X-rays and risk of childhood leukaemia. Int. J. Epidemiol. 2010, 39, 1628–1637. [Google Scholar] [CrossRef] [Green Version]
  31. Francis, S.S.; Enders, C.; Hyde, R.; Gao, X.; Wang, R.; Ma, X.; Wiemels, J.L.; Selvin, S.; Metayer, C. Spatial-Temporal Cluster Analysis of Childhood Cancer in California. Epidemiology 2020, 31, 214–223. [Google Scholar] [CrossRef]
  32. Slusky, D.; Mezei, G.; Metayer, C.; Selvin, S.; Von Behren, J.; Buffler, P. Comparison of racial differences in childhood cancer risk in case-control studies and population-based cancer registries. Cancer Epidemiol. 2012, 36, 36–44. [Google Scholar] [CrossRef] [PubMed]
  33. Williams, D.; Priest, N.; Anderson, N. Understanding associations among race, socioeconomic status, and health: Patterns and prospects. Health Psychol. 2016, 35, 407–411. [Google Scholar] [CrossRef] [PubMed]
  34. Chiu, D.; Green, D.; Abidin, N.; Hughes, J.; Odudu, A.; Sinha, S.; Kalra, P. Non-recruitment to and selection bias in studies using echocardiography in haemodialysis patients. Nephrology 2017, 22, 864–871. [Google Scholar] [CrossRef]
  35. Sritharan, J.; Luo, Y.; Harris, M.A. Trends in participation rates in case–control studies of occupational risk factors 1991–2017. Occup. Environ. Med. 2020, 77, 659–665. [Google Scholar] [CrossRef] [PubMed]
  36. Wheeler, D.; De Roos, A.; Cerhan, J.; Morton, L.; Severson, R.; Cozen, W.; Ward, M. Spatial-temporal analysis of non-Hodgkin lymphoma in the NCI-SEER NHL case-control study. Environ. Health 2011, 10, 63. [Google Scholar] [CrossRef] [Green Version]
  37. Wheeler, D. A comparison of spatial clustering and cluster detection techniques for childhood leukemia incidence in Ohio, 1996–2003. Int. J. Health Geogr. 2007, 6, 13. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Posterior mean weights for variables in the crude model of neighborhood deprivation index for childhood leukemia. Note: components are Black segregation, Hispanic segregation, ratio of income to poverty <1, percent receiving public assistance income, percent of renters, percent with no high school diploma, percent in a different house than 1 year ago, percent foreign born, per capita income, median house value, and median gross rent.
Figure 1. Posterior mean weights for variables in the crude model of neighborhood deprivation index for childhood leukemia. Note: components are Black segregation, Hispanic segregation, ratio of income to poverty <1, percent receiving public assistance income, percent of renters, percent with no high school diploma, percent in a different house than 1 year ago, percent foreign born, per capita income, median house value, and median gross rent.
Ijerph 20 03582 g001
Figure 2. Posterior mean weights for variables in the covariate-adjusted model of neighborhood deprivation index for childhood leukemia. Note: components are Black segregation, Hispanic segregation, ratio of income to poverty <1, percent receiving public assistance income, percent of renters, percent with no high school diploma, percent in a different house than 1 year ago, percent foreign born, per capita income, median house value, and median gross rent.
Figure 2. Posterior mean weights for variables in the covariate-adjusted model of neighborhood deprivation index for childhood leukemia. Note: components are Black segregation, Hispanic segregation, ratio of income to poverty <1, percent receiving public assistance income, percent of renters, percent with no high school diploma, percent in a different house than 1 year ago, percent foreign born, per capita income, median house value, and median gross rent.
Ijerph 20 03582 g002
Figure 3. Neighborhood deprivation index odds ratio estimates in the blue circles and 95% credible intervals in black lines for each of the 100 simulated datasets from the first sampling scheme for participants.
Figure 3. Neighborhood deprivation index odds ratio estimates in the blue circles and 95% credible intervals in black lines for each of the 100 simulated datasets from the first sampling scheme for participants.
Ijerph 20 03582 g003
Figure 4. Distributions of neighborhood deprivation index component weights for the crude models for the 100 simulated datasets from the first sampling scheme for participants, where there are some large values above the body for most variables. Note: components are Black segregation, Hispanic segregation, percent of households with ratio of income to poverty <1 (below the poverty threshold), percent receiving public assistance income, percent of renters, percent with no high school diploma, percent in a different house than 1 year ago, percent foreign born, per capita income, median house value, and median gross rent.
Figure 4. Distributions of neighborhood deprivation index component weights for the crude models for the 100 simulated datasets from the first sampling scheme for participants, where there are some large values above the body for most variables. Note: components are Black segregation, Hispanic segregation, percent of households with ratio of income to poverty <1 (below the poverty threshold), percent receiving public assistance income, percent of renters, percent with no high school diploma, percent in a different house than 1 year ago, percent foreign born, per capita income, median house value, and median gross rent.
Ijerph 20 03582 g004
Figure 5. Area of elevated risk in red according to exceedance probabilities of spatial random effects in spatial risk model based on observed data.
Figure 5. Area of elevated risk in red according to exceedance probabilities of spatial random effects in spatial risk model based on observed data.
Ijerph 20 03582 g005
Figure 6. Significant spatial cluster in red detected using local spatial scan (left) and BYM model (right) based on the observed data.
Figure 6. Significant spatial cluster in red detected using local spatial scan (left) and BYM model (right) based on the observed data.
Ijerph 20 03582 g006
Figure 7. Percent of areas detected as significantly elevated risk over 100 simulated datasets from the first scheme using local spatial scan (left) and BYM model (right).
Figure 7. Percent of areas detected as significantly elevated risk over 100 simulated datasets from the first scheme using local spatial scan (left) and BYM model (right).
Ijerph 20 03582 g007
Table 1. Odds ratios and 95% credible intervals for the covariate-adjusted neighborhood deprivation index (NDI) model for childhood leukemia.
Table 1. Odds ratios and 95% credible intervals for the covariate-adjusted neighborhood deprivation index (NDI) model for childhood leukemia.
VariableOdds Ratio2.5% CI97.5% CI
NDI0.970.871.07
Child’s age1.000.911.11
Female1.000.731.37
Child’s ethnicity
 Hispanic1.300.862.08
 Non-Hispanic1.460.962.27
Household income
$15,000–$29,9991.040.532.06
$30,000–$44,9990.900.461.70
$45,000–$59,9990.870.421.70
$60,000–$74,9990.520.221.10
$75,000 or more0.440.220.88
 Income missing0.670.221.69
Mother’s education
 High school1.120.622.29
 Some college1.090.592.20
 Bachelor’s or higher1.250.672.62
Mother’s age1.010.981.04
Residence since birth0.720.501.02
Table 2. Odds ratios and 95% credible intervals for the covariate-adjusted neighborhood deprivation index (NDI) and chemical exposure groups model for childhood leukemia.
Table 2. Odds ratios and 95% credible intervals for the covariate-adjusted neighborhood deprivation index (NDI) and chemical exposure groups model for childhood leukemia.
VariableOdds Ratio2.5% CI97.5% CI
PCBs1.190.911.52
Insecticides0.580.350.94
Herbicides1.220.841.80
Metals0.790.591.06
PAHs1.210.981.52
Tobacco0.840.671.04
PBDEs1.250.821.86
NDI0.950.851.07
Child’s age1.010.911.11
Female0.970.681.36
Child’s ethnicity
 Hispanic1.320.832.18
 Non-Hispanic1.420.902.29
Household income
$15,000–$29,9991.020.462.20
$30,000–$44,9990.730.321.50
$45,000–$59,9990.740.311.60
$60,000–$74,9990.410.151.01
$75,000 or more0.320.130.70
 Income missing0.510.151.50
Mother’s education
 High school1.330.643.14
 Some college1.310.623.22
 Bachelor’s or higher1.340.613.44
Mother’s age1.010.981.05
Residence since birth0.680.461.00
Table 3. Summary of spatial cluster detection results in simulations adding participants to the observed sample to evaluate selection bias. Notes: Weights refers to the sampling weights applied to census tracts for added control participants. Equal refers to equal weight given to income deprivation, education deprivation, and population for a census tract. SES refers to 50% greater weight given to income and education deprivation than to population for a census tract. Quantities in the table for Size and Overlap refer to the median and 95% percentile-based interval in square kilometers for the convex hull of the spatial cluster.
Table 3. Summary of spatial cluster detection results in simulations adding participants to the observed sample to evaluate selection bias. Notes: Weights refers to the sampling weights applied to census tracts for added control participants. Equal refers to equal weight given to income deprivation, education deprivation, and population for a census tract. SES refers to 50% greater weight given to income and education deprivation than to population for a census tract. Quantities in the table for Size and Overlap refer to the median and 95% percentile-based interval in square kilometers for the convex hull of the spatial cluster.
MethodLocal Spatial ScanBesag–York–Mollie
WeightsEqualSESEqualSES
% with Cluster37.030.055.041.0
Size0 (0, 5586)0 (0, 4813)0 (0, 7373)0 (0, 8918)
Overlap0 (0, 100.0)0 (0, 92.0)0 (0, 64.0)0 (0, 30.0)
% with Overlap20.012.023.012.0
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wheeler, D.C.; Boyle, J.; Carli, M.; Ward, M.H.; Metayer, C. Neighborhood Deprivation, Indoor Chemical Concentrations, and Spatial Risk for Childhood Leukemia. Int. J. Environ. Res. Public Health 2023, 20, 3582. https://doi.org/10.3390/ijerph20043582

AMA Style

Wheeler DC, Boyle J, Carli M, Ward MH, Metayer C. Neighborhood Deprivation, Indoor Chemical Concentrations, and Spatial Risk for Childhood Leukemia. International Journal of Environmental Research and Public Health. 2023; 20(4):3582. https://doi.org/10.3390/ijerph20043582

Chicago/Turabian Style

Wheeler, David C., Joseph Boyle, Matt Carli, Mary H. Ward, and Catherine Metayer. 2023. "Neighborhood Deprivation, Indoor Chemical Concentrations, and Spatial Risk for Childhood Leukemia" International Journal of Environmental Research and Public Health 20, no. 4: 3582. https://doi.org/10.3390/ijerph20043582

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop