Next Article in Journal
Research Priorities for NCD Prevention and Climate Change: An International Delphi Survey
Previous Article in Journal
A Case Study Perspective on Working with ProUCL and a State Environmental Agency in Determining Background Threshold Values
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 12
Issue 10
10.3390/ijerph121012924
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Association of Exposure to Particular Matter and Carotid Intima-Media Thickness: A Systematic Review and Meta-Analysis

by
Xiaole Liu
1,
Hui Lian
1,
Yanping Ruan
1,
Ruijuan Liang
1,
Xiaoyi Zhao
1,
Michael Routledge
2 and
Zhongjie Fan
1,*
1
Department of Cardiology, Peking Union Medical College Hospital, Peking Union Medical College, Chinese Academy of Medical Sciences, Beijing 100730, China
2
Leeds Institute of Cardiovascular & Metabolic Medicine, University of Leeds, Leeds LS2 9JT, UK
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2015, 12(10), 12924-12940; https://doi.org/10.3390/ijerph121012924
Submission received: 1 September 2015 / Revised: 29 September 2015 / Accepted: 9 October 2015 / Published: 15 October 2015
Browse Figures
Versions Notes

Abstract

:
Background: Long time exposure to particular matter has been linked to myocardial infarction, stroke and blood pressure, but its association with atherosclerosis is not clear. This meta-analysis was aimed at assessing whether PM2.5 and PM10 have an effect on subclinical atherosclerosis measured by carotid intima-media thickness (CIMT). Methods: Pubmed, Ovid Medline, Embase and NICK between 1948 and 31 March 2015 were searched by combining the keywords about exposure to the outcome related words. The random-effects model was applied in computing the change of CIMT and their corresponding 95% confidence interval (95% CI). The effect of potential confounding factors was assessed by stratified analysis and the impact of traffic proximity was also estimated. Results: Among 56 identified studies, 11 articles satisfied the inclusion criteria. In overall analysis increments of 10 μg/m3 in PM2.5 and PM10 were associated with an increase of CIMT (16.79 μm; 95% CI, 4.95–28.63 μm and 4.13 μm; 95% CI, −5.79–14.04 μm, respectively). Results shown in subgroup analysis had reference value for comparing with those of the overall analysis. The impact of traffic proximity on CIMT was uncertain. Conclusions: Exposure to PM2.5 had a significant association with CIMT and for women the effect may be more obvious.

1. Introduction

The association between air pollution (especially particular matter) and cardiovascular disease (CVD) or their risk factors has been demonstrated by a great number of epidemiological and experimental studies [1,2,3,4,5,6]. Among the size fractions of particular matter, long term exposure to ambient and individual particular matter less than 2.5 μm in diameter (PM2.5) is responsible for morbidity and mortality of cardiovascular events [7].
Atherosclerosis is a chronic process and mainly affects the aorta, coronary artery and cerebral artery, which often leads to serious consequences like lumen occlusion and plaque rupture. It is the major pathological process of heart disease and stroke. In Western developed countries, atherosclerosis account for about 50% of all deaths [8,9,10]. Epidemiological studies have suggested that the degree of atherosclerosis can be measured by CIMT to forecast population’s future cardiovascular risk [11,12,13].
Several studies of long term exposure to particular matter (PM2.5, PM10) have shown that the higher particular matter concentrations were associated with increased CIMT. However, not all studies had found significant results, so the association between particular matter and CIMT is still uncertain. We therefore systematically reviewed the studies examining the effect of particular matter (PM2.5, PM10) on CIMT to quantify this effect.

2. Materials and Methods

2.1. Search Strategy and Eligibility Criteria

We performed a comprehensive databases search in PubMed, Ovid Medline, Embase and CNKI using the following key words: “air pollution”, “air pollutants”, “particular matter”, “PM2.5”, “PM10”, “meteorological factor”, “carotid intima-media thickness”, “Carotid atherosclerosis”, “carotid IMT (intima-media thickness)”, “CIMT” and “subclinical atherosclerosis”. The publication date of literature was limited between 1948 and 31 March 2015.Literatures were included if they were population-based studies, which not only reported the association between particular matter(PM2.5 or PM10) and CIMT, but also provided original data for particular matter(PM2.5 or PM10) and carotid artery intima-media thickness. There were no language restrictions. We excluded duplicates, summaries, reviews, letters, commentaries and editorials, toxicological studies, case reports and case series. In this way we selected 13 studies meeting the inclusion criteria. However, two of these studies, which only presented the median value or the percentage change of CIMT, didn’t have adequate data for CIMT. We contacted authors for detail data and no answer was obtained, so the two studies were excluded and 11 studies were finally included in our meta-analyses.

2.2. Study Selection

By screening all titles and abstracts potentially eligible studies were selected by two independent investigators (Xiaole Liu and Hui Lian). Then the eligibility of the study for the meta-analysis was picked out by reading the full text of the potentially eligible studies. If the two reviewers had disagreements, a third reviewer (Ruijuan Liang) would help adjudicate conflicts.

2.3. Data Extraction

On the basis of in-depth reading of all eligible literatures we extracted the useful data and enter it in an advance designed standardized information table, which presented a comprehensive description of the study characteristics, including title, first author, journal publication year, study design, location and period, characteristics of the participants (age, sex, physical condition, sample size), measurement of CIMT, data analysis model, exposure measurement, effect measurement and confounding factors adjusted (age, sex, race, education, temperature, humidity and so on). Two reviewers (Xiaole Liu and Hui Lian) completed the operation of data extraction respectively and then compared. In case of conflict, a third reviewer (Ruijuan Liang) was asked to judge and make a decision.

2.4. Statistical Analysis

We transformed the value of CIMT with 95% CIs from each study for a standardized increment per 10 μg/m3 in particular matter (PM2.5, PM10) and took it as our outcome. In addition, we hypothesizeda linear relation between exposure and outcome because most studies used linear regression models. On account of different study designs, geographical settings, methods of exposure and CIMT measurements, characteristics of participants and exposure durations, heterogeneity existed in the studies. Therefore, we used the random-effects model, which accounts for both within and between studies heterogeneity to pool the summary-effect estimates. According to the weight (1/SE2) of each study account for the total, we calculated the overall effect. Standard I2 statistic was applied to tests for heterogeneity in order to quantify inconsistencies between studies.I2 values of 25% or less, 50% and 75% or more stand for low, moderate and high heterogeneity respectively.
We also did subgroup analyses stratifying studies performed by study design (cross-sectional vs. longitudinal), sex (female vs. male), education (low education vs. high education), treatment (lipid-lowering treatment vs. no lipid-lowering treatment). In addition, association between traffic proximity and CIMT was also assessed. To estimate the potential publication bias, funnel plots were constructed and we also tested them using the Egger regression test due to the limitations of funnel plot. Statistical analyses were conducted using Stata software (Stata Corp., College Station, TX, USA). Statistical significance was taken as two-sided p < 0.05 with the exception of the heterogeneity assessment, which was considered statistically significant at p < 0.01.

3. Results

3.1. Literature Search

104 initial records were retrieved by searching databases and 56 remained after removing duplicates. Then by screening the titles and abstracts, 35 articles were excluded, which were animal studies or not primary documents (review, letter). After that we read the full text of the remaining 21 studies and determined 13 of them fulfilled the eligibility criteria. Whereas two studies didn’t present sufficient data for mean value of CIMT and their authors didn’t respond to our e-mails requesting information [14,15], 11 articles were finally eligibility of the review and meta-analysis. Figure 1 show a flow of information through the different study screening phases in our meta-analysis.
Ijerph 12 12924 g001 1024
Figure 1. Flow chart of studies selection in the meta-analysis.
Figure 1. Flow chart of studies selection in the meta-analysis.
Ijerph 12 12924 g001

3.2. Study Characteristics

The characteristics of included studies are presented in the Table 1. Among the eligible studies, nine used cross-sectional design, one used longitudinal design, and another one used both study designs. Study locations were mainly USA (six studies), three studies were from Europe (one of them including four cohorts), one study was from Canada and one was from Taiwan. The sample size of participants ranged from 509 to 6256. The populations of these studies were all adults and most of them were healthy. Four studies selected the population from a same existing cohort, participants of which aged from 45 to 84 and without preexisting clinically apparent cardiovascular disease. In addition, one study was conducted in young adults aged from 18 to 27.
Table
Table 1. Characteristics of included studies.
Table 1. Characteristics of included studies.
First Author,Year [Reference No.]LocationPeriodStudy designSamplesizeAge (Years)Exposure MeasurementStatistical Analysis
Su, 2015 [16]Taiwan2009–2011cross-sectional68935–65Individualmultiple linearregression model
Perez, 2015 [17]Europe1997–2009cross-sectional918342–68Individuallinear regression model
Kim, 2014 [18]USA2000–2002cross-sectional548845–84individualmultiple linearregression model
Gan, 2014 [19]Canada2004–2011longitudinal50930–65individualgeneral linear regression model
Sun, 2013 [20]USA2000–2002cross-sectional625645–84ambientmultiple linearregression model
Adar, 2013 [21]USA2000–2005cross-sectional566045–84individuallongitudinal mixed model
Breton, 2012 [22]USA2007–2009cross-sectional76818–27ambientlinear regression model
Tonne, 2012 [23]Britain2002–2006cross-sectional234855–67individualgeneralized linear regression models
Künali, 2010 [24]USA1994–2006cross-sectional, longitudinal1483>30ambientlinear regression model
Lenters, 2010 [25]The Netherlands1999–2000cross-sectional74545–84individualmultiple linearregression model
Künali, 2005 [26]USA1998–2003cross-sectional798>40ambientlinear regression model
Particular matter in 10 studies was PM2.5, in one study it was PM10 and in three studies both. The concentrations of PM10 and PM2.5 were estimated in ambient or individual-levels. Linear regression model was used to evaluate the association between air pollution and CIMT in most studied. The number of potential confounding factors included in the studies varied, most adjusted for age, sex, race/ethnicity, body mass index (BMI), smoking status, education, and low-density lipoprotein cholesterol (LDL-C) in the results.

3.3. Analysis

The results from the random-effects meta-analysis of the relationship between exposure to PM2.5 and CIMT are shown in Figure 2. When the concentration of PM2.5 increased 10 μg/m3 in the evaluation of overall combination, its relationship with CIMT reached statistical significance (the increment of CIMT is 16.79 μm; 95% CI, 4.95–28.63 μm). The heterogeneity observed for 10 studies was small-medium (I2 = 67.6%). When some of the eligible studies were pooled with an additional adjustment for education and income, the summary estimate was attenuated to 16.68 μm (95% CI, 4.93–28.43 μm), results were not shown in the table.
Ijerph 12 12924 g002 1024
Figure 2. Forest plot for overall analysis of the association between PM2.5 and CIMT (random-effects model); * four on-going European cohort analyzed by Perez et al. [17].
Figure 2. Forest plot for overall analysis of the association between PM2.5 and CIMT (random-effects model); * four on-going European cohort analyzed by Perez et al. [17].
Ijerph 12 12924 g002
There was no statistical evidence of publication bias in overall analyses. In Egger’s test we got p = 0.211. The subgroup analysis about PM2.5 and CIMT was conducted by sex (Adar et al. [21]; Lenters et al. [25]; Künzli et al. [26]), education (Adar et al. [21]; Künzli et al. [24]; Lenters et al. [25]), lipid-lowering treatment (Adar et al. [21]; Künzli et al. [24]; Künzli et al. [26]) and study design. Significant association between PM2.5 and CIMT was found with female, the summary estimate of which was larger than overall analysis (64.42 μm; 95% CI, 38.44–90.39 μm). However, the association with male had no statistic significant. Similarly, in longitudinal study design a weak correlation between exposure to PM2.5 and CIMT was represented (5.50 μm; 95% CI, 0.00–10.99 μm), comparing with no significant association in cross-sectional study design (22.60 μm; 95% CI, −8.39–53.60 μm). The subgroup analysis stratified by educational qualifications showed that people with low education had a larger effect than high education, whereas neither of them had statistic significant. The pooled estimates of low education and high education were 31.80 μm (95% CI, −4.16–67.77 μm) and 14.46 μm (95% CI,−15.47–44.40 μm), respectively. When compared the effects based on whether receive the lipid-lowering treatment, we also found a difference. Participants with a lipid-lowering treatment showed an increase of CIMT with 43.57 μm (95% CI, −12.12–99.27 μm), whereas people had no lipid-lowering treatment was 24.74 μm (95% CI,−7.75–57.25 μm). (Figure 3).
Ijerph 12 12924 g003 1024
Figure 3. Subgroup analyses based on sex, education, treatment and study design.
Figure 3. Subgroup analyses based on sex, education, treatment and study design.
Ijerph 12 12924 g003
Summary estimate for PM10 is shown in Figure 4. When the concentration of PM10 increased 10 μg/m3 in the evaluation of overall combination, the CIMT increment is 4.13 μm (95% CI, −5.79–14.04 μm), which was inverse in comparison with PM2.5 but not statistically significant, though there was significant heterogeneity across the studies (I2 = 66.5% or p = 0.006) in associations with PM10.
Ijerph 12 12924 g004 1024
Figure 4. Forest plot for overall analysis of the association between PM10 and CIMT (random-effects model); * four on-going European cohorts analyzed by Perez et al. [17].
Figure 4. Forest plot for overall analysis of the association between PM10 and CIMT (random-effects model); * four on-going European cohorts analyzed by Perez et al. [17].
Ijerph 12 12924 g004

4. Discussion

This study is, to our knowledge, the first meta-analysis which estimates the effects of exposure to particular matter (PM2.5, PM10) on CIMT, an accepted measure of the progression of atherosclerosis [27,28]. In overall estimation we observed a significant and positive association between PM2.5 and CIMT. When compared with the overall analysis, subgroup analyses were associated with lower heterogeneity and had the same direction of estimated effect. Therefore, the association was robust.
Two studies we excluded due a lack of sufficient data for mean value of CIMT showed similar results. One is in Germany [14]: Median CIMT of the 3380 analyzed participants was 0.66 mm (interquartile range 0.16 mm). An interdecile range increase in PM2.5 (4.2 μg/m3), PM10 (6.7 μg/m3), and distance to high traffic (1939 m) were associated with a 4.3% (95% CI, 1.9%–6.7%), 1.7% (95% CI, −0.7%–4.1%), and 1.2% (95% CI,−0.2%–2.6%) increase in CIMT, respectively; The other one is in the USA [15]: Intimal-medial thickness was weakly, positively associated with exposures to particulate matter <10 μmin aerodynamic diameter and <2.5 μm in aerodynamic diameter after controlling for age, sex, race/ethnicity, socioeconomic factors, diet, smoking, physical activity, blood lipids, diabetes, hypertension, and body mass index (1%–4% increase per 21-μg/m3 increase in particulate matter <10 μm in aerodynamic diameter or a 12.5-μg/m3 increase in particulate matter <2.5 μm in aerodynamic diameter). Results were consistent from a qualitative angle and didn’t affect the results in our paper.
CIMT results from the processes of cumulative atherogenesis and is a predictor of cardiovascular events. In comparison with pulse wave velocity and augmentation index, which are affected by changes in blood pressure, CIMT is quite easy to be measured due to little short-term variation. Therefore, previous environment studies applied it to measure the degree of atherosclerosis [27,29,30,31]. Inflammatory dysfunction [32], the excitation of oxidative stress and autonomic imbalance are thought to be the potential pathways, by which particular matter is associated with atherogenesis. Then these potential pathways lead to endothelial dysfunction and reduction of vascular reactivity, which have been proved to be early manifestations of atherosclerosis by many studies. Endothelial dysfunction, as a possible and important mechanism, is an initial step in atherosclerosis. Several studies have pointed out a relationship between endothelial function and particulate air pollution [33,34,35]. Santoro et al. [36] demonstrated that endothelial dysfunction can occur without structural atherosclerotic changes in young women with endometriosis, which underlined the importance to investigate this parameter especially in young and healthy people, to confirm the precocity of endothelial dysfunction respect to intima-media thickness. Hoffmann et al. [37]showed fine particulate matter exposure was associated with coronary artery calcification (CAC), which is related in relevant ways to CIMT. Wilker et al. [38] reported annual mean black carbon concentration was associated with CIMT in the elderly. These findings supported an association between long-term air pollution exposure and atherosclerosis. Many animal experiments also supported the viewpoint that exposure to PM2.5 may contribute to the process of atherosclerosis by potential mechanisms including bone marrow stimulation, release of monocytes and altered vasomotor tone [39,40,41].Exposure of apolipoproteinE mice to PM2.5 had an effect on altered vasomotor tone, vascular inflammation and increase of aortic atherosclerosis [39]. In addition, animal experiments found other biologic mechanisms, which connect particulate matter exposure with the progress of atherosclerosis in a long-term period, that exposure to particular matter may influence blood pressure, autonomic function and low density lipoprotein oxidation [42,43,44,45,46].
As shown in Figure 3, we found the estimate effect was larger in women. The result suggested that gender may influence the association between PM2.5 and CIMT. One potential mechanism is the secretion of androgen. In addition, compared with young men, elderly men with less androgen have higher risk for atherosclerosis [26].The other one was that females had slightly greater airway reactivity than males. Thus, compared with males, we might find dose-response relations more easily in females [47]. Although previous studies also reported that particular matter had greater effect estimates in women [47,48], the effect modification by gender remained unclear and further investigations are needed [49]. Although we didn’t discuss the effects of age due to limited number of included studies, previous literature showed a linkage among sex, age and atherosclerosis [50]. If more research were conducted in the future, we can perform a subgroup analysis by age.
Participants with lower education were more vulnerable when exposed to PM2.5. One of the reasons was that because of poor living conditions, people with lower education are more likely to live near busy roads and expose to multiple air pollutants. For example, higher concentrations of some air pollutants have been demonstrated among disadvantaged groups [51]. Studies for Scandinavian indicated the discrepancy of personal exposures to particular matter among people with different education and occupation [52,53]. Another reason was that a majority of people receiving lower education have poor living conditions and don’t have ability to get enough nutrition, such as antioxidant polyunsaturated fatty acids and vitamins, which may protect against adverse effects of particular matter [54]. Furthermore, people with lower socioeconomic status (SES) have a higher prevalence of preexisting diseases and usually receive inferior medical treatment for them, which leads to higher sensitivity of air pollution-related health hazards.
Our study found people with lipid-lowering treatment was not significant compared with those without treatment. Some studies reported that participants taking lipid-lowering medications at baseline represented stronger association between CIMT and PM2.5 [24,26]. Hyperlipidemic rabbits experiments had demonstrated this conclusion [40,55]. However, the modification direction reported in other study was inconsistent. In order to illuminate the relevance of lipid and statin status, future researches can be conducted among cohorts with familial hypercholesteremia [56,57].
We also conducted meta-analyses among different study designs. Longitudinal studies compared with cross-sectional ones. When excluding cross-sectional studies, the relevance between PM2.5 and CIMT had no statistical significance because in cross-sectional studies, the study object was the whole population, which stopped the researchers from exploring person-level factors, while longitudinal studies took the individuals as study objects, so intra-individual variability could be taken into consideration. If more cohorts are built in the future, more longitudinal studies could be conducted.
Four studies [17,19,24,25] referred to the relationship between CIMT and traffic proximity. Due to different data expression, we cannot conduct meta-analysis. Living close to major roads may indicate high exposure to traffic-related exhaust emissions, such as ultrafine particles and other highly redox-active pollution especially diesel particles [58]. Perez et al. [17] presented that living in proximity to high traffic might also positively associated with CIMT. Künzli et al. [24] showed that a 10 μg/m3 increasing in PM2.5 annual was associated with 2.5 μm (95% CI, −0.3–5.4 μm) increase in CIMT, which had no significant. When living within 100 m traffic, annual CIMT increased 5.5 μm (95% CI, 0.13–10.79 μm) compared with people living away from traffic. However, living within a highway (100 m) or within a major road (50 m) was related with a non-significant 1.6 μm (95% CI, −0.15–3.42 μm) augment in CIMT per year. Lenters et al. [25] didn’t find consistent direction of association between traffic indicators (traffic proximity, traffic density) and CIMT. Similarly results were also represented by Gan et al. [19]. Several other recent studies observing the associations of CIMT with biomass fuel [59] and traffic-related air pollution [60] showed statistic significant results. Rivera et al. [60] reported that exposure contrasts between the 5th and 95th percentiles for NO2 (25 µg/m3), traffic intensity in the nearest street (15,000 vehicles/day), and traffic load within 100 m (7,200,000 vehicle-m/day) were related with 0.56% (95% CI, −1.5%–2.6%), 2.32% (95% CI, 0.48%–4.17%), and 1.91% (95% CI, −0.24–4.06) percent difference in IMT, respectively. Armijos et al. [61] examined the association of long-term exposure to traffic with CIMT in children. The results showed that children residing <100 meters from the nearest heavily trafficked road had mean and maximum CIMT increment of 15% and 11% compared to those living ≥200 m away (p = 0.0001). From the above, future researches should focus on the effects of traffic proximity on atherosclerosis. Furthermore, studies can also be conducted to find if CIMT is a necessary ideal marker to reflect adverse effects of atherosclerosis related with particular matter.
The results for PM10 presented by Perez et al. [17] were different from other ones. Bauer et al. [14] reported a 5% change (95% CI, 1.9%–8.3%) for an IQR increase of 5.2 μg/m3 PM10. While Tonne et al. [23] showed an insignificant association (1.8% change (95% CI, 0.6%–4.3%) per 6.7 μg/m3increase of PM10).
Diet of population can also affect the atherosclerotic development and lead to different results. Bassett et al. [62] indicated Trans-fatty acids in the diet are closely related to atherosclerosis measured by CIMT.
Several potential limitations should be noted in our study. Firstly, heterogeneity due to distinction between individuals and between studies was found across all researches, such as publication year, location, study design, study period, characteristics of participants, PM2.5 and PM10 measurement, sample size, covariates in each study and measuring method of CIMT. According to existing detailed protocols about measurement technique and analysis, the CIMT was assessed noninvasively by B-mode ultra-sound imaging coupled with automatic data processing systems. However, the optimal site and used value are still uncertain [29]. Some studies utilized the value of mean CIMT of the right far common carotid wall. Other studies regarded the average of the largest IMT in the left and right carotid arteries as a person’s CIMT. Still one study used mean of all available maximum wall thicknesses. In addition, choosing to use the cross-sectional CIMT or progression of CIMT also make some differences. Health status of participants and medication use were others potential factors having effects on outcome. Different statistical methods including linear regression models and longitudinal mixed models as well as the varying adjusted factors used in different studies may also product heterogeneity. Besides the heterogeneity factors we referred above, the limited number of the included studies and inferences in our meta-analysis make it difficult for us to find other potential factors by further analysis. As a result of which, heterogeneity, publication bias and quality reduction for studies arose. Secondly, since few involved studies used a “multi-pollution” model, we only put a “single-pollution” model into use in our study, regardless of latent interactions between pollutants. Therefore, we can’t estimate the interaction of multi-pollution associated with CIMT. Thirdly, some potential confounding factors were shown by subgroup analysis and additional overall analysis, which assessed the pooled-effect after putting an additional adjustment for education and income in some included studies. Nonetheless, more confounding factors are not able to be represented by more stratified analysis due to the less number of studies and limited information they provide.
Our study provides further evidence that particular matter exposure may increase the risks of arteriosclerosis as well as the morbidity and mortality of cardiovascular diseases. Almost all of studies included in our meta-analysis used a linear regression model to estimate the relationship between particular matter (PM2.5, PM10) and CIMT. If the association is linear, it is of great value to reduce the concentration of PM2.5 at all levels and can provide a basis for the government to issue regulations for decreasing particular matter emissions. In view of the limited number of existing studies about association between particular matter and CIMT, more analogous studies should be conducted in the future to further verify the results. In addition, future research can also focus on distinguishing potential confounding factors that impact the effect of PM2.5 and PM10 on CIMT, such as noise, postmenopausal women, diabetics or physical exercise.

5. Conclusions

Our results showed that an increase in PM2.5 had a significant association with CIMT, which is a marker for subclinical atherosclerosis. In females the effect may be more obvious and statistically significant, while the relationship of the effect with education level and lipid-lowering treatment status is still unclear.

Acknowledgments

Funding: This study was supported by Beijing Municipal Science and Technology Commission (Z131107002213176); National 973 Project (2015CB553400); The National Environmental Protection Non-profit Project (2015003016); National Natural Science Foundation (41450006); Beijing Medical Health Science and Technology Key-support Project (2014-1-4016).

Author Contributions

Xiaole Liu conceived and designed the work, and took part in every step of the work, including, execution, statistical analysis and writing of the manuscript. Hui Lian and Yanping Ruan were responsible for the data collection, and reviewing of the manuscript. Ruijuan Liang and Xiaoyi Zhao gave input in the data analysis and the drafts of the paper. Michael Routledge reviewed and critiqued the manuscript. Zhongjie Fan was responsible for the conception of the manuscript and reviewed and critiqued of the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Miller, K.A.; Siscovick, D.S.; Sheppard, L.; Shepherd, K.; Sullivan, J.H.; Anderson, G.L.; Kaufman, J.D. Long-term exposure to air pollution and incidence of cardiovascular events in women. N. Engl. J. Med. 2007, 356, 447–458. [Google Scholar] [CrossRef] [PubMed]
  2. Pope, C.R.; Burnett, R.T.; Thurston, G.D.; Thun, M.J.; Calle, E.E.; Krewski, D.; Godleski, J.J. Cardiovascular mortality and long-term exposure to particulate air pollution: Epidemiological evidence of general pathophysiological pathways of disease. Circulation 2004, 109, 71–77. [Google Scholar] [CrossRef] [PubMed]
  3. Hoek, G.; Brunekreef, B.; Goldbohm, S.; Fischer, P.; van den Brandt, P.A. Association between mortality and indicators of traffic-related air pollution in the Netherlands: A cohort study. Lancet 2002, 360, 1203–1209. [Google Scholar] [CrossRef]
  4. Dockery, D.W.; Pope, C.A., III; Xu, X.; Spengler, J.D.; Ware, J.H.; Fay, M.E.; Ferris, B.G., Jr.; Speizer, F.E. An association between air pollution and mortality in six U.S. cities. N. Engl. J. Med. 1993, 329, 1753–1759. [Google Scholar] [CrossRef] [PubMed]
  5. Liang, R.; Zhang, B.; Zhao, X.; Ruan, Y.; Lian, H.; Fan, Z. Effect of exposure to PM2.5 on blood pressure: A systematic review and meta-analysis. J. Hypertens 2014, 32, 2130–2140. [Google Scholar] [CrossRef] [PubMed]
  6. Zhao, X.; Sun, Z.; Ruan, Y.; Yan, J.; Mukherjee, B.; Yang, F.; Duan, F.; Sun, L.; Liang, R.; Lian, H.; et al. Personal black carbon exposure influences ambulatory blood pressure: Air pollution and cardiometabolic disease (AIRCMD-China) study. Hypertension 2014, 63, 871–877. [Google Scholar] [CrossRef] [PubMed]
  7. Brook, R.D.; Rajagopalan, S.; Pope, C.A., III; Brook, J.R.; Bhatnagar, A.; Diez-Roux, A.V.; Holguin, F.; Hong, Y.; Luepker, R.V.; Mittleman, M.A.; et al. Particulate matter air pollution and cardiovascular disease: An update to the scientific statement from the American Heart Association. Circulation 2010, 121, 2331–2378. [Google Scholar] [CrossRef] [PubMed]
  8. Libby, P.; Theroux, P. Pathophysiology of coronary artery disease. Circulation 2005, 111, 3481–3488. [Google Scholar] [CrossRef] [PubMed]
  9. Lusis, A.J. Atherosclerosis. Nature 2000, 407, 233–241. [Google Scholar] [CrossRef] [PubMed]
  10. Ross, R. The pathogenesis of atherosclerosis: A perspective for the 1990s. Nature 1993, 362, 801–809. [Google Scholar] [CrossRef] [PubMed]
  11. Stein, J.H.; Korcarz, C.E.; Hurst, R.T.; Lonn, E.; Kendall, C.B.; Mohler, E.R.; Najjar, S.S.; Rembold, C.M.; Post, W.S. American Society of Echocardiography Carotid Intima-Media Thickness Task Force.Use of carotid ultrasound to identify subclinical vascular disease and evaluate cardiovascular disease risk: A consensus statement from the American Society of Echocardiography Carotid Intima-Media Thickness Task Force. Endorsed by the Society for Vascular Medicine. J. Am. Soc. Echocardiogr. 2008, 21, 93–111. [Google Scholar] [PubMed]
  12. Chambless, L.E.; Folsom, A.R.; Clegg, L.X.; Sharrett, A.R.; Shahar, E.; Nieto, F.J.; Rosamond, W.D.; Evans, G. Carotid wall thickness is predictive of incident clinical stroke: The Atherosclerosis Risk in Communities (ARIC) Study. Am. J. Epidemiol. 2000, 151, 478–487. [Google Scholar] [CrossRef] [PubMed]
  13. Chambless, L.E.; Heiss, G.; Folsom, A.R.; Rosamond, W.; Szklo, M.; Sharrett, A.R.; Clegg, L.X. Association of coronary heart disease incidence with carotid arterial wall thickness and major risk factors: The Atherosclerosis Risk in Communities (ARIC)study, 1987–1993. Am. J. Epidemiol. 1997, 146, 483–494. [Google Scholar] [CrossRef] [PubMed]
  14. Bauer, M.; Moebus, S.; Möhlenkamp, S.; Dragano, N.; Nonnemacher, M.; Fuchsluger, M.; Kessler, C.; Jakobs, H.; Memmesheimer, M.; Erbel, R.; et al. Urban particulate matter air pollution is associated with subclinical atherosclerosis: Results from the HNR (Heinz Nixdorf Recall) study. J. Am. Coll. Cardiol. 2010, 56, 1803–1808. [Google Scholar] [CrossRef] [PubMed]
  15. Diez, R.A.; Auchincloss, A.H.; Franklin, T.G.; Raghunathan, T.; Barr, R.G.; Kaufman, J.; Astor, B.; Keeler, J. Long-term exposure to ambient particulate matter and prevalence of subclinical atherosclerosis in the Multi-Ethnic Study of Atherosclerosis. Am. J. Epidemiol. 2008, 167, 667–675. [Google Scholar] [CrossRef] [PubMed]
  16. Su, T.C.; Hwang, J.J.; Shen, Y.C.; Chan, C.C. Carotid Intima-media thickness and long-term exposure to traffic-related air pollution in middle-aged residents of taiwan: A cross-sectional study. Environ. Health Perspect. 2015, 123, 773–778. [Google Scholar] [CrossRef] [PubMed]
  17. Perez, L.; Wolf, K.; Hennig, F.; Penell, J.; Basagaña, X.; Foraster, M.; Aguilera, I.; Agis, D.; Beelen, R.; Brunekreef, B.; et al. Air pollution and atherosclerosis: A cross-sectional analysis of four european cohort studies in the ESCAPE study. Environ. Health Perspect. 2015, 123, 795–605. [Google Scholar] [CrossRef] [PubMed]
  18. Kim, S.Y.; Sheppard, L.; Kaufman, J.D.; Bergen, S.; Szpiro, A.A.; Larson, T.V.; Adar, S.D.; Diez Roux, A.V.; Polak, J.F.; Vedal, S.; et al. Individual-level concentrations of fine particulate matter chemical components and subclinical atherosclerosis: A cross-sectional analysis based on 2 advanced exposure prediction models in the multi-ethnic study of atherosclerosis. Am. J. Epidemiol. 2014, 180, 718–728. [Google Scholar] [PubMed]
  19. Gan, W.Q.; Allen, R.W.; Brauer, M.; Davies, H.W.; Mancini, G.B.; Lear, S.A. Long-term exposure to traffic-related air pollution and progression of carotid artery atherosclerosis: A prospective cohort study. BMJ Open 2014, 4. [Google Scholar] [CrossRef] [PubMed]
  20. Sun, M.; Kaufman, J.D.; Kim, S.Y.; Larson, T.V.; Gould, T.R.; Polak, J.F.; Budoff, M.J.; Diez Roux, A.V.; Vedal, S. Particulate matter components and subclinical atherosclerosis: Common approaches to estimating exposure in a multi-ethnic study of atherosclerosis cross-sectional study. Environ. Health Glob. Access Sci. Source 2013, 12. [Google Scholar] [CrossRef] [PubMed]
  21. Adar, S.D.; Sheppard, L.; Vedal, S.; Polak, J.F.; Sampson, P.D.; Diez Roux, A.V.; Budoff, M.; Jacobs, D.R., Jr.; Barr, R.G.; Watson, K.; et al. Fine particulate air pollution and the progression of carotid intima-medial thickness: A prospective cohort study from the multi-ethnic study of atherosclerosis and air pollution. PLoS Med. 2013, 10. [Google Scholar] [CrossRef] [PubMed]
  22. Breton, C.V.; Wang, X.; Mack, W.J.; Berhane, K.; Lopez, M.; Islam, T.S.; Feng, M.; Lurmann, F.; McConnell, R.; Hodis, H.N.; et al. Childhood air pollutant exposure and carotid artery intima-media thickness in young adults. Circulation 2012, 126, 1614–1620. [Google Scholar] [CrossRef] [PubMed]
  23. Tonne, C.; Yanosky, J.D.; Beevers, S.; Wilkinson, P.; Kelly, F.J. PM mass concentration and PM oxidative potential in relation to carotid intima-media thickness. Epidemiology 2012, 23, 486–494. [Google Scholar] [CrossRef] [PubMed]
  24. Kunzli, N.; Jerrett, M.; Garcia-Esteban, R.; Basagaña, X.; Beckermann, B.; Gilliland, F.; Medina, M.; Peters, J.; Hodis, H.N.; Mack, W.J.; et al. Ambient air pollution and the progression of atherosclerosis in adults. PLoS ONE 2010, 5. [Google Scholar] [CrossRef]
  25. Lenters, V.; Uiterwaal, C.S.; Beelen, R.; Bots, M.L.; Fischer, P.; Brunekreef, B.; Hoek, G. Long-term exposure to air pollution and vascular damage in young adults. Epidemiology 2010, 21, 512–520. [Google Scholar] [CrossRef] [PubMed]
  26. Kunzli, N.; Jerrett, M.; Mack, W.J.; Beckerman, B.; LaBree, L.; Gilliland, F.; Thomas, D.; Peters, J.; Hodis, H.N. Ambient air pollution and atherosclerosis in Los Angeles. Environ. Health Perspect. 2005, 113, 201–206. [Google Scholar] [CrossRef] [PubMed]
  27. Hodis, H.N.; Mack, W.J.; LaBree, L.; Selzer, R.H.; Liu, C.R.; Liu, C.H.; Azen, S.P. The role of carotid arterial intima-media thickness in predicting clinical coronary events. Ann. Intern. Med. 1998, 128, 262–269. [Google Scholar] [CrossRef] [PubMed]
  28. Blankenhorn, D.H.; Hodis, N.H. George Lyman Duff Memorial Lecture. Arterial imaging and atherosclerosis reversal. Arterioscler. Thromb. 1994, 14, 177–192. [Google Scholar] [CrossRef] [PubMed]
  29. Kunzli, N.; Perez, L.; von Klot, S.; Baldassarre, D.; Bauer, M.; Basagana, X.; Breton, C.; Dratva, J.; Elosua, R.; de Faire, U.; et al. Investigating air pollution and atherosclerosis in humans: Concepts and outlook. Prog. Cardiovasc. Dis. 2011, 53, 334–343. [Google Scholar] [CrossRef] [PubMed]
  30. Johnson, H.M.; Douglas, P.S.; Srinivasan, S.R.; Bond, M.G.; Tang, R.; Li, S.; Chen, W.; Berenson, G.S.; Stein, J.H. Predictors of carotid intima-media thickness progression in young adults: The Bogalusa Heart Study. Stroke 2007, 38, 900–905. [Google Scholar] [CrossRef] [PubMed]
  31. O’Leary, D.H.; Polak, J.F.; Kronmal, R.A.; Manolio, T.A.; Burke, G.L.; Wolfson, S.K., Jr. Carotid-artery intima and media thickness as a risk factor for myocardial infarction and stroke in older adults. Cardiovascular Health Study CollaborativeResearch Group. N. Engl. J. Med. 1999, 340, 14–22. [Google Scholar] [CrossRef]
  32. Hoffmann, B.; Moebus, S.; Dragano, N.; Stang, A.; Möhlenkamp, S.; Schmermund, A.; Memmesheimer, M.; Bröcker-Preuss, M.; Mann, K.; Erbel, R.; et al. Chronic residential exposure to particulate matter air pollution and systemic inflammatory markers. Environ. Health Perspect. 2009, 117, 1302–1308. [Google Scholar] [CrossRef] [PubMed]
  33. Krishnan, R.M.; Adar, S.D.; Szpiro, A.A.; Jorgensen, N.W.; van Hee, V.C.; Barr, R.G.; O’Neill, M.S.; Herrington, D.M.; Polak, J.F.; Kaufman, J.D.; et al. Vascular responses to longandshort-term exposure to fine particulate matter: MESA Air (Multi-Ethnic Study of Atherosclerosis and AirPollution). J. Am. Coll. Cardiol. 2012, 60, 2158–2166. [Google Scholar] [CrossRef] [PubMed]
  34. Brook, R.D.; Urch, B.; Dvonch, J.T.; Bard, R.L.; Speck, M.; Keeler, G.; Morishita, M.; Marsik, F.J.; Kamal, A.S.; Kaciroti, N.; et al. Insights into the mechanisms and mediatorsof the effects of air pollution exposure on blood pressure and vascular function in healthy humans. Hypertension 2009, 54, 659–667. [Google Scholar] [CrossRef] [PubMed]
  35. Briet, M.; Collin, C.; Laurent, S.; Tan, A.; Azizi, M.; Agharazii, M.; Jeunemaitre, X.; Alhenc-Gelas, F.; Boutouyrie, P. Endothelial function and chronic exposure to airpollution in normal male subjects. Hypertension 2007, 50, 970–976. [Google Scholar] [CrossRef] [PubMed]
  36. Santoro, L.; D’Onofrio, F.; Campo, S.; Ferraro, P.M.; Tondi, P.; Campo, V.; Flex, A.; Gasbarrini, A.; Santoliquido, A. Endothelial dysfunction but not increased carotid intima-media thickness in young European women with endometriosis. Hum. Reprod. 2012, 27, 1320–1326. [Google Scholar] [CrossRef] [PubMed]
  37. Hoffmann, B.; Moebus, S.; Möhlenkamp, S.; Stang, A.; Lehmann, N.; Dragano, N.; Schmermund, A.; Memmesheimer, M.; Mann, K.; Erbel, R.; et al. Residential exposure to traffic is associated with coronary atherosclerosis. Circulation 2007, 116, 489–496. [Google Scholar] [CrossRef] [PubMed]
  38. Wilker, E.H.; Mittleman, M.A.; Coull, B.A.; Gryparis, A.; Bots, M.L.; Schwartz, J.; Sparrow, D. Long-term exposure to black carbon and carotid intima-media thickness: The normative aging study. Environ. Health Perspect. 2013, 121, 1061–1067. [Google Scholar] [CrossRef] [PubMed]
  39. Sun, Q.; Wang, A.; Jin, X.; Natanzon, A.; Duquaine, D.; Brook, R.D.; Aguinaldo, J.G.; Fayad, Z.A.; Fuster, V.; Lippmann, M.; et al. Long-term air pollution exposure and acceleration of atherosclerosis and vascular inflammation in an animal model. JAMA 2005, 294, 3003–3010. [Google Scholar] [CrossRef] [PubMed]
  40. Suwa, T.; Hogg, J.C.; Quinlan, K.B.; Ohgami, A.; Vincent, R.; van Eeden, S.F. Particulate air pollution induces progression of atherosclerosis. J. Am. Coll. Cardiol. 2002, 39, 935–942. [Google Scholar] [CrossRef]
  41. Fujii, T.; Hayashi, S.; Hogg, J.C.; Mukae, H.; Suwa, T.; Goto, Y.; Vincent, R.; van Eeden, S.F. Interaction of alveolar macrophages and airway epithelial cells following exposure to particulate matter produces mediators that stimulate the bone marrow. Am. J. Respir. Cell Mol. Biol. 2002, 27, 34–41. [Google Scholar] [CrossRef] [PubMed]
  42. Brook, R.D. You are what you breathe: Evidence linking air pollution and blood pressure. Curr. Hypertens. Rep. 2005, 7, 427–434. [Google Scholar] [CrossRef] [PubMed]
  43. Brook, R.D.; Franklin, B.; Cascio, W.; Hong, Y.; Howard, G.; Lipsett, M.; Luepker, R.; Mittleman, M.; Samet, J.; Smith, S.C.; et al. Air pollution and cardiovascular disease: A statement for healthcare professionals from the Expert Panel on Population and Prevention Science of the American Heart Association. Circulation 2004, 109, 2655–2671. [Google Scholar] [CrossRef] [PubMed]
  44. Sharman, J.E.; Coombes, J.S.; Geraghty, D.P.; Fraser, D.I. Exposure to automotive pollution increases plasma susceptibility to oxidation. Arch. Environ. Health 2002, 57, 536–540. [Google Scholar] [CrossRef] [PubMed]
  45. Donaldson, K.; Stone, V.; Seaton, A.; MacNee, W. Ambient particle inhalation and the cardiovascular system: Potential mechanisms. Environ. Health Perspect. 2001, 109, 523–527. [Google Scholar] [CrossRef] [PubMed]
  46. Creason, J.; Neas, L.; Walsh, D.; Williams, R.; Sheldon, L.; Liao, D.; Shy, C. Particulate matter and heart rate variability among elderly retirees: The Baltimore 1998 PM study. J. Expo. Anal. Environ. Epidemiol. 2001, 11, 116–122. [Google Scholar] [CrossRef] [PubMed]
  47. Kan, H.; London, S.J.; Chen, G.; Zhang, Y.; Song, G.; Zhao, N.; Jiang, L.; Chen, B. Season, sex, age, and education as modifiers of the effects of outdoor air pollution on daily mortality in Shanghai, China: The Public Health and Air Pollution in Asia (PAPA) Study. Environ. Health Perspect. 2008, 116, 1183–1188. [Google Scholar] [CrossRef] [PubMed]
  48. Zanobetti, A.; Schwartz, J.; Gold, D. Are there sensitive subgroups for the effects of airborne particles? Environ. Health Perspect. 2000, 108, 841–845. [Google Scholar] [CrossRef] [PubMed]
  49. Clougherty, J.E. A growing role for gender analysis in air pollution epidemiology. Environ. Health Perspect. 2010, 118, 167–176. [Google Scholar] [CrossRef] [PubMed]
  50. Ciccone, M.M.; Bilianou, E.; Balbarini, A.; Gesualdo, M.; Ghiadoni, L.; Metra, M.; Palmiero, P.; Pedrinelli, R.; Salvetti, M.; Scicchitano, P.; et al. Task force on: “Early markers of atherosclerosis: Influence of age and sex”. J. Cardiovasc. Med. 2013, 14, 757–766. [Google Scholar] [CrossRef] [PubMed]
  51. Sexton, K.; Gong, H., Jr.; Bailar, J.C., III; Ford, J.G.; Gold, D.R.; Lambert, W.E.; Utell, M.J. Air pollution health risks: Do class and race matter? Toxicol. Ind. Health 1993, 9, 843–878. [Google Scholar] [PubMed]
  52. Rotko, T.; Kousa, A.; Alm, S.; Jantunen, M. Exposures to nitrogen dioxide in EXPOLIS-Helsinki: Microenvironment, behavioral and sociodemographic factors. J. Expo. Anal. Environ. Epidemiol. 2001, 11, 216–223. [Google Scholar] [CrossRef] [PubMed]
  53. Rotko, T.; Koistinen, K.; Hänninen, O.; Jantunen, M. Sociodemographic descriptors of personal exposure to fine particles (PM2.5) in EXPOLIS Helsinki. J. Expo. Anal. Environ. Epidemiol. 2000, 10, 385–393. [Google Scholar] [CrossRef] [PubMed]
  54. Romieu, I.; Téllez-Rojo, M.M.; Lazo, M.; Manzano-Patiño, A.; Cortez-Lugo, M.; Julien, P.; Bélanger, M.C.; Hernandez-Avila, M.; Holguin, F. Omega-3 fatty acid prevents heart rate variability reductions associated with particulate matter. Am. J. Respir. Crit. Care Med. 2005, 172, 1534–1540. [Google Scholar] [CrossRef] [PubMed]
  55. Goto, Y.; Hogg, J.C.; Shih, C.H.; Ishii, H.; Vincent, R.; van Eeden, S.F. Exposure to ambient particles accelerates monocyte release from bone marrow in atherosclerotic rabbits. Am. J. Physiol. Lung Cell. Mol. Physiol. 2004, 287, L79–L85. [Google Scholar] [CrossRef] [PubMed]
  56. Wiegman, A. Efficacy and safety of statin therapy in children with familial hypercholesterolemia: A randomized controlled trial. JAMA 2004, 292, 331–337. [Google Scholar] [CrossRef] [PubMed]
  57. Wittekoek, M.E.; de Groot, E.; Prins, M.H.; Trip, M.D.; Büller, H.R.; Kastelein, J.J. Differences in intima-media thickness in the carotid and femoral arteries in familial hypercholesterolemic heterozygotes with and without clinical manifestations of cardiovascular disease. Atherosclerosis 1999, 146, 271–279. [Google Scholar] [CrossRef]
  58. Zhu, Y.; Hinds, W.C.; Kim, S.; Sioutas, C. Concentration and size distribution of ultrafine particles near a major highway. J. Air Waste Manag. Assoc. 2002, 52, 1032–1042. [Google Scholar] [CrossRef] [PubMed]
  59. Painschab, M.S.; Davila-Roman, V.G.; Gilman, R.H.; Vasquez-Villar, A.D.; Pollard, S.L.; Wise, R.A.; Miranda, J.J.; Checkley, W.; CRONICAS Cohort Study Group. Chronic exposure to biomass fuel is associated with increased carotid artery intima-media thickness and a higher prevalence of atherosclerotic plaque. Heart 2013, 99, 984–991. [Google Scholar] [CrossRef] [PubMed]
  60. Rivera, M.; Basagaña, X.; Aguilera, I.; Foraster, M.; Agis, D.; de Groot, E.; Perez, L.; Mendez, M.A.; Bouso, L.; Targa, J.; et al. Association between long-term exposure to traffic-related air pollution and subclinical atherosclerosis: The REGICOR study. Environ. Health Perspect. 2013, 121, 223–230. [Google Scholar] [PubMed]
  61. Armijos, R.X.; Weigel, M.M.; Myers, O.B.; Li, W.W.; Racines, M.; Berwick, M. Residential exposure to urban traffic is associated with increased carotid intima-media thickness in children. J. Environ. Public Health 2015. [Google Scholar] [CrossRef] [PubMed]
  62. Bassett, C.M.; McCullough, R.S.; Edel, A.L.; Maddaford, T.G.; Dibrov, E.; Blackwood, D.P.; Austria, J.A.; Pierce, G.N. Trans-fatty acids in the diet stimulate atherosclerosis. Metabolism 2009, 58, 1802–1808. [Google Scholar] [CrossRef] [PubMed]

Share and Cite

MDPI and ACS Style

Liu, X.; Lian, H.; Ruan, Y.; Liang, R.; Zhao, X.; Routledge, M.; Fan, Z. Association of Exposure to Particular Matter and Carotid Intima-Media Thickness: A Systematic Review and Meta-Analysis. Int. J. Environ. Res. Public Health 2015, 12, 12924-12940. https://doi.org/10.3390/ijerph121012924

AMA Style

Liu X, Lian H, Ruan Y, Liang R, Zhao X, Routledge M, Fan Z. Association of Exposure to Particular Matter and Carotid Intima-Media Thickness: A Systematic Review and Meta-Analysis. International Journal of Environmental Research and Public Health. 2015; 12(10):12924-12940. https://doi.org/10.3390/ijerph121012924

Chicago/Turabian Style

Liu, Xiaole, Hui Lian, Yanping Ruan, Ruijuan Liang, Xiaoyi Zhao, Michael Routledge, and Zhongjie Fan. 2015. "Association of Exposure to Particular Matter and Carotid Intima-Media Thickness: A Systematic Review and Meta-Analysis" International Journal of Environmental Research and Public Health 12, no. 10: 12924-12940. https://doi.org/10.3390/ijerph121012924

APA Style

Liu, X., Lian, H., Ruan, Y., Liang, R., Zhao, X., Routledge, M., & Fan, Z. (2015). Association of Exposure to Particular Matter and Carotid Intima-Media Thickness: A Systematic Review and Meta-Analysis. International Journal of Environmental Research and Public Health, 12(10), 12924-12940. https://doi.org/10.3390/ijerph121012924

Article Metrics

Back to TopTop