Next Article in Journal
Association between Precipitation and Diarrheal Disease in Mozambique
Next Article in Special Issue
Assessment of Impacts of Coal Mining in the Region of Sydney, Australia on the Aquatic Environment Using Macroinvertebrates and Chlorophyll as Indicators
Previous Article in Journal
Are Bank Employees Stressed? Job Perception and Positivity in the Banking Sector: An Italian Observational Study
Previous Article in Special Issue
Antibiotics in Crab Ponds of Lake Guchenghu Basin, China: Occurrence, Temporal Variations, and Ecological Risks
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 15
Issue 4
10.3390/ijerph15040708
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Abundances of Clinically Relevant Antibiotic Resistance Genes and Bacterial Community Diversity in the Weihe River, China

by
Xiaojuan Wang
,
Jie Gu
*,
Hua Gao
,
Xun Qian
and
Haichao Li
College of Natural Resources and Environment, Agriculture Key Laboratory of Plant Nutrition and Agri-Environment in Northwest China, Northwest A&F University, Yangling 712100, China
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2018, 15(4), 708; https://doi.org/10.3390/ijerph15040708
Submission received: 3 February 2018 / Revised: 30 March 2018 / Accepted: 7 April 2018 / Published: 10 April 2018
(This article belongs to the Special Issue Aquatic Ecosystem Health)
Browse Figures
Versions Notes

Abstract

:
The spread of antibiotic resistance genes in river systems is an emerging environmental issue due to their potential threat to aquatic ecosystems and public health. In this study, we used droplet digital polymerase chain reaction (ddPCR) to evaluate pollution with clinically relevant antibiotic resistance genes (ARGs) at 13 monitoring sites along the main stream of the Weihe River in China. Six clinically relevant ARGs and a class I integron-integrase (intI1) gene were analyzed using ddPCR, and the bacterial community was evaluated based on the bacterial 16S rRNA V3–V4 regions using MiSeq sequencing. The results indicated Proteobacteria, Actinobacteria, Cyanobacteria, and Bacteroidetes as the dominant phyla in the water samples from the Weihe River. Higher abundances of blaTEM, strB, aadA, and intI1 genes (103 to 105 copies/mL) were detected in the surface water samples compared with the relatively low abundances of strA, mecA, and vanA genes (0–1.94 copies/mL). Eight bacterial genera were identified as possible hosts of the intI1 gene and three ARGs (strA, strB, and aadA) based on network analysis. The results suggested that the bacterial community structure and horizontal gene transfer were associated with the variations in ARGs.

Graphical Abstract

1. Introduction

In recent years, antibiotic resistance genes (ARGs) have been recognized as emerging environmental contaminants due to the overuse and misuse of antibiotics in medical, veterinary and agricultural applications [1,2]. ARGs can be widely diffused among different bacterial species in the environment through horizontal gene transfer (HGT) [3,4,5] and ARGs circulating in the environment can significantly affect microbial population dynamics, and pose potential threats to public health through the food chain [6,7]. In addition, HGT may facilitate the transfer of ARGs from non-pathogens to human pathogens when both coexist in the environment, thereby causing antibiotic resistance and the subsequent failure of infectious disease treatments [6,8]. Most ARGs are located on mobile genetic elements such as plasmids and transposons [5,9]. Integrons are involved with the transfer of ARGs between different bacterial species due to their association with plasmids [10]. Therefore, integrons play an important role in the dynamics of antibiotic resistance. Among the three major integrons (classes 1, 2, and 3) [10], the class I integron-integrase (intI1) genes are the most common gene capture and transmission system in clinical and environmental isolates [11]. Recently, the intI1 gene was selected as a generic marker for evaluating anthropogenic pollutants because of its common association with antibiotic resistance in both pathogenic and non-pathogenic bacteria [3,12].
Streams and rivers are important for human culture, welfare, and development, but they are also a key route for the dissemination of ARGs [13]. Various antibiotics are used extensively for clinical treatments or on farms in China, which may induce antibiotic resistance in bacterial pathogens [2]. Therefore, the surveillance of ARGs in surface rivers is critically important for ensuring water quality and public health [14]. Among the ARGs identified in previous studies, those related to sulfonamide and tetracycline resistance are the most common in Chinese aquatic environments, followed by β-lactam ARGs [11,14,15,16].
Studies have detected ARGs in surface river systems but most of these previous studies focused on cultivable bacteria [17,18]. Current molecular approaches such as the polymerase chain reaction (PCR) and real-time quantitative PCR (qPCR) are faster, and they can alleviate the main problems related to culture-based methods, which are used most often for detecting ARGs in aquatic environments [19,20,21]. However, standardization based on reference materials limits the application of qPCR for detecting ARGs in environmental samples [22]. Furthermore, qPCR is susceptible to inhibition by common constituents found in environmental samples, such as humic and fulvic acids, which are major inhibitory substances [23,24]. Recently, droplet digital PCR (ddPCR) has been developed based on partitioning (to mimic limiting dilution) and Poisson statistics, which overcomes the potential limitations of qPCR [25]. The major advantages of ddPCR compared with conventional qPCR include the simple experimental procedure employed and the high sensitivity at detecting trace DNA in samples. Dilution curves and PCR efficiency calculations for DNA standards are not required for absolute quantification [26]. In addition, ddPCR is more accurate than qPCR for nucleic acid detection because it allows absolute quantification of nucleic acids in samples without the need for external calibrators. Recently, ddPCR has been successfully applied in DNA assays using environmental samples, such as for ARGs in soils and organic residues [23], fecal indicators in water [22], and Escherichia coli in bovine feces [27].
The Yellow River is the second longest river in China and it has experienced severe loading with pollutants during recent decades [28]. The Weihe River is the largest tributary of the Yellow River and it is located in north-west China (Figure 1). The Weihe River is known as the “Mother River” of the Guanzhong region and it plays important roles in the social, ecological, and economic development of Shaanxi Province. In Shaanxi Province, about 64% of the population, 56% of the farmland, 72% of the irrigation area, and 82% of the total industrial output value are found in the Weihe River area [29]. This area receives large amounts of sewage effluent and animal waste discharges, which may contain various antibiotics and antibiotic-resistant bacteria. According to survey data from the Shaanxi Provincial Environmental Protection Bureau, 245 sewage discharge points are distributed on both sides of the Weihe River and more than 700 million tons of sewage are discharged into the river annually [30]. Thus, contamination by ARGs, especially those that are clinically relevant, is a severe challenge that affects water quality and public health in the Weihe River area. The distributions of clinically relevant ARGs in the Weihe River and the diversity of the bacterial community have not been evaluated previously.
In this study, we evaluated clinically relevant ARGs in the Weihe River using ddPCR, i.e., two β-lactam resistance genes (blaTEM and mecA), one vancomycin resistance gene (vanA), three streptomycin resistance genes (strA, strB, and aadA), one integron-integrase gene (intI1), and the 16S rRNA gene. The bacterial community was analyzed based on the 16S rDNA V3–V4 regions using MiSeq sequencing. The aims of this study were to evaluate the levels of pollution by clinically relevant ARGs and the spatial variation in the bacterial community in the Weihe River. The results of this study may allow the identification of potential factors related to the spatial distribution of ARGs in the Weihe River as well as clarifying the relationships between ARGs, bacterial communities, and environmental factors. To the best of our knowledge, this is the first study to investigate clinically relevant ARGs in water samples using ddPCR.

2. Materials and Methods

2.1. Sampling Sites and Sample Collection

Water samples were collected from 13 monitoring stations along the main stream of the Weihe River during November 2015 (Supplementary Materials, Table S1). Figure 1 shows the 13 monitoring sites along the main stream of the Weihe River in Shaanxi province. Four cities are located along the main stream from west to east, i.e., Baoji, Xianyang, Xi’an and Weinan. Xi’an City is the capital of Shaanxi Province and it had a total population of 8.5 million in 2010. Xi’an City is one of the cradles of ancient Chinese civilization in the Yellow River Basin and the starting point of the Silk Road [29]. Samples were collected along the Weihe River (Shaanxi section) in the western part (sampling sites S1–S4), middle part (S5–S10), and eastern part (S11–S13). Seven sites (S2–S3, and S8–S12) were located in urban areas and six sites (S1, S4–S7, and S13) were located in rural areas. The water samples were collected aseptically from 10–20 cm below the surface in sterile polyethylene bottles (1000 mL). The electrical conductivity, temperature, pH and dissolved oxygen content were measured onsite at each sampling point using a calibrated HACH HQ30d system (HACH, Loveland, CO, USA). Three bottles were sampled from each site and they were then returned to the laboratory in a portable icebox and processed within 24 h for further analyses.

2.2. Water Sample Processing and Genomic DNA Extraction

Each water sample (1000 mL) was filtered through a porous mixed cellulose ester filter membrane (pore size = 0.22 μm) to collect cell pellets. The membrane filter was then cut into small pieces and mixed with 50% ethanol for fixation. All of the fixed samples were stored at −20 °C before subsequent DNA extraction. Total genomic DNA was extracted from the pieces of membrane using an E.Z.N.A. Water DNA kit (Omega, Biotech, Norcross, GA, USA) according to the manufacturer’s protocol. The concentration and purity of DNA were determined using an Epoch™ Multi-Volume Spectrophotometer System (Epoch, BioTek, Winooski, VT, USA) and the DNA samples were stored at −80 °C until their analysis.

2.3. Quantification of Antibiotic Resistance Genes (ARGs) Using Droplet Digital Polymerase Chain Reaction (ddPCR)

ddPCR was performed using a QX200™ Droplet Digital™ PCR system (Bio-Rad, Foster City, CA, USA). The reactions were conducted in a final volume of 20 μL containing 10 μL of 2× ddPCR Supermix for probes, 1 μL of primers and probes (final concentration of 900 nM for each primer and 250 nM for each probe), and 1 μL of the sample DNA. The primers and probes used in this study are shown in Supplementary Materials Table S2 [31,32,33,34,35]. The reaction mixtures were equilibrated to room temperature for 3 min before loading into a DG8TM cartridge for droplet formation with a QX200 droplet generator (Bio-Rad, Foster City, CA, USA) according to the manufacturer’s instructions. The droplets obtained were transferred onto a 96-well PCR plate (Eppendorf AG, Hamburg, Germany) and heat-sealed at 180 °C for 5 s with a foil plate seal (Eppendorf AG, Hamburg, Germany). Thermal cycling was performed using a ProFlexTM PCR system (Applied Biosystems, Carlsbad, CA, USA) with the following program: 95 °C for 5 min, 40 cycles at 94 °C for 30 s and 60 °C for 60 s, followed by 98 °C for 10 min, with a ramp rate of 2 °C/s. After PCR, the plate was transferred to a QX200 droplet reader (Bio-Rad, Foster City, CA, USA) for data acquisition. The fluorescence of each droplet was recorded in each well and automatically analyzed using QuantaSoft™ Software 1.7.4.0917.

2.4. Illumina High-Throughput Sequencing

The extracted DNA samples were sent to the Beijing Center for Physical and Chemical Analysis (Beijing, China) for PCR amplification of the bacterial 16S rRNA gene and high-throughput sequencing. The 16S V3–V4 region was amplified using the primer pairs 341F (5′-CCTACGGGNGGCWGCAG-3′) and 805R (5′-GACTACHVGGGTATCTAATCC-3′) with different barcodes. All of the PCR products were then sequenced using the Illumina MiSeq platform (Illumina, San Diego, CA, USA). The raw reads were deposited in the National Center for Biotechnology Information (NCBI) Sequence Read Archive database (accession number SRP099541).
The sequences obtained from each sample were processed using the QIIME software package 1.6.0 [36]. After sequencing, the raw fastq files were demultiplexed and quality filtered. The reads were then merged in pairs into a new read based on their overlap using Fast Length Adjustment of SHort reads (FLASH, version 1.2.7, http://ccb.jhu.edu/software/FLASH/). The clean tags were checked and removed after testing for the presence of chimeras using UCHIME [37]. Next, the high-quality sequences were assigned to generate operational taxonomic units (OTUs) at 97% similarity with Usearch (version 7.1, http://drive5.com/uparse). Taxonomic assignments were then made for the sequences based on the Greengenes database using the RDP classifier (Version 2.2, http://sourceforge.net/projects/rdp-classifier/) [38]. The distributions of phyla in the 13 water samples were visualized using Circos (Version 0.67, http://circos.ca/). Subsequently, alpha and beta diversity analyses were both conducted with the mothur pipeline.

2.5. Statistical Analysis

The Pearson’s correlation coefficients were calculated in order to evaluate any significant correlations among the ARGs, bacterial community, and environmental parameters using R (version 3.3.1; stats package,). Redundancy analysis (RDA) was conducted using the vegan package in R. Network analysis was performed based on the Spearman’s correlation coefficients by Cytoscope 3.4.0 [39].

3. Results

3.1. Distributions of ARGs and the intI1 Gene

Figure 2 summarizes the absolute abundances of these genes detected at all the sampling sites. The total copy numbers of bacterial 16S rRNA genes in the surface water samples were quantified by normalization and they ranged from 4.38 × 104 to 4.32 × 105 copies/mL. Higher abundances of the blaTEM, strB, aadA, and intI1 genes (103–105 copies/mL) was identified in the surface water samples compared with the relatively low abundances of the strA, mecA, and vanA genes (0–1.94 copies/mL) (Figure 2), thereby suggesting high-level contamination with β-lactam and streptomycin resistance genes. Spatially, the absolute abundances of blaTEM gene were 122 and 102 times higher in the S9 (2.76 × 104 copies/mL) and S10 (2.32 × 104 copies/mL) samples than the S1 sample (p < 0.01, by Student’s t-test). Among the six ARGs detected, the strB gene was most abundant (1.32 × 105 copies/mL) in the S2 sample (p < 0.01, by Student’s t-test), followed by the S10, S3, and S4 samples. The absolute abundances of the aadA gene were also significantly higher in the S4, S9, and S10 samples (3.94 × 104, 3.31 × 104, and 3.64 × 104 copies/mL, respectively) compared with the S1 sample (p < 0.01, by Student’s t-test). The intI1 gene was detected in all of the water samples (2.68 × 103–1.20 × 105 copies/mL) (Figure 2).
Figure S1 shows the distributions of the total relative abundances of ARGs and the intI1 gene in the Weihe River, where the absolute abundances were normalized against the bacterial 16S rRNA gene copy number in the same sample in order to avoid underestimating the abundances due to the presence of eukaryotic DNA (i.e., protozoa, fungi, and algae). Spatially, the total relative abundances of the ARGs and the intI1 gene were higher in the samples from Baoji urban district (S2, S3, and S4) than those from the other sites. The highest relative abundances of strB and intI1 were found in S2 and S3, whereas the lowest were detected in S7. However, the total relative abundances of ARGs and intI1 were relatively high at the sites ranging from S9 to S12 (Supplementary Materials Figure S1).

3.2. Microbial Diversity and Community Composition

In this study, after filtering the low-quality reads and trimming the chimeras, we obtained 20,520–206,956 high-quality tags from the 13 water samples using MiSeq sequencing (Supplementary Materials Table S3). According to the sequencing results, the numbers of OTUs ranged from 974 to 1849 in the 13 samples. Further analysis showed that 1083 shared OTUs collected at all sites from Baoji to Weinan, whereas 219, 276, and 278 OTUs were found only in Baoji, Xianyang and Xi’an, and Weinan, respectively (Supplementary Materials Figure S2), thereby suggesting that many of the same species were present in all 13 samples, but some unique species were also found in particular regions of the Weihe River.
All of the effective sequences from each sample were further assigned to their corresponding taxonomic levels (from phylum to genus). The phylum distributions were visualized using Circos. As shown in Figure 3, Proteobacteria was the most abundant phylum in the 13 samples, where it accounted for 27.4–71.4% of the total effective sequences in different water samples. The other dominant phyla comprised Actinobacteria (9.3–30.6%), Cyanobacteria (3.7–29.5%), Bacteroidetes (6.4–23.7%), Firmicutes (0.56–7.1%), and Verrucomicrobia (0.25–5.5%). Spatially, Proteobacteria was clearly the most abundant phylum in S2, whereas Cyanobacteria was the least abundant. It should be noted that the phylum Firmicutes was more abundant at S2 than the other samples. The results obtained at the class, order and family levels showed that Epsilonproteobacteria, Campylobacterales, and Campylobacteraceae were the most abundant in the S2 bacterial community, respectively (Figure S3). Furthermore, we selected the top 35 dominant genera in the 13 samples and used them to prepare a heatmap (Figure 4). We found that Cloacibacterium, Faecalibacterium, Acinetobacter, Roseburia, Bacteroides, Arcobacter, Acidovorax, Tolumonas, and Sulfurospirillum (in the phyla Proteobacteria, Firmicutes and Bacteroidetes) were the dominant genera in S2. In particular the genera Arcobacter and Acinetobacter from the phylum Proteobacteria were the two most abundant genera in the S2 sample, where they accounted for 42.5% and 6.7% of the total effective sequences, respectively. These results indicate that the bacterial composition in S2 differed significantly from those in the other samples.

3.3. Relationships between ARGs, Bacterial Communities, and Environmental Factors

We employed RDA to investigate the relationships between the ARGs, bacterial communities, and environmental factors (electrical conductivity, temperature, pH and dissolved oxygen) in the water samples (Supplementary Materials Table S4). RDA analysis showed that the bacterial community and selected environmental factors explained 84.3% of the total variance in the ARGs (Figure 5). Clearly, the ARG profile for the S2 sample differed significantly from those of the other samples. In addition, the positive correlations between the phyla Proteobacteria and Firmicutes with the strB and intI1 genes demonstrate that these phyla were the major factors responsible for driving the ARG distribution in S2 (Supplementary Materials Table S5). Similar to the microbial community compositions (Figure 4), the ARG profiles were clustered in S3 and S4, and they were positively associated with the phylum Bacteroidetes (Figure 5). According to the RDA results, the ARG profiles varied little between some of the water samples. For example, S1 was clustered with S8–S10 and S12–S13, whereas S11 was clustered with S5–S7.

3.4. Network Analysis Based on the intI1 Gene, ARGs, and Bacterial Taxa

The potential host bacteria for ARGs were identified using network analysis (Figure 6), which identified eight bacterial genera as possible hosts of the intI1 gene and three ARGs (strA, strB, and aadA). Network analysis showed that 62.5% of the potential hosts for intI1 and ARGs were Proteobacteria. Lactococcus and Bacillus were possible hosts of the streptomycin resistance gene strA, whereas Cloacibacterium could host the streptomycin resistance gene strB. In addition, the streptomycin resistance gene aadA was carried mainly by Hydrogenophaga and Polynucleobacter. The significant positive correlations between the intI1 gene and the genera Acidovorax, Cloacibacterium, Sulfurospirillum, and Tolumonus suggest that these genera could have been hosts of the intI1 gene. However, compared with the genes mentioned above, the intI1 gene was carried by more diverse genera, thereby indicating that the intI1 gene had a broader host range.

4. Discussion

4.1. Prevalence of the intI1 Gene and ARGs in Urban Districts

In this study, we detected two β-lactam resistance genes (blaTEM and mecA), one vancomycin resistance gene (vanA), three streptomycin resistance genes (strA, strB, and aadA), one integron-integrase gene (intI1), and the 16S rRNA gene in water samples from the Weihe River, Shaanxi, China using ddPCR. The intI1 gene was detected in all of the water samples, which is consistent with the high levels found previously in urban rivers in Beijing and the Haihe River [14,40]. It has been reported that the abundance of the intI1 gene is correlated with the levels of the blaTEM and aadA genes [10,41], which was supported by our results (Supplementary Materials Table S6). Thus, the dissemination of the blaTEM and aadA genes may be facilitated by the intI1 gene, and HGT might explain the variations in the β-lactam and streptomycin resistance genes in the Weihe River. Furthermore, the intI1 gene had a broader host range in Weihe River (Figure 6), thereby suggesting that HGT between bacterial hosts is a key factor responsible for the variations in ARGs in the Weihe River. Similar results were obtained in previous studies, which showed that class I integrons play important roles in the dissemination of ARGs in human-impacted aquatic environments [42].
In general, the blaTEM gene is one of the most common antimicrobial resistance genes transferred by plasmids. The blaTEM gene confers resistance to penicillins, cephalosporins and carbapenems, which account for approximately two-thirds by weight of the antibiotics consumed by humans [31,43]. The strA, strB and aadA genes are associated with resistance to streptomycin, which is one of the first-line antibiotics used for tuberculosis treatment. Streptomycin is still utilized widely in China. In addition, it has been used as an important agricultural bactericide since the late 1950s in both animal husbandry and plant disease control [44]. Therefore, agricultural pollution and discharges from fisheries may be the main sources of the high levels of the strB and aadA genes in the Weihe River. It should be noted that the absolute and relative abundances of the strB gene were significantly higher in our samples compared with those of strA (p < 0.01) (Figure 2), possibly because the abundances of the bacteria associated with the strB gene were higher in the Weihe River. This finding agrees with those obtained in a recent study, which showed that most streptomycin-resistant bacteria harbored the strB gene but not the strA gene [45].

4.2. Bacterial Community Diversity

Many previous studies have shown that Proteobacteria, Actinobacteria and Bacteroidetes are the most abundant bacterial phyla found in the communities in river water samples [46,47,48]. Similarly, we found that Proteobacteria, Actinobacteria, Cyanobacteria and Bacteroidetes were the most abundant phyla in the Weihe River using culture-independent methods based on 16S rRNA gene sequencing (Supplementary Materials Figure S3). The high-throughput sequencing results indicated that the bacterial composition of S2 differed significantly from those of the other samples, where Epsilonproteobacteria, Campylobacterales, Campylobacteraceae, and the genera Arcobacter and Acinetobacter, dominated the bacterial community. A previous study demonstrated that Campylobacteraceae (Epsilonproteobacteria) was the most abundant bacterial family in both treated and untreated wastewaters [49]. According to Li et al. [50], Epsilonproteobacteria might be specifically associated with antibiotic-containing aquatic environments. In addition, the genus Arcobacter includes both animal and human pathogens, which are found mainly in manure derived from animal livestock [51,52]. Several Arcobacter species in the phylum Epsilonproteobacteria are related to human infections and they often exhibit multi-drug resistance [53]. A previous study showed that Acinetobacter spp. are nosocomial pathogens with a higher frequency in wastewater than river water, thereby suggesting that the discharge of effluent wastewater can change the distribution of Acinetobacter spp. in the receiving water [54]. Thus, animal and human wastewaters along the Weihe River were probably the most important sources of the genera Arcobacter and Acinetobacter. The highest relative abundances of the intI1 gene and ARGs were also detected in S2 (Supplementary Materials Figure S1), which was located near large-scale livestock and poultry farms, which indicates that anthropogenic activities may have caused changes in the bacterial community and increased the abundances of ARGs.

4.3. Relationships between ARGs, Bacterial Communities, and Environmental Factors

The emergence and proliferation of ARGs are closely associated with the composition of the microbial community and environmental factors [55,56]. In the present study, RDA analysis showed that the bacterial community and selected environmental factors explained 84.3% of the total variance in the ARGs (Figure 5), but no significant correlations were found between the ARGs and environmental factors (Supplementary Materials Table S7). Therefore, compared with the environmental factors, the bacterial communities probably made the largest contribution to the dynamic changes in ARGs, as also concluded in a previous study [57] where the bacterial community was the major factor responsible for driving the ARG distribution in aquatic environments.
In order to understand the detailed relationships between specific ARGs and bacteria, we identified the potential host bacteria for ARGs using network analysis. Some of our results were consistent with those obtained in previous studies of antibiotic resistance. For example, Lactococcus and Hydrogenophaga strains were previously shown to exhibit resistance to streptomycin [58,59], and the strA gene was detected at a high frequency in Bacillus strains isolated from the influent samples in wastewater treatment processes [59]. Network analysis is a reasonable and powerful tool for obtaining new insights into the distributions of ARGs and their possible hosts in complex environmental samples [60], and it should be noted that some of the suggested hosts shown in Figure 6 were determined for the first time in the present study. Therefore, additional research is required to isolate the bacterial hosts of ARGs in various environments [39] and the relationships identified by network analysis should also be validated using other approaches.

5. Conclusions

β-lactam (blaTEM) and streptomycin (strB and aadA) resistance genes were highly prevalent in the Weihe River, where the highest relative abundances of the intI1 gene and ARGs were detected in Baoji urban district. The bacterial community exhibited spatial variation along the Weihe River basin, and the bacterial composition of the samples from Baoji urban district differed significantly from those of the other samples. Our results also suggest that the bacterial communities and HGT explained most of the variations in ARGs.

Supplementary Materials

The following are available online at https://www.mdpi.com/1660-4601/15/4/708/s1. Figure S1: Total relative abundances of ARGs and intI1 in water samples collected from the Weihe River; Figure S2: Venn diagrams showing the shared and distinct operational taxonomic units (OTUs) in different sites; Figure S3: Distributions of the relative abundances of the 10 most abundant bacteria in the 13 samples at different levels: (a) phylum level; (b) class level; (c) order level; and (d) family level; Table S1: Descriptions of the sampling sites; Table S2: Primers and probes for the detection of clinically relevant antibiotic genes in this study; Table S3: Raw and clean tags, OTUs, Good’s coverage, and Shannon, Chao1, ACE, and Simpson’s indices for the 13 water samples; Table S4: Environmental factors used for redundancy analysis; Table S5: Pearson’s correlation coefficients between genes and the main bacterial phyla. * Significantly different at p < 0.05. ** Significantly different at p < 0.01; Table S6: Pearson’s correlation coefficients between the relative abundances of ARGs and the intI1 gene. * Significantly different at p < 0.05; Table S7: Pearson’s correlation coefficients between genes and environmental factors. * Significantly different at p < 0.05.

Acknowledgments

This study was supported by the National Natural Scientific Foundation of China (NSFC: 41601531; 41671474). We would like to thank Duncan E. Jackson for critically reading and editing this manuscript.

Author Contributions

Jie Gu conceived the experiments; Xiaojuan Wang performed the experiments, analyzed the data, and wrote the paper; Hua Gao, Xun Qian and Haichao Li participated in sample collection.

Conflicts of Interest

The authors have no conflicts of interest to declare.

References

  1. Pruden, A.; Pei, R.T.; Storteboom, H.; Carlson, K.H. Antibiotic resistance genes as emerging contaminants: Studies in northern Colorado. Environ. Sci. Technol. 2006, 40, 7445–7450. [Google Scholar] [CrossRef] [PubMed]
  2. Zhu, Y.-G.; Johnson, T.A.; Su, J.-Q.; Qiao, M.; Guo, G.-X.; Stedtfeld, R.D.; Hashsham, S.A.; Tiedje, J.M. Diverse and abundant antibiotic resistance genes in Chinese swine farms. Proc. Natl. Acad. Sci. USA 2013, 110, 3435–3440. [Google Scholar] [CrossRef] [PubMed]
  3. Gillings, M.R.; Gaze, W.H.; Pruden, A.; Smalla, K.; Tiedje, J.M.; Zhu, Y.G. Using the class 1 integron-integrase gene as a proxy for anthropogenic pollution. ISME J. 2015, 9, 1269–1279. [Google Scholar] [CrossRef] [PubMed]
  4. Stecher, B.; Maier, L.; Hardt, W.-D. ‘Blooming’ in the gut: How dysbiosis might contribute to pathogen evolution. Nat. Rev. Microbiol. 2013, 11, 277–284. [Google Scholar] [CrossRef] [PubMed]
  5. Zhang, T.; Zhang, X.-X.; Ye, L. Plasmid metagenome reveals high levels of antibiotic resistance genes and mobile genetic elements in activated sludge. PLoS ONE 2011, 6, e26041. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Martinez, J.L. Antibiotics and antibiotic resistance genes in natural environments. Science 2008, 321, 365–367. [Google Scholar] [CrossRef] [PubMed]
  7. Van den Bogaard, A.E.; Stobberingh, E.E. Epidemiology of resistance to antibiotics—Links between animals and humans. Int. J. Antimicrob. Agents 2000, 14, 327–335. [Google Scholar] [CrossRef]
  8. Venturini, C.; Beatson, S.A.; Djordjevic, S.P.; Walker, M.J. Multiple antibiotic resistance gene recruitment onto the enterohemorrhagic Escherichia coli virulence plasmid. FASEB J. 2010, 24, 1160–1166. [Google Scholar] [CrossRef] [PubMed]
  9. Stokes, H.W.; Gillings, M.R. Gene flow, mobile genetic elements and the recruitment of antibiotic resistance genes into Gram-negative pathogens. FEMS Microbiol. Rev. 2011, 35, 790–819. [Google Scholar] [CrossRef] [PubMed]
  10. Su, H.-C.; Ying, G.-G.; Tao, R.; Zhang, R.-Q.; Zhao, J.-L.; Liu, Y.-S. Class 1 and 2 integrons, sul resistance genes and antibiotic resistance in Escherichia coli isolated from Dongjiang River, South China. Environ. Pollut. 2012, 169, 42–49. [Google Scholar] [CrossRef] [PubMed]
  11. Lin, L.; Yuan, K.; Liang, X.M.; Chen, X.; Zhao, Z.S.; Yang, Y.; Zou, S.C.; Luan, T.G.; Chen, B.W. Occurrences and distribution of sulfonamide and tetracycline resistance genes in the Yangtze River Estuary and nearby coastal area. Mar. Pollut. Bull. 2015, 100, 304–310. [Google Scholar] [CrossRef] [PubMed]
  12. Ma, L.; Li, A.-D.; Yin, X.-L.; Zhang, T. The prevalence of integrons as the carrier of antibiotic resistance genes in natural and man-made environments. Environ. Sci. Technol. 2017, 51, 5721–5728. [Google Scholar] [CrossRef] [PubMed]
  13. Pruden, A.; Arabi, M.; Storteboom, H.N. Correlation between upstream human activities and riverine antibiotic resistance genes. Environ. Sci. Technol. 2012, 46, 11541–11549. [Google Scholar] [CrossRef] [PubMed]
  14. Xu, Y.; Guo, C.; Luo, Y.; Lv, J.; Zhang, Y.; Lin, H.; Wang, L.; Xu, J. Occurrence and distribution of antibiotics, antibiotic resistance genes in the urban rivers in Beijing, China. Environ. Pollut. 2016, 213, 833–840. [Google Scholar] [CrossRef] [PubMed]
  15. Jiang, L.; Hu, X.; Xu, T.; Zhang, H.; Sheng, D.; Yin, D. Prevalence of antibiotic resistance genes and their relationship with antibiotics in the Huangpu River and the drinking water sources, Shanghai, China. Sci. Total Environ. 2013, 458, 267–272. [Google Scholar] [CrossRef] [PubMed]
  16. Niu, Z.G.; Zhang, K.; Zhang, Y. Occurrence and distribution of antibiotic resistance genes in the coastal area of the Bohai Bay, China. Mar. Pollut. Bull. 2016, 107, 245–250. [Google Scholar] [CrossRef] [PubMed]
  17. Tao, R.; Ying, G.-G.; Su, H.-C.; Zhou, H.-W.; Sidhu, J.P.S. Detection of antibiotic resistance and tetracycline resistance genes in Enterobacteriaceae isolated from the Pearl rivers in South China. Environ. Pollut. 2010, 158, 2101–2109. [Google Scholar] [CrossRef] [PubMed]
  18. Hu, J.; Shi, J.; Chang, H.; Li, D.; Yang, M.; Kamagata, Y. Phenotyping and genotyping of antibiotic-resistant Escherichia coli isolated from a natural river basin. Environ. Sci. Technol. 2008, 42, 3415–3420. [Google Scholar] [CrossRef] [PubMed]
  19. Rodriguez-Mozaz, S.; Chamorro, S.; Marti, E.; Huerta, B.; Gros, M.; Sanchez-Melsio, A.; Borrego, C.M.; Barcelo, D.; Balcazar, J.L. Occurrence of antibiotics and antibiotic resistance genes in hospital and urban wastewaters and their impact on the receiving river. Water Res. 2015, 69, 234–242. [Google Scholar] [CrossRef] [PubMed]
  20. Yu, Z.F.; He, P.J.; Shao, L.M.; Zhang, H.; Lu, F. Co-occurrence of mobile genetic elements and antibiotic resistance genes in municipal solid waste landfill leachates: A preliminary insight into the role of landfill age. Water Res. 2016, 106, 583–592. [Google Scholar] [CrossRef] [PubMed]
  21. LaPara, T.M.; Burch, T.R.; McNamara, P.J.; Tan, D.T.; Yan, M.; Eichmiller, J.J. Tertiary-treated municipal wastewater is a significant point source of antibiotic resistance genes into Duluth-Superior Harbor. Environ. Sci. Technol. 2011, 45, 9543–9549. [Google Scholar] [CrossRef] [PubMed]
  22. Cao, Y.P.; Raith, M.R.; Griffith, J.F. Droplet digital PCR for simultaneous quantification of general and human-associated fecal indicators for water quality assessment. Water Res. 2015, 70, 337–349. [Google Scholar] [CrossRef] [PubMed]
  23. Cave, L.; Brothier, E.; Abrouk, D.; Bouda, P.S.; Hien, E.; Nazaret, S. Efficiency and sensitivity of the digital droplet PCR for the quantification of antibiotic resistance genes in soils and organic residues. Appl. Microbiol. Biotechnol. 2016, 100, 10597–10608. [Google Scholar] [CrossRef] [PubMed]
  24. Cao, Y.; Griffith, J.F.; Dorevitch, S.; Weisberg, S.B. Effectiveness of qPCR permutations, internal controls and dilution as means for minimizing the impact of inhibition while measuring Enterococcus in environmental waters. J. Appl. Microbiol. 2012, 113, 66–75. [Google Scholar] [CrossRef] [PubMed]
  25. Huggett, J.F.; Foy, C.A.; Benes, V.; Emslie, K.; Garson, J.A.; Haynes, R.; Hellemans, J.; Kubista, M.; Nolan, R.; Pfaffl, M.W.; et al. The digital MIQE guidelines: Minimum information for publication of quantitative digital PCR experiments. Clin. Chem. 2013, 59, 892–902. [Google Scholar] [CrossRef] [PubMed]
  26. Jahn, M.; Vorpahl, C.; Turkowsky, D.; Lindmeyer, M.; Buhler, B.; Harms, H.; Muller, S. Accurate determination of plasmid copy number of flow-sorted cells using droplet digital PCR. Anal. Chem. 2014, 86, 5969–5976. [Google Scholar] [CrossRef] [PubMed]
  27. Verhaegen, B.; De Reu, K.; De Zutter, L.; Verstraete, K.; Heyndrickx, M.; Van Coillie, E. Comparison of droplet digital PCR and qPCR for the quantification of shiga toxin-producing Escherichia coli in bovine feces. Toxins 2016, 8, 157. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Wang, S.J.; Lu, A.G.; Dang, S.H.; Chen, F.L. Ammonium nitrogen concentration in the Weihe River, central China during 2005–2015. Environ. Earth Sci. 2016, 75. [Google Scholar] [CrossRef]
  29. Song, J.; Cheng, D.; Li, Q.; He, X.; Long, Y.; Zhang, B. An evaluation of river health for the Weihe River in Shaanxi Province, China. Adv. Meteorol. 2015, 476020. [Google Scholar] [CrossRef]
  30. Li, Q.; Song, J.; Wei, A.; Zhang, B. Changes in major factors affecting the ecosystem health of the Weihe River in Shaanxi Province, China. Front. Environ. Sci. Eng. 2013, 7, 875–885. [Google Scholar] [CrossRef]
  31. Lachmayr, K.L.; Kerkhof, L.J.; DiRienzo, A.G.; Cavanaugh, C.M.; Ford, T.E. Quantifying nonspecific TEM beta-Lactamase (blaTEM) genes in a wastewater stream. Appl. Environ. Microbiol. 2009, 75, 203–211. [Google Scholar] [CrossRef] [PubMed]
  32. Volkmann, H.; Schwartz, T.; Bischoff, P.; Kirchen, S.; Obst, U. Detection of clinically relevant antibiotic-resistance genes in municipal wastewater using real-time PCR (TaqMan). J. Microbiol. Methods 2004, 56, 277–286. [Google Scholar] [CrossRef] [PubMed]
  33. Schmidt, G.V.; Mellerup, A.; Christiansen, L.E.; Stahl, M.; Olsen, J.E.; Angen, O. Sampling and pooling methods for capturing herd level antibiotic resistance in swine feces using qPCR and CFU approaches. PLoS ONE 2015, 10, e0131672. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Walsh, F.; Ingenfeld, A.; Zampicolli, M.; Hilber-Bodmer, M.; Frey, J.E.; Duffy, B. Real-time PCR methods for quantitative monitoring of streptomycin and tetracycline resistance genes in agricultural ecosystems. J. Microbiol. Methods 2011, 86, 150–155. [Google Scholar] [CrossRef] [PubMed]
  35. Barraud, O.; Baclet, M.C.; Denis, F.; Ploy, M.C. Quantitative multiplex real-time PCR for detecting class 1, 2 and 3 integrons. J. Antimicrob. Chemother. 2010, 65, 1642–1645. [Google Scholar] [CrossRef] [PubMed]
  36. Caporaso, J.G.; Kuczynski, J.; Stombaugh, J.; Bittinger, K.; Bushman, F.D.; Costello, E.K.; Fierer, N.; Pena, A.G.; Goodrich, J.K.; Gordon, J.I.; et al. QIIME allows analysis of high-throughput community sequencing data. Nat. Methods 2010, 7, 335–336. [Google Scholar] [CrossRef] [PubMed]
  37. Edgar, R.C.; Haas, B.J.; Clemente, J.C.; Quince, C.; Knight, R. UCHIME improves sensitivity and speed of chimera detection. Bioinformatics 2011, 27, 2194–2200. [Google Scholar] [CrossRef] [PubMed]
  38. McDonald, D.; Price, M.N.; Goodrich, J.; Nawrocki, E.P.; DeSantis, T.Z.; Probst, A.; Andersen, G.L.; Knight, R.; Hugenholtz, P. An improved Greengenes taxonomy with explicit ranks for ecological and evolutionary analyses of bacteria and archaea. ISME J. 2012, 6, 610–618. [Google Scholar] [CrossRef] [PubMed]
  39. Sun, W.; Gu, J.; Wang, X.; Qian, X.; Tuo, X. Impacts of biochar on the environmental risk of antibiotic resistance genes and mobile genetic elements during anaerobic digestion of cattle farm wastewater. Bioresour. Technol. 2018, 256, 342–349. [Google Scholar] [CrossRef] [PubMed]
  40. Luo, Y.; Mao, D.; Rysz, M.; Zhou, Q.; Zhang, H.; Xu, L.; Alvarez, P.J.J. Trends in antibiotic resistance genes occurrence in the Haihe River, China. Environ. Sci. Technol. 2010, 44, 7220–7225. [Google Scholar] [CrossRef] [PubMed]
  41. Vaz-Moreira, I.; Nunes, O.C.; Manaia, C.M. Ubiquitous and persistent Proteobacteria and other Gram-negative bacteria in drinking water. Sci. Total Environ. 2017, 586, 1141–1149. [Google Scholar] [CrossRef] [PubMed]
  42. Chen, B.; Liang, X.; Nie, X.; Huang, X.; Zou, S.; Li, X. The role of class I integrons in the dissemination of sulfonamide resistance genes in the Pearl River and Pearl River Estuary, South China. J. Hazard. Mater. 2015, 282, 61–67. [Google Scholar] [CrossRef] [PubMed]
  43. Mroczkowska, J.E.; Barlow, M. Fitness trade-offs in bla(TEM) evolution. Antimicrob. Agents Chemother. 2008, 52, 2340–2345. [Google Scholar] [CrossRef] [PubMed]
  44. Sundin, G.W.; Bender, C.L. Dissemination of the strA-strB streptomycin-resistance genes among commensal and pathogenic bacteria from humans, animals, and plants. Mol. Ecol. 1996, 5, 133–143. [Google Scholar] [CrossRef] [PubMed]
  45. Ben Salem, R.; Abbassi, M.S.; García, V.; García-Fierro, R.; Fernández, J.; Kilani, H.; Jaouani, I.; Khayeche, M.; Messadi, L.; Rodicio, M.R. Antimicrobial drug resistance and genetic properties of Salmonella enterica serotype Enteritidis circulating in chicken farms in Tunisia. J. Infect. Public Health 2017, 10, 855–860. [Google Scholar] [CrossRef] [PubMed]
  46. Liu, Z.; Huang, S.; Sun, G.; Xu, Z.; Xu, M. Phylogenetic diversity, composition and distribution of bacterioplankton community in the Dongjiang River, China. FEMS Microbiol. Ecol. 2012, 80, 30–44. [Google Scholar] [CrossRef] [PubMed]
  47. Hu, A.; Yang, X.; Chen, N.; Hou, L.; Ma, Y.; Yu, C.-P. Response of bacterial communities to environmental changes in a mesoscale subtropical watershed, Southeast China. Sci. Total Environ. 2014, 472, 746–756. [Google Scholar] [CrossRef] [PubMed]
  48. Staley, C.; Gould, T.J.; Wang, P.; Phillips, J.; Cotner, J.B.; Sadowsky, M.J. Species sorting and seasonal dynamics primarily shape bacterial communities in the Upper Mississippi River. Sci. Total Environ. 2015, 505, 435–445. [Google Scholar] [CrossRef] [PubMed]
  49. Bai, Y.; Qi, W.; Liang, J.; Qu, J. Using high-throughput sequencing to assess the impacts of treated and untreated wastewater discharge on prokaryotic communities in an urban river. Appl. Microbiol. Biotechnol. 2014, 98, 1841–1851. [Google Scholar] [CrossRef] [PubMed]
  50. Li, D.; Qi, R.; Yang, M.; Zhang, Y.; Yu, T. Bacterial community characteristics under long-term antibiotic selection pressures. Water Res. 2011, 45, 6063–6073. [Google Scholar] [CrossRef] [PubMed]
  51. Ho, H.T.K.; Lipman, L.J.A.; Gaastra, W. Arcobacter, what is known and unknown about a potential foodborne zoonotic agent! Vet. Microbiol. 2006, 115, 1–13. [Google Scholar] [CrossRef] [PubMed]
  52. Kabeya, H.; Maruyama, S.; Morita, Y.; Kubo, M.; Yamamoto, K.; Arai, S.; Izumi, T.; Kobayashi, Y.; Katsube, Y.; Mikami, T. Distribution of Arcobacter species among livestock in Japan. Vet. Microbiol. 2003, 93, 153–158. [Google Scholar] [CrossRef]
  53. Fera, M.T.; Maugeri, T.L.; Giannone, M.; Gugliandolo, C.; La Camera, E.; Blandino, G.; Carbone, M. In vitro susceptibility of Arcobacter butzleri and Arcobacter cryaerophilus to different antimicrobial agents. Int. J. Antimicrob. Agents 2003, 21, 488–491. [Google Scholar] [CrossRef]
  54. Zhang, Y.; Marrs, C.F.; Simon, C.; Xi, C. Wastewater treatment contributes to selective increase of antibiotic resistance among Acinetobacter spp. Sci. Total Environ. 2009, 407, 3702–3706. [Google Scholar] [CrossRef] [PubMed]
  55. Gao, P.; Mao, D.; Luo, Y.; Wang, L.; Xu, B.; Xu, L. Occurrence of sulfonamide and tetracycline-resistant bacteria and resistance genes in aquaculture environment. Water Res. 2012, 46, 2355–2364. [Google Scholar] [CrossRef] [PubMed]
  56. Luo, G.; Li, B.; Li, L.-G.; Zhang, T.; Angelidaki, I. Antibiotic resistance genes and correlations with microbial community and metal resistance genes in full-scale biogas reactors as revealed by metagenomic analysis. Environ. Sci. Technol. 2017, 51, 4069–4080. [Google Scholar] [CrossRef] [PubMed]
  57. Huerta, B.; Marti, E.; Gros, M.; López, P.; Pompêo, M.; Armengol, J.; Barceló, D.; Balcázar, J.L.; Rodríguez-Mozaz, S.; Marcé, R. Exploring the links between antibiotic occurrence, antibiotic resistance, and bacterial communities in water supply reservoirs. Sci. Total Environ. 2013, 456, 161–170. [Google Scholar] [CrossRef] [PubMed]
  58. Walther, C.; Rossano, A.; Thomann, A.; Perreten, V. Antibiotic resistance in Lactococcus species from bovine milk: Presence of a mutated multidrug transporter mdt(A) gene in susceptible Lactococcus garvieae strains. Vet. Microbiol. 2008, 131, 348–357. [Google Scholar] [CrossRef] [PubMed]
  59. Zhang, S.; Han, B.; Gu, J.; Wang, C.; Wang, P.; Ma, Y.; Cao, J.; He, Z. Fate of antibiotic resistant cultivable heterotrophic bacteria and antibiotic resistance genes in wastewater treatment processes. Chemosphere 2015, 135, 138–145. [Google Scholar] [CrossRef] [PubMed]
  60. Li, B.; Yang, Y.; Ma, L.P.; Ju, F.; Guo, F.; Tiedje, J.M.; Zhang, T. Metagenomic and network analysis reveal wide distribution and co-occurrence of environmental antibiotic resistance genes. ISME J. 2015, 9, 2490–2502. [Google Scholar] [CrossRef] [PubMed]
Ijerph 15 00708 g001 550
Figure 1. Locations of the sampling sites.
Figure 1. Locations of the sampling sites.
Ijerph 15 00708 g001
Ijerph 15 00708 g002 550
Figure 2. Heatmap showing the absolute abundances of antibiotic resistance genes (ARGs), intI1, and 16S rRNA genes in water samples collected from the Weihe River. Black denotes the absence of gene.
Figure 2. Heatmap showing the absolute abundances of antibiotic resistance genes (ARGs), intI1, and 16S rRNA genes in water samples collected from the Weihe River. Black denotes the absence of gene.
Ijerph 15 00708 g002
Ijerph 15 00708 g003 550
Figure 3. Distribution of phyla in the 13 water samples according to the taxonomic annotations obtained using the Greengenes database and the Ribosomal Database Project (RDP) classifier.
Figure 3. Distribution of phyla in the 13 water samples according to the taxonomic annotations obtained using the Greengenes database and the Ribosomal Database Project (RDP) classifier.
Ijerph 15 00708 g003
Ijerph 15 00708 g004 550
Figure 4. Heatmap showing the relative abundances of the 35 most abundant genera in the 13 water samples.
Figure 4. Heatmap showing the relative abundances of the 35 most abundant genera in the 13 water samples.
Ijerph 15 00708 g004
Ijerph 15 00708 g005 550
Figure 5. Redundancy analysis of the relationships between environmental factors (blue arrows), main bacterial phyla (red arrows), and ARGs and intI1 genes (green arrows).
Figure 5. Redundancy analysis of the relationships between environmental factors (blue arrows), main bacterial phyla (red arrows), and ARGs and intI1 genes (green arrows).
Ijerph 15 00708 g005
Ijerph 15 00708 g006 550
Figure 6. Network analysis showing the co-occurrence patterns based on the intI1 gene, ARGs, and bacterial taxa in the 13 water samples.
Figure 6. Network analysis showing the co-occurrence patterns based on the intI1 gene, ARGs, and bacterial taxa in the 13 water samples.
Ijerph 15 00708 g006

Share and Cite

MDPI and ACS Style

Wang, X.; Gu, J.; Gao, H.; Qian, X.; Li, H. Abundances of Clinically Relevant Antibiotic Resistance Genes and Bacterial Community Diversity in the Weihe River, China. Int. J. Environ. Res. Public Health 2018, 15, 708. https://doi.org/10.3390/ijerph15040708

AMA Style

Wang X, Gu J, Gao H, Qian X, Li H. Abundances of Clinically Relevant Antibiotic Resistance Genes and Bacterial Community Diversity in the Weihe River, China. International Journal of Environmental Research and Public Health. 2018; 15(4):708. https://doi.org/10.3390/ijerph15040708

Chicago/Turabian Style

Wang, Xiaojuan, Jie Gu, Hua Gao, Xun Qian, and Haichao Li. 2018. "Abundances of Clinically Relevant Antibiotic Resistance Genes and Bacterial Community Diversity in the Weihe River, China" International Journal of Environmental Research and Public Health 15, no. 4: 708. https://doi.org/10.3390/ijerph15040708

APA Style

Wang, X., Gu, J., Gao, H., Qian, X., & Li, H. (2018). Abundances of Clinically Relevant Antibiotic Resistance Genes and Bacterial Community Diversity in the Weihe River, China. International Journal of Environmental Research and Public Health, 15(4), 708. https://doi.org/10.3390/ijerph15040708

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop