Next Article in Journal
Etiology and Treatment of Peri-Implant Soft Tissue Dehiscences: A Narrative Review
Next Article in Special Issue
Isolation of Clinical Microbial Isolates during Orthodontic Aligner Therapy and Their Ability to Form Biofilm
Previous Article in Journal
On the Role of Dietary Nitrate in the Maintenance of Systemic and Oral Health
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Mechanistic Effects of E-Liquids on Biofilm Formation and Growth of Oral Commensal Streptococcal Communities: Effect of Flavoring Agents

by
Christina P. Xu
1,
Dominic L. Palazzolo
2 and
Giancarlo A. Cuadra
1,*
1
Biology Department, Muhlenberg College, 2400 Chew Street, Allentown, PA 18104, USA
2
Department of Physiology, DeBusk College of Ostheopathic Medicine, Lincoln Memorial University, 6965 Cumberland Gap Parkway, Harrogate, TN 37752, USA
*
Author to whom correspondence should be addressed.
Dent. J. 2022, 10(5), 85; https://doi.org/10.3390/dj10050085
Submission received: 8 March 2022 / Revised: 21 April 2022 / Accepted: 11 May 2022 / Published: 13 May 2022
(This article belongs to the Special Issue Oral Microbiology and Related Research)

Abstract

:
Background: Vaping has become a global health concern. As research continues, more studies are beginning to question the relative safety of E-liquid flavoring additives. The oral cavity is the first site of exposure to E-liquid aerosol, making it critical for investigation. Because of the importance of commensal bacterial biofilms for oral health, we sought to explore the effects of E-liquids ± flavors on the formation and growth of single- and multi-species biofilms and to investigate the mechanism of inhibition. Methods: Quantitative and confocal biofilm analysis, death curves, and colony-forming units (CFU) were evaluated with flavorless and flavored (tobacco, menthol, cinnamon, strawberry, blueberry) E-liquids using four strains of oral commensal bacteria (Streptococcus gordonii, Streptococcus intermedius, Streptococcus mitis, and Streptococcus oralis). Results: All flavoring agents show a dose-dependent inhibition in the growth of single-species and multi-species biofilms. Furthermore, CFUs, death curves, and light microscopy show that flavoring agents have a bactericidal mode of inhibition on the growth of these oral streptococci. Conclusions: These results show that flavored, rather than unflavored, E-liquids are more detrimental to biofilm formation and growth of oral commensal bacteria. Consequently, E-liquid flavorings agents could pose risks to the oral microenvironment, and by extension, to systemic health.

Graphical Abstract

1. Introduction

Electronic cigarettes (ECIGs), commonly known as vaping devices, or electronic nicotine delivery system (ENDS), were originally developed in China in 2003 and marketed towards those seeking to cease smoking [1]. As tobacco usage rates have decreased, ECIG usage rates have increased significantly, especially among adolescents [2]. ENDS are handheld devices that come in a variety of constructs, such as E-cigars, E-pipes, and E-hookahs [3]. Each device contains a rechargeable battery, a heating element with a resistance coil, and an atomizer tank or removable cartridge (e.g., pods) containing E-liquid. The E-liquid typically contains a mixture of nicotine, a myriad of flavoring agents, and the humectants vegetable glycerin (VG) and propylene glycol (PG). When the ENDS is actuated, the resistance coil is heated, and the surrounding E-liquid mixture is aerosolized. The user inhales the aerosol (i.e., vaping) in the manner of conventional cigarette smoke [4].
Many conventional smokers who want to quit have substituted traditional smoking with vaping to satisfy their nicotine urges. Smoke from conventional cigarettes is primarily hazardous because of the tar generated from combusting tobacco. Tar contains thousands of chemicals, many of which are known to be carcinogenic [1,5]. Smoke also contains nicotine, the addictive component of cigarettes. E-liquids similarly contain nicotine, but without tar. Anecdotally, many believe that vaping is a safer alternative to cigarette smoking because the nicotine addiction can still be satisfied without the perils of tar. Consequently, this harm-reduction approach to vaping is viewed by current smokers to be a useful smoking cessation option [6,7,8]. As ECIGs have become increasingly popular, they have also caught the attention of the media and health organizations, including the Office of the Surgeon General, to raise awareness about this trend which is now a public health concern.
E-liquids contain nicotine ranging from 0 to 87 mg/mL [9]. The introduction of flavoring compounds to E-liquids, which mimic fruits, desserts, candy, and beverages, has increased the usage of ECIGs in the past few years, especially among adolescents [2]. Adolescents and teenagers are generally naïve to smoking or vaping, and tend to be more vulnerable and willing to experiment with ECIGs. Thus, if these naïve individuals wish to experience new taste sensations of E-liquid flavors, they may unwittingly fall prey to nicotine addiction. E-liquid components are commonly available online. This not only facilitates the preparation of E-liquids at home, but may allow under-age individuals to circumvent purchasing ready-made E-liquids at the local vape shop. This new phenomenon called “Do-It-Yourself Vape Juice” allows for adolescents to experiment with a variety of different flavor profiles [10]. For adolescents, these home-made products have proven to be very enticing and addictive, with more accessible options and appealing flavors including, but not limited to, bubblegum, tutti-frutti, and blueberry. Therefore, flavored E-liquids are the most used nicotine product among this age group. For example, in 2020, approximately 5% of middle schoolers and 20% of high schoolers reported using these products in the last 30 days [2]. The Truth Initiative [11] communicated that 32.7% of US high school students (aged 14–18) have used vaping products, making youth tobacco usage a forefront epidemic. It is paradoxical that vaping, which started as a promising smoke-cessation option, has also become an alternative means by which E-liquid and tobacco companies take advantage of naïve individuals–especially adolescents–addicting them to nicotine and profiting in the process.
Many studies have been conducted regarding the effects of vaping products on lung tissue and airway epithelial cells, arguing that these products have significant effects on respiratory health [12,13]. Studies have shown that flavorings such as strawberry, cinnamon, and menthol added in vaping products on top of the base humectants of PG and VG contribute to the detrimental effects on pulmonary tissues and cells such as cytokine production and cell death [14,15]. Furthermore, studies in human lung and airway epithelial cells, in the presence of ECIG aerosol and E-liquid diluted in media, result in damage to DNA, decrease in antimicrobial activity, increase in levels of cellular stress, decrease in cell proliferation, and other stress-induced detrimental effects [16,17,18,19]. These in vitro findings suggest that E-liquids induce toxic effects. A high incidence of E-cigarette/Vaping Associated Lung Injury (EVALI) has been reported [20,21]. EVALI is characterized by respiratory symptoms such as sudden lung infections, shortness of breath, cough, chest pain, fever, and chills [22]. While the effects of E-liquids on airway are under investigation, there are very few studies on the effects of E-liquids on the oral microenvironment (i.e., microbiota and underlining epithelium).
The oral cavity contains the second highest concentration of bacteria in humans, with over 700 species present [23], and is home to pathogenic and commensal bacteria [24]. Initially, commensal bacteria interact with each other to form biofilm communities on tooth surfaces [25,26]. These biofilms are often extremely dense when growing on hard surfaces. Commensal species, mainly streptococci, play a role in preventing many oral diseases such as gingivitis, caries, and periodontal disease [27]. Studies have shown that commensal oral streptococci contribute to oral homeostasis through factors such as pH stability, while slowing growth of pathogenic species [28,29,30]. For example, a previous study from our group shows that commensals Streptococcus gordonii and Streptococcus intermedius reduce invasion of the oral pathogen Porphyromonas gingivalis into oral epithelial cells [31]. When this microbiome is destabilized by outside stressors such as cigarette smoke, the oral cavity becomes more susceptible to inflammation and infection, leading to diseases such as gingivitis and periodontitis [32,33]. Since the oral cavity is the first anatomical site to be affected by the exposure of cigarette smoke or ECIG aerosol, oral bacteria will likely be affected from this exposure. Previous studies by our group explored the effects of cigarette smoke, E-liquids (±flavors), and their aerosols with and without the addition of nicotine. Results suggest that ECIG-generated aerosols have less detrimental effects on oral commensal streptococci in comparison to conventional cigarette smoke [34,35]. The most recent study tested the effects of flavoring compounds in E-liquids on the growth of streptococci, in planktonic mode rather than biofilms, concluding that flavored E-liquids are more detrimental to the growth of these bacteria in comparison to the unflavored controls [36]. Other studies have shown that the normal antimicrobial properties of saliva can be compromised in a user of ECIGs, resulting in decreased levels of oral lysozyme and lactoferrin [37]. Another study demonstrated a shift in the composition of the oral microbiota as a result of vaping [38]. In addition, alterations in the beta-diversity (i.e., number of species and abundance of each) of the oral microbiome, such as higher levels of Porphyromonas and Veillonella, increase the risk of infection [39]. As a result of alterations in oral microbial communities’ beta-diversity, there is a risk for predominance of pathogenic species (i.e., dysbiosis) and impaired homeostasis, which can contribute to oral diseases [40], and may ultimately lead to more serious systemic complications.
In this study, we evaluate the effects of various E-liquid flavorings on biofilm formation and toxicity of four oral commensal bacterial species: Streptococcus gordonii, Streptococcus intermedius, Streptococcus mitis, and Streptococcus oralis. We aim to test the effects of five commercially available E-liquid flavorings on oral biofilm formation and growth in an in vitro model system. A complete description of these flavors has previously been documented [36]. The aims of this study are two-fold: (i) to determine the effects of flavoring compounds on the formation and growth of single-species and multi-species oral commensal bacterial biofilms, and (ii) to explore the mechanistic mode of inhibition of E-liquid flavorings on oral bacteria. We hypothesize that exposure to E-liquid flavorings alters biofilm formation and growth. Since commensal oral biofilms are naturally occurring in the mouth, disruption of such communities could impact oral health. It is important to note that oral health is not isolated from the rest of the body. Consequently, it is critical to understand the ways in which vaping can impact the oral cavity, and therefore ultimately influence systemic health.

2. Materials and Methods

2.1. Reagents and Supplies

Reagents and supplies for this study were purchased from Fisher Scientific (Hampton, NH, USA) unless otherwise explicitly noted.

2.2. Bacterial Strains

The bacterial strains tested were S. gordonii DL1, S. mitis UF2, S. intermedius 0809, and S. oralis SK139. These strains were originally donated by Dr. Robert Burne at the University of Florida, College of Dentistry in Gainesville, Florida, United States and have been routinely grown and passaged in our laboratory. These strains were grown in brain heart infusion (BHI) media with a supplemental addition of 5 μg/mL porcine hemin, and on BHI agar at 37 °C, 5% CO2 as previously described [31,36]. All bacterial stocks were stored in a −80 °C freezer and, prior to experiments, purity of individual strains was routinely confirmed by Gram staining and light microscopy. In addition, 16S rRNA sequencing (Genewiz, South Plainfield, NJ, USA) was performed to ensure the purity of each species.

2.3. Stock E-Liquid

In this study, E-liquid preparations followed a strict protocol, allowing us to know the exact composition of each batch. A common problem with commercially prepared E-liquids is that they are proprietary, and therefore the exact composition is unknown in most cases. Furthermore, commercially prepared E-liquids are known to be highly variable from batch to batch [41]. Consequently, the base flavorless E-liquid solution was prepared with a 1:1 v/v mixture of PG and VG, obtained from Liquid Nicotine Wholesalers (Phoenix, AZ, USA), and spiked with 20 mg/mL of (S)-(-)-nicotine, 99% (Alpha Aesar, Tewksbury, MA, USA). Stock flavors were added to a final concentration of 25% (v/v) in the base flavorless E-liquid, which included tobacco, menthol, cinnamon, strawberry, and blueberry, as indicated in Table 1. These five flavors, also obtained from Liquid Nicotine Wholesalers (Phoenix, AZ, USA), were chosen because tobacco and menthol are commonly used among individuals trying to quit smoking, and cinnamon, strawberry, and blueberry are popular flavors among adolescents. As shown in Table 1, E-liquid solutions were made with concentrations of 0 or 25% stock flavoring and subsequently diluted to a final working concentration of 5%, 3%, and 1% in BHI broth for further experimentation.

2.4. Saliva Preparation

Saliva donations were collected from five different participants at Muhlenberg College under IRB approval code Cuadra_S19_18. Following previously published saliva donation protocols [42,43], all participants were required to fit donation criteria: (i) non-smokers or vapers, (ii) no current antibiotic treatment, (iii) no food or drinks (except water) two hours prior to donation, and (iv) healthy status at the time of donation excluding any allergies. Raw saliva donations were stored at −20 °C. Raw saliva samples from the five donors were pooled and mixed on ice. Dithiothreitol was added to a final concentration of 2.5 mM to reduce disulfide bonds, stirring on ice for 10 to 15 min. All reduced saliva was then diluted 1:4 in distilled water. Diluted saliva was centrifuged at 14,000× g for 30 min, vacuumed through a 0.45 μm filter, and collected in a sterile container. All processed saliva was aliquoted into 25 mL tubes and stored indefinitely at −20 °C or at 4 °C for up to a week or before use.

2.5. Biofilm Assays and Confocal Analysis

One hundred microliters of processed saliva were added to each well of a 96-well plate for 48 h at 4 °C to generate a pellicle. All bacterial strains were streaked and cultured on BHI agar overnight at 37 °C and 5% CO2 and inoculated into BHI broth to grow batch cultures. After overnight incubation, batch cultures were adjusted to an optical density (OD) = 1.0 at 595 nm wavelength, approximately one billion bacteria/mL in the culture. These samples were diluted in 1:4 in BHI broth. Saliva was removed from wells and the existing pellicles were washed once with 100 µL phosphate buffered saline (PBS). Each species of diluted bacteria was subsequently added to saliva-treated 96-well plates in a final volume of 100 µL per well. Bacteria were incubated at 37 °C and 5% CO2 for one hour, allowing for adherence of streptococci species to the pellicle generated by the processed saliva. Excess bacterial cells were washed out twice with 100 µL/well PBS. Then, 100 µL of 50% BHI (control) or 50% BHI containing 5% hydrogen peroxide or 5%, 3%, or 1% concentrations of E-liquids ± 25% flavors were added to each well (Table 1). Single-species biofilms were grown overnight at 37 °C and 5% CO2 and the crystal violet staining procedure was used to quantify the amount of biofilm biomass [44]. Briefly, all spent media were discarded, and wells were washed with distilled water. One hundred microliters of 5% crystal violet solution (diluted in PBS) were added into each well for 10 min to stain the biofilms. Once stained, the crystal violet solution was discarded, and each well was washed five times with 100 µL distilled water. To extract the crystal violet stain from the biofilms, 100 µL of 3% acetic acid diluted in distilled water was added to all wells and shaken in a plate shaker for 1 min at 400 rpm. Then, the 3% acetic acid with any extracted crystal violet was transferred onto a new and untreated 96-well plate. The amount of extracted crystal violet in 3% acetic acid serves as an index of biofilm biomass. Absorbance of each well was read at 595 nm wavelength with a μQuant monochromatic microplate reader equipped with KC4 software version 3.4 (MTX Lab Systems, Bradenton, FL, United States). This method was repeated for all four species separately.
To form multi-species biofilms, all streptococci species were grown separately in BHI broth and then standardized to OD = 1.0 at 595 nm. Each species was then mixed in a 1:1:1:1 ratio. This mixture was then diluted 1:4 in BHI broth. Biofilm formation with 50% BHI broth, with and without E-liquids ± flavors or hydrogen peroxide, followed the same procedure as single-species biofilms above. For confocal analysis, multi-species biofilms were grown in chamber-slides with 3% E-liquids ± 25% flavors as above. Biofilms were washed and the DNA was stained with 5 µM SYTO 59 in PBS for 30 min at room temperature in the dark. Excess stain was washed twice with PBS. Biofilms were imaged using a Carl Zeiss LSM880 laser scanning confocal microscope (Carl Zeiss Inc. White Plains, NY, USA) at 630× magnification with oil immersion using an excitation wavelength of 610 nm. Optical slicing was set at 1 µm and Z-stacks were acquired at slow speed and high resolution. Three-dimensional images were rendered using the ZEN 3.5 software (Carl Zeiss Inc., White Plains, NY, USA). The confocal microscope used in this study and the time allowed for its use were generously provided by the Biological Sciences Department in the College of Arts and Sciences at Lehigh University (Bethlehem, PA, USA).

2.6. Colony Forming Unit Assay

Batch cultures of all bacteria were grown and adjusted to OD = 1.0 as above. One milliliter of bacterial suspension was transferred to microcentrifuge tubes and centrifuged at 10,000× g for 10 min, then washed once with 1 mL PBS. To assess the mechanism of growth inhibition, pellets were resuspended in either 100 µL PBS (control) or 100 µL of each of the undiluted stock E-liquid flavors. Bacteria were then incubated at 37 °C and 5% CO2 for 15 min to allow flavors to completely bathe the bacteria. This was followed by addition of 1 mL of PBS to all bacterial suspensions and centrifugation as above. To completely remove excess flavors, bacteria were washed twice with 1 mL PBS and carefully decanted to ensure no bacterial loss. To measure any potential lysis and loss of bacterial biomass, pellets were weighed before and after treatments. Bacteria were resuspended in 500 µL PBS, serially diluted 1:10, and plated on agar to assess colony formation. The undiluted suspensions of bacteria were stained with 5% crystal violet and observed under light microscopy at 1000× to determine cellular morphology. The microscope used was a Nikon Eclipse TE2000-U inverted microscope equipped with a Nikon Digital Sight DS-Fi1 camera and NIS Elements Imagine Software (Nikon Instruments Inc., Melvin, NY, USA).

2.7. Death Curves

Batch cultures of each bacterial species were grown as indicated above and subsequently adjusted to OD = 1.0. One milliliter of bacteria suspension was transferred to microcentrifuge tubes and centrifuged as above. All excess media were removed and bacteria were washed with 1 mL PBS, twice. Flavorless E-liquid or E-liquids plus 25% menthol or cinnamon flavors only were diluted separately in PBS, ranging from a 0% (control) to 5, 10, 15, 20, and 25% E-liquid ± flavors. Bacterial pellets were resuspended in 100 µL of PBS without and with E-liquids ± flavors at all concentrations. Mixtures were vortexed for 10 s to mix well. Bacterial suspensions were immediately serially diluted 1:10 and 40 µL were plated on BHI agar. Liquid was allowed to be absorbed in the agar for a few minutes and agar plates were incubated at 37 °C and 5% CO2 overnight. Colony-forming units (CFU) counts were collected after 24 h to determine the amount of bacterial viability after exposure to the different concentrations of E-liquid ± cinnamon or menthol flavorings. This method was repeated for all four species individually.

2.8. Statistical Analysis

For all quantitative experiments, means and standard errors of the mean (SEM) were calculated and analyzed. Statistical significance, when comparing flavorless and flavored E-liquid conditions to each other, was determined using one-way ANOVA. For comparisons between percentages of each E-liquid ± flavors in biofilm biomass and death curve assays, a two-way ANOVA was used. For both one-way and two-way ANOVAs, the Bonferroni post-hoc analysis was used to determine differences between treatment groups. Student t-test was used to determine significance between pellet weights before and after stock flavor treatments. Significance was established at p < 0.05.

3. Results

3.1. Biofilm Assays

As expected, all four streptococci grow single-species biofilms with 50% BHI and are severely inhibited by the addition of 5% hydrogen peroxide (Figure 1). There is a significant dose-dependent biofilm inhibition of growth with increasing E-liquids ± flavors (Figure 1 and Table 2). E-liquids containing cinnamon inhibit biofilm formation and growth on all single-species tested more than any other flavor. For all streptococci, 5% E-liquid with cinnamon (and 3% E-liquid with cinnamon for S. intermedius) yields biofilm biomasses that approach the lower limit of detection. According to Table 1, 5% and 3% E-liquids with flavorings in BHI is equivalent to 1.25% and 0.75% final flavoring concentration in the broth, respectively. Menthol also significantly inhibits biofilm formation and growth in comparison to flavorless E-liquid (p < 0.05) (Figure 1 and Table 2). For S. gordonii, S. oralis and S. mitis, 5% E-liquid with menthol resulted in much lower biofilm growth compared to tobacco, strawberry, and blueberry (Figure 1). Interestingly, at 1% E-liquid ± flavors, the biofilm biomass was similar, or at times greater than that of BHI positive control.
Multi-species biofilms with all four species mixed in a 1:1:1:1 ratio were exposed to E-liquids ± flavors as previously described for single-species. The results collected (Figure 2) appear to match the trends found with single-species biofilms (Figure 1). Significant dose-dependent inhibitory effects are evident for all E-liquids ± flavors (Figure 2). The cinnamon flavoring results in significantly lower biofilm growth at 1% and 3%, but is undetectable at 5% (Figure 2). Menthol flavoring also strongly inhibits growth compared to tobacco, strawberry, and blueberry flavors (Figure 2). Our data suggest that E-liquids containing cinnamon and menthol flavorings most strongly hinder biofilm formation and growth of oral commensal bacteria in comparison to all other conditions tested.
Confocal images of multi-species biofilms (shown on three dimensions; X, Y, and Z axes) treated with E-liquids ± flavors are depicted in Figure 3. Biofilms grown in 50% BHI (control) present a confluent community of roughly 20 µm in height (Z axis) with occasional bacterial extensions radiating above the 30 µm mark. In stark contrast, 5% peroxide in media yielded no significant biofilm formation showing only sparse bacterial aggregates. All four species are known to co-aggregate with each other [42,43,45,46,47,48], and most likely these aggregates represent any combinations of the four species adhered to each other and the saliva-coated surface. Biofilms grown with 3% flavorless E-liquid show a similar architecture and confluence as those grown in 50% BHI, albeit the height is slightly lower. Biofilms grown in media plus 3% E-liquid with tobacco flavoring display a different architecture, where communities grow in height to around 40 µm without achieving confluence. Biofilms grown with 3% E-liquid with cinnamon or menthol flavorings resemble the peroxide condition, but slightly enhanced bacterial aggregations. Finally, biofilms grown with 3% E-liquid with strawberry or blueberry flavorings resemble the architecture of the 50% BHI control and the flavorless E-liquid condition, but with slightly diminished confluence and biomass. These data support the biofilm biomass quantifications shown in Figure 2 and Table 2 indicating that both menthol and cinnamon flavors hinder biofilm formation of these commensal oral streptococci more than the other flavors tested.

3.2. Colony Forming Unit Assay

After treating with undiluted stock flavoring agents or flavorless E-liquid and examining with light microscopy, all bacteria remain intact. For all four species, cells appear to be uncompromised and display similar morphologies when comparing controls to the treatments (Figure 4). In addition, Table 3 shows the growth, or lack thereof, of all species on agar after the same treatments. All four streptococci grow after treatment with flavorless E-liquid. Treatment with the tobacco flavoring results in reduced numbers of colonies. However, treatments with menthol, cinnamon, strawberry, and blueberry result in complete obliteration of growth, potentially indicating bacterial death (Table 3). These results suggest that out of all the flavors, tobacco is the least harmful for all four spp. as they can still grow, but to a lesser degree when compared to flavorless E-liquid.
Based on Figure 1, Figure 2 and Figure 3, and Table 2, as well as our previous findings on planktonic inhibition [36], cinnamon and menthol appear to have the strongest inhibitory effects on biofilm formation compared to the other flavorings. Therefore, the remaining experiments will focus on the effects of cinnamon and menthol on all four bacteria.

3.3. Death Curves

Figure 5 shows a significant dose-dependent decrease in bacterial viability after exposure to PBS containing 0 to 25% E-liquid with or without menthol or cinnamon flavors in 5% increments (p < 0.001) for all species. Additionally, E-liquids containing cinnamon or menthol flavors reduced the numbers of viable bacteria compared to flavorless E- liquid in all four species at every dose tested. For S. oralis, there was a striking decrease in bacterial viability with menthol and cinnamon, showing that this species is more susceptible to these flavoring agents than the other three. Altogether, our data demonstrate that these two flavoring agents have an obvious and overwhelming significant effect on the survival of all four oral streptococci tested in a dose-dependent manner.

3.4. Bacterial Mass Pre- and Post-Treatments

Treatments with undiluted stock flavors show bacterial death (Table 3) and possibly bacterial lysis. However, light microscopy in Figure 4 reveals intact bacterial cells. To further evaluate the possibility of bacterial lysis upon stock flavoring treatments, bacteria were resuspended in these flavoring agents and samples (microcentrifuge tube + bacterial pellet) were weighed pre- and post-treatment. If lysis should occur, streptococcal cells would become cellular debris from the lysing activity and most of this cellular material would be removed with the supernatant. Consequently, the weight of the sample would be reduced post-treatment and the pellet would appear smaller. Figure 6A quantifies the weight of streptococcal samples before and after treatments with flavorless E-liquid, and undiluted stock cinnamon or menthol flavorings. There is little to no change in sample weights before and after PBS and E-liquid treatments, suggesting no bacterial lysis, indicating that the biomass for these conditions is unaltered. In the case of S. mitis, there is a modest increase of the sample weight, which could be a result of the remaining PBS in the tube. Removing all PBS volume without disturbing the bacterial pellet is technically challenging and could account for this increase. Unexpectedly, the weight of the menthol- and cinnamon-treated samples increases post-treatments (Figure 6A). Upon visual inspection (Figure 6B), menthol crystals are clearly evident in the centrifuge tubes, indicated by the green arrows, most likely contributing to this increase in weight. Similarly, an amber colored material associated with the stock cinnamon flavor appears to be trapped within the pellets, indicated by the orange arrows (Figure 6B), again adding to the final weight of this sample. In Figure 4 there are visible microscopic hydrophobic droplets among the bacteria in water-based PBS (orange arrow). In Figure 6B there is an amber colored material (orange arrows) that does not mix with the water-based PBS, hence not removed during the washing step. This most likely correlates with the microscopic hydrophobic droplets in Figure 4, which contain inherent organic materials from the stock cinnamon flavor and do not dissolve in aqueous solutions. Overall, Figure 6 demonstrates that treatments with stock menthol and cinnamon flavors do not decrease the actual biomass of the four streptococci tested, suggesting there is little to no bacteriolytic effect from these flavors, which support the results seen in the micrographs in Figure 4.

4. Discussion

Oral commensal biofilms are essential for homeostasis of the oral cavity. Considering the evidence that planktonic growth of oral commensal bacteria is negatively affected by E-liquid flavorings [36], in this study we sought to determine the impact of E-liquid flavorings on biofilm formation as single-species (Figure 1) or in multi-species communities of oral commensal bacteria (Figure 2 and Figure 3). Altogether, our work demonstrates that biofilm formation and growth are severely affected by E-liquids ± flavors in a dose-dependent fashion (Figure 1 and Figure 2; Table 2) and is supported by confocal analysis (Figure 3). The mixture of PG, VG, and nicotine alone are enough to produce this inhibitory effect. The addition of flavors may enhance such effect. On visual inspection, Figure 3 and Figure 4 demonstrate that, after treatments with E-liquids ± flavors, bacterial cells are still intact. However, Table 3 indicates that treatment with these E-liquids ± flavors (except tobacco) stops their growth. Interestingly, tobacco flavoring also induces a different biofilm architecture compared to control biofilms (Figure 3). At this time, there are no reports on the viability and biofilm architecture of oral bacteria, induced by tobacco flavoring, that would explain these findings; except to say that this flavoring alters the microbiology of these spp. From a clinical perspective, studies performed comparing the oral microbiome diversity sampled from smokers and vapers found a unique periodontal microbiome where relative concentrations of streptococci species, including Streptococcus sanguinis, Streptococcus parasanguinis, Streptococcus anginosis, and S. gordonii were altered in vivo [49]. This was also seen in experiments comparing relative mean abundance, with a net decrease in streptococci in ECIG users [49]. This is consistent with our findings, as streptococci species grown in biofilms exposed to E-liquids result in a significantly lower biomass.
Since cinnamon and menthol flavors cause the most significant effects, we narrowed the rest of the study to test just these two flavors. Figure 5 shows that cinnamon and menthol, compared to flavorless E-liquid, significantly inhibit bacterial growth. Figure 6 illustrates that the size and weight of the pellets after treatment with flavorless E-liquid or cinnamon or menthol do not decrease. Based on these findings, we propose flavoring agents to be bactericidal (i.e., bacteria present, but dead) but not bacteriolytic (i.e., bacterial remnants/cellular debris) on the four oral spp. tested in this study.
The results of this study are consistent with previous findings from our group [34,35,36], as well as others [50,51,52] regarding vaping and the oral cavity, underlining the effects of a variety of E-liquids and their aerosols on oral streptococci. All data collected in this investigation extend the previous studies [36] while providing some mechanistic details. Specifically, there is a direct correlation between the increase in dosage of E-liquids ± flavors and the augmented inhibition of biofilm formation and growth of the spp. tested, even in the absence of flavoring agents. In particular, 3% and 5% E-liquids ± flavors significantly inhibited biofilm formation and growth, while the lowest percentage of 1% showed little to no statistically significant effect on the growth in comparison to the BHI control (Figure 1, Figure 2 and Figure 3; Table 2). Among the flavors tested, menthol and cinnamon have the highest effect on single- and multi-species biofilm formation and growth, as demonstrated by reduced biofilm biomass (Figure 1, Figure 2 and Figure 3; Table 2). These results are in line with previous data on the same four species of oral bacteria [34,35,36]. Interestingly, although there are no significant differences between single-species biofilms grown with strawberry flavored E-liquid compared to the flavorless E-liquid controls, there is a significant decrease in the amount of multi-species biofilm biomass for this condition (Table 2), suggesting that these species are more sensitive to the strawberry flavoring agent when residing in microbial communities. Of the five flavors tested, cinnamon and menthol are most consistent in biofilm growth inhibition across the four species alone or as a microbial community (Figure 1, Figure 2 and Figure 3; Table 2). This general trend is supported by the death curve experiments, where both cinnamon and menthol flavoring agents significantly reduced CFU counts in comparison to the flavorless E-liquid control (Table 3 and Figure 5). Additionally, the CFU assays show the mechanistic effects of the flavoring compounds, as light microscopy indicates that bacteria remain intact post-treatment (Figure 4), as well as the pellet biomass (Figure 6), indicating no bacteriolytic effects.
Our group has previously shown the inhibitory effects of flavoring compounds, which are added to the flavorless E-liquids humectants: PG and VG. Studies regarding harmful flavoring chemicals when inhaled, started in the early 2000s, when workers in microwave popcorn factories were inhaling chemicals coming from butter flavoring, similar to flavoring compounds mimicking food flavors [53]. Diacetyl is the main ingredient in butter flavoring, and the same as those found in studies evaluating numerous E-liquid flavors [47]. Diacetyl and two closely related chemicals (2,3-pentanedione and acetoin) have been found in high concentrations in some flavoring agents, which may enhance inhibitory effects [53]. Moreover, creation of “Do-It-Yourself Vape Juice” among adolescents too young to purchase E-liquids adds additional risks since these home-made concoctions lack quality control assurances. Such practices greatly increase the percentage of flavoring compounds in the mixture, thereby amplifying the potential risk to overall health [54].
In this study, menthol and cinnamon flavorings are the most damaging to biofilm formation and growth of oral commensal streptococci. Treatments with stock cinnamon, followed by washes and centrifugation of bacteria, resulted in pellets with a hydrophobic amber material (Figure 6), which was also observed as droplets under light microscopy (Figure 4). Most likely, this material is trans-cinnamaldehyde which, according to the safety data sheet (SDS), is in liquid form at room temperature [55]. These droplets contain organic materials sequestered from the aqueous fraction of the stock cinnamon flavor in PBS, but remain unknown. Menthol treatments resulted in formation of crystallized materials left in the centrifuge tube after multiple washes, also observable under light microscopy. Undiluted stock menthol flavor (as with all flavors used in this study) is dissolved in propylene glycol [36], an organic solvent that prevents its crystallization at room temperature. According to the SDS, menthol crystallizes at 28 °C [56] and the PBS washes were conducted at room temperature (22 °C), which explains this phenomenon. Additionally, after decanting the PBS from the microcentrifuge tubes, trace volumes of PBS were inevitably left behind. Attempting to remove all PBS would result in partial loss of the bacterial pellet, thereby affecting its final weight. Unfortunately, this contributes to the variability of the mass within the microcentrifuge tubes (i.e., bacterial mass, hydrophobic materials, menthol crystals, and trace PBS), and could account for the significance noted pre and post PBS treatments for S. mitis (Figure 6A). Albeit, quantitative results in Figure 6A, and qualitative visual inspection of the pellets in Figure 6B demonstrate no loss of bacterial mass following treatments, negating a bacteriolytic effect.
The results of the bactericidal effects of menthol and cinnamon in this report correlate well with the antimicrobial properties shown by others [57,58,59,60,61,62]. For example, cinnamaldehyde has detrimental effects on the bacterial cell morphology and cell membrane integrity of Escherichia coli and Staphylococcus aureus [57], possibly explaining the major inhibitory effects observed in this study. A recent investigation by Silva et al. (2022) shows that essentials oils from the peppermint plant Mentha piperita yield a low minimal inhibitory concentration on Gram positives Staphylococcus aureus and Listeria monocytogenes [58]. Additional biochemical studies with cinnamon and menthol flavoring agents will help uncover the specific bactericidal mechanisms on oral streptococci.
Multi-species biofilms appear to be more susceptible to E-liquids with flavors, compared to single-species biofilms. As a matter of speculation, perhaps important interactions that normally occur among these four species, such as chemical communication (i.e., quorum sensing), are altered when exposed to E-liquids with flavors. For example, d-arabinose inhibits formation of S. oralis, Fusobacterium nucleatum and P. gingivalis multi-species biofilms of by abolishing the quorum sensing signaling molecule, autoinducer-2 [59]. Similarly, trans-cinnamaldehyde, a component of cinnamon flavor, inhibited Streptococcus mutans sucrose-dependent biofilm formation [60]. Due to the complex nature of polymicrobial interactions, further studies on oral biofilms with specific flavoring compounds are required to unravel the effects of E-liquids ± flavors on the oral microbiota.
This study was limited to four oral streptococci species that are primary colonizers in the oral microbiota and were chosen for their role in the development of oral biofilms (e.g., dental plaque) [61]. Human saliva was used to simulate the acquired pellicle, which serves as the mechanism to initiate bacterial adherence and biofilm growth conditions in vitro [62,63,64,65]. However, despite these in vitro efforts, there are other limitations that are challenging to recreate, including: (i) the overwhelming number oral bacterial species in the mouth, (ii) the overall relative abundance of each species (iii) the interactions among commensal species, (iv) the putative presence of pathogenic species, (v) the flow of saliva over time, and (vi) the topography of vaping sessions (i.e., personal preference of puff duration, inter-puff duration, puff flow rate), to name a few. Additionally, E-liquids in this study were either diluted in BHI or used as undiluted stock flavors and directly added onto the bacteria without aerosolization. The process of aerosolization has the potential to alter the chemical nature of E-liquids [66]. Our previous findings have shown that the overall chemical load of vaporized E-liquid is typically lower in comparison to E-liquid diluted in the media [36]. This means that equal volumes of aerosol and E-liquid result in a greater effect of the latter on the growth of oral streptococci, but does not take into account the uniformity of aerosol generated based on its constituents. Nonetheless, the information gained from this study identifies potential risks associated with the more realistic effect of ECIG-generated aerosol on oral commensal bacterial communities. The volume of the oral cavity is roughly 230 cm3 according to Kaufman and Farahmand [67]. This is a significantly larger volume than the vessels used in this study, which means that the effect of E-liquids ± flavors presented is amplified. Furthermore, only a fraction of the total aerosol inhaled into the oral cavity is dissolved into the saliva. Therefore, most of the aerosol ends up in the respiratory tract, thus limiting the chemical load in the mouth [68]. Another fact to consider is that the continuous flow of saliva across the oral cavity further lowers the chemical load on the oral microbiota as old saliva is washed away and replaced by new saliva. Lastly, this study does not take into consideration the possible interactions between the flavoring agents and numerous other trace constituents known to exist in E-liquids and their aerosols. For example, previous studies have shown the presence of trace metals in aerosolized E-liquids [69,70] that could potentially impact the normal growth of biofilms. To date, there are no documented effects of any of these trace constituents on the growth of oral commensal bacteria.
Experiments are currently being designed to investigate the effects of E-liquids on polymicrobial biofilms under similar conditions, containing both commensal and pathogenic species such as P. gingivalis, F. nucleatum, and Aggregatibacter actinomycetemcomitans. With the addition of these three species, it will be possible to evaluate how commensal and pathogenic microbes interact after exposures to E-liquids ± flavors. Such studies may provide a clearer understanding into interspecies interactions, as well as change in abundance and composition of spp. involved. For example, signaling molecules involved in bacterial communication, physical coaggregation between species, and metabolites such as adenine-derived molecules will be explored after E-liquid ± flavors exposure. Importantly, polymicrobial communities treated with E-liquids ± flavors could result in dysbiosis, leading to oral diseases. Moreover, future studies will employ more realistic conditions such as a continuous supply of human saliva to mimic biofilm formation in the oral cavity with intermittent addition of flavored E-liquid compounds. Other studies being considered include in-depth chemical analyses, using techniques such as gas chromatography, high performance liquid chromatography, and nuclear magnetic resonance spectroscopy, to determine which compounds are found most frequently in these flavoring agents and which compounds contribute to the toxicity and decreased growth patterns found in the oral microbiota.

5. Conclusions

This study has shown that E-liquids containing flavoring compounds at high concentrations have significant inhibitory effects on biofilm formation and growth of oral commensal streptococci, both as a single-species and as a multi-species community. Mechanistically, the flavoring compounds exhibit a bactericidal effect, killing the streptococci, but keeping their morphology intact. These findings promote further understanding of the effects of E-liquids on the implications of oral health. Dysbiosis of the oral microbiota has been implicated in dental caries, periodontitis, gingivitis, and many other oral diseases [28,71]. The diverse and complex oral microbiota may be severely impacted by altering the abundance of pathogenic bacteria, at the expense of the commensal microorganism, resulting in detriment to the rest of the oral microenvironment. Commensals are extremely important in maintaining homeostasis of the oral microenvironment, and variations to the oral microbiome may prove to have detrimental effects beyond the oral cavity leading to systemic pathological processes [72]. Exploring the effects of vaping in oral biology deserves more attention as oral health impacts, and is greatly correlated to, systemic health.
The results of these experiments contribute significantly to the understanding of vaping effects oral health by demonstrating that E-liquids ± flavors are detrimental to the in vitro growth of oral commensal bacterial biofilms, following a bactericidal mechanism. These oral streptococci are primary colonizers in dental plaque and biofilm communities in the oral cavity, and their growth is crucial to the homeostasis of this anatomical site. Flavoring agents of E-liquids may pose a risk to the health of the oral microenvironment, and thereby systemic health.

Author Contributions

C.P.X. ran all experiments and wrote the first draft of the paper. G.A.C. conceptualized the project; designed the experiments; edited the paper. D.L.P. generated figures; data statistical analysis, edited the paper. All authors have read and agreed to the published version of the manuscript.

Funding

Funding derived from the Rising Scholar’s Award, granted to Giancarlo Cuadra by the Office of the Provost at Muhlenberg College.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of Muhlenberg College (IRB approval code Cuadra_S19_18, 13 May 2019).

Informed Consent Statement

Verbal informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The contributions presented in the study are included in the publication. Any further questions or inquiries can be directed to the corresponding author.

Acknowledgments

Authors would like to thank Keri Colabroy, Marten Edwards, Bruce Wightman and Sherri Young from Muhlenberg College. In addition, authors are grateful for Michelle James’ support with early pilot experiments and Lee Graham at Lehigh University for his technical assistance with confocal microscopy.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Palazzolo, D.L. Electronic Cigarettes and Vaping: A New Challenge in Clinical Medicine and Public Health. A Literature Review. Front. Public Health 2013, 1, 56. [Google Scholar] [CrossRef] [PubMed]
  2. CDC Tobacco Free Youth and Tobacco Use. Available online: https://www.cdc.gov/tobacco/data_statistics/fact_sheets/youth_data/tobacco_use/index.htm (accessed on 9 November 2021).
  3. E-Cigarettes: Facts, Stats and Regulations. Available online: https://truthinitiative.org/research-resources/emerging-tobacco-products/e-cigarettes-facts-stats-and-regulations (accessed on 15 February 2022).
  4. Get the Facts on E-Cigarettes|Know the Risks: E-Cigarettes & Young People|U.S. Surgeon General’s Report. Available online: https://e-cigarettes.surgeongeneral.gov/getthefacts.html (accessed on 15 February 2022).
  5. St. Helen, G.; Liakoni, E.; Nardone, N.; Addo, N.; Jacob, P.; Benowitz, N.L. Comparison of Systemic Exposure to Toxic and/or Carcinogenic Volatile Organic Compounds (VOC) during Vaping, Smoking, and Abstention. Cancer Prev. Res. 2020, 13, 153–162. [Google Scholar] [CrossRef] [PubMed]
  6. McRobbie, H.; Bullen, C.; Hartmann-Boyce, J.; Hajek, P. Electronic Cigarettes for Smoking Cessation and Reduction. In Cochrane Database of Systematic Reviews; The Cochrane Collaboration, Ed.; John Wiley & Sons, Ltd.: Chichester, UK, 2014; p. CD010216.pub2. [Google Scholar]
  7. Nicotine without Smoke: Tobacco Harm Reduction. Available online: https://www.rcplondon.ac.uk/projects/outputs/nicotine-without-smoke-tobacco-harm-reduction (accessed on 2 January 2022).
  8. Polosa, R.; Caponnetto, P.; Morjaria, J.B.; Papale, G.; Campagna, D.; Russo, C. Effect of an Electronic Nicotine Delivery Device (e-Cigarette) on Smoking Reduction and Cessation: A Prospective 6-Month Pilot Study. BMC Public Health 2011, 11, 786. [Google Scholar] [CrossRef] [PubMed]
  9. Stratton, K.; Kwan, L.; Eaton, D. Public Health Consequences of E-Cigarettes; The National Academies Press: Washington, DC, USA, 2018; ISBN 978-0-309-46834-3. [Google Scholar]
  10. Cox, S.; Leigh, N.J.; Vanderbush, T.S.; Choo, E.; Goniewicz, M.L.; Dawkins, L. An Exploration into “Do-It-Yourself” (DIY) e-Liquid Mixing: Users’ Motivations, Practices and Product Laboratory Analysis. Addict. Behav. Rep. 2019, 9, 100151. [Google Scholar] [CrossRef] [PubMed]
  11. Youth Vaping, Smoking & Nicotine Use. Available online: https://truthinitiative.org/our-top-issues/vaping-issue (accessed on 6 December 2021).
  12. Chun, L.F.; Moazed, F.; Calfee, C.S.; Matthay, M.A.; Gotts, J.E. Pulmonary Toxicity of E-Cigarettes. Am. J. Physiol.-Lung Cell. Mol. Physiol. 2017, 313, L193–L206. [Google Scholar] [CrossRef]
  13. Traboulsi, H.; Cherian, M.; Abou Rjeili, M.; Preteroti, M.; Bourbeau, J.; Smith, B.M.; Eidelman, D.H.; Baglole, C.J. Inhalation Toxicology of Vaping Products and Implications for Pulmonary Health. Int. J. Mol. Sci. 2020, 21, 3495. [Google Scholar] [CrossRef]
  14. Leigh, N.J.; Lawton, R.I.; Hershberger, P.A.; Goniewicz, M.L. Flavourings Significantly Affect Inhalation Toxicity of Aerosol Generated from Electronic Nicotine Delivery Systems (ENDS). Tob. Control 2016, 25, ii81–ii87. [Google Scholar] [CrossRef]
  15. Leigh, N.J.; Tran, P.L.; O’Connor, R.J.; Goniewicz, M.L. Cytotoxic Effects of Heated Tobacco Products (HTP) on Human Bronchial Epithelial Cells. Tob. Control 2018, 27, s26–s29. [Google Scholar] [CrossRef]
  16. Aug, A.; Altraja, S.; Kilk, K.; Porosk, R.; Soomets, U.; Altraja, A. E-Cigarette Affects the Metabolome of Primary Normal Human Bronchial Epithelial Cells. PLoS ONE 2015, 10, e0142053. [Google Scholar] [CrossRef]
  17. Lee, H.-W.; Park, S.-H.; Weng, M.; Wang, H.-T.; Huang, W.C.; Lepor, H.; Wu, X.-R.; Chen, L.-C.; Tang, M. E-Cigarette Smoke Damages DNA and Reduces Repair Activity in Mouse Lung, Heart, and Bladder as Well as in Human Lung and Bladder Cells. Proc. Natl. Acad. Sci. USA 2018, 115, E1560–E1569. [Google Scholar] [CrossRef]
  18. Schweitzer, K.S.; Chen, S.X.; Law, S.; Van Demark, M.; Poirier, C.; Justice, M.J.; Hubbard, W.C.; Kim, E.S.; Lai, X.; Wang, M.; et al. Endothelial Disruptive Proinflammatory Effects of Nicotine and E-Cigarette Vapor Exposures. Am. J. Physiol.-Lung Cell. Mol. Physiol. 2015, 309, L175–L187. [Google Scholar] [CrossRef] [PubMed]
  19. Wu, Q.; Jiang, D.; Minor, M.; Chu, H.W. Electronic Cigarette Liquid Increases Inflammation and Virus Infection in Primary Human Airway Epithelial Cells. PLoS ONE 2014, 9, e108342. [Google Scholar] [CrossRef] [PubMed]
  20. Kalininskiy, A.; Bach, C.T.; Nacca, N.E.; Ginsberg, G.; Marraffa, J.; Navarette, K.A.; McGraw, M.D.; Croft, D.P. E-Cigarette, or Vaping, Product Use Associated Lung Injury (EVALI): Case Series and Diagnostic Approach. Lancet Respir. Med. 2019, 7, 1017–1026. [Google Scholar] [CrossRef]
  21. Wolf, M.; Rock, L.K. EVALI: New Information on Vaping-Induced Lung Injury. Available online: https://www.health.harvard.edu/blog/evali-new-information-on-vaping-induced-lung-injury-2020040319359 (accessed on 31 December 2021).
  22. E-Cigarette, or Vaping Product, Use Associated Lung Injury (EVALI) > Fact Sheets > Yale Medicine. Available online: https://www.yalemedicine.org/conditions/evali (accessed on 9 November 2021).
  23. Socransky, S.S.; Haffajee, A.D. Periodontal Microbial Ecology. Periodontol 2000 2005, 38, 135–187. [Google Scholar] [CrossRef]
  24. Burne, R.A. Oral Streptococci… Products of Their Environment. J. Dent. Res. 1998, 77, 445–452. [Google Scholar] [CrossRef]
  25. Huang, R.; Li, M.; Gregory, R.L. Bacterial Interactions in Dental Biofilm. Virulence 2011, 2, 435–444. [Google Scholar] [CrossRef] [PubMed]
  26. Berger, D.; Rakhamimova, A.; Pollack, A.; Loewy, Z. Oral Biofilms: Development, Control, and Analysis. High Throughput 2018, 7, 24. [Google Scholar] [CrossRef]
  27. Lamont, R.J.; Koo, H.; Hajishengallis, G. The Oral Microbiota: Dynamic Communities and Host Interactions. Nat. Rev. Microbiol. 2018, 16, 745–759. [Google Scholar] [CrossRef]
  28. Gross, E.L.; Beall, C.J.; Kutsch, S.R.; Firestone, N.D.; Leys, E.J.; Griffen, A.L. Beyond Streptococcus Mutans: Dental Caries Onset Linked to Multiple Species by 16S RRNA Community Analysis. PLoS ONE 2012, 7, e47722. [Google Scholar] [CrossRef]
  29. Herrero, E.R.; Slomka, V.; Bernaerts, K.; Boon, N.; Hernandez-Sanabria, E.; Passoni, B.B.; Quirynen, M.; Teughels, W. Antimicrobial Effects of Commensal Oral Species Are Regulated by Environmental Factors. J. Dent. 2016, 47, 23–33. [Google Scholar] [CrossRef]
  30. Huang, X.; Browngardt, C.M.; Jiang, M.; Ahn, S.-J.; Burne, R.A.; Nascimento, M.M. Diversity in Antagonistic Interactions between Commensal Oral Streptococci and Streptococcus Mutans. Caries Res. 2018, 52, 88–101. [Google Scholar] [CrossRef] [PubMed]
  31. Hanel, A.N.; Herzog, H.M.; James, M.G.; Cuadra, G.A. Effects of Oral Commensal Streptococci on Porphyromonas Gingivalis Invasion into Oral Epithelial Cells. Dent. J. 2020, 8, 39. [Google Scholar] [CrossRef] [PubMed]
  32. Joshi, V.; Matthews, C.; Aspiras, M.; de Jager, M.; Ward, M.; Kumar, P. Smoking Decreases Structural and Functional Resilience in the Subgingival Ecosystem. J. Clin. Periodontol. 2014, 41, 1037–1047. [Google Scholar] [CrossRef] [PubMed]
  33. Mason, M.R.; Preshaw, P.M.; Nagaraja, H.N.; Dabdoub, S.M.; Rahman, A.; Kumar, P.S. The Subgingival Microbiome of Clinically Healthy Current and Never Smokers. ISME J. 2015, 9, 268–272. [Google Scholar] [CrossRef]
  34. Cuadra, G.A.; Smith, M.T.; Nelson, J.M.; Loh, E.K.; Palazzolo, D.L. A Comparison of Flavorless Electronic Cigarette-Generated Aerosol and Conventional Cigarette Smoke on the Survival and Growth of Common Oral Commensal Streptococci. Int. J. Environ. Res. Public Health 2019, 16, 1669. [Google Scholar] [CrossRef]
  35. Nelson, J.M.; Cuadra, G.A.; Palazzolo, D.L. A Comparison of Flavorless Electronic Cigarette-Generated Aerosol and Conventional Cigarette Smoke on the Planktonic Growth of Common Oral Commensal Streptococci. Int. J. Environ. Res. Public Health 2019, 16, 5004. [Google Scholar] [CrossRef]
  36. Fischman, J.S.; Sista, S.; Lee, D.; Cuadra, G.A.; Palazzolo, D.L. Flavorless vs. Flavored Electronic Cigarette-Generated Aerosol and E-Liquid on the Growth of Common Oral Commensal Streptococci. Front. Physiol. 2020, 11, 585416. [Google Scholar] [CrossRef]
  37. Cichońska, D.; Kusiak, A.; Kochańska, B.; Ochocińska, J.; Świetlik, D. Influence of Electronic Cigarettes on Selected Antibacterial Properties of Saliva. Int. J. Environ. Res. Public Health 2019, 16, 4433. [Google Scholar] [CrossRef]
  38. Chopyk, J.; Bojanowski, C.M.; Shin, J.; Moshensky, A.; Fuentes, A.L.; Bonde, S.S.; Chuki, D.; Pride, D.T.; Crotty Alexander, L.E. Compositional Differences in the Oral Microbiome of E-Cigarette Users. Front. Microbiol. 2021, 12, 1250. [Google Scholar] [CrossRef]
  39. Pushalkar, S.; Paul, B.; Li, Q.; Yang, J.; Vasconcelos, R.; Makwana, S.; González, J.M.; Shah, S.; Xie, C.; Janal, M.N.; et al. Electronic Cigarette Aerosol Modulates the Oral Microbiome and Increases Risk of Infection. iScience 2020, 23, 100884. [Google Scholar] [CrossRef]
  40. He, J.; Li, Y.; Cao, Y.; Xue, J.; Zhou, X. The Oral Microbiome Diversity and Its Relation to Human Diseases. Folia Microbiol. 2015, 60, 69–80. [Google Scholar] [CrossRef] [PubMed]
  41. Palazzolo, D.; Nelson, J.M.; Hudson, Z. The Use of HPLC-PDA in Determining Nicotine and Nicotine-Related Alkaloids from E-Liquids: A Comparison of Five E-Liquid Brands Purchased Locally. Int. J. Environ. Res. Public Health 2019, 16, 3015. [Google Scholar] [CrossRef] [PubMed]
  42. Cuadra-Saenz, G.; Rao, D.L.; Underwood, A.J.; Belapure, S.A.; Campagna, S.R.; Sun, Z.; Tammariello, S.; Rickard, A.H. Autoinducer-2 Influences Interactions amongst Pioneer Colonizing Streptococci in Oral Biofilms. Microbiology 2012, 158, 1783–1795. [Google Scholar] [CrossRef] [PubMed]
  43. Foster, J.S.; Kolenbrander, P.E. Development of a Multispecies Oral Bacterial Community in a Saliva-Conditioned Flow Cell. Appl. Environ. Microbiol. 2004, 70, 4340–4348. [Google Scholar] [CrossRef] [PubMed]
  44. O’Toole, G.A. Microtiter Dish Biofilm Formation Assay. JoVE 2011, 2437. [Google Scholar] [CrossRef]
  45. Kolenbrander, P.E.; Palmer, R.J.; Rickard, A.H.; Jakubovics, N.S.; Chalmers, N.I.; Diaz, P.I. Bacterial Interactions and Successions during Plaque Development. Periodontol. 2000 2006, 42, 47–79. [Google Scholar] [CrossRef]
  46. Yoshida, Y.; Palmer, R.J.; Yang, J.; Kolenbrander, P.E.; Cisar, J.O. Streptococcal Receptor Polysaccharides: Recognition Molecules for Oral Biofilm Formation. BMC Oral Health 2006, 6 (Suppl. 1), S12. [Google Scholar] [CrossRef]
  47. Willcox, M.D.; Drucker, D.B. Surface Structures, Co-Aggregation and Adherence Phenomena of Streptococcus Oralis and Related Species. Microbios 1989, 59, 19–29. [Google Scholar]
  48. Yang, J.; Yoshida, Y.; Cisar, J.O. Genetic Basis of Coaggregation Receptor Polysaccharide Biosynthesis in Streptococcus Sanguinis and Related Species. Mol. Oral Microbiol. 2014, 29, 24–31. [Google Scholar] [CrossRef]
  49. Thomas, S.C.; Xu, F.; Pushalkar, S.; Lin, Z.; Thakor, N.; Vardhan, M.; Flaminio, Z.; Khodadadi-Jamayran, A.; Vasconcelos, R.; Akapo, A.; et al. Electronic Cigarette Use Promotes a Unique Periodontal Microbiome. mBio 2022, 13, e00075-22. [Google Scholar] [CrossRef]
  50. Ebersole, J.; Samburova, V.; Son, Y.; Cappelli, D.; Demopoulos, C.; Capurro, A.; Pinto, A.; Chrzan, B.; Kingsley, K.; Howard, K.; et al. Harmful Chemicals Emitted from Electronic Cigarettes Andpotential Deleterious Effects in the Oral Cavity. Tob. Induc. Dis. 2020, 18, 41. [Google Scholar] [CrossRef] [PubMed]
  51. Isik Andrikopoulos, G.; Farsalinos, K.; Poulas, K. Electronic Nicotine Delivery Systems (ENDS) and Their Relevance in Oral Health. Toxics 2019, 7, 61. [Google Scholar] [CrossRef] [PubMed]
  52. Kumar, P.S.; Clark, P.; Brinkman, M.C.; Saxena, D. Novel Nicotine Delivery Systems. Adv. Dent. Res. 2019, 30, 11–15. [Google Scholar] [CrossRef] [PubMed]
  53. Allen, J.G.; Flanigan, S.S.; LeBlanc, M.; Vallarino, J.; MacNaughton, P.; Stewart, J.H.; Christiani, D.C. Flavoring Chemicals in E-Cigarettes: Diacetyl, 2,3-Pentanedione, and Acetoin in a Sample of 51 Products, Including Fruit-, Candy-, and Cocktail-Flavored E-Cigarettes. Environ. Health Perspect. 2016, 124, 733–739. [Google Scholar] [CrossRef]
  54. Vape Flavors and Vape Juice: What You Need to Know. Available online: https://www.hopkinsmedicine.org/health/wellness-and-prevention/vape-flavors-and-vape-juice-what-you-need-to-know (accessed on 9 December 2021).
  55. Material Safety Data Sheet: Trans-Cinnamaldehyde. Available online: https://fscimage.fishersci.com/msds/96752.htm (accessed on 5 March 2022).
  56. Material Safety Data Sheet: Menthol. Available online: https://fscimage.fishersci.com/msds/23818.htm (accessed on 5 March 2022).
  57. Shen, S.; Zhang, T.; Yuan, Y.; Lin, S.; Xu, J.; Ye, H. Effects of Cinnamaldehyde on Escherichia Coli and Staphylococcus Aureus Membrane. Food Control 2015, 47, 196–202. [Google Scholar] [CrossRef]
  58. Silva, W.M.F.; Bona, N.P.; Pedra, N.S.; Cunha, K.F.D.; Fiorentini, A.M.; Stefanello, F.M.; Zavareze, E.R.; Dias, A.R.G. Risk Assessment of In Vitro Cytotoxicity, Antioxidant and Antimicrobial Activities of Mentha Piperita L. Essential Oil. J. Toxicol. Environ. Health A 2022, 85, 230–242. [Google Scholar] [CrossRef]
  59. An, S.-J.; Namkung, J.-U.; Ha, K.-W.; Jun, H.-K.; Kim, H.Y.; Choi, B.-K. Inhibitory Effect of D-Arabinose on Oral Bacteria Biofilm Formation on Titanium Discs. Anaerobe, 2022; in press. [Google Scholar] [CrossRef]
  60. Balasubramanian, A.R.; Vasudevan, S.; Shanmugam, K.; Lévesque, C.M.; Solomon, A.P.; Neelakantan, P. Combinatorial Effects of Trans-Cinnamaldehyde with Fluoride and Chlorhexidine on Streptococcus Mutans. J. Appl. Microbiol. 2021, 130, 382–393. [Google Scholar] [CrossRef]
  61. Kreth, J.; Merritt, J.; Qi, F. Bacterial and Host Interactions of Oral Streptococci. DNA Cell Biol. 2009, 28, 397–403. [Google Scholar] [CrossRef]
  62. Scannapieco, F.A. Saliva-Bacterium Interactions in Oral Microbial Ecology. Crit. Rev. Oral Biol. Med. 1994, 5, 203–248. [Google Scholar] [CrossRef]
  63. Rosan, B.; Lamont, R.J. Dental Plaque Formation. Microbes Infect. 2000, 2, 1599–1607. [Google Scholar] [CrossRef]
  64. Diaz, P.I.; Chalmers, N.I.; Rickard, A.H.; Kong, C.; Milburn, C.L.; Palmer, R.J.; Kolenbrander, P.E. Molecular Characterization of Subject-Specific Oral Microflora during Initial Colonization of Enamel. Appl. Environ. Microbiol. 2006, 72, 2837–2848. [Google Scholar] [CrossRef] [PubMed]
  65. Jakubovics, N.S.; Kolenbrander, P.E. The Road to Ruin: The Formation of Disease-Associated Oral Biofilms. Oral Dis. 2010, 16, 729–739. [Google Scholar] [CrossRef] [PubMed]
  66. Jensen, R.P.; Luo, W.; Pankow, J.F.; Strongin, R.M.; Peyton, D.H. Hidden Formaldehyde in E-Cigarette Aerosols. N. Engl. J. Med. 2015, 372, 392–394. [Google Scholar] [CrossRef]
  67. Kaufman, J.W.; Farahmand, K. In Vivo Measurements of Human Oral Cavity Heat and Water Vapor Transport. Respir. Physiol. Neurobiol. 2006, 150, 261–277. [Google Scholar] [CrossRef] [PubMed]
  68. Sosnowski, T.R.; Odziomek, M. Particle Size Dynamics: Toward a Better Understanding of Electronic Cigarette Aerosol Interactions with the Respiratory System. Front. Physiol. 2018, 9, 853. [Google Scholar] [CrossRef]
  69. Olmedo, P.; Goessler, W.; Tanda, S.; Grau-Perez, M.; Jarmul, S.; Aherrera, A.; Chen, R.; Hilpert, M.; Cohen, J.E.; Navas-Acien, A.; et al. Metal Concentrations in E-Cigarette Liquid and Aerosol Samples: The Contribution of Metallic Coils. Environ. Health Perspect. 2018, 126, 027010. [Google Scholar] [CrossRef]
  70. Palazzolo, D.L.; Crow, A.P.; Nelson, J.M.; Johnson, R.A. Trace Metals Derived from Electronic Cigarette (ECIG) Generated Aerosol: Potential Problem of ECIG Devices That Contain Nickel. Front. Physiol. 2016, 7, 663. [Google Scholar] [CrossRef]
  71. Marsh, P.D.; Head, D.A.; Devine, D.A. Dental Plaque as a Biofilm and a Microbial Community—Implications for Treatment. J. Oral Biosci. 2015, 57, 185–191. [Google Scholar] [CrossRef]
  72. Cichońska, D.; Kusiak, A.; Piechowicz, L.; Świetlik, D. A Pilot Investigation into the Influence of Electronic Cigarettes on Oral Bacteria. Pdia 2021, 38, 1092–1098. [Google Scholar] [CrossRef]
Figure 1. Dose-Dependent effect of E-liquids on Single-Species Biofilm Formation. Oral streptococci single-species biofilms biomass after treatment with 1, 3, and 5% E-liquids ± flavorings in 50% BHI. The color gradient for each E-liquid ± flavors ranges from light to dark indicating an increasing E-liquid percent. The given p values indicate significance between BHI 50% (positive control) and 5% peroxide (negative control) or BHI 50% and 1% E-liquid ± flavors using One-Way Anova. The red line indicates the average absorbance of the positive control. Three boxes above each E-liquid ± flavors indicate significance between them using Two-Way Anova. Each bar represents mean ± SE of absorbance (n = 10 to 24).
Figure 1. Dose-Dependent effect of E-liquids on Single-Species Biofilm Formation. Oral streptococci single-species biofilms biomass after treatment with 1, 3, and 5% E-liquids ± flavorings in 50% BHI. The color gradient for each E-liquid ± flavors ranges from light to dark indicating an increasing E-liquid percent. The given p values indicate significance between BHI 50% (positive control) and 5% peroxide (negative control) or BHI 50% and 1% E-liquid ± flavors using One-Way Anova. The red line indicates the average absorbance of the positive control. Three boxes above each E-liquid ± flavors indicate significance between them using Two-Way Anova. Each bar represents mean ± SE of absorbance (n = 10 to 24).
Dentistry 10 00085 g001
Figure 2. Dose-Dependent effect of E-liquids on Multi-Species (S. gordonii, S. intermedius, S. mitis and S. oralis) Biofilm Formation. Mixed streptococci (1:1:1:1) biofilms biomass after treatment with 1, 3, and 5% E-liquids ± flavorings in 50% BHI. The given p values indicate significance between BHI 50% (positive control) and 5% peroxide (negative control) or BHI 50% and 1% E-liquid ± flavors using One-Way Anova. The red line indicates the average absorbance of the positive control. The three boxes above each E-liquid ± flavors indicate significance between them using Two-Way Anova. Each bar represents mean ± SE of absorbance (n = 12 to 18).
Figure 2. Dose-Dependent effect of E-liquids on Multi-Species (S. gordonii, S. intermedius, S. mitis and S. oralis) Biofilm Formation. Mixed streptococci (1:1:1:1) biofilms biomass after treatment with 1, 3, and 5% E-liquids ± flavorings in 50% BHI. The given p values indicate significance between BHI 50% (positive control) and 5% peroxide (negative control) or BHI 50% and 1% E-liquid ± flavors using One-Way Anova. The red line indicates the average absorbance of the positive control. The three boxes above each E-liquid ± flavors indicate significance between them using Two-Way Anova. Each bar represents mean ± SE of absorbance (n = 12 to 18).
Dentistry 10 00085 g002
Figure 3. Effects of 3% E-liquids ± Flavors on Multi-Species (S. gordonii, S. intermedius, S. mitis, and S. oralis) Biofilm Formation. Confocal images of mixed streptococci (1:1:1:1) biofilms grown in 50% BHI with 3% E-liquids ± flavorings. The positive control is the 50% BHI alone. The negative control is the 5% Peroxide in 50% BHI. Biofilms were stained with SYTO 59 (red fluorescence). Each image is a typical representative of eight fields of view. Magnification = 630× Z-stacks were acquired at 1 µm thickness of optical slicing. Images are representative of eight different fields of view.
Figure 3. Effects of 3% E-liquids ± Flavors on Multi-Species (S. gordonii, S. intermedius, S. mitis, and S. oralis) Biofilm Formation. Confocal images of mixed streptococci (1:1:1:1) biofilms grown in 50% BHI with 3% E-liquids ± flavorings. The positive control is the 50% BHI alone. The negative control is the 5% Peroxide in 50% BHI. Biofilms were stained with SYTO 59 (red fluorescence). Each image is a typical representative of eight fields of view. Magnification = 630× Z-stacks were acquired at 1 µm thickness of optical slicing. Images are representative of eight different fields of view.
Dentistry 10 00085 g003
Figure 4. Streptococcal Morphology after E-liquid or stock flavor treatments. Light microscopy images were taken at 1000× magnification after treatment with 100 µL of PBS, flavorless E-liquid, or the five stock flavoring agents. The green arrow indicates menthol crystalline formation and the orange arrow points at the presence of a hydrophobic material associated with cinnamon. Black bars on top four images = 10 µm. Images are representative of four different fields of view.
Figure 4. Streptococcal Morphology after E-liquid or stock flavor treatments. Light microscopy images were taken at 1000× magnification after treatment with 100 µL of PBS, flavorless E-liquid, or the five stock flavoring agents. The green arrow indicates menthol crystalline formation and the orange arrow points at the presence of a hydrophobic material associated with cinnamon. Black bars on top four images = 10 µm. Images are representative of four different fields of view.
Dentistry 10 00085 g004
Figure 5. Death Curves of Streptococci after E-liquid ± menthol or cinnamon. Death curves performed with all four species of streptococci using E-liquid ± flavors from 0 to 25% in PBS. Each data point represents mean ± SEM (n = 6). Green stars and orange stars indicate significance between flavorless E-liquid and menthol and cinnamon, respectively. * p < 0.05, ** p < 0.01 and *** p < 0.001.
Figure 5. Death Curves of Streptococci after E-liquid ± menthol or cinnamon. Death curves performed with all four species of streptococci using E-liquid ± flavors from 0 to 25% in PBS. Each data point represents mean ± SEM (n = 6). Green stars and orange stars indicate significance between flavorless E-liquid and menthol and cinnamon, respectively. * p < 0.05, ** p < 0.01 and *** p < 0.001.
Dentistry 10 00085 g005
Figure 6. (A). Pellet Mass before and after E-liquid or stock flavor treatments. The weight of oral streptococci pellets was determined before and after treatment with 100 µL of PBS, or 100 µL of flavorless E-liquid, or cinnamon or menthol stock flavorings. Each bar represents mean ± SEM (n = 3). ** p < 0.01, *** p < 0.001. (B). Pellet size of representative centrifuge tubes. Bacteria were exposed to 100 µL of PBS, flavorless E-liquid, or cinnamon and menthol flavoring agents for 15 min. Bacteria were then washed and pelleted. Green arrows indicate precipitation of menthol crystals and orange arrows indicate the presence of a hydrophobic material associated with the cinnamon flavor.
Figure 6. (A). Pellet Mass before and after E-liquid or stock flavor treatments. The weight of oral streptococci pellets was determined before and after treatment with 100 µL of PBS, or 100 µL of flavorless E-liquid, or cinnamon or menthol stock flavorings. Each bar represents mean ± SEM (n = 3). ** p < 0.01, *** p < 0.001. (B). Pellet size of representative centrifuge tubes. Bacteria were exposed to 100 µL of PBS, flavorless E-liquid, or cinnamon and menthol flavoring agents for 15 min. Bacteria were then washed and pelleted. Green arrows indicate precipitation of menthol crystals and orange arrows indicate the presence of a hydrophobic material associated with the cinnamon flavor.
Dentistry 10 00085 g006
Table 1. Final percentage of flavors in the working BHI broth.
Table 1. Final percentage of flavors in the working BHI broth.
E-Liquid ConstituentsPercent
Stock E-Liquid added to BHI *
Stock
E-Liquid
Propylene GlycolVegetable GlycerineStock FlavorNicotine
(mg/mL)
5%3%1%
Flavorless50%50%0%200%0%0%
Flavored37.5%37.5%25%201.25%0.75%0.25%
* Final percentage flavoring in the working BHI broth after the addition of 5, 3, and 1% stock E-liquids.
Table 2. Comparison of Absorbance Readings of Flavorless E-liquid vs. each of the Flavored E-liquids.
Table 2. Comparison of Absorbance Readings of Flavorless E-liquid vs. each of the Flavored E-liquids.
S. gordoniiFlavorlessTobaccoMentholCinnamonStrawberryBlueberry
1% E-liquid0.77 ± 0.07 *0.76 ± 0.070.84 ± 0.070.65 ± 0.030.81 ± 0.070.81 ± 0.07
3% E-liquid0.55 ± 0.030.57 ± 0.050.40 ± 0.050.25 ± 0.05
p < 0.001
0.50 ± 0.050.60 ± 0.05
5% E-liquid0.30 ± 0.030.33 ± 0.040.12 ± 0.02
p < 0.01
0.04 ± 0.03
p < 0.001
0.29 ± 0.030.31 ± 0.03
S. intermediusFlavorlessTobaccoMentholCinnamonStrawberryBlueberry
1% E-liquid1.16 ± 0.041.23 ± 0.031.15 ± 0.040.38 ± 0.08
p < 0.001
1.16 ± 0.041.21 ± 0.03
3% E-liquid1.04 ± 0.041.00 ± 0.040.89 ± 0.060.07 ± 0.03
p < 0.001
0.96 ± 0.061.05 ± 0.03
5% E-liquid0.70 ± 0.040.63 ± 0.070.46 ± 0.040.07 ± 0.04
p < 0.001
0.55 ± 0.100.69 ± 0.05
S. mitisFlavorlessTobaccoMentholCinnamonStrawberryBlueberry
1% E-liquid0.48 ± 0.030.54 ± 0.050.49 ± 0.030.37 ± 0.060.54 ± 0.050.52 ± 0.05
3% E-liquid0.43 ± 0.030.39 ± 0.010..33 ± 0.02
p < 0.05
0.14 ± 0.03
p < 0.001
0.39 ± 0.020.40 ± 0.02
5% E-liquid0.28 ± 0.030.25 ± 0.030.09 ± 0.02
p < 0.001
0.05 ± 0.03
p < 0.001
0.26 ± 0.030.27 ± 0.02
S. oralisFlavorlessTobaccoMentholCinnamonStrawberryBlueberry
1% E-liquid0.68 ± 0.020.72 ± 0.020.58 ± 0.020.35 ± 0.03
p < 0.001
0.74 ± 0.030.65 ± 0.05
3% E-liquid0.44 ± 0.020.47± 0.020.33 ± 0.02
p < 0.01
0.15 ± 0.02
p < 0.001
0.52 ± 0.030.49 ± 0.02
5% E-liquid0.32 ± 0.030.30 ± 0.030.11 ± 0.03
p < 0.001
0.04 ± 0.03
p < 0.001
0.20 ± 0.010.33 ± 0.04
Mixed Species #FlavorlessTobaccoMentholCinnamonStrawberryBlueberry
1% E-liquid0.67 ± 0.030.71 ± 0.040.61 ± 0.040.45 ± 0.04
p < 0.001
0.70 ± 0.030.75 ± 0.02
3% E-liquid0.50 ± 0.030.43 ± 0.020.27 ± 0.03
p < 0.001
0.15 ± 0.03
p < 0.001
0.44 ± 0.030.51 ± 0.03
5% E-liquid0.36 ± 0.040.25 ± 0.030.31 ± 0.02
p < 0.001
−0.14 ± 0.01
p < 0.001
0.21 ± 0.03
p < 0.01
0.30 ± 0.02
* All values expressed as mean ± SEM of absorbance (n = 10 to 24). # S. gordonii, S. intermedius, S. mitis, and S. oralis mixed at a 1:1:1:1 ratio.
Table 3. Colony Forming Unit Assay.
Table 3. Colony Forming Unit Assay.
S. gordoniiS. intermediusS. mitisS. oralis
PBS++++++++++++
Flavorless E-liquid++++++++++
Tobacco++++++
Menthol
Cinnamon
Strawberry
Blueberry
Each assay consisted of n = 4 and the amount of CFUs was visually ranked as follows: +++ bacterial lawns; ++ too many to count; + countable colonies; − growth was not detected.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Xu, C.P.; Palazzolo, D.L.; Cuadra, G.A. Mechanistic Effects of E-Liquids on Biofilm Formation and Growth of Oral Commensal Streptococcal Communities: Effect of Flavoring Agents. Dent. J. 2022, 10, 85. https://doi.org/10.3390/dj10050085

AMA Style

Xu CP, Palazzolo DL, Cuadra GA. Mechanistic Effects of E-Liquids on Biofilm Formation and Growth of Oral Commensal Streptococcal Communities: Effect of Flavoring Agents. Dentistry Journal. 2022; 10(5):85. https://doi.org/10.3390/dj10050085

Chicago/Turabian Style

Xu, Christina P., Dominic L. Palazzolo, and Giancarlo A. Cuadra. 2022. "Mechanistic Effects of E-Liquids on Biofilm Formation and Growth of Oral Commensal Streptococcal Communities: Effect of Flavoring Agents" Dentistry Journal 10, no. 5: 85. https://doi.org/10.3390/dj10050085

APA Style

Xu, C. P., Palazzolo, D. L., & Cuadra, G. A. (2022). Mechanistic Effects of E-Liquids on Biofilm Formation and Growth of Oral Commensal Streptococcal Communities: Effect of Flavoring Agents. Dentistry Journal, 10(5), 85. https://doi.org/10.3390/dj10050085

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop