Next Article in Journal
Effect of Ni Substitution on Thermoelectric Properties of Bulk β-Fe1−xNixSi2 (0 ≤ x ≤ 0.03)
Previous Article in Journal
Enhanced Emission of Tellurite Glass Doped with Pr3+/Ho3+ and Their Applications
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Active Biohybrid Nanocomposite Films Made from Chitosan, ZnO Nanoparticles, and Stearic Acid: Optimization Study to Develop Antibacterial Films for Food Packaging Application

1
Department of Food Science and Technology, Faculty of Agricultural Engineering and Technology, IPB University, Bogor 16880, Indonesia
2
MATIM, UFR Sciences Exactes et Naturelles, Université de Reims Champagne-Ardenne, Campus Moulin de la Housse, 51100 Reims, France
3
Food Quality Assurance, College of Vocational Studies, IPB University, Bogor 16128, Indonesia
*
Authors to whom correspondence should be addressed.
Materials 2023, 16(3), 926; https://doi.org/10.3390/ma16030926
Submission received: 7 December 2022 / Revised: 11 January 2023 / Accepted: 16 January 2023 / Published: 18 January 2023

Abstract

:
Chitosan is a biopolymer with great potential as food packaging due to its ability to create a film without additives and its better mechanical and antibacterial qualities compared to other biopolymers. However, chitosan film still has limitations due to its high moisture sensitivity and limited flexibility. Incorporating ZnO nanoparticles (ZnO-NPs) and stearic acid (SA) into chitosan films was expected to improve tensile strength, water vapor barrier, and antibacterial capabilities. This study aims to find the optimal formula for biohybrid nanocomposite films composed of chitosan, ZnO-NPs, and SA. The full factorial design approach—4 × 2 with 3 replicates, i.e., two independent variables, namely %ZnO-NPs at 4 levels (0%, 0.5%, 1%, and 3%, w/w) and %SA at 2 levels (0% and 5%, w/w)—was utilized to optimize chitosan-based biohybrid nanocomposite films, with the primary interests being antibacterial activities, water vapor barrier, and tensile strength. The incorporation of ZnO-NPs into chitosan films could increase antibacterial activity, while SA decreased it. The addition of SA had a good effect only in decreasing water vapor transmission rate (WVTR) values but a detrimental effect on other film properties mentioned above. The incorporation of ZnO-NPs enhanced all functional packaging properties of interest. The suggested solution of the optimization study has been validated. As a result, the formula with the inclusion of 1% ZnO-NPs without SA is optimal for the fabrication of active antibacterial films with excellent multifunctional packaging capabilities.

1. Introduction

Food contact materials are materials and articles that are intended for direct contact with food, such as containers and packaging. These can be created from plastic, rubber, paper, and metal [1]. Plastic is the most used material for food packaging since it is flexible, easy to mold, heat sealable, lightweight, tough to break, and inexpensive to make. Thus, over 50% of packaged food in Europe is packed in plastics [2], and the packaging sector has become Europe’s largest end-use market for plastic [3]. However, many plastics are single-use, which, when combined with low recycling or reuse rates, contributes significantly to environmental pollution [4]. Plastic packaging’s environmental consequences have inspired research in eco-friendly packaging materials, such as polysaccharides, proteins, and lipids.
Thanks to their ability to form films, nontoxicity, low cost, strong mechanical and gas barrier properties, accessibility, and biodegradability [5,6], polysaccharides are the most often-utilized material. Due to its chemical-free film production and antibacterial properties, chitosan has been the subject of many research studies on different polysaccharides seeking to create active antimicrobial food packaging. Chitosan has been used in numerous foods as a natural preservative, but its poor mechanical resistance, water resistance, and barrier properties have limited its application [7]. To avoid these drawbacks, it is conceivable to create biohybrid nanocomposite films by reinforcing chitosan with nanosized fillers [8].
Biohybrid nanocomposite is defined as a bio-based polymer loaded with inorganic nanoparticles, such as metal oxides, clays, and silica [9]. The incorporation of inorganic nanoparticles into bio-based polymers as food contact materials intends to enhance the mechanical and barrier properties of the polymers while also offering an active function. ZnO-NPs are the most promising inorganic nanoparticles due to their amazing physical and chemical characteristics. Recently, Aji et al. [10] conducted a meta-analysis on the evaluation of numerous factors of ZnO-NPs on bionanocomposite film properties. According to the current meta-analysis, using ZnO-NPs as nanofillers in bionanocomposite films significantly enhanced tensile strength, elongation at break, and water vapor permeability (WVP). In addition, this study demonstrated that the optimal film characteristics for increasing the shelf-life of food products could be achieved by deploying ZnO-NPs with proper specifications.
ZnO-NPs are nontoxic inorganic metal oxides widely applied in the food industry as zinc supplements and antibacterial agents, particularly in edible coatings, to prevent food spoilage by fungi and bacteria. The incorporation of ZnO-NPs could increase the antibacterial activity of the packaging system for extending the shelf-life of foods packaged with these materials. The United States Food and Drug Administration (FDA) has categorized ZnO as generally recognized as a safe substance (GRAS) [11,12] since it is nontoxic to human cells. Siddiqi et al. [13] evidenced that ZnO-NPs with concentrations exceeding 100 g/mL were harmful, but ZnO-NPs with concentrations below 100 g/mL were safe. In addition, Jayasuriya et al. [14] discovered that composite films containing 1% ZnO-NP by weight (particle size about 30 nm) revealed low cytotoxicity of cells, but ZnO-NP concentrations larger than 5% exhibited evident toxicity. Several studies have shown that biohybrid chitosan-ZnO-NP nanocomposite films are superior for retaining fruit color, minimizing water loss, enhancing antibacterial activity, and extending the freshness period. Li et al. [8] and Rahman et al. [15] showed that chitosan – ZnO-NPs composite films could extend the shelf life of cherry tomatoes and raw beef, respectively.
Stearic acid (SA) is a saturated fatty acid known for its benefit on water vapor barrier properties. It has been commonly incorporated into biopolymer-based films, such as starch [16,17,18], hydroxypropyl methylcellulose [19], and gelatin [20], to increase the water vapor barrier. Casillas-Vargas et al. [21] found that SA has antibacterial activity against gram-positive and gram-negative microorganisms. However, the antibacterial activity of SA in biocomposite films has not been investigated yet. Thus, the combination of ZnO-NPs and SA can enhance several functional packaging properties, such as the water vapor barrier, mechanical properties (higher tensile strength and elasticity simultaneously), and antibacterial properties of chitosan-based biohybrid nanocomposite films.
This work aimed to find the optimal formulation for producing chitosan, ZnO-NP, and SA biohybrid nanocomposite films. The best combination of mechanical, water vapor transmission rate and antibacterial properties against gram-negative and gram-positive bacteria was determined using a full factorial design (FFD) during the optimization phase. Differential scanning calorimetry (DSC), Fourier-transform infrared (FTIR) spectroscopy, scanning electron microscopy (SEM), and other physical characterization techniques were also used to investigate representative samples of biohybrid nanocomposite films in this study. This research could provide the optimal formulation and guidance for preparing biohybrid nanocomposite films, which could be used as active antibacterial films or coatings for food packaging applications.

2. Materials and Methods

2.1. Materials

The materials used for producing nanocomposite films/coatings were chitosan powder with a 90.2% degree of deacetylation (measured via colloid titration) from Biotech Surindo (Cirebon, Indonesia), Glycerol 99% Sigma Aldrich, Darmstadt, Germany), ZnO-NPs with an average particle size of 20 nm and 95% purity from Wako Pure Chemicals (Osaka, Japan), and lactic acid 90% (Sigma Aldrich, Darmstadt, Germany). Nutrient agar and nutrient broth (Merck KGaA, Darmstadt, Germany) were employed for the antimicrobial activity test; test cultures taken from the collection of SEAFAST CENTER IPB University were Bacillus cereus (ATCC 11778), Escherichia coli (ATCC 25922), and Staphylococcus aureus (ATCC 25923).

2.2. Nanocomposite Film/Coating Solution Preparation

Figure 1 illustrates the process flowchart used to produce chitosan–ZnO NPs biohybrid nanocomposite films with or without stearic acid. ZnO-NPs were first dispersed in lactic acid 2% with or without stearic acid with Tween 80 (Merck KGaA, Darmstadt, Germany) as emulsifier and homogenized using a high-speed homogenizer at 15,000 rpm for 2 min (POLYTRON Homogenizer from Kinematica AG, Malters, Switzerland) until a homogenous solution was obtained. Chitosan powder and glycerol chitosan polymer could act as capping agents for ZnO-NPs in this blending system to prevent stearic acid and ZnO-NPs from aggregating. The generated biohybrid nanocomposite solutions were then poured into a poly (tetrafluoroethylene) (PTFE) mold with dimensions of 40 × 30 × 5 cm3 to a solution depth of approximately 2 cm and dried in an oven drier at 40 °C for 24 h Before testing, the dry films were scraped from the casting surface and preconditioned in a desiccator at room temperature for two days at 75% relative humidity.

2.3. Optimization Using a Full Factorial Design and Statistical Analysis

Design Expert V13 (StatEase, Minneapolis, MN, USA) was used to build a full factorial design with multilevel categories for generating experimental runs, analyzing data (ANOVA and fit statistics with α = 0.05 for significant level), and optimizing and confirming the optimal formula. We defined two independent variables: ZnO-NP concentration at four levels (0%, 0.5%, 1%, 3% by weight of chitosan) and stearic acid (SA) amount at two levels (0% and 5% by weight of chitosan) with a constant amount of glycerol as a plasticizer and the addition of Tween 80 as an emulsifier when stearic acid was used. The amounts of ZnO-NPs and stearic acid used in this study refer to our previous studies with pectin and starch as biopolymer matrix [16]. While the responses (dependent variables) were water vapor permeability (WVP), percent elongation at break (% EB), tensile strength at break (TS), and antibacterial activity against Bacillus cereus, Staphylococcus aureus, and Escherichia coli indicated by inhibitory zone diameter. Further analyses include DSC thermal analysis, water activity, and SEM observation of film microstructure.
The mathematical model representing the response of a full factorial design is a linear polynomial model whose interactions are described by Equation (1).
Yijk = μ + Ai + Bj + (AB)ij + εijk
where Y is the response and A, B, and AB are coded independent variables corresponding to the concentration of ZnO-NPs, the concentration of stearic acid, and their interaction, respectively. Indexes “i”, “j”, and “k” values are taken as i = 0%, 0.5%, 1%, and 3%; j = 0% and 5%; and k = 1, 2, 3 (number of replication).

2.4. Analysis of Biohybrid Nanocomposite Films

2.4.1. Water Vapor Transmission Test Using Gravimetric Method

The water vapor transmission rate (WVTR) of the film was measured using a gravimetric technique (ASTM E-96) and the dry cup system. Desiccant (CaCl2) was placed in cups. Circular film samples (2.5 cm in diameter) were then placed on top of the cups and covered with wax to guarantee no water vapor leakage during the sample test. Before immersing the cup in a desiccator containing a saturated K2SO4 salt solution (97% RH), its initial weight was measured with an accuracy of 0.0001 g. The entire assembly was afterward weighed consistently every two hours for three days. We checked that no leakage occurred such that the whole increase in sample mass can be attributed to water vapor transmission. A graph depicting the relationship between weight gain and time is also drawn. WVTR is computed with Equation (2), given below:
WVTR =   g r a p h   s l o p e   ( g d a y ) s a m p l e   a r e a   ( m 2 )
WVTR units are g/(m2 day), measured at ∆RH = RHout − RHin = 97% RH at the temperature of 30 °C. All film samples for WVTR measurement were selected with the same thickness in the range of 33.2–33.7 μm.

2.4.2. Mechanical Properties

A tensile testing machine was utilized to evaluate the films’ mechanical properties (Instron 4411, Norwood (Massachusetts), USA). In order to compute the cross-sectional area, the thicknesses of the film specimens were determined using a digital micrometer (Digimatic Micrometer, Mitutoyo, Japan) prior to testing. Each film specimen was placed between the grips of the tensile testing apparatus and tested with an initial grip spacing of 50 mm and a crosshead speed of 1 mm/s. The mechanical tests were replicated seven times. The tensile strength was calculated as the maximum force at break divided by the initial cross-sectional area of the film, and elongation at break (in %) was calculated as the delta length at break (∆L) divided by the initial gauge length.

2.4.3. Antibacterial Activity with Agar Well Diffusion Assay

Bacillus cereus (ATCC 11778), Escherichia coli (ATCC 25922), and Staphylococcus aureus (ATCC 25923) were inoculated into 100 mL of Nutrient Agar (NA) with 0.2 mL containing 1 × 108 CFU/mL, standardized with McFarland (standard 1). After solidification, five pieces were bored with a sterile cork borer to create a “well”. Five wells were filled with four treatments of biohybrid nanocomposite solution and one (in the center) with sterile water. The incubation was then completed for 24 h at 37 °C. Subtracting the exterior diameter from the inner diameter of the clear zone of the “well” yields the inhibition zone (cm).

2.4.4. Scanning Electron Microscopy

Scanning electron micrographs were obtained using a Jeol JSM-5600LV (JEOL, Akishima, Japan). Film specimens were mounted on an aluminum stub covered with double-sided carbon tape and sputter-coated with gold to enhance surface conductivity. All specimens were observed in SEM at 5 kV.

2.4.5. Thermal Analysis by DSC

Using a differential scanning calorimeter (SHIMADZU DSC-60, Kyoto, Japan), the thermal properties of the films were measured. After conditioning a sample specimen, 10 mg-weighted samples were cut and sealed in aluminum pans. The analysis was conducted between −30 °C and 300 °C at a scanning rate of 10 °C/min with an empty pan as a reference sample.

2.4.6. FTIR Spectroscopy Analysis

FTIR spectra of chitosan and biohybrid nanocomposite films with and without SA were recorded using a Fourier-transform infrared spectrophotometer (Spectrum One FT-IR spectrometer, Perkin Elmer, Waltham, MA, USA) in the frequency range of 400–4000 cm−1. Sample films with thicknesses of around 20–30 μm were used for measurement. Each sample was scanned 16 times.

2.4.7. Water Activity

Water activity was measured using the aw meter (Shibaura WA–360, Saitama, Japan). Prior to measurement, the instrument was first calibrated using a saturated salt solution of NaCl. The recording was performed on the aw value and temperature at the time of measurement.

3. Results and Discussion

3.1. Optimization Process with Full Factorial Design

3.1.1. Number of Runs and Multiple Responses for the Optimization

Design-Expert® software (DX13) offering a “Multilevel Categoric” option, which is known as a “general or conventional factorial” [22], is used in the present study. Design of the experiment by using full factorial facilitates the simultaneous assessment of the impact of using ZnO-NPs and SA as well as their interaction effects on the targeted responses. Table 1 presents the total 24 runs obtained from the full factorial design (4 × 2 with three replications). The order of run was randomized to optimize the process variable together with the experimental and the dependent variables, i.e., WVTR, %EB, TS, and antibacterial activity.

3.1.2. Analysis of Variance (ANOVA) and Independent Variables’ Effect on Multiple Responses

The results of variance analysis (ANOVA) are presented in Table 2. It shows that the p-values of the factorial model for all response parameters are less than 0.01%, indicating that all models are valid. Table 2 also shows the main effect of Factors A (%ZnO-NPs) and B (%SA) and their interaction (AB). All responses with p-values less than 0.01% indicate significant effects of factors and their interaction. In the case of tensile strength, there was no significant interaction effect between ZnO-NP and SA (p = 0.4524). Additionally, Table 2 indicates that all the predicted R² of the responses are in reasonable agreement with the adjusted R²; i.e., the difference was less than 0.2, indicating that the fit statistics and all responses are qualified for the optimization process. Moreover, concerning the adequate precision, when measuring the signal-to-noise ratio (S/N ratio), a ratio greater than 4 is desirable. The current study led to ratios of 43.4378, 23.1187, 25.5774, 18.1951, 8.8458, 17.788 for response WVTR, %EB, TS, B. cereus, S. aureus, and E. coli, respectively, indicating an adequate signal. This confirms that each model of all responses can be used to navigate in the design space or qualified to be included in the optimization stage.
Figure 2 depicts the interaction effect of ZnO-NPs and SA on multiple responses: WVTR; % EB; Tensile Strength; and antibacterial activity against B. cereus; S. aureus; and E. coli. Except for tensile strength, Figure 2 indicates the significant effect of the interaction between ZnO-NPs and SA. In Figure 2C, the dashed red lines (representing 0% SA) and the solid green line (representing 5% SA) are nearly parallel, indicating no significant interaction. However, in Figure 2A,B,D–F, the dashed red lines and solid green lines are far from parallel, indicating a significant interaction between ZnO-NPs and SA.
Figure 2 reveals that the addition of SA has a favorable effect on the reduction of the WVTR value, which increases the water vapor barrier, but a negative effect on the other responses, i.e., a decrease in elongation at break, tensile strength, and antibacterial activities. Fortunately, the addition of ZnO-NPs has favorable effects on all responses, including a decrease of WVTR (Figure 2A), and an improvement of elongation at break (Figure 2B), tensile strength (Figure 2C), and antibacterial activities as well (Figure 2D–F).

Main Factor and the Interaction Effects on WVTR

With the addition of ZnO-NPs, lower WVTR values were obtained, as shown in Figure 2A. The lowest WVTR value is seen with the addition of 3% ZnO-NPs, which is 27.23 g/(m2.day). However, this WVTR value was not significantly different from the WVTR value with 1% ZnO-NPs (p > 0.05). Therefore, 1% ZnO-NPs is sufficient for generating films with excellent moisture barrier properties. Regarding the addition of SA, WVTR values were reduced when compared to similar formulations without stearic acid. Nevertheless, the reduction in WVTR values was not significantly different between formulations containing SA and those without SA (p > 0.05).

Main Factor and Interaction Effects on Mechanical Properties

The mechanical properties of films are illustrated in Figure 2B,C. It is noticed that when ZnO-NP content increased, the film’s tensile strength increased (Figure 2C). The addition of ZnO-NPs will fill the chitosan polymer matrix structure, enhancing the film’s integrity. Adding up to 3% ZnO-NPs to the biohybrid nanocomposite solution provided the strongest film in terms of tensile strength, elasticity, and strength for use as food packaging material. Unfortunately, the addition of SA to biohybrid nanocomposite films had unfavorable effects on film quality. The addition of SA reduces the film’s tensile strength compared to identical formulations without SA. The addition of SA may hinder the penetration of ZnO-NPs into the chitosan polymer matrix structure, resulting in a film with lower integrity than a film without SA. Based on an ANOVA analysis with a level of confidence of 5%, it was determined that the addition of SA led to a significant difference in the tensile strength of the film without the addition of SA. This demonstrates that the presence of SA has a negative effect; i.e., it may disrupt the films’ integrity.
Regarding the elasticity of films, as assessed by the %elongation (Figure 2B), the use of ZnO-NPs as a nanofiller for chitosan seems to have limitations. The %EB value increased with the addition of ZnO-NPs up to 1%, then dropped with the addition of 3% ZnO-NPs. This indicates that the formula with 1% ZnO-NPs may produce the highest %EB. The inclusion of SA tends to reduce the %EB values of nanocomposite films, as seen in Figure 2B. As for tensile strength, the presence of SA possibly created nonhomogeneous mixtures of chitosan–ZnO-NPs biohybrid nanocomposite films and weakened the resulting films’ integrity.

Main Factor and Interaction Effects on Antibacterial Activity

Figure 2D–F depict the antibacterial activity of biohybrid nanocomposite films produced using the “well method”. This investigation was conducted to test the antibacterial activity of chitosan-based biohybrid nanocomposite formulations as a function of ZnO-NP and SA concentrations. Bacillus cereus (Gram+), Staphylococcus aureus (Gram+), and Escherichia coli (Gram−) were the pathogenic bacteria tested. Due to differences in gram-positive and gram-negative bacteria cell walls, biohybrid nanocomposites are effective as antibacterial agents for both types of bacteria.
Gram-positive cell walls contain teichoic acid with a peptidoglycan (PG) thickness between 20 and 50 nm. Gram-negative bacteria have a cell wall component that is more complicated in terms of structure and chemistry than gram-positive bacteria [23,24]. Gram-negative cell walls contain a thin PG layer and a protective outer membrane. Metal oxide nanoparticles are known to be toxic to gram-positive bacteria [13], while chitosan solution’s antibacterial capabilities are more efficient against gram-negative bacteria [25]. The antibacterial activity of biohybrid nanocomposites is measured by the size of the clear zone, also known as the inhibitory zone. The wider the inhibitory zone formed, the greater the biohybrid nanocomposite antibacterial effectiveness. Theoretically, gram-positive bacteria (B. cereus and S. aureus) will be more easily affected by the antimicrobial properties of bionanocomposites because the cell wall of gram-positive bacteria does not have an outer membrane that can prevent the entry of hydrophobic compounds such as chitosan suspension into the cell. However, the sensitivity levels of bacteria do not depend only on the type of cell wall. Several other factors can affect the tolerance of bacteria to nanoparticles.
Antibacterial activity is one of the benefits of utilizing ZnO-NPs for film packaging. ZnO-NPs contribute to antibacterial properties to the active packaging via photon-induced production of reactive oxygen species (ROS) and the release of Zn2+ ions. ZnO-NPs can be applied to food surfaces in contact with pathogenic bacteria, resulting in bacterial death [26]. Figure 2D–F depict the results of the antibacterial activity of the chitosan-based biohybrid nanocomposite. With the addition of ZnO-NPs, the inhibition zone against gram-positive and gram-negative pathogenic bacteria increased. At a concentration of 3% ZnO-NPs, antibacterial activity was reduced. The expected result of incorporating SA into biohybrid nanocomposite films was not achieved. Figure 2D–F demonstrate that adding SA diminished the antibacterial activity of biohybrid nanocomposite films. Even though Casillas-Vargas et al. [21] found that SA has antibacterial action against gram-positive and gram-negative bacteria, it generates nonhomogenous mixtures that might alter the effect of ZnO-NPs.

3.1.3. Optimization of the Multiple Responses

In the optimization process, the goal for independent variables was set to “in range”, and the importance level was set to 3 (default), while the goals of each response were set according to the research purposes (Table 3), i.e., WVTR was minimized to obtain maximum water vapor barrier; %EB was maximized to obtain maximum elasticity for avoiding crack during the application, and tensile strength was set to “in range” because application as edible film/coating does not require a rigid property. Consequently, the answer importance level was adjusted to 5 for all responses except tensile strength, which was set to 3.
Eight solutions were obtained using the Design Expert software, as shown in Table 4. The values of desirability range from 0 to 1, and the solution whose desirability values are close to 1 must be chosen as the optimal formula. Solution No. 1 is found to have the highest desirability value, which is 0.904. Thus, the formula achieved by combining ZnO-NPs with 1% by weight of chitosan without adding SA is considered optimal.

3.1.4. Confirmation of the Optimum Formula

To confirm the optimal formula suggested by DX13, biohybrid nanocomposite films prepared with chitosan with 1% (w/w) ZnO-NPs without SA were produced six times, and the results are shown in Table 5. The average measurements were then compared to the DX13 prediction value shown in Table 6. All response data means fall between the 95% predicted interval (PI) low and 95% predicted interval (PI) high, indicating that the optimal formula was reached by utilizing 1% ZnO-NPs without SA. Despite the fact that the data mean for antibacterial activity against S. aureus was outside the expected interval, the actual value was greater than 95% PI high, so the research objective was achieved.
Based on the optimization and confirmation results, the formulation containing 1% (w/w) ZnO-NPs without the addition of SA should be the optimal formulation for use as an active film/coating. This observation was consistent with Figure 2 in that utilizing 3% (w/w) ZnO-NPs had a diminished beneficial effect. Furthermore, Jayasuriya et al. [13] showed that composite films containing 1% ZnO-NP (30 nm) would not induce cytotoxicity in cells, i.e., they would not be harmful to humans.

3.2. Films Morphology Observed by SEM

Figure 3 shows the surface morphology of chitosan films and chitosan – ZnO-NPs nanocomposite films. Figure 3A depicts the control film (chitosan alone), while Figure 3B,C exhibit biohybrid nanocomposite films formed from chitosan+ZnO-NPs with and without 5% SA, respectively. Both Figure 3A,B displayed a flat surface. In Figure 3B, a homogeneous structure with the appearance of ZnO-NPs as tiny white spots can be observed. ZnO-NP size is less than 100 nm, as measured using an SEM scale. This observation indicates that chitosan and ZnO-NPs were successfully fabricated into active biohybrid nanocomposite films. A similar result was reported by Shahvalizadeh et al. [27] that used gelatin as a biopolymer matrix. However, an uneven shape was observed when 5% stearic acid was added to the chitosan+1% ZnO-NPs matrix (Figure 3C). Figure 3C displays a rough surface, and it is probable that nanocomposite film structures contained micro-cracks. The addition of SA rendered the surface of chitosan+ZnO-NPs rougher and more heterogeneous, which explains the decreased effects on multiple responses, except on WVTR.

3.3. Water Activity

Measurement of water activity (aw) aims to measure the ease with which microbes, such as bacteria, yeast, or mold, grow on this biohybrid nanocomposite film. The lower the aw value, the more difficult it is for microbes to grow on it. Data measurements of aw are presented in Figure 4, which shows the trend of reduction in aw values with the addition of ZnO-NPs: the higher ZnO-NPs content is, the lower the aw value is. The opposite effect was obtained by using SA: the presence of SA in the chitosan and chitosan+ZnO-NPs films increased the water activity value. For the purpose of food preservation, the higher aw value is not expected because it is more favorable for microbial growth.

3.4. Thermal Properties

The thermal characteristics of the produced films were determined using DSC analysis. Due to its efficiency in revealing the thermal characteristics of chitosan, the approach of Erol et al. [28] was applied. The DSC thermograms of biohybrid nanocomposite films are depicted in Figure 5. All compositions exhibit an endothermic peak with a wide temperature range between 150 and 170 °C, which may correspond to the chitosan melting point. For the pure chitosan film and films containing 5% SA, there is a modest endothermic peak at about 100 °C that may be caused by the evaporation of water from the film. Qiao et al. [29] and Carvalho et al. [30] also reported the same observation. The addition of SA caused a larger endothermic peak at 100 °C, indicating more water evaporation from the film matrix. In the case of films formed from chitosan + 1%ZnO-NPs without SA, the endothermic peak at 100 °C was not detected, indicating any water evaporation. ZnO-NPs may bind water to generate Zn(OH)2, preventing the water from easily evaporating. This result revealed that the addition of ZnO-NPs decreased the water activity values, whereas the use of SA had the opposite effect and increased the aw. The films containing 5%SA exhibited an endothermic peak at around 70 °C, which is attributed to the SA melting temperature [31,32]. In Figure 5, it was noticed that the incorporation of ZnO-NPs enhanced both the onset and peak melting points of chitosan films, whereas the addition of SA decreased those values. Regarding enthalpy, the addition of ZnO-NPs and SA may increase the enthalpy values, indicating an increase in the film’s crystallinity.
Dong et al. [33] reported that the glass transition temperature (Tg) of chitosan was determined by DSC to be between 140 and 150 °C. In the present study, the Tg of chitosan was not detected, which is in agreement with Akalin et al. [34]. This may be due to the rigid molecular structure of chitosan, which causes the Tg baseline step to be excessively broad. Cervera et al. [35] observed that many features, including crystallinity, amount of water, degree of deacetylation, and OH or amine groups in the chain of the macromolecule, could affect the appearance of chitosan’s glass transition.

3.5. FTIR Analysis

FTIR analysis was performed to determine whether the ZnO-NPs were successfully dispersed in the chitosan matrix. Using IR spectroscopy, Shuai et al. [36] analyzed hydrogen bonding and other interactions and the miscibility of polymer blends. Figure 6 illustrates the FTIR spectra of chitosan and chitosan with 1% ZnONP as processed in this study.
Figure 6 compares the FTIR of the chitosan-ZnO-NPs film to that of the chitosan film. In chitosan+ZnO-NPs film spectra, two additional peaks appear at 659 cm−1 and 465 cm−1, indicating the presence of amide groups and Zn-O, respectively. This result suggests that ZnO-NPs were successfully incorporated into the chitosan polymer matrix and that a specific interaction through hydrogen-bonding may occur between chitosan and ZnO-NPs. Abdelhady [37] achieved comparable FTIR results.

4. Conclusions

In this study, we achieved the fabrication of active biohybrid nanocomposite films based on chitosan, with improved multifunctional packaging properties. A full factorial design with multilevel categorical components and multiple functional food packaging characteristics responses has been applied to determine the optimal formula for preparing antibacterial chitosan-based biohybrid nanocomposite films. The incorporation of ZnO-NPs at 1% (by weight of chitosan) without using SA was confirmed to be the optimum formula. Although the inclusion of stearic fatty acids in the preparation of biohybrid nanocomposites films may raise the water vapor barrier, it caused a nonhomogeneous mixture with detrimental effects on tensile strength, elongation at break, and antibacterial activities. SEM analysis revealed that films made with SA were rough and likely cracked. Furthermore, observations on films without SA revealed that the size of ZnO-NPs in the chitosan matrix was in the nanoscale range (<100 nm). The DSC and FTIR analyses confirmed that interaction between chitosan and ZnO-NPs has occurred.

Author Contributions

Conceptualization, N.E.S. and B.A.; methodology, N.E.S., R.Y.P. and S.G.; software, N.E.S., S.G. and D.Y.H.; validation, N.E.S., S.G. and B.A.; formal analysis, N.E.S., A.T., F.A. and D.Y.H.; resources, F.A., A.T., D.Y.H. and B.A.; data curation, N.E.S., D.Y.H., S.G. and R.Y.P.; writing—original draft preparation, N.E.S. and S.G.; writing—review and editing, N.E.S., D.Y.H. and B.A.; visualization, F.A. and A.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors would like to thank the Institut Francais d’Indonésie, French Embassy in Indonesia, for providing fellowships under the Séjours Scientifiques de Haut Niveau 2022 (SSHN 2022) program to the first and sixth authors for them to complete the experimental analysis and prepare the manuscript at MATIM (Université de Reims Champagne-Ardenne, France).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. EFSA. Food Contact Materials. Available online: https://www.efsa.europa.eu/en/topics/topic/food-contact-materials (accessed on 6 December 2022).
  2. The Union of International Associations (UIA). Using Plastic Packaging for Food in The Encyclopedia of World Problems & Human Potential. Available online: http://encyclopedia.uia.org/en/strategy/211421 (accessed on 2 December 2022).
  3. Plastics Europe. Plastics–The Facts 2020. Available online: https://plasticseurope.org/fr/knowledge-hub/plastics-the-facts-2020/ (accessed on 5 December 2022).
  4. Macena, M.W.; Carvalho, R.; Cruz-Lopes, L.P.; Guiné, R.P.F. Plastic food packaging: Perceptions and attitudes of portuguese consumers about environmental impact and recycling. Sustainability 2021, 13, 9953. [Google Scholar] [CrossRef]
  5. Moeini, A.; Pedram, P.; Fattahi, E.; Cerruti, P.; Santagata, G. Edible polymers and secondary bioactive compounds for food packaging applications: Antimicrobial, mechanical, and gas barrier properties. Polymers 2022, 14, 2395. [Google Scholar] [CrossRef] [PubMed]
  6. Janik, W.; Nowotarski, M.; Shyntum, D.Y.; Banaś, A.; Krukiewicz, K.; Kudła, S.; Dudek, G. Antibacterial and biodegradable polysaccharide-based films for food packaging applications: Comparative study. Materials 2022, 15, 3236. [Google Scholar] [CrossRef]
  7. Souza, V.G.L.; Alves, M.M.; Santos, C.F.; Ribeiro, I.A.C.; Rodrigues, C.; Coelhoso, I.; Fernando, A.L. Biodegradable chitosan films with ZnO nanoparticles synthesized using food industry byproducts—Production and characterization. Coatings 2021, 11, 646. [Google Scholar] [CrossRef]
  8. Li, Y.; Zhou, Y.; Wang, Z.; Cai, R.; Yue, T.; Cui, L. Preparation and characterization of chitosan-nano-ZnO composite films for preservation of cherry tomatoes. Foods 2021, 10, 3135. [Google Scholar] [CrossRef]
  9. Gorrasi, G.; Bugatti, V.; Sorrentino, A. Nanohybrid active fillers in food contact bio-based materials. In Bionanocomposites for Packaging Applications; Springer: Berlin/Heidelberg, Germany, 2017; pp. 71–94. [Google Scholar] [CrossRef]
  10. Aji, A.I.; Suyatma, N.E.; Arpah, M.; Jayanegara, A. Evaluation of different parameters of ZnO nanoparticles on bionanocomposite film properties: A meta-analysis. Int. J. Food Sci. Technol. 2022. Accepted. [Google Scholar] [CrossRef]
  11. Espitia, P.J.P.; Soares, N.d.F.F.; Coimbra, J.S.d.R.; de Andrade, N.J.; Cruz, R.S.; Medeiros, E.A.A. Zinc oxide nanoparticles: Synthesis, antimicrobial activity and food packaging applications. Food Bioprocess Technol. 2012, 5, 1447–1464. [Google Scholar] [CrossRef]
  12. U.S. Food and Drug Administration (FDA). Select Committee on GRAS Substances Database. Available online: https://www.cfsanappsexternal.fda.gov/scripts/fdcc/?set=SCOGS (accessed on 29 November 2022).
  13. Siddiqi, K.S.; ur Rahman, A.; Tajuddin; Husen, A. Properties of zinc oxide nanoparticles and their activity against microbes. Nanoscale Res. Lett. 2018, 13, 141. [Google Scholar] [CrossRef]
  14. Jayasuriya, A.C.; Aryaei, A.; Jayatissa, A.H. ZnO nanoparticles induced effects on nanomechanical behavior and cell viability of chitosan films. Mater. Sci. Eng. C 2013, 33, 3688–3696. [Google Scholar] [CrossRef]
  15. Rahman, P.M.; Mujeeb, V.M.A.; Muraleedharan, K. Flexible chitosan-nano ZnO antimicrobial pouches as a new material for extending the shelf life of raw meat. Int. J. Biol. Macromol. 2017, 97, 382–391. [Google Scholar] [CrossRef]
  16. Wardana, A.A.; Suyatma, N.E.; Muchtadi, T.R.; Yuliani, S. Influence of zno nanoparticles and stearic acid on physical, mechanical and structural properties of cassava starch-based bionanocomposite edible films. Int. Food Res. J. 2018, 25, 837–1844. [Google Scholar]
  17. Reddy, C.K.; Choi, S.M.; Lee, D.-J.; Lim, S.-T. Complex formation between starch and stearic acid: Effect of enzymatic debranching for starch. Food Chem. 2018, 244, 136–142. [Google Scholar] [CrossRef] [PubMed]
  18. Schmidt, V.C.R.; Porto, L.M.; Laurindo, J.B.; Menegalli, F.C. Water vapor barrier and mechanical properties of starch films containing stearic acid. Ind. Crops Prod. 2013, 41, 227–234. [Google Scholar] [CrossRef]
  19. Shi, S.C.; Peng, Y.Q. Preparation and tribological studies of stearic acid-modified biopolymer coating. Prog. Org. Coat. 2020, 138, 105304. [Google Scholar] [CrossRef]
  20. Karnnet, S.; Potiyaraj, P.; Pimpan, V. Preparation and properties of biodegradable stearic acid-modified gelatin films. Polym. Degrad. Stab. 2005, 90, 106–110. [Google Scholar] [CrossRef]
  21. Casillas-Vargas, G.; Ocasio-Malavé, C.; Medina, S.; Morales-Guzmán, C.; Del Valle, R.G.; Carballeira, N.M.; Sanabria-Ríos, D.J. Antibacterial Fatty Acids: An update of possible mechanisms of action and implications in the development of the next-generation of antibacterial agents. Prog. Lipid Res. 2021, 82, 101093. [Google Scholar] [CrossRef]
  22. StatEase. Multilevel Categoric Factorial. Available online: https://www.statease.com/docs/v13/tutorials/general-multilevel-categoric-factorial/ (accessed on 29 November 2022).
  23. Hajipour, M.J.; Fromm, K.M.; Ashkarran, A.A.; Jimenez de Aberasturi, D.; de Larramendi, I.R.; Rojo, T.; Serpooshan, V.; Parak, W.J.; Mahmoudi, M. Antibacterial properties of nanoparticles. Trends Biotechnol. 2012, 30, 499–511. [Google Scholar] [CrossRef] [Green Version]
  24. Wang, L.L.; Hu, C.; Shao, L.Q. The antimicrobial activity of nanoparticles: Present situation and prospects for the future. Int. J. Nanomed. 2017, 12, 1227–1249. [Google Scholar] [CrossRef] [Green Version]
  25. Cheng, M.; Deng, J.; Yang, F.; Gong, Y.; Zhao, N.; Zhang, X. Study on physical properties and nerve cell affinity of composite films from chitosan and gelatin solutions. Biomaterials 2003, 24, 2871–2880. [Google Scholar] [CrossRef]
  26. Sirelkhatim, A.; Mahmud, S.; Seeni, A.; Kaus, N.H.M.; Ann, L.C.; Bakhori, S.K.M.; Hasan, H.; Mohamad, D. Review on zinc oxide nanoparticles: Antibacterial activity and toxicity mechanism. Nano-Micro Lett. 2015, 7, 219–242. [Google Scholar] [CrossRef]
  27. Shahvalizadeh, R.; Ahmadi, R.; Davandeh, I.; Pezeshki, A.; Moslemi, S.A.S.; Karimi, S.; Rahimi, M.; Hamishehkar, H.; Mohammadi, M. Antimicrobial bio-nanocomposite films based on gelatin, tragacanth, and zinc oxide nanoparticles–microstructural, mechanical, thermo-physical, and barrier properties. Food Chem. 2021, 354, 129492. [Google Scholar] [CrossRef] [PubMed]
  28. Erol, I.; Hazman, O.; Aksu, M.; Bulut, E. Synergistic effect of ZnO nanoparticles and hesperidin on the antibacterial properties of chitosan. J. Biomater. Sci. Polym. Ed. 2022, 33, 1973–1997. [Google Scholar] [CrossRef] [PubMed]
  29. Qiao, C.; Ma, X.; Wang, X.; Yao, J. Effect of water on the thermal transition in chitosan films. Polym. Cryst. 2019, 2, e10092. [Google Scholar] [CrossRef]
  30. Carvalho, J.D.S.; Rabelo, R.S.; Hubinger, M.D. Thermo-rheological properties of chitosan hydrogels with hydroxypropyl methylcellulose and methylcellulose. Int. J. Biol. Macromol. 2022, 209, 367–375. [Google Scholar] [CrossRef] [PubMed]
  31. Singleton, W.S.; Ward, T.L.; Dollear, F.G. Physical properties of fatty acids. I. Some dilatometric and thermal properties of stearic acid in two polymorphic forms. J. Am. Oil Chem. Soc. 1950, 27, 143–146. [Google Scholar] [CrossRef]
  32. INCHEM. Stearic acid: Physical & Chemical Information. Available online: https://inchem.org/documents/icsc/icsc/eics0568.htm (accessed on 4 December 2022).
  33. Dong, Y.; Ruan, Y.; Wang, H.; Zhao, Y.; Bi, D. Studies on glass transition temperature of chitosan with four techniques. J. Appl. Polym. Sci. 2004, 93, 1553–1558. [Google Scholar] [CrossRef]
  34. Akalin, G.O.; Oztuna Taner, O.; Taner, T. The preparation, characterization and antibacterial properties of chitosan/pectin silver nanoparticle films. Polym. Bull. 2022, 79, 3495–3512. [Google Scholar] [CrossRef]
  35. Cervera, M.F.; Heinämäki, J.; Räsänen, M.; Maunu, S.L.; Karjalainen, M.; Acosta, O.M.N.; Colarte, A.I.; Yliruusi, J. Solid-state characterization of chitosans derived from lobster chitin. Carbohyd. Polym. 2004, 58, 401–408. [Google Scholar] [CrossRef]
  36. Shuai, X.; He, Y.; Asakawa, N.; Inoue, Y. Miscibility and phase structure of binary blends of poly(L-lactide) and poly(vinyl alcohol). J. Appl. Polym. Sci. 2001, 81, 762–772. [Google Scholar] [CrossRef]
  37. Abdelhady, M. Preparation and characterization of chitosan/zinc oxide nanoparticles for imparting antimicrobial and UV protection to cotton fabric. Int. J. Carbohydr. Chem. 2012, 2012, 840591. [Google Scholar] [CrossRef]
Figure 1. Flowchart of chitosan–ZnO-NPs nanocomposite film preparation: (A) with stearic acid, (B) without stearic acid.
Figure 1. Flowchart of chitosan–ZnO-NPs nanocomposite film preparation: (A) with stearic acid, (B) without stearic acid.
Materials 16 00926 g001
Figure 2. Interaction effect of ZnO-NPs and SA: (A) WVTR; (B) % elongation at break; (C) tensile strength; (DF) antibacterial against B. cereus, S. aureus, and E. coli, respectively.
Figure 2. Interaction effect of ZnO-NPs and SA: (A) WVTR; (B) % elongation at break; (C) tensile strength; (DF) antibacterial against B. cereus, S. aureus, and E. coli, respectively.
Materials 16 00926 g002aMaterials 16 00926 g002b
Figure 3. SEM Surface morphology: (A) control chitosan films; (B) biohybrid nanocomposite films made of chitosan+1%ZnO-NPs without SA; (C) biohybrid nanocomposite films made of chitosan+1%ZnO-NPs with 5%SA.
Figure 3. SEM Surface morphology: (A) control chitosan films; (B) biohybrid nanocomposite films made of chitosan+1%ZnO-NPs without SA; (C) biohybrid nanocomposite films made of chitosan+1%ZnO-NPs with 5%SA.
Materials 16 00926 g003
Figure 4. Water activity of biohybrid nanocomposite films (the error bars represent standard deviation and bars with different letters are significantly different based on Duncan’s multiple range test with α = 0.05).
Figure 4. Water activity of biohybrid nanocomposite films (the error bars represent standard deviation and bars with different letters are significantly different based on Duncan’s multiple range test with α = 0.05).
Materials 16 00926 g004
Figure 5. DSC thermogram of biohybrid-nanocomposite films: (A) chitosan only; (B) chitosan + 5%SA; (C) chitosan + 1%ZnO-NP; (D) chitosan + 1%ZnO-NPs+5%SA.
Figure 5. DSC thermogram of biohybrid-nanocomposite films: (A) chitosan only; (B) chitosan + 5%SA; (C) chitosan + 1%ZnO-NP; (D) chitosan + 1%ZnO-NPs+5%SA.
Materials 16 00926 g005
Figure 6. FTIR spectra of chitosan and chitosan + 1% ZnO-NP.
Figure 6. FTIR spectra of chitosan and chitosan + 1% ZnO-NP.
Materials 16 00926 g006
Table 1. Full factorial design run matrix and the obtained multiple responses.
Table 1. Full factorial design run matrix and the obtained multiple responses.
Run Number **Independent VariablesDependent Variables (Responses for Optimization)
ZnO-NPsSAWVTR%EBTSInhibitory Zone (cm)
(%, w/w)(%, w/w)(g/m2/day) (kPa)B. cereusS. aureusE. coli
11528.593840.60.980.751.08
23026.9854.272.51.101.031.13
30543.2620.47.80.730.770.75
43526.829.5520.930.880.85
51029.4868.050.81.221.151.15
60048.732.324.30.720.820.68
73027.2350.383.21.000.971.12
81029.2959.156.91.221.231.18
90.5040.2441.328.50.800.971.00
101527.4835.043.30.870.851.07
111029.3956.247.91.181.101.20
123027.4857.765.20.981.171.02
130.5539.4431.320.50.830.820.82
140045.9633.324.30.650.720.63
150541.220.49.10.630.720.73
160.5539.732.410.40.720.870.88
170049.4530.625.30.700.830.68
180.5040.8341.731.70.831.220.9
191526.983038.60.850.680.92
200542.5321.27.70.730.700.70
210.5041.6643.628.70.831.081.02
223526.1529.459.10.880.980.83
230.5539.4731.919.30.800.950.83
243526.6927.353.60.950.780.85
Note: ** The order of run number was randomized using the software DX13.
Table 2. Results of ANOVA (full factorial model) and fit statistics.
Table 2. Results of ANOVA (full factorial model) and fit statistics.
Response Parameterp-Value FFD Modelp-Value Factor A p-Value Factor Bp-Value
Inter. AB
Adj-R2 ModelPred-R2 ModelAdeq Precision
WVTR<0.0001 ****<0.0001 ****<0.0001 ****0.0005 ****0.98870.982443.4378
%EB<0.0001 ****<0.0001 ****<0.0001 ****0.0002 ****0.94720.917323.1187
TS<0.0001 ****<0.0001 ****<0.0001 ****0.45240.95630.931625.5774
B. Cereus<0.0001 ****<0.0001 ****<0.0001 ****0.0002 ****0.91740.870718.1951
S. aureus<0.0001 ****0.0008 ****<0.0001 ****0.0226 **0.75650.61888.8458
E. coli<0.0001 ****<0.0001 ****<0.0001 ****0.0006 ****0.91880.872917.788
Note: adj = adjusted, pred = predicted, adeq = adequacy; A = %ZnO-NP; B = % SA; Inter. = Interaction; p-value with **** = significant at p < 0.001; with ** = significant at p < 0.05; without ** = not significant.
Table 3. Constraints for the optimization process.
Table 3. Constraints for the optimization process.
Variable NameGoalLower LimitUpper LimitImportance
A: ZnO-NPin range033
B: Stearic Acidin range053
WVTRminimize26.1549.455
%EBmaximize20.4168.025
Tensile Strengthin range7.7183.213
B. cereusmaximize0.631.225
S. aereusmaximize0.681.235
E. colimaximize0.631.205
Table 4. Solution of the optimized formula given by DX-13.
Table 4. Solution of the optimized formula given by DX-13.
Solution No.ZnO-NPSAWVTR%EBTSB. cereusS. aereusE. coliDesirability
11029.38661.09551.8751.2061.1611.1780.904
23027.22854.09373.6511.0281.0561.0890.757
30.5040.90942.19129.6370.8221.0890.9720.474
41527.68134.33340.8380.90.7611.0220.414
53526.5528.73154.8730.9220.8830.8440.41
60.5539.53831.82916.7490.7830.8780.8440.322
70048.03732.07924.6140.6890.7890.6670.11
80542.3320.6578.1990.70.7290.7280.076
Table 5. Response data of confirmation formula: ZnO-NPs 1% without adding SA.
Table 5. Response data of confirmation formula: ZnO-NPs 1% without adding SA.
RunWVTR%EBTSB. cereusS. aureusE. coli
128.5263.451.91.211.321.30
231.1762.652.31.381.321.09
330.7561.452.41.281.311.10
429.8466.249.91.171.300.99
531.7962.748.01.261.281.12
630.2865.250.61.341.391.23
Table 6. Confirmation result: actual vs. predicted value.
Table 6. Confirmation result: actual vs. predicted value.
ResponseNumber of ReplicationsPrediction Value95% PI LowData Mean of 6 Replications95% PI High
WVTR629.3928.130.3930.67
%EB661.156.663.665.6
TS651.945.250.858.5
B. cereus61.211.131.271.28
S. aereus61.161.031.321.29
E. coli61.181.11.141.25
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Suyatma, N.E.; Gunawan, S.; Putri, R.Y.; Tara, A.; Abbès, F.; Hastati, D.Y.; Abbès, B. Active Biohybrid Nanocomposite Films Made from Chitosan, ZnO Nanoparticles, and Stearic Acid: Optimization Study to Develop Antibacterial Films for Food Packaging Application. Materials 2023, 16, 926. https://doi.org/10.3390/ma16030926

AMA Style

Suyatma NE, Gunawan S, Putri RY, Tara A, Abbès F, Hastati DY, Abbès B. Active Biohybrid Nanocomposite Films Made from Chitosan, ZnO Nanoparticles, and Stearic Acid: Optimization Study to Develop Antibacterial Films for Food Packaging Application. Materials. 2023; 16(3):926. https://doi.org/10.3390/ma16030926

Chicago/Turabian Style

Suyatma, Nugraha Edhi, Sanjaya Gunawan, Rani Yunia Putri, Ahmed Tara, Fazilay Abbès, Dwi Yuni Hastati, and Boussad Abbès. 2023. "Active Biohybrid Nanocomposite Films Made from Chitosan, ZnO Nanoparticles, and Stearic Acid: Optimization Study to Develop Antibacterial Films for Food Packaging Application" Materials 16, no. 3: 926. https://doi.org/10.3390/ma16030926

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop