Next Article in Journal
Activation of Adenosine A1 Receptor in Ischemic Stroke: Neuroprotection by Tetrahydroxy Stilbene Glycoside as an Agonist
Next Article in Special Issue
Modeling of Antioxidant Activity, Polyphenols and Macronutrients Content of Bee Pollen Applying Solid-State 13C NMR Spectra
Previous Article in Journal
Biological Mechanisms of S-Nitrosothiol Formation and Degradation: How Is Specificity of S-Nitrosylation Achieved?
Previous Article in Special Issue
Phytochemical Profile and Antioxidant Properties of Bee-Collected Artichoke (Cynara scolymus) Pollen
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Optimisation of Bee Pollen Extraction to Maximise Extractable Antioxidant Constituents

1
Cooperative Research Centre for Honey Bee Products Limited (CRC HBP), University of Western Australia, Agriculture North M085, Perth, WA 6009, Australia
2
Division of Pharmacy, School of Allied Health, University of Western Australia, Curnow Building M315, Perth, WA 6009, Australia
3
M Block QEII Medical Centre, School of Biomedical Sciences, University of Western Australia, Monash Ave, Perth, WA 6009, Australia
*
Author to whom correspondence should be addressed.
Antioxidants 2021, 10(7), 1113; https://doi.org/10.3390/antiox10071113
Submission received: 6 June 2021 / Revised: 6 July 2021 / Accepted: 7 July 2021 / Published: 12 July 2021
(This article belongs to the Special Issue Bee Products as a Source of Natural Antioxidants)

Abstract

:
This paper presents the findings of a comprehensive review on common bee pollen processing methods which can impact extraction efficiency and lead to differences in measured total phenolic content (TPC) and radical scavenging activity based on 2,2-diphenyl-1-picrylhydrazyl (DPPH) and ferric reducing antioxidant power (FRAP) data. This hampers the comparative analysis of bee pollen from different floral sources and geographical locations. Based on the review, an in-depth investigation was carried out to identify the most efficient process to maximise the extraction of components for measurement of TPC, DPPH and FRAP antioxidant activity for two bee pollen samples from western Australia (Jarrah and Marri pollen). Optimisation by Design of Experiment with Multilevel Factorial Analysis (Categorical) modelling was performed. The independent variables included pollen pulverisation, the extraction solvent (70% aqueous ethanol, ethanol, methanol and water) and the extraction process (agitation, maceration, reflux and sonication). The data demonstrate that non-pulverised bee pollen extracted with 70% aqueous ethanol using the agitation extraction method constitute the optimal conditions to maximise the extraction of phenolics and antioxidant principles in these bee pollen samples.

1. Introduction

Flower pollen are the reproductive cells found in the stamen of plants which are transferred to the stigma of another plant via pollinating agents, such as bees, other insects, wind and water [1]. Bee pollen, on the other hand, is made by worker honeybees combining flower pollen, nectar and bee salivary constituents, and it is transferred to beehives in the form of pollen baskets attached to the bees’ hind legs [1,2]. Inside the hives, bee pollen is packed into honeycomb cells and covered with a layer of honey and wax to initiate fermentation to generate bee bread, which is the principal source of nutrients for honeybees [2]. Bee pollen, which is also known as apicultural, bee-collected or corbicular pollen, can be harvested for human consumption with the help of pollen traps. These traps are fixed at the entrance of beehives and collect pollen by stripping the pollen baskets from the hind legs of bees on entry to the hives [3].
Bee pollen provides bees with carbohydrates and other necessary nutrients such as proteins, fats, minerals and vitamins [4]. The secondary metabolite profiles of bee pollens vary significantly, reflecting the botanical and geographical origin as well as the climatic conditions, soil type and beekeeper activities [5,6]. The chemical composition of bee pollens typically includes 13–55% carbohydrates, 10–40% proteins and 1–13% lipids, alongside minor components such as minerals and trace elements, vitamins, carotenoids, phenolic compounds, flavonoids, sterols and terpenes [6,7,8]. Some even consider bee pollen to be the only complete food, as it contains all the essential amino acids needed by humans [6]. Bee pollen has been recommended as a natural nutraceutical due to its antimicrobial, antioxidant, anti-inflammatory, antiallergen, anticarcinogenic, antiradiation, antiulcer, hepatoprotective and chemopreventive properties. More recently, bee pollen has been found to modulate gut microbiota to promote gut health [6,7,8].
The antioxidant activity of bee pollen is mainly associated with the presence of polyphenols in the form of phenolic acids and flavonoids, which exert their antioxidant activity by neutralising free radicals through the donation of electron or hydrogen atoms [9]. This bioactivity has attracted considerable interest in recent years because of its association with anti-inflammatory, anti-cancer and also anti-aging effects [5]. Commonly, the determination of the antioxidant activity of honey and other bee products such as bee pollen involves the use of a range of popular colorimetric assays. These include the measurement of total phenolic content (TPC) [10,11,12,13,14], total flavonoid content (TFC) [13,14,15], free radical scavenging activity using the 2,2-diphenyl-1-picrylhydrazyl (DPPH) assay [4,12,13,14,15,16] or measuring the ferric reducing antioxidant power (FRAP) [4,10,17]. DPPH and FRAP assays, in particular, are widely used to determine the antioxidant activity of plant extracts and food products. These assays use stable redox reagents which are inexpensive and easy to prepare, they are quick and easy to perform, and the results are accurate, highly reproducible, and readily validated [18].
The determination of the antioxidant activity of bee pollen necessitates an extraction step guided by the premise of a high yield and minimal changes to the functional properties of the extract. It is, therefore, necessary to select an appropriate extraction method and solvent, based on sample matrix properties, the chemical properties of the analytes as well as potential matrix–analyte interactions [19]. Further parameters that require consideration are the number of extractions to be performed, the extraction time, the ratio of solvent to raw material, and the extraction pressure and temperature. As the polarity of bioactive polyphenols ranges from very polar to relatively non-polar, the extraction solvent plays a significant role in extraction efficiency [20]. Furthermore, pre-extraction processes such as pulverisation can also affect the extraction efficiency of bioactive principles, as powdered samples have smaller particle sizes and narrower particle size distribution, leading to improved surface contact with extraction solvents [21].
In order to determine an optimal extraction process for bee pollen that yields the maximum extraction of antioxidant constituents, a survey of the literature was carried out. A review of 101 papers published between 2003 and 2021 reporting the antioxidant activity of bee pollen found a wide range of extraction conditions (Table 1). Some, but not all, subjected the samples to pulverisation (31.7%). Extraction solvents also varied, though they were mainly of high polarity, with methanol (21.8%), 70% aqueous ethanol (13.0%), ethanol (10.1%) and water (10.1%) being the more commonly used solvents. As for the extraction process itself, maceration was found to be most widely used (34.8%), followed by sonication (26.1%), agitation (23.1%) and reflux extraction (1.5%).
It can be assumed that the adopted extraction process for a bee pollen sample, including the sample pre-treatment, extraction method and solvent, impacts the extraction efficiency of antioxidant constituents and consequently on the level of antioxidant activity measured. The objective of this study was to use the Design of Experiment approach to optimise an extraction process for bee pollen with a view to maximising the extraction of antioxidant constituents as measured by the DPPH, FRAP and TPC assays. The independent variables were sample pulverisation, extraction process (agitation, maceration, reflux or sonication) and extraction solvent (methanol, 70% aqueous ethanol, ethanol or water). Two different bee pollen samples from western Australia, Jarrah (Eucalyptus marginata) and Marri (Corymbia calophylla) bee pollen, were used as model bee pollen samples.

2. Materials and Methods

2.1. Chemicals, Reagents and Pollen Samples

The chemicals and reagents were sourced as follows: Folin and Ciocalteu’s phenol reagent 2N, (F9252-1L, Lot No. SHBH4781V), 2,4,6-tris(2-pyridyl)-1,3,5-triazine (TPTZ ≥ 98.0%, Lot No. BCBW0518, CAS No. 3682-35-7), iron (III) chloride hexahydrate (FeCl3·6H2O ACS Reagent 97.0%, Lot No. BCBZ5998, CAS No. 10025-77-1), iron (II) sulphate heptahydrate (FeSO4·7H2O ACS reagent, ≥99.0%, Lot No. MKCJ9113, CAS No. 7782-63-0), fructose (C6H12O6 ≥ 99.0%, Lot No. SLBZ1343, CAS No. 57-48-7), and maltose (C12H22O11·H2O BioXtra, ≥99%, Lot No. SLCC4130, CAS No. 6363-53-7) from Sigma Aldrich Truganina, Victoria 3029 Australia.; sodium anhydrous carbonate (Na2CO3, LR, B.N. 334280, CA No. 497-19-8), glucose (D-glucose anhydrous, C6H12O6 99.0%, Batch No. 314615, CAS No. 50-99-7) sucrose (C12H22O11 99.0%, Batch No. 324472, CAS No. 57-50-1), ethanol (CH3CH2OH, B.N. 360221, 64-17-5), from Chem Supply, Port Adelaide, SA 5015, Australia; anhydrous sodium acetate (C2H3NaO2 ≥ 99.0%, Batch No. AF512004, CAS No. 127-09-3) and glacial acetic acid ≥ 99.0%, Batch No. AH602167, CAS No.64-19-7) were purchased from Ajax Finechem, Wollongong NSW 2500, Australia; hydrochloric acid (HCl, Pt. 3350-1813, CAS No. 7647-01-0) was obtained from Asia Pacific Specialty Chemicals Limited, Seven Hills NSW 2147, Australia; 2,2-diphenyl-1-picrylhydrazyl (C18H12N5O6, CAS No. 1898-66-4 was purchased from Fluka AG, Buchs, Sankt Gallen, Switzerland; trihydroxybenzoic acid (C7H6O5, Lot. No. 1278, CAS No. 149-91-7) from Ajax Chemicals Ltd.; Sydney–Melbourne; Methanol (CH3OH, B.N. 19758725, 67-56-1) from Scharlau, Barcelona, Spain.
Jarrah (Eucalyptus marginata) and Marri (Corymbia calophylla) pollen, both harvested in October 2019, were purchased from Davies Apiaries in Oldbury, 6121, WA, Australia.

2.2. Extract Preparation

The bee pollen samples had already been dried, processed, and packed commercially, and no further treatment was undertaken prior to their analysis. To obtain pulverised samples (75–150 µm), the crude pollen grains were milled for 5 min using a commercial grinder (Breville Coffee Grinder Model BCG200). An amount of 0.5 g of pollen samples (crude, and non-pulverised) were separately extracted using ethanol, methanol, deionised water, and 70% ethanol in water, and the following extraction procedures:
Agitation. Agitation extraction was performed based on a protocol reported by Aleksieva et al. [72] with minor modifications. The extraction was carried out over 2 h in 7 mL of solvent using a hotplate magnetic stirrer (LLG Uni stirrer 3, John Morris Group) operating at a speed of 1500 rpm, with the temperature set at 40 °C. After 2 h, the solvent was decanted, and was replaced with fresh solvent and the extraction process was repeated two more times for the sample.
Maceration. Maceration extraction was performed based on a protocol reported by Kaškonienė et al. [95] with minor modifications. The bee pollen sample was macerated in 7 mL of extraction solvent at room temperature (25 °C) at a speed of 160 rpm shaking (Memmert Shaker Bath, Model WNB 22) over three days and solvent changes every 24 h.
Reflux. Reflux extraction was performed using an Electromantle reflux set-up and the protocol reported by Cheng et al. [81] with slight modifications. The method employed 21 mL of solvent and an extraction temperature determined by the boiling point of the respective solvent. Extraction was performed once over 2 h for each sample.
Sonication. Sonication extraction was performed following a procedure developed by Yan et al. [79] with slight modifications. The extraction was performed with 21 mL of solvent using a probe sonicator (Sonics Vibra Cell Model VCX130) operating at 130 Watts and 20 kHz. The amplitude was set at 100% and the extraction process was carried out once for 30 min on an ice bath.
Following extraction, the solvent was filtered (Whatman #4 filter paper) and, if the extraction process was repeated, filtrates were combined, and made up to 25 mL with the respective solvent. The resulting solutions were stored at −85 °C until further analysis. Every extraction process was carried out in triplicate for each pollen sample, and the responses combined to determine the mean. Table 2 summarises the independent variables studied along with their corresponding abbreviations.

2.3. Determination of Total Phenolic Content

A sugar solution was used as a blank in order to account for the potential sugar matrix interference in the assay. The sugar solution was prepared by diluting 2 g of a sugar stock solution (21.625 g of fructose, 18.125 g of glucose, 1.000 g of maltose, 0.750 g of sucrose and 8.500 g of water) to 5 mL (40%) with deionised water. The solution was stored under refrigeration and used within a week. A dilute Folin–Ciocalteu reagent was prepared by mixing 1 mL of Folin–Ciocalteu reagent with 30 mL deionised water. A 0.75% anhydrous sodium carbonate solution was prepared by mixing 0.1875 g Na2CO3 in 25 mL water. A 2 mg/mL gallic acid stock solution was prepared by dissolving 200 mg of gallic acid in 100 mL deionised water and standards ranging in concentration from 0.18 mg/mL to 0.06 mg/mL were prepared by diluting the stock with water.
The TPC assay was performed based on the methodology described by Liberato et al. [116] with minor modifications. In brief, for the analysis, 200 µL of pollen extract or 100 µL of gallic acid standard spiked with 100 µL of sugar solution were placed in a test tube followed by the addition of 1 mL of the diluted Folin–Ciocalteu reagent. The mixture was allowed to react for 5 min before 800 µL of Na2CO3 was added. The mixture was kept in the dark for 2 h before the absorbance was measured at 760 nm (Carry 60 Bio UV–Vis spectrophotometer) using 100 µL of water spiked with 100 µL of sugar solution along with other TPC reagents as a blank. The analysis was carried out in triplicate and the mean results for each sample were obtained. The antioxidant activity was expressed as mg of gallic acid equivalent (GAE) per g of pollen.
TPC   Value   of   Sample   ( mg ) Gallic   Acid   = ( Δ Abs intercept ) slope ×   Dilution   Factor

2.4. Determination of Antioxidant Activity using Ferric Reducing Antioxidant Power (FRAP) Assay

The FRAP reagent was prepared by mixing in proportions of 1:1:10 (v/v/v) 10 mM TPTZ (0.31 g dissolved in 100 mL of 40 mM HCl), 20 mM FeCl3·6H2O (0.5406 g dissolved in 100 mL of deionised water) and 300 mM acetate buffer pH 3.6 (3.1 g C2H3NaO2, 16.00 mL of glacial acetic acid dissolved in 1000 mL of deionised water). The reagent was freshly prepared and incubated at 37 °C prior to each test. For the standard curve, a 2 mM stock solution of FeSO4·7H2O was prepared by dissolving 55.6 mg of FeSO4·7H2O in 100 mL of deionised water. Standards ranging in concentration from 1200 µM to 200 µM were prepared prior to each experiment, stored on ice, and used within 2 h. The standard at 600 µM was used as a positive control in each experiment.
The FRAP assay, which is based on the reduction of ferric 2,4,6-tris(2-pyridyl)-1,3,5-triazine [Fe(III)-TPTZ] to ferrous complex at low pH followed by a spectrophotometric analysis, was performed according to the protocol described by Almeida et al. [60] with minor modifications. In brief, 20 µL of pollen extract or standards were mixed with 180 µL of FRAP reagent in a 96-well microplate, incubated at 37 °C for 30 min and the absorbance of the reaction mixture was determined at 620 nm (BMG Labtech POLARstar Optima Microplate Reader). The mean of triplicate analysis results was calculated and the FRAP activity was determined on the interpolation of the standard curve and expressed as µmol Fe2+ equivalent (Fe+2 E)/g FW of pollen.
FRAP   Value   of   Sample   ( µ M ) Fe   ( II ) = ( Δ Abs intercept ) slope ×   Dilution   Factor

2.5. Determination of Antioxidant Activity using the 2,2-diphenyl-1-picrylhydrazyl (DPPH) Radical Scavenging Assay

This colorimetric assay utilises 2,2-diphenyl-1-picrylhydrazyl (DPPH) radicals, which are purple in colour; the colour decays in the presence of antioxidant agents, seen in a change in absorbance at 517 nm. The DPPH reaction mixture was made up of 0.130 mM DPPH reagent (5.1262 mg of DPPH in 100 mL of methanol), 100 mM NaC2H3O2 buffer pH 5.5 (7.355 g of NaC2H3O2 and 0.621 g of HC2H3O2) and bee pollen extract. Trolox in a concentration range of 600–100 µM (aqueous, pH adjusted to pH 7.0 to completely solubilize in water) was used as the standard, with the 400 µM standard acting as a positive control throughout all tests.
The DPPH assay adopted in this experiment is based on the protocol described by Karabagias et al. [117] with minor modifications. In brief, 10 µL of bee pollen extract or Trolox standards were placed in a 96-well microplate, followed by the addition of 100 µL of NaC2H3O2 buffer and 190 µL of 0.130 mM methanolic DPPH solution. The reaction mixture was kept in the dark for 120 min before the absorbance was measured at 520 nm using the microplate reader. The mean radical scavenging activity of triplicate samples was expressed as the Trolox equivalent (TE), calculated by a linear regression analysis, and then expressed as µmol Trolox equivalent per g of pollen.
DPPH   Value   of   Sample   ( µ M )   Trolox = ( Δ Abs intercept ) slope ×   Dilution   Factor

2.6. Statistical Analysis

Statistical analysis of the data was carried out using Design Expert 12 (StatEase Inc., Minneapolis, MN, USA) and two-way t-test or one-way ANOVA was analysed using Graphpad Prism 9 (GraphPad Software, San Diego, CA, USA). Pareto plots of regression coefficients of the independent variables were generated using Microsoft Excel. The signal to noise ratio was set at 5 times the standard deviation of observations for each response (n = 3). The model was developed based on the regression analysis of the statistical significance of variables, and the model coefficient was significant when the F value was larger than the critical F value (p < 0.05). The relative influence of factors was identified by comparing the magnitude of regression coefficients. Correlations between responses were established using Spearman regression analysis. When significant interactions between factors were identified, a two-way t-test or a one-way analysis of variance with Tukey’s post hoc comparison was used to identify differences between the groups, and the statistical significance was set at p > 0.05.

3. Results

A thorough literature review of 101 published articles on the most widely used conditions for extracting antioxidant principles from bee pollen (Table 1) indicated a lack of a consistent approach. Researchers used a variety of antioxidant assays and analysis standards, and also, the manner by which the results were expressed varied greatly, making it difficult to conduct comparative analyses of findings across research groups. Furthermore, there appears to be no agreed protocol to guide the extraction process itself, which is required to establish baseline data for bee pollen of Australian origin in order to compare their antioxidant activity with other bee pollen samples. The gaps in information form the basis for this study, which aimed to optimise the extraction conditions for bee pollen collected in western Australia to enable the maximum extraction of antioxidant constituents as measured by the TPC, DPPH and FRAP assays. The Design of Experiment approach examined three independent variables: sample pulverisation, extraction solvent, and the extraction process. The two pollen types provided sample diversity to enable the development of a generalised extraction protocol that may be adopted for all types of bee pollen collected in western Australian and beyond.

3.1. Analysis of the Optimisation Process

A multilevel factorial design was implemented using Design Expert 12 (StatEase Inc., Minneapolis, MN, USA), with sample pulverisation, extraction solvent, and the extraction process as independent variables. The conditions selected for each variable were based on the popularity of use, as reflected in the literature review (Table 1). The responses (dependent variables) measured were the TPC, DPPH, and FRAP antioxidant activities. As summarised in Table 3 (the full data set is available as Supplementary Material, Table S1), the extraction variables for the multilevel factorial design (categorical) were selected at two levels for pulverisation (A, crude = −, pulverised = +), four levels for extraction solvent (B, 70% ethanol: 30% = E70:30, ethanol = EtOH, water = H2O, and methanol = MtOH), and four levels for the extraction process (C, agitation = A, maceration = M, reflux = R, and sonication = S). The total runs consisted of 32 experimental points, and each point was triplicated. The sequence of the experiments was randomised, where the random numbers were generated by the Design Expert 12 software.
Pulverisation (Variable A) did not show any significant effect on the TPC, DPPH and FRAP data for the bee pollen (p value > 0.05) and was therefore removed from further analysis. Both solvent type (Variable B) and the extraction process (Variable C) were found to have significant impacts on the TPC, DPPH and FRAP antioxidant activity of bee pollen (p value < 0.05). A significant interaction between the solvent type and extraction process (Variables B and C) was observed for the TPC and FRAP responses (p value < 0.05), whereas the interaction of these variables did not influence the DPPH antioxidant activity.
However, the larger coefficients obtained for extraction solvent relative to those for the extraction process indicate that the selection of solvent has a dominant effect on all three responses based on the tabulated regression coefficients (see Table 4), also seen in Pareto charts (Figure 1, Figure 2 and Figure 3).
The relationships between the independent variables and TPC, DPPH and FRAP assays are further illustrated in three-dimensional graphs (Figure 4, Figure 5 and Figure 6). Figure 4 shows the results for the TPC assay of the bee pollen samples. The highest responses were observed when a solvent of 70% ethanol (E70:30) was coupled with reflux (R) or agitation (A) as the extraction process (p value < 0.05). These conditions may therefore represent optimal parameters for the extraction of the bee pollen samples for the TPC assay. For the DPPH antioxidant activity (Figure 5), the extraction solvent of 70% ethanol (E70:30) coupled with agitation (A) were the best extracting conditions for the bee pollen samples (p value < 0.001). Figure 6 shows that the extraction solvent of 70% ethanol (E70:30) coupled with maceration (M) produced the highest FRAP activity (p value < 0.05), and may therefore be considered as the combination of solvent type and the extraction process of choice for the FRAP assay of the bee pollen samples.

3.2. Correlation of TPC, DPPH and FRAP Antioxidant Activity

Bee pollen has been reported to contain many types of polyphenols [99] which are strongly correlated to the antioxidant activity of bee pollen [9]. In this study, a strong positive correlation was observed between the TPC and DPPH data, TPC and FRAP data as well as the DPPH and FRAP data, with correlation values of ρ = 0.6925 (p < 0.001), ρ = 0.7295 (p < 0.001) and ρ = 0.6520 (p < 0.001), respectively. Thus, the presence of polyphenols, captured in the pollen’s TPC, appears to positively influence its antioxidant capacity expressed in the DPPH and FRAP assays. However, it needs to be acknowledged that there are other pollen constituents, such as carotenoids, that could also influence the antioxidant capacity [82,106].

3.3. Choosing Optimum Conditions

The optimisation of the extraction process to maximise the three dependent variables was determined by employing a new variable desirability, which represents all responses simultaneously. Desirability is an objective function that is determined by ranked responses and its value ranges from zero to one, with one being most desirable. When there are several responses, the individual goals are combined to generate one desirability function, which was automated by Design Expert software 12 (StatEase, Inc. Minneapolis, MN, USA). The numerical optimisation based on the goal of the study finds a point that maximises the desirability function. The criteria adopted to determine the desirability function for this study are to maximise all responses. Figure 7, Figure 8 and Figure 9 provide predicted TPC, DPPH and FRAP values obtained for the three optimum conditions identified for the extraction of bee pollen samples.
Based on the model, the crude/non-pulverised pollen sample, extracted with 70% ethanol:30% water (E70:30) by agitation (A) as the extraction process produced the highest desirability (0.92) (Figure 7), followed by the crude/non-pulverised pollen sample, extracted with 70% ethanol:30% water (E70:30) by maceration (M) (desirability = 0.893) (Figure 8), and finally, the non-pulverised pollen sample, extracted with 70% ethanol:30% water (E70:30) by reflux (R) (desirability = 0.883) (Figure 9). These three conditions can therefore be considered to represent the optimal combination of sample pre-processing treatment, solvent type and extraction process to yield the maximum extraction of constituents from the bee pollen samples for the TPC, DPPH and FRAP assays. The bee pollen extracts prepared using the crude/non-pulverised pollen sample, extracted with 70% ethanol:30% water (E70:30) by agitation (A) as the extraction process were found to have an average total phenolic content of 20.86 mg GAE/g, DPPH antioxidant activity of 320.11 µmol TE/g and 342.28 µmol Fe+2 E/g FRAP activities, respectively. These values are very close to the predicted values of 20.83 mg GAE/g, 324.52 µmol TE/g and 351.78 µmol Fe+2 E/g, respectively, demonstrating the good fit of the chosen model.

4. Discussion

Commonly, the initial stage in studying the chemical composition and/or bioactivity of natural products, including bee pollen, includes a pre-extraction step, in which the material undergoes drying in order to preserve the biomolecules present in the sample [21]. This is often followed by grinding the dried material using a mortar and pestle, electric blender or various mills to decrease the particle size to enhance surface contact with the extraction solvent [21]. Particles that are too fine will, however, adsorb onto filters and impede filtration [118]. In this study, the effect of the pulverisation of bee pollen samples on its total phenolic content and associated antioxidant activity as captured by DPPH and FRAP assays was analysed. On the basis of these findings, the pulverisation process can be omitted from the extraction protocol.
The selection of solvent is crucial for solvent extraction, with selectivity for the target compounds, the target compound’s solubility as well as cost and safety to be considered. Based on the law of similarity and intermiscibility, solvents with a polarity value near the polarity of the solute are likely to perform better [118]. Water, along with a range of alcoholic and organic solvents such as methanol, ethanol, acetonitrile, acetone, hexane and diethyl ether are commonly utilised in the extraction of bioactive compounds [20]. The current study aimed to analyse the impact of different solvents, including water, methanol (M), ethanol (E) and the combination of ethanol and water at a ratio of 70:30 (v/v) (E70:30) on the total phenolic content as well as DPPH and FRAP antioxidant activity of pollen samples collected from western Australia. The findings of the study demonstrate that the extraction solvent had the strongest influence on the responses of the dependent variables (p <0.05). Among the solvents tested, extracts prepared with 70% ethanol:30% water (v/v) demonstrated the highest activity across all performed assays.
Based on the interactions observed in this study, it appears that TPC values are dependent on solvent type and the extraction process, and it can be concluded that TPC can be maximised when the pollen extraction is carried out either using 70% ethanol:30% water coupled with agitation or reflux. DPPH antioxidant activity is maximised following agitation as an extraction process in any of the investigated solvents, whereas FRAP antioxidant activity is highest when pollen is extracted with maceration coupled with 70% ethanol:30% water. Bee pollen contains 13–55% of carbohydrates [6,7,8] and it can be assumed that some can be carried over into the extract by polar solvents. Consequently, the prolonged heating of bee pollen at a high temperature might lead to the formation of Maillard products from these carbohydrates during processing [3]. Therefore, an extraction method that does not expose the pollen sample to prolonged high temperatures can be considered favourable. Maceration is an easy process in extracting antioxidant principles; however, it takes 72 h to complete, as compared to agitation, which only requires 6 h. Reflux is a very promising method of extraction, as it only requires 2 h to perform; however, depending on the chosen solvent, it might require high temperature in order to operate. Thus, in this light, agitation can be recommended as the optimal extraction process to maximise antioxidant principles obtained from bee pollen samples.
The term ‘phenolic’ or ‘polyphenol’ is chemically defined as a substance that possesses an aromatic ring bearing one or more hydroxyl substituents, including functional derivatives such as esters, methyl esters and glycosides. These bioactive compounds are extensively found across the plant kingdom and are closely linked with the sensory and nutritional quality of fresh and processed plant foods, including bee products such as honey and bee pollen [9]. Keskin and Özkök reported various multifloral bee pollen samples from the Czech Republic to have a total phenolic content ranging from 15.2 mg to 22.73 mg GAE/g pollen [38], whereas Mayda, Özkök et al. reported TPC values of 26.69 ± 0.595 and 43.42 ± 0.779 4 mg GAE/g pollen [58]. TPC for multifloral bee pollen from Morocco was reported as 45.96 ± 0.51 mg GAE/g pollen [63] and samples obtained from Hungary had TPC values ranging from 9.15 ± 0.12 to 13.63 ± 0.11 mg GAE/g pollen [72]. TPC values (mg GAE/g pollen) for the two western Australian monofloral pollen samples investigated as part of this study following the optimised extraction protocol by using non-pulverised samples extracted with 70% ethanol:30% via agitation was 20.86 mg GAE/g. With this, the TPC value of the western Australian pollens are broadly within typical ranges found for a range of bee pollen samples from a wide geographical spread. It needs to be highlighted, though, that comparisons between data generated in different studies need to be treated with caution, as the chosen extraction condition (solvent and extraction method) will impact on the obtained TPC data. Furthermore, the method used in the analysis of TPC in this study utilised a Folin–Ciocalteu method in slightly basic medium (0.75% sodium carbonate) as compared to most researchers that used 7.5% sodium carbonate. This amendment to the common assay protocol was found to be necessary, since reducing sugars present in alcoholic and aqueous pollen extracts can also be reduced by the reagent, and thus, lead to an overestimation of TPC. [119]
The optimised extraction protocol was also used to assess the antioxidant activity of the two western Australian pollen samples investigated in this study. Despite relatively high correlations between FRAP, DPPH and TPC values found in this study, it can be argued that in vitro antioxidant capacity should not be determined by means of a single antioxidant test model because of the diverse types of antioxidant that might be present in the sample as well as the intricacy of the natural product matrix and the variety of free radical reaction mechanisms involved in oxidation. Complementary antioxidant assays might, therefore, produce richer data [78]. Thus, in this study, the antioxidant potential of bee pollen extracts was determined by means of two different radical scavenging assays, namely DPPH and FRAP.
Using the DPPH assay, Rocchetti and Castiglioni reported Magnolia and Lamium bee pollen from Italy to have antioxidant activities of 11.9 and 134.7 µmol TE/g pollen, respectively [78]. Mărghitaş et al. reported DPPH antioxidant activities ranging from 135 to 2814 µmol TE/g for various monofloral pollens from Romania [28] and Saral et al. found DPPH scavenging activities between 13.87 and 15.04 mg TE/g for multifloral pollen from Turkey [74]. DPPH data generated in this study for the western Australian pollen samples were 320.11 µmol (equivalent to 80.12 mg) TE/g following the optimised extraction protocol using non-pulverised pollen extracted with E70:30 by agitation. These findings are within the range of values reported by others.
Using the FRAP assay, Zuluaga-Domínguez et al. reported 87.2 ± 15.6 μmol Trolox/g for multifloral pollen from Colombia [37], whereas Saral et al. found a FRAP activity ranging from 8.69 to 84.89 μmol Fe2+E/g for multifloral bee pollen from Turkey [74]. In this study, following the optimised extraction protocol by using non-pulverised pollen extracted with E70:30 by agitation, FRAP antioxidant activity was found to be 342.28 μmol Fe+2 E/g, which is higher than the values reported by Saral et al. However, the comparison of FRAP values appears even more difficult, not only because the results are dependent on the chosen extraction conditions but also because the studies use different reference standards (Trolox or Fe2+) to express their results.

5. Conclusions

Based on a thorough review of the extant literature, a number of common bee pollen processing steps, solvents and extraction methods were identified, which can all impact on extraction efficiency and thus result in different TPC, DPPH and FRAP values. The study reports on an in-depth investigation into the optimisation of the most popular extraction conditions for maximum TPC, DPPH and FRAP antioxidant activity using two bee pollen samples from western Australia. The effects of pulverisation, the chosen solvent (70% aqueous ethanol, ethanol, methanol and water) as well as the adopted extraction process (agitation, maceration, reflux and sonication) were determined in order to optimise the extraction parameters. The study’s findings demonstrate that non-pulverised pollen extracted with 70% aqueous ethanol coupled with agitation as the extraction method constitutes the best conditions in order to maximise the extraction of phenolics and antioxidant principles in these bee pollen samples.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/antiox10071113/s1. Table S1: Data of pollen multilevel factor pollen analysis.

Author Contributions

Conceptualisation, I.L.L. and C.L.; methodology, I.L.L., O.Y. and C.L.; formal analysis, I.L.L. and O.Y.; writing—original draft preparation, I.L.L.; writing—review and editing, C.L., O.Y. and L.Y.L.; supervision, C.L., L.Y.L. and K.H.; project administration, C.L.; funding acquisition, C.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Cooperative Research Centre for Honey Bee Products (CRC HBP).

Data Availability Statement

The data presented in this study are available as supplementary material.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. LeBlanc, B.W.; Davis, O.K.; Boue, S.; DeLucca, A.; Deeby, T. Antioxidant activity of Sonoran Desert bee pollen. Food Chem. 2009, 115, 1299–1305. [Google Scholar] [CrossRef]
  2. Estevinho, L.M.; Dias, T.; Anjos, O. Influence of the storage conditions (frozen vs dried) in health-related lipid indexes and antioxidants of bee pollen. Eur. J. Lipid Sci. Technol. 2018, 121, 1–9. [Google Scholar] [CrossRef] [Green Version]
  3. Thakur, M.; Nanda, V. Composition and functionality of bee pollen: A review. Trends Food Sci. Technol. 2020, 98, 82–106. [Google Scholar] [CrossRef]
  4. Bakour, M.; Fernandes, Â.; Barros, L.; Sokovic, M.; Ferreira, I.C.; Lyoussi, B. Bee bread as a functional product: Chemical composition and bioactive properties. LWT 2019, 109, 276–282. [Google Scholar] [CrossRef] [Green Version]
  5. Nguyen, H.T.L.; Panyoyai, N.; Kasapis, S.; Pang, E.; Mantri, N. Honey and Its Role in Relieving Multiple Facets of Atherosclerosis. Nutrients 2019, 11, 167. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Féas, X.; Vázquez-Tato, M.P.; Estevinho, L.; Seijas, J.A.; Iglesias, A. Organic Bee Pollen: Botanical Origin, Nutritional Value, Bioactive Compounds, Antioxidant Activity and Microbiological Quality. Molecules 2012, 17, 8359–8377. [Google Scholar] [CrossRef]
  7. Kalaycıoğlu, Z.; Kaygusuz, H.; Döker, S.; Kolaylı, S.; Erim, F. Characterization of Turkish honeybee pollens by principal component analysis based on their individual organic acids, sugars, minerals, and antioxidant activities. LWT 2017, 84, 402–408. [Google Scholar] [CrossRef]
  8. Wu, W.; Wang, K.; Qiao, J.; Dong, J.; Li, Z.; Zhang, H. Improving nutrient release of wall-disrupted bee pollen with a combination of ultrasonication and high shear technique. J. Sci. Food Agric. 2019, 99, 564–575. [Google Scholar] [CrossRef]
  9. Hossen, M.S.; Ali, M.Y.; Jahurul, M.H.A.; Abdel-Daim, M.M.; Gan, S.H.; Khalil, M.I. Beneficial roles of honey polyphenols against some human degenerative diseases: A review. Pharmacol. Rep. 2017, 69, 1194–1205. [Google Scholar] [CrossRef]
  10. Borycka, K.; Grabek-Lejko, D.; Kasprzyk, I. Antioxidant and antibacterial properties of commercial bee pollen products. J. Apic. Res. 2015, 54, 491–502. [Google Scholar] [CrossRef]
  11. Ozkok, A. Determination of antioxidant capacities, chemical composition and melissopalynological characterization of Verbascum spp. and Euphorbia spp. honeys. Fresenius Environ. Bull. 2019, 28, 2644–2649. [Google Scholar]
  12. Čeksterytė, V.; Kurtinaitienė, B.; Venskutonis, P.; Pukalskas, A.; Kazernavičiūtė, R.; Balžekas, J. Evaluation of antioxidant activity and flavonoid composition in differently preserved bee products. Czech J. Food Sci. 2016, 34, 133–142. [Google Scholar] [CrossRef] [Green Version]
  13. Nayik, G.A.; Nanda, V. A chemometric approach to evaluate the phenolic compounds, antioxidant activity and mineral content of different unifloral honey types from Kashmir, India. LWT 2016, 74, 504–513. [Google Scholar] [CrossRef]
  14. Cinkmanis, I.; Dimins, F.; Mikelsone, V. Influence of Lyophilization and convective type drying on antioxidant properties, total phenols and flavonoids in pollens. In Proceedings of the 11th Baltic Conference on Food Science and Technology “Food Science and Technology in a Changing World, Jelgava, Latvia, 27–28 April 2017; pp. 201–203. [Google Scholar]
  15. Ozkan, K.; Sagcan, N.; Ozulku, G.; Sagdic, O.; Toker, O.S.; Muz, M.N. Bioactive and bioaccessibility characteristics of honeybee pollens collected from different regions of Turkey. J. Food Meas. Charact. 2017, 12, 581–587. [Google Scholar] [CrossRef]
  16. Yang, Y.; Zhang, J.; Zhou, Q.; Wang, L.; Huang, W.; Wang, R. Effect of ultrasonic and ball-milling treatment on cell wall, nutrients, and antioxidant capacity of rose (Rosa rugosa) bee pollen, and identification of bioactive components. J. Sci. Food Agric. 2019, 99, 5350–5357. [Google Scholar] [CrossRef] [PubMed]
  17. Gorjanović, S.Ž.; Alvarez-Suarez, J.M.; Novaković, M.M.; Pastor, F.T.; Pezo, L.; Battino, M.; Sužnjević, D.Ž. Comparative analysis of antioxidant activity of honey of different floral sources using recently developed polarographic and various spectrophotometric assays. J. Food Compos. Anal. 2013, 30, 13–18. [Google Scholar] [CrossRef]
  18. Khalil, I.; Moniruzzaman, M.; Boukraâ, L.; Benhanifia, M.; Islam, A.; Islam, N.; Sulaiman, S.A.; Gan, S.H. Physicochemical and Antioxidant Properties of Algerian Honey. Molecules 2012, 17, 11199–11215. [Google Scholar] [CrossRef] [Green Version]
  19. Hmidani, A.; Bouhlali, E.D.T.; Khouya, T.; Ramchoun, M.; Filali-Zegzouti, Y.; Benlyas, M.; Alem, C. Effect of extraction methods on antioxidant and anticoagulant activities of Thymus atlanticus aerial part. Sci. Afr. 2019, 5, 5. [Google Scholar] [CrossRef]
  20. Dailey, A.; Vuong, Q.V. Effect of extraction solvents on recovery of bioactive compounds and antioxidant properties from macadamia (Macadamia tetraphylla) skin waste. Cogent Food Agric. 2015, 1, 1115646. [Google Scholar] [CrossRef]
  21. Azwanida, A. A Review on the Extraction Methods Use in Medicinal Plants, Principle, Strength and Limitation. Med. Aromat. Plants 2015, 04, 04. [Google Scholar] [CrossRef]
  22. Khadra, L.; Kamel, M.; Hamama, B.; Ibrahim, D.; Daoud, H. Chemical composition, antioxidant and antimicrobial activities of algerian bee pollen (inula viscosa) methanolic extract. Int. J. Res. Pharm. Chem. 2019, 9, 9. [Google Scholar] [CrossRef]
  23. De-Melo, A.A.M.; Estevinho, M.L.M.F.; Sattler, J.A.G.; Souza, B.R.; Freitas, A.D.S.; Barth, O.M.; de Almeida-Muradian, L.B. Effect of processing conditions on characteristics of dehydrated bee-pollen and correlation between quality parameters. LWT 2016, 65, 808–815. [Google Scholar] [CrossRef] [Green Version]
  24. Alimoglu, G.; Guzelmeric, E.; Yuksel, P.I.; Celik, C.; Deniz, I.; Yesilada, E. Monofloral and polyfloral bee pollens: Comparative evaluation of their phenolics and bioactivity profiles. LWT 2021, 142, 110973. [Google Scholar] [CrossRef]
  25. Pascoal, A.; Rodrigues, S.; Teixeira, A.; Feás, X.; Estevinho, L.M. Biological activities of commercial bee pollens: Antimicrobial, antimutagenic, antioxidant and anti-inflammatory. Food Chem. Toxicol. 2014, 63, 233–239. [Google Scholar] [CrossRef]
  26. Morais, M.; Moreira, L.; Feás, X.; Estevinho, L.M. Honeybee-collected pollen from five Portuguese Natural Parks: Palynological origin, phenolic content, antioxidant properties and antimicrobial activity. Food Chem. Toxicol. 2011, 49, 1096–1101. [Google Scholar] [CrossRef] [Green Version]
  27. Leja, M.; Mareczek, A.; Wyżgolik, G.; Klepacz-Baniak, J.; Czekońska, K. Antioxidative properties of bee pollen in selected plant species. Food Chem. 2007, 100, 237–240. [Google Scholar] [CrossRef]
  28. Mărghitaş, L.A.; Stanciu, O.G.; Dezmirean, D.S.; Bobis, O.; Popescu, O.; Bogdanov, S.; Campos, M.G. In vitro antioxidant capacity of honeybee-collected pollen of selected floral origin harvested from Romania. Food Chem. 2009, 115, 878–883. [Google Scholar] [CrossRef]
  29. Thakur, M.; Nanda, V. Screening of Indian bee pollen based on antioxidant properties and polyphenolic composition using UHPLC-DAD-MS/MS: A multivariate analysis and ANN based approach. Food Res. Int. 2021, 140, 110041. [Google Scholar] [CrossRef] [PubMed]
  30. De-Melo, A.A.M.; Estevinho, L.M.; Moreira, M.M.; Delerue-Matos, C.; Freitas, A.D.S.D.; Barth, O.M.; de Almeida-Muradian, L.B. A multivariate approach based on physicochemical parameters and biological potential for the botanical and geographical discrimination of Brazilian bee pollen. Food Biosci. 2018, 25, 91–110. [Google Scholar] [CrossRef] [Green Version]
  31. Kaškonienė, V.; Adaškevičiūtė, V.; Kaškonas, P.; Mickienė, R.; Maruška, A. Antimicrobial and antioxidant activities of natural and fermented bee pollen. Food Biosci. 2020, 34, 100532. [Google Scholar] [CrossRef]
  32. Omar, W.A.W.; Azhar, N.A.; Fadzilah, N.H.; Kamal, N.N.S.N.M. Bee pollen extract of Malaysian stingless bee enhances the effect of cisplatin on breast cancer cell lines. Asian Pac. J. Trop. Biomed. 2016, 6, 265–269. [Google Scholar] [CrossRef] [Green Version]
  33. Khongkarat, P.; Ramadhan, R.; Phuwapraisirisan, P.; Chanchao, C. Safflospermidines from the bee pollen of Helianthus annuus L. exhibit a higher in vitro antityrosinase activity than kojic acid. Heliyon 2020, 6, e03638. [Google Scholar] [CrossRef] [PubMed]
  34. Zhang, H.; Wang, X.; Wang, K.; Li, C. Antioxidant and Tyrosinase Inhibitory Properties of Aqueous Ethanol Extracts from Monofloral Bee Pollen. J. Apic. Sci. 2015, 59, 119–128. [Google Scholar] [CrossRef] [Green Version]
  35. Hemmami, H.; Ben Seghir, B.; Ben Ali, M.; Rebiai, A.; Zeghoud, S.; Brahmia, F. Phenolic profile and antioxidant activity of bee pollen extracts from different regions of Algeria. Ovidius Univ. Ann. Chem. 2020, 31, 93–98. [Google Scholar] [CrossRef]
  36. Izuta, H.; Narahara, Y.; Shimazawa, M.; Mishima, S.; Kondo, S.-I.; Hara, H. 1,1-Diphenyl-2-picrylhydrazyl Radical Scavenging Activity of Bee Products and Their Constituents Determined by ESR. Biol. Pharm. Bull. 2009, 32, 1947–1951. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Zuluaga-Domínguez, C.; Serrato-Bermudez, J.; Quicazan, M.; Zuluaga, C.; Serrato, J. Influence of drying-related operations on microbiological, structural and physicochemical aspects for processing of bee-pollen. Eng. Agric. Environ. Food 2018, 11, 57–64. [Google Scholar] [CrossRef]
  38. Keskin, M.; Özkök, A. Effects of drying techniques on chemical composition and volatile constituents of bee pollen. Czech J. Food Sci. 2020, 38, 203–208. [Google Scholar] [CrossRef]
  39. Vasconcelos, M.R.D.S.; Duarte, A.; Gomes, E.P.; Da Silva, S.C.; López, A.M.Q. Physicochemical composition and antioxidant potential of bee pollen from different botanical sources in Alagoas, Brazil. Ciência Agrotecnol. 2017, 41, 447–458. [Google Scholar] [CrossRef] [Green Version]
  40. Predictive mathematical modeling for EC50 calculation of antioxidant activity and antibacterial ability of Thai bee products. J. Appl. Pharm. Sci. 2017, 7, 122–133. [CrossRef] [Green Version]
  41. Cosmulescu, S.; Trandafir, I.; Nour, V. Chemical Composition and Antioxidant Activity of Walnut Pollen Samples. Not. Bot. Horti Agrobot. Cluj-Napoca 2015, 43, 361–365. [Google Scholar] [CrossRef]
  42. Bridi, R.; Atala, E.; Pizarro, P.N.; Montenegro, G. Honeybee Pollen Load: Phenolic Composition and Antimicrobial Activity and Antioxidant Capacity. J. Nat. Prod. 2019, 82, 559–565. [Google Scholar] [CrossRef] [PubMed]
  43. Lopes, A.J.O.; Vasconcelos, C.C.; Pereira, F.; Silva, R.H.M.; Queiroz, P.F.D.S.; Fernandes, C.V.; Garcia, J.B.S.; Ramos, R.M.; Da Rocha, C.Q.; Lima, S.T.D.J.R.M.; et al. Anti-Inflammatory and Antinociceptive Activity of Pollen Extract Collected by Stingless Bee Melipona fasciculata. Int. J. Mol. Sci. 2019, 20, 4512. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Lopes, A.J.O.; Vasconcelos, C.C.; Garcia, J.B.S.; Pinheiro, M.S.D.; Pereira, F.A.N.; Camelo, D.D.S.; De Morais, S.V.; Freitas, J.R.B.; Da Rocha, C.Q.; Ribeiro, M.N.D.S.; et al. Anti-Inflammatory and Antioxidant Activity of Pollen Extract Collected by Scaptotrigona affinis postica: In silico, in vitro, and in vivo Studies. Antioxidants 2020, 9, 103. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Futui, W.; Thongwai, N. Antimicrobial and Antioxidant Activities, Total Phenolic and Flavonoid Contents of Bee Pollen Crude Extracts. Int. J. Biosci. Biochem. Bioinform. 2020, 10, 42–48. [Google Scholar] [CrossRef] [Green Version]
  46. Nurdianah, H.F.; Firdaus, A.A.H.; Azam, O.E.; Wan Adnan, W.O. Antioxidant activity of bee pollen ethanolic extracts from Malaysian stingless bee measured using DPPH-HPLC assay. Int. Food Res. J. 2016, 23, 403–405. [Google Scholar]
  47. Fatrcová-Šramková, K.; Nôžková, J.; Kačániová, M.; Máriássyová, M.; Rovná, K.; Stricik, M. Antioxidant and antimicrobial properties of monofloral bee pollen. J. Environ. Sci. Health Part B 2013, 48, 133–138. [Google Scholar] [CrossRef] [PubMed]
  48. Sun, L.; Guo, Y.; Zhang, Y.; Zhuang, Y. Antioxidant and Anti-tyrosinase Activities of Phenolic Extracts from Rape Bee Pollen and Inhibitory Melanogenesis by cAMP/MITF/TYR Pathway in B16 Mouse Melanoma Cells. Front. Pharmacol. 2017, 8, 1–9. [Google Scholar] [CrossRef] [Green Version]
  49. Su, J.; Yang, X.; Lu, Q.; Liu, R. Antioxidant and anti-tyrosinase activities of bee pollen and identification of active components. J. Apic. Res. 2021, 60, 297–307. [Google Scholar] [CrossRef]
  50. Uçar, M.; Barlak, Y.; Deger, O. Antioxidant properties of dmso and water extracts of turkish bee pollen. World J. Pharm. Pharm. Sci. 2017, 6647, 154–163. [Google Scholar] [CrossRef]
  51. Oroian, M.; Ursachi, F.; Dranca, F. Ultrasound-Assisted Extraction of Polyphenols from Crude Pollen. Antioxidants 2020, 9, 322. [Google Scholar] [CrossRef]
  52. Barbieri, D.; Gabriele, M.; Summa, M.; Colosimo, R.; Leonardi, D.; Domenici, V.; Pucci, L. Antioxidant, Nutraceutical Properties, and Fluorescence Spectral Profiles of Bee Pollen Samples from Different Botanical Origins. Antioxidants 2020, 9, 1001. [Google Scholar] [CrossRef] [PubMed]
  53. Shen, Z.; Geng, Q.; Huang, H.; Yao, H.; Du, T.; Chen, L.; Wu, Z.; Miao, X.; Shi, P. Antioxidative and Cardioprotective Effects of Schisandra chinensis Bee Pollen Extract on Isoprenaline-Induced Myocardial Infarction in Rats. Molecules 2019, 24, 1090. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  54. Saral, Ö.; Yildiz, O.; Aliyazicioğlu, R.; Yuluğ, E.; Canpolat, S.; Öztürk, F.; Kolayli, S. Apitherapy products enhance the recovery of CCL4-induced hepatic damages in rats. Turk. J. Med. Sci. 2016, 46, 194–202. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Pérez-Pérez, E.M.; Vit, P.; Rivas, E.; Sciortino, R.; Sosa, A.; Tejada, D.; Rodríguez-Malaver, A.J. Antioxidant activity of four color fractions of bee pollen from Mérida, Venezuela. Arch. Latinoam. Nutr. 2012, 62, 375–380. [Google Scholar]
  56. Daudu, O.M. Bee Pollen Extracts as Potential Antioxidants and Inhibitors of α-Amylase and α-Glucosidase Enzymes In Vitro Assessment. J. Apic. Sci. 2019, 63, 315–325. [Google Scholar] [CrossRef] [Green Version]
  57. Stanciu, O.G.; Dezmirean, D.S.; Campos, M.G. Bee Pollen in Transylvania (Romania): Palynological Characterization and ORACFL Values of Lipophilic and Hydrophilic Extracts of Monofloral Pollen Pellets. J. Agric. Sci. Technol. A 2016, 6, 18–37. [Google Scholar] [CrossRef] [Green Version]
  58. Mayda, N.; Özkök, A.; Bayram, N.E.; Gerçek, Y.C.; Sorkun, K. Bee bread and bee pollen of different plant sources: Determination of phenolic content, antioxidant activity, fatty acid and element profiles. J. Food Meas. Charact. 2020, 14, 1795–1809. [Google Scholar] [CrossRef]
  59. Anjos, O.; Fernandes, R.; Cardoso, S.M.; Delgado, T.; Farinha, N.; Paula, V.; Estevinho, L.M.; Carpes, S.T. Bee pollen as a natural antioxidant source to prevent lipid oxidation in black pudding. LWT 2019, 111, 869–875. [Google Scholar] [CrossRef] [Green Version]
  60. Almeida, J.D.F.; dos Reis, A.S.; Heldt, L.F.S.; Pereira, D.; Bianchin, M.; de Moura, C.; Plata-Oviedo, M.V.; Haminiuk, C.; Ribeiro, I.S.; Luz, C.F.P.; et al. Lyophilized bee pollen extract: A natural antioxidant source to prevent lipid oxidation in refrigerated sausages. LWT 2017, 76, 299–305. [Google Scholar] [CrossRef]
  61. Fatrcová-Šramková, K.; Nôžková, J.; Máriássyová, M.; Kačániová, M. Biologically active antimicrobial and antioxidant substances in theHelianthus annuusL. bee pollen. J. Environ. Sci. Health Part B 2016, 51, 176–181. [Google Scholar] [CrossRef]
  62. Mosić, M.; Trifković, J.; Vovk, I.; Gašić, U.; Tešić, Ž.; Šikoparija, B.; Milojković-Opsenica, D. Phenolic Composition Influences the Health-Promoting Potential of Bee-Pollen. Biomolecules 2019, 9, 783. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  63. El Ghouizi, A.; El Menyiy, N.; Falcão, S.I.; Vilas-Boas, M.; Lyoussi, B. Chemical composition, antioxidant activity, and diuretic effect of Moroccan fresh bee pollen in rats. Veter. World 2020, 13, 1251–1261. [Google Scholar] [CrossRef] [PubMed]
  64. Rebiai, A.; Lane, T. Chemical composition and antioxidant activity of Apis mellifera bee pollen from Northwest Algeria. J. Fundam. Appl. Sci. 2012, 4, 26–35. [Google Scholar] [CrossRef] [Green Version]
  65. Araújo, J.S.; Chambó, E.D.; Costa, M.A.P.D.C.; Da Silva, S.M.P.C.; De Carvalho, C.A.L.; Estevinho, L.M. Chemical Composition and Biological Activities of Mono- and Heterofloral Bee Pollen of Different Geographical Origins. Int. J. Mol. Sci. 2017, 18, 921. [Google Scholar] [CrossRef] [Green Version]
  66. Bárbara, M.S.; Machado, C.S.; Sodré, G.D.S.; Dias, L.G.; Estevinho, L.M.; De Carvalho, C.A.L. Microbiological Assessment, Nutritional Characterization and Phenolic Compounds of Bee Pollen from Mellipona mandacaia Smith, 1983. Molecules 2015, 20, 12525–12544. [Google Scholar] [CrossRef] [Green Version]
  67. Carpes, S.T. Chemical composition and free radical scavenging activity of Apis mellifera bee pollen from Southern Brazil. Braz. J. Food Technol. 2009, 12, 220–229. [Google Scholar] [CrossRef]
  68. Sartini, S.; Djide, M.N.; Nainu, F. Correlation Phenolic Concentration to Antioxidant and Antibacterial Activities of Several Ethanolic extracts from Indonesia. J. Phys. Conf. Ser. 2019, 1341, 072009. [Google Scholar] [CrossRef]
  69. Özcan, M.M.; Aljuhaimi, F.; Babiker, E.E.; Uslu, N.; Ceylan, D.A.; Ghafoor, K.; Özcan, M.M.; Dursun, N.; Ahmed, I.M.; Jamiu, F.G.; et al. Determination of Antioxidant Activity, Phenolic Compound, Mineral Contents and Fatty Acid Compositions of Bee Pollen Grains Collected from Different Locations. J. Apic. Sci. 2019, 63, 69–79. [Google Scholar] [CrossRef] [Green Version]
  70. Zuluaga-Dominguez, C.M.; Quicazan, M. Effect of Fermentation on Structural Characteristics and Bioactive Compounds of Bee-Pollen Based Food. J. Apic. Sci. 2019, 63, 209–222. [Google Scholar] [CrossRef] [Green Version]
  71. Duran, A.; Quicazan, M.; Zuluaga-Dominguez, C. Effect of Solar Drying Process on Bioactive Compounds and Antioxidant Activity in Vitro of High Andean Region Bee Pollen. Chem. Eng. Trans. 2019, 75, 91–96. [Google Scholar] [CrossRef]
  72. Aleksieva, K.I.; Mladenova, R.B.; Solakov, N.Y.; Loginovska, K.K. EPR analysis of free radical components and antioxidant activity of bee pollen before and after gamma-irradiation. J. Radioanal. Nucl. Chem. 2021, 327, 713–719. [Google Scholar] [CrossRef]
  73. Atsalakis, E.; Chinou, I.; Makropoulou, M.; Karabournioti, S.; Graikou, K. Evaluation of Phenolic Compounds in Cistus creticus Bee Pollen from Greece. Antioxidant and Antimicrobial Properties. Nat. Prod. Commun. 2017, 12, 1813–1816. [Google Scholar] [CrossRef] [Green Version]
  74. Saral, Ö.; Kiliçarslan, M.; Şahin, H.; Yildiz, O.; Dinçer, B. Evaluation of antioxidant activity of bee products of different bee races in Turkey. Turk. J. Veter. Anim. Sci. 2019, 43, 441–447. [Google Scholar] [CrossRef]
  75. Al-Salem, H.S.; Al-Yousef, H.M.; Ashour, A.E.; Ahmed, A.F.; Amina, M.; Issa, I.S.; Bhat, R.S. Antioxidant and hepatorenal protective effects of bee pollen fractions against propionic acid-induced autistic feature in rats. Food Sci. Nutr. 2020, 8, 5114–5127. [Google Scholar] [CrossRef] [PubMed]
  76. Gabriele, M.; Parri, E.; Felicioli, A.; Sagona, S.; Pozzo, L.; Biondi, C.; Domenici, V.; Pucci, L. Phytochemical composition and antioxidant activity of Tuscan bee pollen of different botanic origins. Ital. J. Food Sci. 2015, 27, 248–259. [Google Scholar]
  77. Yıldız, O.; Can, Z.; Saral, O.; Yuluğ, E.; Oztürk, F.; Aliyazıcıoğlu, R.; Canpolat, S.; Kolaylı, S. Hepatoprotective Potential of Chestnut Bee Pollen on Carbon Tetrachloride-Induced Hepatic Damages in Rats. Evid. Based Complement. Altern. Med. 2013, 2013, 1–9. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  78. Rocchetti, G.; Castiglioni, S.; Maldarizzi, G.; Carloni, P.; Lucini, L. UHPLC-ESI-QTOF-MS phenolic profiling and antioxidant capacity of bee pollen from different botanical origin. Int. J. Food Sci. Technol. 2018, 54, 335–346. [Google Scholar] [CrossRef]
  79. Yan, S.; Li, Q.; Xue, X.; Wang, K.; Zhao, L.; Wu, L. Analysis of improved nutritional composition of bee pollen (Brassica campestris L.) after different fermentation treatments. Int. J. Food Sci. Technol. 2019, 54, 2169–2181. [Google Scholar] [CrossRef]
  80. Rebiai, A.; Lanez, T. A Facile Electrochemical Analysis to Determine Antioxidant Activity of Bee Pollen. Int. Lett. Chem. Phys. Astron. 2013, 14, 31–38. [Google Scholar] [CrossRef] [Green Version]
  81. Cheng, N.; Chen, S.; Liu, X.; Zhao, H.; Cao, W. Impact of SchisandraChinensis Bee Pollen on Nonalcoholic Fatty Liver Disease and Gut Microbiota in HighFat Diet Induced Obese Mice. Nutrients 2019, 11, 346. [Google Scholar] [CrossRef] [Green Version]
  82. Muñoz, E.; Velásquez, P.; Rodriguez, K.; Montenegro, G.; Giordano, A. Influence of Brassica campestris and Galega officinalis on Antioxidant Activity of Bee Pollen. Rev. Bras. Farm. 2020, 30, 444–449. [Google Scholar] [CrossRef]
  83. Yesiltas, B.; Capanoglu, E.; Fıratlıgil-Durmuş, E.; Sunay, A.E.; Samanci, T.; Boyacioglu, D. Investigating the in-vitro bioaccessibility of propolis and pollen using a simulated gastrointestinal digestion System. J. Apic. Res. 2014, 53, 101–108. [Google Scholar] [CrossRef] [Green Version]
  84. Mejías, E.; Montenegro, G. The Antioxidant Activity of Chilean Honey and Bee Pollen Produced in the Llaima Volcano’s Zones. J. Food Qual. 2012, 35, 315–322. [Google Scholar] [CrossRef]
  85. Negri, G.; Teixeira, É.W.; Alves, M.L.T.M.F.; Moreti, A.C.D.C.C.; Otsuk, I.P.; Borguini, R.G.; Salatino, A. Hydroxycinnamic Acid Amide Derivatives, Phenolic Compounds and Antioxidant Activities of Extracts of Pollen Samples from Southeast Brazil. J. Agric. Food Chem. 2011, 59, 5516–5522. [Google Scholar] [CrossRef]
  86. Campos, M.G.; Webby, R.F.; Markham, K.R.; Mitchell, K.A.; Da Cunha, A.P. Age-Induced Diminution of Free Radical Scavenging Capacity in Bee Pollens and the Contribution of Constituent Flavonoids. J. Agric. Food Chem. 2003, 51, 742–745. [Google Scholar] [CrossRef] [Green Version]
  87. Ulusoy, E.; Kolayli, S. Phenolic Composition and Antioxidant Properties of Anzer Bee Pollen. J. Food Biochem. 2013, 38, 73–82. [Google Scholar] [CrossRef]
  88. Mohdaly, A.A.; Mahmoud, A.A.; Roby, M.; Smetanska, I.; Ramadan, M.F. Phenolic Extract from Propolis and Bee Pollen: Composition, Antioxidant and Antibacterial Activities. J. Food Biochem. 2015, 39, 538–547. [Google Scholar] [CrossRef]
  89. De-Melo, A.A.M.; Estevinho, L.M.; Moreira, M.M.; Delerue-Matos, C.; Freitas, A.D.S.D.; Barth, O.M.; de Almeida-Muradian, L.B. Phenolic profile by HPLC-MS, biological potential, and nutritional value of a promising food: Monofloral bee pollen. J. Food Biochem. 2018, 42, e12536. [Google Scholar] [CrossRef] [Green Version]
  90. Şahin, S.; Karkar, B. The antioxidant properties of the chestnut bee pollen extract and its preventive action against oxidatively induced damage in DNA bases. J. Food Biochem. 2019, 43, e12888. [Google Scholar] [CrossRef] [PubMed]
  91. Belina-Aldemita, M.D.; Schreiner, M.; D’Amico, S. Characterization of phenolic compounds and antioxidative potential of pot-pollen produced by stingless bees (Tetragonula biroiFriese) from the Philippines. J. Food Biochem. 2020, 44, e13102. [Google Scholar] [CrossRef]
  92. Zuluaga-Domínguez, C.; Castro-Mercado, L.; Quicazán, M.C. Effect of enzymatic hydrolysis on structural characteristics and bioactive composition of bee-pollen. J. Food Process. Preserv. 2019, 43, e13983. [Google Scholar] [CrossRef]
  93. Bujang, J.S.; Zakaria, M.H.; Ramaiya, S.D. Chemical constituents and phytochemical properties of floral maize pollen. PLoS ONE 2021, 16, e0247327. [Google Scholar] [CrossRef]
  94. Kaškonienė, V.; Kaškonas, P.; Maruška, A. Volatile compounds composition and antioxidant activity of bee pollen collected in Lithuania. Chem. Pap. 2015, 69, 291–299. [Google Scholar] [CrossRef]
  95. Kaškonienė, V.; Katilevičiūtė, A.; Kaškonas, P.; Maruska, A. The impact of solid-state fermentation on bee pollen phenolic compounds and radical scavenging capacity. Chem. Pap. 2018, 72, 2115–2120. [Google Scholar] [CrossRef]
  96. Khider, M.; Elbanna, K.; Mahmoud, A.; Owayss, A.A. Egyptian honeybee pollen as antimicrobial, antioxidant agents, and dietary food supplements. Food Sci. Biotechnol. 2013, 22, 1–9. [Google Scholar] [CrossRef]
  97. Canale, A.; Benelli, G.; Castagna, A.; Sgherri, C.; Poli, P.; Serra, A.; Mele, M.; Ranieri, A.; Signorini, F.; Bientinesi, M.; et al. Microwave-Assisted Drying for the Conservation of Honeybee Pollen. Materials 2016, 9, 363. [Google Scholar] [CrossRef] [Green Version]
  98. Freire, K.R.L.; Lins, A.C.S.; Dórea, M.C.; Santos, F.A.R.; Camara, C.A.; Silva, T.M.S. Palynological Origin, Phenolic Content, and Antioxidant Properties of Honeybee-Collected Pollen from Bahia, Brazil. Molecules 2012, 17, 1652–1664. [Google Scholar] [CrossRef] [Green Version]
  99. Kim, S.B.; Jo, Y.H.; Liu, Q.; Ahn, J.H.; Hong, I.P.; Han, S.M.; Hwang, B.Y.; Lee, M.K. Optimization of Extraction Condition of Bee Pollen Using Response Surface Methodology: Correlation between Anti-Melanogenesis, Antioxidant Activity, and Phenolic Content. Molecules 2015, 20, 19764–19774. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  100. Zhang, Y.; Yang, F.; Jamali, M.A.; Peng, Z. Antioxidant Enzyme Activities and Lipid Oxidation in Rape (Brassica campestris L.) Bee Pollen Added to Salami during Processing. Molecules 2016, 21, 1439. [Google Scholar] [CrossRef]
  101. Zhang, H.; Liu, R.; Lu, Q. Separation and Characterization of Phenolamines and Flavonoids from Rape Bee Pollen, and Comparison of Their Antioxidant Activities and Protective Effects against Oxidative Stress. Molecules 2020, 25, 1264. [Google Scholar] [CrossRef] [Green Version]
  102. Castagna, A.; Benelli, G.; Conte, G.; Sgherri, C.; Signorini, F.; Nicolella, C.; Ranieri, A.; Canale, A. Drying Techniques and Storage: Do They Affect the Nutritional Value of Bee-Collected Pollen? Molecules 2020, 25, 4925. [Google Scholar] [CrossRef] [PubMed]
  103. Oyarzún, J.E.; Andia, M.E.; Uribe, S.; Pizarro, P.N.; Núñez, G.; Montenegro, G.; Bridi, R. Honeybee Pollen Extracts Reduce Oxidative Stress and Steatosis in Hepatic Cells. Molecules 2021, 26, 6. [Google Scholar] [CrossRef] [PubMed]
  104. Asmae, E.G.; Nawal, E.M.; Bakour, M.; Lyoussi, B. Moroccan Monofloral Bee Pollen: Botanical Origin, Physicochemical Characterization, and Antioxidant Activities. J. Food Qual. 2021, 2021, 1–10. [Google Scholar] [CrossRef]
  105. Rodriguez-Gonzalez, I.; Ortega-Toro, R.; Diaz, C. Influence of microwave- and ultrasound-assisted extraction on bioactive compounds from pollen. Contemp. Eng. Sci. 2018, 11, 1669–1676. [Google Scholar] [CrossRef] [Green Version]
  106. Velasquez, P.; Rodriguez, K.; Retamal, M.; Giordano, A.; Valenzuela, L.M.; Montenegro, G. Relation between composition, antioxidant and antibacterial activities and botanical origin of multi-floral bee pollen. J. Appl. Bot. Food Qual. 2017, 90, 306–314. [Google Scholar] [CrossRef]
  107. Carpes, S.; De Alencar, S.; Cabral, I.; Oldoni, T.; Mourão, G.; Haminiuk, C.; Da Luz, C.; Masson, M.L. Polyphenols and palynological origin of bee pollen ofApis melliferaL. from Brazil. Characterization of polyphenols of bee pollen. CyTA J. Food 2013, 11, 150–161. [Google Scholar] [CrossRef] [Green Version]
  108. Bárbara, M.F.S.; Moreira, M.M.; Machado, C.S.; Chambó, E.D.; Pascoal, A.; De Carvalho, C.A.L.; Sodré, G.D.S.; Delerue-Matos, C.; Estevinho, L.M. Storage methods, phenolic composition, and bioactive properties of Apis mellifera and Trigona spinipes pollen. J. Apic. Res. 2020, 60, 1–9. [Google Scholar] [CrossRef]
  109. Carpes, S.T.; Begnini, R.; De Alencar, S.M.; Masson, M.L. Study of preparations of bee pollen extracts, antioxidant and antibacterial activity. Ciência Agrotecnol. 2007, 31, 1818–1825. [Google Scholar] [CrossRef] [Green Version]
  110. Zou, Y.; Hu, J.; Huang, W.; Zhu, L.; Shao, M.; Dordoe, C.; Ahn, Y.-J.; Wang, D.; Zhao, Y.; Xiong, Y.; et al. The botanical origin and antioxidant, anti-BACE1 and antiproliferative properties of bee pollen from different regions of South Korea. BMC Complement. Med. Ther. 2020, 20, 236. [Google Scholar] [CrossRef]
  111. Paradowska, K.; Zielińska, A.; Kuras, M.; Wawer, I. The composition of bee pollen color fractions evaluated by solid-state 1H and 13C NMR: Their macroelement content and antioxidant properties. J. Apic. Res. 2017, 56, 523–532. [Google Scholar] [CrossRef]
  112. Yildiz, O.; Karahalil, F.Y.; Can, Z.; Sahin, H.; Kolayli, S. Total monoamine oxidase (MAO) inhibition by chestnut honey, pollen and propolis. J. Enzym. Inhib. Med. Chem. 2014, 29, 690–694. [Google Scholar] [CrossRef] [PubMed]
  113. Silva, T.M.; Camara, C.; Lins, A.C.; Agra, M.D.F.; Silva, E.M.; Reis, I.T.; Freitas, B. Chemical composition, botanical evaluation and screening of radical scavenging activity of collected pollen by the stingless bees Melipona rufiventris (Uruçu-amarela). An. Acad. Bras. Ciências 2009, 81, 173–178. [Google Scholar] [CrossRef] [PubMed]
  114. Dai, Y.; Ding, Z.; Lei, Y.; Yufen, B. Polyphenol Content in Chinese Bee Products and Their Antioxidant Activity. Asian J. Chem. 2013, 25, 8019–8021. [Google Scholar] [CrossRef]
  115. Amalia, E.; Diantini, A.; Subarnas, A. Water-soluble propolis and bee pollen of Trigona spp. from South Sulawesi Indonesia induce apoptosis in the human breast cancer MCF-7 cell line. Oncol. Lett. 2020, 20, 1. [Google Scholar] [CrossRef] [PubMed]
  116. Liberato, M.D.C.T.C.; De Morais, S.M.; Siqueira, S.M.C.; De Menezes, J.E.S.A.; Ramos, D.N.; Machado, L.K.A.; Magalhães, I.L. Phenolic Content and Antioxidant and Antiacetylcholinesterase Properties of Honeys from Different Floral Origins. J. Med. Food 2011, 14, 658–663. [Google Scholar] [CrossRef]
  117. Karabagias, I.K.; Louppis, A.P.; Karabournioti, S.; Kontakos, S.; Papastephanou, C.; Kontominas, M.G. Characterization and geographical discrimination of commercial Citrus spp. honeys produced in different Mediterranean countries based on minerals, volatile compounds and physicochemical parameters, using chemometrics. Food Chem. 2017, 217, 445–455. [Google Scholar] [CrossRef] [PubMed]
  118. Zhang, Q.-W.; Lin, L.-G.; Ye, W.-C. Techniques for extraction and isolation of natural products: A comprehensive review. Chin. Med. 2018, 13, 1–26. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  119. Sánchez-Rangel, J.C.; Benavides, J.; Heredia, J.B.; Cisneros-Zevallos, L.; Jacobo-Velázquez, D.A. The Folin–Ciocalteu assay revisited: Improvement of its specificity for total phenolic content determination. Anal. Methods 2013, 5, 5990–5999. [Google Scholar] [CrossRef]
Figure 1. Pareto chart of regression coefficients for TPC assay data. X-axis indicates the different factors (B[n] = solvent type, C[n] = extraction process, and B[n]C[n] = interaction of solvent type and extraction process) while the values in the left y-axis indicate the coefficient values for the corresponding factors. Black bars indicate positive effect, while white bars indicate negative effect on TPC.
Figure 1. Pareto chart of regression coefficients for TPC assay data. X-axis indicates the different factors (B[n] = solvent type, C[n] = extraction process, and B[n]C[n] = interaction of solvent type and extraction process) while the values in the left y-axis indicate the coefficient values for the corresponding factors. Black bars indicate positive effect, while white bars indicate negative effect on TPC.
Antioxidants 10 01113 g001
Figure 2. Pareto chart of regression coefficients for DPPH antioxidant activity data. X-axis indicates the different factors (B[n] = solvent type and C[n] = extraction process,) while the values in the left y-axis indicate the coefficient values for the corresponding factors. Black bars indicate positive effect, while white bars indicate negative effect on DPPH antioxidant activity.
Figure 2. Pareto chart of regression coefficients for DPPH antioxidant activity data. X-axis indicates the different factors (B[n] = solvent type and C[n] = extraction process,) while the values in the left y-axis indicate the coefficient values for the corresponding factors. Black bars indicate positive effect, while white bars indicate negative effect on DPPH antioxidant activity.
Antioxidants 10 01113 g002
Figure 3. Pareto chart of regression coefficients for FRAP antioxidant activity data. X-axis indicates the different factors (A[n] = pulverisation, B[n] = solvent type, C[n] = extraction process, AB[n] = interaction of pulverisation and solvent, B[n]C[n] = interaction of solvent type and extraction process) while the values in the left x-axis indicate the coefficient values for the corresponding factors. Black bars indicate positive effect, while white bars indicate negative effect on DPPH antioxidant activity.
Figure 3. Pareto chart of regression coefficients for FRAP antioxidant activity data. X-axis indicates the different factors (A[n] = pulverisation, B[n] = solvent type, C[n] = extraction process, AB[n] = interaction of pulverisation and solvent, B[n]C[n] = interaction of solvent type and extraction process) while the values in the left x-axis indicate the coefficient values for the corresponding factors. Black bars indicate positive effect, while white bars indicate negative effect on DPPH antioxidant activity.
Antioxidants 10 01113 g003
Figure 4. Interactive effects of extraction solvent and extraction method on the TPC assay for bee pollen samples. TPC values were expressed as mg gallic acid equivalent per gram pollen, B: extraction solvent (70% ethanol:30% = E70:30, ethanol = EtOH, water = H2O, and methanol = MtOH) and C: extraction process (agitation = A, maceration = M, reflux = R, and sonication = S).
Figure 4. Interactive effects of extraction solvent and extraction method on the TPC assay for bee pollen samples. TPC values were expressed as mg gallic acid equivalent per gram pollen, B: extraction solvent (70% ethanol:30% = E70:30, ethanol = EtOH, water = H2O, and methanol = MtOH) and C: extraction process (agitation = A, maceration = M, reflux = R, and sonication = S).
Antioxidants 10 01113 g004
Figure 5. Effects of extraction solvent and extraction method on the DPPH antioxidant activity for bee pollen samples. DPPH values were expressed as µmol Trolox equivalent per gram pollen, B: extraction solvent (70% ethanol:30% =E70:30, ethanol = EtOH, water = H2O, and methanol = MtOH) and C: extraction process (agitation = A, maceration = M, reflux = R, and sonication = S).
Figure 5. Effects of extraction solvent and extraction method on the DPPH antioxidant activity for bee pollen samples. DPPH values were expressed as µmol Trolox equivalent per gram pollen, B: extraction solvent (70% ethanol:30% =E70:30, ethanol = EtOH, water = H2O, and methanol = MtOH) and C: extraction process (agitation = A, maceration = M, reflux = R, and sonication = S).
Antioxidants 10 01113 g005
Figure 6. Interaction effects of extraction solvent and extraction method on the FRAP antioxidant activity for bee pollen samples. FRAP values were expressed as µmol Fe+2 equivalent per gram pollen, B: extraction solvent (70% ethanol:30% = E70:30, ethanol = EtOH, water = H2O, and methanol = MtOH) and C: extraction process (agitation = A, maceration = M, reflux = R, and sonication = S).
Figure 6. Interaction effects of extraction solvent and extraction method on the FRAP antioxidant activity for bee pollen samples. FRAP values were expressed as µmol Fe+2 equivalent per gram pollen, B: extraction solvent (70% ethanol:30% = E70:30, ethanol = EtOH, water = H2O, and methanol = MtOH) and C: extraction process (agitation = A, maceration = M, reflux = R, and sonication = S).
Antioxidants 10 01113 g006
Figure 7. Proposed optimised extraction condition 1: crude/non-pulverised sample extracted using 70% ethanol:30% water (E70:30) and agitation (A), corresponding to the optimal conditions see in Figure 4 for TPC data, Figure 5 for DPPH data, and Figure 6 for FRAP data (desirability = 0.925).
Figure 7. Proposed optimised extraction condition 1: crude/non-pulverised sample extracted using 70% ethanol:30% water (E70:30) and agitation (A), corresponding to the optimal conditions see in Figure 4 for TPC data, Figure 5 for DPPH data, and Figure 6 for FRAP data (desirability = 0.925).
Antioxidants 10 01113 g007
Figure 8. Proposed optimised extraction condition 2: crude/non-pulverised sample extracted using 70% ethanol:30% water (E70:30) and maceration (M), corresponding to the optimal conditions see in Figure 4 for TPC data, Figure 5 for DPPH data, and Figure 6 for FRAP data (desirability = 0.893).
Figure 8. Proposed optimised extraction condition 2: crude/non-pulverised sample extracted using 70% ethanol:30% water (E70:30) and maceration (M), corresponding to the optimal conditions see in Figure 4 for TPC data, Figure 5 for DPPH data, and Figure 6 for FRAP data (desirability = 0.893).
Antioxidants 10 01113 g008
Figure 9. Proposed optimised extraction condition 3: crude/non-pulverised sample extracted using 70% ethanol:30% water (E70:30) and reflux (R), corresponding to the optimal conditions see in Figure 4 for TPC data, Figure 5 for DPPH data, and Figure 6 for FRAP data (desirability = 0.883).
Figure 9. Proposed optimised extraction condition 3: crude/non-pulverised sample extracted using 70% ethanol:30% water (E70:30) and reflux (R), corresponding to the optimal conditions see in Figure 4 for TPC data, Figure 5 for DPPH data, and Figure 6 for FRAP data (desirability = 0.883).
Antioxidants 10 01113 g009
Table 1. Summary of extraction parameters used to determine the antioxidant activity of bee pollen.
Table 1. Summary of extraction parameters used to determine the antioxidant activity of bee pollen.
AuthorReferenceCountryBotanical
Origin
Pre-ExtractionPulve-RisationExtraction MethodSolventVolume of SolventExtraction Tempe-RatureMixing/
Power
Extraction TimeNo. of ExtractionsPost-ExtractionAntioxidant Assays
Daoud, Ibrahim et al., 2019[22]AlgeriaInula viscosaStored at 4 °CNoneMaceration80% Methanol (Aqueous)10 g w/100 mLN.I.N.I.24 h2Dried in vacuoTPC, TFC, β-carotene bleaching
Machado De-Melo, Estevinho et al., 2016[23]BrazilmultifloralStored at −20 °C, some batches were oven dried at 42 °C, another was vacuum lyophilisedCrushed and sieved through a 0.595 mm sieveAgitation70% Ethanol (Aqueous)2 g w/ 25 mL70 °C105 rpm30 minN.I.Volume was adjusted to 25 mLTPC, DPPH, ORAC
Kalaycıoğlu, Kaygusuz et al., 2017[7]TurkeyChestnuts, Buckwheat, Oak, multifloralN.I.Ground in mortar and pestleMacerationWater0.1 g w/5 mL80 °CNone15 minN.I.Filtered using Whatman #41TPC, DPPH
Alimoglu, Guzelmeric et al., 2021[24]TurkeymultifloralStored at 20 °CNoneAgitation and Sonication70% Ethanol (Aqueous)5 g w/50 mL40 °C100 rpm, N.I.1 h and
15 min
N.I.Filtered using filter paper, dried in vacuoTPC, TFC, DPPH, CUPRAC, FRAP
Pascoal, Rodrigues et al., 2014[25]Porugal and SpainmultifloralStored at 20 °CNoneMacerationMethanol1:2 w/vRTNone72 h2Filtered using Whatman #4, dried in vacuo,TPC, TFC, TBARS, DPPH
Morais, Moreira et al., 2011[26]PortugalmultifloralStored at −20 °CNoneMacerationMethanol1:2 w/vRTNone72 h2N.I.TPC, DPPH, β-carotene bleaching
Leja, Mareczek et al., 2006[27]PolandmultifloralStored at −18 °CNoneMaceration80% Methanol (Aqueous)N.I.N.I.NoneN.I.N.I.N.I.TPC, TFC, anthocyanidins, phenylpropanoids, DPPH, TAA
Mărghitaş, Stanciu et al., 2009[28]RomaniamultifloralN.I.NoneMaceration and SonicationMethanol2 g w/15 mLRTNone1 h and
15 min
3Dried in vacuoTPC, TFC, DPPH, FRAP, ABTS
Thakur and Nanda 2021[29]IndiaCoconut, Coriander, Rapeseed, and multifloralStored at −18 °CGround (method not indicated)Maceration and Sonication85% Methanol (Aqueous)0.15:1RTNone2 h and 30 minN.I.Centrifuged, and Dried in vacuo,TPC, TFC, DPPH, FRAP, ABTS, MCA,
Machado De-Melo, Estevinho et al., 2018[30]BrazilMimosa
caesalpiniifolia, Eucalyptus spp., Rubiaceae, Astrocaryum
aculeatissimum, Fabaceae, Cocos nucifera, M. verrucosa, Myrcia spp., Alternanthera spp., Asteraceae, Brassica spp., and multifloral
Stored at −4 °CNoneMacerationMethanol1:2 w/vRTNone72 h2N.I.TPC, TFC, DPPH, ORAC
Machado De-Melo, Estevinho et al., 2018[30]BrazilMimosa
caesalpiniifolia, Eucalyptus spp., Rubiaceae, Astrocaryum
aculeatissimum, Fabaceae, Cocos nucifera, M. verrucosa, Myrcia spp., Alternanthera spp., Asteraceae, Brassica spp. and multifloral
Stored at −4 °CNoneAgitation70% Ethanol (Aqueous)2 g/25 mL70 °C105 rpm30 minN.I.N.I.TPC, TFC, DPPH, ORAC
Kaškonienė, Adaškevičiūtė et al., 2020[31]Latvia and LithuaniamultifloralPasteurisation
at 95 °C for 20 min and stored at 6–8 °C
NoneAgitation80% Methanol (Aqueous)2 g/20 mLRT180 rpmN.I.N.I.7–10 μm paper filter (Labbox), followed by a 0.22 μm polyvinylidene
fluoride (PVDF) membrane filter, stored at 4 C.
TPC, TFC, DPPH
Wan Omar, Azhar et al., 2016[32]MalaysiaL. terminateN.I.NoneSonicationMethanol10 g/25 mL41 °CN.I.1 hN.I.Centrifuged, filtered using 0.2 mm filterDPPH
Khongkarat, Ramadhan et al., 2020[33]ThailandSunflower (Helianthus annuus L.)Dried at 40 °C and stored at 25 °CNoneAgitationMethanol140 g/800 mL15 °C100 rpm18 hN.I.Centrifuged and dried in vacuoDPPH
Zhang, Wang et al., 2015[34]ChinaRape (Brassica campestris L.)Vacuum dried at 50 °C and stored at −18 °CGround (method not indicated)MacerationWater1:20, w/vRTNone24 hN.I.Centrifuged, reconstituted to 100 mLTPC, TFC, ABTS, DPPH, Reducing power
Zhang, Wang et al., 2015[34]ChinaRape (Brassica campestris L.)Rape (Brassica campestris L.)Ground (method not indicated)Maceration25% Ethanol (Aqueous)1:20, w/vRTNone24 hN.I.Centrifuged, reconstituted to 100 mLTPC, TFC, ABTS, DPPH, Reducing power
Zhang, Wang et al., 2015[34]ChinaRape (Brassica campestris L.)Vacuum dried at 50 °C and stored at −18 °CGround (method not indicated)Maceration50% Ethanol (Aqueous)1:20, w/vRTNone24 hN.I.Centrifuged, reconstituted to 100 mLTPC, TFC, ABTS, DPPH, Reducing power
Zhang, Wang et al., 2015[34]ChinaRape (Brassica campestris L.)Vacuum dried at 50 °C and stored at −18 °CGround (method not indicated)Maceration75% Ethanol (Aqueous)1:20, w/vRTNone24 hN.I.Centrifuged, reconstituted to 100 mLTPC, TFC, ABTS, DPPH, Reducing power
Zhang, Wang et al., 2015[34]ChinaRape (Brassica campestris L.)Vacuum dried at 50 °C and stored at −18 °CGround (method not indicated)MacerationEthanol1:20, w/vRTNone24 hN.I.Centrifuged, reconstituted to 100 mLTPC, TFC, ABTS, DPPH, Reducing power
Hemmami, Ben Seghir et al., 2020[35]AlgeriamultifloralN.I.Crushed in a commercial blender and homogenised.SonicationMethanol0.2 g w/2 mLRTN.I.30 minN.I.Centrifuged, filtered using Whatman # 1, dried in vacuo, stored in 4 °C in brown bottleTPC, TFC, TAC
Izuta, Narahara et al., 2009[36]Japan and SpainJara
pringosa (Cistus ladanifer) and Jara blanca (Cistus albidus)
[Spain]
N.I.NoneN.I.95% Ethanol (Aqueous)N.I.RTN.I.N.I.N.I.N.I.DPPH
Zuluaga-Domínguez, Serrato-Bermudez et al., 2018[37]ColombiaHypochaeris radicata
and Brassica sp.
Stored at 2 °CNoneMaceration96% Ethanol (Aqueous)1 g w/30 mLN.I.N.I.24 hN.I.Filtered using 3 hw filter paper and reconstituted to 100 mLTPC, TFC, ABTS, FRAP
Keskin and Özkök 2020[38]TurkeymultifloralDried at different conditionsNoneAgitationEthanol3 g/20 mLN.I.N.I.12 hN.I.Filtered and the final volume was completed to 30 mLTPC
Vasconcelos, Duarte et al., 2017[39]BrazilmultifloralN.I.NoneAgitation70% Ethanol (Aqueous)1 g/10 mL70 °C150 rpm30
min
2CentrifugedTPC, TFC, DPPH, FRAP
Suriyatem, Auras et al., 2017[40]ThailandLonganStored at 20 °CNoneMacerationMethanol1:2 (w/v).RTShaken by hand twice a day72 h2Filtered using Whatman #4 and dried in vacuoTPC, DPPH, ABTS
Cosmulescu, Trandafir et al., 2015[41]RomaniaWalnut (Juglans regia L.)N.I.NoneSonication and macerationMethanol1 g/10 mLRTN.I.60 min and 24 h1Filtered using 0.45 µm membrane filterTPC, TFC, DPPH
Bridi, Atala et al., 2019[42]ChileBrassica rapa and Eschscholzia californicaStored at −20 °CNoneSonicationEthanol1 g/10 mL−20 °CN.I.10 min3Centrifuged and filtered using Whatman No.1 and reconstituted to 50 mL TPC, TFC, FRAP, ORAC
Lopes, Vasconcelos et al., 2019[43]BrazilmultifloralStored at 4 °CNoneMaceration70% Ethanol (Aqueous)1:5 (m/v)RTNone72 h (solvent renewal every 24 h)3Dried in vacuoTPC, TFC, FRAP, DPPH, ABTS
Lopes, Vasconcelos et al., 2020[44]BrazilmultifloralStored at 4 °CNoneMaceration70% Ethanol (Aqueous)1: 5 (m/v)RTNone72 h (solvent renewal every 24 h)3Dried in vacuo, lyophilisedTPC, TFC, FRAP, DPPH, ABTS
Futui and Thongwai 2020[45]ThailandmultifloralStored at −20 °CPowdered (method not indicated)MacerationWater1:1045 °CNone3 h3Filtered, dried in vacuo, lyophilisedTPC, TFC, DPPH
Futui and Thongwai 2020[45]ThailandmultifloralStored at −20 °CPowdered (method not indicated)Maceration95% Ethanol (Aqueous)1:10RTNone72 h (solvent renewal every 24 h)3Filtered, dried in vacuo, lyophilisedTPC, TFC, DPPH
Futui and Thongwai 2020[45]ThailandmultifloralStored at −20 °CPowdered (method not indicated)SonicationWater1:10RTN.I.30 min2Filtered, dried in vacuo, lyophilisedTPC, TFC, DPPH
Nurdianah, Ahmad Firdaus et al., 2016[46]MalaysiamultifloralStored at 4 °CNoneMacerationEthanol10 g/100 mLRTN.I.24 h1Filtered, dried in vacuo, lyophilised, 4DPPH
Fatrcova-Sramkova, Nozkova et al., 2013[47]SlovakPoppy (Papaver somniferum
L.), Rape (Brassica napus subsp. napus L.), Sunflower (Helianthus annuus L.).
Stored at −18 °CHomogenisedMaceration90% Ethanol (Aqueous)5 g/50 mL70 °CN.I.30 min N.I.DPPH, Reducing Power
Sun, Guo et al., 2017[48]ChinaRapeDefatted with hexaneNoneSonication70% Methanol (Aqueous)N.IRTN.I60 min N.I.TPC, TFC, DPPH, FRAP, ABTS
Borycka, Grabek-Lejko et al., 2016[10]PolandmultifloralN.I.Ground using mortar and pestleAgitationWater2 g/15 mL70 °CN.I.30 min Filtered using Whatman #1 and dried in vacuoTPC, TFC, DPPH, FRAP, ABTS,
Borycka, Grabek-Lejko et al., 2016[10]PolandmultifloralN.I.Ground using mortar and pestleAgitation70% Ethanol (Aqueous)2 g/15 mL70 °CN.I.30 min Filtered usingWhatman #1 and dried in vacuoTPC, TFC, DPPH, FRAP, ABTS
Borycka, Grabek-Lejko et al., 2016[10]PolandmultifloralN.I.Ground using mortar and pestleAgitation70% Methanol (Aqueous)2 g/15 mL70 °CN.I.30 min1Filtered, using Whatman #1 and dried in vacuoTPC, TFC, DPPH, FRAP, ABTS
Su, Yang et al., 2020[49]ChinaCamellia, Rape, Rose,
and Lotus
N.I.Mechanical pulverisationSonicationMethanol1:1030 °C100 W1 h1Filtered, dried in vacuoTPC, DPPH, RP, ABTS
Uçar, Barlak et al., 2017[50]TurkeymultifloralN.I.Ground (method not indicated)AgitationDMSO5 g w/20 mL60 °C150 rpm24 h1CentrifugedTPC, TFC, FRAP, ABTS
Uçar, Barlak et al., 2017[50]TurkeymultifloralN.I.Ground (method not indicated)AgitationWater5 g w/20 mL60 °C150 rpm24 h1CentrifugedTPC, TFC, FRAP, ABTS
Oroian, Ursachi et al., 2020[51]RomaniamultifloralStored at −20 °CNoneSonication80% Methanol (Aqueous)1:10–3035 °C, 50 °C, 65 °C100 W.10–30 min1N.I.TPC, TFC
Barbieri, Gabriele et al., 2020[52]ItalymultifloralStored at −20 °CPowdered with mortar and pestleAgitation95% Ethanol (Aqueous)50 mg/mLRTN.I.1 hN.I.N.I.TPC, TFC, FRAP
Shen, Geng et al., 2019[53]ChinaSchisandra chinensisDried at 37 °CPulverised (method not indicated)Refluxed70% Ethanol (Aqueous)1:15Boling PointNone2 hN.I.Centrifuged, dried in vacuo, freeze driedABTS, FRAP
Saral, Yildiz et al., 2016[54]TurkeyCastanea sativa L.N.I.NoneMaceration and sonicationMethanol5 g/100 mLRTN.I.24 h, 3 hN.I.Filtered, fried in vacuoTPC, FRAP, DPPH
Pérez-Pérez, Vit et al., 2012[55]VenezuelamultifloralN.I.Ground in a
mortar, frozen
homogenisedWater0.1 g/5 mL4 °CN.I.N.I.N.I.CentrifugedTPC, ABTS
Pérez-Pérez, Vit et al., 2012[55]VenezuelamultifloralN.I.Ground in a
mortar, frozen
homogenisedMethanol0.1 g/5 mL4 °CN.I.N.I.N.I.CentrifugedTPC, ABTS
Pérez-Pérez, Vit et al., 2012[55]VenezuelamultifloralN.I.Ground in a
mortar, frozen
homogenised95% Ethanol (Aqueous)0.1 g/5 mL4 °CN.I.N.I.N.I.CentrifugedTPC, ABTS
Daudu 2019[56]NigeriamultifloralOven dried at 40 °CGround (method not indicated)Maceration50% Ethanol (Aqueous)0.5 g/5 mLN.I.N.I.N.I.N.I.FilteredTPC, TFC, NO2, DPPH, TAC, RP, Metal Chelating
Daudu 2019[56]NigeriamultifloralOven dried at 40 °CGround (method not indicated)MacerationMethanol0.5 g/5 mLN.I.N.I.N.I.N.I.FilteredTPC, TFC, NO2, DPPH, TAC, RP, Metal Chelating
Daudu 2019[56]NigeriamultifloralOven dried at 40 °CGround (method not indicated)MacerationWater0.5 g/5 mLN.I.N.I.N.I.N.I.FilteredTPC, TFC, NO2, DPPH, TAC, RP, Metal Chelating
Daudu 2019[56]NigeriamultifloralOven dried at 40 °CGround (method not indicated)MacerationEthanol0.5 g/5 mLN.I.N.I.N.I.N.I.FilteredTPC, TFC, NO2, DPPH, TAC, RP, Metal Chelating
Stanciu, Dezmirean et al., 2016[57]RomaniamultifloralStored at −18 °CGround (method not indicated)N.I.Hexane:dichloromethane 1:1N.I.N.I.N.I.1 hN.I.N.I.TPC, Total carotenoid, ORAC
Stanciu, Dezmirean et al., 2016[57]RomaniamultifloralStored at −18 °CGround (method not indicated)N.I.acetone:water:acetic acid
70:29.5:0.5
N.I.N.I.N.I.1 hN.I.N.I.TPC, Total carotenoid, ORAC
Mayda, Özkök et al., 2020[58]TurkeymultifloralStored at −18 °CNoneAgitation and sonication95% Ethanol (Aqueous)1.5 g/10 mL40 °CVortex Mixer60 minN.I.Filtered through 0.45 μm filterTPC, TFC, DPPH, ABTS
Anjos, Fernandes et al., 2019[59]PortugalmultifloralStored at −18 °CNoneAgitation80% Ethanol (Aqueous)11 g/200 mLRTg24 hN.I.Centrifuged, dried in vacuo, freeze driedTPC, TFC, DPPH, RP
Almeida, Reis et al., 2017[60]BrazilmultifloralN.I.NoneAgitation80% Ethanol (Aqueous)10 g/100 mL40 °C150 rpm60 minN.I.Filtered, dried in vacuo, freeze driedTPC, TFC, ABTS, DPPH, FRAP, Coupled oxidation of b-carotene and linoleic acid assay
Fatrcova-Sramkova, Nozkova et al., 2016[61]SlovakiaHelianthus annuusStored at 35 °CHomogenised (method not indicated)Maceration90% Ethanol (Aqueous)5 g/50 mL70 °CN.I.30 minN.I.Stored at 5 °CTPC, Caroteniods, RP, Flavonoids
Mosic, Trifkovic et al., 2019[62]SerbiamultifloralN.I.NoneSonication70% Methanol (Aqueous)1 g/10 mLN.I.N.I.1 hN.I.N.I.TPC
El Ghouizi, Menyiy et al., 2020[63]MoroccomultifloralN.I.NoneAgitation70% Ethanol (Aqueous)2 g/15 mL70 °CN.I.30 minN.IFiltered using Whatman #5TPC, TFC, TAC, RP
Rebiai and Lane 2012[64]AlgeriaCarrot, Rosemary, Eucalyptus, and multifloralStored at 4 °CHomogenised in blenderSoxhletMethanol5 g w/175 mL70 CNone2 h1Dried in vacuoTPC, TFC, TAC
Araujo, Chambo et al., 2017[65]BrazilCocos nucifera, Miconia spp.,
Spondias spp., Myrcia spp., Eucalyptus spp.
N.I.NoneAgitationMethanol1:1N.I.N.I.24 h3Dried in vacuoTPC, TFC, DPPH, A BTS
Barbara, Machado et al., 2015[66]BrazilmultifloralN.I.NoneAgitationMethanol1:1N.I.N.I.24 h3Dried in vacuoTPC, TFC
Carpes, Mourao et al., 2009[67]BrazilmultifloralStored at −12 to −15 °CCrushed using commercial blenderMaceration70% Ethanol (Aqueous)2 g/15 mL70 °CNone30 minN.I.Filtered and storedTPC, TFC, DPPH
Sartini, Djide et al., 2019[68]IndonesiamultifloralN.I.Coarse powder (method not indicated)Maceration80% Ethanol (Aqueous)100 g/1 LRTNone120 hN.I.Dried in vacuo, freeze driedTPC, TFC, DPPH
Le Blanc, Davis et al., 2009[1]USAMesquite, Yucca, Palm, Terpentine
Bush, Mimosa and Chenopod
N.I.NoneSonicationWater50 mg/mL41 °CNone90 minN.I.N.I.TPC, Total flavones and flavonol, total flavonones, DPPH, FRAP
Le Blanc, Davis et al., 2009[1]USAMesquite, Yucca, Palm, Terpentine
Bush, Mimosa and Chenopod
N.I.NoneSonicationMethanol50 mg/mL41 °CNone90 minN.I.N.I.TPC, Total flavones and flavonol, total flavonones, DPPH, FRAP
Le Blanc, Davis et al., 2009[1]USAMesquite, Yucca, Palm, Terpentine
Bush, Mimosa and Chenopod
N.I.NoneSonicationEthanol50 mg/mL41 °CNone90 minN.I.N.I.TPC, Total flavones and flavonol, total flavonones, DPPH, FRAP
Le Blanc, Davis et al., 2009[1]USAMesquite, Yucca, Palm, Terpentine
Bush, Mimosa and Chenopod
N.I.NoneSonicationPropanol50 mg/mL41 °CNone90 minN.I.N.I.TPC, Total flavones and flavonol, total flavonones, DPPH, FRAP
Le Blanc, Davis et al., 2009[1]USAMesquite, Yucca, Palm, Terpentine
Bush, Mimosa and Chenopod
N.I.NoneSonication2-propanol50 mg/mL41 °CNone90 minN.I.N.I.TPC, Total flavones and flavonol, total flavonones, DPPH, FRAP
Le Blanc, Davis et al., 2009[1]USAMesquite, Yucca, Palm, Terpentine
Bush, Mimosa and Chenopod
N.I.NoneSonicationAcetone50 mg/mL41 °CNone90 minN.I.N.I.TPC, Total flavones and flavonol, total flavonones, DPPH, FRAP
Le Blanc, Davis et al., 2009[1]USAMesquite, Yucca, Palm, Terpentine
Bush, Mimosa and Chenopod
N.I.NoneSonicationDMF50 mg/mL41 °CNone90 minN.I.N.I.TPC, Total flavones and flavonol, total flavonones, DPPH, FRAP
Le Blanc, Davis et al., 2009[1]USAMesquite, Yucca, Palm, Terpentine
Bush, Mimosa and Chenopod
N.I.NoneSonicationACN50 mg/mL41 °CNone90 minN.I.N.I.TPC, Total flavones and flavonol, total flavonones, DPPH, FRAP
Ceksteryte, Kurtinaitiene et al., 2016[12]LithuaniamultifloralStored at 5–8 °CNoneAgitation80% Methanol (Aqueous)6 g/10 mLN.I.None5 minN.I.Centrifuged, dried in vacuo, freeze driedTPC, DPPH, ABTS, ORAC
Özcan, Aljuhaimi et al., 2019[69]BrazilmultifloralStored at −18 °CNoneSonicationMethanol0.5 g/12 mLN.I.None10 minN.I.Centrifuged, dried in vacuoTPC, DPPH, Carotenoid, Minerals
Zuluaga-Dominguez and Quicazan 2019[70]ColombiaHypochaeris spp., and Brassica spp.N.I.NoneAgitation96% Ethanol (Aqueous)1 g/30 mLN.I.N.I.24 hN.I.Filtered, volume completed quantitatively to 100 mLTPC, ABTS, FRAP
Duran A 2019[71]ColombiamultifloralN.I.None.Agitation96% Ethanol (Aqueous)1 g/30 mLN.I.N.I.24 hN.I.Filtered, volume completed quantitatively to 100 mLTPC, TEAC, FRAP
Aleksieva, Mladenova et al., 2021[72]BulgariamultifloralLyophilisedNoneAgitationEthanol0.5 g/7.5 mLRTN.I.2 hN.I.filteredTPC, TFC, DPPH, TEAC
Aleksieva, Mladenova et al., 2021[72]BulgariamultifloralLyophilisedNoneAgitationWater0.5 g/7.5 mLRTN.I.2 hN.I.filteredTPC, TFC, DPPH, TEAC
Atsalakis, Chinou et al., 2017[73],GreeceCistus creticusStored at −20 °CNoneMacerationCyclohexane,
Dichloromethane, Butanol and Water
27.5 g/150 mLN.I.NoneN.I.N.I.N.I.TPC, TFC, DPPH, ABTS
Saral,
KiliÇArslan et al., 2019
[74]TurkeymultifloralStored at 4 °CBlendedMacerationMethanolN.I.RTNone24 hN.I.Filtered using Whatman filter paper #4 and then stored at 4 °CTPC, TFC, CUPRAC, FRAP, DPPH
Al-Salem, Al-Yousef et al., 2020[75]Saudi ArabiamultifloralN.I.NoneMaceration95% Ethanol (Aqueous)N.I.RTNone48 hN.I.Filtered, dried in vacuoCatalase (CAT) assay, Vitamin C (ascorbic acid) assay, Glutathione (GSH) assay, Glutathione S-Transferase (GST) activity
Gabriele, Parri et al., 2015[76]ItalymultifloralStored at −20 °CNoneAgitation95% Ethanol (Aqueous)N.IRTN.I.1 hN.IFiltered, stored at 4°CTPC, TFC, DPPH, ORAC
Yildiz, Can et al., 2013[77]TurkeymultifloralDried in 40 °CPowder (method not indicated)SonicationMethanol1 g/10 mLN.I.None3 hN.I.FilteredTPC, TFC, Total Anthocyanins, Total Carotenoids, FRAP, DPPH
Rocchetti, Castiglioni et al., 2019[78]ItalymultifloralStored in the dark at room temperatureGround (method not indicated)Agitation70% Methanol (Aqueous)0.5 g/5 mLN.I.Shaking5 minN.IStored at −20 °CTPC, DPPH, ABTS, ORAC
Yan, Li et al., 2019[79]ChinaBrassica campestris L.N.I.Superfine jet pulverisation
Combined low-pressure jet-boiling device
Sonication80% Acetone (Aqueous)2 g/15 mLN.I.None30 minN.I.Freeze dried and stored at −40 °CTPC
Rebiai and Lanez 2013[80]AlgeriamultifloralN.I.NoneMacerationMethanol5 g/50 mLRTNone24 h3Filtered, refrigeratedTPC, TFC, cyclic voltammetry techniques
Cheng, Chen et al., 2019[81]ChinamultifloralN.I.NoneReflux75% Ethanol (Aqueous)1:1075 °CNone2 h2Centrifuged, dried in vacuo,DPPH, FRAP
Muñoz, Velásquez et al., 2020[82]ChileBrassica campestris and Galega officinalisStored at −18 °CNoneSonicationMethanol1 g/7.5 mLN.I.50 Hz.30 min1Centrifuged, filtered at 0.45 um, refrigeratedTPC, TFC, FRAP
Yesiltas, Capanoglu et al., 2015[83]Turkey and SpainmultifloralStored at −18 °CGround (method not indicated)Maceration and sonicationMethanol2 g/15 mLRTN.I.3 d, 15 min1CentrifugedTPC, TFC, ABTS, FRAP, DPPH, CUPRAC
Mejias and Montenegro 2012[84]ChilemultifloralN.I.NoneSuspensionWaterN.I.N.I.NoneN.I.N.I.N.I.TPC, DPPH, FRAP
Negri, Teixeira et al., 2011[85]BrazilmultifloralStored at −18 °CNoneMaceration70% Methanol (Aqueous)1.0 g/75 mLRTN.I.45 minN.I.Filtered, volume completed quantitatively to
100 mL
TPC, DPPH
Campos, Webby et al., 2003[86]New Zealand, PortugalSalix atrocinera Brot., Ranunculus sardous Crantz, and
Ulex europeus L. (Portugal and New Zealand);
Eucalyptus globulus Labill., Cistus ladanifer L., Echium plantagineum
L., and Erica australis L. (Portugal); and Metrosideros
umbellata, Ixerba brexioides, and Knightia excelsa (New
Zealand)
N.I.NoneSonication50% Ethanol (Aqueous)N.I.N.I.NoneN.I.N.I.CentrifugedDPPH
Ulusoy and Kolayli 2014[87]TurkeymultifloralStored at 4 °CNoneSonicationMethanolN.I.RTNone1 h3Filtered, dried in vacuoTPC, FRAP, CUPRAC, DPPH
Mohdaly, Mahmoud et al., 2015[88]EgyptMaize (Zea mays)Stored at 4 °CPowdered (method not indicated)MacerationMethanol10.0 g/100 mLRTN.I.12 h1Filtered (Whatman #1), dried in vacuoDPPH, ABTS
De-Melo, Estevinho et al., 2018[89]BrazilAlternanthera, Anadenanthera, Cocos nucifera, Mimosa caesalpiniaefolia, Myrcia, and Mimosa scabrellaStored at 4 °CCrushed using commercial blenderMaceration70% Ethanol (Aqueous)2 g/15 mL70 °CNone30 min1FilteredTPC, TFC, DPPH
De-Melo, Estevinho et al., 2018[89]BrazilAlternanthera, Anadenanthera, Cocos nucifera, Mimosa caesalpiniaefolia, Myrcia, and Mimosa scabrellaStored at 4 °CCrushed using commercial blenderMacerationMethanol2 g/15 mL70°CNone30 min1FilteredTPC, TFC, DPPH
Sahin and Karkar 2019[90]TurkeyChestnutN.I.NoneSonicationEthanol3 g/30 mL65 °CNone30 h1FilteredTPC, FRAP, ABTS, CHROMAC
Belina-Aldemita, Schreiner et al., 2020[91]PhilippinesmultifloralUnder argon at −24 °C, defatted with hexane 3 timesGround (method not indicated)MaceratedMethanol1 g/5 mLRTN.I.1 h3Centrifuged, stored at −20 °CTPC, TFC, and TMAC
Belina-Aldemita, Schreiner et al., 2020[91]PhilippinesmultifloralUnder argon at −24 °C, defatted with hexane 3 timesGround (method not indicated)SonicationMethanol1 g/5 mLRTN.I.1 h3Centrifuged, stored at −20 °CTPC, TFC, and TMAC
Belina-Aldemita, Schreiner et al., 2020[91]PhilippinesmultifloralUnder argon at −24 °C, defatted with hexane 3 timesGround (method not indicated)Macerationacidified Methanol solution (methanol and
1 N hydrochloric acid 85:15 v/v).
1 g/5 mL50 °CN.I.30 min3Centrifuged, stored at −20°CTPC, TFC, and TMAC
Zuluaga-Domínguez, Castro-
Mercado et al., 2019
[92]ColombiaHypochaeris spp., and Brassica spp.Stored at 4 °CNoneAgitation96% Ethanol (Aqueous)1 g/30 mLN.I.Low speed24 h1Filtered using 3 hw filter paper and volume completed quantitatively to
100 mL
TPC, TFC, Total Carotenoids, FRAP, ABTS
Bujang, Zakaria et al., 2021[93]MalaysiaMaize (Zea mays L)Stored at −20 °CCrushedSonication70% Ethanol (Aqueous)2 g/15 mLRTNone30 min1Centrifuged, filtered using Whatman #2TPC, TFC, DPPH
Yang, Zhang et al., 2019[16]ChinaRoseN.I.Ball milledSonication70% Ethanol (Aqueous)50 mg/1 mL25 °C600 W and a frequency of 20 kHz4 h1FilteredTFC, DPPH, ORAC, ABTS, In Vivo antioxidant
Kaskoniene, Kaskonas et al., 2015[94]LithuaniamultifloralN.I.NoneMaceration85% Methanol (Aqueous)N.I.RTN.I.24 h3FilteredTPC, TFC, DPPH
Kaškonienė, Katilevičiūtė et al., 2018[95]LithuaniamultifloralN.I.NoneMaceration85% Methanol (Aqueous)N.I.RTN.I.24 h3FilteredTPC, TFC, DPPH
Khider, Elbanna et al., 2013[96]EgyptMaize (Zea mays),
clover (Trifolium alexandrinum), and Date palm (Phoenix dactylifera)
Stored at 4 °CPowdered (method not indicated)MacerationMethanol50 g/500 mLRTNone12 h1Filtered using Whatman paper # 5DPPH
Khider, Elbanna et al., 2013[96]EgyptMaize (Zea mays),
clover (Trifolium alexandrinum), and date palm (Phoenix dactylifera)
Stored at 4 °CPowdered (method not indicated)MacerationHexane50 g/500 mLRTNone12 h1Filtered using Whatman paper # 5DPPH
Canale, Benelli et al., 2016[97]ItalymultifloralStored at −20 °CNoneSonication and agitation80% Methanol (Aqueous)0.5 g/15 mLN.I. and 4°CNone and N.I.30 min and 30 min2Filtered through 0.45 µm filterTPC, TFC, Rutin
Freire, Lins et al., 2012[98]Brazil.multifloralN.I.NoneSonicationEthanolN.I.N.I.N.I.N.I.N.I.Filtered, dried in vacuoTPC, DPPH, ABTS, Fe Chelating
Kim, Jo et al., 2015[99]KoreamultifloralDried at 40 °C and then stored in a freezer until useNoneMaceration80% Methanol (Aqueous)N.I.N.I.N.I.N.I.2N.I.DPPH, TPC
Zhang, Yang et al., 2016[100]ChinaRapeseed (Brassica campestris L.)N.I.Powdered (method not indicated)Sonication80% Ethanol (Aqueous)50 mL/g80 °C40 kHz30 min1Filtered through 0.45 µmTPC, FRAP
Zhang, Liu et al., 2020[101]ChinaRapeseed (Brassica campestris L.)Extracted with petroleum ether to remove the lipidsPowdered (method not indicated)Sonication80% Ethanol (Aqueous)50 mL/g80 °C40 kHz30 min1Dried in vacuo, lyophilisedDPPH, ABTS, FRAP
Castagna, Benelli et al., 2020[102]ItalyChestnutN.I.NoneSonication80% Methanol (Aqueous)N.I.4 °CN.I.30 min1Centrifuged and filtered through 0.45 µm filterTPC, TFC
Oyarzun, Andia et al., 2020[103]ChilemultifloralN.I.NoneSonicationEthanol1.0 g in 10 mLRT37 kHz frequency and 240 W10 min3Centrifuged and filtered through Whatman # 1FRAP, ORAC, TPC, TFC
Asmae, Nawal et al., 2021[104]MoroccomultifloralStored at −20 °CNoneMaceration70% Ethanol (Aqueous)1.0 g in 10 mLRTN.I.1 week1Filtered through Whatman # 1TPC, Flavones and Flavonols Content, TAC, DPPH, RP, ABTS
Feas, Vazquez-Tato et al., 2012[6]PortugalmultifloralN.I.Ground (method not indicated)Sonication and macerationMethanol1:2RTN.I.30 min and 2 days1Centrifuged, dried in vacuoTPC, TFC, DPPH, β-Carotene Bleaching
Rodriguez-Gonzalez, Ortega-Toro et al., 2018[105]ColombiamultifloralN.I.NoneMicrowave Assisted ExtractionEthanol1 g/10 or 50 mLVaries1350 W of power and 60 Hz6, 12 and 24 s1Filtered and stored in −20°CTPC, ABTS, FRAP
Rodriguez-Gonzalez, Ortega-Toro et al., 2018[105]ColombiamultifloralN.I.NoneSonicationEthanol1 g/10 mLN.I.5 kHz frequency and 250 W15 min1Filtered and stored in −20°CTPC, ABTS, FRAP
Velasquez, Rodriguez et al., 2017[106]ChilemultifloralN.I.NoneSonicationWater1:1N.I.N.I.1 h5Filtered using Whatman #2 dried in vacuo and the dry extract was reconstituted to 10 mL, filtered
(EDLAB CA syringe filter 0.45 µm) and stored at −20 °C.
Total Carotenoid, TPC, FRAP
Carpes, de Alencar et al., 2013[107]BrazilmultifloralN.I.NoneMaceration70% Ethanol (Aqueous)1:170 °CN.I.30 minN.I.N.I.TPC, TFC, DPPH, Antioxidant activity by the coupled oxidation of
b-carotene and linoleic acid
Santa Bárbara, Moreira et al., 2020[108]BrazilmultifloralOven dried, freeze dried, freshNoneAgitation70% Ethanol (Aqueous)10 g/50 mLRTN.I.45 min1Filtered, Dried in vacuob-Carotene bleaching assay, FRAP, DPPH, TPC, TFC
Carpes, Begnini et al., 2007[109]BrazilmultifloralN.I.MilledAgitation40% Ethanol (Aqueous)2.0 g/15 mL70 °CN.I.30 min2Stored at 5 ºCoxidation of -carotene and linoleic acid,
TPC
Carpes, Begnini et al., 2007[109]BrazilmultifloralN.I.MilledAgitation50% Ethanol (Aqueous)2.0 g/15 mL70 °CN.I.30 min2Stored at 5 ºCoxidation of -carotene and linoleic acid, TPC
Carpes, Begnini et al., 2007[109]BrazilmultifloralN.I.MilledAgitation60% Ethanol (Aqueous)2.0 g/15 mL70 °CN.I.30 min2Stored at 5 ºCoxidation of -carotene and linoleic acid, TPC
Carpes, Begnini et al., 2007[109]BrazilmultifloralN.I.MilledAgitation70% Ethanol (Aqueous)2.0 g/15 mL70 °CN.I.30 min2Stored at 5 ºCoxidation of -carotene and linoleic acid, TPC
Carpes, Begnini et al., 2007[109]BrazilmultifloralN.I.MilledAgitation80% Ethanol (Aqueous)2.0 g/15 mL70 °CN.I.30 min2Stored at 5 ºCoxidation of -carotene and linoleic acid, TPC
Carpes, Begnini et al., 2007[109]BrazilmultifloralN.I.MilledAgitation90% Ethanol (Aqueous)2.0 g/15 mL70 °CN.I.30 min2Stored at 5 ºCoxidation of -carotene and linoleic acid, TPC
Zou, Hu et al., 2020[110]South Korea, ChinamultifloralN.I.NoneMaceration70% Ethanol (Aqueous)N.I.RTN.I.48 h3Filtered, dried in vacuoTPC, TFC, DPPH
Paradowska, Zielińska et al., 2017[111]PolandBuckwheat, Oilseeed RapeN.I.NoneSonication80% Methanol (Aqueous)0.2/10 mL25 °CN.I.N.I.1Filtered through a sintered glass filter funnelTPC, TFC, DPPH, FRAP, ORAC
Yildiz, Karahalil et al., 2014[112]TurkeymultifloralN.I.NoneSuspensionWaterN.I.N.I.N.I.N.I.N.I.FilteredTPC, FRAP
Silva, Camara et al., 2009[113]BrazilmultifloralN.I.NoneSonicationEthanolN.I.N.I.N.I.N.I.N.I.Filtered, dried in vacuoDPPH
Dai, Ding et al., 2013[114]ChinaRape, Rose, Camellia, Herba leonuri and SchizandraN.I.NoneSonicationEthanol50 mg/10 mLN.I.N.I.N.I.N.I.Filtered, completed to 10 mLTPC, DPPH
Amalia, Diantini et al., 2020[115]IndonesiamultifloralN.I.NoneSuspensionWater1:10N.I.N.I.N.I.N.I.Filtered using Whatman® # 41 paper, freeze-driedDPPH
Legend: N.I.—not indicated, w/—with, w/v—weight over volume, TPC—total phenolic content, TFC—total flavonoid content, DPPH—2,2-diphenyl-1-picryl-hydrazyl-hydrate assay, ORAC—oxygen radical absorbance capacity, CUPRAC—Cupric reducing antioxidant capacity, FRAP—ferric reducing antioxidant capacity, TBARS—Thiobarbituric acid reactive substances, TAA—total antioxidant activity, ABTS—2,2′-azino-bis(3-ethylbenzothiazoline-6-sulfonic acid) (ABTS•+) radical cation-based assay, MCA—metal chelating activity, TAC—total antioxidant capacity, RP—reducing power, CHROMAC—chromium reducing antioxidant capacity.
Table 2. Independent variables used in the Design of Experiments to optimise the extraction of bee pollen for antioxidant evaluation.
Table 2. Independent variables used in the Design of Experiments to optimise the extraction of bee pollen for antioxidant evaluation.
FactorsTested ConditionsAbbreviation
PulverisationCrude, non-pulverised
Pulverised+
Solvent70% EthanolE70:30
EthanolEtOH
MethanolMtOH
WaterH2O
Extraction ProcessAgitationA
MacerationM
RefluxR
SonicationS
Table 3. Multilevel factorial experimental design to optimise the extraction of antioxidant components in bee pollen. Experiments were conducted with 3 independent variables and the responses comprised of antioxidant activity measured by the TPC, DPPH and FRAP assays.
Table 3. Multilevel factorial experimental design to optimise the extraction of antioxidant components in bee pollen. Experiments were conducted with 3 independent variables and the responses comprised of antioxidant activity measured by the TPC, DPPH and FRAP assays.
RunIndependent VariablesDependent Variables
PulverisationSolventExtractionTPCDPPHFRAPDPPH/FRAP Ratio
1E70:30A20.86 ± 4.07320.11 ± 27.00342.28 ± 55.571.07
2+E70:30A20.85 ± 2.67331.86 ± 43.20357.36 ± 35.651.08
3E70:30M19.99 ± 1.08267.92 ± 39.77396.39 ± 14.231.48
4+E70:30M19.42 ± 2.13291.42 ± 56.06349.19 ± 90.211.20
5E70:30R21.37 ± 1.70309.28 ± 32.62326.54 ± 34.191.17
6+E70:30R20.46 ± 1.33300.81 ± 48.42328.85 ± 40.441.16
7E70:30S18.80 ± 2.20266.37 ± 56.46326.61 ± 62.161.23
8+E70:30S19.68 ± 2.87296.61 ± 55.53338.49 ± 59.041.14
9EtOHA16.61 ± 2.15298.92 ± 14.55286.19 ± 29.220.88
10+EtOHA16.92 ± 3.23297.37 ± 15.99289.85 ± 45.370.97
11EtOHM17.03 ± 2.24244.52 ± 55.49302.95 ± 33.921.24
12+EtOHM16.84 ± 1.72236.25 ± 52.65297.27 ± 33.841.28
13EtOHR19.35 ± 1.08285.28 ± 32.63323.98 ± 29.191.36
14+EtOHR18.84 ± 2.00262.40 ± 37.24310.51 ± 32.891.25
15EtOHS15.67 ± 2.24231.12 ± 52.88269.77 ± 24.221.17
16+EtOHS16.57 ± 2.16251.47 ± 37.37286.61 ± 31.221.14
17H2OA3.50 ± 0.5234.67 ± 10.9345.06 ± 12.361.30
18+H2OA3.68 ± 0.1834.22 ± 6.1444.05 ± 12.661.29
19H2OM3.58 ± 0.5520.91 ± 3.8044.42 ± 6.332.13
20+H2OM3.34 ± 0.3026.04 ± 10.2643.01 ± 8.441.65
21H2OR5.07 ± 1.4549.21 ± 13.9483.66 ± 23.002.83
22+H2OR4.98 ± 1.6949.9 ± 20.2480.89 ± 27.602.14
23H2OS4.26 ± 0.2931.72 ± 10.9455.64 ± 9.421.75
24+H2OS4.35 ± 0.4934.55 ± 4.5356.99 ± 6.811.65
25MtOHA19.55 ± 2.22311.92 ± 33.70196.83 ± 43.710.63
26+MtOHA19.25 ± 3.26298.15 ± 47.53237.14 ± 18.040.80
27MtOHM19.17 ± 3.29267.20 ± 62.25221.76 ± 66.730.83
28+MtOHM18.58 ± 2.90236.85 ± 46.00268.84 ± 38.981.14
29MtOHR21.15 ± 3.20253.10 ± 25.66254.02 ± 30.521.06
30+MtOHR20.00 ± 3.41261.09 ± 41.84270.53 ± 14.491.11
31MtOHS17.85 ± 2.21254.80 ± 65.14216.45 ± 26.870.85
32+MtOHS17.95 ± 2.21261.78 ± 70.17241.74 ± 19.540.92
Table 4. Summary of regression coefficients. A[n] = pulverisation; B[n] = solvent type; C[n] = extraction process; AB[n] = interaction of pulverisation and solvent, B[n]C[n] = interaction of solvent type and extraction process. * = significant p-value < 0.05.
Table 4. Summary of regression coefficients. A[n] = pulverisation; B[n] = solvent type; C[n] = extraction process; AB[n] = interaction of pulverisation and solvent, B[n]C[n] = interaction of solvent type and extraction process. * = significant p-value < 0.05.
Coefficient Estimate
TermTPCDPPHFRAP
Intercept3.7613.7114.64
A--0.1503
B[1]0.7323 *3.36 *3.93 *
B[2]0.3897 *2.26 *2.47 *
B[3]−1.74 *−8.15 *−7.18 *
C[1]−0.0195 *0.9483 *−0.4800 *
C[2]−0.0691 *−0.4900 *0.0891 *
C[3]0.1706 *−0.2780 *0.6496 *
AB[1]--−0.2061
AB[2]--−0.0267
AB[3]--−0.1826
B[1]C[1]0.0937 *-0.6036 *
B[2]C[1]−0.0348 *-−0.0579 *
B[3]C[1]−0.1043 *-−0.3087 *
B[1]C[2]0.0177 *-0.6213 *
B[2]C[2]0.0365 *-0.1917 *
B[3]C[2]−0.0886 *-−0.9382 *
B[1]C[3]−0.0886 *-−1.14 *
B[2]C[3]0.0498 *-0.0415 *
B[3]C[3]0.0529 *-0.9468 *
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lawag, I.L.; Yoo, O.; Lim, L.Y.; Hammer, K.; Locher, C. Optimisation of Bee Pollen Extraction to Maximise Extractable Antioxidant Constituents. Antioxidants 2021, 10, 1113. https://doi.org/10.3390/antiox10071113

AMA Style

Lawag IL, Yoo O, Lim LY, Hammer K, Locher C. Optimisation of Bee Pollen Extraction to Maximise Extractable Antioxidant Constituents. Antioxidants. 2021; 10(7):1113. https://doi.org/10.3390/antiox10071113

Chicago/Turabian Style

Lawag, Ivan Lozada, Okhee Yoo, Lee Yong Lim, Katherine Hammer, and Cornelia Locher. 2021. "Optimisation of Bee Pollen Extraction to Maximise Extractable Antioxidant Constituents" Antioxidants 10, no. 7: 1113. https://doi.org/10.3390/antiox10071113

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop