Next Article in Journal
Intra-Varietal Diversity and Its Contribution to Wheat Evolution, Domestication, and Improvement in Wheat
Next Article in Special Issue
Evolution of a Cockroach Allergen into the Major Protein of Termite Royal Jelly
Previous Article in Journal
A New, Convenient Way to Fully Substituted α,β-Unsaturated γ-Hydroxy Butyrolactams
Previous Article in Special Issue
Histone H3 and H4 Modifications Point to Transcriptional Suppression as a Component of Winter Freeze Tolerance in the Gall Fly Eurosta solidaginis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Communication

SDS-PAGE-Based Quantitative Assay of Hemolymph Proteins in Honeybees: Progress and Prospects for Field Application

1
Department of Veterinary Medical Sciences, Alma Mater Studiorum-University of Bologna, Via Tolara di Sopra 50, Ozzano dell’Emilia, 40064 Bologna, Italy
2
Department of Surgery, Medicine, Dentistry and Morphological Sciences with Transplant Surgery, Oncology and Regenerative Medicine Relevance, Proteomic Lab, University of Modena and Reggio Emilia, 41124 Modena, Italy
3
Department of Medical and Surgical Sciences, Alma Mater Studiorum-University of Bologna, Via Belmeloro, 8, 40126 Bologna, Italy
*
Author to whom correspondence should be addressed.
Int. J. Mol. Sci. 2023, 24(12), 10216; https://doi.org/10.3390/ijms241210216
Submission received: 25 May 2023 / Revised: 12 June 2023 / Accepted: 13 June 2023 / Published: 16 June 2023

Abstract

:
In human and veterinary medicine, serum proteins are considered to be useful biomarkers for assessing the health and nutritional status of the organism. Honeybee hemolymph has a unique proteome that could represent a source of valuable biomarkers. Therefore, the aims of this study were to separate and identify the most abundant proteins in the hemolymph of worker honeybees to suggest a panel of these proteins that could represent useful biomarkers for assessing the nutritional and health status of the colonies and, finally, to analyze them in different periods of the year. Four apiaries were selected in the province of Bologna, and the bees were analyzed in April, May, July, and November. Thirty specimens from three hives of each apiary were sampled and their hemolymph was collected. The most represented bands obtained after 1D sodium-dodecyl-sulfate-polyacrylamide gel electrophoresis (SDS-PAGE) were cut from the gel, and the proteins were identified using an LC-ESI-Q-MS/MS System. A total of twelve proteins were unmistakably identified; the two most abundant proteins were apolipophorin and vitellogenin, which are known biomarkers of bee trophic and health status. The two other proteins identified were transferrin and hexamerin 70a, the first being involved in iron homeostasis and the second being a storage protein. Most of these proteins showed an increase from April to November, mirroring the physiological changes of honeybees during the productive season. The current study suggests a panel of biomarkers from honeybee hemolymph worth testing under different physiological and pathological field conditions.

1. Introduction

Insect hemolymph is composed of circulating cells and fluid containing proteins, lipids, carbohydrates, nucleic acids, hormones, and ions [1,2]. In human and veterinary medicine, serum proteins, either total proteins or specific proteins such as albumin, are considered important biomarkers for assessing the health and nutritional status of an organism.
Gel electrophoresis is a useful tool for separating and analyzing proteins, from agarose gel electrophoresis used to separate serum proteins in clinical routine to the more sensitive mono (1D)- or bidimensional (2D) sodium dodecyl sulfate–polyacrylamide gel electrophoresis (SDS-PAGE) used to separate complex protein mixtures of different biological samples [2,3,4,5]. The clinical applications of electrophoresis in separating hemolymph proteins are still limited in honeybees due to the paucity of data defining a reference proteome. In addition, there are two main issues complicating the interpretation of the results: the first is the difficulty of obtaining homogeneous samples from healthy animals, while the second is the high variability, accentuated by several factors such as polyethism or seasonal variations. Studies regarding hemolymph proteins have recently been reported; they focused on the differences between pupae and newly emerged bees using 2DE [2,6] or on Nosema–honeybee interaction [7]. However, due to the complexity of data, these studies do not offer the possibility of using their results in field applications. Moreover, despite its higher resolution power, 2DE cannot be routinely used due to its complex and time-consuming protocol. On the other hand, even if 1DE does not perform as well, its one-day protocol and its easier execution make it a valid and reliable method for studying hemolymph proteins and obtaining useful information on the health and nutritional status of honeybees.
Only a few diseases of the hive can be diagnosed by means of direct examination; for this reason, hive assessment is routinely coupled with laboratory analysis of hive matrix samples. On the other hand, there is a simple method for measuring the strength of a honeybee colony, the Liebefeld method which estimates the number of adult workers, brood, and food storage quantities [8]. However, methods for accurately assessing health and nutritional status at the colony level using molecular biomarkers are currently lacking. Therefore, the aims of this study were: (1) to separate and identify the most abundant and relevant hemolymph proteins of worker honeybees using an expeditious 1DE proteomic approach, (2) to suggest a panel from these hemolymph proteins which could represent a useful tool for measuring the nutritional and health status of the colony, and (3) to quantify these proteins in bees from different apiaries of the province of Bologna in different periods of the year. To overcome individual variations, a pooled sample of hemolymph from young worker honeybees was used, as suggested by Ricigliano et al. [9]. The use of a comprehensive panel of hemolymph biomarkers has never been proposed before and will represent meaningful advances in the preservation of bee populations.

2. Results and Discussion

2.1. The Total Protein Concentration in Hemolymph Varies Depending on the Season

The mean concentration of the total proteins in the hemolymph of the samples analyzed ranged from 13.0 ± 3.56 mg/mL in April to 54.4 ± 9.62 mg/mL in November. No significant differences were detected among the apiaries at the same sampling time, except for apiary C, which showed significantly higher concentrations of total proteins in May than all the other apiaries (p < 0.01) (Figure 1 and Supplementary Table S1). This finding can be related to the abundance of pollen in the surrounding semi-natural habitat rich in wild plants characterized by spring blooms, including acacia and linden trees. In all other months, the total protein values were homogeneous among the apiaries regardless of the environmental characteristics.
Hemolymph proteins showed a clear and significant (p < 0.05) increase from April to November in all the apiaries studied (Figure 1 and Supplementary Table S1), except for apiary C. The values obtained in the present study were consistent with those published by other authors. The mean values determined in July (from 19.6 ± 1.72 to 21.7 ± 3.60 mg/mL) are included in the range of those reported by Cabbri et al. [10] (from 12.4 ± 2.80 to 13.6 ± 2.90 mg/mL) in healthy colonies sampled in July 2017 in the province of Bologna and those around 30 mg/mL determined in summer in a colony located in an apiary near Brno, Czech Republic, by Kunc et al. [11]. These authors reported that the protein concentration increased significantly in the hemolymph starting from autumn and remained at over 50 mg/mL from October to March [11]. Accordingly, in the present study, the mean values determined in November varied from 51.1 ± 10.5 to 63.1 ± 3.49 mg/mL. In contrast, Dostálková et al. [12] found a concentration of hemolymph proteins of 34.5 in summer and 30.2 mg/mL in winter bees from the Czech Republic.
In previous papers, the total proteins in the hemolymph have been correlated with nutritional status [10,13,14]. A positive correlation with the quantity and quality of protein food intake was consistently found. The study of Basualdo et al. [15] showed that a diet based on bee bread promoted a significant increase in hemolymph proteins as compared to a protein substitute, and increased survival in bees artificially infected by Nosema ceranae. These results supported the hypothesis that the reaction of bees to pathogens was positively related to hemolymph proteins.
Future research about the use of total proteins as an index for assessing nutritional and health status is needed, as it could represent a simple and useful index, mirroring the quantification of serum total proteins in human and veterinary clinical biochemistry.

2.2. Identification of the Most Abundant Hemolymph Proteins Using Mass Spectrometry

To shed more light on the complexity of the hemolymph proteome, the proteins were separated using SDS-PAGE electrophoresis, and the most abundant bands were cut from the gel for subsequent identification using mass spectrometry. As an example, a gel showing the protein bands is reported in Figure 2 and Supplementary Figure S1. The bands had apparent molecular masses (MMs) ranging from >200 to 14 kDa. A total of 12 proteins were unmistakably identified (Table 1).
The two most abundant high MM bands contained apolipophorin (>200 kDa) and vitellogenin (180 kDa) (bands 1 and 2, respectively, Figure 2). Apolipophorin was also present at lower MMs in bands 4 (80 kDa) and 9 (21 kDa), and vitellogenin was also found in band 3 (150 kDa). In the middle part of the gel, other important proteins were identified: transferrin (70 kDa) and hexamerin 70a (67 kDa), present in bands 5 and 6, respectively. Prophenoloxidase (proPO) (58 kDa) and major royal jelly protein (MRJP) (54 kDa) were identified in bands 7 and 8, respectively. Finally, different isoforms of odorant binding proteins (OBPs), namely proteins which bind olfactory molecules, were identified in bands 9, 10, and 11. The other proteins identified are reported in Table 1.
Apolipophorins are multifunctional high MM proteins devoted to the transport of hydrophobic molecules and are integral components of the lipophorin systems, the major role of which is the transport of diacylglycerol, phospholipids, sterols, and hydrocarbons in the hemolymph. The honeybee lipophorins contain two integral apolipoproteins, apolipophorin I (240 kDa) and apolipophorin II (80 kDa), which derive from the same precursor apolipophorin I/II and may contain an exchangeable protein, apolipophorin III (18 kDa) [16]. Using the electrophoretic protocol developed in this study, it was possible to separate and identify apolipophorin I (band 1) and apolipophorin III (band 9) while the apolipophorin (fragment) present in band 4 (MM 80 kDa) should be apolipophorin II.
Vitellogenin is a complex 180 kDa monomeric phospholipoglycoprotein with a key trophic function; in fact, it has been shown to serve as a lipid transporter [17] and as the substrate from which nurse workers derive royal jelly [18]. It is released into the hemolymph from the fat body, the site of production and storage. From the hemolymph, vitellogenin passes to the acini of the hypopharyngeal glands which are devoted to the secretion of royal jelly [19]. The presence of a 150 kDa vitellogenin in band 3 seems to contradict what Havukainen et al. [20] hypothesized, namely that only the intact 180 kDa protein is present in worker hemolymph.
Transferrin is the main iron transport protein in all animals and is one of the most important proteins involved in maintaining homeostasis of this essential element. In insects, this monomeric protein of approximately 70 kDa transports iron from the gut to the fat body where this metal is stored in the trophocytes [21].
As in all holometabolous insects, the larva-to-pupa transition occurs at the expense of the protein reserves accumulated during the larval phase. These proteins are typically represented by hexamerins which occur in massive amounts in the hemolymph of larvae [22,23]. Genes encoding hexamerin are actively transcribed in the fat body of the larvae; the proteins are then released into the hemolymph where they represent an important source of amino acids during the pupal stage. Even in adult worker bees, hexamerin production continues in the fat body and may be involved in the transition between nurse and forager bees [24]. The hexamerin 70a detected in the hemolymph of the adult bees analyzed in this study is in agreement with the data reported by Martins et al. [24] and Danty et al. [25]. The absence of hexamerin 70b confirms the data of Chan et al. [22] who reported that the queen was the only caste showing hexamerin 70b during adulthood.
The other proteins identified were proPO, chitinase-like protein Idgf4, MRJP, and OBPs. The most abundant protein in band 7 was proPO, the inactive zymogen of phenoloxidase which controls the melanisation of pathogens and damaged tissues and represents one of the major innate defense systems in invertebrates. Activation of this enzyme is brought about by the proPO-activating system containing proteins capable of binding to polysaccharides and other compounds typically associated with microorganisms [26]. Chitinase-like protein Idgf4 belongs to a small glycoprotein family of chitinase-related secretory proteins found in various insect species; similar glycoproteins have been associated with antimicrobial responses and insect hemolymph clotting as well as with the molting process and extracellular matrix formation [27]. Major royal jelly proteins are the most abundant proteins in royal jelly. They can be present in monomeric form with an MM of approximately 55 kDa or join to form pentameric polymers. These proteins are secreted by the hypopharyngeal glands of the nurse bees and have important functions for insect development [28]. Finally, OBPs are small acidic proteins (~13–16 kDa) present in very high concentrations (10–20 mM) at the interface between the olfactory receptors and the external environment [29]. Their physiological role has not yet been elucidated; however, they have been associated with the transfer of olfactory molecules to membrane receptors [30].

2.3. Quantification of the Most Abundant Hemolymph Proteins

Hemolymph samples of bees obtained from four apiaries of the province of Bologna in April, May, July, and November 2022 underwent SDS-PAGE fractionation. The presence of two high-abundance proteins (apolipophorin and vitellogenin) represented an analytical problem, the same as albumin in mammal serum. As a matter of fact, loading a high protein concentration to 1DE while favoring the separation and quantification of less abundant proteins complicated the accurate quantification of vitellogenin and apolipophorin due to protein overload in these bands (Figure 2). Therefore, it was decided that a good compromise between high- and low-abundance proteins would be to load 3–5 µg of total proteins onto the gel.
Apolipophorin-I and II, vitellogenin, transferrin, and hexamerin 70a could clearly be separated, detected, and quantified. As an example, gels and pherograms after SDS-PAGE separation of hemolymph samples obtained from the same colonies of apiary A in April and November are reported in Figure 3. The profiles obtained agreed with those reported after 1D SDS-PAGE by Chan et al. [22] and Cabbri et al. [10] for the hemolymph of worker honeybees, confirming the presence of a common set of the most abundant proteins. Complete original gel images are reported in Supplementary Figure S2.
Despite the variability among different colonies of the same apiary, quantitative differences are clearly visible across the seasons. Data regarding seasonal variations of apolipophorins, vitellogenin, transferrin, and hexamerin 70a are reported in Figure 4 and Supplementary Table S1. An increasing trend of these proteins from April to November is visible, mirroring the increase in hemolymph total proteins.
The mean concentrations of vitellogenin found in the present study varied from a minimum of 0.00 mg/mL in May in apiary B to a maximum of 41.5 ± 10.9 mg/mL in November in apiary B (Figure 4) and were consistent with those reported by Dostálková et al. [12] in summer and winter bees from the Czech Republic. A significant increase from April to November (p < 0.05) was detected in all the apiaries with the exception of apiary D (Figure 4 and Supplementary Table S1). Vitellogenin is the best known and the most studied hemolymph protein which has been proposed as a biomarker of bee trophic status and health [10,31]. Hemolymph vitellogenin is useful in establishing the vitality of the colony; it correlates with food quality [32], immune function [33], and/or exposure to pesticides [34]. A decrease in vitellogenin may also be related to loss of colony vitality [35]. Finally, increased vitellogenin concentration has been correlated with increased longevity [31]. It is known that vitellogenin is higher in winter bees when compared to summer bees [11,36]. Accordingly, the presence of a winter bee phenotype characterized by a high concentration of vitellogenin was also evidenced in this study in all the colonies analyzed, suggesting that this storage and antioxidant protein is essential to face the winter season, because it is probably used as a source of amino acids to sustain energy metabolism during the winter.
Regarding apolipophorins, significant variations were detected only in apiary B, with an increase from May to November (p < 0.05) (Figure 4 and Supplementary Table S1). These proteins transport lipids from the site of absorption (midgut) to the site of storage (fat body) and vice versa from the fat body to the tissues [37]. Their concentration in the hemolymph is closely related to lipid mobilization, and variations can be due to a number of causes, such as embryogenesis, immune response, and starvation [38]. A high apolipophorin concentration is a signal that should be carefully evaluated and not underestimated because lipid mobilization from the fat body is an index of malnutrition. Moreover, in honeybee colonies there is a strict correlation between nutritional status and immunity [39]. Therefore, apolipophorins can represent a good biomarker of lipid metabolism, monitoring at the same time the nutritional status and thus the honeybee resilience to pathogens.
Despite the importance of iron in honeybee physiology and metabolism [40], transferrin has been poorly investigated. Insect transferrin is considered a multifunctional protein because in addition to its involvement in iron metabolism other roles have been suggested [41]. Recently, Iatsenko et al. [42] reported that Drosophila melanogaster triggers a hypoferremic response after microbe infection. This response is aimed at limiting the availability of iron to pathogens and is part of the so-called nutritional immunity [43]. Accordingly, the study of Rodriguez-Garcìa et al. [40] evidenced that Nosema ceranae infection determined iron loss in infected bees suggesting altered iron homeostasis. In the present study, hemolymph transferrin increased significantly from spring to autumn (p < 0.05) (Figure 4 and Supplementary Table S1) in all the apiaries with the exception of apiary D with values ranging from 0.07 ± 0.01 mg/mL in apiary B in May to 3.18 ± 0.54 mg/mL in apiary C in November. The significance of this increase is currently unknown. It can be speculated that elevated transferrin concentrations represent increased iron-sequestrating capacity in case of microorganism infection limiting iron availability or, alternatively, an effective system for maintaining active iron trafficking between the fat body and the peripheral tissues during the cold season without the risk of oxidative stress. Therefore, the quantification of hemolymph transferrin could be of interest in assessing bee health status and deserves more research in the future.
Finally, despite an increase in hexamerin 70a being evident from April to November in all the apiaries analyzed, the difference was statistically significant only in apiary B (Figure 4 and Supplementary Table S1) due to high variability among the colonies of the same apiary. Danty et al. [25] observed that nutrition significantly influenced the accumulation of this protein in adult honeybees, at both the transcript and protein level. High concentrations of this protein in May in apiary C support a relationship with nutritional status. Therefore, the hemolymph concentration of hexamerin 70a could be used as an additional nutritional biomarker.
Most of these proteins showed an increase from April to November, mirroring the activities of honeybees during the productive season. Differences, though not significant, are evident among the four apiaries, in particular from April to July, suggesting an environmental influence. The study of the effects of the environment around the hives on the nutrition and health status of honeybees is beyond the scope of the present research. However, recent studies have suggested that the landscape can affect bee nutritional physiology and colony performance; in particular, highly managed agricultural landscapes might negatively affect the nutritional physiology of honeybees [9,44]. Accordingly, the data reported in the current study show that the greatest differences between colonies are evident in May, the month in which differences in floral abundance among the environments surrounding the four apiaries are most evident. Bees of apiary C had high concentration of hemolymph proteins coinciding with the peak flowering of spring flora, while in the same month bees of apiary B had very low concentrations of hemolymph proteins, probably due to the shortage of flowering plants in an environment with extensive wheat and sunflower cultivation.

3. Materials and Methods

3.1. Experimental Design and Hemolymph Sampling

Four apiaries were selected. The apiaries chosen were owned by the same professional beekeeper and were located in different environments of the province of Bologna (Italy): apiaries A (44°32′27.6″ N 11°19′07.4″ E) and D (44°32′37.2″ N 11°17′09.2″ E) were located in the proximity of the town of Bologna, in the proximity of the Reno River, apiary B (44°38′40.6″ N 11°19′49.6″ E) was located on an extensive agricultural landscape characterized by wheat and sunflower, and apiary C (44°22′51.0″ N 11°20′00.3″ E) was in a less anthropized environment, characterized by higher abundance of wild flora. All the colonies did not show any clinical symptom of disease. The colonies were treated for varroosis with Apivar strips (Véto-Pharma, Palaiseau, France) in the absence of the brood. Representative colonies were selected from each apiary based on similar anamnesis (n = 3); all the colonies were homogenous in the number of bees and brood, and honey and pollen stores were adequate. Samplings were performed in the months of April, May, July, and November 2022 to include the entire production season.
For each colony/hive and for each sampling time, after a visual inspection, thirty young worker bees (Apis mellifera ligustica) were sampled between the last brood frame and the stores [10] to minimize age variability; in general, nursing bees are found on that frame. The bees were transported to the laboratory of the Department of Veterinary Medical Sciences and 1–2 microliters of transparent uncontaminated hemolymph were collected from each bee as previously described [10]. Briefly, the bees were narcotized with CO2 and a glass microcapillary (Blaubrand® BRANDT GMBH, Wertheim, Germany) was inserted between the fourth and fifth tergite to obtain at least one microliter of hemolymph. The hemolymphs collected from honeybees of the same colony were pooled and stored at −80 °C.

3.2. Total Protein Determination

Total protein (TP) concentration was measured using the Bradford method (Bradford Reagent, Sigma-Aldrich, MO, USA) following the manufacturer’s instructions. Bovine serum albumin (Sigma-Aldrich, MO, USA) was used as a standard for the calibration curve. The absorbance was measured with a plate reader (Infinite F50 ELISA Plate reader, Tecan Trading AG, Männedorf, Switzerland).

3.3. Protein Separation Using SDS-PAGE

Hemolymph proteins were separated using 1D-SDS-PAGE electrophoresis. The diluted hemolymph was loaded onto 4–12% Bis-Tris polyacrylamide gels (NuPage/Thermo Fisher Scientific, Waltham, MA, USA), and electrophoresis was carried out in an Xcell SureLock Mini-Cell with 2-(N-morpholino) propanesulfonic acid buffer (MOPS; NuPage/Thermo Fisher Scientific, Waltham, MA, USA) at pH 7.3 containing sodium dodecyl sulfate (SDS). Different amounts of total proteins from 2 to 15 µg were loaded onto the gel for subsequent identification by mass spectrometry (MS), while to quantify the proteins in the bands of interest, the samples were properly diluted to obtain 3–5 µg of total proteins to be loaded onto the gel. Each gel was also loaded with standard proteins of known molecular mass (SeeBlue™ Plus2 Pre-stained Protein Standard, Thermo Fisher Scientific, Waltham, MA, USA). The electrophoresis system was connected to a power supply (Power Pack Basic—Bio-Rad, Hercules, CA, USA) with a constant voltage of 200 V for 40 min. The gels were stained with Coomassie G250 compatible with MS analysis. After staining, each gel was digitalized using ChemiDocMP (BioRad, Hercules, CA, USA), and pherograms were obtained using ImageLab 5.2.1 software (BioRad, Hercules, CA, USA).
To quantify the protein bands of interest, 1 μg of protein, obtained from a solution containing 1 μg/μL of lactate dehydrogenase (LDH), (Sigma-Aldrich/Merck KGaA, Darmstadt, Germany) was added as an internal standard of quantity to each sample. ImageLab software estimated the volume of each protein band based on pixel density. The volume of the band of interest was then compared to that of the internal standard of the same lane, and the protein content was calculated as previously reported [45].

3.4. Protein Identification by Mass Spectrometry

The most represented bands were manually cut from the gel and underwent “in-gel” tryptic digestion, as previously reported [46]. Briefly, the bands were destained with acetonitrile; the proteins were then reduced and subsequently alkylated with dithiothreitol and iodoacetamide, respectively. The proteins were digested with Trypsin (Promega, Madison, WI, USA) at 37 °C, and the peptides obtained were concentrated in a vacuum dryer (Eppendorf Concentrator Plus). The samples were analyzed using a Nano LC-CHIP-MS system (ESI-Q-TOF 6520; Agilent Technologies, Santa Clara, CA, USA) as previously described [10]. Protein identification was obtained using the MASCOT search engine (version 2.7, http://mascot.cigs.unimo.it/mascot (accessed on 20 November 2022)) and the UniProt database, setting the following restriction parameters: taxonomy (a broader taxonomy was selected for identification to be based on sequence homology as the honeybee hemolymph protein database was not well annotated), trypsin as a proteolytic enzyme (max. two missed cleavages), peptide mass tolerance ± 40 ppm and fragment mass tolerance ± 0.12 Da, alkylated cysteine residues (fixed modifications) and oxidized methionine (variable modifications); the significant threshold was set to obtain a false discovery rate of <5%. Only proteins with the highest score hits among the MASCOT search results and identified with at least two or more significant sequences were selected.

3.5. Statistical Analysis

Sample distribution was assessed using the Shapiro–Wilk test [47]. The Levene test for homogeneity of variances was applied to each variable at the same time point (month) and among the same groups (apiaries) over the time [48]. Depending on the above-mentioned test outcomes, different statistical tests were applied. One-way ANOVA with Tukey’s HSD post hoc test and the Kruskal–Wallis test one-way ANOVA with Dunn’s multiple comparison post hoc test were performed to determine significant differences among the groups (apiaries) at the same time point [49,50]. The analysis of the variations within the same group at different time points was performed using ANOVA for repeated measures with the pairwise Bonferroni post hoc test or the Friedman rank sum test for repeated measures with the Nemenyi post hoc test [51,52]. In order to apply ANOVA for repeated measures, the presence of outliers was investigated through box-plot visualization [53]. Differences were considered statistically significant for p < 0.05. Statistical analyses were performed using R 4.2.2 (R foundation for statistical computing; Vienna, Austria; https://www.R-project.org/, accessed on 1 April 2023). The data are reported as the mean ± SD (standard deviation).

4. Conclusions

Overall, in addition to vitellogenin, the application of an expeditious 1D SDS-PAGE protocol to hemolymph proteins allowed the separation and quantification of apolipophorins, transferrin, and hexamerin 70a. These proteins can represent a panel of biomarkers related to key metabolic processes, such as lipid metabolism (apolipophorins) and iron homeostasis (transferrin). Moreover, they are also involved in other important physiological processes, such as nutrition, development, immune response, and longevity (vitellogenin and hexamerins).
In conclusion, this study has suggested a putative panel of hemolymph biomarkers, including total proteins, apolipophorins, vitellogenin, transferrin and hexamerin 70a. These proteins are worth testing in the future under different field conditions to set reference values in healthy colonies, search for a correlation with the strength of the colony (brood, honey, pollen, and parasites), and verify their usefulness in assessing the nutritional and health status of honeybees under stress conditions. The information obtained would be an interesting and innovative management tool to develop beekeeping strategies on a molecular basis.

Supplementary Materials

The supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijms241210216/s1.

Author Contributions

G.I. conceptualization, validation, writing—original draft, writing—review and editing, project administration, and funding acquisition; E.B., C.R., E.F. and R.C. investigation and writing—review and editing. G.A. writing—review and editing, validation, and resources. All authors have read and agreed to the published version of the manuscript.

Funding

This study was in part carried out within the Agritech National Research Center and received funding from the European Union Next-Generation EU (PIANO NAZIONALE DI RIPRESA E RESILIENZA (PNRR)–MISSIONE 4 COMPONENTE 2, INVESTIMENTO 1.4–D.D. 1032 17/06/2022, CN00000022). This manuscript reflects only the authors’ views and opinions; neither the European Union nor the European Commission can be considered responsible for them.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

All data analyzed in this study are available upon request.

Acknowledgments

We would like to thank Thomas Dalmonte for his help and support with the statistical analysis. The authors thank Matteo Finelli for his professional help with the handling and care of the honeybees.

Conflicts of Interest

The authors declare that there are no conflict of interest.

References

  1. Ararso, Z.; Ma, C.; Qi, Y.; Feng, M.; Han, B.; Hu, H.; Meng, L.; Li, J. Proteome Comparisons between Hemolymph of Two Honeybee Strains (Apis mellifera ligustica) Reveal Divergent Molecular Basis in Driving Hemolymph Function and High Royal Jelly Secretion. J. Proteome Res. 2018, 17, 402–419. [Google Scholar] [CrossRef] [PubMed]
  2. Feng, M.; Ramadan, H.; Han, B.; Fang, Y.; Li, J. Hemolymph proteome changes during worker brood development match the biological divergences between western honey bees (Apis mellifera) and eastern honey bees (Apis cerana). BMC Genom. 2014, 15, 563. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Brunelle, J.L.; Green, R. One-dimensional SDS-polyacrylamide gel electrophoresis (1D SDS-PAGE). Methods Enzymol. 2014, 541, 151–159. [Google Scholar] [CrossRef] [PubMed]
  4. Ferlizza, E.; Campos, A.; Neagu, A.; Cuoghi, A.; Bellei, E.; Monari, E.; Dondi, F.; Almeida, A.M.; Isani, G. The effect of chronic kidney disease on the urine proteome in the domestic cat (Felis catus). Vet. J. 2015, 204, 73–81. [Google Scholar] [CrossRef] [Green Version]
  5. Isani, G.; Ferlizza, E.; Nally, J.E. Proteomic Research in Urine and other Fluids BT—Proteomics in Domestic Animals: From Farm to Systems Biology; de Almeida, A.M., Eckersall, D., Miller, I., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 121–147. ISBN 978-3-319-69682-9. [Google Scholar]
  6. Erban, T.; Harant, K.; Kamler, M.; Markovic, M.; Titera, D. Detailed proteome mapping of newly emerged honeybee worker hemolymph and comparison with the red-eye pupal stage. Apidologie 2016, 47, 805–817. [Google Scholar] [CrossRef] [Green Version]
  7. Kurze, C.; Dosselli, R.; Grassl, J.; Le Conte, Y.; Kryger, P.; Baer, B.; Moritz, R.F.A. Differential proteomics reveals novel insights into Nosema-honey bee interactions. Insect Biochem. Mol. Biol. 2016, 79, 42–49. [Google Scholar] [CrossRef]
  8. Dainat, B.; Dietemann, V.; Imdorf, A.; Charrière, J.-D. A scientific note on the ‘Liebefeld Method’ to estimate honey bee colony strength: Its history, use, and translation. Apidologie 2020, 51, 422–427. [Google Scholar] [CrossRef] [Green Version]
  9. Ricigliano, V.A.; Mott, B.M.; Maes, P.W.; Floyd, A.S.; Fitz, W.; Copeland, D.C.; Meikle, W.G.; Anderson, K.E. Honey bee colony performance and health are enhanced by apiary proximity to US Conservation Reserve Program (CRP) lands. Sci. Rep. 2019, 9, 4894. [Google Scholar] [CrossRef] [Green Version]
  10. Cabbri, R.; Ferlizza, E.; Nanetti, A.; Monari, E.; Andreani, G.; Galuppi, R.; Isani, G. Biomarkers of nutritional status in honeybee haemolymph: Effects of different biotechnical approaches for Varroa destructor treatment and wintering phase. Apidologie 2018, 49, 606–618. [Google Scholar] [CrossRef] [Green Version]
  11. Kunc, M.; Dobeš, P.; Hurychová, J.; Vojtek, L.; Poiani, S.B.; Danihlík, J.; Havlík, J.; Titěra, D.; Hyršl, P. The Year of the Honey Bee (Apis mellifera L.) with Respect to Its Physiology and Immunity: A Search for Biochemical Markers of Longevity. Insects 2019, 10, 244. [Google Scholar] [CrossRef] [Green Version]
  12. Dostálková, S.; Dobeš, P.; Kunc, M.; Hurychová, J.; Škrabišová, M.; Petřivalský, M.; Titěra, D.; Havlík, J.; Hyršl, P.; Danihlík, J. Winter honeybee (Apis mellifera) populations show greater potential to induce immune responses than summer populations after immune stimuli. J. Exp. Biol. 2021, 224, jeb232595. [Google Scholar] [CrossRef]
  13. Basualdo, M.; Barragán, S.; Vanagas, L.; García, C.; Solana, H.; Rodríguez, E.; Bedascarrasbure, E. Conversion of high and low pollen protein diets into protein in worker honey bees (Hymenoptera: Apidae). J. Econ. Entomol. 2013, 106, 1553–1558. [Google Scholar] [CrossRef]
  14. Bitondi, M.M.G.; Simões, Z.L.P. The relationship between level of pollen in the diet, vitellogenin and juvenile hormone titres in Africanized Apis mellifera workers. J. Apic. Res. 1996, 35, 27–36. [Google Scholar] [CrossRef]
  15. Basualdo, M.; Barragán, S.; Antúnez, K. Bee bread increases honeybee haemolymph protein and promote better survival despite of causing higher Nosema ceranae abundance in honeybees. Environ. Microbiol. Rep. 2014, 6, 396–400. [Google Scholar] [CrossRef]
  16. Van Der Horst, D.J.; Rodenburg, K.W. Lipoprotein assembly and function in an evolutionary perspective. Biomol. Concepts 2010, 1, 165–183. [Google Scholar] [CrossRef]
  17. Leipart, V.; Halskau, Ø.; Amdam, G. V How Honey Bee Vitellogenin Holds Lipid Cargo: A Role for the C-Terminal. Front. Mol. Biosci. 2022, 9, 865194. [Google Scholar] [CrossRef]
  18. Amdam, G.V.; Norberg, K.; Hagen, A.; Omholt, S.W. Social exploitation of vitellogenin. Proc. Natl. Acad. Sci. USA 2003, 100, 1799–1802. [Google Scholar] [CrossRef] [Green Version]
  19. Haydak, M.H. Honey Bee Nutrition. Annu. Rev. Entomol. 1970, 15, 143–156. [Google Scholar] [CrossRef]
  20. Havukainen, H.; Halskau, Ø.; Skjaerven, L.; Smedal, B.; Amdam, G. V Deconstructing honeybee vitellogenin: Novel 40 kDa fragment assigned to its N terminus. J. Exp. Biol. 2011, 214, 582–592. [Google Scholar] [CrossRef] [Green Version]
  21. Shaw, J.A.; Boyd, A.; House, M.; Cowin, G.; Baer, B. Multi-modal imaging and analysis in the search for iron-based magnetoreceptors in the honeybee Apis mellifera. R. Soc. Open Sci. 2018, 5, 181163. [Google Scholar] [CrossRef] [Green Version]
  22. Chan, Q.W.T.; Howes, C.G.; Foster, L.J. Quantitative comparison of caste differences in honeybee hemolymph. Mol. Cell. Proteom. 2006, 5, 2252–2262. [Google Scholar] [CrossRef] [Green Version]
  23. Burmester, T. Origin and evolution of arthropod hemocyanins and related proteins. J. Comp. Physiol. B Biochem. Syst. Environ. Physiol. 2002, 172, 95–107. [Google Scholar] [CrossRef]
  24. Martins, J.R.; Nunes, F.M.F.; Cristino, A.S.; Simões, Z.L.P.; Bitondi, M.M.G. The four hexamerin genes in the honey bee: Structure, molecular evolution and function deduced from expression patterns in queens, workers and drones. BMC Mol. Biol. 2010, 11, 23. [Google Scholar] [CrossRef] [Green Version]
  25. Danty, E.; Arnold, G.; Burmester, T.; Huet, J.C.; Huet, D.; Pernollet, J.C.; Masson, C. Identification and developmental profiles of hexamerins in antenna and hemolymph of the honeybee, Apis mellifera. Insect Biochem. Mol. Biol. 1998, 28, 387–397. [Google Scholar] [CrossRef] [PubMed]
  26. Cerenius, L.; So, K. The prophenoloxidase-activating system in invertebrates. Immunol. Rev. 2004, 198, 116–126. [Google Scholar] [CrossRef] [PubMed]
  27. Zurovcova, M.; Benes, V.; Zurovec, M.; Kucerova, L. Expansion of imaginal disc growth factor gene family in diptera reflects the evolution of novel functions. Insects 2019, 10, 365. [Google Scholar] [CrossRef] [Green Version]
  28. Buttstedt, A.; Moritz, R.F.A.; Erler, S. Origin and function of the major royal jelly proteins of the honeybee (Apis mellifera) as members of the yellow gene family. Biol. Rev. 2014, 89, 255–269. [Google Scholar] [CrossRef]
  29. Pelosi, P.; Zhou, J.J.; Ban, L.P.; Calvello, M. Soluble proteins in insect chemical communication. Cell. Mol. Life Sci. 2006, 63, 1658–1676. [Google Scholar] [CrossRef]
  30. Sun, J.S.; Xiao, S.; Carlson, J.R. The diverse small proteins called odorant-binding proteins. Open Biol. 2018, 8, 180208. [Google Scholar] [CrossRef] [Green Version]
  31. Amdam, G.V.; Aase, A.L.T.O.; Seehuus, S.-C.; Kim Fondrk, M.; Norberg, K.; Hartfelder, K. Social reversal of immunosenescence in honey bee workers. Exp. Gerontol. 2005, 40, 939–947. [Google Scholar] [CrossRef] [Green Version]
  32. Cremonz, T.M.; De Jong, D.; Bitondi, M.M.G. Quantification of Hemolymph Proteins as a Fast Method for Testing Protein Diets for Honey Bees (Hymenoptera: Apidae). J. Econ. Entomol. 1998, 91, 1284–1289. [Google Scholar] [CrossRef]
  33. Amdam, G.V.; Simões, Z.L.P.; Hagen, A.; Norberg, K.; Schrøder, K.; Mikkelsen, Ø.; Kirkwood, T.B.L.; Omholt, S.W. Hormonal control of the yolk precursor vitellogenin regulates immune function and longevity in honeybees. Exp. Gerontol. 2004, 39, 767–773. [Google Scholar] [CrossRef]
  34. Pinto, L.Z.; Bitondi, M.M.G.; Simões, Z.L.P. Inhibition of vitellogenin synthesis in Apis mellifera workers by a juvenile hormone analogue, pyriproxyfen. J. Insect Physiol. 2000, 46, 153–160. [Google Scholar] [CrossRef]
  35. van der Steen, J.J.M.; Martel, A.-C.; Hendrickx, P. The fraction haemolymph vitellogenin of a honey bee colony, derived from a pooled haemolymph sample, a colony vitality parameter. J. Apic. Res. 2015, 54, 55–58. [Google Scholar] [CrossRef]
  36. Aurori, C.M.; Buttstedt, A.; Dezmirean, D.S.; Mărghitaş, L.A.; Moritz, R.F.A.; Erler, S. What is the main driver of ageing in long-lived winter honeybees: Antioxidant enzymes, innate immunity, or vitellogenin? J. Gerontol. A. Biol. Sci. Med. Sci. 2014, 69, 633–639. [Google Scholar] [CrossRef] [Green Version]
  37. Robbs, S.L.; Ryan, R.O.; Schmidt, J.O.; Keim, P.S.; Law, J.H. Lipophorin of the larval honeybee, Apis mellifera L. J. Lipid Res. 1985, 26, 241–247. [Google Scholar] [CrossRef]
  38. Arrese, E.L.; Soulages, J.L. Insect fat body: Energy, metabolism, and regulation. Annu. Rev. Entomol. 2010, 55, 207–225. [Google Scholar] [CrossRef] [Green Version]
  39. Münch, D.; Kreibich, C.D.; Amdam, G. V Aging and its modulation in a long-lived worker caste of the honey bee. J. Exp. Biol. 2013, 216, 1638–1649. [Google Scholar] [CrossRef] [Green Version]
  40. Rodríguez-García, C.; Heerman, M.C.; Cook, S.C.; Evans, J.D.; DeGrandi-Hoffman, G.; Banmeke, O.; Zhang, Y.; Huang, S.; Hamilton, M.; Chen, Y.P. Transferrin-mediated iron sequestration suggests a novel therapeutic strategy for controlling Nosema disease in the honey bee, Apis mellifera. PLoS Pathog. 2021, 17, e1009270. [Google Scholar] [CrossRef]
  41. Geiser, D.L.; Winzerling, J.J. Insect transferrins: Multifunctional proteins. Biochim. Biophys. Acta—Gen. Subj. 2012, 1820, 437–451. [Google Scholar] [CrossRef]
  42. Iatsenko, I.; Marra, A.; Boquete, J.-P.; Peña, J.; Lemaitre, B. Iron sequestration by transferrin 1 mediates nutritional immunity in Drosophila melanogaster. Proc. Natl. Acad. Sci. USA 2020, 117, 7317–7325. [Google Scholar] [CrossRef]
  43. Hood, M.I.; Skaar, E.P. Nutritional immunity: Transition metals at the pathogen-host interface. Nat. Rev. Microbiol. 2012, 10, 525–537. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Smart, M.D.; Otto, C.R.V.; Lundgren, J.G. Nutritional status of honey bee (Apis mellifera L.) workers across an agricultural land-use gradient. Sci. Rep. 2019, 9, 16252. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Ferlizza, E.; Isani, G.; Dondi, F.; Andreani, G.; Vasylyeva, K.; Bellei, E.; Almeida, A.M.; Matzapetakis, M. Urinary proteome and metabolome in dogs (Canis lupus familiaris): The effect of chronic kidney disease. J. Proteom. 2020, 222, 103795. [Google Scholar] [CrossRef] [PubMed]
  46. Andreani, G.; Ferlizza, E.; Cabbri, R.; Fabbri, M.; Bellei, E.; Isani, G. Essential (Mg, Fe, Zn and Cu) and Non-Essential (Cd and Pb) Elements in Predatory Insects (Vespa crabro and Vespa velutina): A Molecular Perspective. Int. J. Mol. Sci. 2021, 22, 228. [Google Scholar] [CrossRef] [PubMed]
  47. Shapiro, S.S.; Wilk, M.B. An Analysis of Variance Test for Normality (Complete Samples). Biometrika 1965, 52, 591–611. [Google Scholar] [CrossRef]
  48. Brown, M.B.; Forsythe, A.B. Robust Tests for the Equality of Variances. J. Am. Stat. Assoc. 1974, 69, 364–367. [Google Scholar] [CrossRef]
  49. Tukey, J.W. Comparing Individual Means in the Analysis of Variance. Biometrics 1949, 5, 99–114. [Google Scholar] [CrossRef]
  50. Kruskal, W.H.; Wallis, W.A. Use of Ranks in One-Criterion Variance Analysis. J. Am. Stat. Assoc. 1952, 47, 583–621. [Google Scholar] [CrossRef]
  51. Friedman, M. A Comparison of Alternative Tests of Significance for the Problem of m Rankings. Ann. Math. Stat. 1940, 11, 86–92. [Google Scholar] [CrossRef]
  52. Nemenyi, P. Distribution-Free Multiple Comparisons. Ph.D. Thesis, Princeton University, Princeton, NJ, USA, 1963. [Google Scholar]
  53. Mauchly, J.W. Significance Test for Sphericity of a Normal n-Variate Distribution. Ann. Math. Stat. 1940, 11, 204–209. [Google Scholar] [CrossRef]
Figure 1. Seasonal variations of total protein concentrations in hemolymph of honeybees from four apiaries (A, B, C, and D) of the province of Bologna. The data are expressed in mg/mL and reported as the mean ± SD (n = 3). Different lower-case letters indicate significant differences (p < 0.05) among the time points (months) within the same apiary. Different symbols (*,†) indicate significant differences (p < 0.05) among the apiaries at the same time point (May).
Figure 1. Seasonal variations of total protein concentrations in hemolymph of honeybees from four apiaries (A, B, C, and D) of the province of Bologna. The data are expressed in mg/mL and reported as the mean ± SD (n = 3). Different lower-case letters indicate significant differences (p < 0.05) among the time points (months) within the same apiary. Different symbols (*,†) indicate significant differences (p < 0.05) among the apiaries at the same time point (May).
Ijms 24 10216 g001
Figure 2. Representative gel obtained after SDS-PAGE (4–12%, Coomassie staining) of hemolymph proteins from healthy worker bees (apiary D, April sampling) at different dilutions (lanes 1–2, 15 µg; lanes 3–5, 3 µg). The first lane shows the molecular mass marker (kDa). The rectangles indicate the bands cut and analyzed using mass spectrometry that led to the protein identifications (Table 1). The numbers next to the rectangles correspond to those reported in Table 1.
Figure 2. Representative gel obtained after SDS-PAGE (4–12%, Coomassie staining) of hemolymph proteins from healthy worker bees (apiary D, April sampling) at different dilutions (lanes 1–2, 15 µg; lanes 3–5, 3 µg). The first lane shows the molecular mass marker (kDa). The rectangles indicate the bands cut and analyzed using mass spectrometry that led to the protein identifications (Table 1). The numbers next to the rectangles correspond to those reported in Table 1.
Ijms 24 10216 g002
Figure 3. (A) Representative gels obtained after SDS-PAGE (4–12%, Coomassie staining) of hemolymph from worker bees sampled in April and November from the same 3 hives located in the province of Bologna (apiary A); the dashed black box indicates the internal standard of quantity (1 µg). (B) The pherograms of lanes 2 and 5 are reported as an example. The arrows indicate the bands identified as apolipophorin-I (ApoLp-I), vitellogenin (Vg), apolipophorin-II (ApoLp-II), transferrin (Tf), and hexamerin 70a (Hex 70a).
Figure 3. (A) Representative gels obtained after SDS-PAGE (4–12%, Coomassie staining) of hemolymph from worker bees sampled in April and November from the same 3 hives located in the province of Bologna (apiary A); the dashed black box indicates the internal standard of quantity (1 µg). (B) The pherograms of lanes 2 and 5 are reported as an example. The arrows indicate the bands identified as apolipophorin-I (ApoLp-I), vitellogenin (Vg), apolipophorin-II (ApoLp-II), transferrin (Tf), and hexamerin 70a (Hex 70a).
Ijms 24 10216 g003
Figure 4. Seasonal variations of vitellogenin, apolipophorin-I, transferrin, and hexamerin 70a in the hemolymph of honeybees from four apiaries (A–D) of the province of Bologna. The data are expressed as mg/mL and reported as the mean ± SD (n = 3). For each analyte, different lower-case letters indicate significant differences (p < 0.05) among time points (months) within the same apiary.
Figure 4. Seasonal variations of vitellogenin, apolipophorin-I, transferrin, and hexamerin 70a in the hemolymph of honeybees from four apiaries (A–D) of the province of Bologna. The data are expressed as mg/mL and reported as the mean ± SD (n = 3). For each analyte, different lower-case letters indicate significant differences (p < 0.05) among time points (months) within the same apiary.
Ijms 24 10216 g004
Table 1. Identification of the most abundant proteins in the hemolymph of worker bees from healthy colonies using mass spectrometry.
Table 1. Identification of the most abundant proteins in the hemolymph of worker bees from healthy colonies using mass spectrometry.
Band 1 Entry Name 2Protein Full NameMM (Da) 3Score 4 Sign. Pept 5Sign. Seq 6emPAI 7Organism
1A0A088AS56Apolipophorin (I)369,55710,6425791163.07Apis cerana
2A0A088ADL8Vitellogenin202,0253244232542.38Apis mellifera
3A0A088ADL8Vitellogenin202,02534730.05Apis mellifera
4A0A088AS56Apolipophorin (fragment) (II)369,5573848224352.59Apis cerana
A0A088AQB0Leucin-rich repeat-containing protein 76,627100159130.96Apis cerana
5A0A088AFH7Transferrin 80,0051790103252.92
6A5YVK7Hexamerin 70a81,5221429101192.14Apis mellifera
7Q86MV4Prophenoloxidase80,4432644149202.45Apis mellifera
A0A088AS36Uncharacterized protein49,05494730.22Apis mellifera
8A0A088AMK2Chitinase-like protein Idgf450,4422708149164.19Apis cerana
MRJP1_APIMEMajor royal jelly protein 149,31151116141.48Apis mellifera
9B0LUE8Apoliphorin-III like protein21,33517234453.32Apis mellifera
10Q1W640OBP1415,21610005468.19Apis mellifera
11Q1W641OBP1315,494771051.69Apis mellifera
Q1W633OBP2115,536112420.48Apis mellifera
1 The number of the band identified as marked in Figure 1. 2 Protein entry name from the UniProt knowledge database. 3 Theoretical protein molecular mass. 4 The highest scores obtained with the Mascot search engine. 5 Significant peptides: total number of significant peptides matching the proteins identified. 6 Significant sequences: total number of significant distinct sequences matching the proteins identified. 7 Exponentially modified protein abundance index.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Isani, G.; Bellei, E.; Rudelli, C.; Cabbri, R.; Ferlizza, E.; Andreani, G. SDS-PAGE-Based Quantitative Assay of Hemolymph Proteins in Honeybees: Progress and Prospects for Field Application. Int. J. Mol. Sci. 2023, 24, 10216. https://doi.org/10.3390/ijms241210216

AMA Style

Isani G, Bellei E, Rudelli C, Cabbri R, Ferlizza E, Andreani G. SDS-PAGE-Based Quantitative Assay of Hemolymph Proteins in Honeybees: Progress and Prospects for Field Application. International Journal of Molecular Sciences. 2023; 24(12):10216. https://doi.org/10.3390/ijms241210216

Chicago/Turabian Style

Isani, Gloria, Elisa Bellei, Cecilia Rudelli, Riccardo Cabbri, Enea Ferlizza, and Giulia Andreani. 2023. "SDS-PAGE-Based Quantitative Assay of Hemolymph Proteins in Honeybees: Progress and Prospects for Field Application" International Journal of Molecular Sciences 24, no. 12: 10216. https://doi.org/10.3390/ijms241210216

APA Style

Isani, G., Bellei, E., Rudelli, C., Cabbri, R., Ferlizza, E., & Andreani, G. (2023). SDS-PAGE-Based Quantitative Assay of Hemolymph Proteins in Honeybees: Progress and Prospects for Field Application. International Journal of Molecular Sciences, 24(12), 10216. https://doi.org/10.3390/ijms241210216

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop