Next Article in Journal
Fabrication of GO/Cement Composites by Incorporation of Few-Layered GO Nanosheets and Characterization of Their Crystal/Chemical Structure and Properties
Next Article in Special Issue
A Novel Magnetic Actuation Scheme to Disaggregate Nanoparticles and Enhance Passage across the Blood–Brain Barrier
Previous Article in Journal
Comparative Evaluation of U.S. Brand and Generic Intravenous Sodium Ferric Gluconate Complex in Sucrose Injection: In Vitro Cellular Uptake
Previous Article in Special Issue
Surface Functionalization of Iron Oxide Nanoparticles with Gallic Acid as Potential Antioxidant and Antimicrobial Agents
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Influence of Sterilization and Preservation Procedures on the Integrity of Serum Protein-Coated Magnetic Nanoparticles

1
Institute of Biomedical Engineering and Informatics (BMTI), Technische Universität Ilmenau, Gustav-Kirchhoff-Strasse 2, D-98693 Ilmenau, Germany
2
Department of Nano Biophotonics, Leibniz Institute of Photonic Technology (IPHT), A.-Einstein-Strasse 9, D-07745 Jena, Germany
3
Department Hematology and Oncology, Jena University Hospital, Am Klinikum 1, D-07747 Jena, Germany
*
Author to whom correspondence should be addressed.
Nanomaterials 2017, 7(12), 453; https://doi.org/10.3390/nano7120453
Submission received: 30 October 2017 / Revised: 8 December 2017 / Accepted: 12 December 2017 / Published: 15 December 2017
(This article belongs to the Special Issue Magnetic Nanoparticles in Biological Applications)

Abstract

:
Protein-coated magnetic nanoparticles are promising candidates for various medical applications. Prior to their application into a biological system, one has to guarantee that the particle dispersions are free from pathogens or any other microbiologic contamination. Furthermore, to find entrance into clinical routine, the nanoparticle dispersions have to be storable for several months. In this study, we tested several procedures for sterilization and preservation of nanoparticle containing liquids on their influence on the integrity of the protein coating on the surface of these particles. For this, samples were treated by freezing, autoclaving, lyophilization, and ultraviolet (UV) irradiation, and characterized by means of dynamic light scattering, determination of surface potential, and gel electrophoresis afterwards. We found that the UV sterilization followed by lyophilization under the addition of polyethylene glycol are the most promising procedures for the preparation of sterilized long-term durable protein-coated magnetic nanoparticles. Ongoing work is focused on the optimization of used protocols for UV sterilization and lyophilization for further improvement of the storage time.

1. Introduction

Magnetic nanoparticles (MNP) are interesting tools for a variety of applications for diagnosis and therapy in medicine [1,2]. Prominent examples are magnetic drug targeting [3,4], magnetic particle hyperthermia [5,6] or magnetic particle imaging [7,8]. For this purpose, aqueous MNP dispersions (ferrofluids) have to be administered to the body, which requires a reliable sterilization of the ferrofluids to exclude any risk for the patient from pathogens within the fluid. Typically, this sterilization is performed by exposure to ultraviolet (UV) radiation or autoclaving [9].
When injecting MNP into a biological system (e.g., the peripheral blood of a patient), a layer made of different proteins present in the biological system (serving as a protein source) is formed on the surface of the MNP—the so-called protein corona [10,11]. This protein layer of a few nanometers [12] can be divided into a peripheral soft corona and a hard corona on the interface to the particles [13,14]. In our previous investigations [15,16] we could demonstrate that the formation of the corona occurs within seconds and the corona composition is furthermore influenced by the temperature at which corona formation takes place, as well as the duration of particle-protein interaction. It should be recalled here that for most engineered nanoparticles, their dilution in biological fluids (such as peripheral blood or fetal bovine serum) leads to particle aggregation [17,18,19]. It is also known that different particle properties (e.g., size and surface charge) exhibit an influence on protein corona formation and the resulting corona composition [20,21,22]. Furthermore, the protein corona plays a crucial role for the biological fate of the particles within the body [22,23,24]. The protein corona affects the cellular uptake profoundly and has an impact on the cell response, for example, cytotoxicity [25,26,27,28]. In a previous investigation we found that the strength of particle-cell interactions, as well as the kinetic ratio of internalized to adherent MNP in/on the cells, can be controlled by adjusting the amount of proteins bound to the MNP. Therefore, MNPs were equipped with a protein corona before introducing them into a biological system [29]. Resulting from all these findings, we conclude that protein-coated nanoparticles are interesting tools to study the interactions of nanoparticles with biological systems in in vitro and in vivo experiments.
Similar to the common MNP, the protein-coated MNP also have to be sterilized prior to their in vitro/in vivo application. For particles smaller than 200 nm sterilization can be obtained by means of filtration. Unfortunately, this method is not suitable for sterilization of larger particles (>220 nm), because the membrane cut off for sterile filtration is 220 nm. Furthermore, a method for preservation of protein-coated MNP is needed, which guarantees storage for several months without an alteration of the integrity of the protein coating. In previous experiments we found a complete decay of the protein coating after nine days for storing in the fridge (4 °C). Up to now, standard procedures for sterilization and preservation of proteins are UV sterilization and lyophilization, respectively. Nevertheless, there are some critical steps which should be considered like freeze-concentration during the initial processes of lyophilization or secondary structure losses by crosslinking of aromatic groups [30].
In the recent years it was demonstrated that magnetic multicore nanoparticles show very promising magnetic properties for several medical applications [31]. Since these particles show a size above 200 nm, a sterilization by means of filtration is not possible. Therefore, the aim of the herein presented study is to establish procedures which allow a reliable sterilization and preservation of larger protein-coated MNP without any damaging effect on the integrity of the corona proteins. For this, protein-coated MNP were prepared as described before [16,32], treated by different procedures for sterilization and preservation, and characterized afterwards regarding possible damaging effects on the integrity of the protein coating.

2. Results and Discussion

2.1. Nanoparticle Properties

MNP were prepared by alkaline precipitation. The resulting particles consist of maghemite and show a mean core diameter of about 10 nm, as confirmed by X-ray diffraction and electron microscopy. After coating with diethylaminoethyl (DEAE) dextran, the mean hydrodynamic diameter determined by means of dynamic light scattering is about 190 nm. Therefore, a slight agglomeration of the cores prior to their protein coating can be assumed. The mean hydrodynamic diameter increased up to 250 nm after serum incubation. This might be due to the additional protein shell on the surface of the particles. An agglomeration of the particles during serum incubation seems not very probable when looking at the hydrodynamic diameters, but cannot be excluded completely. A second indication for a successful protein coating is the surface charge of the particles, which turned from +60 mV to −30 mV for particles prior and after incubation, respectively.
These protein-coated particles were treated by different procedures for preservation and sterilization. The following sections describe the results of the particle characterization concerning their hydrodynamic size, surface charge, and the integrity of the protein coating after treatment; see Table 1.

2.2. Freezing

Protein-coated MNP were frozen under two commonly used freezing conditions, at −15 °C (samples assigned “F”) and −80 °C (samples assigned “DF”). Protein-coated MNP samples were stored for one day (1d), two days (2d), one week (1w), two weeks (2w), four weeks (4w) or six weeks (6w). After thawing, samples were characterized immediately.

2.2.1. Freezing at −15 °C

The visual evaluation of the thawed samples showed that for storing times of two weeks and longer a significant change in the rheology of the fluid occurs. Larger agglomerates can be found in the samples and the viscosity decreases. These observations are confirmed by dynamic light scattering (DLS) measurements (Figure 1a). The original sample, F-0, as well as F-1d, shows a hydrodynamic diameter of about 260 nm. This value increased to 340 nm for F-2w and in F-6w agglomerates larger than 1000 nm can be detected. Furthermore, the polydispersity index (PDI) increased with the particle size simultaneously.
Despite the zeta potential provided a constant value of about −30 mV for all samples, it became obvious from the size measurements that, during the storage of the samples at a temperature of −15 °C, after two weeks a significant alteration of the integrity of the protein coating takes place. This assumption was confirmed by gel electrophoresis (SDS-PAGE).
Since the SDS-PAGE has to be carried out immediately after thawing of the samples, it was not possible to investigate all samples in parallel on one gel. Therefore, different runs of SDS-PAGE were performed during the study and the plots of the obtained lanes were merged (Figure 1b). The detailed investigation of the three groups of proteins contributing to the coating was defined: <30 kDa; 30–100 kDa; >100 kDa. The proportion of each group on the protein coating was calculated from an analysis of the grey value distribution in the raw greyscale image by means of ImageJ. The normalized optical grey value analysis by means of ImageJ shows a similar behaviour of the samples as observed by DLS (Figure 1c). Starting with sample F-2w, an increase of the amount of smaller proteins (<30 kDa) can be observed. For samples F-4w and F-6w a pronounced amount of the smaller proteins is present in the protein corona and the proportion of large proteins >100 kDa decreases. This behaviour can be interpreted as a degradation of the larger proteins to smaller fragments, which means a decay of the protein coating on the surface of the MNP. The degradation of the protein corona may then progressively liberate the metal core surface of the nanoparticles, and thus agglomeration is facilitated when these free metal sites come in contact [33].
In summary, freezing at −15 °C is not suitable for the long-term storage of protein-coated MNP. Short-term storage for up to one week might be possible.

2.2.2. Deep-Freezing at −80 °C

Similar to the freezing experiments, deep-freezing caused an agglomeration of the MNP. Starting from a mean hydrodynamic diameter in DLS of 250 nm for the original sample (F-0), for all samples, but especially for longer storage times (two and six weeks) the occurrence of larger agglomerates was observed (Figure 2a). Furthermore, the zeta potential remained in the range from −29 mV to −30 mV for all samples indicating no alteration of the integrity of the protein coating.
For the investigation of the protein composition by means of SDS-PAGE, similar effects to those for freezing at −15 °C were observed. For storage times longer than two weeks, a significant alteration of the integrity of the protein coating was detected (Figure 2b and 2c).
In summary, the deep-freezing and storage of the samples at −80 °C revealed results similar to that at −15 °C. An agglomeration of protein-coated MNP was observed for storage at −80 °C similar to storage at −15 °C, and a remarkable alteration of the protein composition was proven for storage times of more than two weeks. Therefore, both the freezing and deep-freezing-based treatments presented here are no suitable procedures for the long-term storage of protein-coated MNP.
It remains to be seen whether a controlled automated freezing and thawing procedure as it is used for long-term storage of stem cell transplants may improve the outcome of long-term storage [34]. However, these procedures are very complicated and expensive.

2.3. Lyophilization

The protein-coated MNP samples were freeze-dried in the condition as prepared (samples assigned “Plain”) and after addition of polyethylene glycol (PEG; samples assigned “PEG”) or tetramethylammonium hydroxide (TMAH; samples assigned “TMAH”). PEG was used because it is suggested as cryoprotectant in combination with sugars [35]. The inherent sugars in serum were expected to be sufficient for this approach. After lyophilization, the dry powders were re-dispersed after one week (1w), three weeks (3w), or six weeks (6w) and characterized immediately.
For all three different re-dispersion time points a similar behavior in particle size and agglomeration was found in each single sample series (Plain, PEG, TMAH). The PEG samples show a similar size and size distribution after re-dispersion for all re-suspension time points like the original sample before drying. The Plain samples exhibit for all re-suspension time points a weak proportion of not re-dispersed agglomerates, and thus a slightly higher mean hydrodynamic diameter and PDI. When using TMAH as an additive, for all time points of re-suspension a large proportion of agglomerates remains after re-dispersion and the fluid is not stable against sedimentation, but also a certain fraction of very small fragments can be found in the sample (Figure 3a). This is due to the solubilizing activity of TMAH [36].
The analysis of the zeta potential revealed a constant value of about −30 mV for the original and all “Plain” and “PEG” samples of different storage times, whereas the zeta potential of all “TMAH” samples was in the range of −42 to −44 mV. From this zeta potential results an alteration of the protein integrity due to the addition of TMAH can be supposed.
Protein analysis showed that for a storage time of one week no remarkable changes in the integrity of the protein coating can be observed for “Plain” and “PEG” samples (Figure 3b and 3c). For TMAH-treated samples, already after one week an alteration of the protein integrity was observed. The amount of small proteins (<30 kDa) increased and the amount of larger proteins decreased, which is an indication for the degradation of the protein coating on the surface of the MNP. After a three-week storage period both, the sample Plain-3w and PEG-3w exhibit an increase in the low molecular weight fraction; nevertheless, the protein distribution remains unchanged.
After a storage time of six weeks, partial degradation of the larger proteins occurs and, in consequence, the fraction of small protein fragments and peptides increases. This might be due to stressors like freeze-concentration or pH-shift [37]. Furthermore, the large standard deviation in means of protein size distributions over repetitive experiments implies the pronounced variability in protein sizes upon re-dispersion of long-term stored samples.
In summary, the lyophilization of protein-coated MNP is a suitable method for the preservation of such particles for durations of up to one week. The re-dispersion of the dry powders can be improved by the addition of PEG prior the lyophilization. This phenomenon may be due to the increased stability of the protein-coated nanoparticles and the reduction of agglomeration [38]. For storage times longer than one week a partial degradation of the corona proteins can be observed.

2.4. Autoclaving

For the sterilization of protein-coated MNP by means of autoclaving, two groups of samples were prepared: samples without autoclaving (A-0) and autoclaved samples (A-1). The mean hydrodynamic diameter of 278 nm for A-0 decreased to 218 nm for the autoclaved samples A-1 (Figure 4a). The PDI decreased from 0.32 (A-0) to 0.24 (A-1) after the autoclaving process. On the one hand, this result might be interpreted as a decrease of the thickness of the protein corona due to coagulation of the proteins, which leads to a higher density of the proteins and thus a lower volume [39].
However, on the other hand, the observed changes in the analyzed parameter sets are in a similar range as those for the UV radiation exposure experiments. Therefore, the described changes in hydrodynamic particle sizes and particle size distributions are considered as not significant. A constant zeta potential of −31 mV for A-0, as well as A-1, was determined. Thus, the obtained results give no indication for a loss of protein content or alteration of protein integrity during autoclave sterilization of protein-coated MNP.
The interpretation that the components of the protein corona form a denser layer after autoclaving is supported by the SDS-PAGE results. After autoclaving the protein bands are no longer clearly separable but appear as a smear, especially in the high-molecular weight area (Figure 4b). The untreated sample (A-0) shows the typical pattern containing distinct protein bands for fetal bovine serum (FBS)-coated MNP, whereas the autoclaved sample (A-1) is mainly blurred and diffuse. All of the typical peaks are vanished, and only one agglomeration in the region of 55 kDa can be observed. Beside putative coagulation of the corona proteins, the denaturation and extensive degradation of the proteins may also contribute to these results.
In conclusion, the standard autoclaving protocol is not suitable for the sterilization of protein-coated MNP since the stability and integrity of the corona proteins is impaired.

2.5. UV Sterilization

The investigation of the samples without UV treatment (UV-0), samples with 150 min exposure time (UV-150), and samples with 240 min exposure time (UV-240) revealed no considerable changes in the mean hydrodynamic particle size, particle size distribution, as well as zeta potential due to the UV radiation (Figure 5a). The hydrodynamic particle size decreased from 257 nm for UV-0 to 218 nm for UV-150 and to 189 nm for UV-240. It seems that exposure of protein-coated MNP to UV radiation led to a reduction of the protein amount on particles surface with increasing exposure time. Since this hypothesis was not confirmed by the following characterization steps, the observed size decrease cannot be explained by protein degradation. Another reason for the decreasing particle size due to UV treatment might be a radiation-induced compaction of the proteins, as previously described by Durchschlag [39,40,41]. For the particle size distribution of all three samples a PDI in the range of 0.23 to 0.33 was determined. This indicates a relatively broad distribution of hydrodynamic diameters of the samples, which might be the reason for the observed variation in the mean particles sizes, too. For all three samples a zeta potential of about −30 mV was determined. All these measurements of physical properties indicate that there is no influence of UV exposure on protein amount on the surface of the MNP. This was confirmed by SDS-PAGE (Figure 5b,c).
Neither in the raw true-color image nor in the pseudo color greyscale image an evidence for any UV radiation-caused damage of the proteins could be observed. The pattern of the original sample (UV-0) and the patterns of the samples exposed to UV radiation (UV-150 and UV-240) looked very similar and showed their maximum intensities between 50 and 70 kDa, which is the typical range for albumin and its derivatives. The detailed investigation of the three groups of proteins contributing to the coating was defined: <30 kDa; 30–100 kDa; >100 kDa. The proportion of each group on the protein coating was calculated from an analysis of the grey value distribution in the raw greyscale image by means of ImageJ. In Figure 5c it is clear to see that in the frame of measurement accuracy, the samples before and after UV exposure revealed a comparable size distribution of the corona proteins.
In conclusion, the exposure of a protein coating on MNP to UV radiation of 200–280 nm for up to 240 min causes no relevant change of protein content and integrity. Thus, the applied UV sterilization regime is suitable for the sterilization of protein-coated MNP.

3. Materials and Methods

3.1. Particle Preparation

The magnetic cores of the nanoparticles introduced in this paper were prepared similar to the well-known wet chemical precipitation methods [42,43], but using another alkaline medium and a slower reaction velocity. In detail, a 1 M NaHCO3 solution was slowly added under permanent stirring to a FeCl2/FeCl3 solution (total Fe-concentration: 0.625 M; Fe2+/Fe3+ ratio = 1/1.3). This procedure was stopped when the pH value reached 8. During this routine a brownish precipitate was formed. This precipitate was heated to 100 °C for 5 min and iron oxides with a spinel structure were formed under the release of CO2. To remove excess reaction products from the prepared particles they were washed with de-ionized water three times [44]. Nanoparticles were stored in de-ionized water at room temperature (RT).
For preparation of protein-coated MNP, the magnetic cores have to be incubated in a natural protein source, which leads to an accumulation of proteins on the surface of the MNP. For our studies, fetal bovine serum (FBS) was used as natural protein source. FBS was obtained from Biochrom GmbH (Berlin, Germany) (#S0115, Lot 1184C, tested for mycoplasma and viruses, tested for endotoxins) FBS was heat-inactivated at 56 °C for 1 h prior to use. FBS incubation of MNP was performed by water bath heating resulting in a homogeneous temperature distribution throughout the sample. For this, FBS was tempered at 37 °C in the water bath. A 15 mg pellet of prepared MNP from previously prepared suspensions was filled up with 2 mL of tempered FBS and kept at the same temperature for 10 min. During the time of incubation ultra-sonic treatment at the given temperature was carried out (S100H, Elmasonic, Singen, Germany) to re-disperse possible agglomerates. After 10 min the suspensions were taken out of the water bath and put on a magnet for magnetic separation, excess FBS was withdrawn and distilled water was added. The washed incubated nanoparticle suspensions were kept at 4 °C for short term storage prior to the following experiments [16].

3.2. Sterilization and Preservation

For a potential application of the protein-coated MNP in animals or human, one has to guarantee that the particles are free from biological pathogens or any biological contamination. After the sterilization it is important, to bring the particles into a condition which makes them storable for several weeks. For this purpose, freezing, lyophilization, autoclaving, and UV sterilization was applied to the protein-coated MNP. The following sections describe the applied procedures in more detail.

3.2.1. Freezing

Freezing is a well-established procedure for the preservation of food but also of biological material. At low temperatures, the reproduction of bacteria is slowed and comes to a standstill at temperatures below 4 °C [45]. To check the influence of temperature on the integrity of the corona proteins after freezing preservation, the samples were frozen at −15 °C (freezing) and −80 °C (deep-freezing). Since the freezing time of the whole sample is a function of the temperature, freezing of the samples takes longer than deep-freezing. It is expected, that the freezing at −15 °C thus leads to the formation of larger ice crystals which might damage the integrity of the protein coating.
For this investigation, each time six samples of protein-coated MNP suspension of 1 mL were frozen at the two different temperatures and stored at the desired temperature for up to six weeks. After defined storage periods (1 day, 2 days, 1 week, 2 weeks, 4 weeks, 6 weeks) the frozen samples were thawed at RT and characterized immediately.

3.2.2. Lyophilization

Lyophilization is also a well-established procedure for the long-term preservation of liquid protein-based pharmaceutical formulations [46]. During lyophilization, the sample is frozen at low temperature and, due to sublimation taking place at vacuum, water within the sample is removed. This leads to a complete cessation of all vital functions, as well as the reproduction of the pathogens since they need aqueous conditions to survive. After storage and before using the formulation, water is added again and after re-dispersion of the samples they should show the same properties like before.
To investigate the influence of additives on the re-dispersion of the lyophilized samples, two different substances were added before lyophilization: tetramethylammonium hydroxide (TMAH) or polyethyleneglycol (PEG). After the lyophilization, the dry samples were stored at 4 °C and after certain storage periods (1 week, 3 weeks, 6 weeks) the samples were re-dispersed and the obtained suspensions characterized. For the re-dispersion, 1 mL of water was added and the samples were vortexed and treated with ultrasound.

3.2.3. Autoclaving

For the sterilization of protein-coated MNP by means of autoclaving, a standard protocol was used [47]. For this, 1 mL of the protein-coated MNP suspension was placed into a Varioklav 25 T (Thermo Fisher Scientific, Waltham, MA, USA) and exposed to a temperature of 121 °C for 20 min at a pressure of 3 bar. This increased temperature leads to protein denaturation and damage of the DNA of potentially existing pathogens and causes their die-off. After a defined cooling down of the samples after the sterilization procedure, the samples were stored for some hours at 4 °C prior to their characterization.

3.2.4. UV Sterilization

For the sterilization procedure, 1 mL of the protein-coated MNP fluid was exposed to a broadband UV-C radiation in the wavelength range from 200 to 280 nm. The optimum wavelength for the damage of nucleic acids, and thus the DNA of the pathogens, is 254 nm [47]. This DNA damage kills all potentially existing pathogens in the sample.
The exposure time was adjusted for a first sample to be 150 min representing the minimum time for the sterilization, and for a second sample to be 240 min, representing a treatment time for sterilization including a safety margin. After the UV sterilization, the samples were stored for some hours at 4 °C prior to their characterization.

3.3. Particle Characterization

The magnetic properties were measured by vibrating sample magnetometry (VSM; Micromag 3900, Princeton Measurement Systems, Princeton, NJ, USA). Measurements were performed on liquid samples or dried powders. Concentration of MNP within the liquid samples and amount of proteins bound to particle surface were calculated from the obtained saturation magnetization. The overall magnetic behavior of the samples was derived from coercivity and relative remanence.
DLS was used to obtain information about degradation, agglomeration, or cross-linking of the protein-coated MNP due to the treatment for sterilization or preservation the MNP by investigating the size distribution of the particles. For these measurements, a Zetasizer (nanoZS, Malvern, UK) and appropriate software (Version 6.20) were used and particles’ size was derived from intensity-weighted scattering. Before the measurement, samples were diluted with a ratio of 1:30 in de-ionized water and treated in an ultrasonic bath. The medium viscosity and the relative dielectric constant were taken from water at 25 °C with 0.8872 cP and 78.5 cP, respectively. Measurements were performed in three consecutive runs and obtained values were averaged.
As shown before, the surface charge of protein-coated MNP might serve as an indicator for surface protein amount and composition [32]. Therefore, we used this parameter for a first check, whether the protein corona was influenced from the procedures to sterilize and preserve the corona coating. To determine the surface charge of the protein-coated MNP, the zeta potential is a valid and widely used parameter. For this, the Zetasizer was used again.
To evaluate, if the sterilization and preservation procedures damage the protein corona coating, the composition of the protein corona has to be determined before and after the treatment, respectively. The evaluation of the protein corona composition was carried out by means of SDS-PAGE, as described previously [32]. In brief, MNP samples were mixed with 4× XT Sample Buffer and 20× Reducing Agent (both from Bio-Rad, Munich, Germany) and heated up to 95 °C for 5 min to crack secondary and tertiary structure of proteins. Then, the denatured proteins were separated by molecular weight with polyacrylamide gel electrophoresis on a 4–12% Bis-Tris gel (Bio-Rad, Munich, Germany). After the run, the proteins were visualized by highly sensitive silver staining (SilverXpress Silver Staining Kit, Invitrogen, Heidelberg, Germany). Gel images were processed and analyzed by ImageJ (National Institutes of Health, Bethesda, MD, USA) [48]. As references, a molecular weight standard protein collection Kaleidoscope marker (Bio-Rad, Munich, Germany) and untreated FBS were used. Since the SDS-PAGE has to be carried out immediately after thawing or resuspension of the samples, it was not possible to investigate all samples in parallel on one gel. Therefore, different runs of SDS-PAGE were performed during the study and the plots of the obtained lanes were merged. The images of the original gels are provided in the Supplementary Materials, Figures S1–S6: images from the original silver-stained SDS-Polyacrylamide gels and corresponding false-color images.

4. Conclusions

With our investigations we could show that freezing at −15 °C allows storage of protein-coated MNP for up to one week. After that, a remarkable degradation of the larger proteins in combination with an agglomeration of the particles takes place. For deep-freezing at −80 °C agglomeration was observed, too, but also a degradation of the larger proteins after two weeks. The application of tightly controlled freezing procedures may achieve longer storability in the future. The addition of PEG to the samples prior to their lyophilization leads to well-dispersed fluids after re-suspension of the dry powders. Unfortunately, for storage times longer than one week a degradation of the proteins was observed. This storage period might be extended by using optimized storing conditions (e.g., lower temperature, oxygen exclusion, reduced humidity). Autoclaving by using a standard protocol embedded in a commercially available instrument is not suitable for the sterilization of protein-coated MNP since it damages the integrity of the protein coating dramatically. For the sterilization by means of UV radiation, we found no damaging effects for protein-coated MNP.
In our experiments, we were very strict about the assessment of the alteration of the integrity of the protein coating. Even slight variations of the protein banding patterns elucidated by SDS-PAGE were interpreted as an alteration of the protein composition already, because they may be the consequence of disintegration or degradation and thus affect biological properties. This led us to calculate relatively short storage times without any visible change of the integrity of the protein coating. In prospective clinical applications such minor changes of the protein integrity may influence the interaction of the protein coating with the biological surrounding. Therefore, future studies are necessary to elucidate the treatment-dependent changes on the protein corona, as well as on the single protein level with regard to cytotoxicity and immunogenicity. Furthermore, the activity of enzymes as well as the availability of adaptor molecules and ligands has to be investigated in detail. Ongoing studies with cell-based and in vivo systems are focusing on this topic.
In conclusion, we state that the UV sterilization followed by lyophilization under addition of PEG are the most promising procedures for the preparation of sterilized long-term durable protein-coated MNP beyond the sterile filtration limit of 220 nm, see Table 2. The aim of the ongoing work is the optimization of the established protocols for UV sterilization and lyophilization in order to further improve the stability of the protein corona and the storage periods.

Supplementary Materials

The following are available online at https://www.mdpi.com/2079-4991/7/12/453/s1, Figures S1–S6: Original SDS-Polyacrylamide gels and false-color images.

Acknowledgments

This work was supported by Deutsche Forschungsgemeinschaft (DFG) via SPP 1681 (FKZ: CL202/3-2 and DU 1293/4-2).

Author Contributions

S.D. and J.H.C. conceived and designed the experiments; S.W., C.G., and A.W. performed the experiments; all authors analyzed the data and contributed equally to the writing of the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Krishnan, K.M. Biomedical nanomagnetics: A spin through possibilities in imaging, diagnostics, and therapy. IEEE Trans. Magn. 2010, 46, 2523–2558. [Google Scholar] [CrossRef] [PubMed]
  2. Pankhurst, Q.A.; Thanh, N.T.K.; Jones, S.K.; Dobson, J. Progress in applications of magnetic nanoparticles in biomedicine. J. Phys. D Appl. Phys. 2009, 42, 224001. [Google Scholar] [CrossRef]
  3. Alexiou, C.; Arnold, W.; Klein, R.J.; Parak, F.G.; Hulin, P.; Bergemann, C.; Erhardt, W.; Wagenpfeil, S.; Lubbe, A.S. Locoregional cancer treatment with magnetic drug targeting. Cancer Res. 2000, 60, 6641–6648. [Google Scholar] [PubMed]
  4. Tietze, R.; Lyer, S.; Durr, S.; Struffert, T.; Engelhorn, T.; Schwarz, M.; Eckert, E.; Goen, T.; Vasylyev, S.; Peukert, W.; et al. Efficient drug-delivery using magnetic nanoparticles—Biodistribution and therapeutic effects in tumour bearing rabbits. Nanomed.-Nanotechnol. Biol. Med. 2013, 9, 961–971. [Google Scholar] [CrossRef] [PubMed]
  5. Dutz, S.; Hergt, R. Magnetic particle hyperthermia-a promising tumour therapy? Nanotechnology 2014, 25. [Google Scholar] [CrossRef] [PubMed]
  6. Perigo, E.A.; Hemery, G.; Sandre, O.; Ortega, D.; Garaio, E.; Plazaola, F.; Teran, F.J. Fundamentals and advances in magnetic hyperthermia. Appl. Phys. Rev. 2015, 2, 041302. [Google Scholar] [CrossRef]
  7. Gleich, B.; Weizenecker, R. Tomographic imaging using the nonlinear response of magnetic particles. Nature 2005, 435, 1214–1217. [Google Scholar] [CrossRef] [PubMed]
  8. Zheng, B.; von See, M.P.; Yu, E.; Gunel, B.; Lu, K.; Vazin, T.; Schaffer, D.V.; Goodwill, P.W.; Conolly, S.M. Quantitative magnetic particle imaging monitors the transplantation, biodistribution, and clearance of stem cells in vivo. Theranostics 2016, 6, 291–301. [Google Scholar] [CrossRef] [PubMed]
  9. Zhao, L.Z.; Mei, S.L.; Wang, W.; Chu, P.K.; Wu, Z.F.; Zhang, Y.M. The role of sterilization in the cytocompatibility of titania nanotubes. Biomaterials 2010, 31, 2055–2063. [Google Scholar] [CrossRef] [PubMed]
  10. Del Pino, P.; Pelaz, B.; Zhang, Q.; Maffre, P.; Nienhaus, G.U.; Parak, W.J. Protein corona formation around nanoparticles - from the past to the future. Mater. Horiz. 2014, 1, 301–313. [Google Scholar] [CrossRef]
  11. Vroman, L. Effect of adsorbed proteins on the wettability of hydrophilic and hydrophobic solids. Nature 1962, 196, 476–477. [Google Scholar] [CrossRef] [PubMed]
  12. Roecker, C.; Poetzl, M.; Zhang, F.; Parak, W.J.; Nienhaus, G.U. A quantitative fluorescence study of protein monolayer formation on colloidal nanoparticles. Nat. Nanotechnol. 2009, 4, 577–580. [Google Scholar] [CrossRef] [PubMed]
  13. Cedervall, T.; Lynch, I.; Lindman, S.; Berggard, T.; Thulin, E.; Nilsson, H.; Dawson, K.A.; Linse, S. Understanding the nanoparticle-protein corona using methods to quantify exchange rates and affinities of proteins for nanoparticles. Proc. Natl. Acad. Sci. USA 2007, 104, 2050–2055. [Google Scholar] [CrossRef] [PubMed]
  14. Winzen, S.; Schoettler, S.; Baier, G.; Rosenauer, C.; Mailaender, V.; Landfester, K.; Mohr, K. Complementary analysis of the hard and soft protein corona: Sample preparation critically effects corona composition. Nanoscale 2015, 7, 2992–3001. [Google Scholar] [CrossRef] [PubMed]
  15. Mahmoudi, M.; Abdelmonem, A.M.; Behzadi, S.; Clement, J.H.; Dutz, S.; Ejtehadi, M.R.; Hartmann, R.; Kantner, K.; Linne, U.; Maffre, P.; et al. Temperature: The “ignored” factor at the nanobio interface. ACS Nano 2013, 7, 6555–6562. [Google Scholar] [CrossRef] [PubMed]
  16. Weidner, A.; Gräfe, C.; Von der Luhe, M.; Remmer, H.; Clement, J.H.; Eberbeck, D.; Ludwig, F.; Müller, R.; Schacher, F.H.; Dutz, S. Preparation of core-shell hybrid materials by producing a protein corona around magnetic nanoparticles. Nanoscale Res. Lett. 2015, 10, 282. [Google Scholar] [CrossRef] [PubMed]
  17. Chanteau, B.; Fresnais, J.; Berret, J.F. Electrosteric enhanced stability of functional sub-10 nm cerium and iron oxide particles in cell culture medium. Langmuir 2009, 25, 9064–9070. [Google Scholar] [CrossRef] [PubMed]
  18. Safi, M.; Courtois, J.; Seigneuret, M.; Conjeaud, H.; Berret, J.F. The effects of aggregation and protein corona on the cellular internalization of iron oxide nanoparticles. Biomaterials 2011, 32, 9353–9363. [Google Scholar] [CrossRef] [PubMed]
  19. Torrisi, V.; Graillot, A.; Vitorazi, L.; Crouzet, Q.; Marletta, G.; Loubat, C.; Berret, J.F. Preventing corona effects: Multiphosphonic acid poly(ethylene glycol) copolymers for stable stealth iron oxide nanoparticles. Biomacromolecules 2014, 15, 3171–3179. [Google Scholar] [CrossRef] [PubMed]
  20. Huehn, D.; Kantner, K.; Geidel, C.; Brandholt, S.; De Cock, I.; Soenen, S.J.H.; Gil, P.R.; Montenegro, J.-M.; Braeckmans, K.; Muellen, K.; et al. Polymer-coated nanoparticles interacting with proteins and cells: Focusing on the sign of the net charge. ACS Nano 2013, 7, 3253–3263. [Google Scholar] [CrossRef] [PubMed]
  21. Lundqvist, M.; Stigler, J.; Elia, G.; Lynch, I.; Cedervall, T.; Dawson, K.A. Nanoparticle size and surface properties determine the protein corona with possible implications for biological impacts. Proc. Natl. Acad. Sci. USA 2008, 105, 14265–14270. [Google Scholar] [CrossRef] [PubMed]
  22. Tenzer, S.; Docter, D.; Kuharev, J.; Musyanovych, A.; Fetz, V.; Hecht, R.; Schlenk, F.; Fischer, D.; Kiouptsi, K.; Reinhardt, C.; et al. Rapid formation of plasma protein corona critically affects nanoparticle pathophysiology. Nat. Nanotechnol. 2013, 8, 772–781. [Google Scholar] [CrossRef] [PubMed]
  23. Mahmoudi, M.; Sheibani, S.; Milani, A.S.; Rezaee, F.; Gauberti, M.; Dinarvand, R.; Vali, H. Crucial role of the protein corona for the specific targeting of nanoparticles. Nanomedicine 2015, 10, 215–226. [Google Scholar] [CrossRef] [PubMed]
  24. Nel, A.E.; Maedler, L.; Velegol, D.; Xia, T.; Hoek, E.M.V.; Somasundaran, P.; Klaessig, F.; Castranova, V.; Thompson, M. Understanding biophysicochemical interactions at the nano-bio interface. Nat. Mater. 2009, 8, 543–557. [Google Scholar] [CrossRef] [PubMed]
  25. Hu, W.; Peng, C.; Lv, M.; Li, X.; Zhang, Y.; Chen, N.; Fan, C.; Huang, Q. Protein corona-mediated mitigation of cytotoxicity of graphene oxide. ACS Nano 2011, 5, 3693–3700. [Google Scholar] [CrossRef] [PubMed]
  26. Lee, Y.K.; Choi, E.-J.; Webster, T.J.; Kim, S.-H.; Khang, D. Effect of the protein corona on nanoparticles for modulating cytotoxicity and immunotoxicity. Int. J. Nanomed. 2015, 10, 97–112. [Google Scholar]
  27. Lesniak, A.; Fenaroli, F.; Monopoli, M.R.; Aberg, C.; Dawson, K.A.; Salvati, A. Effects of the presence or absence of a protein corona on silica nanoparticle uptake and impact on cells. ACS Nano 2012, 6, 5845–5857. [Google Scholar] [CrossRef] [PubMed]
  28. Monopoli, M.P.; Walczyk, D.; Campbell, A.; Elia, G.; Lynch, I.; Bombelli, F.B.; Dawson, K.A. Physical-chemical aspects of protein corona: Relevance to in vitro and in vivo biological impacts of nanoparticles. J. Am. Chem. Soc. 2011, 133, 2525–2534. [Google Scholar] [CrossRef] [PubMed]
  29. Huang, J.; Wang, L.Y.; Lin, R.; Wang, A.Y.; Yang, L.; Kuang, M.; Qian, W.P.; Mao, H. Casein-coated iron oxide nanoparticles for high mri contrast enhancement and efficient cell targeting. ACS Appl. Mater. Interfaces 2013, 5, 4632–4639. [Google Scholar] [CrossRef] [PubMed]
  30. Correia, M.; Neves-Petersen, M.T.; Jeppesen, P.B.; Gregersen, S.; Petersen, S.B. Uv-light exposure of insulin: Pharmaceutical implications upon covalent insulin dityrosine dimerization and disulphide bond photolysis. PLoS ONE 2012, 7, e50733. [Google Scholar] [CrossRef] [PubMed]
  31. Dutz, S. Are magnetic multicore nanoparticles promising candidates for biomedical applications? IEEE Trans. Magn. 2016, 52. [Google Scholar] [CrossRef]
  32. Gräfe, C.; Weidner, A.; von der Lühe, M.; Bergemann, C.; Schacher, F.H.; Clement, J.H.; Dutz, S. Intentional formation of a protein corona on nanoparticles: Serum concentration affects protein corona mass, surface charge, and nanoparticle-cell interaction. Int. J. Biochem. Cell Biol. 2016, 75, 196–202. [Google Scholar] [CrossRef] [PubMed]
  33. Gebauer, J.S.; Malissek, M.; Simon, S.; Knauer, S.K.; Maskos, M.; Stauber, R.H.; Peukert, W.; Treuel, L. Impact of the nanoparticle-protein corona on colloidal stability and protein structure. Langmuir 2012, 28, 9673–9679. [Google Scholar] [CrossRef] [PubMed]
  34. Leemhuis, T.; Padley, D.; Keever-Taylor, C.; Niederwieser, D.; Teshima, T.; Lanza, F.; Chabannon, C.; Szabolcs, P.; Bazarbachi, A.; Koh, M.B.C.; et al. Essential requirements for setting up a stem cell processing laboratory. Bone Marrow Transplant. 2014, 49, 1098–1105. [Google Scholar] [CrossRef] [PubMed]
  35. Prestrelski, S.J.; Arakawa, T.; Carpenter, J.F. Separation of freezing-induced and drying-induced denaturation of lyophilized proteins using stress-specific stabilization. II. Structural studies using infrared spectroscopy. Arch. Biochem. Biophys. 1993, 303, 465–473. [Google Scholar] [CrossRef] [PubMed]
  36. Shimizu, S.; Cho, T.; Murakami, Y. Alkali digestion method using tmah for determination of trace elements contained in biological materials. In Trace Element Analytical Chemistry in Medicine and Biology, Proceedings of the International Workshop, Neuherberg, Germany, 15–18 April 1988; Braetter, P., Schramel, P., Eds.; Walter de Gruyter: Berlin, Germany, 1988; Volume 5, pp. 72–77. [Google Scholar]
  37. Bhatnagar, B.S.; Pikal, M.J.; Bogner, R.H. Study of the individual contributions of ice formation and freeze-concentration on isothermal stability of lactate dehydrogenase during freezing. J. Pharm. Sci. 2008, 97, 798–814. [Google Scholar] [CrossRef] [PubMed]
  38. Logie, J.; Owen, S.C.; McLaughlin, C.K.; Shoichet, M.S. Peg-graft density controls polymeric nanoparticle micelle stability. Chem. Mater. 2014, 26, 2847–2855. [Google Scholar] [CrossRef]
  39. Vaz, C.M.; De Graaf, L.A.; Reis, R.L.; Cunha, A.M. Effect of crosslinking, thermal treatment and uv irradiation on the mechanical properties and in vitro degradation behavior of several natural proteins aimed to be used in the biomedical field. J. Mater. Sci.-Mater. Med. 2003, 14, 789–796. [Google Scholar] [CrossRef] [PubMed]
  40. Durchschlag, H.; Fochler, C.; Feser, B.; Hausmann, S.; Seroneit, T.; Swientek, M.; Swoboda, E.; Winklmair, A.; Wlcek, C.; Zipper, P. Effects of x- and uv-irradiation on proteins. Radiat. Phys. Chem. 1996, 47, 501–505. [Google Scholar] [CrossRef]
  41. Mahmoudi, M. Nanoparticle and protein corona. In Protein-Nanoparticle Interactions; Rahman, M., Laurent, S., Tawil, N., Yahia, L., Mahmoudi, M., Eds.; Springer: Berlin, Germany, 2013. [Google Scholar]
  42. Khalafalla, S.E.; Reimers, G.W. Preparation of dilution-stable aqueous magnetic fluids. IEEE Trans. Magn. 1980, 16, 178–183. [Google Scholar] [CrossRef]
  43. Massart, R. Preparation of aqueous ferrofluids without using surfactant - behavior as a function of the ph and the counterions. C. R. Hebd. Seances Acad. Sci. Ser. C 1980, 291, 1–3. [Google Scholar]
  44. Dutz, S.; Clement, J.H.; Eberbeck, D.; Gelbrich, T.; Hergt, R.; Mueller, R.; Wotschadlo, J.; Zeisberger, M. Ferrofluids of magnetic multicore nanoparticles for biomedical applications. J. Magn. Magn. Mater. 2009, 321, 1501–1504. [Google Scholar] [CrossRef]
  45. Kurzhals, H. Kühlen und Gefrieren von Lebensmitteln; BEHRS Verlag: Hamburg, Germany, 2007. [Google Scholar]
  46. Wang, W. Lyophilization and development of solid protein pharmaceuticals. Int. J. Pharm. 2000, 203, 1–60. [Google Scholar] [CrossRef]
  47. Bodenschatz, W. Handbuch für den Desinfektor in Ausbildung und Praxis; Elsevier: München, Germany, 1993. [Google Scholar]
  48. Schneider, C.A.; Rasband, W.S.; Eliceiri, K.W. NIH image to imageJ: 25 years of image analysis. Nat. Methods 2012, 9, 671–675. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Freezing of protein-coated nanoparticles at −15 °C causes agglomeration during long-term storage. (a) DLS measurements exhibit a continuous increase of the hydrodynamic diameter with extended storage times; (b) Protein size distribution is shifted towards smaller sizes after several weeks of storage demonstrated by gel electrophoresis (silver staining and false color representation); (c) Variations of the protein size ranges over the storage period (based on (b)). n = 3, M—protein size marker.
Figure 1. Freezing of protein-coated nanoparticles at −15 °C causes agglomeration during long-term storage. (a) DLS measurements exhibit a continuous increase of the hydrodynamic diameter with extended storage times; (b) Protein size distribution is shifted towards smaller sizes after several weeks of storage demonstrated by gel electrophoresis (silver staining and false color representation); (c) Variations of the protein size ranges over the storage period (based on (b)). n = 3, M—protein size marker.
Nanomaterials 07 00453 g001
Figure 2. Deep-freezing of protein-coated nanoparticles at −80 °C affects the integrity of the protein corona during long-term storage. (a) DLS measurements confirm the occurrence of larger agglomerates with extended storage times; (b) Protein size distribution is shifted towards smaller sizes after several weeks of storage demonstrated by gel electrophoresis (silver staining and false color representation); (c) Variations of the protein size ranges over the storage period (based on (b)). n = 3, M—protein size marker.
Figure 2. Deep-freezing of protein-coated nanoparticles at −80 °C affects the integrity of the protein corona during long-term storage. (a) DLS measurements confirm the occurrence of larger agglomerates with extended storage times; (b) Protein size distribution is shifted towards smaller sizes after several weeks of storage demonstrated by gel electrophoresis (silver staining and false color representation); (c) Variations of the protein size ranges over the storage period (based on (b)). n = 3, M—protein size marker.
Nanomaterials 07 00453 g002
Figure 3. Lyophilization of protein-coated nanoparticles affects the integrity of the protein corona during long-term storage. (a) After storage of the dry powders for six weeks the DLS measurements show that the hydrodynamic diameter of re-suspended Plain and polyethylene glycol (PEG) samples is very similar to that of the original sample, but for tetramethylammonium hydroxide (TMAH) an agglomeration results; (b) Proteins are degraded during lyophilization, especially in the presence of TMAH, resulting in smaller sizes after several weeks of storage demonstrated by gel electrophoresis (silver staining and false color representation); (c) Variations of the protein size ranges over the storage period (based on (b)). n = 3, M—protein size marker.
Figure 3. Lyophilization of protein-coated nanoparticles affects the integrity of the protein corona during long-term storage. (a) After storage of the dry powders for six weeks the DLS measurements show that the hydrodynamic diameter of re-suspended Plain and polyethylene glycol (PEG) samples is very similar to that of the original sample, but for tetramethylammonium hydroxide (TMAH) an agglomeration results; (b) Proteins are degraded during lyophilization, especially in the presence of TMAH, resulting in smaller sizes after several weeks of storage demonstrated by gel electrophoresis (silver staining and false color representation); (c) Variations of the protein size ranges over the storage period (based on (b)). n = 3, M—protein size marker.
Nanomaterials 07 00453 g003
Figure 4. Autoclaving of protein-coated nanoparticles affects the protein corona dramatically. (a) DLS measurements show that the hydrodynamic diameter of the protein-coated nanoparticles decreases during treatment (b) Proteins are degraded during autoclaving demonstrated by gel electrophoresis (silver staining and false color representation). n = 3, M—protein size marker.
Figure 4. Autoclaving of protein-coated nanoparticles affects the protein corona dramatically. (a) DLS measurements show that the hydrodynamic diameter of the protein-coated nanoparticles decreases during treatment (b) Proteins are degraded during autoclaving demonstrated by gel electrophoresis (silver staining and false color representation). n = 3, M—protein size marker.
Nanomaterials 07 00453 g004
Figure 5. Ultraviolet (UV) sterilization of protein-coated nanoparticles does not affect the protein corona. (a) DLS measurements show that the hydrodynamic diameter of the protein-coated nanoparticles decreases with increasing treatment time (b) Protein size distribution is not altered as demonstrated by gel electrophoresis (silver staining and false color representation). (c) Variations of the protein size ranges over the storage period (based on (b)). n = 3, M—protein size marker.
Figure 5. Ultraviolet (UV) sterilization of protein-coated nanoparticles does not affect the protein corona. (a) DLS measurements show that the hydrodynamic diameter of the protein-coated nanoparticles decreases with increasing treatment time (b) Protein size distribution is not altered as demonstrated by gel electrophoresis (silver staining and false color representation). (c) Variations of the protein size ranges over the storage period (based on (b)). n = 3, M—protein size marker.
Nanomaterials 07 00453 g005
Table 1. Summary of applied treatments and methods used for characterization. Dynamic light scattering (DLS); zeta potential (ZETA); sodium dodecyl sulphate polyacrylamide gel electrophoresis (SDS-PAGE).
Table 1. Summary of applied treatments and methods used for characterization. Dynamic light scattering (DLS); zeta potential (ZETA); sodium dodecyl sulphate polyacrylamide gel electrophoresis (SDS-PAGE).
Treatment ConditionDurationAnalysis
DLSZETASDS-PAGE
Preservation
Freezing (−15 °C)up to 6 weeksXXX
Deep-Freezing (−80 °C) up to 6 weeksXXX
Lyophilizationup to 6 weeksXXX
Sterilization
Autoclavingbefore/afterXXX
UV-Sterilizationbefore/afterXXX
Table 2. Summary of treatment methods and their suitability for sterilization and preservation of protein-coated magnetic nanoparticles.
Table 2. Summary of treatment methods and their suitability for sterilization and preservation of protein-coated magnetic nanoparticles.
MethodSuitable for Application Remarks
UV-Sterilisationyesno major changes
Lyophilizationyes, with PEG as additivedegradation of large proteins with TMAH
Freezing (−15 °C)only for short term storageagglomeration of MNP,
degradation of large proteins
Deep-freezing (−80 °C)only for short term storageagglomeration of MNP,
degradation of large proteins
Autoclavingnodegradation of proteins

Share and Cite

MDPI and ACS Style

Dutz, S.; Wojahn, S.; Gräfe, C.; Weidner, A.; Clement, J.H. Influence of Sterilization and Preservation Procedures on the Integrity of Serum Protein-Coated Magnetic Nanoparticles. Nanomaterials 2017, 7, 453. https://doi.org/10.3390/nano7120453

AMA Style

Dutz S, Wojahn S, Gräfe C, Weidner A, Clement JH. Influence of Sterilization and Preservation Procedures on the Integrity of Serum Protein-Coated Magnetic Nanoparticles. Nanomaterials. 2017; 7(12):453. https://doi.org/10.3390/nano7120453

Chicago/Turabian Style

Dutz, Silvio, Stephanie Wojahn, Christine Gräfe, Andreas Weidner, and Joachim H. Clement. 2017. "Influence of Sterilization and Preservation Procedures on the Integrity of Serum Protein-Coated Magnetic Nanoparticles" Nanomaterials 7, no. 12: 453. https://doi.org/10.3390/nano7120453

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop