Next Article in Journal
Dietary Micronutrient Status and Relation between Micronutrient Intakes and Overweight and Obesity among Non-Pregnant and Non-Lactating Women Aged 18 to 49 in China
Next Article in Special Issue
A Systematic Review of the Influence of Bovine Colostrum Supplementation on Leaky Gut Syndrome in Athletes: Diagnostic Biomarkers and Future Directions
Previous Article in Journal
Intestinal Barrier Permeability in Allergic Diseases
Previous Article in Special Issue
The Effects of Carbohydrate versus Fat Restriction on Lipid Profiles in Highly Trained, Recreational Distance Runners: A Randomized, Cross-Over Trial
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Examination of Amorphous Calcium Carbonate on the Inflammatory and Muscle Damage Response in Experienced Resistance Trained Individuals

Department of Physical Therapy, School of Health Sciences, Ariel University, Ariel 40700, Israel
*
Author to whom correspondence should be addressed.
Nutrients 2022, 14(9), 1894; https://doi.org/10.3390/nu14091894
Submission received: 3 April 2022 / Revised: 22 April 2022 / Accepted: 28 April 2022 / Published: 30 April 2022
(This article belongs to the Special Issue Nutritional Intervention for Competitive Athletes)

Abstract

:
The effect of 3 weeks of amorphous calcium carbonate (ACC) supplementation (2000 mg per day) was examined on the recovery response to resistance exercise. Thirty men were randomized into a supplement (ACC) or placebo (PL) group. Following supplementation, participants performed six sets of 10 repetitions in the bench press (BP) and incline BP exercises, using 80% of maximal strength. Participants returned 24 (T4) and 48 h (T5) later and performed six sets of the BP exercise. Significant decreases in the number of repetitions (p < 0.001), peak power (p < 0.001), and mean power (p = 0.009) were noted over time, but no significant interactions were observed (p > 0.05). Magnitude-based inference analysis (MBI) indicated that the change in repetitions was possibly beneficial for ACC at T4 and likely beneficial at T5. No significant interaction was noted for general soreness (p = 0.452), but a trend toward an interaction was observed in upper body soreness (p = 0.089). Confidence intervals for mean percent change scores indicated significant differences between the groups at T4 and T5, and MBI analysis indicated that ACC was very likely or likely to be beneficial for reducing soreness at those time points. In conclusion, ACC supplementation may have a potential beneficial effect in attenuating the decline in performance, which is possibly due to the carbonate component.

1. Introduction

Calcium is a micronutrient that has an important role in both bone health and skeletal muscle function [1]. Calcium is an integral part of bone composition and is involved in muscle regulation via its critical role in skeletal muscle contraction and relaxation [2]. Calcium supplementation is often used to achieve adequate calcium intake. Several meta-analyses have concluded that calcium supplementation is effective at enhancing bone strength, but there is some thought that it may be more efficacious when it is combined with vitamin D [3,4]. When provided by itself, its efficacy for enhancing bone strength has been inconclusive [5,6,7]. Research examining the efficacy of calcium supplementation and muscle performance in young, athletic populations is limited. Most studies have generally focused on an older population and often in conjunction with vitamin D ingestion.
Calcium supplements can be divided into either an organic or inorganic group, which differ on their chelating capability [8]. Organic calcium supplements include negatively charged organic molecules, such as malate, citrate, fumarate, and gluconate, while inorganic calcium supplements include carbonates, phosphates, and chlorides [8]. The calcium found in most dietary supplements is from either carbonate and citrate salts derived from various sources including oyster shells, coral calcium, dolomite minerals, and other synthetic material [9]. The limited absorbability of calcium from these sources is thought to contribute to the lack of consistency reported regarding the efficacy of calcium supplementation [10]. Calcium carbonate is one of the most abundant minerals in nature, having six known polymorphs. The most stable form of calcium carbonate is calcite, while the least stable polymorph is the amorphous form [11]. However, amorphous calcium carbonate is reported to have a significantly greater absorption capability than the calcite form [12].
The shell of freshwater crayfish is constructed with a specialized transient mineral storage site (i.e., gastroliths), which is composed of stabilized amorphous calcium carbonate embedded into an organic matrix comprising dense chitin fibers and proteins [13]. The instability of the amorphous calcium carbonate provides a highly bioavailable calcium source that enables a fast and effective transport of the mineral across the intestinal epithelium and into the hardening exoskeleton of the crayfish. This biological finding resulted in the development of a novel method for the synthetic production of stabilized amorphous calcium carbonate using phospho-amino acids [8]. The superior bioavailability of the amorphous calcium carbonate over crystalline calcium carbonate has been demonstrated in both animal [14] and human studies [15].
It has been well-established that resistance exercise can result in varying degrees of muscle damage, resulting in an inflammatory response and performance impairments [16]. There have been a number of dietary supplements that have been shown to accelerate recovery from exercise [16]. These supplements may allow an accumulation of specific nutrients within the tissues of the body or in the circulation that will enhance the athlete’s ability to recover. The greater absorption capability of the amorphous calcium carbonate (ACC) would potentially provide for a quicker and more efficient buffering capability of hydrogen ions (H+) during high-intensity exercise. In consideration of the limited research on young, active participants, the purpose of this study was to examine the effect of supplementing with ACC on the recovery response to intense resistance exercise in resistance trained men.

2. Materials and Methods

2.1. Participants

Thirty experienced, resistance-trained men volunteered to participate in this study. Participants were randomly divided into a supplement (ACC; n = 15, age = 25.5 ± 4.4 years old, height = 175.9 ± 6.8 cm, body mass = 84.2 ± 17.3 kg) or a placebo (PL; n = 15, age = 26.6 ± 3.1 years old, height = 179.6 ± 8.4 cm, body mass = 89.1 ± 16.3 kg) group. A simple 1:1 randomization procedure was employed. All participants had at least 1-year of resistance training experience (mean 5.8 ± 3.3 years old), including specific experience in performing the bench press exercise. Following an explanation of all procedures, including the risks and benefits associated with volunteering for the study, each participant provided his informed consent. The Institutional Review Board of Ariel University (AU-HEA-JH-20210603) approved the research protocol. Participants were not permitted to use any additional nutritional supplements for at least six weeks prior to the study and did not consume anabolic steroids or any other anabolic agents known to enhance performance for the previous year. Screening for supplement and steroid use was accomplished via a health history questionnaire completed during the recruitment phase.

2.2. Study Protocol

The investigation was performed as a double-blind, randomized design. Participants reported to the Human Performance Laboratory (HPL) on five separate occasions. On the first visit (T1), participants received an explanation of the study, provided their informed consent, and were randomized into either the ACC or PL groups. Participants commenced supplementation at T1. Two weeks later, the participants reported to the HPL again (T2) for maximal strength (one repetition-maximum (1-RM)) assessments on the bench press and incline bench press exercises. On their third visit (T3), 7 days following T2, participants performed an upper body resistance exercise session which consisted of six sets of the bench press and incline bench press exercises. The rest interval between each set was 60 s. Each set was performed with 80% of the participant’s previously measured 1-RM. This protocol was based on simulating a typical training program during the hypertrophy phase of training [17], and it has been previously used in other studies examining the effect of nutrient intervention on recovery during high-intensity exercise [18,19]. Participants were required to perform no more than 10 repetitions for each set. No forced repetitions were performed, and resistance was not lowered for subsequent sets if the participant was unable to perform the required number of repetitions in the previous set. Participants reported back to the HPL 24 (T4) and 48 h (T5) post-exercise. During T4 and T5, participants performed six sets of the bench press exercise only using the same loading pattern and rest interval length as T3. The bench press and incline bench press exercises were selected due to the participants’ familiarity with this exercise and years of experience performing it. Any changes noted would be considered the result of the study protocol and not related to any physiological adaptation stimulated by the study itself.

2.3. Supplement Protocol

Participants consumed either 2000 mg of ACC or placebo per day. The supplement or placebo was consumed four times per day (500 mg per serving) for 21 days. Calcium comprised 32% of the supplement [15], and the total calcium intake was similar to that used in most calcium supplement studies [3]. During each serving, the participant consumed two packets of the powder. The powder was placed under the participants’ tongues and dissolved sublingually. There was no difference in the appearance or taste between the active ingredient and placebo. Each participant consumed one serving of the supplement 30 min prior to each resistance training session.

2.4. Maximal Strength Testing

The 1-RM tests were performed using methods previously described [20]. Each participant performed two warm-up sets using a resistance that was approximately 40–60% and 60–80% of their estimated 1-RM, respectively. The third set was the first attempt at the participant’s 1-RM. If the set was successfully completed, then weight was added, and another set was attempted. If the set was not successfully completed, then the weight was reduced, and another set was attempted. A 3–5-min rest period was provided between each set. The process of adding and removing weight was continued until a 1-RM was reached. Attempts that did not meet the range of motion criterion for each exercise, as determined by the researcher, were discarded. The participants were required to lower the bar to their chest before initiating the concentric movement. Grip widths were measured and recorded for later use.

2.5. Performance Measures

Upper body power during the bench press exercise protocol was measured for each repetition with a Tendo™ Power Output Unit (Tendo Sports Machines, Trencin, Slovakia). The Tendo™ unit consists of a transducer that is attached to the end of the barbell, which measures linear displacement and time. Subsequently, bar velocity was calculated, and power was determined. Both peak and mean power output were recorded for each repetition and used for subsequent analysis. Test–retest reliability for the Tendo unit has been shown to be R > 0.90 [18,21].

2.6. Soreness Questionnaire

To provide a subjective measure of the participants’ perceptions of muscle and whole-body soreness, participants were asked to rate their degree of whole-body muscle soreness and upper-body muscle soreness at T3, T4, and T5 using a 15 cm visual analog scale (VAS). Participants were asked to rate their feelings of soreness by marking on a line with words anchored at each end of the VAS. Questions were structured as “My level of muscle soreness is:” with the words “low” and “high” serving as the verbal anchors representing the extreme ratings. Therefore, the greater the measured value, the greater the feeling. The VAS was conducted following each blood draw prior to performing the workouts on each assessment day. The validity and reliability of VAS in assessing fatigue and energy has been previously established [22].

2.7. Blood Measurements

During the T3 experimental session baseline (PRE), blood samples were obtained prior to exercise. An additional blood sample was drawn 60 min post-exercise (POST). All blood samples were obtained using a 20-gauge Teflon cannula placed in a superficial forearm vein. The cannula was maintained patent using an isotonic saline solution (with 10% heparin). PRE blood samples were drawn following a 15-min equilibration period prior to exercise. All T3 blood samples were obtained while the participant was in a seated position. During the T4 and T5 sessions, only a baseline blood sample was drawn. These blood samples were obtained from an antecubital arm vein using a 20-gauge disposable needle equipped with a Vacutainer® tube holder with the participant in a seated position. Each participant’s blood samples were obtained at the same time of day during each session. Blood samples were collected into a single Vacutainer® tube, containing SST® Gel and Clot Activator. The blood was allowed to clot at room temperature and subsequently centrifuged at 1500× g for 15 min. The resulting serum was placed into separate 1.8 mL microcentrifuge tubes and frozen at −80 °C for later analysis. All blood draws were conducted by individuals trained in phlebotomy.

2.8. Biochemical Analyses

Serum concentrations of creatine kinase muscle (CK-M) were analyzed with enzyme-linked immunosorbent assay (ELISA) kits per manufacturer’s instructions. CK-M was analyzed using kits from Abcom (ab264617, San Diego, CA, USA). Serum concentrations of pro- and anti-inflammatory cytokines including tumor necrosis factor-alpha (TNF-α), interleukin (IL)-6, and IL-10 were analyzed via multiplex assay using Human Cytokine/Chemokine Panel I (EMD Millipore, Billerica, MA, USA). All samples were thawed once and analyzed in duplicate by the same technician using an Absorbance 96 spectrophotometer (Byonoy GmbH, Hamburg, Germany) for the CK-M assay and MagPix (EMD Millipore) for cytokine concentrations. The mean intra-assay variability for all assays was <10%.

2.9. Statistical Analysis

Prior to analysis, all data were assessed to ensure normal distribution, homogeneity of variance, and sphericity. If sphericity was violated, a Greenhouse–Geisser correction was applied. Statistical evaluation of performance and biochemical changes was accomplished using a two-way (group × time) repeated analysis of variance (ANOVA). If there was a significant main effect for time, then the post hoc analysis for each group was assessed using 95% confidence intervals (CI) as previously described [23,24]. Percent change scores were calculated for each participant from T3 to T4 and from T3 to T5 for performance, soreness, and CK-M measures, while percent change scores were calculated for the cytokine measures from PRE to POST, PRE to T4, and PRE to T5. These percent change scores were averaged separately for the ACC and PL groups, and 95% CI were constructed around the mean percent change scores. When the 95% CI included 0, the mean percent-change was considered no different from 0 and was interpreted as no statistical change [25,26]. However, if the 95% CI did not include 0, the mean percent change for that variable was considered statistically significant at p ≤ 0.05 [25,26]. In addition, if the CIs between groups did not overlap, it was considered to represent a significant interaction [27]. All statistical analyses were analyzed using SPSS v27 software (SPSS Inc., Chicago, IL), and an alpha level of p ≤ 0.05 was used to determine statistical significance. All data are reported as mean ± SD.
To complement our null hypothesis testing and to make inferences about the true effects of the supplement on exercise recovery, data were further analyzed using magnitude-based inferences (MBI) [28]. Several studies have suggested that the MBI analysis is an effective statistical tool for null hypothesis testing to reduce interpretation errors [29,30]. Data were calculated from 90% CI and analyzed as previously described [29]. Differences in the change of the ∆ scores between ACC vs. PL at all time points were analyzed using the p-value from independent t-tests to determine a mechanistic inference utilizing a published spreadsheet [31]. All data are expressed as a mean effect ± SD, with percent chances of a beneficial, trivial, or negative outcome. Qualitative inferences, based on quantitative chances, were assessed as: <1% almost certainly not, 1–5% very unlikely, 5–25% unlikely, 25–75% possibly, 75–95% likely, 95–99% very likely, and >99% almost certainly [30]. If there was a greater than 5% chance that the true value was either greater or lesser, indicating that the CI was overlapping multiple thresholds, the effect was considered to be mechanistically unclear [30]. The smallest non-trivial change, or smallest worthwhile change, was set at 20% of the grand standard deviation for all PRE-values [30].

3. Results

Two of the 30 participants (one participant from each group) improved the number of repetitions performed in the bench press exercise from T3 to T4. This was not expected, and it was suggested that maximal effort was not achieved on T3. These participants were removed from the study, and a total of 28 participants were used in the final analysis (14 per group). No differences were seen in 1-RM bench press (p = 0.32; 100.0 ± 18.6 kg and 107.9 ± 20.5 kg) or in the number of repetitions performed in the bench press exercise during T3 (p = 0.773, 26.7 ± 5.5 and 27.6 ± 8.7) between ACC and PL, respectively. In addition, the total training volume (repetitions x load) for both the bench press and incline bench press exercises performed at T3 were similar (p = 0.34) between ACC (3211 ± 648 kg) and PL (3561 ± 1115 kg).
The number of repetitions performed per workout in the bench press exercise, the average peak and mean power exhibited for each workout, and subjective feelings of soreness, both general and local, can be seen in Table 1. Significant main effects for time were noted in the number of repetitions performed (F = 27.565, p < 0.001), peak power (F = 8.180, p < 0.001), and mean power (F = 5.208, p = 0.009). However, no significant interactions were noted in the number of repetitions performed (F = 2.077, p = 0.136), peak power (F = 0.678, p = 0.494), or mean power (F = 2.232, p = 0.119). The mean percent change scores (see Figure 1) revealed significant decreases for repetitions performed at T4 and T5 for both ACC and PL. Significant decreases from PRE were noted in peak power for ACC at both T4 and T5, while this was only noted for PL at T4. Similarly, decreases in mean power were noted for ACC at both T4 and T5, but no change was observed for PL. MBI analysis (see Table 2) indicated that the change in repetitions performed was possibly beneficial for ACC compared to PL at T4 and likely beneficial at T5. Similarly, MBI analysis on changes in peak power between ACC and PL indicated that ACC was possibly beneficial for changes in peak power at T4, but it was unclear at T5. This analysis also indicated that ACC supplementation was possibly negative and likely negative for changes in mean power at T4 and T5, respectively.
Results for subjective measures of soreness, both general and upper body, are also depicted in Table 1. Significant main effects for time were noted for both general soreness (F = 5.703, p = 0.006) and soreness specific for the upper body (F = 26.287, p =< 0.001). No significant interaction was noted in general soreness (F = 0.809, p = 0.452), but a trend toward an interaction was observed in upper body soreness (F = 2.551, p = 0.089). The mean percent change scores (see Figure 2) revealed significant changes from PRE in general soreness for ACC at T4 only, while significant increases in soreness were noted for PL at both T4 and T5. Examination of the CIs for general soreness at T5 and upper body soreness at T4 and T5 clearly show a separation in the change score suggesting a significant difference between the groups. MBI analysis (see Table 2) indicated that ACC was unclear for reducing general body soreness at T4 and at T5. However, when examining the effects of ACC on reducing specifically upper body soreness, results indicated that ACC was very likely (97.4%) or likely beneficial at T4 and T5, respectively.
Changes in cytokine concentrations are depicted in Figure 3a–c. Significant main effects for time were observed in IL-6 (F = 4.058, p = 0.017) and IL-10 (F = 4.128, p = 0.048) but not TNFα (F =2.025, p = 0.138). With both groups combined, significant elevations in IL-6 concentrations were noted from PRE at POST (p = 0.005), T4 (p = 0.019), and T5 (p = 0.004), while significant elevations were noted in IL-10 concentrations from PRE at T4 (p = 0.022) and T5 (p = 0.046). No significant interactions were noted between ACC and PL in circulating concentrations of IL-6 (F = 0.201, p = 0.859), IL-10 (F = 0.103, p = 0.786), or TNFα (F =1.705, p = 0.190). Mean percent change scores (see Figure 4) indicated significant elevations in percent change for IL-6 concentrations from PRE at POST and T5 for both ACC and PL but only for ACC at T4. Examination of percent changes in IL-10 concentrations resulted in a significant decrease in IL-10 from PRE to POST for PL only, where a significant elevation was noted at T4 for ACC only. Significant elevations in percent changes were noted for both ACC and PL at T5. MBI analyses for the changes in cytokine concentrations from PRE (see Table 3) revealed that differences between ACC and PL in the IL-6 response were unclear for all time comparisons. Changes from PRE in IL-10 concentrations was likely beneficial for ACC compared to PL at POST. The benefits of ACC supplementation on changes in IL-10 concentrations at T4 and T5 were unclear. ACC supplementation appeared to be likely negative, possibly negative, and likely negative for changes in TNFα concentrations at POST, T4, and T5, respectively.
Results for changes in creatine kinase concentrations can be observed in Figure 5a. A significant main effect for time (F = 5.580, p = 0.007) was seen, but no significant interaction was noted between the groups (F = 1.914, p = 0.160). Mean percent change scores (see Figure 5b) showed significant differences between T3 and T4 for ACC only, but for both ACC and PL between T3 and T5. MBI analysis (see Table 3) indicated that the change from T3 at T4 was very likely negative for ACC and unclear at T5.

4. Discussion

The aim of this study was to determine whether 3 weeks of ACC supplementation can enhance recovery from consecutive days of resistance training. The results from the performance measures, subjective feelings of soreness and blood markers of muscle damage and inflammation, appear to be inconclusive. Parametric analysis was unable to provide traditional statistical support regarding ACC supplementation and enhanced recovery. However, complementary analyses using confidential intervals and inferential analysis were suggestive of possible and likely benefits in performance improvements in consecutive days of exercise in participants consuming ACC. Furthermore, confidence interval examination of percent change scores indicated that the differences in soreness between the groups was significant. More specifically, participants in ACC had less soreness in the upper body than PL at both T4 and T5, which was supported by inferential analysis showing that ACC was very likely and likely beneficial at T4 and T5, respectively. Changes in the cytokine and CK-M measures though were not suggestive of any clear benefit for ACC supplementation on reducing inflammation or muscle damage.
Calcium supplementation has generally not been associated with being ergogenic [1]. However, the greater absorbability and stability of amorphous calcium stimulated the curiosity that this specific calcium supplement can increase the likelihood of an ergogenic effect. Considering that most of the body’s calcium is stored in bone [32], its role in muscle performance is not well-understood. During high volume activity in which calcium levels may fall, athletes may be at greater risk for fractures, which has been shown to be reversed with calcium supplementation [33]. Although the inferential analysis performed in this study suggested that ACC supplementation may be possibly or likely beneficial for attenuating performance decrements, the mechanism that underlies this response is not clear. We believe that the difference in the number of repetitions performed at T4 (35%) and T5 (55%) between ACC and PL is likely related to the carbonate component of the supplement. Carbonate has a known ergogenic effect by buffering increases in hydrogen ions produced during high-intensity exercise [34]. Previous research had demonstrated a greater number of repetitions performed in the back squat but not the bench press exercise following an acute ingestion of sodium bicarbonate [35]. Although participants in the present study supplemented for 3 weeks, they were also instructed to consume a dose 30 min prior to each exercise bout. Thus, it is not clear whether the benefits associated from this study were related to the prolonged supplementation schedule or the acute dose provided prior to the exercise protocol.
Supplementation with ACC appeared to result in a negative response for mean power. This was likely related to the greater number of repetitions performed by ACC. Considering that the carbonate component may have increased resiliency to the fatiguing nature of the exercise, the additional repetitions performed resulted in a lower mean power output leading to the appearance of negative effect. This is supported by recent research that indicated a dose–response effect between repetitions performed and power output [36]. When examining the peak power performance, inferential analysis suggested that ACC supplementation provided a possible benefit at T4.
The reduced soreness ratings specific to the upper body suggested that ACC supplementation likely or very likely provided a benefit. This was noted in both the MBI analysis as well as the 95% CI measurements. The mechanism associated with this finding, however, can only be speculative. However, pain perception during or following exercise is thought to be a result in part to increases in proton concentrations [37]. It is possible that the carbonate molecule may have reduced upper body muscle soreness due to its buffering effect. Previous research has reported that an increase in membrane permeability from exercise-induced muscle damage results in a disruption to the transverse tubule (T-tubule) system impacting excitation–contraction coupling [38]. Damage to the T-tubule system directly impacts the sarcoplasmic reticulum, storage site of calcium, resulting in uncontrolled calcium entry into the sarcoplasm and a fall in active tension [39]. Elevations in intracellular calcium have also been demonstrated to activate the calpain proteolytic pathway, resulting in the enzymatic degradation of cytoskeletal proteins [38,40]. This is not a mechanism for reducing muscle soreness, and whether exogenous calcium intake can reverse this process has not been examined. One case study examining the effect of exogenous calcium ingestion in a patient with sporadic idiopathic hypoparathyroidism reported that calcium supplementation was able to reverse impaired nerve conduction velocity [41]. However, these findings have not been confirmed by any other study. Improvements in muscle strength have been reported from a 6-month study examining the effect of combined calcium and vitamin D administration in vitamin D-deficient individuals [42]. However, the investigators were unable to differentiate the individual effects of calcium from vitamin D (i.e., cholecalciferol). Regardless, other studies have failed to provide any evidence that the combination of calcium and cholecalciferol is effective at increasing muscle strength [43,44].
The CK-M and cytokine responses were consistent with other investigations using a similar exercise protocol [18,19,45]. The significant elevations in CK-M at both T4 and T5 in both groups reflect the damage resulting from the exercise protocol. Interestingly, inferential analysis suggested that ACC supplementation was associated with a likely negative effect at T4. This may be related to the greater number of repetitions performed at that time point. Previous research examining the effect of a nutritional intervention on recovery have reported total CK levels being significantly attenuated [18]. This was not seen in the present study, suggesting that ACC supplementation did not reduce the magnitude of muscle damage. This was consistent with the IL-6 and IL-10 responses, in which no between-group differences were noted in any of the cytokine measures. IL-6 has both pro-and anti-inflammatory roles [46]. Elevations in IL-6 are reported to stimulate the anti-inflammatory cytokine IL-10 [47] and inhibit the production of TNFα [48]. Inferential analysis suggested a benefit from ACC supplementation from PRE to POST at T3 for changes in IL-10 concentrations. However, the unclear effects observed at T4 and T5 question the veracity of that response. Furthermore, the negative effects observed in TNFα from ACC supplementation provide further doubt regarding the supplement’s recovery benefits.
The exercise protocol used in this present study did elicit significant declines in performance and significant elevations in muscle soreness, damage, and inflammation. The ACC intervention did appear to provide some benefit toward attenuating the performance and soreness changes. However, there were several limitations associated with this study. The statistical power of this study may not have been adequate. Unfortunately, there were no previous studies available that examined this specific dietary supplement to provide the necessary information to determine appropriate participant number. The research team instead used previous studies that examined a similar research protocol with a nutrient intervention [17,18]. In addition, this study used a single exercise protocol. Previous research examining a calcium supplement reported increases in lower body but not upper body exercise [34]. Differences in performance outcomes between different exercises are likely related to differences in exercise-specific training experience and technique versus a physiological effect. There is no evidence available demonstrating that calcium supplementation can impact lower body differently that upper body musculature. In conclusion, the results of this study suggest that the attenuation in performance decline and soreness was most probably due to the carbonate component of the supplement.

Author Contributions

Conceptualization, methodology and analysis, J.R.H.; formal analysis, A.Z. and T.B.-Z.; investigation, T.B.-Z., A.Z., C.L., I.O.; resources, J.R.H.; data curation, T.B.-Z., A.Z., C.L, I.O.; writing—original draft preparation, J.R.H.; writing—review and editing, T.B.-Z., A.Z., I.O.; supervision, J.R.H. and I.O.; project administration, J.R.H.; funding acquisition, J.R.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Amorphical, LTD, Ness Ziona, Israel.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board of Ariel University (protocol code AU-HEA-JH-20210603 on 3 June 2021).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Arroyo, E.; Jajtner, A.R. Vitamins and Minerals. In Dietary Supplementation in Sport and Exercise; Hoffman, J.R., Ed.; Routledge: New York, NY, USA, 2019; pp. 22–46. [Google Scholar]
  2. Harvey, N.C.; Biver, E.; Kaufman, J.M.; Bauer, J.; Branco, J.; Brandi, M.L.; Cooper, C. The role of calcium supplementation in healthy musculoskeletal ageing: An expert consensus meeting of the European Society for Clinical and Economic Aspects of Osteoporosis, Osteoarthritis and Musculoskeletal Diseases (ESCEO) and the International Foundation for Osteoporosis (IOF). Osteoporos. Int. 2017, 28, 447–462. [Google Scholar] [PubMed] [Green Version]
  3. Chandran, M.; Tay, D.; Mithal, A. Supplemental calcium intake in the aging individual: Implications on skeletal and cardiovascular health. Aging Clin. Exp. Res. 2019, 31, 765–781. [Google Scholar] [CrossRef] [PubMed]
  4. Weaver, C.M.; Alexander, D.D.; Boushey, C.J.; Dawson-Hughes, B.; Lappe, J.M.; LeBoff, M.S.; Looker, A.C.; Wallace, T.C.; Wang, D.D. Calcium plus vitamin D supplementation and risk of fractures: An updated meta-analysis from the National Osteoporosis Foundation. Osteoporos. Int. 2016, 27, 367–376. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Bischoff-Ferrari, H.A.; Dawson-Hughes, B.; Baron, J.A.; Burckhardt, P.; Li, R.; Spiegelman, D.; Willett, W.C. Calcium intake and hip fracture risk in men and women: A meta-analysis of prospective cohort studies and randomized controlled trials. Am. J. Clin. Nutr. 2007, 86, 1780–1790. [Google Scholar] [CrossRef]
  6. Bolland, M.J.; Leung, W.; Tai, V.; Bastin, S.; Gamble, G.D.; Grey, A.; Reid, I.R. Calcium intake and risk of fracture: Systematic review. BMJ 2015, 351, h4580. [Google Scholar] [CrossRef] [Green Version]
  7. Tang, B.M.; Eslick, G.D.; Nowson, C.; Smith, C.; Bensoussan, A. Use of calcium or calcium in combination with vitamin D supplementation to prevent fractures and bone loss in people aged 50 years and older: A meta-analysis. Lancet 2007, 370, 657–666. [Google Scholar] [CrossRef]
  8. Meiron, O.E.; Bar-David, E.; Aflalo, E.D.; Shechter, A.; Stepensky, D.; Berman, A.; Sagi, A. Solubility and bioavailability of stabilized amorphous calcium carbonate. J. Bone Miner. Res. 2011, 26, 364–372. [Google Scholar] [CrossRef]
  9. Straub, D.A. Calcium supplementation in clinical practice: A review of forms, doses, and indications. Nutr. Clin. Pract. 2007, 22, 286–296. [Google Scholar] [CrossRef]
  10. Heaney, R.P.; Dowell, M.S.; Bierman, J.; Hale, C.A.; Bendich, A. Absorbability and cost effectiveness in calcium supplementation. J. Am. Coll. Nutr. 2001, 20, 239–246. [Google Scholar] [CrossRef]
  11. Nebel, H.; Neumann, M.; Mayer, C.; Epple, M. On the structure of amorphous calcium carbonate--a detailed study by solid-state NMR spectroscopy. Inorg. Chem. 2008, 47, 7874–7879. [Google Scholar] [CrossRef]
  12. Gal, J.Y.; Bollinger, J.C.; Tolosa, H.; Gache, N. Calcium carbonate solubility: A reappraisal of scale formation and inhibition. Talanta 1996, 43, 1497–1509. [Google Scholar] [CrossRef]
  13. Shechter, A.; Berman, A.; Singer, A.; Freiman, A.; Grinstein, M.; Erez, J.; Sagi, A. Reciprocal changes in calcification of the gastrolith and cuticle during the molt cycle of the red claw crayfish Cherax quadricarinatus. Biol. Bull. 2008, 214, 122–134. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Shaltiel, G.; Bar-David, E.; Meiron, O.E.; Waltman, E.; Shechter, A.; Aflalo, E.D.; Sagi, A. Bone loss prevention in ovariectomized rats using stable amorphous calcium carbonate. Health 2013, 5, 18–29. [Google Scholar] [CrossRef] [Green Version]
  15. Vaisman, N.; Shaltiel, G.; Daniely, M.; Meiron, O.E.; Shechter, A.; Abrams, S.A.; Sagi, A. Increased calcium absorption from synthetic stable amorphous calcium carbonate: Double-blind randomized crossover clinical trial in postmenopausal women. J. Bone Miner. Res. 2014, 29, 2203–2209. [Google Scholar] [CrossRef] [Green Version]
  16. Markus, I.; Constantini, K.; Hoffman, J.R.; Bartolomei, S.; Gepner, Y. Exercise-induced muscle damage: Mechanism assessment nutritional factors to accelerate recovery. Eur. J. Appl. Physiol. 2021, 121, 969–992. [Google Scholar] [CrossRef]
  17. Hoffman, J.R. Physiological Aspects of Sport Training and Performance; Human Kinetics: Champaign, IL, USA, 2014. [Google Scholar]
  18. Hoffman, J.R.; Ratamess, N.A.; Tranchina, C.P.; Rashti, S.L.; Kang, J.; Faigenbaum, A.D. Effect of a proprietary protein supplement on recovery indices following resistance exercise in strength/power athletes. Amino Acids. 2010, 38, 771–778. [Google Scholar] [CrossRef]
  19. Jajtner, A.R.; Hoffman, J.R.; Gonzalez, A.M.; Worts, P.R.; Fragala, M.S.; Stout, J.R. Comparison of the effects of electrical stimulation and cold-water immersion on muscle soreness after resistance exercise. J. Sport Rehabil. 2015, 24, 99–108. [Google Scholar] [CrossRef] [Green Version]
  20. Hoffman, J.R. Norms for Fitness, Performance and Health; Human Kinetics: Champaign, IL, USA, 2006. [Google Scholar]
  21. Hoffman, J.R.; Ratamess, N.A.; Tranchina, C.P.; Rashti, S.L.; Kang, J.; Faigenbaum, A.D. Effect of protein-supplement timing on strength, power, and body composition changes in resistance-trained men. Int. J. Sport Nutr. Exerc. Metab. 2009, 19, 172–185. [Google Scholar] [CrossRef]
  22. Lee, K.A.; Hicks, G.; Nino-Murcia, G. Validity and reliability of a scale to assess fatigue. Psychiatry Res. 1991, 36, 291–298. [Google Scholar] [CrossRef]
  23. Hoffman, J.R.; Gepner, Y.; Stout, J.R.; Hoffman, M.W.; Ben-Dov, D.; Funk, S.; Ostfeld, I. β-Hydroxy-β-methylbutyrate attenuates cytokine response during sustained military training. Nutr. Res. 2016, 36, 553–563. [Google Scholar] [CrossRef]
  24. Townsend, J.R.; Fragala, M.S.; Jajtner, A.R.; Gonzalez, A.M.; Wells, A.J.; Mangine, G.T.; Hoffman, J.R. β-Hydroxy-β-methylbutyrate (HMB)-free acid attenuates circulating TNF-α and TNFR1 expression postresistance exercise. J. Appl. Physiol. 2013, 115, 1173–1182. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Fethney, J. Statistical and clinical significance, and how to use confidence intervals to help interpret both. Aust. Crit. Care 2010, 23, 93–97. [Google Scholar] [CrossRef] [PubMed]
  26. Guyatt, G.; Jaeschke, R.; Heddle, N.; Cook, D.; Shannon, H.; Walter, S. Basic statistics for clinicians: 2. Interpreting study results: Confidence intervals. Can. Med. Assoc. J. 1995, 152, 169–173. [Google Scholar]
  27. Frost, J. Hypothesis Testing: An Intuitive Guide for Making Data Driven Decisions; Statistics Jim Publishing: State College, PA, USA, 2020. [Google Scholar]
  28. Buchheit, M. The numbers will love you back in return-I promise. Int. J. Sports Physiol. Perform. 2016, 11, 551–554. [Google Scholar] [CrossRef] [PubMed]
  29. Batterham, A.M.; Hopkins, W.G. Making meaningful inferences about magnitudes. Int. J. Sports Physiol. Perform. 2006, 1, 50–57. [Google Scholar] [CrossRef] [PubMed]
  30. Hopkins, W.G.; Marshall, S.W.; Batterham, A.M.; Hanin, J. Progressive statistics for studies in sports medicine and exercise science. Med. Sci. Sports Exerc. 2009, 41, 3–12. [Google Scholar] [CrossRef] [Green Version]
  31. Hopkins, W.G. A spreadsheet for deriving a confidence interval, mechanistic inference, and clinical inference from a p-value. Sportscience 2007, 11, 16–21. [Google Scholar]
  32. Peacock, M. Calcium metabolism in health and disease. Clin. J. Am. Soc. Nephrol. 2010, 5 (Suppl. 1), S23–S30. [Google Scholar] [CrossRef] [Green Version]
  33. Lappe, J.; Cullen, D.; Haynatzki, G.; Recker, R.; Ahlf, R.; Thompson, K. Calcium and vitamin d supplementation decreases incidence of stress fractures in female navy recruits. J. Bone Miner. Res. 2008, 23, 741–749. [Google Scholar] [CrossRef]
  34. McNaughton, L.R.; Gough, L.; Deb, S.; Bentley, D.; Sparks, S.A. Recent Developments in the Use of Sodium Bicarbonate as an Ergogenic Aid. Curr. Sports Med. Rep. 2016, 15, 233–244. [Google Scholar] [CrossRef]
  35. Duncan, M.J.; Weldon, A.; Price, M.J. The effect of sodium bicarbonate ingestion on back squat and bench press exercise to failure. J. Strength Cond. Res. 2014, 28, 1358–1366. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Dos Santos, W.D.N.; Vieira, C.A.; Bottaro, M.; Nunes, V.A.; Ramirez-Campillo, R.; Steele, J.; James, P.F.; Gentil, P. Resistance Training Performed to Failure or Not to Failure Results in Similar Total Volume, but With Different Fatigue and Discomfort Levels. J. Strength Cond. Res. 2021, 35, 1372–1379. [Google Scholar] [CrossRef] [PubMed]
  37. Miles, M.P.; Clarkson, P.M. Exercise-induced muscle pain, soreness, and cramps. J. Sports Med. Phys. Fitness 1994, 34, 203–216. [Google Scholar] [PubMed]
  38. Stožer, A.; Vodopivc, P.; Križančić Bombek, L. Pathophysiology of exercise-induced muscle damage and its structural, functional, metabolic, and clinical consequences. Physiol. Res. 2020, 69, 565–598. [Google Scholar] [CrossRef] [PubMed]
  39. Allen, D.G.; Whitehead, N.P.; Yeung, E.W. Mechanisms of stretch-induced muscle damage in normal and dystrophic muscle: Role of ionic changes. J. Physiol. 2005, 567 Pt 3, 723–735. [Google Scholar] [CrossRef] [PubMed]
  40. Goll, D.E.; Thompson, V.F.; Li, H.; Wei, W.; Cong, J. The calpain system. Physiol. Rev. 2003, 83, 731–801. [Google Scholar] [CrossRef]
  41. Goswami, R.; Vatsa, M.; Sreenivas, V.; Singh, U.; Gupta, N.; Lakshmy, R.; Bhatia, H. Skeletal muscle strength in young Asian Indian females after vitamin D and calcium supplementation: A double-blind randomized controlled clinical trial. J. Clin. Endocrinol. Metab. 2012, 97, 4709–4716. [Google Scholar] [CrossRef] [Green Version]
  42. Gupta, R.; Sharma, U.; Gupta, N.; Kalaivani, M.; Singh, U.; Guleria, R.; Jagannathan, N.R.; Goswami, R. Effect of cholecalciferol and calcium supplementation on muscle strength and energy metabolism in vitamin D-deficient Asian Indians: A randomized, controlled trial. Clin. Endocrinol. 2010, 73, 445–451. [Google Scholar] [CrossRef]
  43. Goswami, R.; Bhatia, M.; Goyal, R.; Kochupillai, N. Reversible peripheral neuropathy in idiopathic hypoparathyroidism. Acta Neurol. Scand. 2002, 105, 128–131. [Google Scholar] [CrossRef]
  44. Saha, S.; Goswami, R.; Ramakrishnan, L.; Vishnubhatla, S.; Mahtab, S.; Kar, P.; Srinivasan, S.; Singh, N.; Singh, U. Vitamin D and calcium supplementation, skeletal muscle strength and serum testosterone in young healthy adult males: Randomized control trial. Clin. Endocrinol. 2018, 88, 217–226. [Google Scholar] [CrossRef]
  45. Gordon, J.A., III; Hoffman, J.R.; Arroyo, E.; Varanoske, A.N.; Coker, N.A.; Gepner, Y.; Wells, A.J.; Stout, J.R.; Fukuda, D.H. Comparisons in the Recovery Response From Resistance Exercise Between Young and Middle-Aged Men. J. Strength Cond. Res. 2017, 31, 3454–3462. [Google Scholar] [CrossRef] [PubMed]
  46. Fischer, C.P. Interleukin-6 in acute exercise and training: What is the biological relevance? Exerc. Immunol. Rev. 2006, 12, 6–33. [Google Scholar] [PubMed]
  47. Reikerås, O. Immune depression in musculoskeletal trauma. Inflamm. Res. 2010, 59, 409–414. [Google Scholar] [CrossRef] [PubMed]
  48. Xing, Z.; Gauldie, J.; Cox, G.; Baumann, H.; Jordana, M.; Lei, X.F.; Achong, M.K. IL-6 is an antiinflammatory cytokine required for controlling local or systemic acute inflammatory responses. J. Clin. Investig. 1998, 101, 311–320. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Mean percent change scores ± 95% confidential intervals (CI) for performance valuables. Black circles indicate amorphous calcium carbonate group; white circles represent placebo group. * Indicates a significant difference when 0 is outside of the 95% CI.
Figure 1. Mean percent change scores ± 95% confidential intervals (CI) for performance valuables. Black circles indicate amorphous calcium carbonate group; white circles represent placebo group. * Indicates a significant difference when 0 is outside of the 95% CI.
Nutrients 14 01894 g001
Figure 2. Mean percent change scores ± 95% confidential intervals (CI) for soreness ratings. Black circles indicate amorphous calcium carbonate group; white circles represent placebo group. * Indicates a significant difference when 0 is outside of the 95% CI.
Figure 2. Mean percent change scores ± 95% confidential intervals (CI) for soreness ratings. Black circles indicate amorphous calcium carbonate group; white circles represent placebo group. * Indicates a significant difference when 0 is outside of the 95% CI.
Nutrients 14 01894 g002
Figure 3. Cytokine response to the exercise protocol: (a): IL-6; (b): IL-10; (c): TNFα. All data are presented as mean ± SD. IL-6 = interleukin-6; IL-10 = interleukin-10; TNFα = Tumor necrosis factor alpha; * = significant main effect for both groups combined versus PRE.
Figure 3. Cytokine response to the exercise protocol: (a): IL-6; (b): IL-10; (c): TNFα. All data are presented as mean ± SD. IL-6 = interleukin-6; IL-10 = interleukin-10; TNFα = Tumor necrosis factor alpha; * = significant main effect for both groups combined versus PRE.
Nutrients 14 01894 g003
Figure 4. Mean percent change scores ± 95% confidential intervals (CI) for IL-6 and IL-10 responses. Black circles indicate amorphous calcium carbonate group; white circles represent placebo group. * Indicates a significant difference when 0 is outside of the 95% CI.
Figure 4. Mean percent change scores ± 95% confidential intervals (CI) for IL-6 and IL-10 responses. Black circles indicate amorphous calcium carbonate group; white circles represent placebo group. * Indicates a significant difference when 0 is outside of the 95% CI.
Nutrients 14 01894 g004
Figure 5. (a): Creatine kinase-muscle (CK-M) response to the exercise protocol; (b): Mean percent change scores ± 95% confidential intervals (CI) for CK-M response. Black circles indicate amorphous calcium carbonate group; white circles represent placebo group. * Indicates a significant difference when 0 is outside of the 95% CI.
Figure 5. (a): Creatine kinase-muscle (CK-M) response to the exercise protocol; (b): Mean percent change scores ± 95% confidential intervals (CI) for CK-M response. Black circles indicate amorphous calcium carbonate group; white circles represent placebo group. * Indicates a significant difference when 0 is outside of the 95% CI.
Nutrients 14 01894 g005
Table 1. Performance and Subjective Measures of Soreness at All Testing Sessions.
Table 1. Performance and Subjective Measures of Soreness at All Testing Sessions.
VariableGroupT3T4T5
Repetitions Performed (#)ACC26.7 ± 5.722.2 ± 7.322.0 ± 7.4
PL27.6 ± 9.020.7 ± 9.018.9 ± 10.1
Peak Power (w)ACC323 ± 51297 ± 48285 ± 44
PL366 ± 86322 ± 95333 ± 103
Mean Power (w)ACC207 ± 39187 ± 29174 ± 24
PL230 ± 53222 ± 59219 ± 70
VAS—General body soreness (cm)ACC3.8 ± 3.84.4 ± 3.55.1 ± 3.9
PL2.0 ± 2.53.6 ± 2.84.8 ± 3.4
VAS—Upper body soreness (cm)ACC2.3 ± 2.54.8 ± 3.16.1 ± 4.7
PL1.3 ± 1.37.0 ± 3.97.3 ± 3.7
ACC = Amorphous calcium carbonate; PL = Placebo; VAS = Visual analogue scale; # = Number of repetitions performed; w = Watts. Data are reported as mean ± SD.
Table 2. Magnitude-Based Inferences on Change Scores in Performance and Subjective Soreness Variables.
Table 2. Magnitude-Based Inferences on Change Scores in Performance and Subjective Soreness Variables.
VariableTimeACCPLMean Difference% Positive% Trivial% NegativeInterpretation
Percent Chance Greater
Repetitions Performed (#)ΔT4−4.5 ± 4.6−6.9 ± 5.82.4 ± 4.167.429.43.2Possibly Beneficial
ΔT5−4.7 ± 4.7−8.6 ± 7.33.9 ± 4.784.813.81.4Likely Beneficial
Peak Power (w)ΔT4−23.0 ± 34.4 −38.2 ± 47.715.0 ± 34.051.644.44.0Possibly Beneficial
ΔT5−32.2 ± 33.9−28.3 ± 65.1−3.9 ± 42.018.551.330.2Unclear
Mean Power (w)ΔT4−21.2 ± 24.2−4.6 ± 34.8−17.0 ± 24.01.825.572.6Possibly Negative
ΔT5−31.6 ± 24.1−6.5 ± 39.4−25.0 ± 26.00.611.088.3Likely Negative
VAS—General Soreness (cm)ΔT40.6 ± 3.71.6 ± 2.2−1.0 ± 2.661.229.09.8Unclear
ΔT51.3 ± 3.42.8 ± 2.9−1.5 ± 2.674.920.15.0Unclear
VAS—Upper Body Soreness (cm)ΔT42.7 ± 3.56.3 ± 3.9−3.6 ± 3.297.41.70.8Very Likely Beneficial
ΔT54.0 ± 4.36.6 ± 3.2−2.6 ± 3.390.95.63.5Likely Beneficial
ACC = Amorphous calcium carbonate; PL = Placebo; VAS = Visual analogue scale; # = Number of repetitions performed; w = Watts. Data are reported as mean ± SD.
Table 3. Magnitude-Based Inferences on Change Scores in Cytokine Concentrations.
Table 3. Magnitude-Based Inferences on Change Scores in Cytokine Concentrations.
VariableTimeACCPLMean Difference% Positive% Trivial% NegativeInterpretation
Percent Chance Greater
IL-6
(pg·mL−1)
Δ POST − PRE0.77 ± 0.781.09 ± 1.95−0.32 ± 1.454.225.620.2Unclear
Δ T4 − PRE0.62 ± 1.340.8 ± 1.31−0.18 ± 1.245.132.322.6Unclear
Δ T5 − PRE1.02 ± 1.721.02 ± 1.560.18 ± 1.427.126.846.0Unclear
IL-10
(pg·mL−1)
Δ POST − PRE1.36 ± 4.42−1.41 ± 2.72.80 ± 3.189.09.71.3Likely Beneficial
Δ T4 − PRE3.76 ± 7.592.12 ± 3.151.6 ± 5.062.722.015.3Unclear
Δ T5 − PRE8.81 ± 14.688.58 ± 23.320.23 ± 17.046.98.444.7Unclear
TNFα
(pg·mL−1)
Δ POST − PRE11.0 ± 24.4−7.4 ± 18.918 ± 201.010.089.0Likely Negative
Δ T4 − PRE9.8 ± 26.11.0 ± 14.98.8 ± 206.932.560.6Possibly Negative
Δ T5 − PRE16.4 ± 27.93.0 ± 14.913 ± 213.520.775.9Likely Negative
CK-M (pg·mL−1)Δ T4 − T3968 ± 116912 ± 1258960 ± 11001.28.590.2Very Likely Negative
Δ T5 − T3942 ± 1702908 ± 165933 ± 150033.329.936.8Unclear
ACC = Amorphous calcium carbonate; PL = Placebo; IL-6 = Interluekin-6; IL-10 = Interleukin-10; TNFα = Tumor necrosis factor α; CK-M = Creatine kinase muscle. Data are reported as mean ± SD.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Hoffman, J.R.; Ben-Zeev, T.; Zamir, A.; Levi, C.; Ostfeld, I. Examination of Amorphous Calcium Carbonate on the Inflammatory and Muscle Damage Response in Experienced Resistance Trained Individuals. Nutrients 2022, 14, 1894. https://doi.org/10.3390/nu14091894

AMA Style

Hoffman JR, Ben-Zeev T, Zamir A, Levi C, Ostfeld I. Examination of Amorphous Calcium Carbonate on the Inflammatory and Muscle Damage Response in Experienced Resistance Trained Individuals. Nutrients. 2022; 14(9):1894. https://doi.org/10.3390/nu14091894

Chicago/Turabian Style

Hoffman, Jay R., Tavor Ben-Zeev, Amit Zamir, Chagai Levi, and Ishay Ostfeld. 2022. "Examination of Amorphous Calcium Carbonate on the Inflammatory and Muscle Damage Response in Experienced Resistance Trained Individuals" Nutrients 14, no. 9: 1894. https://doi.org/10.3390/nu14091894

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop