Next Article in Journal
Exploring the Antimycobacterial Potential of Podocarpusflavone A from Kielmeyera membranacea: In Vitro and In Vivo Insights
Previous Article in Journal
Network Pharmacology and Molecular Docking Reveal Anti-Asthmatic Potential of Zephyranthes rosea Lindl. in an Ovalbumin-Induced Asthma Model
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Pharmacological Evaluation of the Traditional Brazilian Medicinal Plant Monteverdia ilicifolia in Gastroesophageal Reflux Disease: Preliminary Results of a Randomized Double-Blind Controlled Clinical Trial

by
Maitê Scherer da Silva
1,
Rebeca Vargas Antunes Schunck
2,
Maicon Pereira Moraes
2,
Giana Blume Corssac
1,2,
Gabriela Meirelles
2,3,
Sara Elis Bianchi
2,3,
Leonardo Vieira Targa
4,
Valquiria Bassani
3,5,
Marcelo Rodrigues Gonçalves
6,
Caroline Dani
1,2 and
Ionara Rodrigues Siqueira
1,2,*
1
Programa de Pós-Graduação em Ciências Biológicas—Farmacologia e Terapêutica, Universidade Federal do Rio Grande do Sul, Porto Alegre 90050170, RS, Brazil
2
Departamento de Farmacologia, Instituto de Ciências Básicas da Saúde, Universidade Federal do Rio Grande do Sul, Porto Alegre 90050170, RS, Brazil
3
Laboratório de Desenvolvimento Galênico, Faculdade de Farmácia, Universidade Federal do Rio Grande do Sul, Porto Alegre 90610-000, RS, Brazil
4
Curso de Medicina, Universidade de Caxias do Sul, Caxias do Sul 95070-560, RS, Brazil
5
Programa de Pós-Graduação em Ciências Farmacêuticas, Universidade Federal do Rio Grande do Sul, Porto Alegre 90160-093, RS, Brazil
6
Departamento de Medicina Social, Faculdade de Medicina, Universidade Federal do Rio Grande do Sul, Porto Alegre 90035-003, RS, Brazil
*
Author to whom correspondence should be addressed.
Pharmaceuticals 2024, 17(11), 1559; https://doi.org/10.3390/ph17111559
Submission received: 18 September 2024 / Revised: 5 November 2024 / Accepted: 11 November 2024 / Published: 20 November 2024

Abstract

:
Background/Objectives: The present work aimed to compare the effects of the standardized dry extract from the leaves of Monteverdia ilicifolia, popularly known as “espinheira-santa”, with omeprazole in the management of dyspepsia related to gastroesophageal reflux disease (GERD). Methods: A double-blind, randomized, non-inferiority and double-dummy clinical trial was conducted. In total, 86 patients with GERD symptoms were randomized into three groups: Omeprazol (20 mg), M. ilicifolia (400 mg), or M. ilicifolia (860 mg). Capsules were provided by SUSTENTEC®, Pato Bragato, Brazil. It was requested that the participants take three capsules before breakfast and dinner for 4 weeks. Clinical outcomes were obtained at the beginning and end of the study, with GERD symptoms (QS-GERD), the impact of heartburn symptoms on quality of life (HBQOL), and medical records. Results: Overall, 75.6% of the participants showed adherence without any differences among the experimental groups. All groups had significant reductions in both QS-GERD and HBQOL scores. Omeprazole and 400 and 860 mg of M. ilicifolia decreased the QS-GERD total scores at the endpoint compared to the baseline (Chi-square = 129.808; p < 0.0001), as well as individual item scores, such as heartburn intensity (Chi-square = 93.568, p < 0.0001) and heartburn after meals (Chi-square = 126.426, p < 0.0001). There were no differences among the experimental groups after the intervention. Conclusions: Our results suggest that capsules with a standardized dry extract from the leaves of M. ilicifolia at a dosage of 400 or 860 mg are non-inferior to omeprazole, a proton pump inhibitor.

Graphical Abstract

1. Introduction

Gastroesophageal reflux disease (GERD) is highly prevalent in Western countries. In the USA and Europe, almost 20% of adults are affected by GERD, while in Brazil, the prevalence is estimated to be 12% [1]. Beyond the impact of its clinical symptoms, such as heartburn, acid regurgitation, and epigastric pain, GERD impacts the quality of life and well-being of patients. In this context, proton pump inhibitors (PPIs) are widely prescribed, representing the main pharmacological management to minimize GERD effects [2]. However, PPI-induced short- and long-term side effects have raised several concerns, and consequently, new and innovative pharmacological treatments for GERD must be studied [3]. Recently, several medicinal plants have been evaluated for their gastroprotective effects on GERD, including clinical trials [4,5].
In this context, the Brazilian native plant Monteverdia ilicifolia Mart. ex Reissek. Biral (basionym: M. ilicifolia Mart ex Reissek, Celastraceae), popularly known as “espinheira santa”, has had extensive traditional use in Brazil [6]. Infusions or decoctions are prepared with dry leaves to manage mainly gastrointestinal diseases [7,8]. This species is described in the Brazilian Pharmacopoeia and listed in the National List of Essential Medicines (RENAME) published by the Unified Health System (“Sistema Único de Saúde”, SUS), which contains 12 medicinal herbs [9,10].
Several preclinical studies have indicated the gastroprotective properties of the oral and intraperitoneal administration of water, hexane, and ethyl acetate M. ilicifolia extracts in rodent models [11,12,13,14]. The gastroprotective actions of M. ilicifolia have been attributed to several phytochemicals, such as phenolic compounds, polysaccharides, and terpenoids [7,15]. Several preclinical studies support the idea that M. ilicifolia compounds have multitarget actions that exert different cellular and molecular gastroprotective mechanisms. An important study reported that the dry aqueous extract of M. ilicifolia reduced ulceration induced by stress (cold and restraint), with an increase in pH in the gastric contents [16,17]. Interestingly, the intraperitoneal administration of a flavonoid-rich extract of M. ilicifolia reduced the gastric lesions induced by ethanol, indomethacin, and acetic acid in rats [18] bringing evidence on the mechanism of action, specifically the antisecretory effects of this extract [18]. In addition, isolated polysaccharides demonstrated a gastroprotective effect in an ethanol-induced gastric damage model [7,19]. These authors suggested that those active polysaccharides of M. ilicifolia could act as a mucosal barrier agent [7,19].
In addition to the efficacy approach in the treatment of gastric diseases, the safety of M. ilicifolia has raised attention using toxicological studies. The acute and chronic (for 180 days) administration of M. ilicifolia leaf aqueous extract did not induce any toxicological effects in rats, mice, or beagle dogs [17] However, a phase I clinical trial showed that this extract, with weekly increment doses of 100 mg up to 2000 mg, was safe and well tolerated [16]. Recently, our group raised in vitro findings of a potential hepatotoxicity [18]. These results were considered to be the eligibility criteria in our project, which was designed to evaluate the efficacy, quality, and safety of M. ilicifolia capsules.
Taken together, our aim is to compare the effects of the standardized dry extract from the leaves of M. ilicifolia with a proton pump inhibitor in a double-blind, randomized, non-inferiority and double-dummy clinical trial in the management of dyspepsia related to gastroesophageal reflux disease (GERD).

2. Results

2.1. Baseline Sociodemographic and Clinical Characteristics

Out of the 86 patients who were included, 21 individuals were lost at the follow-up (Figure 1); therefore, only 65 patients (75.6%) completed this study. There were no differences among the experimental groups regarding those lost to follow-up [omeprazole (16.67%), M. ilicifolia 400 mg (30%), M. ilicifolia 860 mg (26.47%) (p = 0.956)]. Even with the fact that researchers performed several telephone contacts to request information and feedback, patients did not provide reasons for their loss at the follow-up, except for one patient from the omeprazole group who discontinued due to an adverse effect, specifically nausea.
There were no sociodemographic and clinical differences among the groups, except for age between the M. ilicifolia 400 mg and M. ilicifolia 860 mg groups (Table 1). The mean age of the individuals who had adherence was 47.2 ± 1.4 years; however, this did not achieve statistical difference in terms of gender distribution.
GERD symptoms and the impact of heartburn symptoms on life quality were evaluated using the QS-GERD and GERD-HBQOL questionnaires, respectively. They were performed at the beginning and at the end of the study. The primary outcome measures are QS-GERD and -HBQOL total scores.

2.2. GERD Symptoms

Our preliminary results suggest that capsules with a standardized dry extract from the leaves of M. ilicifolia at 400 or 860 mg are non-inferior to omeprazole. The severity of the symptoms of GERD, evaluated by the QS-GERD questionnaire, was reduced by all treatments, since all groups had significantly decreased scores after the 4 weeks compared to the baseline (Figure 2).
Figure 2A shows the QS-GERD total scores, which have a maximum rating of 55, which denotes the most severe symptom intensity. The GEE analyses indicated that the timepoint factor had a strong effect (Chi-square = 129.808; p < 0.0001) because all groups had decreased total scores at the endpoint compared to the baseline.
Although the allocation was randomly performed, our preliminary data indicated some significant differences among groups at the baseline, since a significant interaction between timepoint and groups was indicated in the total score of QS-GERD (MI 860, Figure 2A; Chi-square = 10.363; p = 0.006). The Sidak test indicated the worst conditions of the higher tested dose of the M. ilicifolia group before the treatment period, which can exclude any risk of bias in favor of the intervention group.
Each item of QS-GERD, spanning 0–5, was analyzed, and huge effects of the timepoint factor have been raised by the GEE analyses. The individual scores of all treatments decreased, indicating significant improvements in typical symptoms, such as heartburn intensity (Chi-square = 93.568, p < 0.0001; Figure 2B), heartburn after meals (Chi-square = 126.426, p < 0.0001; Figure 2C), and regurgitation (Chi-square = 42.436, p < 0.0001; Figure 2D). Levels of patient dissatisfaction with the current situation were reduced by all treatments (Figure 2E, Chi-square = 121.51; p < 0.0001), without any differences among the positive control group and MI groups before and after treatment for 4 weeks.

2.3. Impact of Heartburn Symptoms on Life Quality

The impact of heartburn symptoms on life quality was evaluated by the Heartburn Quality of Life (HBQOL) Questionnaire. The HBQOL scores were improved by capsules with omeprazole or dry extract from leaves of M. ilicifolia at 400 or 860 mg (GEE analysis, Figure 3). HBQOL total scores (worst condition rating 69) were significantly reduced by all treatments (Figure 3A; Chi-square = 64.769; p < 0.0001).
Each item of the HBQOL was individually evaluated. The omeprazole, M. ilicifolia at 400, and M. ilicifolia at 860 mg groups after 4 weeks of intervention had improved scores in terms of GERD-induced impairments in work productivity scores; this item ranged from 1 (no time) to 6 (all the time with work impartments) (timepoint effect, Chi-square = 16.459, p < 0.001; Figure 3B). The GEE analyses indicated effects of the timepoint factor on GERD-induced impaired vitality, where the scores ranged from 1 to 6, since decreased total scores at the endpoint, compared to the baseline, were found (Chi-square = 31.625; p < 0.001; Figure 3C). In addition, capsules with omeprazole or extract from leaves of M. ilicifolia at 400 or 860 mg reduced the pain intensity induced by GERD (Chi-square = 35.028; p < 0.001; Figure 3D).

3. Discussion

The data here reported suggested that capsules with dry extract from leaves of M. ilicifolia at both doses, 400 and 860 mg, twice a day, are non-inferior to omeprazole, because the severity of the symptoms of GERD and their impacts on life quality were improved by all interventions.
To the best of our knowledge, this is the first multicenter, randomized, double-blind and controlled clinical trial assessed to compare the effects of M. ilicifolia compared to the positive control, omeprazole, bringing about efficacy in terms of the evidence for the decision-making of medicinal plants and herbal medicines available in the Unified Health System (SUS, Brazil).
The randomized double-blind controlled clinical trial here described, indicating that M. ilicifolia aqueous extracts at 400 or 860 mg are non-inferior to omeprazole, represents a higher level of evidence to support a recommendation on the use of capsules containing dry extract from leaves of M. ilicifolia to treat GERD. In addition, our work supports those preclinical and clinical findings in terms of the safety of M. ilicifolia extracts [16,17]. Besides GERD symptoms, our results indicate improvements in quality of life, such as work productivity, sleep, diet, and daily activities as well.
This work has some strengths, since it is a positive-controlled (against omeprazole group), double-blind, randomized, multicenter clinical trial, in which validated questionnaires on GERD symptoms and GERD-related quality of life were used. In addition, we tried to indicate the MI optimal dose with our study design. However, there are some limitations, as follows: the follow-up was only over 4 weeks, and this study had a small sample size. The preliminary findings were obtained with a smaller number of the participants considering sample size determination for a non-inferiority clinical trial, which may have biased the data. In this context, some baseline differences, specifically in terms of GERD symptoms total score as mentioned above, were found, even with proper randomization. However, this baseline difference did not alter the outcome analysis, since it would be in favor of the control group.
Although proton pump inhibitors (PPIs), such as omeprazole, are the first choice for the management of GERD, there are several concerns about their inappropriate prescription, as overuse has been observed and side effects reported, especially those associated with long-term use. Some of them are related to their mechanism of action; gastric hypoacidity, such as changes in bacterial flora; reduction in the absorption of minerals, calcium, iron, and magnesium; enteric infections; hypoacidity-induced hypergastrinemia; and gastric neoplasia. In addition, the involvement of PPIs with a risk of bone fracture, especially hip fracture, and more recently with all-cause dementia has been raised [20,21,22]. In this context, complementary and alternative approaches of treatment, such as herbal medicines, probiotics, and dietary interventions, have also been evaluated [23].
Several medicinal plants have been evaluated in terms of their potential management of GERD, such as Myrtus communis L. (Myrtaceae) [5,24]. Rose oil capsules, a traditional Persian medicine, alleviated GERD-induced symptoms in a randomized, placebo-controlled, double-blind clinical trial [25].
In addition to the above-suggested effects, such as antisecretory [18] and as a mucosal barrier agent [7,19] Wonfor et al. (2017) provided in vitro evidence on the anti-inflammatory properties of a hexane extract from M. ilicifolia using a human intestinal epithelial cell line [26]. Specifically, M. ilicifolia reduced IL-8 secretion induced by a ligand for TLR2 and lipoteichoic acid [27]. In this context, it is important to note that the modulation of the TLRs signaling pathway has been raised as a potential therapeutic approach in several GI diseases [26]; a reduction in gastric inflammation by traditional medicines in gastritis has also been reported, for example, the hydroethanolic extract of Rosa damascena showed a strong reduction in IL-8 secretion in Helicobacter pylori-infected cells [28] and, as abovementioned, rose oil capsules reduced symptoms in GERD in a clinical trial.
On the other hand, it is possible to postulate that M. ilicifolia contains compounds acting on prostaglandin pathways since its aqueous extract fractionated using ethyl acetate had pharmacological effects, specifically hypotension, reverted by indomethacin, an inhibitor of prostaglandin synthase [24] In this sense, misoprostol, a synthetic prostaglandin analog, that can inhibit gastric acid secretion from parietal cells, a mucosal protective agent, induces uterine smooth muscle contractions, inducing labor/abortion. The involvement of prostaglandin pathways as a mechanism of action can be inferred considering that this species was used as a contraceptive and an abortion inductor by women in South America [29]. In this way, pregnant or nursing women, as well as women of reproductive age who were not at that time using any contraceptive method, were considered exclusion criteria in this clinical trial.
Recently, de Paula and colleagues [30,31] showed significant activities of extracts and fractions, including those with aqueous extraction, against Helicobacter pylori, as well as the inhibition of urease activity that would allow its survival at acid secretion, and an anti-adhesive effect of hydroalcoholic extracts was detected [32]. Monteverdia ilicifolia actions against H. pylori can be, at least in part, potential mechanisms of action in clinical benefits on dyspepsia, since it has been preconized that patients suffering with functional dyspepsia (normal endoscopy) who tested positive for H. pylori can have some benefits with eradication therapy [30].
Taken together, we can infer that these secondary metabolites, such as phenolic compounds and primary metabolites, including polysaccharides, can be related to M. ilicifolia-induced improvements in the clinical GERD symptoms here described as a multitarget strategy based on antisecretory, mucosal barrier, anti-inflammatory, and antibacterial (against H. pylori) activities.
In our opinion, beyond the efficacy of the evidence-based validation of decision-making of traditional medicinal plants in the context of our health system (SUS, Brazil), it is relevant to highlight that this broader project raised the potential hepatotoxicity induced by M. ilicifolia in a preclinical study, bringing about concerns regarding safety [31]. In the present clinical trial, liver diseases were considered to be exclusion criteria.

4. Materials and Methods

4.1. Study Design and Ethical Considerations

The preliminary data reported here were collected from December 2021 to May 2023. This multicenter, randomized, double-blind controlled clinical trial was conducted in accordance with good clinical research practice. The research followed the guidelines of the Declaration of Helsinki and Tokyo for humans and was approved by independent Ethics Committees: Comitê de Ética em Pesquisa (CEP)—Hospital de Clínicas de Porto Alegre—HCPA (code number 36540720.1.000.5327); CEP Grupo Hospitalar Conceição (code number 36540720.1.3002.5530); and CEP Prefeitura de Porto Alegre (code number 36540720.1.3004.5338). In addition, this study was registered in the Brazilian Registry of Clinical Trials (ReBEC) under number 10yqwrk6. All participants in this study read and signed a written consent form.

4.2. Participants, Criteria, and Randomization

Patients of either gender aged between 18 and 80 years with the presence of gastroesophageal reflux symptoms who asked for clinical care in Basic Health Units in the municipalities of Porto Alegre, Igrejinha, and Nova Petrópolis, located in Rio Grande do Sul State, Brazil (30.0277° S, 51.2287° W, 29.5734° S, 50.7925° W, and 29.3826° S, 51.1186° W, respectively), were potential participants. At this point, the inclusion and exclusion criteria were assessed. Eligible patients were those who claimed to have at least one of the typical GERD symptoms: regurgitation, epigastric pain, or burning pain in the last week prior to the medical appointment. Exclusion criteria were as follows: age <18 or >80 years; intolerance to compounds; pregnant or nursing women; women of reproductive age who were not at that time using any contraceptive method; patients who used any antiulcer or prokinetic drugs during the last week before enrollment; and patients with a history of GERD-related anatomical alterations, such as hiatus hernia, or with a history of liver diseases. Considering that our preliminary preclinical data had indicated a potential interaction of MI compounds with CYP2D6, in order to avoid drug–drug interaction and increase their safety, patients who used chronically CYP2D6 substrates were not included.
Eligible participants were invited; before agreeing to participate, they received information on this study, such as confidentiality, aims, procedures, benefits, and risks. Each participant signed an informed consent form. At this point, 86 participants were enrolled in this study.
Participants were randomly assigned using a virtual platform, www.randomization.com (accessed on 1 September 2024) [33,34,35]. Randomization was stratified by each center. This randomization plan generator system generated tables containing columns and lines, where the left column had an ordered sequence of numbers (the number of participants), and the other column shows the assigned treatments (OME, MI 400, or MI 860). The researchers at each center received the ordered envelopes containing the treatments (and the questionnaires) in accordance with the sequence generated by the randomization platform, and then the patients received their number and respective treatment that was previously organized in accordance with their platform number. Double blinding was ensured using planned interventions, such as the same appearance of capsules in terms of packaging, smell, taste, shape, and color. The allocation remained masked up to the statistical analysis.

4.3. Intervention

At this point, 86 participants were randomly assigned to experimental groups: 20 mg omeprazole, 400 mg M. ilicifolia, or 860 mg M. ilicifolia.
Previously, a double-blind placebo-controlled clinical trial conducted for 28 days indicated that M. ilicifolia 400 mg was superior to the placebo group (sugar brown capsules (n = 10), reducing dyspeptic symptoms [6,33]. In addition to 400 mg, we tested those guidelines of national regulatory agencies, specifically ANVISA recommendations, about the M. ilicifolia dose (860 mg twice a day) described in the Phytotherapeutic Memento—Brazilian Pharmacopoeia [33].
The technological development aimed to produce a suitable spray-dried powder to be employed as gelatin capsules. The developed technology was transferred to SUSTENTEC®, Pato Bragato, Brazil, for scale-up to produce capsules with the standardized dry extract from leaves of M. ilicifolia for this clinical trial. The capsules were provided following parameters specified by the Brazilian Health Regulatory Agency (in Portuguese: Agência Nacional de Vigilância Sanitária; RDC 301/2019; RDC 17/2010 and RDC 26/2014). A spray-dried M. ilicifolia extract was prepared using a mixture of the excipients starch/colloidal silicon dioxide (Supplementary Materials). The content of chemical markers in the dry extract was 6.5 ± 1.15% and 2.8%, respectively, for total tannins and epicatechin. The fingerprint of the M. ilicifolia extract was evaluated by high-performance liquid chromatography (HPLC, Supplementary Figure S1 and Table S1), in accordance with the official plant monograph. In addition to the phytochemical quality control of this extract, microbiological, heavy metal, and pesticides analyses were performed. There was no contamination by heavy metals, pesticides, or mycotoxins. Salmonella species and E. coli were not detected. The total mesophilic aerobic bacteria, yeast–mold, and Enterobacteriaceae species were below the safe limit for consumption (maximum permissible limits: 104 UFC/g, 104 UFC/g, and 100 NMP/g, respectively).
We registered access to genetic heritage in the National System of Genetic Resource Management and Associated Traditional Knowledge (in Portuguese: Sistema Nacional de Gestão do Patrimônio Genético e do Conhecimento Tradicional Associado—SISGEN/ACE02A1).
It was requested that the participants take three capsules before breakfast and also three capsules before dinner for 4 weeks. The questionnaires were applied (and biological samples were obtained) at the beginning and at the end of the study.

4.4. Assessment

The impact of omeprazole or M. ilicifolia capsules on GERD symptoms was assessed using the QS-GERD questionnaire, which was translated to Portuguese and validated and comprises 11 items regarding cardinal symptoms of GERD, such as heartburn, regurgitation, sleep disturbance, and pain. The score of each item spans from 0 (best condition) to 5 (worst condition). The primary outcome is QS-GERD total scores, with 55 as the highest score, implying the worst condition.
The HBQOL questionnaire was translated and validated by Pereira et al. (2007) [36] and consists of 12 items about the impact of symptoms related to GERD on quality of life of patients, inducing social restrictions, problems with sleep, loss of work productivity, and symptoms related to eating. For HBQOL total scores, the worst level is indicated by the highest score of 69, and each item was analyzed.

4.5. Sample Size and Statistical Analysis

We calculated a sample size of 189 participants (63 for each group) to test non-inferiority in terms of mean among the tested groups, MI 860, MI 400, and omeprazole (with an increase of 10% for possible losses and refusals; this number should be 208). The calculation considered a non-inferiority margin of −5 points on the QS-DRGE scale, power of 80%, a significance level of 5%, a difference of 1 point between the means, and standard deviation equal to 9 points (the data were obtained from the pilot study carried out due to the absence of parameters in the literature). This calculation was performed using the PSS Health online version tool.
Data on sample characterization composition were described as mean ± SD or percentual (%). Analysis included patients who completed the study and the “per-protocol” principle (PP). Normality and homogeneity were evaluated using the Kolmogorov–Smirnov test and Levine test, respectively. To evaluate the main outcomes of this study, a GEE (generalized estimation equation) was performed with gamma distribution followed by the Sidak test. Clinical outcomes are expressed as medians (interquartile ranges 25/75). In the GEEs, it is possible to analyze the impact of isolated factors (group and timepoint) and the interaction between factors. The qualitative variables were analyzed by Chi-square and showed as frequencies. The statistical software IBM SPSS version 20.0 was used, and values of p < 0.05 were considered statistically significant.

5. Conclusions

The present study showed promising results for the use of capsules containing dry extract from the leaves of M. ilicifolia to manage GERD symptoms. Our results add evidence not only for healthcare workers making clinical decisions but also to support regulatory agencies to elaborate on the guidelines of evidence-based phytotherapy. M. ilicifolia can be useful to reduce the irrational and widespread use of proton pump inhibitors in the treatment of dyspepsia. Further studies with long-term treatment and a bigger sample size to elucidate the underlying mechanisms may be performed to bring about stronger evidence supporting M. ilicifolia as an alternative intervention.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ph17111559/s1, Figure S1: HPLC fingerprint of Monteverdia ilicifolia extract capsules. Two marker components were detected. The details are described in the following Supplement Table S1; Table S1: Chemical components in HPLC of Monteverdia ilicifolia capsules.

Author Contributions

M.S.d.S.: data curation, investigation, methodology, formal analysis, resources, validation, writing—original draft; M.P.M.: investigation, methodology, resources; R.V.A.S.: investigation, validation, writing—original draft; G.B.C.: investigation, validation; G.M.: investigation, methodology, resources, validation; S.E.B.: investigation, methodology, resources; L.V.T.: investigation, methodology, resources; V.B.: conceptualization, methodology, resources, formal analysis, writing—original draft; M.R.G.: methodology, writing—original draft; C.D.: data curation, investigation, methodology, formal analysis, resources, validation, writing—original draft; I.R.S.: conceptualization, data curation, formal analysis, funding acquisition, investigation, methodology, project administration, resources, software, supervision, validation, visualization, writing—original draft, writing—review and editing. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq—grant number 405888/2018). I.R.S. and V.L.B received the Researcher Productivity Grant from CNPq.

Institutional Review Board Statement

This research followed the guidelines of the Declaration of Helsinki and Tokyo for humans and was approved by independent Ethics Committees: Comitê de Ética em Pesquisa (CEP)—Hospital de Clínicas de Porto Alegre—HCPA (code number 36540720.1.000.5327); CEP Grupo Hospitalar Conceição (code number 36540720.1.3002.5530); and CEP Prefeitura de Porto Alegre (code number 36540720.1.3004.5338). In addition, this study was registered in the Brazilian Registry of Clinical Trials (ReBEC) under number 10yqwrk6. All the participants in this study read and signed a written consent form.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The authors declare that the data supporting the findings of this study are available from the corresponding authors upon reasonable request. Information that could compromise the privacy of the research participants is not available.

Acknowledgments

The authors thank SUSTENTEC®, as well as ANVISA and Ministério da Saúde (Brazil), for comments that improved the project. All centers who contributed to this study are acknowledged. The authors wish to express their appreciation to Monica Oliveira for her support with the sample size quantification. The graphical abstract was created with BioRender.com.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Moraes-Filho, J.P.P.; Cecconello, I.; Gama-Rodrigues, J.; De Paula Castro, L.; Henry, M.A.; Meneghelli, U.G.; Quigley, E. Brazilian Consensus on Gastroesophageal Reflux Disease: Proposals for Assessment, Classification, and Management. Scopus 2002, 97, 241–248. [Google Scholar] [CrossRef] [PubMed]
  2. Strand, D.S.; Kim, D.; Peura, D.A. 25 Years of Proton Pump Inhibitors: A Comprehensive Review. Gut Liver 2017, 11, 27–37. [Google Scholar] [CrossRef] [PubMed]
  3. Kinoshita, Y.; Ishimura, N.; Ishihara, S. Advantages and Disadvantages of Long-Term Proton Pump Inhibitor Use. J. Neurogastroenterol. Motil. 2018, 24, 182–196. [Google Scholar] [CrossRef]
  4. Shih, Y.S.; Tsai, C.H.; Li, T.C.; Yu, C.J.; Chou, J.W.; Feng, C.L.; Wang, K.T.; Lai, H.C.; Hsieh, C.L. Effect of Wu Chu Yu Tang on Gastroesophageal Reflux Disease: Randomized, Double-Blind, Placebo-Controlled Trial. Phytomedicine 2019, 56, 118–125. [Google Scholar] [CrossRef] [PubMed]
  5. Zohalinezhad, M.E.; Imanieh, M.H.; Samani, S.M.; Mohagheghzadeh, A.; Dehghani, S.M.; Haghighat, M.; Salehi, A.; Faridi, P.; Akbarzadeh, A.R. Effects of Quince Syrup on Clinical Symptoms of Children with Symptomatic Gastroesophageal Reflux Disease: A Double-Blind Randomized Controlled Clinical Trial. Complement. Ther. Clin. Pract. 2015, 21, 268–276. [Google Scholar] [CrossRef] [PubMed]
  6. Santos-Oliveira, R.; Coulaud-Cunha, S.; Colaço, W. Revisão Da Maytenus Ilicifolia Mart. Ex Reissek, Celastraceae. Contribuição Ao Estudo Das Propriedades Farmacológicas. Rev. Bras. Farmacogn. 2009, 19, 650–659. [Google Scholar] [CrossRef]
  7. Baggio, C.H.; Freitas, C.S.; Mayer, B.; dos Santos, A.C.; Twardowschy, A.; Potrich, F.B.; Cipriani, T.R.; de Souza, L.M.; Sassaki, G.L.; Iacomini, M.; et al. Muscarinic-Dependent Inhibition of Gastric Emptying and Intestinal Motility by Fractions of Maytenus Ilicifolia Mart Ex. Reissek. J. Ethnopharmacol. 2009, 123, 385–391. [Google Scholar] [CrossRef]
  8. Cipriani, T.R.; Gracher, A.H.P.; De Souza, L.M.; Fonseca, R.J.C.; Belmiro, C.L.R.; Gorin, P.A.J.; Sassaki, G.L.; Iacomini, M. Influence of Molecular Weight of Chemically Sulfated Citrus Pectin Fractions on Their Antithrombotic and Bleeding Effects. Thromb. Haemost. 2009, 101, 860–866. [Google Scholar] [CrossRef]
  9. Andrade, S.A.L.d.; Tristão, M.I.d.S.; Miguel, M.D.; Dias, J.D.F.G.; Gomes, E.C.; Burci, L.M.; Paula, C.d.S. Fitoterápicos Da Relação Nacional de Medicamentos Essenciais No Brasil. Rev. Cuba. Plantas Med. 2017, 22. [Google Scholar]
  10. Brasil Resolução RDC No 10, de 9 de Março de 2010. Dispõe Sobre a Notificação de Drogas Vegetais Junto à Agência Nacional de Vigilância Sanitária (ANVISA) e Dá Outras Providências. 2010. Available online: https://bvsms.saude.gov.br/bvs/saudelegis/anvisa/2010/res0010_09_03_2010.html (accessed on 17 September 2024).
  11. Ferreira, P.M.; De Oliveira, C.N.; De Oliveira, A.B.; Lopes, M.J.; Alzamora, F.; Vieira, M.A.R. A Lyophilized Aqueous Extract of Maytenus Ilicifolia Leaves Inhibits Histamine-Mediated Acid Secretion in Isolated Frog Gastric Mucosa. Planta 2004, 219, 319–324. [Google Scholar] [CrossRef]
  12. Jorge, R.M.; Leite, J.P.V.; Oliveira, A.B.; Tagliati, C.A. Evaluation of Antinociceptive, Anti-Inflammatory and Antiulcerogenic Activities of Maytenus Ilicifolia. J. Ethnopharmacol. 2004, 94, 93–100. [Google Scholar] [CrossRef] [PubMed]
  13. Oliveira Souza-Formigoni, M.L.; Oliveira, M.G.M.; Goldnadel Monteiro, M.; Gomes da Silveira-Filho, N.; Braz, S.; Carlini, E.A. Antiulcerogenic Effects of Two Maytenus Species in Laboratory Animals. J. Ethnopharmacol. 1991, 34, 21–27. [Google Scholar] [CrossRef] [PubMed]
  14. Tabach, R.; Oliveira, W.P. Evaluation of the Anti-Ulcerogenic Activity of a Dry Extract of Maytenus Ilicifolia Martius Ex. Reiss Produced by a Jet Spouted Bed Dryer. Pharmazie 2003, 58, 573–576. [Google Scholar] [PubMed]
  15. Cipriani, T.R.; Mellinger, C.G.; De Souza, L.M.; Baggio, C.H.; Freitas, C.S.; Marques, M.C.A.; Gorin, P.A.J.; Sassaki, G.L.; Iacomini, M. A Polysaccharide from a Tea (Infusion) of Maytenus Ilicifolia Leaves with Anti-Ulcer Protective Effects. J. Nat. Prod. 2006, 69, 1018–1021. [Google Scholar] [CrossRef]
  16. Soares, L.A.L.; Oliveira, A.L.; Ortega, G.G.; Petrovick, P.R. Development and Validation of a LC-Method for Determination of Catechin and Epicatechin in Aqueous Extractives from Leaves of Maytenus Ilicifolia. J. Pharm. Biomed. Anal. 2004, 36, 787–790. [Google Scholar] [CrossRef]
  17. Tabach, R.; Duarte-Almeida, J.M.; Carlini, E.A. Pharmacological and Toxicological Study of Maytenus Ilicifolia Leaf Extract Part II-Clinical Study (Phase I). Phytother. Res. 2017, 31, 921–926. [Google Scholar] [CrossRef]
  18. Tabach, R.; Duarte-Almeida, J.M.; Carlini, E.A. Pharmacological and Toxicological Study of Maytenus Ilicifolia Leaf Extract. Part I—Preclinical Studies. Phytother. Res. 2017, 31, 915–920. [Google Scholar] [CrossRef]
  19. Baggio, C.H.; Freitas, C.S.; de Martini Otofuji, G.; Cipriani, T.R.; de Souza, L.M.; Sassaki, G.L.; Iacomini, M.; Marques, M.C.A.; Mesia-Vela, S. Flavonoid-Rich Fraction of Maytenus Ilicifolia Mart. Ex. Reiss Protects the Gastric Mucosa of Rodents through Inhibition of Both H+, K+ -ATPase Activity and Formation of Nitric Oxide. J. Ethnopharmacol. 2007, 113, 433–440. [Google Scholar] [CrossRef]
  20. Danilevicz, C.K.; Pizzolato, L.S.; Bianchi, S.E.; Meirelles, G.; Bassani, V.L.; Siqueira, I.R. Pharmacological Evaluation of a Traditional Brazilian Medicinal Plant, Monteverdia Ilicifolia. Part I—Preclinical Safety Study. J. Ethnopharmacol. 2024, 324, 117806. [Google Scholar] [CrossRef]
  21. Fossmark, R.; Martinsen, T.C.; Waldum, H.L. Adverse Effects of Proton Pump Inhibitors-Evidence and Plausibility. Int. J. Mol. Sci. 2019, 20, 5203. [Google Scholar] [CrossRef]
  22. Paz, M.F.C.J.; De Alencar, M.V.O.B.; De Lima, R.M.I.P.; Sobral, A.L.P.; Do Nascimento, G.T.M.; Dos Reis, C.A.; Coêlho, M.D.P.S.D.S.; Do Nascimento, M.L.L.B.; Gomes Júnior, A.L.; MacHado, K.D.C.; et al. Pharmacological Effects and Toxicogenetic Impacts of Omeprazole: Genomic Instability and Cancer. Oxid. Med. Cell. Longev. 2020, 2020, 3457890. [Google Scholar] [CrossRef] [PubMed]
  23. Poly, T.N.; Islam, M.M.; Yang, H.C.; Wu, C.C.; Li, Y.C. Proton Pump Inhibitors and Risk of Hip Fracture: A Meta-Analysis of Observational Studies. Osteoporos. Int. 2019, 30, 103–114. [Google Scholar] [CrossRef] [PubMed]
  24. Wauters, L.; Slaets, H.; De Paepe, K.; Ceulemans, M.; Wetzels, S.; Geboers, K.; Toth, J.; Thys, W.; Dybajlo, R.; Walgraeve, D.; et al. Efficacy and Safety of Spore-Forming Probiotics in the Treatment of Functional Dyspepsia: A Pilot Randomised, Double-Blind, Placebo-Controlled Trial. Lancet Gastroenterol. Hepatol. 2021, 6, 784–792. [Google Scholar] [CrossRef] [PubMed]
  25. Paknejad, M.S.; Eftekhari, K.; Rahimi, R.; Vigeh, M.; Naghizadeh, A.; Karimi, M. Myrtle (Myrtus Communis L.) Fruit Syrup for Gastroesophageal Reflux Disease in Children: A Double-Blind Randomized Clinical Trial. Phytother. Res. 2021, 35, 6369–6376. [Google Scholar] [CrossRef]
  26. Wonfor, R.; Natoli, M.; Parveen, I.; Beckman, M.; Nash, R.; Nash, D. Anti-Inflammatory Properties of an Extract of M. Ilicifolia in the Human Intestinal Epithelial Caco-2 Cell Line. J. Ethnopharmacol. 2017, 209, 283–287. [Google Scholar] [CrossRef]
  27. Adel Mehraban, M.S.; Shirzad, M.; Ahmadian-Attari, M.M.; Shakeri, R.; Taghizadeh Kashani, L.M.; Tabarrai, M.; Shirbeigi, L. Effect of Rose Oil on Gastroesophageal Reflux Disease in Comparison with Omeprazole: A Double-Blind Controlled Trial. Complement. Ther. Clin. Pract. 2021, 43, 101361. [Google Scholar] [CrossRef]
  28. Pimentel-Nunes, P.; Soares, J.B.; Roncon-Albuquerque, R.; Dinis-Ribeiro, M.; Leite-Moreira, A.F. Toll-like Receptors as Therapeutic Targets in Gastrointestinal Diseases. Expert. Opin. Ther. Targets 2010, 14, 347–368. [Google Scholar] [CrossRef]
  29. Zaidi, S.F.; Muhammad, J.S.; Shahryar, S.; Usmanghani, K.; Gilani, A.H.; Jafri, W.; Sugiyama, T. Anti-Inflammatory and Cytoprotective Effects of Selected Pakistani Medicinal Plants in Helicobacter Pylori-Infected Gastric Epithelial Cells. J. Ethnopharmacol. 2012, 141, 403–410. [Google Scholar] [CrossRef]
  30. de Paula, M.N.; Kelm, M.; Symma, N.; Isolani, R.G.; da Silva, F.P.; Sendker, J.; Hensel, A.; de Mello, J.C.P. Anti-Adhesive Activity of Maytenus Ilicifolia Against Helicobacter Pylori. Rev. Bras. Farmacogn. 2021, 31, 726–731. [Google Scholar] [CrossRef]
  31. de Paula, M.N.; Ribeiro, T.D.V.R.; Isolani, R.; de Medeiros Araújo, D.C.; Borges, A.S.; Philippsen, G.S.; de Cássia Ribeiro Gonçalves, R.; Kitagawa, R.R.; Seixas, F.A.V.; de Mello, J.C.P. An In Vitro and In Silico Investigation about Monteverdia Ilicifolia Activity against Helicobacter Pylori. Antibiotics 2023, 12, 46. [Google Scholar] [CrossRef]
  32. Dos Santos Vilhena Leme, T.; Bruno Lima Prando, T.; Mourão Gasparotto, F.; De Souza, P.; Crestani, S.; Mera De Souza, L.; Ricardo Cipriani, T.; Luiz Botelho Lourenço, E.; Gasparotto Junior, A. Role of Prostaglandin/CAMP Pathway in the Diuretic and Hypotensive Effects of Purified Fraction of Maytenus Ilicifolia Mart Ex Reissek (Celastraceae). J. Ethnopharmacol. 2013, 150, 154–161. [Google Scholar] [CrossRef] [PubMed]
  33. Bastos, C.I.M.; Dani, C.; Cechinel, L.R.; da Silva Neves, A.H.; Rasia, F.B.; Bianchi, S.E.; da Silveira Loss, E.; Lamers, M.L.; Meirelles, G.; Bassani, V.L.; et al. Achyrocline Satureioides as an Adjuvant Therapy for the Management of Mild Viral Respiratory Infections in the Context of COVID-19: Preliminary Results of a Randomized, Placebo-Controlled, and Open-Label Clinical Trial. Phytother. Res. 2023, 37, 5354–5365. [Google Scholar] [CrossRef] [PubMed]
  34. Engman, M.; Granberg, S.; Williams, A.R.W.; Meng, C.X.; Lalitkumar, P.G.L.; Gemzell-Danielsson, K. Mifepristone for Treatment of Uterine Leiomyoma. A Prospective Randomized Placebo Controlled Trial. Hum. Reprod. 2009, 24, 1870–1879. [Google Scholar] [CrossRef] [PubMed]
  35. Papaikonomou, K.; Kallner, H.K.; Söderdahl, F.; Gemzell-Danielsson, K. Mifepristone Treatment Prior to Insertion of a Levonorgestrel Releasing Intrauterine System for Improved Bleeding Control—A Randomized Controlled Trial. Hum. Reprod. 2018, 33, 2002–2009. [Google Scholar] [CrossRef]
  36. Pereira, G.I.D.N.; Costa, C.D.D.S.; Geocze, L.; Borim, A.A.; Ciconelli, R.M.; Camacho-Lobato, L. Tradução e Validação Para a Língua Portuguesa (Brasil) de Instrumentos Específicos Para Avaliação de Qualidade de Vida Na Doença Do Refluxo Gastroesofágico. Arq. Gastroenterol. 2007, 44, 168–177. [Google Scholar] [CrossRef]
Figure 1. The flow chart of the study.
Figure 1. The flow chart of the study.
Pharmaceuticals 17 01559 g001
Figure 2. Symptoms of gastroesophageal reflux disease evaluated using QS-GERD questionnaire before and after 4 weeks of intervention with omeprazole or standardized dry extract from leaves of Monteverdia ilicifolia (MI). (A) Total scores. (B) Heartburn intensity. (C) Heartburn intensity after meals. (D) Regurgitation. (E) Degree of dissatisfaction. OME 20: omeprazole 20 mg; MI 400: M. ilicifolia 400 mg; MI 860: M. ilicifolia 860 mg. Results are expressed as medians (interquartile ranges 25/75). Generalized estimating equations (GEEs), * p ≤ 0.05 indicates a significant difference between the baseline and after intervention.
Figure 2. Symptoms of gastroesophageal reflux disease evaluated using QS-GERD questionnaire before and after 4 weeks of intervention with omeprazole or standardized dry extract from leaves of Monteverdia ilicifolia (MI). (A) Total scores. (B) Heartburn intensity. (C) Heartburn intensity after meals. (D) Regurgitation. (E) Degree of dissatisfaction. OME 20: omeprazole 20 mg; MI 400: M. ilicifolia 400 mg; MI 860: M. ilicifolia 860 mg. Results are expressed as medians (interquartile ranges 25/75). Generalized estimating equations (GEEs), * p ≤ 0.05 indicates a significant difference between the baseline and after intervention.
Pharmaceuticals 17 01559 g002
Figure 3. Effects of capsules with omeprazole or a standardized dry extract from leaves of Monteverdia ilicifolia at 400 or 860 mg on GERD-induced impairments in daily life and social relations, detected by Heartburn Quality of Life (HBQOL) Questionnaire, before and after 4 weeks of intervention. (A) Total scores. (B) Impairments in work productivity. (C) Impairments in vitality. (D) GERD-induced pain. OME 20: omeprazole 20 mg; MI 400: M. ilicifolia 400 mg; MI 860: M. ilicifolia 860 mg. Results are expressed as medians (interquartile ranges 25/75). Generalized estimating equations (GEEs). * p ≤ 0.05 indicates a significant difference between the baseline and after intervention.
Figure 3. Effects of capsules with omeprazole or a standardized dry extract from leaves of Monteverdia ilicifolia at 400 or 860 mg on GERD-induced impairments in daily life and social relations, detected by Heartburn Quality of Life (HBQOL) Questionnaire, before and after 4 weeks of intervention. (A) Total scores. (B) Impairments in work productivity. (C) Impairments in vitality. (D) GERD-induced pain. OME 20: omeprazole 20 mg; MI 400: M. ilicifolia 400 mg; MI 860: M. ilicifolia 860 mg. Results are expressed as medians (interquartile ranges 25/75). Generalized estimating equations (GEEs). * p ≤ 0.05 indicates a significant difference between the baseline and after intervention.
Pharmaceuticals 17 01559 g003
Table 1. Baseline sociodemographic and clinical characteristics.
Table 1. Baseline sociodemographic and clinical characteristics.
Group
Parameters
OmeprazoleMI 400 mg MI 860 mg p Value
Gender (% n/group) 36 (41.86)20 (23.26)30 (34.88)
Male24 (66.7)7 (35)22 (73.3)0.17
Female12 (33.3)13 (65)8 (26.7)
N (%)
Age (mean ± SE)46.9 (2.0)52.5 (2.5) *43.8 (2.5)0.05
Weight (Kg) (mean ± SE)79.0 (3.2)81.9 (3.6)77.9 (3.2)0.75
Height (cm) (mean ± SE)165.4 (1.4)167.6 (1.5)164.3 (1.7)0.44
Marital status (n-%)36 (100)20 (100)30 (100)0.21
Single15 (42.9)5 (25.5)13 (43.4)
Married16 (42.9)9 (45)16 (53.3)
Divorced4 (11.4)4 (20)1 (3.3)
Widower1 (2.9)2 (10)0 (0)
Education (n-%)36 (100)20 (100)30 (100)0.56
Incomplete elementary school 9 (25)10 (50)6 (20)
Full elementary education3 (8.3)1 (5)4 (13.3)
Incomplete high school4 (11.1)2 (10)3 (10)
Complete high school7 (19.4)4 (20)8 (26.7)
Incomplete higher education5 (13.9)0 (0)4 (13.3)
Complete higher education8 (22.2)3 (15)5 (16.7)
Smoker (n -%)36 (100)20 (100)30 (100)0.53
Never26 (72.2)11 (55)23 (76.7)
Yes5 (13.9)4 (20)4 (13.3)
Ex-smoker5 (13.9)5 (25)3 (10)
Alcohol consumption (n-%)36 (100)20 (100)30 (100)0.57
No19 (52.8)11 (55)18 (60)
Yes17 (47.2)9 (45)12 (40)
Physical exercise (n-%)36 (100)20 (100)30 (100)0.65
Yes17 (47.2)9 (45)17 (56.7)
No19 (52.8)11 (55)13 (43.3)
Symptomatology (n-%)
Sore throat7 (19.4)4 (20)11 (36.7)0.22
Dysphonia11 (30.6)8 (40)8 (26.7)0.60
Globus sensation19 (52.8)13 (65)12 (40)0.21
Globus pharyngeus11 (30.6)9 (45)10 (33.3)0.54
Cough14 (38.9)10 (50)15 (50)0.59
* statistically different (p = 0.05) when comparing MI 400 mg vs. MI 860 mg groups.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

da Silva, M.S.; Schunck, R.V.A.; Moraes, M.P.; Corssac, G.B.; Meirelles, G.; Bianchi, S.E.; Targa, L.V.; Bassani, V.; Gonçalves, M.R.; Dani, C.; et al. Pharmacological Evaluation of the Traditional Brazilian Medicinal Plant Monteverdia ilicifolia in Gastroesophageal Reflux Disease: Preliminary Results of a Randomized Double-Blind Controlled Clinical Trial. Pharmaceuticals 2024, 17, 1559. https://doi.org/10.3390/ph17111559

AMA Style

da Silva MS, Schunck RVA, Moraes MP, Corssac GB, Meirelles G, Bianchi SE, Targa LV, Bassani V, Gonçalves MR, Dani C, et al. Pharmacological Evaluation of the Traditional Brazilian Medicinal Plant Monteverdia ilicifolia in Gastroesophageal Reflux Disease: Preliminary Results of a Randomized Double-Blind Controlled Clinical Trial. Pharmaceuticals. 2024; 17(11):1559. https://doi.org/10.3390/ph17111559

Chicago/Turabian Style

da Silva, Maitê Scherer, Rebeca Vargas Antunes Schunck, Maicon Pereira Moraes, Giana Blume Corssac, Gabriela Meirelles, Sara Elis Bianchi, Leonardo Vieira Targa, Valquiria Bassani, Marcelo Rodrigues Gonçalves, Caroline Dani, and et al. 2024. "Pharmacological Evaluation of the Traditional Brazilian Medicinal Plant Monteverdia ilicifolia in Gastroesophageal Reflux Disease: Preliminary Results of a Randomized Double-Blind Controlled Clinical Trial" Pharmaceuticals 17, no. 11: 1559. https://doi.org/10.3390/ph17111559

APA Style

da Silva, M. S., Schunck, R. V. A., Moraes, M. P., Corssac, G. B., Meirelles, G., Bianchi, S. E., Targa, L. V., Bassani, V., Gonçalves, M. R., Dani, C., & Siqueira, I. R. (2024). Pharmacological Evaluation of the Traditional Brazilian Medicinal Plant Monteverdia ilicifolia in Gastroesophageal Reflux Disease: Preliminary Results of a Randomized Double-Blind Controlled Clinical Trial. Pharmaceuticals, 17(11), 1559. https://doi.org/10.3390/ph17111559

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop