Next Article in Journal
Focal Pulsed Field Ablation for Atrial Arrhythmias: Efficacy and Safety under Deep Sedation
Previous Article in Journal
Diagnosis and Therapy of Community-Acquired Pneumonia in the Emergency Department: A Retrospective Observational Study and Medical Audit
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

Comparison of Combined Parenteral and Oral Hormonal Contraceptives: A Systematic Review and Meta-Analysis of Randomized Trials

by
Gábor Vleskó
1,2,
Fanni Adél Meznerics
2,3,
Péter Hegyi
2,4,5,
Brigitta Teutsch
2,4,
Márkó Unicsovics
1,2,
Zoltán Sipos
4,6,
Péter Fehérvári
2,7,
Nándor Ács
1,2,
Szabolcs Várbíró
1,8,* and
Márton Keszthelyi
1,2
1
Department of Obstetrics and Gynecology, Semmelweis University, 1082 Budapest, Hungary
2
Centre for Translational Medicine, Semmelweis University, 1085 Budapest, Hungary
3
Department of Dermatology, Venereology and Dermatooncology, Faculty of Medicine, Semmelweis University, 1082 Budapest, Hungary
4
Institute for Translational Medicine, Medical School, University of Pécs, 7621 Pécs, Hungary
5
Institute of Pancreatic Diseases, Semmelweis University, 1085 Budapest, Hungary
6
Institute of Bioanalysis, Medical School, University of Pécs, 7621 Pécs, Hungary
7
Department of Biostatistics, University of Veterinary Medicine, 1078 Budapest, Hungary
8
Workgroup of Research Management, Doctoral School, Semmelweis University, 1085 Budapest, Hungary
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2024, 13(2), 575; https://doi.org/10.3390/jcm13020575
Submission received: 30 November 2023 / Revised: 15 January 2024 / Accepted: 16 January 2024 / Published: 19 January 2024
(This article belongs to the Section Obstetrics & Gynecology)

Abstract

:
Background: Delivering contraceptive hormones through a transdermal patch or a vaginal ring might have advantages over the traditional oral route. Objectives: To compare the effectiveness, compliance, and side effect profile of oral and parenteral drug administration methods. Methods: We performed a systematic literature search in four medical databases—MEDLINE (via PubMed), Cochrane Library (CENTRAL), Embase, and Scopus—from inception to 20 November 2022. Randomized controlled trials assessing the efficacy, compliance, and adverse event profile of combined parenteral and oral hormonal contraceptives were included. Results: Our systematic search provided 3952 records; after duplicate removal, we screened 2707 duplicate-free records. A total of 13 eligible studies were identified after title, abstract, and full-text selection. We observed no significant difference in contraceptive efficacy (Pearl Index) between oral and parenteral drug administration (MD = −0.06, CI: −0.66–0.53; I2 = 0%). We found significant subgroup differences between parenteral methods in terms of compliance (χ2 = 4.32, p =0.038, I2 = 80%) and certain adverse events: breast discomfort (χ2 = 19.04, p =0.001, I2 = 80%), nausea (χ2 = 8.04, p =0.005, I2 = 75%), and vomiting (χ2 = 9.30, p =0.002; I2 = 72%). Conclusion: Both parenteral and oral contraceptives can be used as an effective contraceptive method, and the route of administration should be tailored to patient needs and adverse event occurrence.

Graphical Abstract

1. Introduction

Hormonal contraception has been widely used for decades and has constantly evolved since it was first introduced [1]. The efficacy of hormonal contraceptives depends largely on patient compliance [2,3,4].
Alternative methods of administration have been developed to reduce the side effect profile while decreasing hormonal levels [5,6,7,8]. Transdermal and vaginal administration allows lower hormonal dosage requirements due to increased bioavailability and provides a convenient and discrete option for women who prefer non-oral routes of administration [9,10]. Nevertheless, the combined oral contraceptive (COC) pill remains the most commonly used hormonal contraceptive method.
Contraceptive pills need to be taken consistently and at the same time every day to be effective. Missing pills or taking them at different times can reduce effectiveness [11]. For women who struggle with daily pill intake, transdermal patches or vaginal rings might be good alternatives [12].
While the existing literature has extensively explored the safety and efficacy of combined parenteral contraception, a critical observation reveals a noticeable temporal gap [13]. Despite the wealth of studies on both contraceptive modalities, a comprehensive synthesis of the latest evidence is conspicuously absent in the literature. This underscores the need for an updated meta-analysis to offer insights into the evolving landscape of combined parenteral contraception in comparison to combined oral contraception.
The aim of our research was to review and compare the efficacy, compliance, and safety of the combined parenteral contraceptive methods with the COC pill. Reducing the side effect profile and increasing compliance is a crucial public health concern due to its medical and financial implications. The outcomes of our analysis are poised to fill the existing temporal void in the literature, providing clinicians, researchers, and policymakers with timely and relevant insights that can inform contraceptive decision making and guide future research directions in this dynamic field [14].

2. Materials and Methods

Our systematic review and meta-analysis followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 Statement [15]. The review protocol was registered on PROSPERO according to the recommendations of the Cochrane Prognosis Methods Group. The protocol of the study was registered on PROSPERO under registration number CRD42022374644 (see https://www.crd.york.ac.uk/prospero/, accessed on 20 November 2022). Respecting the protocol, we also searched the Scopus database.
A systematic literature search was performed in four medical databases—MEDLINE (via PubMed), Cochrane Library (CENTRAL), Embase, and Scopus—from inception to 20 November 2022 using the following search key: “(contraception or contraceptive) and (ring or patch or transdermal) and random*”. Manual searches involved a meticulous review of reference lists of relevant articles and key journals to identify additional studies that may not have been captured through electronic database searches alone. This approach was undertaken to thoroughly explore the existing literature and minimize the risk of overlooking relevant randomized controlled trials (RCTs) that might contribute valuable data to our meta-analysis.
The following population–intervention–control–outcome (PICO) framework was used:
  • P—Women of reproductive age;
  • I—Combined parenteral contraceptives (transdermal patch, vaginal ring);
  • C—Combined oral contraceptives (COCs);
  • O—Primary outcome: Pearl Index, secondary outcomes: compliance, adverse events.
The following inclusion and exclusion criteria were applied:

2.1. Inclusion Criteria

Studies were limited to randomized controlled trials (RCTs) to ensure a high level of methodological rigor. Only studies published in peer-reviewed journals were considered. The participants in the selected studies were women of fertile age. The intervention involved combined parenteral contraception (transdermal patches and vaginal rings). Studies reporting outcomes related to efficacy, adverse events, and cycle control were included. Reports had to identify the specific contraceptive methods used.

2.2. Exclusion Criteria

Non-randomized study designs were excluded. Studies published in non-peer-reviewed sources or grey literature were not considered. Studies with insufficient data or unclear methodology were excluded. We excluded studies focused on women with specific health problems, such as HIV or autoimmune diseases. We also excluded studies of contraceptives as a treatment for specific disorders such as abnormal uterine bleeding, acne, hirsutism, or polycystic ovary syndrome.
We used EndNote 20 (Clarivate Analytics, Philadelphia, PA, USA) to select the retrieved articles. After removing duplicates, two independent authors screened the library separately by title and abstract, then by full text (G.V., M.U.). Cohen’s kappa coefficient (κ) was calculated after each selection process to measure interrater reliability. Disagreements were resolved after each step by a third author (M.K.).
The odds ratio with 95% CI was applied to the effect measures of all outcomes. To calculate the odds ratio, the total number of patients in each group and those with the event of interest were extracted from each study. Raw data from the selected studies were pooled using a random effect model with the Mantel–Haenszel method and the Hartung–Knapp adjustment [16,17,18,19,20].
We used the Paule–Mandel method to estimate τ2 and the Q profile method for calculating the confidence interval of τ2. To evaluate publication bias, we used a funnel plot of the logarithm of the effect size and a comparison with the standard error for each trial.
Statistical heterogeneity across trials was assessed by means of the Cochrane Q test, and the I2 statistic values [21].
Outlier and influence analyses were carried out following the recommendations of Harrer et al. and Viechtbauer and Cheung [17,22].
We used forest plots to graphically summarize results. Where applicable, we reported the prediction intervals (i.e., the expected range of effects of future studies) of results following the recommendations of IntHout et al. [23].
All analyses were carried out using the R 4.1.3 (R Core Team 2021), using the packages ‘meta’ and ‘diameter’ [24].
The efficacy was assessed using the Pearl Index. The Pearl Index, also known as the Pearl Rate or Pearl Control Index, is a measure used to indicate the effectiveness of a contraceptive method in preventing pregnancies. The Pearl Index is defined as the number of pregnancies per 100 woman-years using a specific contraceptive method. In other words, it represents the number of unintended pregnancies that happen while using a contraceptive method over a year of usage for 100 women. The lower the Pearl Index, the more effective the contraceptive method is in preventing pregnancy. Compliance was measured using self-reported patient diaries; one study assessed compliance by measuring plasma steroid levels in addition to diaries [25].
The quality assessment of the outcomes was performed separately by two reviewers (M.U, G.V.) using the RoB 2 tool for assessing the risk of bias [26]. Disagreements were resolved by a third person (F.M.).
To assess the quality of the evidence, we followed the recommendation of the “Grades of Recommendation, Assessment, Development, and Evaluation (GRADE)” workgroup [27].

3. Results

3.1. Search and Selection, Characteristics of the Studies Included

Our systematic search resulted in 3952 records; after duplicate removal, we reviewed 2707 duplicate-free records. A total of 13 eligible studies were identified after title, abstract, and full-text selection [25,28,29,30,31,32,33,34,35,36,37,38,39]. A summary of the selection process is shown in Figure 1.
The characteristics of the studies identified for the systematic review and meta-analysis, as well as the patient characteristics of the studies included, are detailed in Table 1.

3.2. Pearl Index for the Assessment of Contraceptive Efficacy

Six studies [28,30,32,35,37,38], covering a total of 7251 patients, were selected for analysis. No difference in contraceptive efficacy was found between the parenteral and the oral administration groups (MD = −0.06, CI: −0.66–0.53; I2 = 0%). In a subgroup analysis according to the method of administration, three studies [28,32,37], with 2959 patients in the patch group, (MD = 0.15, CI: −1.19–1.48; I2 = 0%) and three studies [30,35,38], with 4292 patients in the ring group (MD = −0.43, CI: −1.73–0.88; I2 = 0%) found similar results (see Figure 2). No statistically significant difference was detected (χ2 = 1.75, df = 1, p = 0.186) between the transdermal patch and the vaginal ring subgroups (see Figure 2).

3.3. Compliance

Nine studies [25,28,30,31,32,34,35,37,38], with a total of 9248 patients, were selected for analysis. The parenteral group had increased odds of better compliance (OR = 1.5, CI: 0.82–2.73; I2 = 80%) (see Figure 3).
In a subgroup analysis according to the method of administration, a total of five studies [25,28,31,32,37], with a total of 6017 patients in the patch subgroup, were selected for analysis. Significantly better compliance was measured in patients using the patch than in the oral group with an increased odds ratio (OR = 2.32, CI: 1.31–4.12; I2 = 33%) (see Figure 3).
In the ring subgroup, a total of four studies [30,34,35,38], involving a total of 3231 patients, found no difference compared to the oral group (OR = 1.01, CI: 0.33–3.03; I2 = 74% (see Figure 3).
The test for subgroup differences suggests that there was a statistically significant subgroup difference between the patch and ring subgroups, with the transdermal patch having significantly better compliance (χ2 = 4.32, df = 1, p = 0.038).

3.4. Adverse Events

3.4.1. Breast Discomfort

Eight studies [28,30,32,33,35,37,38,39], with a total of 9143 patients, were selected for analysis. The parenteral group was found to have clinically relevant increased odds for developing breast discomfort (OR = 1.78, CI: 0.98–3.25; I2 = 80%) (see Figure 4).
In a subgroup analysis according to the method of administration, four studies [28,32,33,37] were selected for analysis in the patch subgroup, with a total of 5700 patients. A statistically significant increase in breast discomfort was measured compared to the oral group (p = 0.05, OR = 3.31, CI: 1.96–5.60; I2 = 13%) (see Figure 4). Four studies [30,35,38,39] in the ring subgroup, with a total of 3443 patients, found no significant difference versus the control (OR = 0.99, CI: 0.49–2.01; I2 = 16%) (see Figure 4).
The test for subgroup differences suggests that there was a statistically significant subgroup difference (χ2 = 19.04, df = 1, p = 0.001).

3.4.2. Vomiting and Nausea

Vomiting

Five studies [28,32,33,35,39], with a total of 5715 patients, were selected for analysis. Decreased odds for vomiting tended to be found in the parenteral group, but this was not statistically significant. (OR = 0.71, CI: 0.23–2.14; I2 = 72%) (see Figure 5A).
In a subgroup analysis according to the method of administration, three studies [28,32,33], with a total of 4284 patients in the patch subgroup, found no difference compared to the oral group (p = 0.997, OR = 1.00, CI: 0.17–5.92; I2 = 76%) (see Figure 5A).
Two studies [35,39], with a total of 1430 patients in the ring subgroup, found reduced odds compared to the oral group. (OR = 0.23, CI: 0.01–5.99; I2 = 0%) (see Figure 5A).
The test for subgroup differences suggests that there was a statistically significant subgroup difference (χ2 = 9.30, df = 1, p = 0.002).

Nausea

Eight studies [28,30,32,33,35,37,38,39], with a total of 9143 patients, were selected for analysis. No difference was found for developing nausea in the parenteral group, but this was not statistically significant (OR = 0.96, CI: 0.61–1.52; I2 = 73%) (see Figure 5B).
In a subgroup analysis according to the method of administration, four studies [28,32,33,37], with a total of 5700 patients in the patch subgroup, found increased odds compared to the oral group (p =0.345, OR = 1.3, CI: 0.62–2.74; I2 = 65%) (see Figure 5B).
Four studies [30,35,38,39] in the ring subgroup, with a total of 3443 patients, found significantly reduced odds compared to the oral group (OR = 0.6, CI: 0.38–0.94; I2 = 0%) (see Figure 5B).
The test for subgroup differences suggests that there was a statistically significant subgroup difference (χ2 = 8.04, df = 1, p = 0.005).

3.4.3. Vaginal Discharge

Four studies [30,35,38,39], with a total of 3443 patients, were selected for analysis. The parenteral group had increased odds of vaginal discharge, and this was statistically significant (p = 0,007, OR = 2.15, CI: 1.5–3.08; I2 = 0%) (see Figure 6).

3.4.4. Dysmenorrhea

Six studies [28,30,32,33,35,37], with a total of 7676 patients, were selected for analysis. No statistical significance was found in the development of dysmenorrhea in the parenteral group. (OR = 0.94, CI: 0.55–1.62; I2 = 70% (95%) (see Figure 7).
In a subgroup analysis according to the method of administration, four studies [28,32,33,37], with a total of 5700 patients in the patch subgroup (OR = 1.24, CI: 0.74–2.09; I2 = 16%), and two studies [30,35], with a total of 1976 patients in the ring subgroup (OR = 0.8, CI: 0.0–3828; I2 = 88%), found no significant difference compared to oral group (see Figure 7).
The test for subgroup differences suggests that there was no statistically significant subgroup difference (χ2 = 0.41, df = 1, p = 0.524).

3.4.5. Headache

Seven studies [28,30,32,33,37,38,39], with a total of 8197 patients, were selected for analysis. There was no difference in the development of headaches between the parenteral and the oral administration groups. (OR = 0.97, CI: 0.81–1.16; I2 = 14%) (see Figure 8).
In a subgroup analysis according to the method of administration, four studies [28,32,33,37], with a total of 5700 patients in the patch subgroup, found slightly decreased odds compared to the oral group (OR = 0.97, CI: 0.59–1.60; I2 = 30%) (see Figure 8).
Three studies [30,38,39], with a total of 2497 patients in the ring subgroup, found slightly increased odds compared to the control (OR = 1.12, CI: 0.67–1.87; I2 = 13%) (see Figure 8).
The test for subgroup differences suggests that there was no statistically significant subgroup difference (χ2 = 0.53, df = 1, p = 0.467).

3.5. Risk of Bias Assessment

Most of the outcomes of the studies included in the meta-analysis were rated as having a low or moderate risk of bias. The risk of bias was low in thirty-nine, moderate in eight and high in three outcomes of studies included in the meta-analysis. The risk of bias assessment for all outcomes is shown in Supplementary Figures S1–S16.

3.6. Quality Assessment

Quality assessment scores for all outcomes are shown in Supplementary Table S3.

4. Discussion

This systematic review and meta-analysis evaluated the contraceptive effectiveness, compliance, and side effect profile of combined oral and combined parenteral methods of hormonal contraception.
Contraceptive compliance plays a crucial role in the safety and effectiveness of the method, which is largely influenced by the method of administration [40]. Compliance with a contraceptive method is highly dependent on its side effect profile, which is a constant challenge for pharmaceutical manufacturers [1].
Previous studies have shown that combined parenteral and oral contraceptives did not differ in efficacy [28,30,32,35,37,38,41]. Our results are consistent with the Cochrane Library’s 2013 systematic review. The three combined hormonal treatments (pill, patch, and ring) have similar contraceptive efficacy, according to the review’s authors’ conclusions [42]. Additionally, a 2017 meta-analysis comparing the effectiveness of combined oral contraception and vaginal ring found no differences in contraceptive efficacy [13].
In summary, our results confirmed the findings of previous studies, as we found similar contraceptive effectiveness for the combined parenteral contraceptive methods observed (transdermal patch, vaginal ring) compared to COCs. Effectiveness was also similar after a subgroup analysis of vaginal ring and transdermal patch. In addition, our results highlight some differences in the adverse event profiles of different methods.
As the effectiveness of a contraceptive method depends on compliance with the regimen, it is a crucial outcome to consider when assessing the efficacy of a contraceptive method [3,43]. Compliance was better with the parenteral methods, showing a difference in favor of the transdermal patch versus the vaginal ring in subgroup analysis. Patch users showed statistically significantly better compliance than COC users in four trials [25,28,32,37]. One trial showed no difference [31]. Compliance varied in four studies on the vaginal ring. Two found better compliance among ring users [34,38], one study found poorer compliance [35], and one showed no difference [30] between vaginal ring users and COC users.
In four trials, ring users had significantly more vaginal discharge than COC users [30,35,38,39]. Some authors investigated the effect of contraception on vaginal flora [44,45] and vaginal ring use [46]. They found an increased risk for leukorrhea but also an increased number of Lactobacilli in the vaginal flora, suggesting that it might have a protective role in vaginal dysbacteriosis; however, elevated discharge could pose a significant challenge for women, leading them to explore alternative administration methods for greater satisfaction.
Our results found higher odds of experiencing breast discomfort in the parenteral group, and we also found a significant difference between the ring and patch subgroups after performing a subgroup analysis. We found a statistically significant increase in the patch subgroup, as suggested by previous authors, indicating that the vaginal contraceptive ring might be more suitable for women with breast discomfort [47].
Regarding nausea, we found no difference between parenteral and oral administration but found a statistically significant difference between the patch and ring subgroups, indicating that ring users had less nausea during use, suggesting that clinicians may consider recommending this method to patients who are concerned about nausea. We found a lower risk of vomiting with parenteral methods. After performing a subgroup analysis, we found a statistically significant difference between the patch and ring subgroups, with the ring subgroup having a lower risk for vomiting. Altogether, parenteral methods are associated with a lower chance of vomiting and nausea. Choosing the right method might contribute to preventing early discontinuation.
Ring users generally had less nausea, breast discomfort, vomiting, and dysmenorrhea than patch users.
We found no significant difference in headache and dysmenorrhea; all methods were safe to use.
These results suggest that both methods of drug administration are highly effective. The selection of the most suitable contraceptive approach should be customized to accommodate the unique preferences and particular requirements of each patient.

4.1. Strengths and Limitations

Our study has several strengths that enhance its credibility. We included only randomized controlled studies, which provide the highest available evidence. Furthermore, it is worth highlighting that there had not been any previous meta-analyses on this particular topic in earlier years, emphasizing the originality and importance of our study in the academic realm.
In addition, the use of random effects models in our meta-analysis is a notable strength, as they account for heterogeneity among the included studies, providing a more conservative estimate of the overall treatment effect.
While our study brings forth significant findings, it is essential to acknowledge certain limitations that warrant consideration. Foremost among these limitations is the notable heterogeneity observed in the assessment of adverse events across the included trials. Additionally, the lack of subgrouping within our analysis represents another limitation, as it may have obscured potential variations in treatment effects across specific populations or intervention characteristics. Furthermore, a subset of these trials lacked comprehensive data concerning efficacy, adding a layer of complexity to the comprehensive analysis. Grey literature, which includes unpublished studies and reports, may not undergo the same scrutiny as peer-reviewed publications and can introduce potential biases. By focusing solely on RCTs published in peer-reviewed journals, we aimed to maintain a high level of methodological quality and enhance the validity of our meta-analysis.
We acknowledge that this exclusion is a limitation, and future research may consider incorporating grey literature to provide a more comprehensive overview of the available evidence in this field. Moreover, the varying utilization of the Pearl Index among studies poses a challenge, impeding direct comparisons between them and thereby influencing the overall coherence of the findings. These limitations underscore the need for caution when interpreting and generalizing the conclusions drawn from our study.

4.2. Implications for Research

Future research should delve deeper into the underlying factors influencing compliance and adverse events associated with different routes of hormonal contraceptive administration. Investigating patient-specific variables such as age, lifestyle, or hormonal sensitivities could offer valuable insights into why certain individuals might respond differently to specific administration methods. Longitudinal studies tracking adherence and side effects over extended periods could also provide a more comprehensive understanding of the sustained effects and variability among contraceptive users. Additionally, comparative studies exploring newer formulations or delivery systems within both oral and parenteral methods may further refine our understanding and potentially offer improved options for contraception.
It would be advisable to conduct randomized controlled trials, use a strict methodology in terms of reporting compliance, and collect data on adverse events. Introducing new drugs, such as progesterone-only patches and rings, is also a new option for research.

4.3. Implications for Practice

The application of scientific results to clinical practice is one of the biggest challenges in medicine today [48,49]. An accurate understanding of the side effect profile of oral as well as parenteral methods allows for a patient-centered, personalized therapeutic approach.
In accordance with the principles of translational medicine, our study was crafted with a commitment to fostering a connection between scientific inquiry and its implementation at the patient’s bedside.

5. Conclusions

Parenteral combined hormonal contraceptive methods demonstrate a commendable safety profile, exhibiting superior compliance compared to oral administration while maintaining comparable effectiveness. Our comprehensive findings underscore the distinct side effect profiles associated with these diverse modes of administration. This nuanced understanding can serve as a pivotal guide for clinicians, enabling them to discern and recommend a contraceptive modality that not only exhibits high effectiveness but also manifests a tailored, minimized side effect profile. This strategic selection is poised to yield enhanced compliance rates and reduced discontinuation instances and ultimately foster heightened patient satisfaction with contraceptive choices.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm13020575/s1, Table S1: PRISMA 2020 checklist. Table S2: PRISMA 2020 for abstracts checklist. Table S3: Summary of Findings Table. Figure S1: Risk of bias assessment of the included studies assessing the Pearl index, using the revised tool for assessing risk of bias in randomized trials (Rob 2). Figure S2: Risk of bias assessment of the included studies assessing the Pearl index, broken down to tools, shown in percentage. Figure S3: Risk of bias assessment of the included studies assessing compliance, using the revised tool for assessing risk of bias in randomized trials (Rob 2). Figure S4: Risk of bias assessment of the included studies assessing compliance, broken down to tools, shown in percentage. Figure S5: Risk of bias assessment of the included studies assessing vomiting, using the revised tool for assessing risk of bias in randomized trials (Rob 2). Figure S6: Risk of bias assessment of the included studies assessing vomiting, broken down to tools, shown in percentage. Figure S7: Risk of bias assessment of the included studies assessing nausea, using the revised tool for assessing risk of bias in randomized trials (Rob 2). Figure S8: Risk of bias assessment of the included studies assessing nausea, broken down to tools, shown in percentage. Figure S9: Risk of bias assessment of the included studies assessing headache, using the revised tool for assessing risk of bias in randomized trials (Rob 2). Figure S10: Risk of bias assessment of the included studies assessing headache, broken down to tools, shown in percentage. Figure S11: Risk of bias assessment of the included studies assessing dysmenorrhea, using the revised tool for assessing risk of bias in randomized trials (Rob 2). Figure S12: Risk of bias assessment of the included studies assessing dysmenorrhea, broken down to tools, shown in percentage. Figure S13: Risk of bias assessment of the included studies assessing discharge, using the revised tool for assessing risk of bias in randomized trials (Rob 2). Figure S14: Risk of bias assessment of the included studies assessing discharge, broken down to tools, shown in percentage. Figure S15: Risk of bias assessment of the included studies assessing breast discomfort, using the revised tool for assessing risk of bias in randomized trials (Rob 2). Figure S16: Risk of bias assessment of the included studies assessing breast discomfort, broken down to tools, shown in percentage. Figure S17: Funnel plot for studies assessing Pearl index. Figure S18: Funnel plot for studies assessing compliance. Figure S19: Funnel plot for studies assessing vomiting. Figure S20: Funnel plot for studies assessing nausea. Figure S21: Funnel plot for studies assessing headache. Figure S22: Funnel plot for studies assessing dysmenorrhea. Figure S23: Funnel plot for studies assessing discharge. Figure S24: Funnel plot for studies assessing breast discomfort. Refs. [15,25,26,28,30,31,32,34,35,37,38,39] cited in Supplementary Materials file.

Author Contributions

G.V.: conceptualization, project administration, visualization, methodology, formal analysis, writing—original draft; F.A.M.: conceptualization, formal analysis, visualization, methodology, writing—review and editing, supervision; P.H.: conceptualization, methodology, supervision, project administration; B.T.: data curation; M.U.: conceptualization; Z.S.: data curation; P.F.: data curation, methodology, visualization; N.Á.: conceptualization; supervision; S.V.: conceptualization, writing—review and editing, supervision; M.K.: conceptualization, methodology, writing—review and editing. All authors certify that they have participated sufficiently in the work to take public responsibility for the content, including participation in the concept, design, analysis, writing, or revision of the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Institutional Review Board Statement

No ethical approval was required for this systematic review with meta-analysis, as all data were already published in peer-reviewed journals.

Informed Consent Statement

No patients were involved in the design, conduct, or interpretation of our study.

Data Availability Statement

The datasets used in this study can be found in the full-text articles included in the systematic review and meta-analysis.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Teal, S.; Edelman, A. Contraception Selection, Effectiveness, and Adverse Effects: A Review. JAMA 2021, 326, 2507–2518. [Google Scholar] [CrossRef] [PubMed]
  2. Borges do Nasciment-Chofakian, C.B.; Moreau, C.; Borges, A.L.V.; dos Santos, O.A.D. Contraceptive discontinuation: Frequency and associated factors among undergraduate women in Brazil. Reprod. Health 2019, 16, 131. [Google Scholar] [CrossRef] [PubMed]
  3. Grimes, D.A. Forgettable contraception. Contraception 2009, 80, 497–499. [Google Scholar] [CrossRef]
  4. Halpern, V.; Lopez, L.M.; Grimes, D.A.; Stockton, L.L.; Gallo, M.F. Strategies to improve adherence and acceptability of hormonal methods of contraception. Cochrane Database Syst. Rev. 2013, 10, Cd004317. [Google Scholar] [CrossRef] [PubMed]
  5. McNamee, K. The vaginal ring and transdermal patch: New methods of contraception. Sex Health 2006, 3, 135–142. [Google Scholar] [CrossRef] [PubMed]
  6. Edwardson, J.; Jamshidi, R. The contraceptive vaginal ring. Semin. Reprod. Med. 2010, 28, 133–139. [Google Scholar] [CrossRef] [PubMed]
  7. Kerns, J.; Darney, P. Vaginal ring contraception. Contraception 2011, 83, 107–115. [Google Scholar] [CrossRef]
  8. Johansson, E.D.; Sitruk-Ware, R. New delivery systems in contraception: Vaginal rings. Am. J. Obstet. Gynecol. 2004, 190, S54–S59. [Google Scholar] [CrossRef]
  9. Festin, M.P.R. Overview of modern contraception. Best. Pract. Res. Clin. Obstet. Gynaecol. 2020, 66, 4–14. [Google Scholar] [CrossRef]
  10. Van den Heuvel, M.W.; van Bragt, A.J.; Alnabawy, A.K.; Kaptein, M.C. Comparison of ethinylestradiol pharmacokinetics in three hormonal contraceptive formulations: The vaginal ring, the transdermal patch and an oral contraceptive. Contraception 2005, 72, 168–174. [Google Scholar] [CrossRef]
  11. Chabbert-Buffet, N.; Jamin, C.; Lete, I.; Lobo, P.; Nappi, R.E.; Pintiaux, A.; Häusler, G.; Fiala, C. Missed pills: Frequency, reasons, consequences and solutions. Eur. J. Contracept. Reprod. Health Care 2017, 22, 165–169. [Google Scholar] [CrossRef]
  12. Hou, M.Y.; Hurwitz, S.; Kavanagh, E.; Fortin, J.; Goldberg, A.B. Using daily text-message reminders to improve adherence with oral contraceptives: A randomized controlled trial. Obstet. Gynecol. 2010, 116, 633–640. [Google Scholar] [CrossRef]
  13. López-Picado, A.; Lapuente, O.; Lete, I. Efficacy and side-effects profile of the ethinylestradiol and etonogestrel contraceptive vaginal ring: A systematic review and meta-analysis. Eur. J. Contracept. Reprod. Health Care 2017, 22, 131–146. [Google Scholar] [CrossRef] [PubMed]
  14. Madden, T.; Secura, G.M.; Nease, R.F.; Politi, M.C.; Peipert, J.F. The role of contraceptive attributes in women’s contraceptive decision making. Am. J. Obstet. Gynecol. 2015, 213, 46.e1–46.e6. [Google Scholar] [CrossRef] [PubMed]
  15. Page, M.J.; Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ 2021, 372, n71. [Google Scholar] [CrossRef] [PubMed]
  16. IntHout, J.; Ioannidis, J.P.; Borm, G.F. The Hartung-Knapp-Sidik-Jonkman method for random effects meta-analysis is straightforward and considerably outperforms the standard DerSimonian-Laird method. BMC Med. Res. Methodol. 2014, 14, 25. [Google Scholar] [CrossRef] [PubMed]
  17. Harrer, M.; Cuijpers, P.; Furukawa, T.; Ebert, D. Doing Meta-Analysis with R: A Hands-On Guide, 1st ed.; Chapman & Hall/CRC Press: Boca Raton, FL, USA, 2021. [Google Scholar]
  18. Mantel, N.; Haenszel, W. Statistical Aspects of the Analysis of Data From Retrospective Studies of Disease. J. Natl. Cancer Inst. 1959, 22, 719–748. [Google Scholar]
  19. Thompson, S.G.; Turner, R.M.; Warn, D.E. Multilevel models for meta-analysis, and their application to absolute risk differences. Stat. Methods Med. Res. 2001, 10, 375–392. [Google Scholar] [CrossRef]
  20. Robins, J.; Greenland, S.; Breslow, N.E. A general estimator for the variance of the Mantel-Haenszel odds ratio. Am. J. Epidemiol. 1986, 124, 719–723. [Google Scholar] [CrossRef]
  21. Higgins, J.P.T.; Thompson, S.G. Quantifying heterogeneity in a meta-analysis. Stat. Med. 2002, 21, 1539–1558. [Google Scholar] [CrossRef] [PubMed]
  22. Viechtbauer, W.; Cheung, M.W. Outlier and influence diagnostics for meta-analysis. Res. Synth. Methods 2010, 1, 112–125. [Google Scholar] [CrossRef] [PubMed]
  23. IntHout, J.; Ioannidis, J.P.A.; Rovers, M.M.; Goeman, J.J. Plea for routinely presenting prediction intervals in meta-analysis. BMJ Open 2016, 6, e010247. [Google Scholar] [CrossRef] [PubMed]
  24. R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2022. [Google Scholar]
  25. Kaunitz, A.M.; Portman, D.; Westhoff, C.L.; Archer, D.F.; Mishell, D.R., Jr.; Foegh, M. Self-reported and verified compliance in a phase 3 clinical trial of a novel low-dose contraceptive patch and pill. Contraception 2015, 91, 204–210. [Google Scholar] [CrossRef] [PubMed]
  26. Sterne, J.A.C.; Savović, J.; Page, M.J.; Elbers, R.G.; Blencowe, N.S.; Boutron, I.; Cates, C.J.; Cheng, H.-Y.; Corbett, M.; Eldridge, S.M.; et al. RoB 2: A revised tool for assessing risk of bias in randomised trials. BMJ 2019, 366, l4898. [Google Scholar] [CrossRef]
  27. Schünemann, H.J.; Oxman, A.D.; Brozek, J.; Glasziou, P.; Jaeschke, R.; Vist, G.E.; Williams, J.W., Jr.; Kunz, R.; Craig, J.; Montori, V.M.; et al. Grading quality of evidence and strength of recommendations for diagnostic tests and strategies. BMJ 2008, 336, 1106–1110. [Google Scholar] [CrossRef]
  28. Urdl, W.; Apter, D.; Alperstein, A.; Koll, P.; Schönian, S.; Bringer, J.; Fisher, A.C.; Preik, M.; ORTHO EVRA/EVRA 003 Study Group. Contraceptive efficacy, compliance and beyond: Factors related to satisfaction with once-weekly transdermal compared with oral contraception. Eur. J. Obstet. Gynecol. Reprod. Biol. 2005, 121, 202–210. [Google Scholar] [CrossRef]
  29. Rad, M.; Kluft, C.; Ménard, J.; Burggraaf, J.; de Kam, M.L.; Meijer, P.; Sivin, I.; Sitruk-Ware, R.L. Comparative effects of a contraceptive vaginal ring delivering a nonandrogenic progestin and continuous ethinyl estradiol and a combined oral contraceptive containing levonorgestrel on hemostasis variables. Am. J. Obstet. Gynecol. 2006, 195, 72–77. [Google Scholar] [CrossRef]
  30. Oddsson, K.; Leifels-Fischer, B.; de Melo, N.R.; Wiel-Masson, D.; Benedetto, C.; Verhoeven, C.H.; Dieben, T.O. Efficacy and safety of a contraceptive vaginal ring (NuvaRing) compared with a combined oral contraceptive: A 1-year randomized trial. Contraception 2005, 71, 176–182. [Google Scholar] [CrossRef]
  31. Merz, M.; Kroll, R.; Lynen, R.; Bangerter, K. Bleeding pattern and cycle control of a low-dose transdermal contraceptive patch compared with a combined oral contraceptive: A randomized study. Contraception 2015, 91, 113–120. [Google Scholar] [CrossRef]
  32. Kaunitz, A.M.; Portman, D.; Westhoff, C.L.; Archer, D.F.; Mishell DRJr Rubin, A.; Foegh, M. Low-dose levonorgestrel and ethinyl estradiol patch and pill: A randomized controlled trial. Obstet. Gynecol. 2014, 123 Pt 1, 295–303. [Google Scholar] [CrossRef]
  33. Kaunitz, A.M.; Archer, D.F.; Mishell, D.R., Jr.; Foegh, M. Safety and tolerability of a new low-dose contraceptive patch in obese and nonobese women. Am. J. Obstet. Gynecol. 2015, 212, 318.e1–318.e8. [Google Scholar] [CrossRef]
  34. Gilliam, M.L.; Neustadt, A.; Kozloski, M.; Mistretta, S.; Tilmon, S.; Godfrey, E. Adherence and acceptability of the contraceptive ring compared with the pill among students: A randomized controlled trial. Obstet. Gynecol. 2010, 115, 503–510. [Google Scholar] [CrossRef] [PubMed]
  35. Fan, G.S.; Ren, M.; Di, W.; Su, P.; Chang, Q.; Wu, S.; Qin, Y.; Korver, T.; Marintcheva-Petrova, M.; Yacik, C.; et al. Efficacy and safety of the contraceptive vaginal ring (NuvaRing) compared with a combined oral contraceptive in Chinese women: A 1-year randomised trial. Eur. J. Contracept. Reprod. Health Care 2016, 21, 303–309. [Google Scholar] [CrossRef] [PubMed]
  36. Creinin, M.D.; Meyn, L.A.; Borgatta, L.; Barnhart, K.; Jensen, J.; Burke, A.E.; Westhoff, C.; Gilliam, M.; Dutton, C.; Ballagh, S.A. Multicenter comparison of the contraceptive ring and patch: A randomized controlled trial. Obstet. Gynecol. 2008, 111 Pt 1, 267–277. [Google Scholar] [CrossRef]
  37. Audet, M.C.; Moreau, M.; Koltun, W.D.; Waldbaum, A.S.; Shangold, G.; Fisher, A.C.; Creasy, G.W.; ORTHO EVRA/EVRA 004 Study Group. Evaluation of contraceptive efficacy and cycle control of a transdermal contraceptive patch vs an oral contraceptive: A randomized controlled trial. JAMA 2001, 285, 2347–2354. [Google Scholar] [CrossRef] [PubMed]
  38. Ahrendt, H.J.; Nisand, I.; Bastianelli, C.; Gómez, M.A.; Gemzell-Danielsson, K.; Urdl, W.; Karskov, B.; Oeyen, L.; Bitzer, J.; Page, G.; et al. Efficacy, acceptability and tolerability of the combined contraceptive ring, NuvaRing, compared with an oral contraceptive containing 30 microg of ethinyl estradiol and 3 mg of drospirenone. Contraception 2006, 74, 451–457. [Google Scholar] [CrossRef] [PubMed]
  39. Mohamed, A.M.M.; El-Sherbiny, W.S.M.; Mostafa, W.A.I. Combined contraceptive ring versus combined oral contraceptive (30-μg ethinylestradiol and 3-mg drospirenone). Int. J. Gynecol. Obstet. 2011, 114, 145–148. [Google Scholar] [CrossRef]
  40. Burkman, R.T. Compliance and other issues in contraception. Int. J. Fertil. Womens Med. 1999, 44, 234–240. [Google Scholar] [PubMed]
  41. Batur, P.; Bowersox, N.; McNamara, M. Contraception: Efficacy, Risks, Continuation Rates, and Use in High-Risk Women. J. Womens Health 2016, 25, 853–856. [Google Scholar] [CrossRef] [PubMed]
  42. Lopez, L.M.; Grimes, D.A.; Gallo, M.F.; Stockton, L.L.; Schulz, K.F. Skin patch and vaginal ring versus combined oral contraceptives for contraception. Cochrane Database Syst. Rev. 2008, 1, Cd003552. [Google Scholar]
  43. Pinter, B. Continuation and compliance of contraceptive use. Eur. J. Contracept. Reprod. Health Care 2002, 7, 178–183. [Google Scholar] [CrossRef]
  44. De Seta, F.; Restaino, S.; De Santo, D.; Stabile, G.; Banco, R.; Busetti, M.; Barbati, G.; Guaschino, S. Effects of hormonal contraception on vaginal flora. Contraception 2012, 86, 526–529. [Google Scholar] [CrossRef] [PubMed]
  45. Eschenbach, D.A.; Patton, D.L.; Meier, A.; Thwin, S.S.; Aura, J.; Stapleton, A.; Hooton, T.M. Effects of oral contraceptive pill use on vaginal flora and vaginal epithelium. Contraception 2000, 62, 107–112. [Google Scholar] [CrossRef] [PubMed]
  46. Brache, V.; Faundes, A. Contraceptive vaginal rings: A review. Contraception 2010, 82, 418–427. [Google Scholar] [CrossRef] [PubMed]
  47. Smallwood, G.H.; Meador, M.L.; Lenihan, J.P.; Shangold, G.A.; Fisher, A.C.; Creasy, G.W.; ORTHO EVRA/EVRA 002 Study Group. Efficacy and safety of a transdermal contraceptive system. Obstet. Gynecol. 2001, 98 Pt 1, 799–805. [Google Scholar] [CrossRef]
  48. Hegyi, P.; Erőss, B.; Izbéki, F.; Párniczky, A.; Szentesi, A. Accelerating the translational medicine cycle: The Academia Europaea pilot. Nat. Med. 2021, 27, 1317–1319. [Google Scholar] [CrossRef]
  49. Hegyi, P.; Petersen, O.H.; Holgate, S.; Erőss, B.; Garami, A.; Szakács, Z.; Dobszai, D.; Balaskó, M.; Kemény, L.; Peng, S.; et al. Academia Europaea Position Paper on Translational Medicine: The Cycle Model for Translating Scientific Results into Community Benefits. J. Clin. Med. 2020, 9, 1532. [Google Scholar] [CrossRef]
Figure 1. PRISMA flow diagram of the screening and selection process.
Figure 1. PRISMA flow diagram of the screening and selection process.
Jcm 13 00575 g001
Figure 2. Forest plot of efficacy comparing combined parenteral and oral hormonal contraceptives [28,30,32,35,37,38].
Figure 2. Forest plot of efficacy comparing combined parenteral and oral hormonal contraceptives [28,30,32,35,37,38].
Jcm 13 00575 g002
Figure 3. Forest plot of compliance with combined parenteral and oral hormonal contraceptives [25,28,30,31,32,34,35,37,38].
Figure 3. Forest plot of compliance with combined parenteral and oral hormonal contraceptives [25,28,30,31,32,34,35,37,38].
Jcm 13 00575 g003
Figure 4. Forest plot of breast discomfort, comparing combined parenteral and oral hormonal contraceptives [28,30,32,33,35,37,38,39].
Figure 4. Forest plot of breast discomfort, comparing combined parenteral and oral hormonal contraceptives [28,30,32,33,35,37,38,39].
Jcm 13 00575 g004
Figure 5. Forest plot of vomiting and nausea. (A) Forest plot of vomiting, comparing combined parenteral and oral hormonal contraceptives (B) Forest plot of nausea, comparing combined parenteral and oral hormonal contraceptives [28,30,32,33,35,37,38,39].
Figure 5. Forest plot of vomiting and nausea. (A) Forest plot of vomiting, comparing combined parenteral and oral hormonal contraceptives (B) Forest plot of nausea, comparing combined parenteral and oral hormonal contraceptives [28,30,32,33,35,37,38,39].
Jcm 13 00575 g005
Figure 6. Forest plot of vaginal discharge, comparing combined parenteral and oral hormonal contraceptives [30,35,38,39].
Figure 6. Forest plot of vaginal discharge, comparing combined parenteral and oral hormonal contraceptives [30,35,38,39].
Jcm 13 00575 g006
Figure 7. Forest plot of dysmenorrhea, comparing combined parenteral and oral hormonal contraceptives [28,30,32,33,35,37].
Figure 7. Forest plot of dysmenorrhea, comparing combined parenteral and oral hormonal contraceptives [28,30,32,33,35,37].
Jcm 13 00575 g007
Figure 8. Forest plot of headache, comparing combined parenteral and oral hormonal contraceptives [28,30,32,33,37,38,39].
Figure 8. Forest plot of headache, comparing combined parenteral and oral hormonal contraceptives [28,30,32,33,37,38,39].
Jcm 13 00575 g008
Table 1. Characteristics of studies included.
Table 1. Characteristics of studies included.
First Author, Year of PublicationMethods, CountryParticipantsInterventionsOutcomesTotal Patients in ParenteralTotal Patients in COCMean (SD) Age in ParenteralMean (SD) Age in COC
Ahrendt, 2006 [38]Randomized trial in 10 European countries from May 2002 to Apr 2004.1017 women, at least 18 years old.Vaginal ring (etonogestrel 120 μg + EE 15 μg) versus COC (drospirenone 3 mg + EE 30 μg).Contraceptive efficacy, compliance, acceptability, adverse events, continuation.49948426.6 (6.1)26.6 (6.2)
Audet, 2001 [37]39 centers in the United States and 6 centers in Canada.Healthy women aged 18 to 45 years.Patch (norelgestromin 150 μg + EE 20 μg) versus
oral contraceptive (levonorgestrel 50/75/125 μg + EE 30/40/30 μg).
Pearl Index, cycle control, compliance, adverse events.81160528.0 (6.6)27.8 (6.4)
Creinin, 2008 [36] 581 women.Vaginal ring (etonogestrel 120 μg + EE 15 μg) versus
transdermal patch (norelgestromin 150 μg + EE 20 μg).
Adverse events.24123826.2 (5.6)25.1 (5.5)
Fan, 2016 [35]Phase-III, open-label, randomized multicenter trial in China. 1137 healthy women.NuvaRing or COC. Contraceptive efficacy, cycle control, dysmenorrhea, compliance.71423231.8 (4.0)31.2 (3.9)
Gilliam, 2010 [34] 273 women, 18–45 years.Vaginal ring (etonogestrel 120 μg + EE 15 μg) versus COC.Compliance.13513722.3 (N/A)22 (N/A)
Kaunitz, 2014 [32]Open-label, randomized, parallel-group, multicenter study. Women, 17–40 years of age.Transdermal patch (120 μg levonorgestrel + 30 μg EE)
versus
100 μg LNG and 20 μg EE.
Contraceptive efficacy, compliance, tolerability.104334426.4 (5.7)26.4 (5.7)
Kaunitz, 2015 [25]Open-label, randomized, multicenter, parallel-group clinical trial.Women, 17–40 years of age.Transdermal patch (120 μg levonorgestrel + 30 μg EE)
versus
100 μg LNG and 20 μg EE.
Adverse events.99833026.4 (N/A)26.4 (N/A)
Kaunitz, 2015 [33]Multicenter crossover study, presumably conducted in USA, dates not specified.Women, 17–40 years.Transdermal patch, (levonorgestrel 120 μg + EE 30 μg) versus COC (levonorgestrel 150 μg + EE 30 μg).Pregnancy (Pearl Index), breakthrough bleeding and spotting, noncompliance, patch wearability, and adverse events.145018826.4 (5.6)26.7 (5.7)
Merz, 2015 [31]Double-blind, double-dummy, randomized, controlled, parallel-group, multicenter trial conducted at 28 centers in the United States.Healthy women, 18–45 years of age.Transdermal patch (0.55 mg EE and 2.1 mg GSD) versus COC (0.02 mg EE and 0.1 mg levonorgestrel). Bleeding pattern, cycle control, safety.19919829.1 (7.3)27.2 (6.8)
Mohamed, 2011 [39]Randomized trial conducted in Cairo, Egypt between 1 May 2008 and 31 July 2010.600 women between 17 and 42 years.Vaginal ring (etonogestrel 120 μg + EE 15 μg) versus
COC (drospirenone 3 mg + EE 30 μg).
Cycle control (via diary cards),
withdrawal bleeding, breakthrough bleeding or spotting, adverse events.
30030029.7 (4.1)30.9 (4.2)
Oddsson, 2004 [30]Open-label, randomized, comparative, multi-center trial in Belgium, Brazil, Chile, Denmark, Finland, France, Germany, Italy, Norway, Spain, and Sweden1090 healthy women. Contraceptive efficacy, cycle control, dysmenorrhea, compliance.51251827.0 (6.2)27.2 (6.3)
Rad, 2005 [29]48 healthy premenopausal women between 18 and 34 years old. Vaginal ring (nestorone 150 μg + EE 15 μg) versus COC
(levonorgestrel 150 μg + EE 30 μg).
Pregnancy and continuation. Study focused on hemostasis variables.232424 (N/A)N/A (N/A)
Urdl, 2005 [28]Open-label, randomized trial in 65 centers in Europe and South Africa.1517 healthy women aged 18 to 45 years.Transdermal patch (norelgestromin 150 μg + EE 20 μg) versus
COC (desogestrel 150 μg + EE 20 μg)
Pregnancy, continuation, compliance, cycle control, satisfaction, adverse events.84664328.8 (6.5)28.3 (6.5)
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Vleskó, G.; Meznerics, F.A.; Hegyi, P.; Teutsch, B.; Unicsovics, M.; Sipos, Z.; Fehérvári, P.; Ács, N.; Várbíró, S.; Keszthelyi, M. Comparison of Combined Parenteral and Oral Hormonal Contraceptives: A Systematic Review and Meta-Analysis of Randomized Trials. J. Clin. Med. 2024, 13, 575. https://doi.org/10.3390/jcm13020575

AMA Style

Vleskó G, Meznerics FA, Hegyi P, Teutsch B, Unicsovics M, Sipos Z, Fehérvári P, Ács N, Várbíró S, Keszthelyi M. Comparison of Combined Parenteral and Oral Hormonal Contraceptives: A Systematic Review and Meta-Analysis of Randomized Trials. Journal of Clinical Medicine. 2024; 13(2):575. https://doi.org/10.3390/jcm13020575

Chicago/Turabian Style

Vleskó, Gábor, Fanni Adél Meznerics, Péter Hegyi, Brigitta Teutsch, Márkó Unicsovics, Zoltán Sipos, Péter Fehérvári, Nándor Ács, Szabolcs Várbíró, and Márton Keszthelyi. 2024. "Comparison of Combined Parenteral and Oral Hormonal Contraceptives: A Systematic Review and Meta-Analysis of Randomized Trials" Journal of Clinical Medicine 13, no. 2: 575. https://doi.org/10.3390/jcm13020575

APA Style

Vleskó, G., Meznerics, F. A., Hegyi, P., Teutsch, B., Unicsovics, M., Sipos, Z., Fehérvári, P., Ács, N., Várbíró, S., & Keszthelyi, M. (2024). Comparison of Combined Parenteral and Oral Hormonal Contraceptives: A Systematic Review and Meta-Analysis of Randomized Trials. Journal of Clinical Medicine, 13(2), 575. https://doi.org/10.3390/jcm13020575

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop