Next Article in Journal
Perineural Invasion Predicts Local Recurrence and Poor Survival in Laryngeal Cancer
Previous Article in Journal
Prospective Evaluation of Children with Robin Sequence following Tübingen Palatal Plate Therapy
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
JCM
Volume 12
Issue 2
10.3390/jcm12020446
jcm-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

GRADE Use in Evidence Syntheses Published in High-Impact-Factor Gynecology and Obstetrics Journals: A Methodological Survey

by
Hui-Juan Yang
1,2,†,
De-Yu Zhang
3,†,
Ying-Ying Hao
3,
He-Li Xu
1,2,
Yi-Zi Li
1,2,
Shuang Zhang
4,
Xin-Yu Li
1,2,
Ting-Ting Gong
3,* and
Qi-Jun Wu
1,2,3,5,6,*
1
Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang 110004, China
2
Clinical Research Center, Shengjing Hospital of China Medical University, Shenyang 110004, China
3
Department of Obstetrics and Gynecology, Shengjing Hospital of China Medical University, Shenyang 110004, China
4
Department of Nephrology, Dalian Municipal Central Hospital, Dalian 116027, China
5
Liaoning Key Laboratory of Precision Medical Research on Major Chronic Disease, Shengjing Hospital of China Medical University, Shenyang 110004, China
6
Key Laboratory of Reproductive and Genetic Medicine, China Medical University, National Health Commission, Shenyang 110004, China
*
Authors to whom correspondence should be addressed.
†
These authors contributed equally to this work.
J. Clin. Med. 2023, 12(2), 446; https://doi.org/10.3390/jcm12020446
Submission received: 7 November 2022 / Revised: 24 December 2022 / Accepted: 27 December 2022 / Published: 5 January 2023
(This article belongs to the Section Obstetrics & Gynecology)
Review Reports Versions Notes

Abstract

:
Objective: To identify and describe the certainty of evidence of gynecology and obstetrics systematic reviews (SRs) using the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) approach. Method: Database searches of SRs using GRADE, published between 1 January 2016 to 31 December 2020, in the 10 “gynecology and obstetrics” journals with the highest impact factor, according to the Journal Citation Report 2019. Selected studies included those SRs using the GRADE approach, used to determine the certainty of evidence. Results: Out of 952 SRs, ninety-six SRs of randomized control trials (RCTs) and/or nonrandomized studies (NRSs) used GRADE. Sixty-seven SRs (7.04%) rated the certainty of evidence for specific outcomes. In total, we identified 946 certainty of evidence outcome ratings (n = 614 RCT ratings), ranging from very-low (42.28%) to low (28.44%), moderate (17.65%), and high (11.63%). High and very low certainty of evidence ratings accounted for 2.16% and 71.60% in the SRs of NRSs, respectively, compared with 16.78% and 26.55% in the SRs of RCTs. In the SRs of RCTs and NRSs, certainty of evidence was mainly downgraded due to imprecision and bias risks. Conclusions: More attention needs to be paid to strengthening GRADE acceptance and building knowledge of GRADE methods in gynecology and obstetrics evidence synthesis.

1. Introduction

Systematic reviews (SRs) are essential parts of evidence-based medicine and serve as the basis for clinical practice guidelines [1], which are widely used in the field of gynecology and obstetrics [2,3,4,5,6]. Recently, several publications have concentrated on the quality and credibility of systematic reviews as the number of such publications has increased [7,8].
The GRADE system is an emerging method for appraising studies and making recommendations for systematic reviews and guidelines [9,10]. As one of the most important methodological achievements of evidence-based medicine (EBM) in the last 30 years, it has been used by over 100 organizations up to now [11]. Different from other appraisal tools (The Jadad, the Newcastle-Ottawa score etc.), GRADE separates quality of evidence and strength of recommendation, assesses the quality of evidence for each outcome, and allows observational studies to be “upgraded”, if they meet certain criteria [12]. There are five distinct steps in the GRADE method [9,12]. Step 1: A prior ranking. For randomized controlled trials, we assign a high ranking, and for observational studies, a low ranking. Step 2: ‘Downgrade’ or ‘Upgrade’ the initial ranking. There are five downgrading domains (risk of bias (RoB), inconsistency, indirectness, imprecision, and publication bias) and three upgrading domains (large consistent effect, dose response, and plausible confounding, which would reduce a demonstrated effect). Step 3: Assign a final grade. On the basis of upgrading and downgrading domains in step 2, the final evidence quality is rated “high”, “medium”, “low”, or “very low” [13]. All the three steps above are repeated for each critical outcome. Step 4: Consider factors affecting recommendation. In addition to evidence quality, recommendations must also take other factors into account, such as cost-effectiveness, patient preference, and balance of desirable and undesirable effects. Step 5: Combine the above factors to give a final recommendation, strong or weak [14].
In general, GRADE has a strict procedure for evaluating evidence and considers other factors besides evidence, which makes it more suitable for the medical field. Previous studies have explored the use of GRADE in the fields of nutrition, urology, and nephrology [15,16]. Among these studies, the number of SRs using GRADE was limited, and the certainty of most evidence was quite low. Considering the merits of GRADE in the evaluation of evidence, there is a need for enhancing the acceptance and use of GRADE in both fields. However, no study has evaluated the application of the GRADE approach in the SRs of journals of gynecology and obstetrics. Therefore, it seems sensible to explore the current status of the GRADE approach used in SRs published in gynecology and obstetrics journals. Herein, we take the following two steps: (1) identify and describe all relevant SRs using the GRADE methodology, to evaluate the outcome-specific certainty of evidence published between 2016 and 2020, in the 10 gynecology and obstetrics journals, with the highest impact factor according to the JCR 2019, and (2) summarize and present the GRADE specific information, including the number of outcomes rated, the certainty of evidence ratings, the use of summary of findings tables, down- and upgrading factors, while also taking the study design (SRs of RCTs vs. NRSs) into account.

2. Materials and Methods

2.1. Search Strategy

Systematic reviews (SR) published between 1 January 2016 to 31 December 2020 in the 10 gynecology and obstetrics journals, with the highest impact factor (range: 17.18–4.25), according to the JCR 2019, were identified through searches in the database PubMed. (Appendix S1).

2.2. Inclusion and Exclusion Criteria

SRs were included if they met the following criteria: (1) SRs published between 1 January 2016 and 31 December 2020 in the top 10 journals according to the JCR 2019 category gynecology and obstetrics, and (2) SRs applying the GRADE approach to rate the certainty of evidence.
SRs were excluded if they met the following criteria: (1) SRs using a modified version of the GRADE approach, based on the adaptions of the tool to self-defined criteria of authors to assess the quality of evidence, and (2) SRs failing to provide detailed GRADE evaluation processes and results.

2.3. Selection Process of Sources of Evidence

First, title and abstract screening were performed by two reviewers (Y-ZL, SZ.) to identify articles relevant to GRADE. Second, for all potentially relevant references, full-text publications were obtained and checked for final inclusion, by two reviewers (H-JY, H-LX.) independently. Discrepancies were resolved through discussion with a third author (Q-J W.).

2.4. Data Extraction

For included SRs, one reviewer (H-JY.) extracted the data and an independent reviewer (H-LX.) cross-checked all data. The following data were extracted at SR level: year of publication, journal name, number of primary studies included, type of studies (RCTs vs. NRSs (including: i.e., non-randomized intervention studies, case-control studies, cohort studies, and cross-sectional studies vs. combination RCTs/NRSs) included, number of participants, description of intervention(s)/exposure(s), number and types of outcome(s) and comparison(s) rated, category of certainty of evidence ratings (high, moderate, low, or very low), meta-analysis conducted (yes vs. no), summary of findings table reported (yes vs. no), number of down and/or upgrades (count of the respective downgrading/upgrading domain used at the outcome-level), and reasons for down- and upgrading. For the quantitative presentation, all downgrading factors listed in the SRs of both RCTs and NRSs were extracted according to the study design, except in the case of two SRs, where a differentiation between study designs was not possible.
Finally, in this methodological survey, we excluded two types of SRs based on minimum criteria proposed by the GRADE working group: (1) the authors of SRs rated the certainty of evidence of each individual study (“study level”); and (2) the authors of SRs rated the certainty of the SR’s body of evidence, instead of rating the body of evidence for a given outcome (“outcome level”) [15].

3. Results

3.1. Search Results and Sample

Figure S1 shows the flow diagram of the literature search. The database search retrieved 1033 documents. After the removal of duplicate records (n = 2), title and abstract screening (n = 79), and analysis of the remaining 952 full-text articles, 93 articles remained. Among them, 3 SRs using a modified version of the GRADE [17,18,19] and 12 SRs failing to provide a detailed evaluation process [20,21,22,23,24,25,26,27,28,29,30,31] were excluded from this study. A total of 11 SRs using GRADE, did not rate the certainty of evidence for the specific outcome [32,33,34,35,36,37,38,39,40,41,42], but instead assessed certainty of evidence of individual studies or overall certainty of the body of evidence (Table S1). Finally, only 67 SRs (7.04%; out of 952 SRs published) were included in this study.
Table 1 shows the distribution of these SRs according to the journal and year. The publication of SRs in the top 10 gynecology and obstetrics journals decreased between 2016 and 2019 and increased in 2020, with the least SRs published in 2019 (n = 160), and the most in 2020 (n = 238). As compared to 2016 and 2017 (6.12% and 6.25%), the proportion of SRs rating the certainty of evidence with GRADE increased among all SRs published in 2018, 2019, and 2020 (9.2%, 6.25%, and 7.56%). More than 80% of all included SRs were published in four journals (Ultrasound in Obstetrics & Gynecology, Human Reproduction Update, British Journal of Obstetrics and Gynecology, and American journal of Obstetrics and Gynecology).

3.2. Characteristics of the Included SRs

In total, 41 SRs analyzed evidence from RCTs only (n = 41) [43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83] and 18 NRSs only [84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101], and 8 SRs that analyzed both RCTs and NRSs [102,103,104,105,106,107,108,109] were included into this methodological study. The characteristics of these SRs are summarized in Table 2, Table 3 and Table 4. Furthermore, from the 8 SRs including both RCTs and NRSs, 4 SRs [103,105,108,109] rated the certainty of evidence derived from RCTs and NRSs separately (in separate rows within a single Summary of Findings table, or in separate Summary of Findings tables), 2 SR [102,104] pooled RCTs and NRSs rated the combined evidence (in the same rows within a single Summary of Findings table), 2 SRs [106,107] rated only evidence from NRSs.
Sixty-four SRs (85%) conducted at least one meta-analysis [43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,91,92,93,94,95,96,97,98,99,102,104,106,107,108,109], and sixty SRs (83%) showed their findings in a summary of findings table [43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,80,81,82,84,85,87,88,89,90,91,93,94,95,96,100,101,103,104,105,106,107,109]. The median number of primary studies included in the SRs was 15 (IQR: 8–21). The median number of participants included in the SRs was 3962 (IQR: 1632–7238) in the SRs of RCTs, and 5829 (IQR: 2791–333,396) in the SRs of NRSs, and 2583 (IQR: 260–244,263) in the SRs of both RCTs and NRSs (Table 5). In the identified SRs, interventions/exposures can be categorized into drug therapy (n = 28), surgical therapy (n = 10), assisted reproductive (n = 9), drug and surgical therapy (n = 2), screening method (n = 4), special disease (n = 2), reproductive strategy (n = 1), lifestyle factors (n = 3), clinical care (n = 1), virus (n = 1), and others (n = 6).

3.3. Certainty of Evidence Ratings

The median of the total number of outcomes rated in a SR was 5 (IQR: 3–8). (Table 5) Overall, there were 946 individual outcome ratings: 42.28% of very low, 28.44% of low, 17.65% of moderate, and 11.63% of high, in certainty of evidence. Among 614 outcomes in the SRs of RCTs, 26.55% were rated very low, 32.74% low, 23.94% moderate, and 16.78% high, in certainty of evidence. In the SRs of NRSs (outcomes were 324), 71.60% were rated very low, 20.73% low, 5.86% moderate, and 2.16% high, in certainty of evidence. In the SRs of NRSs and RCTs, a total of 8 outcomes were rated: 5 of very low, 2 of low, and 1 of moderate certainty of evidence. In studies assessing interventions with drug therapy, there were 445 individual outcome ratings: 415 in the SRs of RCTs, 26 in the SRs of NRSs, and 4 in the SRs of NRSs and RCTs. The certainty of evidence was rated as very low (33.26%), low (23.37%), moderate (22.70%) and high (20.67%). Details can be seen in Table 6.
Table
Table 2. Summary of the study characteristics and the number and type of (un)rated outcomes of systematic reviews of randomized controlled trials (n = 41) that rated the outcome-specific certainty of evidence with GRADE.
Table 2. Summary of the study characteristics and the number and type of (un)rated outcomes of systematic reviews of randomized controlled trials (n = 41) that rated the outcome-specific certainty of evidence with GRADE.
Author, YearIntervention/ExposureNumber of StudiesNumber of ParticipantsNumber of Outcomes Rated (Number of Unrated Outcomes)Number of Rated ComparisonsOutcomes Rated
Wei et al., 2016 [44] Paroxetine51571101Mean reduction in frequency of VMS at (week 4; week 6; week 12); Mean reduction in daily VMS severity score at (week 4; week 12); Headache; Dizziness; Nausea; Fatigue/Drowsiness/Somnolence/Lethargy; Constipation
Rydén et al., 2016 [45]Aromatase inhibitors alone or sequentially combined with tamoxifen8unclear81Disease-free survival; Overall Survival; Death without recurrence; Endometrial cancer; Fractures; venous thromboembolism events; Cerebrovascular events; Cardiovascular events
Nastri et al., 2016 [46]Embryo culture using Low O221unclear3 Clinical outcomes2 (AtmO2 during all embryo culture, AtmO2 after Day 2)Live birth/ongoing pregnancy; Clinical pregnancy; Miscarriage
5 Laboratory outcomes3 (AtmO2 during all embryo culture, before Day 3 followed by LowO2 in both groups, after Day 2)Fertilization; Cleavage; High/Top cleavage; Blastocyst; High/Top blastocyst
Di et al., 2016 [47]Hysteroscopy9297632 (Hysteroscopy vs. no hysteroscopy, Operative vs. diagnostic hysteroscopy)Live birth rate; pregnancy rate; miscarriage rate
Barbosa et al., 2016 [48]Oral dydrogesterone838095 (3)2 (vaginal progesterone capsules, Vaginal progesterone gel)Live birth; Ongoing pregnancy; Clinical pregnancy; Miscarriage per clinical pregnancy; Dissatisfaction
Martins et al., 2016 [49]Gonadotrophin-releasing hormone agonist10305631Live birth/ongoing pregnancy; Clinical pregnancy; Miscarriage per clinical pregnancy
Tsiami et al., 2016 [50]Salpingectomy, proximal tubal occlusion, aspiration of the hydrosalpingeal fluid 7unclear41Ongoing pregnancy (direct evidence); Ongoing pregnancy (network meta-analysis); Clinical pregnancy (direct evidence); Clinical pregnancy (network meta-analysis)
Kollmann et al., 2016 [51]Menopausal gonadotropin, metformin, mannitol66unclear41live birth/ongoing pregnancy; OHSS; clinical pregnancy; miscarriage;
Berghella et al., 2017 [52]Cervical cerclage5419191PTB (<35 w; 37 w; 34 w; 32 w; 28 w; 24 w); GA at delivery (w); Latency (days); PPROM; Birth weight (grams); LBW; VLBW; RDS; IVH; Sepsis; NEC; NICU; LOS in NICU (days); Neonatal death
Berghella et al., 2017 [53]Cervical length screening32877 (1)1PTB (<37 w; 34 w; 32 w; 28 w); LBW; Perinatal death; Maternal hospitalization
Romero et al., 2017 [54]Vaginal progesterone6909 (303 women, 606 infants)231PTB (<33 w; 37 w; 36 w; 35 w; 34 w; 32 w; 30 w; 28 w); SPTB (<33 w; 34 w); RDS; NEC; IVH; Proven neonatal sepsis; Retinopathy of prematurity; Fetal death; Neonatal death; Perinatal death; Composite neonatal morbidity/mortality; Birth weight < 1500 g; 2500 g); Admission to NICU; Mechanical ventilation
Bechtejew et al., 2017 [55]clomiphene and/or letrozole23196162live birth and OHSS; clinical pregnancy; miscarriage per clinical pregnancy; number of oocytes retrieved; number of FSH ampoules (75 IU); and cycle cancellation
Sjöström et al., 2017 [56]no-doctors667352 (1)1effectiveness; acceptability
Pinto-Lopes et al., 2017 [57]antibiotic16269541Composite postpartum infectious morbidity; Endometritis; Wound infection; Urinary tract infection
Saccone et al., 2017 [58]Vaginal progesterone368012 (1)1SPTB < 37 w; SPTB (<34 w; 32 w; 28 w); Adverse drug reaction; Admission to NICU; RDS; BPD; IVH; NEC; Sepsis; Perinatal death (SPTB < 37 weeks)
Luque-Ramírez et al., 2018 [59]Combined oral contraceptives and/or antiandrogens33152171Efficiency (Hirsutism; Menstrual dysfunction); Cardiometabolic risk factors (BMI; Abnormal glucose tolerance; Lipid profile; Blood pressure; Hypertension)
Senra et al., 2018 [60] Gonadotrophin-releasing hormone plus chemotherapy 13120821Primary ovarian insufficiency; Spontaneous pregnancy
Kalafat et al., 2018 [61]Metformin15312434 (insulin, glyburide, placebo, other drugs or placebo)Hypertensive disorders of pregnancy; Preeclampsia; PIH
Vitagliano et al., 2018 [62]Endometrial scratch injury10146851Live birth rate; Clinical pregnancy rate; multiple PR; miscarriage rate; EPR
Vitagliano et al., 2018 [63]Endometrial scratch injury8187151Clinical pregnancy rate; Ongoing pregnancy rate; multiple PR; EPR; miscarriage rate
Siristatidis et al., 2018 [64]Human papilloma virus14234881Live birth/ongoing pregnancy; Miscarriage rate per clinical pregnancy; Clinical pregnancy; Positive pregnancy test; ectopic pregnancy; Live birth/ongoing pregnancy-male factor; Clinical pregnancy-male factor; Miscarriage rate-male factor
Gadalla et al., 2018 [65]Clomiphene citrate33434941Endometrial thickness; Ovulation; Pregnancy; Live birth
Romero et al., 2018 [66]Vaginal progesterone5974321Preterm birth (<33 w; 37 w; 36 w; 35 w; 34 w; 32 w; 30 w; 28 w); Spontaneous preterm birth (<33 w; 34 w); GA at delivery; RDS; NEC; IVH; Bronchopulmonary dysplasia; Retinopathy of prematurity; Fetal death; Neonatal death; Perinatal death; Composite neonatal morbidity/mortality; Apgar score < 7 at 5 min; Birthweight (<1500 g; <2500 g); Admission to NICU; Mechanical ventilation; Congenital anomaly; Bayley-III cognitive composite score at age 2 year; Moderate/severe neurodevelopmental impairment at age 2 year; Visual or hearing Impairment at age 2 year; gastrointestinal; or respiratory function at age 2 year; Any maternal adverse event
Matthewman et al., 2018 [67]Physical activity15168121Pain intensity; pain duration
Fang et al., 2018 [68]oil-soluble contrast material6256241Ongoing pregnancy; Live birth; Miscarriage; ectopic pregnancy
Vitagliano et al., 2019 [69]Gonadotrophin-releasing hormone15234521Ongoing pregnancy rate/Live birth rate; Clinical pregnancy rate
Jarde et al., 2019 [70]Vaginal progesterone, oral progesterone,17-OHPC, cerclage, and pessary4011,31131Preterm birth < 34 weeks; Preterm birth < 37 weeks; Neonatal death
Baiju et al., 2019 [71] Self-assessment of outcome454936-Effectivenes1Complete Abortion; Need for Surgery; Hemorrhage (Excessive Bleeding); Fever and Infection; Drugs for hemorrhage; Ongoing pregnancy
6-Safety1Complete Abortion; Need for surgery; Excessive bleeding; Fever and infection; Drugs for hemorrhage; Continuing pregnancy
Bosdou et al., 2019 [72]Frozen-embryo transfer8526551Live birth; Ongoing pregnancy; Clinical pregnancy; ovarian hyperstimulation syndrome; Miscarriage
Wang et al., 2019 [73]Letrozole, clomiphene + metformin20396251Live birth; Clinical pregnancy; Multiple pregnancy; Miscarriage; Ovulation
Sotiriadis et al., 2019 [74]Elective induction5726191Cesarean section; NICU admission; Operative delivery; Grade-3/4 perineal laceration; postpartum hemorrhage; Postpartum maternal infection; Maternal hypertension; Neonatal death; Neonatal respiratory support
Li et al., 2020 [75]Progestogen10505691Live birth; Live birth-oral progestogen; Live birth vaginal progesterone; Miscarriage; Miscarriage oral progestogen; Miscarriage vaginal progesterone; Preterm birth; low birth weight; Congenital abnormalities
Qin et al., 2020 [76]Acupuncture therapies534133 (antibiotics; no treatment; sham acupuncture)Composite cure rate; Recurrent rate; Symptom duration
Danhof et al., 2020 [77]intrauterine insemination26531631Live birth/ongoing pregnancy; multiple pregnancy; clinical pregnancy
Bergeron et al., 2020 [43] Endometrial ablation or resection13884131Hysterectomy rates; PBAC scores (at 3 months; 6 months; 12 months; 24 months); Amenorrhea (at 6 months; 12 months; 24 month); Side effects; Quality of life; Treatment failures; Satisfaction rate; Hemoglobin
Islam et al., 2020 [78]Prophylactic antibiotics2416,17821 Genital tract infection; adverse event
Bordewijk et al., 2020 [79]individual participant data sharing45869721Live birth; Clinical pregnancy
Cai et al., 2020 [80]Prophylactic antibiotics20716921Chorioamnionitis; Neonatal Death
Di Mascio et al., 2020 [81]Delayed pushing125445171SVD; OVD; CD; OD; CD in the second stage; Duration of second stage; Time of active pushing; Chorioamnionitis; Intrapartum fever; Endometritis; PPH; Episiotomy; Severe perineal lacerations; Low umbilical cord pH; Apgar < 7 at 5 min; Neonatal respiratory morbidity; NICU admission
Samy et al., 2020 [82]Misoprostol; oxytocin; vasopressin; tranexamic acid; epinephrine; or ascorbic acid26162711Blood loss
Stewart et al., 2020 [83]Trastuzumab511,37621Disease-free survival; Overall Survival
Outcome graded: BMI, Body Mass Index; BPD, bronchopulmonary dysplasia; CD, cesarean delivery; EPR, ectopic pregnancy rate; FSH, follicle-stimulating hormone; GA, gestational age; IVH, Intraventricular hemorrhage; LBW, low birth weight; LOS, length of stay; NEC, necrotizing enterocolitis; NICU, admission to the neonatal intensive care unit; OD, operative delivery; OHSS, ovarian hyperstimulation syndrome; OVD, operative vaginal delivery; PBAC, pictorial blood loss assessment chart; PIH, Hypertensive disorders of pregnancy; PPH, postpartum hemorrhage; PPROM, preterm premature rupture of membranes; PR, pregnancy rate; PTB, Preterm birth; RDS, respiratory distress syndrome; SPTB, Spontaneous preterm birth; SVD, spontaneous vaginal delivery; VLBW, very low birth weight; VMS, vasomotor symptom.
Table
Table 3. Summary of the study characteristics and the number and type of (un)rated outcomes of systematic reviews of nonrandomized studies (n = 18) that rated the outcome-specific certainty of evidence with GRADE.
Table 3. Summary of the study characteristics and the number and type of (un)rated outcomes of systematic reviews of nonrandomized studies (n = 18) that rated the outcome-specific certainty of evidence with GRADE.
Author, YearIntervention/ExposureNumber of StudiesNumber of ParticipantsNumber of Outcomes Rated (Number of Unrated Outcomes)Number of Rated ComparisonsOutcomes Rated
Mowat et al., 2016 [85]The volume of surgeons in Gynecology surgery (low volume surgeons)14741,760221Total complications; Total complications adjusted OR; Total complications adjusted OR excluding gynecologic oncology; Intraoperative complications; Intraoperative complications adjusted OR; Intraoperative complications adjusted OR excluding gynecologic oncology; Postoperative complications; Postoperative complications adjusted OR; Postoperative adjusted OR excluding gynecologic oncology; Mortality; Medical complications; Operating time (mins); Transfusion; Estimated blood loss; Cystotomy; Ureteric Injury; Cystotomy or ureteric injury; Bowel injury; Vascular injury; Readmission; Reoperation; LOS > 2 days
Zafer et al., 2016 [86]Semen washing followed by IUI, IVF, or IVF/ICSI.404257 couples11HIV seroconversion
Martins et al., 2016 [87] Cleavage stage; blastocyst transfer.12195,325231Perinatal mortality; Birth defects; PTB (<37 w); VPTB (<32 w); LBW (<2.5 kg); VLBW (<1.5 kg); BW > 4.0 kg; BW > 4.5 kg; GA; LGA; PE/PIH; GDM; PP; PAb; PAc; PROM; APH; PPH; CS; Low Apgar 5 min; Miscarriage; Stillbirth; VT
Park et al., 2016 [88]Corticosteroid Therapy17364671Mortality before discharge; RDS; IVH; NEC; Chronic lung disease; ROP stages greater than 2; Neurologic impairment 18–22 month
Wang et al., 2017 [89]Fine needle aspiration cytology and core needle biopsy in evaluation of suspicious breast lesions12180221True positives; False negatives; True negatives; False positives
Meireles et al., 2017 [90]Metformin19unclear31Atypical endometrial Hyperplasia; Biomarkers proliferation; Overall Survival
Berg et al., 2018 [101]3 (defibulation; antepartum defibulation; previous defibulation)62582963 (defibulation vs. no defibulation; antepartum defibulation vs. intrapartum defibulation; previous defibulation vs. antenatal defibulation)CS; episiotomy; 2nd degree tear; 3rd degree tear; 4th degree tear; 1 min Apgar < 7
Cavoretto et al., 2018 [91] IVF/ICSI 1561,67721sPTB < 37 w; sPTB < 34
Alviggi et al., 2018 [92] blastocyst-embryo transfer14197,27581PTB < 37 w; LBW (<2500 g); VPTB < 32 w; VLBW (<1500 g); SGA; LGA; perinatal mortality and congenital anomaly
Cai et al., 2019 [93]3 (Rotating shiftwork, Fixed night shift, long working hours)62196,98971PTL; LBW; SGA; miscarriage; preeclampsia; gestational hypertension; IUGR
Haahr et al., 2019 [94]Bacterial vaginosis1229806 (2)1LBR; early spontaneous abortion rate; CPR; Biochemical pregnancy rate; Implantation rate; PTL < 37 w
Saccone et al., 2019 [95]Interventional radiology 1595841Estimated Blood Loss; Units of Packed red blood cells transfused; Blood Loss > 2.5 L; Red Blood Cells Transfused > 5 Units
Vermey et al., 2019 [96]ART336,178,94444 (ART vs. SC; non-ART (unspecified); non-ART (sub-fertile). FET-ART (frozen-embryo transfer) vs. SC)Placenta preavia; placenta abruption; morbidly adherent placenta; abnormal cord insertion
Cai et al., 2020 [84]Occupational activities80853,149131PTL (adjusted for confounders; unadjusted for confounders); LBW (adjusted for confounders; unadjusted for confounders); SGA (adjusted for confounders; unadjusted for confounders); Miscarriage (adjusted for confounders; unadjusted for confounders); Pre-eclampsia (adjusted for confounders; unadjusted for confounders); Gestational hypertension (adjusted for confounders; unadjusted for confounders); Intrauterine growth restriction
Backes et al., 2020 [97]Resuscitation and intensive care31222631Prevalence of survival; survival without major morbidity; prevalence of survival without moderate or severe neurologic impairment
Giorgione et al., 2020 [98]Pregnancy complicated by preeclampsia15unclear21 Incidence of hypertension after hypertensive disorders of pregnancies; incidence of hypertension after preeclampsia
Varghese et al., 2020 [99]Neoadjuvant chemotherapy17324981Overall complication; Flap losses (total and partial) in free-flap reconstruction; Flap losses (total and partial) for all autologous flaps (pedicled and free-flaps); Implant or Expander losses; Hematomas in all reconstructions; Seromas in all reconstructions; Wound complications in all reconstructions; Delay to adjuvant therapy
Joyeux et al., 2020 [100]Open fetal surgery for spina bifida aperta17unclear131Maternal death; Postoperative death ≤ 7 d; Mean operation time (min); Technical failure; PPROM < 30 + 0 w; Delivery < 30 + 0 w; In utero complete reversal of HH; Any treatment at repair site; Additional recovery at repair site; Improved motor function at birth; Complete reversal of HH at 12 months; CSF diversion at 12 months; Improved motor function at 30 months
Exposure: ART, Assisted reproduction technology; ICSI, intracytoplasmic; IUI, intrauterine insemination; IVF, in vitro fertilization. Outcome graded: APH, antepartum hemorrhage; BW, birth weight; CS, cesarean section; CSF, cerebrospinal fluid; CPR, Clinical pregnancy rate; FET-ART, frozen-embryo transfer; GA, gestational age; GDM, gestational diabetes mellitus; HH, hindbrain herniation; HIV, human immunodeficiency virus; IUGR, intrauterine growth restriction; IVH, Intraventricular hemorrhage, LBR, Live birth rate, LBW, low birth weight; LGA, Large for gestational age; LOS, Length of stay; NEC, necrotizing enterocolitis; PAc, placenta accrete; PAb, placental abruption; PE, pre-eclampsia; PIH, Hypertensive disorders of pregnancy; PP, placenta previa; PPH, postpartum hemorrhage; PPROM, preterm premature rupture of membranes; PROM, preterm rupture of membranes; PTB, Preterm birth; PTL, Preterm delivery; PTL, Preterm delivery; RDS, respiratory distress syndrome; ROP, retinopathy of prematurity; SGA, Small for gestational age; SPTB, Spontaneous preterm birth; VLBW, very low birth weight; VPTB, very preterm birth; VT, vanishing twin.
Table
Table 4. Summary of the study characteristics and the number and type of (un)rated outcomes of systematic reviews of RCTs/NRSs (n = 8) that rated the outcome-specific certainty of evidence with GRADE.
Table 4. Summary of the study characteristics and the number and type of (un)rated outcomes of systematic reviews of RCTs/NRSs (n = 8) that rated the outcome-specific certainty of evidence with GRADE.
Author, YearIntervention/ExposureStudy DesignNumber of StudiesNumber of ParticipantsNumber of Outcomes Rated (Number of Unrated Outcomes)Number of Rated ComparisonsOutcomes Rated
Armstrong et al., 2017 [103]Baseline anatomical assessment of the uterus and ovaries in infertile womenRCTs/NRSs (separately)19unclear31Diagnostic value of a baseline assessment of the uterus and ovaries with imaging or surgery; versus pelvic examination; Diagnostic value of transvaginal ultrasound; sonohysterography; hysteroscopy; HSG; HyCoSy and MRI in detecting uterine; endometrial and/or ovarian pathology; Prognostic value of assessment of the uterus and ovaries with imaging or surgery; on clinical pregnancy and live birth (became pregnant unassisted or through ART);
Shan et al., 2020 [109]Gabapentin and pregabalinRCTs and NRSs (separately)213519243 (placebo; estrogen; antidepressants)HF frequency (4 weeks; 8 weeks; 12 weeks; 24 weeks); HF duration (4 weeks; 12 weeks); HF severity (composite score): (4 weeks; 8 weeks; 12 weeks); Dizziness; Drop out of AE; Fatigue; Headache; Insomnia; Nausea; Somnolence; Weigh gain
Bellos et al., 2020 [104]Non-steroidal anti-inflammatory drugsRCTs and NRSs (combined)10164741Severe hypertension; Systolic blood pressure; Diastolic blood pressure; Mean arterial pressure
Zhang et al., 2020 [108]Sacrocolpopexy (transvaginalmesh surgery)RCTs/NRSs (separately)20unclear12 (3)1Anatomical success; Total vaginal length; Point C site; Subjective success; Mesh-related complications; Reoperation for prolapse recurrence; De novo dyspareunia; Operating time; Bladder injury; Bowel injury; Hematoma.
Grabovac et al., 2018 [106]Caesarean sectionRCTs/NRSs (NRS)1512,33571Death (23–27 + 6 w; 23- 24 + 6 w25; 26 + 6 weeks; 27–27 + 6 w); IVH gr III/IV (23–27 + 6 w; 25–26 + 6 w; 27–27 + 6 w)
Maheshwari et al., 2018 [107]Frozen embryoRCTs/NRSs (NRS)26940,04751SGA; BW < 2500 gm (low birth weight); LGA; PTL; PIH
Nassr et al., 2017 [104]Vesico-amniotic shuntRCTs/NRSs (combined)924642Perinatal survival; 6–12 month postnatal survival; 2-year postnatal survival; renal function of fetuses
Kim et al., 2017 [105]Self-administration of injectable contraceptivesRCTs/NRSs (separately)326410 (2)1Vontinuation (non-interrupted use at 12 months; non-interrupted use at 3 months); Satisfaction with the contraception method (want to continue this method) at 12 months; Satisfaction with the contraception method (prefer to continue the method) at 3 months; Satisfaction with the contraception method (recommend to a friend) at 12 months; Satisfaction with the contraception method at 3 months; Satisfaction in location (at 3 months)
Study design: RCTs, randomized controlled trials; NRSs, nonrandomized studies. Outcome graded: AE, Adverse Event; ART, assisted reproduction technology; BW, birth weight; HF, hot flash; HSG, hysterosalpingography; IVH, Intraventricular hemorrhage; LGA, Large for gestational age; PIH, Hypertensive disorders of pregnancy; PTL, Preterm delivery; SGA, Small for gestational age.
Table
Table 5. Summary of the systematic review characteristics.
Table 5. Summary of the systematic review characteristics.
Total SRs (n = 67)SRs of RCTs (n = 41)SRs of NRSs (n = 18)SRs of RCTs/NRSs (n = 8)
No of primary studies, median (IQR)15 (8–21)10 (6–20)17 (14–25)17 (9–21)
No of participants, median (IQR)3962 (1632–7238)2976 (1533.5–5412.75)5829 (2791–333,396)2583 (260–244,263)
No of summary of findings table6039147
No of meta-analysis conducted6441176
No of outcomes rated in a SR, median (IQR)5 (3–8)4 (3–8)6 (3–11)6 (4–11)
Category6741188
Drug therapy, n (%)28 (41.79)22 (53.66)3 (16.67)3 (37.50)
Surgical therapy, n (%)10 (14.93)6 (14.63)2 (11.11)2 (25.00)
Assisted reproductive, n (%)9 (13.43)3 (7.32)5 (27.78)1 (12.50)
Drug and Surgical therapy, n (%)2 (2.99)2 (4.88)00
Screening method, n (%)4 (5.97)2 (4.88)1 (5.56)1 (12.50)
Special disease, n (%)2 (2.99)02 (11.11)0
Reproductive strategy, n (%)1 (1.49)01 (5.56)0
Lifestyle factors, n (%)3 (4.48)1 (2.44)2 (11.11)0
Clinical care, n (%)1 (1.49)01 (5.56)0
Virus, n (%)1 (1.49)1 (2.44)00
Others, n (%)6 (8.96)4 (9.76)1 (5.56)1 (12.50)
IQR: interquartile range; NRSs, nonrandomized studies; RCTs, randomized controlled trials; SRs, systematic reviews.
Table
Table 6. Frequency of the rating domains according to study design.
Table 6. Frequency of the rating domains according to study design.
Total (%)RCTs (%)NRSs (%)RCTs/NRSs (%)
The rating of the certainty per outcome, n9466143248 (2 study)
High, n (%)110 (11.63)103 (16.78)7 (2.15)0
Moderate, n (%)167 (17.65)147 (23.94)19 (5.85)1 (12.50)
Low, n (%)269 (28.44)201 (32.74)66 (20.72)2 (25.00)
Very low, n (%)400 (42.28)163 (26.54)232 (71.58)5 (62.50)
Total number of downgrading domains, n1473 1027 427 19
Risk of bias, n (%)492 (33.40)334 (32.52)150 (35.13)8 (42.11)
Imprecision, n (%)582 (39.51)434 (42.26)143 (33.49)5 (26.31)
Inconsistency, n (%)201 (13.65)100 (9.73)98 (22.95)3 (15.79)
Indirectness, n (%)122 (8.28)104 (10.12)15 (3.51)3 (15.79)
Publication bias, n (%)76 (5.16)55 (5.36)21 (4.92)0
Total number of upgrading domains, n42042 0
Large effect, n (%)25(59.52)023 (54.76)0
Dose-response, n (%)1(2.38)01 (2.38)0
Plausible confounding, n (%)18(42.86)018 (42.86)0
Unclear, n (%)0000
Frequency of the rating domains
Mean frequency, n of Downgrading domains, n/
The rating of the certainty per outcome, n		1.56
1473/946		1.67
1027/614		1.32
427/324		2.38
19/8
Risk of bias, n (% of outcomes downgraded)492 (52.01)334 (54.40)150 (46.30)8 (100.00)
Imprecision, n (% of outcomes downgraded582 (61.52)434 (70.68)143 (44.14)5 (62.50)
Inconsistency, n (% of outcomes downgraded)201 (21.25)100 (16.29)98 (30.25)3 (37.50)
Indirectness, n (% of outcomes downgraded)122 (12.90)104 (16.94)15 (4.63)3 (37.50)
Publication bias, n (% of outcomes downgraded)76 (8.03)55 (8.96)21 (6.48)0
Mean frequency, n of Upgrading domains, n/
The rating of the certainty per outcome, n		0.05
42/946		0
0/614		0.13
42/324		0
Large effect, n (% of outcomes upgraded)25 (2.64)023 (7.10)0
Dose-response, n (% of outcomes upgraded)1 (0.11)01 (0.31)0
Plausible confounding, n (% of outcomes upgraded)18 (1.90)018 (5.56)0
Unclear, n (% of outcomes upgraded)0000
NRSs, nonrandomized studies; RCTs, randomized controlled trials; SRs, systematic reviews.

3.4. Upgrading and Downgrading Domains

The reasons for downgrading and upgrading are shown in Table 6. In total, 1473 instances of downgrading were identified, namely due to imprecision (39.51%), risk of bias (RoB) (33.40%), inconsistency (13.65%), indirectness (8.28%), and publication bias (5.16%), as well as 44 instances of upgrading due to large effect (59.52%), plausible confounding (42.86%), and dose-response (2.38%). Downgrading for imprecision and indirectness was more common in the SRs of RCTs (42.26%, 10.13%) compared to the SRs of NRSs (33.49%, 3.51%), whereas downgrading for RoB and inconsistencies was more common in the SRs of NRSs (35.13%, 22.95%), compared to the SRs of RCTs (32.52%, 9.74%). In addition, upgrading for dose-response, large effect, and plausible confounding were all in the SRs of NRSs.
We counted an approximate mean of 1.67 downgrades per outcome in the SRs of RCTs and a mean of 1.32 downgrades per outcome in the SRs of NRSs. The downgrading frequency (the number of downgrades per the number of rated outcomes) in the SRs of RCTs was higher for imprecision (70.68%), RoB (54.40%), indirectness (16.94%), and publication bias (8.96%), and lower for inconsistency (16.29%), compared to the downgrading frequencies encountered in the SRs of NRSs. Besides, 13.00% of outcomes rated to the SRs of NRSs were upgraded, 7.10% outcomes were upgraded for large effect, 5.56% for plausible confounding, and 0.31% for dose-response. Of note, no outcome was upgraded for unclear effect (Table 6). The reasons for the authors’ choice to downgrade or upgrade the certainty of evidence for outcomes are summarized in Table S2.

4. Discussion

4.1. Principal Findings

To the best of our knowledge, this is the first study to examine the extent to which GRADE has been used in SRs published in the top 10 gynecology and obstetrics journals with the highest impact factor, according to the JCR 2019. In the last five years, the number of SRs using GRADE to evaluate the certainty of evidence was relatively small, but the number of it showed an upward trend, reaching 18 (7.56%) in 2020. In general, this methodological survey shows there were only 67 SRs (7.04%) that rated the outcome specific certainty of evidence with GRADE. Four hundred (42.28%) and 269 (24.88%) individual outcomes were rated as very low and low, respectively. In the SRs of RCTs, the certainty of evidence was downgraded mostly for RoB and imprecision, while in the SRs of NRSs, the certainty of evidence was downgraded mostly for RoB, imprecision, and inconsistency.
It is a very important finding that such a low proportion of evidence evaluated using GRADE in gynecology and obstetrics is of high quality. There are several reasons for this. First, several limitations in clinical studies such as the lack of a clearly randomized allocation sequence, blinding, allocation concealment, and failure to adhere to intention-to-treat analysis are inevitable, and can lower the quality of the evidence. In our study, we found all these accounting for 33.40%, among downgrading domains. Second, in clinical studies, it can be difficult to control the number of participants. If the number of participants is low and the confidence interval is wide, the quality of the evidence will be downgraded due to imprecision. For example, in a RCT conducted by Armstrong, et al. [103], the number of women undergoing hysteroscopy after IVF (in vitro fertilization) failure was low, so the quality of evidence was downgraded for impression. In addition, indirectness, publication bias, and inconsistency are also reasons for such low quality.

4.2. Results in the Context of What Is Known

This is the first scoping review on the use of GRADE in gynecology and obstetrics, and other publications have also addressed the details, advantages, and challenges of the GRADE approach in the clinical field [110,111,112]. As noted in the findings of the scope review above, certainty of evidence in NRSs may be downgraded too much, which would appear to prevent the application of GRADE in such cases. However, solutions to this challenge may help to promote the use of the GRADE approach. For example, researchers have recommended using ROBINS-I in GRADE. ROBINS-I offers an alternative terminology: establishing NRS rather than observational studies, which will give researchers a more transparent way of separating studies by design. This placed RCTs and NRS on a common metric for risk of bias, and facilitated the comparison of evidence from both types of studies.
Considering that the research design is the initial and key point of GRADE, in determining the level of evidence, our research investigated the use of GRADE in the evaluation of evidence in gynecology and obstetrics, and additionally presented the use of down- and upgrading factors, according to the study design reviewed in the SRs. The results of our study were similar to findings reported by Cuello-Garcia and colleagues [113], which showed that most respondents would present pooled data from both RCTs and NRSs separately, either in a single Summary of Findings Table or each in its own table. As our sample size is small, these findings need to be supported by testing on a larger sample.

4.3. Implications for the Broader Research Field

Having been adopted by more than 100 organizations worldwide indicates that GRADE is a promising approach to evaluating the certainty of evidence and determining the strength of a recommendation. Ref. [11] However, our experience permits us to put forward a few recommendations on assessing certainty of evidence and strength of recommendations.
First, GRADE has been widely used for rating the level of evidence from both RCTs and NRS, but using GRADE to evaluate the certainty of evidence in NRSs continues to present some challenges. Since the study design is the initial and key consideration of GRADE to rate the initial certainty of evidence, RCTs start as “high”, whereas NRSs start as “low”, due to the risk of confounding and selection bias, users may improperly double count the risk of confounding and selection bias, so the certainty of evidence in NRSs may be downgraded excessively. Several opportunities for GRADE are presented by ROBINS-I (risk of bias in non-randomized studies of interventions) [114]. Since ROBINS-I places RCTs and NRS on a common metric for risk of bias, it may facilitate the comparison of evidence from both types of studies [114]. ROBINS-I does not consider study design as a risk of bias, such as cohort, case-control, case series, or cross sectional. The GRADE certainty of evidence from a body of studies using NRS designs would be high when ROBINS-I is used to assess risk of bias in NRS, since selection bias and confounding are assessed as integral components of ROBINS-I [114]. In addition, ROBINS-I provides a way to assess whether failure to use randomization in individual studies impacts bias risk and harmonizes GRADE approaches for different types of questions, such as prognosis and test accuracy [114]. In order to accurately rate the certainty of a body of evidence, it is highly recommended to use ROBINS-I in GRADE.
Second, while GRADE provides a framework for a systematic, transparent, and explicit assessment of the certainty of evidence and strength of recommendations, using GRADE will commonly involve some subjective judgments, and result in various assessments [115,116]. For example, if the GRADE users are uncertain about the exact ratings for multiple domains or when the same issue affects multiple domains, they may render various judgments. In this case, GRADE users should consider the domains together and choose the worst rating considered in one domain and the best rating considered in the other. Further, transparency requires presenting the reasoning for all judgments. Third, for better recommendations, individual patient conditions, preferences, and values should also be considered in addition to the certainty of evidence, as well as other important factors in GRADE approach.

5. Strengths and Limitations

Our study has several strengths. Firstly, we performed a rigorous screening and extensive data extraction, with information such as the number of outcomes rated and unrated outcomes, number and reason identified for down- and upgrading domains being included. Secondly, this is the first study to examine the extent to which GRADE has been used in SRs published in gynecology and obstetrics journals, which may contribute to improving the process of evidence-informed diagnostic methods in this area.
Limitations of this study are as follows. Firstly, our study focused on SRs published in the top 10 gynecology and obstetrics journals within a time frame limited to 5 years, which consequently resulted in a relatively small sample size (n = 67) and lack of inclusion in other medical and lower-ranked gynecology and obstetrics journals. Nevertheless, SRs published in high-impact medical journals are more likely to be relevant for future research and to provide evidence for clinical practice. Second, prior to this study, no official research protocol about GRADE use had been published, therefore, we reported our findings following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) framework where applicable to study design. Third, our study was based on a descriptive examination of GRADE use in SRs in gynecological and obstetric, rather than determining whether the authors followed criteria conducted by the GRADE working group to rate the certainty of the outcomes. Our study indicates that some authors may misconstrue GRADE domains. For example, the certainty of evidence in SRs was upgraded due to low RoB, narrow confidence intervals, very low P-values and mild statistical heterogeneity, rather than upgrading domains. Therefore, future research should give priority to the optimal use of the GRADE approach. Finally, no time trends are addressed or assessed in this report. GRADE system adoption has possibly increased and improved over time.

6. Conclusions

This methodological investigation attempts to reveal the application of GRADE in gynecology and obstetrics. As an explicit, comprehensive, transparent, and pragmatic evaluation system, GRADE gives the strength of evidence and recommended significance for each outcome, which makes it important to evaluate the certainty of the review evidence in obstetrics and gynecology. Our study shows that the use of rating the certainty of evidence in gynecology and obstetrics SR is relatively few. More attention should be paid to the use of ROBINS-I in GRADE, to the transparency of GRADE in the evaluation of evidence, and the actual situation of patients in the synthesis of gynecology and obstetrics evidence, to provide evidence for the final decision of clinical researchers and clinicians.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm12020446/s1, Figure S1: Flow diagram showing study selection process; Table S1: Overview of SRs that applied GRADE incorrectly* by rating the certainty of evidence for all studies or each individual study; Table S2: Overview of the GRADE domains of systematic reviews that rated the outcome-specific certainty of evidence.

Author Contributions

Data curation, H.-J.Y., D.-Y.Z., H.-L.X., Y.-Z.L., S.Z. and X.-Y.L.; Formal analysis, H.-J.Y., D.-Y.Z. and Y.-Y.H.; Methodology, T.-T.G. and Q.-J.W.; Writing—original draft, H.-J.Y., D.-Y.Z., Y.-Y.H., T.-T.G. and Q.-J.W.; Writing—review & editing, S.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Key R&D Program of China (No. 2022YFC2704200 to W.Q.J.), Natural Science Foundation of China (No. 82073647 to W.Q.J., and 82103914 to G.T.T.), LiaoNing Revitalization Talents Program (No. XLYC1907102 to W.Q.J.), and 345 Talent Project of Shengjing Hospital of China Medical University (No. M0268 to W.Q.J. and No. M0952 to G.T.T.).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data is contained within the article or Supplementary Material.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Cook, D.J.; Mulrow, C.D.; Haynes, R.B. Systematic reviews: Synthesis of best evidence for clinical decisions. Ann. Intern. Med. 1997, 126, 376–380. [Google Scholar] [CrossRef] [PubMed]
  2. Chmielewska, B.; Barratt, I.; Townsend, R.; Kalafat, E.; van der Meulen, J.; Gurol-Urganci, I.; O’Brien, P.; Morris, E.; Draycott, T.; Thangaratinam, S.; et al. Effects of the COVID-19 pandemic on maternal and perinatal outcomes: A systematic review and meta-analysis. Lancet Glob. Health 2021, 9, e759–e772. [Google Scholar] [CrossRef] [PubMed]
  3. Chawanpaiboon, S.; Vogel, J.P.; Moller, A.B.; Lumbiganon, P.; Petzold, M.; Hogan, D.; Landoulsi, S.; Jampathong, N.; Kongwattanakul, K.; Laopaiboon, M.; et al. Global, regional, and national estimates of levels of preterm birth in 2014: A systematic review and modelling analysis. Lancet Glob. Health 2019, 7, e37–e46. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Davies, C.; Segre, G.; Estrade, A.; Radua, J.; De Micheli, A.; Provenzani, U.; Oliver, D.; Salazar de Pablo, G.; Ramella-Cravaro, V.; Besozzi, M.; et al. Prenatal and perinatal risk and protective factors for psychosis: A systematic review and meta-analysis. Lancet Psychiatry 2020, 7, 399–410. [Google Scholar] [CrossRef] [PubMed]
  5. Derakhshan, A.; Peeters, R.P.; Taylor, P.N.; Bliddal, S.; Carty, D.M.; Meems, M.; Vaidya, B.; Chen, L.; Knight, B.A.; Ghafoor, F.; et al. Association of maternal thyroid function with birthweight: A systematic review and individual-participant data meta-analysis. Lancet Diabetes Endocrinol. 2020, 8, 501–510. [Google Scholar] [CrossRef]
  6. Toloza, F.J.; Derakhshan, A.; Männistö, T.; Bliddal, S.; Popova, P.V.; Carty, D.M.; Chen, L.; Taylor, P.; Mosso, L.; Oken, E.; et al. Endocrinology, Association between maternal thyroid function and risk of gestational hypertension and pre-eclampsia: A systematic review and individual-participant data meta-analysis. Lancet Diabetes Endocrinol. 2022, 10, 243–252. [Google Scholar] [CrossRef]
  7. Pussegoda, K.; Turner, L.; Garritty, C.; Mayhew, A.; Skidmore, B.; Stevens, A.; Boutron, I.; Sarkis-Onofre, R.; Bjerre, L.M.; Hróbjartsson, A.; et al. Systematic review adherence to methodological or reporting quality. Syst. Rev. 2017, 6, 131. [Google Scholar] [CrossRef] [Green Version]
  8. Ioannidis, J.P. The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta-analyses. Milbank Q. 2016, 94, 485–514. [Google Scholar] [CrossRef] [Green Version]
  9. Guyatt, G.H.; Oxman, A.D.; Vist, G.E.; Kunz, R.; Falck-Ytter, Y.; Alonso-Coello, P.; Schünemann, H.J. GRADE: An emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008, 336, 924–926. [Google Scholar] [CrossRef] [Green Version]
  10. Hsu., J.; Brożek, J.L.; Terracciano, L.; Kreis, J.; Compalati, E.; Stein, A.T.; Fiocchi, A.; Schünemann, H.J. Application of GRADE: Making evidence-based recommendations about diagnostic tests in clinical practice guide-lines. Implement Sci. 2011, 6, 62. [Google Scholar] [CrossRef]
  11. Siemieniuk, R.; Guyatt, G. What is GRADE. BMJ J. Best Practi. 2019, 10. Available online: https://bophin-com.ngontinh24.com/article/what-is-grade-bmj-best-practice (accessed on 6 November 2022).
  12. Goldet, G.; Howick, J. Understanding GRADE: An introduction. J. Evid. Based Med. 2013, 6, 50–54. [Google Scholar] [CrossRef]
  13. Guyatt, G.H.; Oxman, A.D.; Kunz, R.; Vist, G.E.; Falck-Ytter, Y.; Schünemann, H.J. What is “quality of evidence” and why is it important to clinicians? BMJ 2008, 336, 995–998. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Guyatt, G.H.; Oxman, A.D.; Kunz, R.; Falck-Ytter, Y.; Vist, G.E.; Liberati, A.; Schünemann, H.J. Going from evidence to recommendations. BMJ 2008, 336, 1049–1051. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Werner, S.S.; Binder, N.; Toews, I.; Schünemann, H.J.; Meerpohl, J.J.; Schwingshackl, L. Use of GRADE in evidence syntheses published in high-impact-factor nutrition journals: A methodological survey. J. Clin. Epidemiol. 2021, 135, 54–69. [Google Scholar] [CrossRef]
  16. Zhang, S.; Wu, Q.J.; Liu, S.X. A methodologic survey on use of the GRADE approach in evidence syntheses published in high-impact factor urology and nephrology journals. BMC Med. Res. Methodol. 2022, 22, 220. [Google Scholar] [CrossRef] [PubMed]
  17. Fell, D.B.; Savitz, D.A.; Kramer, M.S.; Gessner, B.D.; Katz, M.A.; Knight, M.; Luteijn, J.M.; Marshall, H.; Bhat, N.; Gravett, M.G.; et al. Maternal influenza and birth outcomes: Systematic review of comparative studies. BJOG 2017, 124, 48–59. [Google Scholar] [CrossRef]
  18. Barra, F.; Scala, C.; Biscaldi, E.; Vellone, V.G.; Ceccaroni, M.; Terrone, C.; Ferrero, S. Ureteral endometriosis: A systematic review of epidemiology, pathogenesis, diagnosis, treatment, risk of malignant transformation and fertility. Hum. Reprod. Update 2018, 24, 710–730. [Google Scholar] [CrossRef] [Green Version]
  19. O’Shea, L.E.; Hawkins, J.E.; Lord, J.; Schmidt-Hansen, M.; Hasler, E.; Cameron, S.; Cameron, I.T. Access to and sustainability of abortion services: A systematic review and meta-analysis for the National Institute of Health and Care Excellence-new clinical guidelines for England. Hum. Reprod. Update 2020, 26, 886–903. [Google Scholar] [CrossRef]
  20. Suarez, S.; Conde-Agudelo, A.; Borovac-Pinheiro, A.; Suarez-Rebling, D.; Eckardt, M.; Theron, G.; Burke, T.F. Uterine balloon tamponade for the treatment of postpartum hemorrhage: A systematic review and meta-analysis. Am. J. Obstet. Gynecol. 2020, 222, 293.e1–293.e52. [Google Scholar] [CrossRef]
  21. Wolf, H.T.; Hegaard, H.K.; Huusom, L.D.; Pinborg, A.B. Multivitamin use and adverse birth outcomes in high-income countries: A systematic review and meta-analysis. Am. J. Obstet. Gynecol. 2017, 217, 404.e1–404.e30. [Google Scholar] [CrossRef] [PubMed]
  22. Di Spiezio Sardo, A.; Saccone, G.; McCurdy, R.; Bujold, E.; Bifulco, G.; Berghella, V. Risk of Cesarean scar defect following single- vs double-layer uterine closure: Systematic review and meta-analysis of randomized controlled trials. Ultrasound Obstet. Gynecol. 2017, 50, 578–583. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. van den Beukel, B.A.; de Ree, R.; van Leuven, S.; Bakkum, E.A.; Strik, C.; van Goor, H.; Ten Broek, R.P.G. Surgical treatment of adhesion-related chronic abdominal and pelvic pain after gynaecological and general surgery: A systematic review and meta-analysis. Hum. Reprod. Update 2017, 23, 276–288. [Google Scholar]
  24. Conde-Agudelo, A.; Romero, R.; Nicolaides, K.H. Cervical pessary to prevent preterm birth in asymptomatic high-risk women: A systematic review and meta-analysis. Am. J. Obstet. Gynecol. 2020, 223, 42–65.e2. [Google Scholar] [CrossRef]
  25. Lichter, K.; Krause, D.; Xu, J.; Tsai, S.H.L.; Hage, C.; Weston, E.; Eke, A.; Levinson, K. Adjuvant Human Papillomavirus Vaccine to Reduce Recurrent Cervical Dysplasia in Unvaccinated Women: A Systematic Review and Meta-analysis. Obstet. Gynecol. 2020, 135, 1070–1083. [Google Scholar] [CrossRef] [PubMed]
  26. Menzies, R.; Li, A.L.K.; Melamed, N.; Shah, P.S.; Horn, D.; Barrett, J.; Murphy, K.E. Risk of singleton preterm birth after prior twin preterm birth: A systematic review and meta-analysis. Am. J. Obstet. Gynecol. 2020, 223, 204.e1–204.e8. [Google Scholar] [CrossRef] [PubMed]
  27. Bernardes, T.P.; Zwertbroek, E.F.; Broekhuijsen, K.; Koopmans, C.; Boers, K.; Owens, M.; Thornton, J.; van Pampus, M.G.; Scherjon, S.A.; Wallace, K.; et al. Delivery or expectant management for prevention of adverse maternal and neonatal outcomes in hypertensive disorders of pregnancy: An individual participant data meta-analysis. Ultrasound Obstet. Gynecol. 2019, 53, 443–453. [Google Scholar] [CrossRef]
  28. Oliver-Williams, C.; Glisic, M.; Shahzad, S.; Brown, E.; Pellegrino Baena, C.; Chadni, M.; Chowdhury, R.; Franco, O.H.; Muka, T. The route of administration, timing, duration and dose of postmenopausal hormone therapy and cardiovascular outcomes in women: A systematic review. Hum. Reprod. Update 2019, 25, 257–271. [Google Scholar] [CrossRef]
  29. Roque, M.; Haahr, T.; Geber, S.; Esteves, S.C.; Humaidan, P. Fresh versus elective frozen embryo transfer in IVF/ICSI cycles: A systematic review and meta-analysis of reproductive outcomes. Hum. Reprod. Update 2019, 25, 2–14. [Google Scholar] [CrossRef]
  30. Magee, L.A. Oral nifedipine or intravenous labetalol for severe hypertension? BJOG 2016, 123, 48. [Google Scholar] [CrossRef] [Green Version]
  31. Wolf, H.T.; Huusom, L.D.; Henriksen, T.B.; Hegaard, H.K.; Brok, J.; Pinborg, A. Magnesium sulphate for fetal neuroprotection at imminent risk for preterm delivery: A systematic review with meta-analysis and trial sequential analysis. BJOG 2020, 127, 1180–1188. [Google Scholar] [CrossRef]
  32. Bogani, G.; Fuca, G.; Maltese, G.; Ditto, A.; Martinelli, F.; Signorelli, M.; Chiappa, V.; Scaffa, C.; Sabatucci, I.; Lecce, F.; et al. Efficacy of adjuvant chemotherapy in early stage uterine leiomyosarcoma: A systematic review and meta-analysis. Gynecol. Oncol. 2016, 143, 443–447. [Google Scholar] [CrossRef] [PubMed]
  33. Evans, E.C.; Matteson, K.A.; Orejuela, F.J.; Alperin, M.; Balk, E.M.; El-Nashar, S.; Gleason, J.L.; Grimes, C.; Jeppson, P.; Mathews, C.; et al. Salpingo-oophorectomy at the Time of Benign Hysterectomy: A Systematic Review. Obstet. Gynecol. 2016, 128, 476–485. [Google Scholar] [CrossRef] [Green Version]
  34. Blanton, E.; Lamvu, G.; Patanwala, I.; Barron, K.I.; Witzeman, K.; Tu, F.F.; As-Sanie, S. Non-opioid pain management in benign minimally invasive hysterectomy: A systematic review. Am. J. Obstet. Gynecol. 2017, 216, 557–567. [Google Scholar] [CrossRef] [PubMed]
  35. Gemmell, L.C.; Webster, K.E.; Kirtley, S.; Vincent, K.; Zondervan, K.T.; Becker, C.M. The management of menopause in women with a history of endometriosis: A systematic review. Hum. Reprod. Update 2017, 23, 481–500. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Joint, R.; Chen, Z.E.; Cameron, S. Breast and reproductive cancers in the transgender population: A systematic review. BJOG 2018, 125, 1505–1512. [Google Scholar] [CrossRef] [Green Version]
  37. Simsek, M.; Lambalk, C.B.; Wilschut, J.A.; Mulder, C.J.J.; de Boer, N.K.H. The associations of thiopurines with male fertility and paternally exposed offspring: A systematic review and meta-analysis. Hum. Reprod. Update 2018, 24, 192–206. [Google Scholar] [CrossRef] [Green Version]
  38. Nahshon, C.; Segev, Y.; Gemer, O.; Bar Noy, T.; Schmidt, M.; Ostrovsky, L.; Lavie, O. Should the risk for uterine cancer influence decision making for prophylactic hysterectomy in BRCA1/2 mutated patients- a systematic review and meta-analysis. Gynecol. Oncol. 2021, 160, 755–762. [Google Scholar] [CrossRef]
  39. Asenius, F.; Danson, A.F.; Marzi, S.J. DNA methylation in human sperm: A systematic review. Hum. Reprod. Update 2020, 26, 841–873. [Google Scholar] [CrossRef]
  40. Nudelman, M.J.R.; Belogolovsky, E.; Jegatheesan, P.; Govindaswami, B.; Song, D. Effect of Delayed Cord Clamping on Umbilical Blood Gas Values in Term Newborns: A Systematic Review. Obstet. Gynecol. 2020, 135, 576–582. [Google Scholar] [CrossRef] [Green Version]
  41. Orr, L.; Reisinger-Kindle, K.; Roy, A.; Levine, L.; Connolly, K.; Visintainer, P.; Schoen, C.N. Combination of Foley and prostaglandins versus Foley and oxytocin for cervical ripening: A network meta-analysis. Am. J. Obstet. Gynecol. 2020, 223, 743.e1–743.e17. [Google Scholar] [CrossRef] [PubMed]
  42. Storgaard, M.; Loft, A.; Bergh, C.; Wennerholm, U.B.; Soderstrom-Anttila, V.; Romundstad, L.B.; Aittomaki, K.; Oldereid, N.; Forman, J.; Pinborg, A. Obstetric and neonatal complications in pregnancies conceived after oocyte donation: A systematic review and meta-analysis. BJOG 2017, 124, 561–572. [Google Scholar] [CrossRef] [PubMed]
  43. Bergeron, C.; Laberge, P.Y.; Boutin, A.; Theriault, M.A.; Valcourt, F.; Lemyre, M.; Maheux-Lacroix, S. Endometrial ablation or resection versus levonorgestrel intra-uterine system for the treatment of women with heavy menstrual bleeding and a normal uterine cavity: A systematic review with meta-analysis. Hum. Reprod. Update 2020, 26, 302–311. [Google Scholar] [CrossRef] [PubMed]
  44. Wei, D.; Chen, Y.; Wu, C.; Wu, Q.; Yao, L.; Wang, Q.; Wang, X.Q.; Yang, K.H. Effect and safety of paroxetine for vasomotor symptoms: Systematic review and meta-analysis. BJOG 2016, 123, 1735–1743. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Ryden, L.; Heibert Arnlind, M.; Vitols, S.; Hoistad, M.; Ahlgren, J. Aromatase inhibitors alone or sequentially combined with tamoxifen in postmenopausal early breast cancer compared with tamoxifen or placebo—Meta-analyses on efficacy and adverse events based on randomized clinical trials. Breast 2016, 26, 106–114. [Google Scholar] [CrossRef] [PubMed]
  46. Nastri, C.O.; Nobrega, B.N.; Teixeira, D.M.; Amorim, J.; Diniz, L.M.M.; Barbosa, M.W.P.; Giorgi, V.S.I.; Pileggi, V.N.; Martins, W.P. Low versus atmospheric oxygen tension for embryo culture in assisted reproduction: A systematic review and meta-analysis. Fertil. Steril. 2016, 106, 95–104.e17. [Google Scholar] [CrossRef] [Green Version]
  47. Di Spiezio Sardo, A.; Di Carlo, C.; Minozzi, S.; Spinelli, M.; Pistotti, V.; Alviggi, C.; De Placido, G.; Nappi, C.; Bifulco, G. Efficacy of hysteroscopy in improving reproductive outcomes of infertile couples: A systematic review and meta-analysis. Hum. Reprod. Update 2016, 22, 479–496. [Google Scholar] [CrossRef] [Green Version]
  48. Barbosa, M.W.; Silva, L.R.; Navarro, P.A.; Ferriani, R.A.; Nastri, C.O.; Martins, W.P. Dydrogesterone vs progesterone for luteal-phase support: Systematic review and meta-analysis of randomized controlled trials. Ultrasound Obstet. Gynecol. 2016, 48, 161–170. [Google Scholar] [CrossRef] [Green Version]
  49. Martins, W.P.; Ferriani, R.A.; Navarro, P.A.; Nastri, C.O. GnRH agonist during luteal phase in women undergoing assisted reproductive techniques: Systematic review and meta-analysis of randomized controlled trials. Ultrasound Obstet. Gynecol. 2016, 47, 144–151. [Google Scholar] [CrossRef] [Green Version]
  50. Tsiami, A.; CAMavridis, D.; Siskou, M.; Assimakopoulos, E.; Sotiriadis, A. Surgical treatment for hydrosalpinx prior to in-vitro fertilization embryo transfer: A network meta-analysis. Ultrasound Obstet. Gynecol. 2016, 48, 434–445. [Google Scholar] [CrossRef]
  51. Kollmann, M.; Martins, W.P.; Lima, M.L.; Craciunas, L.; Nastri, C.O.; Richardson, A.; Raine-Fenning, N. Strategies for improving outcome of assisted reproduction in women with polycystic ovary syndrome: Systematic review and meta-analysis. Ultrasound Obstet. Gynecol. 2016, 48, 709–718. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  52. Berghella, V.; Ciardulli, A.; Rust, O.A.; To, M.; Otsuki, K.; Althuisius, S.; Nicolaides, K.H.; Roman, A.; Saccone, G. Cerclage for sonographic short cervix in singleton gestations without prior spontaneous preterm birth: Systematic review and meta-analysis of randomized controlled trials using individual patient-level data. Ultrasound Obstet. Gynecol. 2017, 50, 569–577. [Google Scholar] [CrossRef] [PubMed]
  53. Berghella, V.; Palacio, M.; Ness, A.; Alfirevic, Z.; Nicolaides, K.H.; Saccone, G. Cervical length screening for prevention of preterm birth in singleton pregnancy with threatened preterm labor: Systematic review and meta-analysis of randomized controlled trials using individual patient-level data. Ultrasound Obstet. Gynecol. 2017, 49, 322–329. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  54. Romero, R.; Conde-Agudelo, A.; El-Refaie, W.; Rode, L.; Brizot, M.L.; Cetingoz, E.; Serra, V.; Da Fonseca, E.; Abdelhafez, M.S.; Tabor, A.; et al. Vaginal progesterone decreases preterm birth and neonatal morbidity and mortality in women with a twin gestation and a short cervix: An updated meta-analysis of individual patient data. Ultrasound Obstet. Gynecol. 2017, 49, 303–314. [Google Scholar] [CrossRef] [Green Version]
  55. Bechtejew, T.N.; Nadai, M.N.; Nastri, C.O.; Martins, W.P. Clomiphene citrate and letrozole to reduce follicle-stimulating hormone consumption during ovarian stimulation: Systematic review and meta-analysis. Ultrasound Obstet. Gynecol. 2017, 50, 315–323. [Google Scholar] [CrossRef] [Green Version]
  56. Sjostrom, S.; Dragoman, M.; Fonhus, M.S.; Ganatra, B.; Gemzell-Danielsson, K. Effectiveness, safety, and acceptability of first-trimester medical termination of pregnancy performed by non-doctor providers: A systematic review. BJOG 2017, 124, 1928–1940. [Google Scholar] [CrossRef] [Green Version]
  57. Pinto-Lopes, R.; Sousa-Pinto, B.; Azevedo, L.F. Single dose versus multiple dose of antibiotic prophylaxis in caesarean section: A systematic review and meta-analysis. BJOG 2017, 124, 595–605. [Google Scholar] [CrossRef]
  58. Saccone, G.; Khalifeh, A.; Elimian, A.; Bahrami, E.; Chaman-Ara, K.; Bahrami, M.A.; Berghella, V. Vaginal progesterone vs intramuscular 17alpha-hydroxyprogesterone caproate for prevention of recurrent spontaneous preterm birth in singleton gestations: Systematic review and meta-analysis of randomized controlled trials. Ultrasound Obstet. Gynecol. 2017, 49, 315–321. [Google Scholar] [CrossRef] [Green Version]
  59. Luque-Ramirez, M.; Nattero-Chavez, L.; Ortiz Flores, A.E.; Escobar-Morreale, H.F. Combined oral contraceptives and/or antiandrogens versus insulin sensitizers for polycystic ovary syndrome: A systematic review and meta-analysis. Hum. Reprod. Update 2018, 24, 225–241. [Google Scholar] [CrossRef]
  60. Senra, J.C.; Roque, M.; Talim, M.C.T.; Reis, F.M.; Tavares, R.L.C. Gonadotropin-releasing hormone agonists for ovarian protection during cancer chemotherapy: Systematic review and meta-analysis. Ultrasound Obstet. Gynecol. 2018, 51, 77–86. [Google Scholar] [CrossRef] [Green Version]
  61. Kalafat, E.; Sukur, Y.E.; Abdi, A.; Thilaganathan, B.; Khalil, A. Metformin for prevention of hypertensive disorders of pregnancy in women with gestational diabetes or obesity: Systematic review and meta-analysis of randomized trials. Ultrasound Obstet. Gynecol. 2018, 52, 706–714. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  62. Vitagliano, A.; Di Spiezio Sardo, A.; Saccone, G.; Valenti, G.; Sapia, F.; Kamath, M.S.; Blaganje, M.; Andrisani, A.; Ambrosini, G. Endometrial scratch injury for women with one or more previous failed embryo transfers: A systematic review and meta-analysis of randomized controlled trials. Fertil. Steril. 2018, 110, 687–702.e2. [Google Scholar] [CrossRef] [PubMed]
  63. Vitagliano, A.; Noventa, M.; Saccone, G.; Gizzo, S.; Vitale, S.G.; Lagana, A.S.; Litta, P.S.; Saccardi, C.; Nardelli, G.B.; Di Spiezio Sardo, A. Endometrial scratch injury before intrauterine insemination: Is it time to re-evaluate its value? Evidence from a systematic review and meta-analysis of randomized controlled trials. Fertil. Steril. 2018, 109, 84–96.e4. [Google Scholar] [CrossRef] [Green Version]
  64. Siristatidis, C.; Vaidakis, D.; Sertedaki, E.; Martins, W.P. Effect of human papilloma virus infection on in-vitro fertilization outcome: Systematic review and meta-analysis. Ultrasound Obstet. Gynecol. 2018, 51, 87–93. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  65. Gadalla, M.A.; Huang, S.; Wang, R.; Norman, R.J.; Abdullah, S.A.; El Saman, A.M.; Ismail, A.M.; van Wely, M.; Mol, B.W.J. Effect of clomiphene citrate on endometrial thickness, ovulation, pregnancy and live birth in anovulatory women: Systematic review and meta-analysis. Ultrasound Obstet. Gynecol. 2018, 51, 64–76. [Google Scholar] [CrossRef]
  66. Romero, R.; Conde-Agudelo, A.; Da Fonseca, E.; O’Brien, J.M.; Cetingoz, E.; Creasy, G.W.; Hassan, S.S.; Nicolaides, K.H. Vaginal progesterone for preventing preterm birth and adverse perinatal outcomes in singleton gestations with a short cervix: A meta-analysis of individual patient data. Am. J. Obstet. Gynecol. 2018, 218, 161–180. [Google Scholar] [CrossRef] [Green Version]
  67. Matthewman, G.; Lee, A.; Kaur, J.G.; Daley, A.J. Physical activity for primary dysmenorrhea: A systematic review and meta-analysis of randomized controlled trials. Am. J. Obstet. Gynecol. 2018, 219, 255.e1–255.e20. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  68. Fang, F.; Bai, Y.; Zhang, Y.; Faramand, A. Oil-based versus water-based contrast for hysterosalpingography in infertile women: A systematic review and meta-analysis of randomized controlled trials. Fertil. Steril. 2018, 110, 153–160.e3. [Google Scholar] [CrossRef]
  69. Vitagliano, A.; Saccone, G.; Noventa, M.; Borini, A.; Coccia, M.E.; Nardelli, G.B.; Saccardi, C.; Bifulco, G.; Litta, P.S.; Andrisani, A. Pituitary block with gonadotrophin-releasing hormone antagonist during intrauterine insemination cycles: A systematic review and meta-analysis of randomised controlled trials. BJOG 2019, 126, 167–175. [Google Scholar] [CrossRef] [Green Version]
  70. Jarde, A.; LOBeyene, J.; McDonald, S.D. Vaginal progesterone, oral progesterone, 17-OHPC, cerclage, and pessary for preventing preterm birth in at-risk singleton pregnancies: An updated systematic review and network meta-analysis. BJOG 2019, 126, 556–567. [Google Scholar] [CrossRef] [Green Version]
  71. Baiju, N.; Acharya, G.; D'Antonio, F.; Berg, R.C. Effectiveness, safety and acceptability of self-assessment of the outcome of first-trimester medical abortion: A systematic review and meta-analysis. BJOG 2019, 126, 1536–1544. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  72. Bosdou, J.K.; Venetis, C.A.; Tarlatzis, B.C.; Grimbizis, G.F.; Kolibianakis, E.M. Higher probability of live-birth in high, but not normal, responders after first frozen-embryo transfer in a freeze-only cycle strategy compared to fresh-embryo transfer: A meta-analysis. Hum. Reprod. 2019, 34, 491–505. [Google Scholar] [CrossRef] [PubMed]
  73. Wang, R.; Li, W.; Bordewijk, E.M.; Legro, R.S.; Zhang, H.; Wu, X.; Gao, J.; Morin-Papunen, L.; Homburg, R.; Konig, T.E.; et al. First-line ovulation induction for polycystic ovary syndrome: An individual participant data meta-analysis. Hum. Reprod. Update 2019, 25, 717–732. [Google Scholar] [CrossRef] [PubMed]
  74. Sotiriadis, A.; Petousis, S.; Thilaganathan, B.; Figueras, F.; Martins, W.P.; Odibo, A.O.; Dinas, K.; Hyett, J. Maternal and perinatal outcomes after elective induction of labor at 39 weeks in uncomplicated singleton pregnancy: A meta-analysis. Ultrasound Obstet. Gynecol. 2019, 53, 26–35. [Google Scholar] [CrossRef] [Green Version]
  75. Li, L.; Zhang, Y.; Tan, H.; Bai, Y.; Fang, F.; Faramand, A.; Chong, W.; Hai, Y. Effect of progestogen for women with threatened miscarriage: A systematic review and meta-analysis. BJOG 2020, 127, 1055–1063. [Google Scholar] [CrossRef]
  76. Qin, X.; Coyle, M.E.; Yang, L.; Liang, J.; Wang, K.; Guo, X.; Zhang, A.L.; Mao, W.; Lu, C.; Xue, C.C.; et al. Acupuncture for recurrent urinary tract infection in women: A systematic review and meta-analysis. BJOG 2020, 127, 1459–1468. [Google Scholar] [CrossRef]
  77. Danhof, N.A.; Wang, R.; van Wely, M.; van der Veen, F.; Mol, B.W.J.; Mochtar, M.H. IUI for unexplained infertility-a network meta-analysis. Hum. Reprod. Update 2020, 26, 1–15. [Google Scholar] [CrossRef]
  78. Islam, N.; Furuya-Kanamori, L.; Mahmood, S.; Thalib, L. Prophylactic antibiotics for preventing genital tract infection in women undergoing surgical procedures for incomplete abortion: A systematic review and meta-analysis of randomised controlled trials. BJOG 2021, 128, 1273–1281. [Google Scholar] [CrossRef]
  79. Bordewijk, E.M.; Wang, R.; van Wely, M.; Costello, M.F.; Norman, R.J.; Teede, H.; Gurrin, L.C.; Mol, B.W.; Li, W. To share or not to share data: How valid are trials evaluating first-line ovulation induction for polycystic ovary syndrome? Hum. Reprod. Update 2020, 26, 929–941. [Google Scholar] [CrossRef]
  80. Chatzakis, C.; Papatheodorou, S.; Sarafidis, K.; Dinas, K.; Makrydimas, G.; Sotiriadis, A. Effect on perinatal outcome of prophylactic antibiotics in preterm prelabor rupture of membranes: Network meta-analysis of randomized controlled trials. Ultrasound Obstet. Gynecol. 2020, 55, 20–31. [Google Scholar] [CrossRef]
  81. Di Mascio, D.; Saccone, G.; Bellussi, F.; Al-Kouatly, H.B.; Brunelli, R.; Benedetti Panici, P.; Liberati, M.; D’Antonio, F.; Berghella, V. Delayed versus immediate pushing in the second stage of labor in women with neuraxial analgesia: A systematic review and meta-analysis of randomized controlled trials. Am. J. Obstet. Gynecol. 2020, 223, 189–203. [Google Scholar] [CrossRef] [PubMed]
  82. Samy, A.; Raslan, A.N.; Talaat, B.; El Lithy, A.; El Sharkawy, M.; Sharaf, M.F.; Hussein, A.H.; Amin, A.H.; Ibrahim, A.M.; Elsherbiny, W.S.; et al. Perioperative nonhormonal pharmacological interventions for bleeding reduction during open and minimally invasive myomectomy: A systematic review and network meta-analysis. Fertil. Steril. 2020, 113, 224–233.e6. [Google Scholar] [CrossRef] [PubMed]
  83. Stewart, P.; Blanchette, P.; Shah, P.S.; Ye, X.Y.; Boldt, R.G.; Fernandes, R.; Vandenberg, T.; Raphael, J. Do all patients with HER2 positive breast cancer require one year of adjuvant trastuzumab? A systematic review and meta-analysis. Breast 2020, 54, 203–210. [Google Scholar] [CrossRef] [PubMed]
  84. Cai, C.; Vandermeer, B.; Khurana, R.; Nerenberg, K.; Featherstone, R.; Sebastianski, M.; Davenport, M.H. The impact of occupational activities during pregnancy on pregnancy outcomes: A systematic review and metaanalysis. Am. J. Obstet. Gynecol. 2020, 222, 224–238. [Google Scholar] [CrossRef] [PubMed]
  85. Mowat, A.; Maher, C.; Ballard, E. Surgical outcomes for low-volume vs high-volume surgeons in gynecology surgery: A systematic review and meta-analysis. Am. J. Obstet. Gynecol. 2016, 215, 21–33. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  86. Zafer, M.; Horvath, H.; Mmeje, O.; van der Poel, S.; Semprini, A.E.; Rutherford, G.; Brown, J. Effectiveness of semen washing to prevent human immunodeficiency virus (HIV) transmission and assist pregnancy in HIV-discordant couples: A systematic review and meta-analysis. Fertil. Steril. 2016, 105, 645–655.e2. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  87. Martins, W.P.; Nastri, C.O.; Rienzi, L.; van der Poel, S.Z.; Gracia, C.R.; Racowsky, C. Obstetrical and perinatal outcomes following blastocyst transfer compared to cleavage transfer: A systematic review and meta-analysis. Hum. Reprod. 2016, 31, 2561–2569. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  88. Park, C.K.; Isayama, T.; McDonald, S.D. Antenatal Corticosteroid Therapy Before 24 Weeks of Gestation: A Systematic Review and Meta-analysis. Obstet. Gynecol. 2016, 127, 715–725. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  89. Wang, M.; He, X.; Chang, Y.; Sun, G.; Thabane, L. A sensitivity and specificity comparison of fine needle aspiration cytology and core needle biopsy in evaluation of suspicious breast lesions: A systematic review and meta-analysis. Breast 2017, 31, 157–166. [Google Scholar] [CrossRef]
  90. Meireles, C.G.; Pereira, S.A.; Valadares, L.P.; Rego, D.F.; Simeoni, L.A.; Guerra, E.N.S.; Lofrano-Porto, A. Effects of metformin on endometrial cancer: Systematic review and meta-analysis. Gynecol. Oncol. 2017, 147, 167–180. [Google Scholar] [CrossRef]
  91. Cavoretto, P.; Candiani, M.; Giorgione, V.; Inversetti, A.; Abu-Saba, M.M.; Tiberio, F.; Sigismondi, C.; Farina, A. Risk of spontaneous preterm birth in singleton pregnancies conceived after IVF/ICSI treatment: Meta-analysis of cohort studies. Ultrasound Obstet. Gynecol. 2018, 51, 43–53. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  92. Alviggi, C.; Conforti, A.; Carbone, I.F.; Borrelli, R.; de Placido, G.; Guerriero, S. Influence of cryopreservation on perinatal outcome after blastocyst- vs cleavage-stage embryo transfer: Systematic review and meta-analysis. Ultrasound Obstet. Gynecol. 2018, 51, 54–63. [Google Scholar] [CrossRef] [PubMed]
  93. Cai, C.; Vandermeer, B.; Khurana, R.; Nerenberg, K.; Featherstone, R.; Sebastianski, M.; Davenport, M.H. The impact of occupational shift work and working hours during pregnancy on health outcomes: A systematic review and meta-analysis. Am. J. Obstet. Gynecol. 2019, 221, 563–576. [Google Scholar] [CrossRef]
  94. Haahr, T.; Zacho, J.; Brauner, M.; Shathmigha, K.; Skov Jensen, J.; Humaidan, P. Reproductive outcome of patients undergoing in vitro fertilisation treatment and diagnosed with bacterial vaginosis or abnormal vaginal microbiota: A systematic PRISMA review and meta-analysis. BJOG 2019, 126, 200–207. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  95. Saccone, G.; Di Spiezio Sardo, A.; Ciardulli, A.; Caissutti, C.; Spinelli, M.; Surbek, D.; von Wolff, M. Effectiveness of seminal plasma in in vitro fertilisation treatment: A systematic review and meta-analysis. BJOG 2019, 126, 220–225. [Google Scholar] [CrossRef]
  96. Vermey, B.G.; Buchanan, A.; Chambers, G.M.; Kolibianakis, E.M.; Bosdou, J.; Chapman, M.G.; Venetis, C.A. Are singleton pregnancies after assisted reproduction technology (ART) associated with a higher risk of placental anomalies compared with non-ART singleton pregnancies? A systematic review and meta-analysis. BJOG 2019, 126, 209–218. [Google Scholar] [CrossRef] [Green Version]
  97. Backes, C.H.; Rivera, B.K.; Pavlek, L.; Beer, L.J.; Ball, M.K.; Zettler, E.T.; Smith, C.V.; Bridge, J.A.; Bell, E.F.; Frey, H.A. Proactive neonatal treatment at 22 weeks of gestation: A systematic review and meta-analysis. Am. J. Obstet. Gynecol. 2021, 224, 158–174. [Google Scholar] [CrossRef]
  98. Giorgione, V.; Ridder, A.; Kalafat, E.; Khalil, A.; Thilaganathan, B. Incidence of postpartum hypertension within 2 years of a pregnancy complicated by pre-eclampsia: A systematic review and meta-analysis. BJOG 2021, 128, 495–503. [Google Scholar] [CrossRef]
  99. Varghese, J.; Gohari, S.S.; Rizki, H.; Faheem, M.; Langridge, B.; Kummel, S.; Johnson, L.; Schmid, P. A systematic review and meta-analysis on the effect of neoadjuvant chemotherapy on complications following immediate breast reconstruction. Breast 2021, 55, 55–62. [Google Scholar] [CrossRef]
  100. Joyeux, L.; De Bie, F.; Danzer, E.; Russo, F.M.; Javaux, A.; Peralta, C.F.A.; De Salles, A.A.F.; Pastuszka, A.; Olejek, A.; Van Mieghem, T.; et al. Learning curves of open and endoscopic fetal spina bifida closure: Systematic review and meta-analysis. Ultrasound Obstet. Gynecol. 2020, 55, 730–739. [Google Scholar] [CrossRef]
  101. Berg, R.C.; TSSaid, M.A.; Sørbye, I.K.; Vangen, S. The effectiveness of surgical interventions for women with FGM/C: A systematic review. BJOG 2018, 125, 278–287. [Google Scholar] [CrossRef] [PubMed]
  102. Bellos, I.; Pergialiotis, V.; Antsaklis, A.; Loutradis, D.; Daskalakis, G. Safety of non-steroidal anti-inflammatory drugs in postpartum period in women with hypertensive disorders of pregnancy: Systematic review and meta-analysis. Ultrasound Obstet. Gynecol. 2020, 56, 329–339. [Google Scholar] [CrossRef] [PubMed]
  103. Armstrong, S.C.; Showell, M.; Stewart, E.A.; Rebar, R.W.; Vanderpoel, S.; Farquhar, C.M. Baseline anatomical assessment of the uterus and ovaries in infertile women: A systematic review of the evidence on which assessment methods are the safest and most effective in terms of improving fertility outcomes. Hum. Reprod. Update 2017, 23, 533–547. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  104. Nassr, A.A.; Shazly, S.A.M.; Abdelmagied, A.M.; Araujo Junior, E.; Tonni, G.; Kilby, M.D.; Ruano, R. Effectiveness of vesicoamniotic shunt in fetuses with congenital lower urinary tract obstruction: An updated systematic review and meta-analysis. Ultrasound Obstet. Gynecol. 2017, 49, 696–703. [Google Scholar] [CrossRef] [Green Version]
  105. Bahamondes, L. Advantages of self-administration of injectable contraceptives. BJOG 2017, 124, 209. [Google Scholar] [CrossRef] [Green Version]
  106. Grabovac, M.; Karim, J.N.; Isayama, T.; Liyanage, S.K.; McDonald, S.D. What is the safest mode of birth for extremely preterm breech singleton infants who are actively resuscitated? A systematic review and meta-analyses. BJOG 2018, 125, 652–663. [Google Scholar] [CrossRef] [Green Version]
  107. Maheshwari, A.; Pandey, S.; Amalraj Raja, E.; Shetty, A.; Hamilton, M.; Bhattacharya, S. Is frozen embryo transfer better for mothers and babies? Can cumulative meta-analysis provide a definitive answer? Hum. Reprod. Update 2018, 24, 35–58. [Google Scholar] [CrossRef] [Green Version]
  108. Zhang, C.Y.; Sun, Z.J.; Yang, J.; Xu, T.; Zhu, L.; Lang, J.H. Sacrocolpopexy compared with transvaginal mesh surgery: A systematic review and meta-analysis. BJOG 2021, 128, 14–23. [Google Scholar] [CrossRef]
  109. Shan, D.; Zou, L.; Liu, X.; Shen, Y.; Cai, Y.; Zhang, J. Efficacy and safety of gabapentin and pregabalin in patients with vasomotor symptoms: A systematic review and meta-analysis. Am. J. Obstet. Gynecol. 2020, 222, 564–579.e12. [Google Scholar] [CrossRef]
  110. Brożek, J.; Akl, E.A.; Alonso-Coello, P.; Lang, D.; Jaeschke, R.; Williams, J.W.; Phillips, B.; Lelgemann, M.; Lethaby, A.; Bousquet, J. Grading quality of evidence and strength of recommendations in clinical practice guidelines: Part 1 of 3. An overview of the GRADE approach and grading quality of evidence about interventions. Allergy 2009, 64, 669–677. [Google Scholar] [CrossRef]
  111. Brożek, J.; Akl, E.A.; Jaeschke, R.; Lang, D.M.; Bossuyt, P.; Glasziou, P.; Helfand, M.; Ueffing, E.; Alonso-Coello, P.; Meerpohl, J. Grading quality of evidence and strength of recommendations in clinical practice guidelines: Part 2 of 3. The GRADE approach to grading quality of evidence about diagnostic tests and strategies. Allergy 2009, 64, 1109–1116. [Google Scholar] [CrossRef] [PubMed]
  112. Brożek, J.; Akl, E.; Compalati, E.; Kreis, J.; Terracciano, L.; Fiocchi, A.; Ueffing, E.; Andrews, J.; Alonso-Coello, P.; Meerpohl, J. Grading quality of evidence and strength of recommendations in clinical practice guidelines part 3 of 3. The GRADE approach to developing recommendations. Allergy 2011, 66, 588–595. [Google Scholar] [CrossRef] [PubMed]
  113. Cuello-Garcia, C.A.; Morgan, R.L.; Brozek, J.; Santesso, N.; Verbeek, J.; Thayer, K.; Guyatt, G.; Schunemann, H.J. A scoping review and survey provides the rationale, perceptions, and preferences for the integration of randomized and nonrandomized studies in evidence syntheses and GRADE assessments. J. Clin. Epidemiol. 2018, 98, 33–40. [Google Scholar] [CrossRef] [PubMed]
  114. Schünemann, H.J.; Cuello, C.; Akl, E.A.; Mustafa, R.A.; Meerpohl, J.J.; Thayer, K.; Morgan, R.L.; Gartlehner, G.; Kunz, R.; Katikireddi, S.V. GRADE guidelines: 18. How ROBINS-I and other tools to assess risk of bias in nonrandomized studies should be used to rate the certainty of a body of evidence. J. Clin. Epidemiol. 2019, 111, 105–114. [Google Scholar] [CrossRef] [Green Version]
  115. Guyatt, G.; Oxman, A.D.; Akl, E.A.; Kunz, R.; Vist, G.; Brozek, J.; Norris, S.; Falck-Ytter, Y.; Glasziou, P.; DeBeer, H. GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables. J. Clin. Epidemiol. 2011, 64, 383–394. [Google Scholar] [CrossRef]
  116. Schunemann, H.J. GRADE Handbook for Grading Quality of Evidence and Strength of Recommendation; Version 3.2. 2008. Available online: http://www.cc-ims.net/gradepro (accessed on 6 November 2022).
Table
Table 1. The distribution of systematic reviews (n = 67) that rated the outcome-specific certainty of evidence with GRADE by year and journal.
Table 1. The distribution of systematic reviews (n = 67) that rated the outcome-specific certainty of evidence with GRADE by year and journal.
Number of SRs PublishedNumber of SRs Rating the Outcome Specific Certainty of Evidence with GRADE, n (% of SRs Published)Impact Factor
Total, n95267 (7.04%)-
201619612 (6.12%)-
201719512 (6.15%)-
201816315 (9.20%)-
201916010 (6.25%)-
202023818 (7.56%)-
Journal
Ultrasound in Obstetrics & Gynecology11921 (17.65%)8.678
British Journal of Obstetrics and Gynecology24417 (6.97%)7.331
American journal of obstetrics and gynecology1178 (6.84%)10.693
Human Reproduction Update938 (8.60%)17.179
Fertility and Sterility905 (5.56%)7.490
Breast654 (6.15%)4.254
Human Reproduction452 (4.44%)6.353
Obstetrics & Gynecology881 (1.14%)7.623
Gynecologic Oncology821 (1.22%)5.304
Best Practice & Research Clinical Obstetrics & Gynecology804.268
SRs, systematic reviews.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Yang, H.-J.; Zhang, D.-Y.; Hao, Y.-Y.; Xu, H.-L.; Li, Y.-Z.; Zhang, S.; Li, X.-Y.; Gong, T.-T.; Wu, Q.-J. GRADE Use in Evidence Syntheses Published in High-Impact-Factor Gynecology and Obstetrics Journals: A Methodological Survey. J. Clin. Med. 2023, 12, 446. https://doi.org/10.3390/jcm12020446

AMA Style

Yang H-J, Zhang D-Y, Hao Y-Y, Xu H-L, Li Y-Z, Zhang S, Li X-Y, Gong T-T, Wu Q-J. GRADE Use in Evidence Syntheses Published in High-Impact-Factor Gynecology and Obstetrics Journals: A Methodological Survey. Journal of Clinical Medicine. 2023; 12(2):446. https://doi.org/10.3390/jcm12020446

Chicago/Turabian Style

Yang, Hui-Juan, De-Yu Zhang, Ying-Ying Hao, He-Li Xu, Yi-Zi Li, Shuang Zhang, Xin-Yu Li, Ting-Ting Gong, and Qi-Jun Wu. 2023. "GRADE Use in Evidence Syntheses Published in High-Impact-Factor Gynecology and Obstetrics Journals: A Methodological Survey" Journal of Clinical Medicine 12, no. 2: 446. https://doi.org/10.3390/jcm12020446

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop