Next Article in Journal
Epidemic Intelligence Service Alumni in Public Health Leadership Roles
Previous Article in Journal
Analysis of Work Related Factors, Behavior, Well-Being Outcome, and Job Satisfaction of Workers of Emergency Medical Service: A Systematic Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

No Recommendation Is (at Least Presently) the Best Recommendation: An Updating Quality Appraisal of Recommendations on Screening for Scoliosis

by
Maciej Płaszewski
Faculty of Physical Education and Health in Biała Podlaska, Józef Piłsudski University of Physical Education, 00-809 Warsaw, Poland
Int. J. Environ. Res. Public Health 2022, 19(11), 6659; https://doi.org/10.3390/ijerph19116659
Submission received: 20 April 2022 / Revised: 24 May 2022 / Accepted: 26 May 2022 / Published: 30 May 2022
(This article belongs to the Section Adolescents)

Abstract

:
Recommendations addressing screening for scoliosis differ substantially. Systematically developed guidelines are confronted by consensus and opinion-based statements. This paper elaborates on the issue of the standards of development and reporting of current guidelines and recommendation statements, as well as on the methodological quality of the corresponding evidence syntheses. The SORT classification and the AMSTAR 2 tool were used for those purposes, respectively. Publications included in the analysis differed substantially in terms of their methodological quality. Based on the SORT and AMSTAR 2 scores, the 2018 US PSTF recommendation statement and systematic review on screening for scoliosis are trustworthy and high-quality sources of evidence and aid for decision making. The recommendation statement on insufficient evidence to formulate any recommendations is, paradoxically, very informative. Significantly, updated opinion-based position statements supporting screening for scoliosis acknowledged the importance of research evidence as a basis for recommendation formulation and are more cautious and balanced than formerly. Expert opinions, not built on properly presented analyses of evidence, are at odds with evidence-based practice. Nonetheless, contemporary principles of screening programs, especially those addressing people’s values and preferences, and the possible harms of screening, remain underrepresented in both research and recommendations addressing screening for scoliosis.

1. Introduction

1.1. Rationale

Adolescent idiopathic scoliosis, AIS, is a health condition that affects 1–3% of the general population [1,2]. Potential serious physical and/or psychosocial consequences, such as pain, pulmonary deficiency, as well as disturbed body image and mental health, are not necessarily correlated with the magnitude of deformity [2,3,4,5]. Treatment effectiveness, including conservative and orthopaedic interventions, remains a matter of long-lasting debate [2,3,4,6]. Another disputed issue is whether early detection of mild scoliosis, which may lead to early, thus possibly effective, treatment, should be done through clinical examination or a population screening, typically school screening [3,6,7,8]. Screening programs may be beneficial, but they may also be harmful [9,10,11], and this may well apply to screening for scoliosis [4,12,13].
School screening for scoliosis applies to millions of schoolchildren globally [3,8,13,14], in their unique and fragile time of puberty [15]. National and regional policies range from obligatory to discontinued screening programs, and recommendations vary from encouraging, through no recommendations due to insufficient evidence to formulate recommendations, to recommendations against screening [10,11,12,13,14,15,16,17,18,19,20].
One important, and long debated issue is the X-ray exposure and related long-held view of carcinogenic risks from X-rays. Current (2021) UK National Screening Committee, UK NSC, recommendations against screening for scoliosis include potential overdetection, waste of resources, and unnecessary X-ray exposure, as reasons for not meeting the criterion of “a simple, safe, precise and validated screening test”, needed to justify a screening program [20]. In the research synthesis study prepared for the US Preventive Services Task Force, US PSTF guideline formulation (2018) [3] no studies met inclusion criteria to answer the key question “What are the harms of screening for AIS?”. On the other hand, routine paediatric radiographic scoliosis screening is regarded by some experts as safe and beneficial in early and accurate diagnosis, in opposition to “non-radiographic screening methods” [21]. Introducing modern devices, producing low, or ultra-low dose radiation (e.g., [22]) supports such opinions. Importantly, however, harms are no longer understood purely in terms of direct adverse events or side effects of diagnostic testing, such as X-ray exposure. Health lost due to the overdiagnosed or false-positive health state, such as anxiety and complications of labelling, diagnostics, unneeded or unnecessary treatment, and stigmatization, are considered as harms [9,11,23].
Guidelines and recommendations not only remain discrepant or contradictory but were developed according to various standards and procedures [16,20,24,25,26]. The evolution of clinical practice guidelines into systematically developed, evidence-based documents, instead of consensus-based statements, serve for improving health outcomes [27,28,29,30]. Trustworthy guidelines and recommendations are developed through rigorous methodological standards, with the certainty of evidence and strengths of recommendations as key features [24,25,27,30,31]. Several rating systems have been introduced for those purposes, initially addressing treatment, then other interventions, such as preventive services and screening [27,28,29,30,31,32,33]. Opinion-based recommendations are on one hand regarded as invalid [27,28,34,35]. On the other hand, however, evidence-informed consensus statements and expert evidence are acknowledged and regarded as needed and unique, especially in providing new ideas and insights [10,36,37,38,39,40]. Therefore, it is important to distinguish trustworthy from potentially misleading recommendations. And it is not merely a matter of technical appraisal of the methodological quality of their development. Issues such as distinguishing between expert opinions and expert evidence, the importance of narrative reviews in formulating new ideas and informed opinions, as well as contemporary understanding of screening programs, highlighting problems such as harms of overdiagnosis and unnecessary treatment, imply that the distinction between evidence-based and opinion-based recommendations is more complex than just the distinction between methodologies of their development.

1.2. Objectives

The study addresses the trustworthiness of current recommendations and position statements addressing screening for scoliosis in terms of their methodological quality and standards of development. Strengths of recommendations and methodological quality of the underlying evidence reviews were assessed.
Consequently, the paper updates earlier research synthesis studies, conducted in 2011 [16] and 2013 [26]. Since that time, major recommendation statements have been updated and/or revised [17,18,19,20] so that an updating appraisal was warranted.
This report also provides a methodological enhancement of another analysis [13], focused on whether and how the contemporary standards of screening programs, specifically issues of person-centeredness and harms of screening interventions, are represented in current recommendations and policy statements on screening for scoliosis.

2. Materials and Methods

2.1. Study Conduct and Reporting

This study was informed by the PRISMA 2020 guideline for reporting systematic reviews, specifically as regards guidance for conducting and reporting updated reviews [41]. Nevertheless, the study, as this was not a formal systematic review, was also informed in terms of the principles and methods of narrative reviews [42].

2.2. Steps of the Study

The analysis comprised two stages. Firstly, the current recommendations on screening for scoliosis were examined in terms of their standards of development. For that purpose, their content was analyzed according to the Institute of Medicine criteria for guideline development and reporting (Table A1) [28]. The strengths of recommendations and levels of evidence were assessed using the Strength of Recommendation Taxonomy, SORT, classification (Table A2) [30]. Secondly—which applied for guidelines based on systematic reviews of evidence—a quality appraisal of evidence reviews that had been used in the process of recommendation formulation, was conducted using the revised A MeaSurement Tool to Assess Systematic Reviews, AMSTAR 2 tool (Table A3) [43]. The steps of the study are presented in Scheme 1. Details of the assessment methods are described in Section 2.5.

2.3. Eligibility Criteria

2.3.1. Guidelines and Recommendation Statements

All current (i.e., new or updated, and not specified as outdated, withdrawn, or retired) recommendations and position statements, regarding screening for scoliosis, were included in the initial analysis. Both opinion-based and evidence-based documents were eligible. New or updated publications were eligible if they were not included in the preceding appraisals [16,26]. Thus, papers published before 2014 were not considered eligible.

2.3.2. Review Reports

The starting point to define the types and forms of review studies was the classical characteristics of systematic review (such as that in the glossary of terms from the Epistemonikos database: “A review of a clearly formulated question that uses systematic and explicit methods to identify, select, and critically appraise relevant research, and to collect and analyse data from the studies that are included in the review. Statistical methods (meta-analysis) may or may not be used to analyse and summarise the results of the included studies” [44]). Nonetheless, to address the issue more adequately and comprehensively, a broader understanding and usage of meta-research [45,46,47], as well as the shift from “systematic review” to “evidence synthesis” [3] were incorporated.
Review reports prepared for the development of guidelines (either commissioned or conducted by the guideline development group) were included. External systematic reviews, referred to in the analysed guidelines, but not prepared in the process of their development, were not included in the analysis of methodological quality with AMSTAR 2, but were only considered in the assessments of strengths of recommendations with SORT.

2.4. Identification of Relevant Publications

PubMed and pre-appraised sources—NICE Evidence, TRIP, PEDro, and REHAB+ databases, as well as G-I-N and INAHTA guideline registries, were searched between 5 and 8 February 2022 for new or updated pertinent publications, published since January 2014 (i.e., to the latest date of publication applied in the previous study [26]). As this was an updating search, previously employed search terms [16,26] were used. In PubMed the MeSH terms “scoliosis” and “mass screening” as well as the free terms “scoliosis” and “screening” were used together with the filters “systematic review” and “meta-analysis”. PubMed “Similar articles” and “Cited by” navigation tools were used for further browsing. For other bibliographic databases, corresponding search terms and limits were used. Additionally, the reference lists of papers included for full-text analysis as well as websites of institutions that have released the included documents, were checked for information on updates, discontinuations, or withdrawals. The PRISMA 2020 [41] flow diagram for updated systematic reviews, presenting the updating search and selection process, is presented in Scheme 2.

2.5. Appraisals and Quality Assessments

2.5.1. Guidelines and Recommendation Statements

Clinical practice guidelines are “systematically developed statements aimed at helping people make clinical, policy-related and system-related decisions” [27]. In the first step, to classify and distinguish the initially included documents as evidence-based, systematically developed guidelines or opinion-based statements, the relevant characteristics of evidence-based guidelines from the Institute of Medicine were applied [28] (Table A1).
The SORT classification was then used to assess the strengths of recommendations and levels of evidence of the included documents [30]. SORT taxonomy is based on three criteria: the level (quality) of evidence, whether the evidence is patient-oriented, and the consistency and coherency across studies (Table A2).

2.5.2. Evidence Syntheses

The methodological quality of the included systematic reviews was assessed with the AMSTAR 2 tool [43]. The AMSTAR 2 comprises 16 criteria for critical appraisal of systematic reviews of studies of healthcare interventions (Table A3). In contrast to the original AMSTAR tool, the AMSTAR 2 was developed to enable appraisals of systematic reviews of randomised trials, but also of non-randomised studies, or both. The instrument has an overall rating, based on weaknesses in critical domains, rather than on an overall score. Overall confidence in the results of a systematic review is rated by considering the potential impact of an inadequate rating for each item and assessing a review in terms of critical weaknesses and critical flaws. Noticeably, appraisers are to decide (judge) which items are most important for the assessed reviews [43].
Appraisals were done in duplicate, with a collaborator, and uncertainties were resolved through discussion.

3. Results

3.1. Updating Search Results

Four updated recommendation documents have been published since 2014 [17,18,19,20], and they were included for analysis. Two of the recommendation statements were supported by evidence syntheses (systematic reviews) [3,48]. They were therefore also considered eligible. Thus, four recommendation documents [17,18,19,20] and two systematic reviews [3,48] were deemed eligible (Scheme 2, Table 1).
In 2021, UK NSC published a commissioned evidence map that aimed at establishing whether an updating evidence review should be conducted based on available evidence for purpose of updating their scoliosis screening recommendations [8]. Out of 622 publications assessed for eligibility, only one primary study, with “purely speculative conclusions” [8], was considered potentially relevant. On that basis, the UK NSC concluded that the volume and type of evidence were at that time insufficient to justify an evidence review [20]. Therefore, as the UK NSC have not released updated recommendations, their 2016 recommendation document, as current for 2021 [20], as well as the background systematic review published in 2015 [48], were included in the present analysis. Accordingly, the 2021 evidence map [8] was excluded.
Two more systematic reviews addressing screening for scoliosis were published after 2014 [14,49]. Nonetheless, quality appraisals of individual evidence syntheses, which were not supporting any of the included guidelines or recommendation statements, were beyond the scope of this study. Therefore, those reports were excluded from the analysis (Scheme 2).

3.2. Quality of Guideline Development

The analysis of current guidelines and recommendation statements according to the Institutes of Medicine standards of guideline development and recommendation formulation is presented in Table 2.

3.3. Strengths of Recommendations and Levels of Evidence

The SORT qualifications of the identified recommendation documents are presented in Table 3. The systematically developed recommendations (US PSTF [19] and UK NSC [20] were ranked higher in SORT than consensus-based (SOSORT [18]) and opinion-based (SRS/AAOS/POSNA/AAP [17]) statements.

3.4. Methodological Quality of Evidence Reviews

Table 4 summarises individual AMSTAR 2 assessments. The overall rated confidence in the results of the systematic review conducted in the preparation of the US PSTF [3] and the UK NSC [48] recommendation were high and moderate, respectively (Table 4).

4. Discussion

The results of this study confirm that systematically developed, evidence-based recommendations, when derived in the process of a thorough, procedural development (Table 2 and Table 3), are of greater trustworthiness than consensus-based recommendations (Table 2), even if the latter ones are more conclusive (Table 1).
Nonetheless, the differences are not as clear as they appear, and the problem matter is not that straightforward. The value of expert evidence, the importance of scholarly narrative reviews, as well as contemporary understanding of screening programs, set a different light on consensus-based and opinion-based recommendations. And the distinction between ‘trustworthy’ and ‘flawed’ statements is not just parallel to the methodological approach of guideline development. Therefore, both the results of this study and the above-mentioned problems are discussed below.

4.1. Quality of Evidence Analyses

4.1.1. Strength of Recommendations and Levels of Evidence

The Scottish Intercollegiate Guideline Network, SIGN Grading System 1999–2012, applied in the previous analysis of guidelines and recommendations [16], was subsequently withdrawn from use for guideline appraising [31]. Therefore, in this updating analysis, the SORT [30] classification was used. It is a recognised [50] and currently used [51,52,53,54] measure, addressing person-centred (patient-oriented) outcomes, as well as the quality, consistency, and coherence of the underlying evidence, in terms of the strength of recommendations (Table A2).

4.1.2. Appraisals of Review Studies

In contrast to the original AMSTAR, the AMSTAR 2 was designed to be usable for the assessment of systematic reviews of randomised trials, as well as systematic reviews of non-randomised studies [43]. This is advantageous, considering the inconsistent and low-quality evidence base addressing screening for scoliosis [3,8,54]. AMSTAR 2, in contrast to the original tool, is not intended to generate an overall score for an appraised paper.
Nonetheless, 10 out of 11 original domains are retained [43]. Therefore, assessing additional reviews with AMSTAR 2 will not exclude building on the previous evidence syntheses (using the original AMSTAR) [26,54].

4.2. Expert Evidence versus Expert Opinion

There is a tendency to view guidelines that use the term “expert opinion” as less rigorous [27,28,29,31,37]. Guidelines are considered evidence-based when the evidence underpinning recommendations is identified, selected, appraised, synthesised, and presented systematically and transparently [24,25,27,34,39]. Nonetheless, at least at the stages of the assessment of the overall body of evidence and critical appraisal, some degree of personal judgment—purposeful or unconscious—is inevitable [33,36,37]. The opinion is not evidence but experts are needed. Multidisciplinary guideline development teams are required for modern guidelines, with experts needed to help understand the evidence as well as to represent patient voices and stakeholders’ needs [27,28,29,37,39,43].
Sometimes using evidence systematically and transparently can be challenging; in some circumstances (such as unpublished or indirect evidence, missing contextual information), experts may be the only or main source of evidence [37,39,40]. To use expertise wisely in the context of evidence, a distinction between expert evidence and expert opinion is proposed, with particular importance of this distinction in terms of guidelines robustness and trustworthiness [37,40].
People’s views, preferences, and circumstances, as well as person-centeredness, are contemporarily acknowledged and promoted in health policies, including concepts and principles of screening [9,10,11,13]. Despite that, contextual factors and person-centred outcomes are still very much underrepresented in scoliosis literature [3,5,13,55]. Opinions of experts can be misleading and dangerous [56], and subsequent screening and treatment policies harmful [4,9]. However, if properly formulated and used [37,39,40], may also be valuable and indicatory [12,18,57,58,59].
Expert opinions were appreciated in the Scoliosis Research Society, SRS, International Task Force’s recommendation formulation process, prepared through a methodological study, as of particular importance for considering perceived harms in the absence of available research evidence on this critical issue [57]. Correspondingly, contemporary standards and policies regarding specific needs and circumstances of adolescents, including careful spine examinations during individual adolescent Periodic Health Visits, not population-based school screenings, are formulated in the Bright Futures expert panel guidelines of the American Pediatric Society [7].

4.3. The Value of Scholarly Narrative Reviews

Systematic reviews are at the top of the classical pyramid hierarchy of evidence, whilst narrative reviews are at the bottom [25,30]. They tend to be disregarded as lacking an explicit intent to maximize scope or analyse data collected, with conclusions that they may reach therefore being prone to bias, with literature selection in a way that supports the authors’ view rather than on the basis of evidence [40,45,47]. Some recent classification approaches do not even consider narrative reviews, as lacking explicit rigorous methods of conduct [46]. On the other hand, the rigid distinction between systematic and narrative (opinion) reviews is criticised as spurious [40] by authors who once disseminated the principles of Evidence-Based Medicine, including hierarchies of evidence [12,42], and who promote the developments of this movement [59,60].
Thus, systematic and narrative reviews serve different purposes and should be viewed as complementary. While conventional systematic reviews address narrowly focused (typically population-intervention-comparator-outcome, PICO) questions, and their key contribution is summarising data, narrative reviews provide interpretation and critique, and their key contribution is to deepen understanding. In that sense, a narrative review is a scholarly summary along with interpretation and critique, which can be conducted using a number of distinctive methodologies, differing from the classic methodology of systematic review, but not unsystematic (i.e., careless or conducted ad hoc) [25]. Narrative reviews emphasize thoughtful, in-depth, critically reflective processes—thinking and interpretation, and thus are evidence-informed rather than evidence-based [25,46,60,61].

4.4. New Understanding and Terminology of Screening

Not only the issues of expert evidence [39,40], contemporary approaches to narrative reviews [42], and evidence-informed practice [61] put a different light on the dilemma of the opposing systematically developed and opinion-based recommendations on screening for scoliosis.
Screening principles, and also terminology, have evolved, and crucial proposals, such as shifting from screening for disease to the prediction of poor health, from early disease detection to preventive service, and from asymptomatic subjects to otherwise healthy individuals, have been formulated [9,10,11]. Analyses of the issue of discrepant and confusing scoliosis screening recommendations, led by the author of this study, also shifted from data analyses and critical appraisals of the underlying evidence [16,26,54] to more person-centred as well as narrative expert evidence processes [5,13].

4.5. When No Recommendation Is the Best Recommendation

The US PSTF have changed their recommendation from “against” screening for scoliosis (1996, 2004) [16,26] to “no recommendation” due to “insufficient evidence to assess the balance of benefits and harms of screening” [19]. Surprisingly, the former (2004) statement was based on a low-quality brief evidence synthesis [16], while the current update is a high-quality document, following modern and demanding standards of guideline development [24,25], and based on an exhaustive evidence synthesis study [3] (Table 3).
The “I” recommendation is addressing the body of evidence (“insufficient evidence”) in terms of recommendation formulation of whether to screen or not to screen for scoliosis. The decisions are, however, left to decision-makers—patients and clinicians [19]. Consequently, the recommendations were criticised as inconclusive and indecisive [58,62].
On the contrary, two arguments support the sense of, and need for, conditional recommendations or statements of no recommendation, in the presence of insufficient or ambiguous evidence: (1) when evidence is sparse or doubtful (insufficient), recommendations need to be issued; otherwise, guideline panels miss an opportunity to support clinicians and patients [40] (2) conditional recommendations based on explicit evidence analyses encourage further relevant research. “Clinical guideline panels should have the courage to make statements of no recommendation if the evidence base is weak”. Such a recommendation could actually be the best guidance, and give impetus to important research” [63], as the underlying low-quality evidence can be counterproductive or even harmful.
The US PSTF “I” recommendations on important health topics are annually reported to the US Congress. Adolescent health topics, including mental and behavioural health, were reported in 2020 [64]. The need for further research was acknowledged in response to the updated US PSTF recommendations [12,58].

4.6. Compelling Need for Further, People-Centred Research

The Oxford Centre for Evidence-Based Medicine, OCEBM, levels of evidence classification, with questions referring to early detection (screening) tests (added in the revised version of the classification as “sufficiently important to merit a separate entry” [33]), gives a good perspective of the most desired and eligible study designs for the questions on evidence on screening tests: preferably systematic reviews of randomised controlled trials, less preferably observational studies, then mechanistic reasoning, and not expert opinions formulated without referring to pre-appraised evidence (Table A4).
Additionally, considering contemporary standards of person-centred care [13,20,40,53], as well as scarce research evidence on person-centred outcomes as regards to screening programs [3,8,48,55], not only further, and methodologically rigorous research, but also more people-centred research is warranted.
Based on the presented updating analyses, it is clear that the lack of an adequate evidence base remains a crucial problem in recommendation formulation of whether to screen or not to screen adolescents for scoliosis.

5. Conclusions

The US PSTF has issued high-quality guidance [19], and the UK NSC recommendations are also based on evidence syntheses [20]. The authors of opinion-based recommendations from professional societies (SRS/AAOS/POSNA/AAP [17] and SOSORT [18]) also acknowledge the importance of research evidence as a basis for recommendation formulation.
Nonetheless, the key issues are that recommendations remain contradictory, that an evidence base to formulate trustworthy statements remains lacking, and that the contemporary principles of screening programs, especially those addressing people’s values and preferences, and the possible harms of screening, are still underrepresented in research and recommendations.
All screening programmes do harm; some do good as well.” [9]

Funding

This research was funded by the Ministry of Education and Science, Poland, within the project Societal Duty of Science, grant No. SONP/SP/461408/2020, and the APC was funded by the Józef Piłsudski University of Physical Education in Warsaw.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

This paper was influenced by my dear colleague, Ejgil Jespersen. We wish you were here, Ejgil. The author wishes to thank Zbigniew Wroński for his contribution to critical appraisals.

Conflicts of Interest

The author declares no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Appendix A

Table A1. Standards of trustworthiness, Institute of Medicine [28].
Table A1. Standards of trustworthiness, Institute of Medicine [28].
StandardDefinition
1.Establishing transparency
2.Management of conflicts of interest
3.Guideline development group composition: multidisciplinary group, methodologist involvement, patient and public perspectives
4.Clinical practice guidelinesystematic review intersection/use of systematic review evidence
5.Evidence foundations for and rating strength of recommendations
6.Specific and unambiguous articulation of recommendations
7.External review
8.Updating

Appendix B

Table A2. The Strength of Recommendation Taxonomy, SORT. Patient-oriented study quality levels of evidence for screening studies, and strengths of recommendations [30].
Table A2. The Strength of Recommendation Taxonomy, SORT. Patient-oriented study quality levels of evidence for screening studies, and strengths of recommendations [30].
Levels of Evidence:
LevelDefinitionType of Study/Source of Evidence—Screening Studies
IGood quality patient-oriented evidenceSystematic review/meta-analysis of randomised controlled trials with consistent findings
High-quality individual randomised controlled study
All-or-none study
IILimited quality patient-oriented evidenceSystematic review/meta-analysis of lower quality clinical trials or of studies with inconsistent findings
Lower quality clinical trial
Cohort study
Case-control study
IIIOther evidenceConsensus guidelines Extrapolations from bench research
Usual practice
Opinion
Disease-oriented evidence
Case series
Strengths of Recommendations:
ARecommendation based on consistent and good-quality patient-oriented evidence
BRecommendation based on inconsistent or limited quality patient-oriented evidence
CRecommendation based on consensus, usual practice, opinion1, disease-oriented evidence, or case series
Explanations:
  • Consistency and coherence across studies:
Consistent:
(1)
Similar or at least coherent conclusions in most studies
  • or
(2)
High quality and up-to-date systematic reviews or meta-analyses support the recommendations
Inconsistent:
(1)
Considerable variance among study findings and lack of coherence
  • or
(2)
High quality and up-to-date systematic reviews or meta-analyses support the recommendations do not find consistent evidence in favour of the recommendations
Coherent:Differences in conclusions are explainable
  • Types of evidence in terms of patient outcomes:
Patient-oriented evidence:Measures outcomes that matter to patients, e.g., morbidity, mortality, symptom improvement, cost reduction, quality of life
Disease-oriented evidence:Measures intermediate, physiologic, or surrogate endpoints that may or may not reflect improvements in patient outcomes, e.g., blood pressure, blood chemistry, physiologic function, pathologic findings

Appendix C

Table A3. The AMSTAR 2 assessment tool of the methodological quality of evidence reviews items and ratings [43].
Table A3. The AMSTAR 2 assessment tool of the methodological quality of evidence reviews items and ratings [43].
AMSTAR 2 Items:
Questions:
1. Did the research questions and inclusion criteria for the review include the components of PICO?;
2. Did the report of the review contain an explicit statement that the review methods were established prior to the conduct of the review and did the report justify any significant deviations from the protocol?;
3. Did the review authors explain their selection of the study designs for inclusion in the review?;
4. Did the review authors use a comprehensive literature search strategy?;
5. Did the review authors perform study selection in duplicate?;
6. Did the review authors perform data extraction in duplicate?;
7. Did the review authors provide a list of excluded studies and justify the exclusions?
8. Did the review authors describe the included studies in adequate detail?;
9. Did the review authors use a satisfactory technique for assessing the risk of bias (RoB) in individual studies that were included in the review?;
10. Did the review authors report on the sources of funding for the studies included in the review?;
11. If meta-analysis was performed did the review authors use appropriate methods for statistical combination of results?;
12. If meta-analysis was performed, did the review authors assess the potential impact of RoB in individual studies on the results of the meta-analysis or other evidence synthesis?;
13. Did the review authors account for RoB in individual studies when interpreting/discussing the results of the review?;
14. Did the review authors provide a satisfactory explanation for, and discussion of, any heterogeneity observed in the results of the review?
15. If they performed quantitative synthesis did the review authors carry out an adequate investigation of publication bias (small study bias) and discuss its likely impact on the results of the review?
16. Did the review authors report any potential sources of conflict of interest, including any funding they received for conducting the review?
Possible Answers:
Yes/No: for questions 1, 3, 5, 6, 10, 13, 4, 16;
Yes/Partial Yes/No: for questions 2, 4, 7, 8;
Yes/No/Includes only nonrandomised studies of interventions or Yes/No/Includes only randomised controlled trials: for question 9;
Yes/No/No meta-analysis conducted: for questions 11, 12, 15
Rating Overall Confidence in the Results of a Review:
ConfidenceRatingInterpretation of a Review
highno or one non-critical weaknessit provides an accurate and comprehensive summary of the results of the available studies that address the question of interest
moderatemore than one critical weaknessit has more than one weakness but no critical flaws; may provide an accurate summary of the results of the available studies that were included
lowone critical flaw with or without non-critical weaknessesit has a critical flaw and may not provide an accurate and comprehensive summary of the available studies that address the question of interest
critically lowmore than one critical flaw with or without non-critical weaknessesit has more than one critical flaw and should not be relied on to provide an accurate and comprehensive summary of the available studies

Appendix D

Table A4. Steps of likely best evidence searching for screening studies and levels of evidence. From the Oxford Centre of Evidence-Based Medicine Levels of Evidence [33].
Table A4. Steps of likely best evidence searching for screening studies and levels of evidence. From the Oxford Centre of Evidence-Based Medicine Levels of Evidence [33].
QuestionSteps to Follow When Searching for Likely Best Evidence/Levels of Evidence
Step 1/Level 1Step 2/Level 2Step 3/Level 3Step 4/Level 4Step 5/Level 5
Is this (early detection) test worthwhile? (screening)systematic review of randomised trialsrandomised trialnon-randomised controlled cohort/follow-up studycase-series, case-control or historically controlled studiesmechanistic reasoning

References

  1. Konieczny, M.R.; Senyurt, H.; Krauspe, R. Epidemiology of Adolescent Idiopathic Scoliosis. J. Child. Orthop. 2013, 7, 3–9. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Hresko, M.T. Idiopathic Scoliosis in Adolescents. N. Engl. J. Med. 2013, 368, 834–841. [Google Scholar] [CrossRef] [PubMed]
  3. Dunn, J.; Henrikson, N.B.; Morrison, C.C.; Nguyen, M.; Blasi, P.R.; Lin, J.S. Screening for Adolescent Idiopathic Scoliosis: A Systematic Evidence Review for the U.S. Preventive Services Task Force; U.S. Preventive Services Task Force Evidence Syntheses, formerly Systematic Evidence Reviews; Agency for Healthcare Research and Quality (US): Rockville, MD, USA, 2018.
  4. Linker, B. A Dangerous Curve: The Role of History in America’s Scoliosis Screening Programs. Am. J. Public Health 2012, 102, 606–616. [Google Scholar] [CrossRef] [PubMed]
  5. Płaszewski, M.; Grantham, W.; Jespersen, E. Mapping the Evidence of Experiences Related to Adolescent Idiopathic Scoliosis: A Scoping Review Protocol. BMJ Open 2019, 9, e032865. [Google Scholar] [CrossRef] [Green Version]
  6. Deurloo, J.A.; Verkerk, P.H. To Screen or Not to Screen for Adolescent Idiopathic Scoliosis? A Review of the Literature. Public Health 2015, 129, 1267–1272. [Google Scholar] [CrossRef]
  7. Hagan, J.F.; Shaw, J.S.; Duncan, P.M. (Eds.) Bright Futures: Guidelines for Health Supervision of Infants, Children, and Adolescents, 4th ed.; American Academy of Pediatrics: Itasca, IL, USA, 2017; updated March 2019. [Google Scholar]
  8. Costello Medical. Evidence Map: Screening for Adolescent Idiopathic Scoliosis a Literature Search to Outline the Volume and Type of Evidence Related to Screening for Adolescent Idiopathic Scoliosis for the UK National Screening Committee; UK National Screening Committee (UK NSC): London, UK, 2021. Available online: https://view-health-screening-recommendations.service.gov.uk/scoliosis/ (accessed on 16 April 2022).
  9. Gray, J.A.M. New Concepts in Screening. Br. J. Gen. Pract. 2004, 54, 292–298. [Google Scholar]
  10. Dobrow, M.J.; Hagens, V.; Chafe, R.; Sullivan, T.; Rabeneck, L. Consolidated Principles for Screening Based on a Systematic Review and Consensus Process. Can. Med. Assoc. J. 2018, 190, E422–E429. [Google Scholar] [CrossRef] [Green Version]
  11. Harris, R.; Sawaya, G.F.; Moyer, V.A.; Calonge, N. Reconsidering the Criteria for Evaluating Proposed Screening Programs: Reflections From 4 Current and Former Members of the U.S. Preventive Services Task Force. Epidemiol. Rev. 2011, 33, 20–35. [Google Scholar] [CrossRef] [Green Version]
  12. Sarwark, J.F.; Davis, M.M. Evolving Recommendations for Scoliosis Screening: A Compelling Need for Further Research. JAMA 2018, 319, 127. [Google Scholar] [CrossRef] [Green Version]
  13. Płaszewski, M.; Grantham, W.; Jespersen, E. Screening for Scoliosis-New Recommendations, Old Dilemmas, No Straight Solutions. World J. Orthop. 2020, 11, 364–379. [Google Scholar] [CrossRef]
  14. Altaf, F.; Drinkwater, J.; Phan, K.; Cree, A.K. Systematic Review of School Scoliosis Screening. Spine Deform. 2017, 5, 303–309. [Google Scholar] [CrossRef] [PubMed]
  15. Alderman, E.M.; Breuner, C.C.; Committee on Adolescence; Grubb, L.K.; Powers, M.E.; Upadhya, K.; Wallace, S.B. Unique Needs of the Adolescent. Pediatrics 2019, 144, e20193150. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Plaszewski, M.; Nowobilski, R.; Kowalski, P.; Cieslinski, M. Screening for Scoliosis: Different Countries’ Perspectives and Evidence-Based Health Care. Int. J. Rehabil. Res. 2012, 35, 13–19. [Google Scholar] [CrossRef] [PubMed]
  17. Hresko, M.T.; Talwalkar, V.; Schwend, R. Early Detection of Idiopathic Scoliosis in Adolescents. J. Bone Jt. Surg. Am. 2016, 98, e67. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Negrini, S.; Donzelli, S.; Aulisa, A.G.; Czaprowski, D.; Schreiber, S.; de Mauroy, J.C.; Diers, H.; Grivas, T.B.; Knott, P.; Kotwicki, T.; et al. 2016 SOSORT Guidelines: Orthopaedic and Rehabilitation Treatment of Idiopathic Scoliosis during Growth. Scoliosis 2018, 13, 3. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. US Preventive Services Task Force; Grossman, D.C.; Curry, S.J.; Owens, D.K.; Barry, M.J.; Davidson, K.W.; Doubeni, C.A.; Epling, J.W.; Kemper, A.R.; Krist, A.H.; et al. Screening for Adolescent Idiopathic Scoliosis: US Preventive Services Task Force Recommendation Statement. JAMA 2018, 319, 165. [Google Scholar] [CrossRef] [Green Version]
  20. UK National Screening Committee (UK NSC). Screening for Adolescent Idiopathic Scoliosis in Children; UK National Screening Committee (UK NSC): London, UK, 2021. Available online: https://view-health-screening-recommendations.service.gov.uk/scoliosis/ (accessed on 16 April 2022).
  21. Oakley, P.A.; Ehsani, N.N.; Harrison, D.E. The Scoliosis Quandary: Are Radiation Exposures From Repeated X-Rays Harmful? Dose-Response 2019, 17, 155932581985281. [Google Scholar] [CrossRef]
  22. Amzallag-Bellenger, E.; Uyttenhove, F.; Nectoux, É.; Moraux, A.; Bigot, J.; Herbaux, B.; Boutry, N. Idiopathic Scoliosis in Children and Adolescents: Assessment with a Biplanar X-Ray Device. Insights Imaging 2014, 5, 571–583. [Google Scholar] [CrossRef] [Green Version]
  23. Moynihan, R.; Henry, D.; Moons, K.G.M. Using Evidence to Combat Overdiagnosis and Overtreatment: Evaluating Treatments, Tests, and Disease Definitions in the Time of Too Much. PLoS Med. 2014, 11, e1001655. [Google Scholar] [CrossRef] [Green Version]
  24. U.S. Preventive Services Task Force. Standards for Guideline Development. June 2018. Available online: https://www.uspreventiveservicestaskforce.org/Page/Name/standards-for-guidelinedevelopment (accessed on 25 November 2021).
  25. U.S. Preventive Services Task Force. Procedure Manual. December 2015. Available online: https://www.uspreventiveservicestaskforce.org/uspstf/procedure-manual (accessed on 25 November 2021).
  26. Płaszewski, M.; Bettany-Saltikov, J. Are Current Scoliosis School Screening Recommendations Evidence-Based and up to Date? A Best Evidence Synthesis Umbrella Review. Eur. Spine J. 2014, 23, 2572–2585. [Google Scholar] [CrossRef] [Green Version]
  27. Brouwers, M.C.; Kho, M.E.; Browman, G.P.; Burgers, J.S.; Cluzeau, F.; Feder, G.; Fervers, B.; Graham, I.D.; Grimshaw, J.; Hanna, S.E.; et al. AGREE II: Advancing Guideline Development, Reporting and Evaluation in Health Care. Can. Med. Assoc. J. 2010, 182, E839–E842. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Institute of Medicine (U.S.); Graham, R. (Eds.) Clinical Practice Guidelines We Can Trust; National Academies Press: Washington, DC, USA, 2011; ISBN 9780309164221/9780309164238. [Google Scholar]
  29. Qaseem, A. Guidelines International Network: Toward International Standards for Clinical Practice Guidelines. Ann. Intern. Med. 2012, 156, 525. [Google Scholar] [CrossRef] [PubMed]
  30. Ebell, M.H.; Siwek, J.; Weiss, B.D.; Woolf, S.H.; Susman, J.; Ewigman, B.; Bowman, M. Strength of Recommendation Taxonomy (SORT): A Patient-Centered Approach to Grading Evidence in the Medical Literature. Am. Fam. Physician 2004, 69, 548–556. [Google Scholar] [CrossRef] [PubMed]
  31. Scottish Intercollegiate Guidelines Network (SIGN). A Guideline Developer’s Handbook; SIGN Publication No. 50; SIGN: Edinburgh, UK, 2019; Available online: http://www.sign.ac.uk (accessed on 25 November 2021).
  32. Balshem, H.; Helfand, M.; Schünemann, H.J.; Oxman, A.D.; Kunz, R.; Brozek, J.; Vist, G.E.; Falck-Ytter, Y.; Meerpohl, J.; Norris, S. GRADE Guidelines: 3. Rating the Quality of Evidence. J. Clin. Epidemiol. 2011, 64, 401–406. [Google Scholar] [CrossRef] [PubMed]
  33. OCEBM Levels of Evidence—Centre for Evidence-Based Medicine (CEBM), University of Oxford. Available online: https://www.cebm.ox.ac.uk/resources/levels-of-evidence/ocebm-levels-of-evidence (accessed on 16 April 2022).
  34. Kredo, T.; Bernhardsson, S.; Machingaidze, S.; Young, T.; Louw, Q.; Ochodo, E.; Grimmer, K. Guide to Clinical Practice Guidelines: The Current State of Play. Int. J. Qual. Health Care 2016, 28, 122–128. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Shekelle, P.G. Clinical Practice Guidelines: What’s Next? JAMA 2018, 320, 757. [Google Scholar] [CrossRef]
  36. Murad, M.H.; Mustafa, R.; Morgan, R.; Sultan, S.; Falck-Ytter, Y.; Dahm, P. Rating the Quality of Evidence Is by Necessity a Matter of Judgment. J. Clin. Epidemiol. 2016, 74, 237–238. [Google Scholar] [CrossRef] [Green Version]
  37. Ponce, O.J.; Alvarez-Villalobos, N.; Shah, R.; Mohammed, K.; Morgan, R.L.; Sultan, S.; Falck-Ytter, Y.; Prokop, L.J.; Dahm, P.; Mustafa, R.A.; et al. What Does Expert Opinion in Guidelines Mean? A Meta-Epidemiological Study. BMJ Evid.-Based Med. 2017, 22, 164–169. [Google Scholar] [CrossRef] [Green Version]
  38. Djulbegovic, B.; Reljic, T.; Elqayam, S.; Cuker, A.; Hozo, I.; Zhou, Q.; Li, S.-A.; Alexander, P.; Nieuwlaat, R.; Wiercioch, W.; et al. Structured Decision-Making Drives Guidelines Panels’ Recommendations “for” but Not “against” Health Interventions. J. Clin. Epidemiol. 2019, 110, 23–33. [Google Scholar] [CrossRef]
  39. Schünemann, H.J.; Zhang, Y.; Oxman, A.D. Distinguishing Opinion from Evidence in Guidelines. BMJ 2019, 366, l4606. [Google Scholar] [CrossRef]
  40. Neumann, I.; Schünemann, H.J. Guideline Groups Should Make Recommendations Even If the Evidence Is Considered Insufficient. Can. Med Assoc. J. 2020, 192, E23–E24. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  41. Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews. J. Clin. Epidemiol. 2021, 134, 178–189. [Google Scholar] [CrossRef] [PubMed]
  42. Greenhalgh, T.; Thorne, S.; Malterud, K. Time to Challenge the Spurious Hierarchy of Systematic over Narrative Reviews? Eur. J. Clin. Investig. 2018, 48, e12931. [Google Scholar] [CrossRef] [PubMed]
  43. Shea, B.J.; Reeves, B.C.; Wells, G.; Thuku, M.; Hamel, C.; Moran, J.; Moher, D.; Tugwell, P.; Welch, V.; Kristjansson, E.; et al. AMSTAR 2: A Critical Appraisal Tool for Systematic Reviews That Include Randomised or Non-Randomised Studies of Healthcare Interventions, or Both. BMJ 2017, 358, j4008. [Google Scholar] [CrossRef] [Green Version]
  44. Glossary of Terms » SUPPORT Summaries; Epistemonikos. Available online: https://supportsummaries.epistemonikos.org/support-summaries/glossary-of-terms/#S (accessed on 16 April 2022).
  45. Gough, D.; Thomas, J.; Oliver, S. Clarifying Differences between Review Designs and Methods. Syst. Rev. 2012, 1, 28. [Google Scholar] [CrossRef] [Green Version]
  46. Gough, D.; Thomas, J.; Oliver, S. Clarifying Differences between Reviews within Evidence Ecosystems. Syst. Rev. 2019, 8, 170. [Google Scholar] [CrossRef] [Green Version]
  47. Grant, M.J.; Booth, A. A Typology of Reviews: An Analysis of 14 Review Types and Associated Methodologies: A Typology of Reviews. Health Inf. Libr. J. 2009, 26, 91–108. [Google Scholar] [CrossRef]
  48. UK National Screening Committee (UK NSC). Screening for Adolescent Idiopathic Scoliosis: External Review against Programme Appraisal Criteria for the UK National Screening Committee (UK NSC), 3rd ed.; Bazian Ltd.: London, UK, 2015.
  49. Ehrmann Feldman, D.; Beausejour, M.; Sosa, J.F.; Goulet, L.; Parent, S.; Labelle, H.; Quebec Scoliosis Society and Canadian Pediatric Spinal Deformities Study Group. Cost effectiveness of school screening for scoliosis: A systematic review. Int. J. Child Adolesc. Health 2014, 7, 7–13. [Google Scholar]
  50. Ma, L.-L.; Wang, Y.-Y.; Yang, Z.-H.; Huang, D.; Weng, H.; Zeng, X.-T. Methodological Quality (Risk of Bias) Assessment Tools for Primary and Secondary Medical Studies: What Are They and Which Is Better? Mil. Med. Res. 2020, 7, 7. [Google Scholar] [CrossRef] [Green Version]
  51. Nelson, K.C.; Swetter, S.M.; Saboda, K.; Chen, S.C.; Curiel-Lewandrowski, C. Evaluation of the Number-Needed-to-Biopsy Metric for the Diagnosis of Cutaneous Melanoma: A Systematic Review and Meta-Analysis. JAMA Dermatol. 2019, 155, 1167. [Google Scholar] [CrossRef]
  52. Ammenti, A.; Alberici, I.; Brugnara, M.; Chimenz, R.; Guarino, S.; La Manna, A.; La Scola, C.; Maringhini, S.; Marra, G.; Materassi, M.; et al. Updated Italian Recommendations for the Diagnosis, Treatment and Follow-up of the First Febrile Urinary Tract Infection in Young Children. Acta Paediatr. 2020, 109, 236–247. [Google Scholar] [CrossRef] [PubMed]
  53. Roca-Millan, E.; Jané-Salas, E.; Estrugo-Devesa, A.; López-López, J. Evaluation of Bone Gain and Complication Rates after Guided Bone Regeneration with Titanium Foils: A Systematic Review. Materials 2020, 13, 5346. [Google Scholar] [CrossRef] [PubMed]
  54. Płaszewski, M.; Bettany-Saltikov, J. Non-Surgical Interventions for Adolescents with Idiopathic Scoliosis: An Overview of Systematic Reviews. PLoS ONE 2014, 9, e110254. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Essex, R.; Bruce, G.; Dibley, M.; Newton, P.; Thompson, T.; Swaine, I.; Dibley, L. A Systematic Scoping Review and Textual Narrative Synthesis of the Qualitative Evidence Related to Adolescent Idiopathic Scoliosis. Int. J. Orthop. Trauma Nurs. 2022, 45, 100921. [Google Scholar] [CrossRef] [PubMed]
  56. Evans, I.; Thornton, H.; Chalmers, I.; Glasziou, P. Testing Treatments: Better Research for Better Healthcare, 2nd ed.; Pinter & Martin: London, UK, 2011; ISBN 9781905177486. [Google Scholar]
  57. Members of the Quebec Scoliosis Society and of the Canadian Paediatric Spinal Deformities Study Group; Beauséjour, M.; Goulet, L.; Parent, S.; Feldman, D.E.; Turgeon, I.; Roy-Beaudry, M.; Sosa, J.F.; Labelle, H. The Effectiveness of Scoliosis Screening Programs: Methods for Systematic Review and Expert Panel Recommendations Formulation. Scoliosis 2013, 8, 12. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  58. Hresko, M.T.; Schwend, R.M.; Hostin, R.A. Early Detection of Scoliosis—What the USPSTF “I” Means for Us. JAMA Pediatr. 2018, 172, 216. [Google Scholar] [CrossRef]
  59. Greenhalgh, T.; Howick, J.; Maskrey, N.; for the Evidence Based Medicine Renaissance Group. Evidence Based Medicine: A Movement in Crisis? BMJ 2014, 348, g3725. [Google Scholar] [CrossRef] [Green Version]
  60. Greenhalgh, T.; Snow, R.; Ryan, S.; Rees, S.; Salisbury, H. Six ‘Biases’ against Patients and Carers in Evidence-Based Medicine. BMC Med. 2015, 13, 200. [Google Scholar] [CrossRef] [Green Version]
  61. Nevo, I.; Slonim-Nevo, V. The Myth of Evidence-Based Practice: Towards Evidence-Informed Practice. Br. J. Soc. Work 2011, 41, 1176–1197. [Google Scholar] [CrossRef]
  62. Ha, A.S.; Beauchamp, E.C. Editorial on “Screening for Adolescent Idiopathic Scoliosis: US Preventive Services Task Force Recommendation Statement”. J. Spine Surg. 2018, 4, 812–816. [Google Scholar] [CrossRef]
  63. Bretthauer, M.; Kalager, M. When No Guideline Recommendation Is the Best Recommendation. Lancet 2018, 392, 898–899. [Google Scholar] [CrossRef]
  64. U.S. Preventive Services Task Force. Tenth Annual Report to Congress on High-Priority Evidence Gaps for Clinical Preventive Services. November 2020. Available online: https://www.uspreventiveservicestaskforce.org/uspstf/sites/default/files/inline-files/10th-USPSTF-Annual-Report-to-Congress.pdf (accessed on 22 April 2021).
Scheme 1. Steps of the study and reporting of the results. IOM—Institutes of Medicine; SORT—Strength of Recommendation Taxonomy.
Scheme 1. Steps of the study and reporting of the results. IOM—Institutes of Medicine; SORT—Strength of Recommendation Taxonomy.
Ijerph 19 06659 sch001
Scheme 2. The PRISMA 2020 flow diagram of the updating search and selection of the literature, which included searches of databases, registers, and other sources [41].
Scheme 2. The PRISMA 2020 flow diagram of the updating search and selection of the literature, which included searches of databases, registers, and other sources [41].
Ijerph 19 06659 sch002
Table 1. Characteristics of the included guidelines and reviews of evidence.
Table 1. Characteristics of the included guidelines and reviews of evidence.
Guidelines:
Institution, YearStandard of DevelopmentRecommendation
SRS/AAOS/POSNA/AAP, 2015 [17]opinion-based; narrative addressing new evidence; screening recommended (but readers encouraged “to reach their own decisions”)
SOSORT, 2018 [18]consensus-based; Delphi method; a panel of experts and scoliosis conservative treatment practitionersscreening recommended
US PSTF, 2018 [19]systematically developed; screening program criteria-basedstatement of no recommendation 1
UK NSC, 2016, 2021 [20]systematically developed;
screening program criteria-based
recommendation not to screen
Evidence Reviews:
Authors, YearPurposeType of StudyConclusions
Bazian Ltd., 2015 [48]UK NSC recommendation formulationsystematic review of RCTs and observational studies“(…) there is an agreed screening test to detect AIS but there is no single agreed cut-off; (…) follow-up testing using X-rays (…) may cause harm to people who would not need any treatment; (…) [it is difficult to determine] how accurate the screening test is to identify those people who need treatment; (…) it is not clear whether there is any added benefit from giving treatments for AIS following detection at screen compared with after clinical detection (…)”
Dunn et al., 2018 [3]US PSTF recommendation formulationsystematic review of RCTs and observational studies“(…) no direct evidence for a benefit of universal AIS screening of adolescents on long-term health outcomes; (…) the majority of persons identified through screening will never require treatment; Theoretical harms of universal screening have been proposed, but high-quality evidence is lacking; direct evidence on the association between magnitude of curve at skeletal maturity and adult quality of life outcomes is lacking (…)”
AAOS—American Academy of Orthopedic Surgeons, POSNA—Pediatric Orthopedic Society of North America, AAP—American Academy of Pediatrics; AIS—adolescent idiopathic scoliosis, SOSORT—Scientific Society on Scoliosis Orthopaedic and Rehabilitation Treatment; SRS—Scoliosis Research Society; RCT—randomszed controlled trial; 1 “I” recommendation: “insufficient evidence to assess the balance of benefits and harms of screening” [25,32].
Table 2. Assessment of the standards of trustworthiness of the included recommendation documents, using the criteria of the Institute of Medicine, IOM [28].
Table 2. Assessment of the standards of trustworthiness of the included recommendation documents, using the criteria of the Institute of Medicine, IOM [28].
Standards, IOM [28] 1SRS/AAOS/
POSNA/AAP, 2015 [17]
SOSORT, 2018 [18]US PSTF, 2018 [19]UK NSC, 2016, 2021 [20]
1.CACAYY
2.NYYY
3.NNYY
4.NNYY
5.NCAYY
6.YYYY
7.NNYN
8.YYYY
Y—criterion met; N—criterion unmet; CA—cannot answer (unclear); IOM—Institute of Medicine; other abbreviations explained in Table 1; 1 Table A1 provides descriptions of the subsequent standards.
Table 3. The Strength of Recommendation Taxonomy, SORT, qualifications of the levels of evidence, and strengths of recommendations of the included recommendation documents [30].
Table 3. The Strength of Recommendation Taxonomy, SORT, qualifications of the levels of evidence, and strengths of recommendations of the included recommendation documents [30].
Publication:SORT Qualification 1:
Institution, YearLevel of EvidenceStrength of Recommendation
SRS/AAOS/POSNA/AAP, 2015 [17]IIIC
SOSORT, 2018 [18]IIIC
US PSTF, 2018 [19]IIB
UK NSC, 2016, 2021 [20]IIB
SORT—Strength of Recommendation Taxonomy; other abbreviations explained in Table 1; 1 Table A2 describes the SORT taxonomy.
Table 4. AMSTAR 2 ratings of the methodological quality of the included systematic reviews, used for the formulation of recommendations in the analysed guidelines.
Table 4. AMSTAR 2 ratings of the methodological quality of the included systematic reviews, used for the formulation of recommendations in the analysed guidelines.
Systematic ReviewAMSTAR 2
Questions 1:Overall Confidence 1
12345678910111213141516
answers 1:
Dunn et al., 2018 [3]YYYYYYYYYNNANAYYNAYHigh
Bazian Ltd., 2015 [48]YNYPYCACANPYNNNANANNNANModerate
Y—yes; N—no; PY—partial yes; NA—not applicable; CA—cannot answer; 1 details provided in Table A3.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Płaszewski, M. No Recommendation Is (at Least Presently) the Best Recommendation: An Updating Quality Appraisal of Recommendations on Screening for Scoliosis. Int. J. Environ. Res. Public Health 2022, 19, 6659. https://doi.org/10.3390/ijerph19116659

AMA Style

Płaszewski M. No Recommendation Is (at Least Presently) the Best Recommendation: An Updating Quality Appraisal of Recommendations on Screening for Scoliosis. International Journal of Environmental Research and Public Health. 2022; 19(11):6659. https://doi.org/10.3390/ijerph19116659

Chicago/Turabian Style

Płaszewski, Maciej. 2022. "No Recommendation Is (at Least Presently) the Best Recommendation: An Updating Quality Appraisal of Recommendations on Screening for Scoliosis" International Journal of Environmental Research and Public Health 19, no. 11: 6659. https://doi.org/10.3390/ijerph19116659

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop