Next Article in Journal
Biased Quantification of Rat Liver Fibrosis—Meta-Analysis with Practical Recommendations and Clinical Implications
Next Article in Special Issue
Current Knowledge on the Different Characteristics of Back Pain in Adults with and without Scoliosis: A Systematic Review
Previous Article in Journal
Ultrasound-Guided Needle Biopsy as an Alternative to Chamberlain’s Mediastinotomy and Video-Assisted Thoracoscopic Surgery (VATS) in the Diagnosis of Anterior Mediastinal Neoformations: A Retrospective Analysis
Previous Article in Special Issue
Is Thoracic Kyphosis Relevant to Pain, Autonomic Nervous System Function, Disability, and Cervical Sensorimotor Control in Patients with Chronic Nonspecific Neck Pain?
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Measuring Quality of Life in Adults with Scoliosis: A Cross-Sectional Study Comparing SRS-22 and ISYQOL Questionnaires

1
ISICO (Italian Scientific Spine Institute), Via Roberto Bellarmino 13/1, 20141 Milan, Italy
2
IRCCS, Istituto Auxologico Italiano, Department of Neurorehabilitation Sciences, Ospedale San Luca, 20149 Milan, Italy
3
Department of Biomedical Sciences for Health, Università degli Studi di Milano, 20133 Milan, Italy
4
Department of Biomedical, Surgical and Dental Sciences, University “La Statale”, 20122 Milan, Italy
5
IRCCS Istituto Ortopedico Galeazzi, 20157 Milan, Italy
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2023, 12(15), 5071; https://doi.org/10.3390/jcm12155071
Submission received: 28 June 2023 / Revised: 20 July 2023 / Accepted: 29 July 2023 / Published: 1 August 2023
(This article belongs to the Special Issue Spine Rehabilitation in 2022 and Beyond)

Abstract

:
Idiopathic scoliosis is common in adulthood and can impact patients’ physical and psychological health. The Scoliosis Research Society-22 Questionnaire (SRS-22) has been designed to assess health-related quality of life (HRQOL) in idiopathic scoliosis, and it is the most used disease-specific outcome tool from adolescence to adulthood. More recently, the Italian Spine Youth Quality of Life (ISYQOL) international questionnaire was developed, which performs better than SRS-22 in adolescent spinal deformities. However, the ISYQOL questionnaire has never been tested in adults. This study compares the construct validity of ISYQOL and SRS-22 with the Rasch analysis (partial credit model). We recruited 150 adults and 50 adolescents with scoliosis (≥30° Cobb). SRS-22, but not ISQYOL, showed disordered categories and one item not fitting the Rasch model. A 21-item SRS-22 version with revised categories was arranged and further compared to ISYQOL. Both questionnaires showed multidimensionality, and some items (SRS-22 in a greater number) functioned differently in persons of different ages. However, the artefacts caused by multidimensionality and differential functioning had a low impact on the questionnaires’ measures. The construct validity of ISYQOL International and the revised SRS-22 are comparable. Both questionnaires (but not the original SRS-22) can return measures of disease burden in adults with scoliosis.

1. Introduction

Spinal deformities, such as scoliosis, may significantly impact patients’ physical and psychological health [1]. Adolescents with idiopathic scoliosis can show psychological and emotional distress, with anxiety as the most common symptom [2]. They may exhibit poorer psychosocial functioning and body image than their healthy peers, while adults with scoliosis show concerns about the risk of disability, body image, and physical health problems [3]. During adulthood, this pathology can cause lower back pain, bent posture, shortness of breath, and reduced autonomy in everyday activities [4]. Disease-specific outcome tools can assess the extent of this impact, e.g., the Scoliosis Research Society-22 Questionnaire (SRS-22), the most used instrument to assess health-related quality of life (HRQOL) in patients with idiopathic scoliosis [5]. Initially developed [5,6] in a young population, many studies have examined its application for adult spinal deformities, demonstrating its usefulness in this population [7,8,9]. Nevertheless, other papers showed drawbacks and limitations [10].
When used as an HRQOL measure, the SRS-22, developed in the classical test theory framework (CTT), the oldest set of psychometrics techniques for developing scales and questionnaires, has a significant flaw: its total ordinal score is not a measure but a measure approximation at best [11]. Equal changes in ordinal scores do not necessarily reflect identical changes in the quantity of the variable of interest. This fact has practical consequences: customary statistics such as effect size can be misleading when calculated on ordinal scores.
Like CTT, the Rasch analysis is a statistical method designed to build and assess questionnaires. If a questionnaire’s score empirically demonstrates compliance with the assumptions of the Rasch analysis, it is possible to turn these total scores into actual interval measures [11].
Rasch’s analysis revealed that the SRS-22 has poor metric properties, failing to assess HRQOL properly in non-surgical adolescents and children [12]. Therefore, we developed the Italian Spine Youth Quality of Life (ISYQOL), using Rasch analysis, as a new patient-reported outcome measure to assess HRQOL in adolescents with spinal deformities [13]. ISYQOL had satisfactory construct validity and, compared to SRS-22, better known-groups validity, detecting the impact of disease severity on HRQOL [14]. More recently, a different version called “ISYQOL International” has been validated in a multicentre international study, the cross-culturally equivalent version of the questionnaire [15].
To our knowledge, no other Rasch-consistent questionnaire measuring HRQOL in adults with spinal deformities is available, and the data on ISYQOL’s and ISYQOL International’s validity come solely from the adolescent population. Therefore, the present study aims to verify the construct validity of ISYQOL International and to compare its properties to the SRS-22 in adults with scoliosis. We hypothesize that the ISYQOL can perform at least as well as the SRS-22 in adults with scoliosis. Moreover, we expect ISYQOL to perform similarly in adults and adolescents with scoliosis.

2. Materials and Methods

2.1. Study Characteristics

We conducted a cross-sectional study based on data from an ongoing prospective database collecting records from patients attending a tertiary outpatient clinic specializing in the conservative treatment of spinal deformities in Italy.

2.2. Data Collection

As standard practice, all patients attending our rehabilitation centre complete the self-administered SRS-22 and ISYQOL questionnaires before every medical consultation.

2.3. Participants

On 8 October 2022, we extracted all consecutive patients respecting the following criteria: (1) age ≥18 years, (2) diagnosis of idiopathic scoliosis with a curve of 30° Cobb or more, and (3) availability of both the ISYQOL and SRS-22 questionnaires. Exclusion criteria were the following: (1) history of spine surgery, (2) history of relevant diseases, surgery, or trauma, and (3) a positive neurologic examination. Only questionnaires not exceeding two missing answers were included in the analysis. From this group, we randomly extracted 150 patients. Since we expected that age could impact the results of the questionnaires, we made a cluster sampling based on age and sex. We had six groups based on age: 20–29, 30–39, 40–49, 50–59, 60–69, and 70–79 years. For each group, we extracted 20 females and five males as per the different sex prevalence of spinal deformities. This is based on the published literature and our data. A systematic review has reported a prevalence of degenerative scoliosis of 41.2% for females versus 27.5% for males [16]. Considering idiopathic scoliosis, the ratio is 7/1 in favour of females [1]. In our database, which includes a mixed population, the ratio is about 4–5/1 for all kinds of scoliosis during adulthood.
Moreover, we randomly extracted a sample of 50 individuals aged between 14 and 18 years from the dataset we analysed in our previous study for the ISYQOL validation study [14]. We included ten participants for each of the five years of age (eight females and two males), all affected by idiopathic scoliosis and all not wearing a brace.

2.4. Sample Size Calculation

In the Rasch analysis framework, about 200 questionnaires are usually enough to produce stable estimates [17]. In addition, we arranged age subgroups of equal size to comply with some recent guidelines and recommendations for the differential item functioning (DIF) analysis (see below) [18,19].

2.5. Health-Related Quality-of-Life Questionnaires: SRS-22 and ISYQOL

The SRS-22 questionnaire [5] consists of 22 items scored on five ordinal categories (1–5), with higher scores corresponding to a lower disease burden and, thus, better quality of life. It measures specific aspects of HRQOL, covering five domains: self-image, mental health, pain, function, and treatment satisfaction [20,21].
ISYQOL International derives from ISYQOL. We translated ISYQOL into different languages and assessed its cross-cultural validity. We removed four items from the original questionnaire [15]. The ISYQOL International consists of 16 items scored on three categories (0–2); the higher the category numeral, the more the disease burden. The ordinal ISYQOL total score is converted into an interval measure with logit as the measurement unit (the higher the logit measure, the higher the disease burden). The ISYQOL ordinal score can also be expressed on an interval scale ranging from 0 to 100%, with 100% indicating an excellent quality of life. It consists of two subscales, one (9 items) regarding spine health and the other (7 items) regarding brace wearing. Only the ISYQOL International spine domain was collected here since no participant wore a brace at the point of inclusion in the study.

2.6. Statistical Analysis

We ran the Rasch analysis in the following steps [12,13,15] (Appendix A and Appendix B).

2.6.1. Categories’ Functioning

The categories’ functioning was evaluated by assessing their average order, as per Linacre [22], and the order of the modal thresholds, as per Andrich [23].

2.6.2. Fit the Model

We can extract measures from the questionnaire’s scores if categories are ordered and data fit one of the Rasch family models (here, Masters’ partial credit model [24]).
We used the mean square (MnSq) and the z-standardised (Z-Std) statistics (“infit” and “outfit” variants) to quantify the departure of the observed data from the model’s prediction and the probability that this departure was due to chance, respectively.
Here, an item was considered to “misfit”, i.e., not fit the model adequately, if:
outfit MnSq > 2.0 and absolute outfit Z-Std > 1.96, or
infit MnSq > 1.5 and absolute infit Z-Std > 1.96.

2.6.3. Dimensionality

Measures are unidimensional, meaning they reflect a single variable’s amount. In the Rasch framework, principal components with an eigenvalue >2 from a principal component analysis (PCA) calculated on the model’s residuals indicate multidimensionality.
In the case that multidimensionality is found, whether this multidimensionality harms measurements can be tested by assessing if cluster 1 items (items with a large and positive loading on the principal component) and cluster 3 items (items with a large and negative loading) return a different participants measure from cluster 2 items (those items loading low on the principal component, thus reflecting only the variable grasped by the model of Rasch).
Suppose persons’ measures from cluster 1 and cluster 3 are comparable. In that case, the artefact caused by the hidden variable highlighted from the principal component is not strong enough to cause a severe measurement artefact [25]. For this comparison, we used ANOVA.

2.6.4. Differential Item Functioning

Differential item functioning (DIF) indicates that an item does not work the same in different groups of respondents. Given the study’s aim, the current analysis focused on the DIF for age. We reorganized the participants’ sample into the following age classes: adolescents (from 14 to 18 years), young adults (from 20 to 39 years), middle-aged adults (from 40 to 59 years) and older adults (from 60 to 79 years). As a complementary analysis, we evaluated DIF for gender (males vs. females). We tested the DIF of SRS-22 and ISYQOL International items following Linacre [25].
Suppose the calibration of an item is different in a subgroup of participants and in the primary analysis. If this difference is <0.5 logit with p > 0.01, the DIF can be considered too small to matter.
In the case of a large (>0.5 logit) and significant (p < 0.01) DIF being found for an item, the observed scores of the participants’ subset on this item and their expected scores are compared to provide an easy understanding of the artefact caused by the DIF in terms of the questionnaire’s total score.

2.6.5. Questionnaire Reliability and Targeting

We reported the ISYQOL International and the SRS-22 reliability as “Rasch persons’ reliability”, similar to Cronbach’s alpha. From this reliability index, we calculated the number of strata, the number of significantly different levels of the disease burden a person can progress through (Supplementary Materials 1 in [26]).
Floor and ceiling effects were calculated as the percentage of respondents obtaining the minimum and maximum total questionnaire scores, respectively. The size of the difference between the persons and the items measures complements this information. A questionnaire with no floor effect, no ceiling effect, and 0 logit difference between participants and items mean measure targets appropriately the recruited sample participants. The item and person maps graphically show the targeting of persons compared to the measurement instrument.
Finally, we provide the score-to-measure tables to allow future users to turn the questionnaires’ total scores into interval measures.
We used FACETS 3.84.0 and WINSTEPS 5.4.3.0 for the Rasch analysis (partial credit model). We performed the statistics using the R (R version 4.2.3 “Shortstop Beagle”) software. Type 1 error probability was set to 0.05 as customary in all analyses, but we lowered this threshold for DIF to 0.01 because of multiple statistical testing [15,27].

2.7. Ethical Approval

The local ethics committee approved the study (Comitato Etico Milano Area 2, 215_2022bis), and we registered the protocol on clinicaltrials.gov (NCT05333757). This study did not receive dedicated funding support. All participants gave written informed consent.

3. Results

At the time of data extraction, our database included 3254 adult patients with scoliosis or other spinal deformities (2540 females, 714 males), fulfilling the inclusion criteria. From these, we randomly selected 150 subjects (120 females, 30 males). For each group, we had 20 females and five males diagnosed with scoliosis based on clinical and radiological assessment.
Table 1 reports the clinical features of the participants included in the current analysis.

3.1. Rasch Analysis of ISYQOL International

All nine items of ISYQOL International had ordered categories and thresholds (Table A1 in Appendix B).
Regarding the fit to the model, infit and outfit MnSq were suitable for all the questionnaire’s items (Table 2).
The PCA of the model’s residuals highlighted that another dimension, in addition to the one taken into account by the Rasch model, affects the questionnaire scores. The eigenvalue of the first principal component was 2.55, a value which indicates that the hidden dimension affects the score of three items at most.
Cluster 1, i.e., the cluster of items with a positive loading on the first principal component, included items 6, 8, and 9 (8, 11, and 12 of ISYQOL original; Figure 1). Notably, all these three items had a large (>0.60) loading. Cluster 3 (i.e., the items with negative loading) included items 1, 2, and 7 (1, 2, and 9 of ISYQOL original).
ANOVA comparing the persons’ measures from cluster 1, 2, and 3 items was not significant (F2,368 = 1.09; p = 0.337), indicating that on average, clusters 1 and 3, i.e., the clusters of items more severely affected by the first principal component hidden variable, measure the same as cluster 2 items, i.e., the items prominently reflecting the variable grasped by the model of Rasch.
Table 3 reports the results of the DIF analysis.
One item only (item 8, corresponding to item 11 in the ISYQOL original) was affected by DIF for age.
In detail, item 8’s calibration was lower in adolescents than in the primary analysis, including participants of all ages (calibration difference = 0.83 logits, p = 0.006).
The age-related DIF for item 8 indicates that adolescents are more likely to be bothered than young, middle-aged, and older people by showing their physical appearance despite the same overall burden of disease level.
Even if large at the item level and statistically significant, the age-related DIF of item 8 caused a minor artefact on the ISYQOL total score (and hence on the ISYQOL measures). On average, adolescents scored more than expected on item 8. However, the difference between the observed score on item 8 (biased since inflated by DIF) and the expected score given the primary analysis was 0.19 (i.e., less than one-fifth of a point of the ISYQOL International total score).
We found no DIF for gender.
The ISYQOL International’s reliability (model, sample reliability, extremes included) was 0.88, which allows for distinguishing 3.91 strata. The questionnaire targeting was satisfactory, as indicated by a participant’s mean measure of 0.27 logits (SD = 2.52 logits).
Regarding the ceiling and floor effect, ten participants (out of 200, i.e., 5%) obtained the maximum score and five (i.e., 2.5%) the minimum.
Figure 2 shows the item and person maps of ISYQOL International. Table 4 provides the ISYQOL International score-to-measure conversion table.

3.2. Rasch Analysis of SRS-22

On the first analysis run, 11 items had disordered categories. One possible reason was that the respondents seldom selected the lower categories. As a result, the accuracy of estimating the categories’ parameters was poor.
We rearranged items 7, 8, 9, 13, 17, and 20 by collapsing the original categories 1 and 2 into the new category 1. For items 5, 11, 15, 18, and 22, it was necessary to collapse categories 1, 2, and 3. Note that after this procedure, SRS-22 consisted of a mixture of items scored on five (11 items), four (6 items), and three (5 items) categories.
The collapsing procedure efficiently ordered all the items’ categories (Table A2 in Appendix B)
However, modal thresholds were disordered in seven items (7, 9, 12, 15, 16, 17, and 19).
On a subsequent analysis run, item 15 did not fit the model because of a large and significant outfit (MnSq = 2.97; Z-Std = 3.30). On a new run in which item 15 was dropped from the questionnaire, all 21 items properly fit the model (Table 5). The analysis continues assessing the measurement properties of this revised version of the SRS-22.
The PCA of the residuals highlighted two hidden dimensions, as indicated by the eigenvalue of the first principal component (3.45) and that of the second (2.72).
Items 1, 2, and 12 were the three items with the largest loading of cluster 1 (Figure 3). Items 4, 10, and 19 were the three with the largest negative loading (i.e., cluster 3 items with the largest loading). Regarding the second principal component, the three cluster 1 items were items 7, 13, and 16. The three most significant cluster 3 items were items 10, 19, and 21.
Despite the presence of two additional dimensions, person measures from the three items clusters were not significantly different from each other (contrasts on the first principal component: F2,396 = 1.57; p = 0.209; contrasts on the second principal component: F2,396 = 0.60; p = 0.549).
Four items (i.e., items 3, 4, 8, and 12) were affected by DIF for age (Table 3).
Item 3’s calibration was significantly lower when calculated in the older adults group than when we inputted the total participants’ sample into the analysis. (i.e., item 3’s calibration was lower in older persons than in middle-aged, young adults, and adolescents). We found the same pattern for item 8. Item 4’s calibration was higher, and item 12’s was lower in adolescents.
Due to these differences in the items’ calibrations, the older adults observed scores on items 3 and 8 was larger than expected. Adolescents’ scores on item 4 were lower than predicted, while on item 12 were higher.
However, when we consider the artefact they cause in the SRS-22 total score, the biases of items 4 and 12 have opposite signs (the first decreases and the second increases the item’s score), thus compensating each other. The bias of items 3 and 8 inflates the SRS-22 total score by 0.31 and 0.36 points (i.e., 0.67 points when considered together) in older persons. Similarly to ISYQOL International, DIF is present, but its consequences on the measures derived from the total questionnaire score seem modest.
We found no DIF for gender.
The reliability of the modified version of the SRS-22 questionnaire was 0.91, and the number of strata was 4.59.
Only one respondent obtained the SRS-22 maximum score. However, the participants’ mean measure was 0.86 logits (SD = 1.18 logits), flagging poor targeting of the SRS-22 questionnaire in this sample (Figure 4).
We provide the score-to-measure table of the revised SRS-22 version in Table 6.

4. Discussion

Spinal deformities can negatively impact a patient’s quality of life during adulthood. To monitor the changes over time, clinicians need specific tools to picture the patient’s pain, activity limitations, and participation restrictions. Many validated and reliable tools are available for patients with chronic LBP [28]. They can also help in the case of spinal deformities but could lack some specificity. From a psychometrics perspective, their content validity is poor. For example, some items included in the Oswestry Disability Index (ODI), such as rest quality and travelling, are not specific for spinal deformities. In a recent study about bracing, despite the significant improvements in pain, the ODI failed to show clinically significant improvements [29]. In a sample of surgically treated patients, the SRS self-image domain demonstrated higher responsiveness to change, followed by SRS total, then SRS pain, and then ODI [7]. Unfortunately, it is unclear whether it was a limit of the ODI, or an issue related to the too-small clinical changes of patients. These findings and limits suggest the need for developing specific tools. The SRS-22 was explicitly designed for adolescent scoliosis patients managed in a surgical setting. For those treated conservatively, they showed some limits and mainly a ceiling effect [12]. Many authors and clinicians use the SRS-22 also in adults even though young patients were its original target, and some limits have already been reported [10]. The SRS-22 remains the most widely used questionnaire in adults with spinal deformities. Nevertheless, the challenges with the currently accepted standard questionnaire (SRS-22) for HRQOL assessments in scoliosis are detailed in the literature and application of the SRS-22 in the adult population with scoliotic deformities has been debated [30]. Currently, there is no gold standard that is reliable and valid for the complexity of the ‘patient’s perception’ on how their deformity impacts their life. Recently, we developed a new tool, the ISYQOL, to measure conservatively managed patients during growth appropriately, but no data are available for adults. The current one was the first study to compare the properties of the ISYQOL to the SRS-22 in adults attending a rehabilitation centre specialized in the conservative treatment of spinal deformities.
Regarding the Rasch analysis, the original SRS-22 questionnaire, but not ISYQOL International, failed to meet the two basic assumptions of the analysis: the assumption of ordered categories and data-model fit.
Several SRS-22 items had disordered categories and thresholds, and disordered thresholds remain even after rearranging the categories so that their average measure is ordered. In addition, item 15 of SRS-22 does not fit the model. Therefore, in the fundamental measurement framework [11,31], the SRS-22 should not be used in its original form to measure the disease burden in adults with spinal deformities.
Despite rearranging the SRS-22 to comply with the ordered categories and data-model fit assumptions, multidimensionality still affects it, and DIF corrupts several items for age and gender. ISYQOL International suffers similar issues in this respect. However, regarding multidimensionality, SRS-22’s measures of HRQOL are disturbed by two additional unknown variables, while those from ISYQOL International are disturbed by one. The SRS-22 is tridimensional, while ISYQOL International is bidimensional: considering that accurate measures are unidimensional [11], we can assume the latter to be better than the former.
Regarding DIF, DIF for age afflicts more SRS-22 than ISYQOL items.
From a measurement theory perspective, multidimensionality and DIF are serious flaws. However, the total questionnaire score and the measures extracted with the Rasch analysis from these scores are robust to some DIF and multidimensionality [32]. If a questionnaire demonstrates this measure’s robustness, we can safely use it despite these flaws. Based on our findings, the ISYQOL International and the modified SRS-22 version can measure the disease burden despite the DIF and multidimensionality, since we experimentally found these flaws are negligible. However, the artefacts caused by DIF and multidimensionality would likely be non-negligible if single or groups of items were selected from the questionnaire and used for measuring, a frequently used practice for SRS-22 [7].
ISYQOL International has two additional strengths: it is shorter and more straightforward than the SRS-22 and better targeted than SRS-22. About this last point, the average SRS-22 measure is larger than 0 logits, indicating that several SRS-22 items investigate a (low) range of HRQOL, which the patients included here do not experience. SRS-22 is not perfectly tuned to measure patients like those recruited here.
On the contrary, SRS-22’s reliability is better than that of ISYQOL International, a finding which results from its large number of categories times items. However, the modest improvement in the reliability of SRS-22 comes at the expense of a more marked increase in the number of categories and items (91 for SRS-22 and 27 for the ISQYOL International—spine domain).
We already assessed the measurement properties of the SRS-22 with the Rasch analysis [12], and our previous study also pointed out different problems. However, in the current work, a more liberal analysis has been conducted, so the SRS-22 flaws seem less severe. Nevertheless, even if adherence to the analysis requirements is relaxed as much as possible, some significant drawbacks remain, such as disordered categories and a misfitting item.
Another reason for the different results of the current and our former work is that the participants recruited here were mostly adults. At the same time, previously, we studied SRS-22 functioning in children and adolescents. The DIF analysis highlights that, in most cases, adolescents usually understand several SRS-22 items differently from adults. Hence, SRS-22 could function differently in young people than adults, but further research is needed.

Study Limitations and Further Developments

The SRS-22 and ISYQOL International questionnaires demonstrated multidimensionality, suggesting they measure multiple HRQOL aspects. It has been empirically shown here that this multidimensionality is unlikely to harm. However, multidimensionality is always a measurement threat strictly, making the questionnaires’ interpretation more challenging. In this regard, the additional hidden variable in ISYQOL International’s scores and the two hidden variables in the SRS-22 remain to be discovered.
The same reasoning applies to the results of the DIF analysis (to note, DIF is simply another form of multidimensionality). The study found that some questionnaire items functioned differently in individuals of different ages. Furthermore, in this case it is shown that the measurement artefact caused by DIF is negligible. However, in strict metrological terms, this response bias indicates that the questionnaires do not perform consistently across different age groups.
ISYQOL is a relatively new instrument, and studies are needed to assess it further. Recently, ISYQOL has been translated into different languages and tested in different cultures in young persons with scoliosis [15]. There is a need to compare ISYQOL International and SRS-22 in adult patients from different countries and cultures as well. We could also test ISYQOL’s properties in patients who underwent spine surgery and compare it to other quality-of-life measures in addition to SRS-22. Finally, ISYQOL International has no items assessing pain, which can be a significant complaint adults make [3]. If this is an issue regarding ISQOL International’s face validity when used to evaluate the scoliosis burden of disease in adults, it remains to be investigated.

5. Conclusions

Scoliosis treatment cannot be restricted solely to correcting the curvature, but it should also assess and monitor patients’ satisfaction, psychological issues, and HRQOL over time. There is a need for a proper tool that allows clinicians to evaluate the impact of spinal deformities in adulthood. The results of the present work indicate that the ISYQOL spine health subscale can be administered in a clinical setting to evaluate HRQOL in adults with scoliosis. SRS-22, in its original form, showed poor construct validity in the Rasch analysis measurement framework. While the revised SRS-22 has improved metrological features, ISYQOL International is better regarding dimensionality and differential item functioning. In addition, ISYQOL International is also considerably shorter, more straightforward, and better targeted to measure the disease burden in adults with non-surgical scoliosis.

Author Contributions

Conceptualization, F.Z.; methodology, A.C. and S.S.; formal analysis, A.C. and S.S.; interpretation of results: F.Z., S.N. and S.D.; writing—original draft preparation, I.F.; writing—review and editing, all authors. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee Comitato Etico Milano Area 2 (parere 215_2022bis, approved 29 March 2022).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study will be available on Zenodo upon acceptance of the paper.

Acknowledgments

This study was supported and funded by the Italian Ministry of Health-Ricerca Corrente (2022).

Conflicts of Interest

S.N owns stock in ISICO. I.F. is related to S.N. All other authors have no conflict to declare.

Appendix A. Methods: The Rasch Analysis of the SRS-22 and ISYQOL International Questionnaires

The Rasch analysis run in the current study has been briefly mentioned in the main text and is detailed in the present appendix. The following steps have been followed to assess the construct validity of the SRS-22 and ISYQOL International questionnaires.
1.
Categories’ functioning
First, the categories’ functioning has been evaluated by assessing their order and the order of the modal thresholds.
The Rasch analysis assumes that the greater the measured variable, the higher the item numeral chosen by the respondent.
In the current study, regarding ISYQOL International, assessing the category order means verifying that the average burden of disease measure of the participants scoring 2 on an item is higher than that of those scoring 1 on the same item. In turn, those scoring 1 measure higher than those scoring 0. If this monotonic relationship between the items’ numerals and the average sample measures holds for all the questionnaire’s items, the questionnaire’s category structure can be considered to work as intended. Regarding SRS-22, categories are ordered if those participants choosing category 5 on an item enjoy, on average, a lower burden of disease than those scoring 4 (and so on).
In addition to the category order, the order of the modal thresholds is also assessed as a complementary analysis. According to some scholars [23], ordered categories and thresholds are more robust evidence that the items category structure works appropriately.
When applied to ISYQOL International, “ordered thresholds” means that there exists a range of disease burden values for which category 0 is most likely chosen from respondents. Adjoining this range is the range of values for which the modal category is category 1 and, finally, the range of disease burden for which category 2 is the modal one. The same reasoning applies to SRS-22.
2.
Fit to the model
Measures can be extracted from the questionnaire’s scores if categories are ordered, and data fit the model of Rasch. To date, the original model of Rasch for the analysis of dichotomous items is complemented by additional models, such as the partial credit model, the one used for the current research, allowing the analysis of polytomous items.
The mean square (MnSq) and the z-standardised (Z-Std) statistics quantify the departure of the observed data from the model’s prediction and the probability that this departure is due to chance, respectively.
Two versions of the MnSq and Z-Std statistics are usually considered: the “outfit”, sensitive to outliers (which is obtained from the chi-squared statistics), and the “infit”. A large and significant infit MnSq indicates that items whose difficulty is well targeted on the respondents’ ability do not work according to the model prescription. A large infit suggests a more severe item malfunctioning.
Here, an item is considered to “misfit”, i.e., not fitting the model adequately, if
outfit MnSq > 2.0 and absolute outfit Z-Std > 1.96, or
infit MnSq > 1.5 and absolute infit Z-Std > 1.96.
Misfitting items are often dropped from the questionnaire.
As mentioned above, once the data are demonstrated to fit the model, questionnaire scores can be turned into measures on an interval scale. The logit is the measurement unit of these measures.
3.
Dimensionality
Measures are unidimensional, i.e., reflect the amount of a single variable. However, in practice, any measurement is affected by some multidimensionality. Therefore, in addition to assessing if a measure is multidimensional, it is crucial to determine the amount of dimensionality and if multidimensionality is so extensive as to distort measures.
In the Rasch framework, multidimensionality is indicated by principal components with an eigenvalue >2 based on a principal component analysis (PCA) calculated on the model’s residuals.
The idea behind this approach is straightforward: if questionnaires’ scores are unidimensional, once the Rasch dimension is “peeled off” from the data, randomness remains in the residuals (i.e., the residuals are entirely uncorrelated). On the contrary, correlation among residuals indicates that a hidden, additional variable drives together the items’ scores.
The PCA is simply a statistical technique that efficiently highlights the correlation pattern among residuals.
In the case of multidimensionality being found, the following approach is used here to evaluate if this multidimensionality harms the measurements.
Items are split into three clusters according to their loading on the principal component with eigenvalue >2: items belonging to cluster 1 have a large positive loading, and those belonging to cluster 3 have a large and negative loading. Finally, cluster 2 items have a low load on the principal component.
Therefore, the score of cluster 1 and 3 items depends on the quantity of the variable grasped by the Rasch model and the quantity of the variable highlighted by the principal component. The score of cluster 2 depends instead on the Rasch variable only.
Moreover, the score of cluster 1 items is inflated by the principal component variable while that of cluster 3 items is decreased, where “increased” and “decreased” are compared to what is predicted by the Rasch model.
Persons are measured with the three clusters, and the three sets of measures are compared with ANOVA (here calculated on linear mixed-effects models).
If persons’ measures from cluster 1 and cluster 3 are comparable to, i.e., not significantly different from those from cluster 2 (i.e., those measures reflecting only the variable grasped by the model of Rasch), then the inflation/deflation of the items’ scores caused by the hidden variable highlighted from the principal component is not strong enough to cause a severe measurement artefact. In a few words, despite multidimensionality, the Rasch variable still mainly drives the items’ scores (despite multidimensionality, the measures from multidimensional items are still comparable to those from unidimensional ones).
Only non-extreme person measures are used for this analysis to improve the accuracy of the analysis (measures are approximated for persons totalling the questionnaire maximum or minimum total score).
4.
Differential Item Functioning
Differential item functioning (DIF), also called item bias, indicates that an item does not work the same in different groups of respondents.
A prominent feature of measures is that they depend only on the measured quantity and are not affected by other features of the measured object. An example from the physical world will clarify this aspect.
Say we have 1 kg of carrots and 1 kg of potatoes. We expect that if a scales is used to measure the mass of carrots and potatoes, the scales reading will be the same (1 kg) when both vegetables are tested.
Say instead that the scales returns 1.3 kg for the (1 kg) of carrots and 0.8 kg for the (1 kg) of potatoes. We would conclude that there is something wrong with the scales. Is the scales measuring the mass and something else (maybe the volume of the vegetable)? Is the scales broken?
The DIF assessment evaluates if an item (which corresponds to the scales of the previous example) returns the same measures of persons (vegetables, in the example) belonging to different groups (e.g., carrots and potatoes). Here, testing DIF is testing if measures from an item of individuals with the same burden of disease level but belonging to different groups (e.g., adolescents vs. old persons) are the same.
Since the study aims to assess if SRS-22 and ISYQOL are suitable to quantify the burden of disease in adults and older people, the current analysis focussed on the DIF for age. The participants’ sample was split into: adolescents (from 14 to 18 years), young adults (from 20 to 39 years), middle-aged adults (from 40 to 59 years), and older adults (from 60 to 79 years). As a complementary analysis, DIF for gender (males vs. females) was also evaluated.
The DIF of SRS-22 and ISYQOL International items is tested here following Linacre [25].
The observed scores for an item in a group of respondents (say older adults) are compared to their expected scores for that item given the items’ calibration from the primary analysis, the analysis including the whole participants’ sample (i.e., adolescents, young, middle-aged, and older people).
Now, imagine that older adults scored more than expected on item i. Item i is thus easier to endorse in older adults than in the complete participants’ sample and easier to endorse than in the participants of the remaining subsets. In other words, the item’s calibration is lower for older adults than for the participants of the other classes.
Item i is considered corrupted by DIF if the difference between the two calibrations is large (i.e., >0.5 logits) and significant (i.e., p < 0.01, see below).
Say DIF is found for some items and grouping variables (i.e., age or gender here). Similar to multidimensionality, what is essential is to assess if DIF causes such a large measurement distortion to produce an artefact in the persons’ measures from the questionnaire total score.
The consequences of DIF (i.e., the malfunctioning of some items) on the measures from the questionnaire’s total score can be just assessed by comparing the observed and expected scores.
Imagine a questionnaire, with each item scored in four categories. Now, consider two different scenarios in which DIF corrupts item k. In the first scenario, the average observed score by a class of respondents is 2.1 points higher than expected. In the second, the difference between the observed and the expected score is 0.14. In the first case, DIF causes a two-point artefact in the total questionnaire score (and thus on the respondents’ measures). In the second, the impact of DIF on the total score are much more negligible (the total score is inflated by just 0.14).
By comparing the observed and expected scores, it is thus easy to understand the artefact caused by DIF at the questionnaire’s total score level.
This way of analysing DIF clearly makes the questionnaire’s total score (and thus the questionnaire measures) central. The idea behind this is all about answering the question: are item calibrations from the main analysis (biased if there is DIF) a good proxy of the exact calibration which would be obtained in the specific group of participants?
Because of multiple statistical testing, the type 1 error probability was lowered to 0.01 for the DIF significance analysis [27].
5.
Targeting and reliability
High-quality measures have high reliability, meaning the measurement error is low compared to the measures’ total variance. High reliability implies that several levels of the measured variable can be distinguished at a single subject level.
In the current work, ISYQOL International’s and SRS-22’s reliability is reported as “Rasch persons’ reliability”, a reliability index similar to Cronbach’s alpha from the CTT. From this reliability index, the number of strata is calculated, i.e., the number of significantly different levels of the burden of disease a person can progress through.
For example, with a questionnaire or a scale with four strata, it is possible to follow a patient’s modification of their clinical condition from severe to moderate, mild, and eventually minimal. When the patient changes stratum, their clinical condition is different in a statistically significant way (see Supplementary Materials 1 in [26]).
Finally, floor and ceiling effects are also calculated as the percentage of respondents obtaining the minimum and maximum total questionnaire scores, respectively. The size of the difference between the persons and the items measures complements this information. A questionnaire with no floor effect, no ceiling effect, and 0 logit difference between participants and items mean measure is appropriately targeted to the recruited sample participants. To take an analogy from the physical world, a questionnaire with these features is like a ruler of the proper length for measuring the object of interest (e.g., the height of a chair vs. the length of a car).

Appendix B. Supplementary Results

Table A1. Category and threshold orders of the ISYQOL International (spine domain).
Table A1. Category and threshold orders of the ISYQOL International (spine domain).
ItemScoreCount UsedAverage MeasureAndrich Threshold
CalibrationSE
1, get worse09−1.36--
1881.13−2.270.39
2883.452.270.19
2, worried back pain028−0.91--
1770.30−1.490.26
2802.601.490.20
3, big deal089−3.03--
177−0.50−1.640.20
2190.711.640.29
4, worried not get better047−1.82--
1760.21−1.300.22
2622.011.300.21
5, suffering065−2.54--
186−0.17−1.610.20
2341.571.610.24
6, appearance071−2.66--
185−0.41−1.640.20
2291.761.640.25
7, worried back problem06−0.65--
11061.08−2.840.46
2733.852.840.20
8, bother to show067−1.94--
172−0.29−1.200.21
2461.551.200.22
9, worried visible058−2.35--
192−0.18−1.740.21
2351.601.740.24
Item: item number and a keyword briefly describing the item content. Score: item’s categories. Counts: number of observations per category participating in the estimation (extreme scores are excluded). Average measure: the mean measure of the participants scoring a specific category to an item, calculated from the item’s calibration. For example, item 3 calibration is 1.76 logits. The mean measure of the participants scoring 1 on item 3 is 1.76 − 0.50 = 1.26 logits. Andrich thresholds calibration: calibration (i.e., measure) of the Andrich (modal) thresholds. SE: standard error. All nine ISYQOL International items had ordered categories and thresholds.
Table A2. SRS-22 category and threshold orders.
Table A2. SRS-22 category and threshold orders.
ItemScoreCount UsedAverage MeasureAndrich Threshold
CalibrationSE
1, pain six months13−1.69--
2370.08−2.740.63
3500.530.130.21
4561.440.880.18
5532.211.730.19
2, pain last month16−0.91--
226−0.10−1.780.46
3510.37−0.420.22
4601.150.650.18
5562.061.560.19
3, nervous person14−1.96--
246−0.21−3.190.55
3880.34−0.670.19
4451.091.340.18
5161.472.510.30
4, back shape118−1.15--
236−0.55−1.540.28
3770.07−1.040.19
4440.630.900.18
5241.391.670.26
5, activity level1260.10--
2630.40−0.540.23
31101.680.540.16
6, look in clothes15−0.89--
219−0.67−2.120.50
3940.28−1.690.24
4651.020.970.17
5161.732.850.29
7, down in the dumps180.20--
2300.54−1.000.40
3351.040.730.21
41262.010.27 (*)0.17
8, back pain at rest128−0.30--
2490.02−0.860.23
3530.700.190.18
4691.090.680.18
9, work/school115−0.07--
2260.47−0.430.31
3370.770.300.21
41201.730.12 (*)0.17
10, trunk appearance113−1.89--
256−0.88−2.730.31
3100−0.20−1.170.17
4230.541.640.23
571.392.260.44
11, pain medications121.97--
2382.01−1.250.77
31593.201.250.19
12, around the house111−0.84--
220−0.05−0.820.35
3420.41−0.500.23
4381.040.820.19
5881.780.50 (*)0.18
13, calm and peaceful121−0.89--
257−0.32−1.700.26
3980.36−0.560.17
4231.042.260.25
14, personal relationships15−0.38--
2110.05−0.780.52
3260.67−0.340.31
4421.150.510.21
51152.120.620.17
16, down hearted and blue16−0.43--
28−0.05−0.410.48
3380.79−1.16 (*)0.32
4551.150.530.19
5921.951.050.17
17, days off1100.31--
260.830.920.39
371.520.75 (*)0.32
41761.95−1.67 (*)0.26
18, going out1180.27--
2520.80−0.450.27
31291.870.450.17
19, feel attractive126−1.70--
225−1.22−1.310.24
3104−0.33−2.18 (*)0.19
4370.140.990.20
571.812.510.43
20, happy person115−0.84--
265−0.38−2.160.29
31000.40−0.400.17
4191.522.560.27
21, satisfied with results111−1.09--
226−0.62−1.680.35
376−0.01−1.320.21
4630.830.570.17
5181.682.430.28
22, same management again167−0.71--
2640.10−0.370.18
3620.550.370.18
Same abbreviations as Table A1. Note that item 15 was removed because it did not fit the model. Note also that the original item structure on five categories has been rearranged for ten items because of disordered categories. Finally, despite ordered categories, six items have disordered Andrich thresholds (*).

References

  1. Negrini, S.; Donzelli, S.; Aulisa, A.G.; Czaprowski, D.; Schreiber, S.; de Mauroy, J.C.; Diers, H.; Grivas, T.B.; Knott, P.; Kotwicki, T.; et al. 2016 SOSORT Guidelines: Orthopaedic and Rehabilitation Treatment of Idiopathic Scoliosis during Growth. Scoliosis Spinal Disord. 2018, 13, 3. [Google Scholar] [CrossRef] [Green Version]
  2. Sanders, A.E.; Andras, L.M.; Iantorno, S.E.; Hamilton, A.; Choi, P.D.; Skaggs, D.L. Clinically Significant Psychological and Emotional Distress in 32% of Adolescent Idiopathic Scoliosis Patients. Spine Deform. 2018, 6, 435–440. [Google Scholar] [CrossRef] [PubMed]
  3. Tones, M.; Moss, N.; Polly, D.W. A Review of Quality of Life and Psychosocial Issues in Scoliosis. Spine 2006, 31, 3027–3038. [Google Scholar] [CrossRef] [PubMed]
  4. Weinstein, S.L.; Dolan, L.A.; Spratt, K.F.; Peterson, K.K.; Spoonamore, M.J.; Ponseti, I.V. Health and Function of Patients with Untreated Idiopathic Scoliosis: A 50-Year Natural History Study. JAMA 2003, 289, 559–567. [Google Scholar] [CrossRef] [Green Version]
  5. Asher, M.; Min Lai, S.; Burton, D.; Manna, B. Discrimination Validity of the Scoliosis Research Society-22 Patient Questionnaire: Relationship to Idiopathic Scoliosis Curve Pattern and Curve Size. Spine 2003, 28, 74–78. [Google Scholar] [CrossRef]
  6. Asher, M.; Min Lai, S.; Burton, D.; Manna, B. Scoliosis Research Society-22 Patient Questionnaire: Responsiveness to Change Associated with Surgical Treatment. Spine 2003, 28, 70–73. [Google Scholar] [CrossRef]
  7. Bridwell, K.H.; Berven, S.; Glassman, S.; Hamill, C.; Horton, W.C.; Lenke, L.G.; Schwab, F.; Baldus, C.; Shainline, M. Is the SRS-22 Instrument Responsive to Change in Adult Scoliosis Patients Having Primary Spinal Deformity Surgery? Spine 2007, 32, 2220–2225. [Google Scholar] [CrossRef]
  8. Bridwell, K.H.; Cats-Baril, W.; Harrast, J.; Berven, S.; Glassman, S.; Farcy, J.-P.; Horton, W.C.; Lenke, L.G.; Baldus, C.; Radake, T. The Validity of the SRS-22 Instrument in an Adult Spinal Deformity Population Compared with the Oswestry and SF-12: A Study of Response Distribution, Concurrent Validity, Internal Consistency, and Reliability. Spine 2005, 30, 455–461. [Google Scholar] [CrossRef]
  9. Berven, S.; Deviren, V.; Demir-Deviren, S.; Hu, S.S.; Bradford, D.S. Studies in the Modified Scoliosis Research Society Outcomes Instrument in Adults: Validation, Reliability, and Discriminatory Capacity. Spine 2003, 28, 2164–2169, discussion 2169. [Google Scholar] [CrossRef]
  10. Mannion, A.F.; Elfering, A.; Bago, J.; Pellise, F.; Vila-Casademunt, A.; Richner-Wunderlin, S.; Domingo-Sàbat, M.; Obeid, I.; Acaroglu, E.; Alanay, A.; et al. Factor Analysis of the SRS-22 Outcome Assessment Instrument in Patients with Adult Spinal Deformity. Eur. Spine J. 2017, 27, 685–699. [Google Scholar] [CrossRef]
  11. Tesio, L.; Scarano, S.; Hassan, S.; Kumbhare, D.; Caronni, A. Why Questionnaire Scores Are Not Measures: A Question-Raising Article. Am. J. Phys. Med. Rehabil. 2023, 102, 75–82. [Google Scholar] [CrossRef]
  12. Caronni, A.; Zaina, F.; Negrini, S. Improving the Measurement of Health-Related Quality of Life in Adolescent with Idiopathic Scoliosis: The SRS-7, a Rasch-Developed Short Form of the SRS-22 Questionnaire. Res. Dev. Disabil. 2014, 35, 784–799. [Google Scholar] [CrossRef]
  13. Caronni, A.; Sciumè, L.; Donzelli, S.; Zaina, F.; Negrini, S. ISYQOL: A Rasch-Consistent Questionnaire for Measuring Health-Related Quality of Life in Adolescents with Spinal Deformities. Spine J. 2017, 17, 1364–1372. [Google Scholar] [CrossRef]
  14. Caronni, A.; Donzelli, S.; Zaina, F.; Negrini, S. The Italian Spine Youth Quality of Life Questionnaire Measures Health-Related Quality of Life of Adolescents with Spinal Deformities Better than the Reference Standard, the Scoliosis Research Society 22 Questionnaire. Clin. Rehabil. 2019, 33, 1404–1415. [Google Scholar] [CrossRef]
  15. Negrini, S.; Zaina, F.; Buyukaslan, A.; Fortin, C.; Karavidas, N.; Kotwicki, T.; Korbel, K.; Parent, E.; Sanchez-Raya, J.; Shearer, K.; et al. Cross-Cultural Validation of the Italian Spine Youth Quality of Life Questionnaire: The ISYQOL International. Eur. J. Phys. Rehabil. Med. 2023, 59, 364. [Google Scholar] [CrossRef]
  16. McAviney, J.; Roberts, C.; Sullivan, B.; Alevras, A.J.; Graham, P.L.; Brown, B.T. The Prevalence of Adult de Novo Scoliosis: A Systematic Review and Meta-Analysis. Eur. Spine J. 2020, 29, 2960–2969. [Google Scholar] [CrossRef]
  17. Linacre, J.M. Sample Size and Item Calibration (or Person Measure) Stability. Rasch Meas. Trans. 1994, 7, 328. [Google Scholar]
  18. Mallinson, T.; Kozlowski, A.J.; Johnston, M.V.; Weaver, J.; Terhorst, L.; Grampurohit, N.; Juengst, S.; Ehrlich-Jones, L.; Heinemann, A.W.; Melvin, J.; et al. Rasch Reporting Guideline for Rehabilitation Research (RULER): The RULER Statement. Arch. Phys. Med. Rehabil. 2022, 103, 1477–1486. [Google Scholar] [CrossRef]
  19. Van de Winckel, A.; Kozlowski, A.J.; Johnston, M.V.; Weaver, J.; Grampurohit, N.; Terhorst, L.; Juengst, S.; Ehrlich-Jones, L.; Heinemann, A.W.; Melvin, J.; et al. Reporting Guideline for RULER: Rasch Reporting Guideline for Rehabilitation Research: Explanation and Elaboration. Arch. Phys. Med. Rehabil. 2022, 103, 1487–1498. [Google Scholar] [CrossRef]
  20. Monticone, M.; Nava, C.; Leggero, V.; Rocca, B.; Salvaderi, S.; Ferrante, S.; Ambrosini, E. Measurement Properties of Translated Versions of the Scoliosis Research Society-22 Patient Questionnaire, SRS-22: A Systematic Review. Qual. Life Res. 2015, 24, 1981–1998. [Google Scholar] [CrossRef]
  21. Aulisa, A.G.; Guzzanti, V.; Perisano, C.; Marzetti, E.; Specchia, A.; Galli, M.; Giordano, M.; Aulisa, L. Determination of Quality of Life in Adolescents with Idiopathic Scoliosis Subjected to Conservative Treatment. Scoliosis 2010, 5, 21. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Linacre, J. Category Disordering (Disordered Categories) vs. Threshold Disordering (Disordered Thresholds). Rasch Meas. Trans. 1999, 13, 675. [Google Scholar]
  23. Andrich, D. An Expanded Derivation of the Threshold Structure of the Polytomous Rasch Model That Dispels Any “Threshold Disorder Controversy”. Educ. Psychol. Meas. 2013, 73, 78–124. [Google Scholar] [CrossRef]
  24. Masters, G.N. A Rasch Model for Partial Credit Scoring. Psychometrika 1982, 47, 149–174. [Google Scholar] [CrossRef]
  25. Linacre, J.M. Facets Computer Program for Many-Facet Rasch Measurement. 2022. Available online: https://www.winsteps.com/facets.htm (accessed on 29 June 2023).
  26. Caronni, A.; Picardi, M.; Redaelli, V.; Antoniotti, P.; Pintavalle, G.; Aristidou, E.; Gilardone, G.; Carpinella, I.; Lencioni, T.; Arcuri, P.; et al. The Falls Efficacy Scale International Is a Valid Measure to Assess the Concern about Falling and Its Changes Induced by Treatments. Clin. Rehabil. 2021, 36, 558–570. [Google Scholar] [CrossRef]
  27. Lange, R.; Irwin, H.J.; Houran, J. Top-down Purification of Tobacyk’s Revised Paranormal Belief Scale. Personal. Individ. Differ. 2000, 29, 131–156. [Google Scholar] [CrossRef]
  28. Fairbank, J.C.; Pynsent, P.B. The Oswestry Disability Index. Spine 2000, 25, 2940–2953. [Google Scholar] [CrossRef]
  29. Zaina, F.; Poggio, M.; Di Felice, F.; Donzelli, S.; Negrini, S. Bracing Adults with Chronic Low Back Pain Secondary to Severe Scoliosis: Six Months Results of a Prospective Pilot Study. Eur. Spine J. 2021, 30, 2962–2966. [Google Scholar] [CrossRef]
  30. Archer, J.E.; Baird, C.; Gardner, A.; Rushton, A.B.; Heneghan, N.R. Evaluating Measures of Quality of Life in Adult Scoliosis: A Systematic Review and Narrative Synthesis. Spine Deform 2022, 10, 991–1002. [Google Scholar] [CrossRef]
  31. Luce, R.D.; Tukey, J.W. Simultaneous Conjoint Measurement: A New Type of Fundamental Measurement. J. Math. Psychol. 1964, 1, 1–27. [Google Scholar] [CrossRef]
  32. Caronni, A.; Picardi, M.; Scarano, S.; Tropea, P.; Gilardone, G.; Bolognini, N.; Redaelli, V.; Pintavalle, G.; Aristidou, E.; Antoniotti, P.; et al. Differential Item Functioning of the Mini-BESTest Balance Measure: A Rasch Analysis Study. Int. J. Environ. Res. Public Health 2023, 20, 5166. [Google Scholar] [CrossRef]
Figure 1. ISYQOL International dimensionality. The principal component analysis (PCA) calculated on the model’s residuals is provided for the ISYQOL International questionnaire. Panel (A): loadings of the ISYQOL International items on the first principal component from the PCA. The items are grouped into three clusters (cluster 1, 2, and 3). Cluster 2 (dark grey) items load low in absolute value on the principal component. Their score is scarcely affected by the hidden variable flagged by this component but mainly reflects the variable, i.e., disease burden, grasped by the Rasch model. On the contrary, the score of cluster 1 items (black) is inflated by an additional hidden variable, while that of cluster 3 items (light grey) is reduced. Panel (B): participants are measured with cluster 1, 2, and 3 items, and their mean measure is compared (black dots). Vertical continuous line: participants’ mean measures from the total ISYQOL International. Vertical dashed lines: participants’ mean measures from the total ISYQOL International ± 0.5 logit. On average, the participants’ measures from the three clusters of items are only slightly different from each other and minimally different from the participants’ measures from the full ISYQOL International. In particular, the mean difference between the clusters and the total questionnaire measures is well below 0.5 logits. Even if an additional unwanted variable contaminates the scores of cluster 1 and 3 items, this variable causes a negligible measurement artefact. Extreme persons, i.e., those obtaining the maximum or minimum questionnaire total score, whose real measure is unknown, have not been considered in this analysis.
Figure 1. ISYQOL International dimensionality. The principal component analysis (PCA) calculated on the model’s residuals is provided for the ISYQOL International questionnaire. Panel (A): loadings of the ISYQOL International items on the first principal component from the PCA. The items are grouped into three clusters (cluster 1, 2, and 3). Cluster 2 (dark grey) items load low in absolute value on the principal component. Their score is scarcely affected by the hidden variable flagged by this component but mainly reflects the variable, i.e., disease burden, grasped by the Rasch model. On the contrary, the score of cluster 1 items (black) is inflated by an additional hidden variable, while that of cluster 3 items (light grey) is reduced. Panel (B): participants are measured with cluster 1, 2, and 3 items, and their mean measure is compared (black dots). Vertical continuous line: participants’ mean measures from the total ISYQOL International. Vertical dashed lines: participants’ mean measures from the total ISYQOL International ± 0.5 logit. On average, the participants’ measures from the three clusters of items are only slightly different from each other and minimally different from the participants’ measures from the full ISYQOL International. In particular, the mean difference between the clusters and the total questionnaire measures is well below 0.5 logits. Even if an additional unwanted variable contaminates the scores of cluster 1 and 3 items, this variable causes a negligible measurement artefact. Extreme persons, i.e., those obtaining the maximum or minimum questionnaire total score, whose real measure is unknown, have not been considered in this analysis.
Jcm 12 05071 g001
Figure 2. ISYQOL International maps. Maps of persons (A), thresholds (B), and items (C) of the ISYQOL International questionnaire (spine domain). PCP: participants; n: number of; THR: Andrich’s thresholds. X-axis: line of the construct (i.e., the disease burden continuum) measured in logits. The disease burden increases from left to right. ISYQOL logit measures are measures of disease burden: the higher the logit measure, the more the disease burden. Rightmost persons on the disease burden line (A) suffer a high disease burden. The rightmost items (C) flag a high disease burden: only persons suffering a high disease burden will affirm the content of these items. In (C), the Y-axis reports the ISYQOL International item number. Labels in plot (C) are keywords recollecting the item content. The dot position on the X-axis returns the item measures, called here “item calibration”. Vertical dashed segment: items mean calibration, set to 0 logits, as customary.
Figure 2. ISYQOL International maps. Maps of persons (A), thresholds (B), and items (C) of the ISYQOL International questionnaire (spine domain). PCP: participants; n: number of; THR: Andrich’s thresholds. X-axis: line of the construct (i.e., the disease burden continuum) measured in logits. The disease burden increases from left to right. ISYQOL logit measures are measures of disease burden: the higher the logit measure, the more the disease burden. Rightmost persons on the disease burden line (A) suffer a high disease burden. The rightmost items (C) flag a high disease burden: only persons suffering a high disease burden will affirm the content of these items. In (C), the Y-axis reports the ISYQOL International item number. Labels in plot (C) are keywords recollecting the item content. The dot position on the X-axis returns the item measures, called here “item calibration”. Vertical dashed segment: items mean calibration, set to 0 logits, as customary.
Jcm 12 05071 g002
Figure 3. SRS-22 dimensionality. The principal component analysis (PCA) of the SRS-22 questionnaire (revised version) highlighted two principal components, indicating that the score of some SRS-22 items were affected by two hidden variables in addition to the Rasch dimension. Same symbols and abbreviations as Figure 1. Upper graphs in panels (A,B) report the analysis for the first principal component. The lower graphs report the clusters on the second principal component. The revised SRS-22 consists of 21 items. Here, are only the three cluster 1 items with the largest positive loadings, the three cluster 3 items with the largest negative loadings, and the three cluster 2 items with the most negligible loading.
Figure 3. SRS-22 dimensionality. The principal component analysis (PCA) of the SRS-22 questionnaire (revised version) highlighted two principal components, indicating that the score of some SRS-22 items were affected by two hidden variables in addition to the Rasch dimension. Same symbols and abbreviations as Figure 1. Upper graphs in panels (A,B) report the analysis for the first principal component. The lower graphs report the clusters on the second principal component. The revised SRS-22 consists of 21 items. Here, are only the three cluster 1 items with the largest positive loadings, the three cluster 3 items with the largest negative loadings, and the three cluster 2 items with the most negligible loading.
Jcm 12 05071 g003
Figure 4. Revised SRS-22 maps. Same abbreviations as Figure 1. SRS-22 logit measures are measures of quality of life. So, the higher the logit measure, the higher the quality of life. People experiencing a full quality of life are on the right of the continuum, and quality of life decreases from right to left. Note that the persons map (A) histogram is displaced to the right (e.g., the distribution mode is about 0.75 logits). This indicates that persons score high on the questionnaire and that the SRS-22 items are too easy to endorse for the participants’ sample recruited here. The thresholds histogram (B) shows several thresholds with overlapping calibrations between −1 and 0 logits. While many thresholds (or items) within the same construct range increase the measurement precision, it also points out some redundancy in the questionnaire. (C) items map.
Figure 4. Revised SRS-22 maps. Same abbreviations as Figure 1. SRS-22 logit measures are measures of quality of life. So, the higher the logit measure, the higher the quality of life. People experiencing a full quality of life are on the right of the continuum, and quality of life decreases from right to left. Note that the persons map (A) histogram is displaced to the right (e.g., the distribution mode is about 0.75 logits). This indicates that persons score high on the questionnaire and that the SRS-22 items are too easy to endorse for the participants’ sample recruited here. The thresholds histogram (B) shows several thresholds with overlapping calibrations between −1 and 0 logits. While many thresholds (or items) within the same construct range increase the measurement precision, it also points out some redundancy in the questionnaire. (C) items map.
Jcm 12 05071 g004
Table 1. Participants’ clinical data.
Table 1. Participants’ clinical data.
AdultsAdolescents
Males vs. females, N30 vs. 12010 vs. 40
Mean age (SD), years49 (17.8)16 (1.4)
Mean disease severity (SD), °Cobb46.2 (16.6)24.7 (9)
Median TRACE score (IQR)7 (4)5 (3)
N: number of participants; SD: standard deviation; °Cobb: angle of scoliosis curvature measured according to Cobb; IQR: interquartile range; TRACE: trunk aesthetic clinical evaluation (ordinal score of back aesthetics ranging from 1 to 12, with a high score marking a poor trunk aesthetic appearance).
Table 2. Calibration of items of ISYQOL International and their fit to the model.
Table 2. Calibration of items of ISYQOL International and their fit to the model.
ItemsCalibrationSEInfitOutfit
MnSqZ-StdMnSqZ-Std
1 (1), get worse−1.950.170.97−0.300.990.00
2 (2), worried back pain−0.950.151.121.171.543.11
3 (3), big deal1.760.161.000.000.95−0.23
4 (4), worried not get better−0.130.141.010.101.080.61
5 (7), suffering0.850.150.93−0.640.84−1.22
6 (8), appearance1.100.150.82−1.920.75−1.81
7 (9), worried back problem−1.950.180.83−1.680.75−1.72
8 (11), bother to show0.590.141.252.311.241.53
9 (12), worried visible0.690.151.070.691.020.23
Items: the item number and a keyword summarising the item content; the item number of ISYQOL original is also reported in brackets. Calibration: item calibration (i.e., item measure) expressed in logit. SE: standard error in the item calibration (logit). Infit: inlier sensitive fit indices; outfit: outlier sensitive fit indices. MnSq: mean square statistic; Z-std: z-standardised statistic.
Table 3. Age-related differential item functioning of the ISYQOL International and SRS-22 questionnaires.
Table 3. Age-related differential item functioning of the ISYQOL International and SRS-22 questionnaires.
ItemGroupObs − ExpBiasSEp Value
ISYQOL International
8 (11), bother to showAdolescents0.190.830.280.006
SRS-22
3, nervous personOlder0.310.610.200.003
4, back shapeAdolescents−0.460.680.170.000
8, back pain at restOlder0.360.510.170.004
12, around the houseAdolescents0.391.190.350.002
Item: item number and its keyword; the item number of ISYQOL original is also provided in brackets. Group: participants group for which the item’s calibration differs from the primary analysis (e.g., the calibration of ISYQOL International item 8 is different in adolescents than in the primary analysis). Obs-Exp: artefact in the item score caused by differential item functioning (DIF) and expressed as the difference between the observed (Obs) and expected (Exp) score. The expected score is calculated given the item’s calibration from the primary analysis. For example, DIF for age inflates by 0.19 the score of adolescents on ISYQOL International item 8 (i.e., their score on this item is 0.19 points higher than it should be). Bias: absolute value difference, expressed in logits, between the item’s calibration from the primary analysis and the participants’ group. SE: standard error (logit) of the bias. p value: type 1 error probability of the t-test with the null hypothesis: “item’s calibrations in group and primary analysis are not different from each other”. For both the ISYQOL International (upper row) and the revised SRS-22 (lower rows), only the items with DIF > 0.5 logit with p < 0.01 are reported. No DIF was found for gender.
Table 4. Score-to-measure conversion table of ISYQOL International.
Table 4. Score-to-measure conversion table of ISYQOL International.
ScoreBurden of DiseaseHRQOL
Measure, LogitSE,
Logit
Measure, %SE,
%
0−6.441.95100.016.2
1−4.891.2487.110.3
2−3.641.0376.78.6
3−2.730.8969.17.4
4−2.040.7863.36.5
5−1.490.7158.85.9
6−1.030.6654.95.5
7−0.610.6351.45.3
8−0.220.6248.15.2
90.160.6145.05.1
100.540.6141.95.1
110.920.6238.75.2
121.320.6435.45.3
131.730.6631.95.5
142.190.6928.15.8
152.700.7423.96.2
163.320.8418.77.0
174.221.1011.29.1
185.561.880.015.7
Score: ISYQOL International (spine health domain) total ordinal score. Measure, logit: interval measures of disease burden expressed in logits, i.e., the measurement unit of the Rasch analysis. Measure, %: interval measures reported on a user-friendly scale ranging from 0 to 100%, with 100% indicating full health-related quality of life (i.e., no disease burden). SE: standard error. Note that the higher the ISYQOL International total score, the higher the problems caused by the back condition to the patient (i.e., the higher the disease burden). The relationship between logit measures and ordinal scores is monotonic. Therefore, the higher the logit measure, the more the disease burden. Originally, ISYQOL was conceptualized as an HRQOL measure rather than a disease burden measure. For this reason, measure %, which is reversed compared to the total score and the logit measure, is also reported.
Table 5. Calibration of items of the revised SRS-22 and their fit to the model.
Table 5. Calibration of items of the revised SRS-22 and their fit to the model.
ItemsCalibrationSEInfitOutfit
MnSqZ-StdMnSqZ-Std
1, pain six months−0.280.090.69−3.720.66−3.67
2, pain last month−0.150.090.75−2.830.71−3.06
3, nervous person0.400.101.141.411.212.02
4, back shape0.700.091.090.961.101.00
5, activity level−0.240.120.87−1.460.85−1.13
6, look in clothes0.320.101.040.411.040.45
7, down in the dumps−0.710.100.97−0.271.130.68
8, back pain at rest0.300.091.424.071.523.90
9, work/school−0.410.091.090.791.080.44
10, trunk appearance1.190.101.000.031.010.10
11, pain medications−2.130.180.96−0.241.000.06
12, around the house−0.190.080.74−2.730.81−1.30
13, calm and peaceful0.720.111.171.731.181.72
14, personal relationships−0.720.090.80−1.820.72−1.63
16, downhearted and blue−0.520.091.090.831.080.64
17, days off−0.990.121.351.671.801.21
18, going out−0.610.130.89−1.100.98−0.07
19, feel attractive1.290.090.97−0.220.91−0.84
20, happy person0.670.111.030.371.050.48
21, satisfied with results0.520.090.95−0.520.93−0.65
22, same management again0.840.111.202.261.242.01
Same abbreviations as Table 2. SRS-22 item 15 is not reported because of outfit values beyond the tolerance limits. The item numbering of the original SRS-22 was kept. Remember that the categories of the original SRS-22 items have been extensively rearranged.
Table 6. Score-to-measure conversion table of the revised SRS-22.
Table 6. Score-to-measure conversion table of the revised SRS-22.
ScoreHRQOLHRQOL
Measure, LogitSE,
Logit
Measure, %SE,
%
21−5.991.850.014.7
22−4.731.0410.18.3
23−3.960.7516.26.0
24−3.490.6319.95.0
25−3.150.5522.74.4
26−2.880.5024.84.0
27−2.650.4626.63.6
28−2.460.4228.23.4
29−2.290.4029.53.2
30−2.140.3730.73.0
31−2.010.3631.72.8
32−1.890.3432.72.7
33−1.780.3333.62.6
34−1.670.3234.42.5
35−1.580.3135.22.4
36−1.490.3035.92.4
37−1.400.2936.62.3
38−1.320.2837.22.3
39−1.240.2837.82.2
40−1.170.2738.42.2
41−1.100.2739.02.1
42−1.030.2639.62.1
43−0.960.2640.12.1
44−0.890.2640.72.1
45−0.820.2641.22.1
46−0.760.2641.72.0
47−0.690.2542.22.0
48−0.630.2542.72.0
49−0.560.2543.32.0
50−0.500.2543.82.0
51−0.440.2544.32.0
52−0.370.2544.82.0
53−0.310.2645.32.0
54−0.240.2645.82.0
55−0.180.2646.42.1
56−0.110.2646.92.1
57−0.040.2647.42.1
580.030.2648.02.1
590.100.2648.52.1
600.170.2749.12.1
610.240.2749.72.2
620.310.2750.22.2
630.390.2850.82.2
640.470.2851.52.2
650.540.2852.12.3
660.630.2952.72.3
670.710.2953.42.3
680.800.3054.12.4
690.890.3054.82.4
700.980.3155.62.5
711.080.3256.42.5
721.180.3257.22.6
731.290.3358.02.6
741.400.3458.92.7
751.520.3559.92.8
761.650.3660.92.9
771.780.3761.92.9
781.920.3863.03.0
792.070.3964.23.1
802.220.4065.53.2
812.390.4166.83.3
822.570.4368.23.4
832.760.4469.73.5
842.960.4671.43.7
853.190.4973.23.9
863.440.5275.24.1
873.730.5677.54.5
884.090.6380.35.0
894.560.7584.16.0
905.311.0390.18.2
916.561.84100.014.7
Same abbreviations as Table 4. SRS-22 logit and percentage measures are quality-of-life measures: the higher the measure, the better the patient. After collection, SRS-22 item scores are rearranged so that the higher the score for each item, the better the quality of life.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zaina, F.; Ferrario, I.; Caronni, A.; Scarano, S.; Donzelli, S.; Negrini, S. Measuring Quality of Life in Adults with Scoliosis: A Cross-Sectional Study Comparing SRS-22 and ISYQOL Questionnaires. J. Clin. Med. 2023, 12, 5071. https://doi.org/10.3390/jcm12155071

AMA Style

Zaina F, Ferrario I, Caronni A, Scarano S, Donzelli S, Negrini S. Measuring Quality of Life in Adults with Scoliosis: A Cross-Sectional Study Comparing SRS-22 and ISYQOL Questionnaires. Journal of Clinical Medicine. 2023; 12(15):5071. https://doi.org/10.3390/jcm12155071

Chicago/Turabian Style

Zaina, Fabio, Irene Ferrario, Antonio Caronni, Stefano Scarano, Sabrina Donzelli, and Stefano Negrini. 2023. "Measuring Quality of Life in Adults with Scoliosis: A Cross-Sectional Study Comparing SRS-22 and ISYQOL Questionnaires" Journal of Clinical Medicine 12, no. 15: 5071. https://doi.org/10.3390/jcm12155071

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop