Do Cross-Group Differences in Life Satisfaction Reflect Measurement Bias or True Differences in Life Satisfaction? Evidence from a Dutch National Sample
Abstract
:1. Introduction
2. Methods
2.1. Participants
2.2. Measure
2.3. Grouping Variables
3. Results
3.1. Factor Structure and Reliability
3.2. Measurement Invariance
4. Discussion
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Diener, E.; Inglehart, R.; Tay, L. Theory and validity of life satisfaction scales. Soc. Indic. Res. 2012, 112, 497–527. [Google Scholar] [CrossRef]
- Diener, E.; Oishi, S.; Tay, L. Advances in subjective well-being research. Nat. Hum. Behav. 2018, 2, 253–260. [Google Scholar] [CrossRef] [PubMed]
- Diener, E.; Emmons, R.A.; Larsen, R.J.; Griffin, S. The Satisfaction With Life Scale. J. Personal. Assess. 1985, 49, 71–75. [Google Scholar] [CrossRef]
- Millsap, R.E. Statistical Approaches to Measurement Invariance; Routledge: New York, NY, USA, 2012. [Google Scholar]
- Hedrih, V. Adapting Psychological Tests and Measurement Instruments for Cross-Cultural Research: An Introduction; Routledge: New York, NY, USA, 2019. [Google Scholar]
- Brandt, M.J.; He, J.; Bender, M. Registered report: Testing ideological asymmetries in measurement invariance. Assessment 2021, 28, 687–708. [Google Scholar] [CrossRef]
- Emerson, S.D.; Guhn, M.; Gadermann, A.M. Measurement invariance of the Satisfaction with Life Scale: Reviewing three decades of research. Qual. Life Res. 2017, 26, 2251–2264. [Google Scholar] [CrossRef] [PubMed]
- Arrindell, W.A.; Meeuwesen, L.; Huyse, F.J. The satisfaction with life scale (SWLS): Psychometric properties in a non-psychiatric medical outpatients sample. Personal. Individ. Differ. 1991, 12, 117–123. [Google Scholar] [CrossRef]
- Arrindell, W.A.; Heesink, J.; Feij, J.A. The Satisfaction With Life Scale (SWLS): Appraisal with 1700 healthy young adults in The Netherlands. Personal. Individ. Differ. 1999, 26, 815–826. [Google Scholar] [CrossRef]
- Anduiza, E.; Galais, C. Answering without reading: IMCs and strong satisficing in online surveys. Int. J. Public Opin. Res. 2016, 29, 497–519. [Google Scholar] [CrossRef]
- Rubio Juan, M.; Revilla, M. Comparing respondents who passed versus failed an Instructional Manipulation Check: A case study about support for climate change policies. Int. J. Mark. Res. 2021, 63, 408–415. [Google Scholar] [CrossRef]
- Sandorf, E.D. Did You Miss Something? Inattentive Respondents in Discrete Choice Experiments. Environ. Resour. Econ. 2018, 73, 1197–1235. [Google Scholar] [CrossRef] [Green Version]
- Steinmetz, H.; Schmidt, P.; Tina-Booh, A.; Wieczorek, S.; Schwartz, S.H. Testing measurement invariance using multigroup CFA: Differences between educational groups in human values measurement. Qual. Quant. 2008, 43, 599–616. [Google Scholar] [CrossRef]
- Checa, I.; Perales, J.; Espejo, B. Measurement invariance of the Satisfaction with Life Scale by gender, age, marital status and educational level. Qual. Life Res. 2018, 28, 963–968. [Google Scholar] [CrossRef] [PubMed]
- Alivernini, F.; Manganelli, S.; Cavicchiolo, E.; Chirico, A.; Lucidi, F. The Use of Self-Regulated Cognitive Strategies Across Students with Different Immigrant Backgrounds and Gender. J. Psychoeduc. Assess. 2018, 37, 652–664. [Google Scholar] [CrossRef]
- McGrane, J.A.; Butow, P.N.; Sze, M.; Eisenbruch, M.; Goldstein, D.; King, M.T. Assessing the invariance of a culturally competent multi-lingual unmet needs survey for immigrant and Australian-born cancer patients: A Rasch analysis. Qual. Life Res. 2014, 23, 2819–2830. [Google Scholar] [CrossRef]
- Guttmannova, K.; Szanyi, J.M.; Cali, P.W. internalizing and externalizing behavior problem scores. Educ. Psychol. Meas. 2008, 68, 676–694. [Google Scholar] [CrossRef]
- Yin, P.; Fan, X. Assessing the factor structure invariance of self-concept measurement across ethnic and gender groups: Findings from a national sample. Educ. Psychol. Meas. 2003, 63, 296–318. [Google Scholar] [CrossRef]
- Haeny, A.M.; Woerner, J.; Overstreet, C.; Hicks, T.A.; Ahuja, M.; Amstadter, A.B.; Sartor, C.E. Measurement invariance of the World Assumptions Questionnaire across race/ethnic group, sex, and sexual orientation. Psychol. Trauma Theory Res. Pract. Policy 2021, 13, 522–527. [Google Scholar] [CrossRef] [PubMed]
- Lee, S.; Vasquez, E.; Ryan, L.; Smith, J. Measurement equivalence of subjective well-being scales under the presence of acquiescent response style for the racially and ethnically diverse older population in the United States. Surv. Res. Methods 2020, 14, 417–437. [Google Scholar] [CrossRef]
- Oishi, S. Culture and subjective well-being: Conceptual and measurement issues. In Handbook of Well-Being; Diener, E., Oishi, S., Tay, L., Eds.; DEF Publishers: Salt Lake City, UT, USA, 2018; Available online: https://www.nobascholar.com (accessed on 1 July 2022).
- Clench-Aas, J.; Nes, R.B.; Dalgard, O.S.; Aarø, L.E. Dimensionality and measurement invariance in the Satisfaction with Life Scale in Norway. Qual. Life Res. 2011, 20, 1307–1317. [Google Scholar] [CrossRef]
- Jovanović, V. Measurement invariance of the Serbian version of the Satisfaction with Life Scale across age, gender, and time. Eur. J. Psychol. Assess. 2019, 35, 555–563. [Google Scholar] [CrossRef]
- Glaesmer, H.; Grande, G.; Braehler, E.; Roth, M. The German version of the Satisfaction with Life Scale (SWLS): Psychometric properties, validity, and population-based norms. Eur. J. Psychol. Assess. 2011, 27, 127–132. [Google Scholar] [CrossRef]
- Putnick, D.L.; Bornstein, M.H. Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Develop. Rev. 2016, 41, 71–90. [Google Scholar] [CrossRef] [PubMed]
- Chen, F.F. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct. Equ. Model. A Multidiscip. J. 2007, 14, 464–504. [Google Scholar] [CrossRef]
- Steenkamp, J.-B.E.M.; Baumgartner, H. Assessing measurement invariance in cross-national consumer research. J. Consum. Res. 1998, 25, 78–107. [Google Scholar] [CrossRef]
- Bache, I.; Reardon, L.; Anand, P. Wellbeing as a wicked problem: Navigating the arguments for the role of government. J. Happiness Stud. 2015, 17, 893–912. [Google Scholar] [CrossRef]
- Oishi, S.; Diener, E. Can and should happiness be a policy goal? Policy Insights Behav. Brain Sci. 2014, 1, 195–203. [Google Scholar] [CrossRef]
Grouping Variable | Group | N | M | SD |
---|---|---|---|---|
Gender | Male | 2474 | 5.029 | 1.132 |
Female | 2891 | 5.050 | 1.144 | |
Age quartile | 1 (16–37) | 1337 | 4.947 | 1.148 |
2 (38–55) | 1354 | 5.011 | 1.123 | |
3 (56–68) | 1374 | 5.039 | 1.193 | |
4 (69–103) | 1300 | 5.167 | 1.072 | |
Education | Primary school and junior high school | 1383 | 4.933 | 1.206 |
Senior high school and junior college | 1868 | 4.970 | 1.148 | |
College and university | 2098 | 5.174 | 1.069 | |
Difficulty | Not difficult (1–2) | 3280 | 5.150 | 1.121 |
Difficult (3–5) | 2029 | 4.860 | 1.144 | |
Clarity | Not clear (1–3) | 1028 | 4.784 | 1.185 |
Clear (4–5) | 4281 | 5.100 | 1.118 | |
Background | Dutch background | 4237 | 5.100 | 1.102 |
First- or second-generation foreign background | 987 | 4.796 | 1.259 |
Model | X2 | df | p | RMSEA | RMSEA 90% CI | CFI | SRMR | ΔRMSEA | ΔCFI | ΔSRMR | |
---|---|---|---|---|---|---|---|---|---|---|---|
CFA models | |||||||||||
1 | Original CFA model | 271.792 | 5 | 0.000 | 0.100 | 0.090 0.110 | 0.969 | 0.029 | - | - | - |
2 | Modified CFA model | 92.753 | 4 | 0.000 | 0.064 | 0.053 0.076 | 0.990 | 0.013 | - | - | - |
Invariance-gender | |||||||||||
3 | Configural | 97.051 | 8 | 0.000 | 0.064 | 0.053 0.076 | 0.990 | 0.013 | - | - | - |
4 | Metric | 109.981 | 12 | 0.000 | 0.055 | 0.046 0.065 | 0.989 | 0.022 | −0.009 | −0.001 | 0.009 |
5 | Scalar | 135.095 | 16 | 0.000 | 0.053 | 0.045 0.061 | 0.987 | 0.026 | −0.002 | −0.002 | 0.004 |
Invariance-age | |||||||||||
6 | Configural | 100.756 | 16 | 0.000 | 0.063 | 0.051 0.075 | 0.991 | 0.013 | - | - | - |
7 | Metric | 125.406 | 28 | 0.000 | 0.051 | 0.042 0.060 | 0.989 | 0.036 | −0.012 | −0.002 | 0.023 |
8 | Scalar | 194.205 | 40 | 0.000 | 0.054 | 0.046 0.061 | 0.983 | 0.045 | 0.003 | −0.006 | 0.009 |
Invariance-education | |||||||||||
9 | Configural | 93.919 | 12 | 0.000 | 0.062 | 0.051 0.074 | 0.991 | 0.013 | - | - | - |
10 | Metric | 109.547 | 20 | 0.000 | 0.050 | 0.041 0.060 | 0.990 | 0.022 | −0.012 | −0.001 | 0.009 |
11 | Scalar | 157.147 | 28 | 0.000 | 0.051 | 0.043 0.059 | 0.985 | 0.026 | 0.001 | −0.005 | 0.004 |
Invariance-difficulty | |||||||||||
12 | Configural | 95.041 | 8 | 0.000 | 0.064 | 0.053 0.076 | 0.990 | 0.013 | - | - | - |
13 | Metric | 121.696 | 12 | 0.000 | 0.059 | 0.049 0.068 | 0.987 | 0.038 | −0.005 | −0.003 | 0.025 |
14 | Scalar | 140.415 | 16 | 0.000 | 0.054 | 0.046 0.063 | 0.986 | 0.038 | −0.005 | −0.001 | 0.000 |
Invariance-clarity | |||||||||||
15 | Configural | 97.784 | 8 | 0.000 | 0.065 | 0.054 0.077 | 0.989 | 0.013 | - | - | - |
16 | Metric | 109.623 | 12 | 0.000 | 0.055 | 0.046 0.065 | 0.988 | 0.018 | −0.010 | −0.001 | 0.005 |
17 | Scalar | 132.714 | 16 | 0.000 | 0.052 | 0.044 0.061 | 0.986 | 0.021 | −0.003 | −0.002 | 0.003 |
Invariance-background | |||||||||||
18 | Configural | 97.042 | 8 | 0.000 | 0.065 | 0.054 0.077 | 0.989 | 0.013 | - | - | - |
19 | Metric | 115.782 | 12 | 0.000 | 0.058 | 0.048 0.067 | 0.988 | 0.025 | −0.007 | −0.001 | 0.012 |
20 | Partial metric | 133.470 | 16 | 0.000 | 0.053 | 0.045 0.062 | 0.986 | 0.026 | −0.005 | −0.002 | 0.001 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Joshanloo, M. Do Cross-Group Differences in Life Satisfaction Reflect Measurement Bias or True Differences in Life Satisfaction? Evidence from a Dutch National Sample. Int. J. Environ. Res. Public Health 2022, 19, 11687. https://doi.org/10.3390/ijerph191811687
Joshanloo M. Do Cross-Group Differences in Life Satisfaction Reflect Measurement Bias or True Differences in Life Satisfaction? Evidence from a Dutch National Sample. International Journal of Environmental Research and Public Health. 2022; 19(18):11687. https://doi.org/10.3390/ijerph191811687
Chicago/Turabian StyleJoshanloo, Mohsen. 2022. "Do Cross-Group Differences in Life Satisfaction Reflect Measurement Bias or True Differences in Life Satisfaction? Evidence from a Dutch National Sample" International Journal of Environmental Research and Public Health 19, no. 18: 11687. https://doi.org/10.3390/ijerph191811687