Validation and Psychometric Properties of the German Operational and Organizational Police Stress Questionnaires
Abstract
:1. Introduction
2. Methodology
2.1. Procedures
- −
- Phase 1: Translation into German and back-translation
- −
- Phase 2: Pre-testing, assessment of item comprehension, and final version development
- −
- Phase 3: Evaluation of the translated scale’s measurement validity
2.2. Participants
2.3. Measures
2.3.1. Police Stress Questionnaire Adapted to German (PSQ-G)
2.3.2. Impact of Event Scale—Revised (IES-R)
2.3.3. Oldenburg Burnout Inventory (OLBI)
2.3.4. Hospital Anxiety and Depression Scale (HADS)
3. Data Analysis
3.1. Reliability
3.2. Construct Validity
3.2.1. Exploratory Factor Analyses (EFA)
3.2.2. Confirmatory Factor Analyses (CFA)
3.3. Convergent Validity
4. Results
4.1. Phase 2: Pre-Test
4.2. Phase 3: Psychometric Validation
Participants
4.3. Factor Analyses
4.3.1. Exploratory Factor Analysis (EFA)
4.3.2. Confirmatory Factor Analysis (CFA)
4.3.3. Reliability: Internal Consistency
4.3.4. Convergent Validity
5. Discussion
6. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
AGFI | Adjusted Goodness–of–Fit Index |
CFA | Confirmatory factor analyses |
CFI | Comparative Fit Index |
EFA | Exploratory factor analyses |
HADS | Hospital Anxiety and Depression Scale |
GFI | Goodness–of–Fit Index |
IES-R | Impact of Event Scale—Revised |
IFI | Boellen’s incremental fit index |
KMO | Kaiser–Meyer–Olkin measure |
NNFI | Non-Normed Fit Index |
OLBI | Oldenburg Burnout Inventory |
PSQ | Police Stress Questionnaire |
PSQ-G | Police Stress Questionnaire adapted to German |
PSQ-G-14 | Police Stress Questionnaire adapted to German, 14-items versions |
PSQ-Op | Police Stress Questionnaire–operational stress |
PSQ-Org | Police Stress Questionnaire–organizational stress |
PTSD | Post-traumatic stress disorder |
RMSEA | Root Mean Squared Error of Approximation |
SRMR | Standardized Root Mean Square Residual |
References
- Collins, P.A.; Gibbs, A.C.C. Stress in Police Officers: A Study of the Origins, Prevalence and Severity of Stress-Related Symptoms within a County Police Force. Occup. Med. 2003, 53, 256–264. [Google Scholar] [CrossRef] [PubMed]
- Deschamps, F.; Paganon-Badinier, I.; Marchand, A.-C.; Merle, C. Sources and Assessment of Occupational Stress in the Police. J. Occup. Health 2003, 45, 358–364. [Google Scholar] [CrossRef] [PubMed]
- Violanti, J.M.; Fekedulegn, D.; Hartley, T.A.; Charles, L.E.; Andrew, M.E.; Ma, C.C.; Burchfiel, C.M. Highly Rated and Most Frequent Stressors among Police Officers: Gender Differences. Am. J. Crim. Justice 2016, 41, 645–662. [Google Scholar] [CrossRef]
- Arial, M.; Gonik, V.; Wild, P.; Danuser, B. Association of Work Related Chronic Stressors and Psychiatric Symptoms in a Swiss Sample of Police Officers; a Cross Sectional Questionnaire Study. Int. Arch. Occup. Environ. Health 2010, 83, 323–331. [Google Scholar] [CrossRef]
- McCreary, D.R.; Thompson, M.M. Development of Two Reliable and Valid Measures of Stressors in Policing: The Operational and Organizational Police Stress Questionnaires. Int. J. Stress. Manag. 2006, 13, 494–518. [Google Scholar] [CrossRef]
- Anders, R.; Willemin-Petignat, L.; Rolli, C.; Samson, A.C.; Putois, B. Profiling Police Forces against Stress: Risk and Protective Factors for Post-Traumatic Stress Disorder and Burnout in Police Officers. Int. J. Environ. Res. Public Health 2022, 19, 9218. [Google Scholar] [CrossRef]
- Deschênes, A.-A.; Desjardins, C.; Dussault, M. Psychosocial Factors Linked to the Occupational Psychological Health of Police Officers: Preliminary Study. Cogent Psychol. 2018, 5, 1426271. [Google Scholar] [CrossRef]
- Garbarino, S.; Cuomo, G.; Chiorri, C.; Magnavita, N. Association of Work-Related Stress with Mental Health Problems in a Special Police Force Unit. BMJ Open 2013, 3, e002791. [Google Scholar] [CrossRef]
- Magnavita, N.; Capitanelli, I.; Garbarino, S.; Pira, E. Work-Related Stress as a Cardiovascular Risk Factor in Police Officers: A Systematic Review of Evidence. Int. Arch. Occup. Environ. Health 2018, 91, 377–389. [Google Scholar] [CrossRef] [PubMed]
- Garbarino, S.; Magnavita, N. Work Stress and Metabolic Syndrome in Police Officers. A Prospective Study. PLoS ONE 2015, 10, e0144318. [Google Scholar] [CrossRef] [PubMed]
- Arble, E.; Daugherty, A.M.; Arnetz, B. Differential Effects of Physiological Arousal Following Acute Stress on Police Officer Performance in a Simulated Critical Incident. Front. Psychol. 2019, 10, 759. [Google Scholar] [CrossRef]
- Baldwin, S.; Bennell, C.; Blaskovits, B.; Brown, A.; Jenkins, B.; Lawrence, C.; McGale, H.; Semple, T.; Andersen, J.P. A Reasonable Officer: Examining the Relationships Among Stress, Training, and Performance in a Highly Realistic Lethal Force Scenario. Front. Psychol. 2022, 12, 759132. [Google Scholar] [CrossRef] [PubMed]
- Cooper, C.L.; Sloan, S.; Williams, S. Occupational Stress Indicator; NFER-Nelson: Windsor, ON, Canada, 1988. [Google Scholar]
- Turnage, J.J.; Spielberger, C.D. Job Stress in Managers, Professionals and Clerical Workers. Work Stress 1991, 5, 165–176. [Google Scholar] [CrossRef]
- Spielberger, C.D.; Reheiser, E.C. Measuring Occupational Stress: The Job Stress Survey. In Occupational Stress: A Handbook; Crandall, R., Perrewe, P.L., Eds.; Taylor and Francis: Philadelphia, PA, USA, 1995; pp. 51–69. [Google Scholar]
- Spielberger, C.D.; Reheiser, E.C. Job Stress in University, Corporate, and Military Personnel. Int. J. Stress. Manag. 1994, 1, 19–31. [Google Scholar] [CrossRef]
- Spielberger, C.D.; Westberry, L.G.; Grier, K.S.; Greenfield, G. The Police Stress Survey: Sources of Stress in Law Enforcement; University of South Florida, College of Social and Behavioral Sciences: Tampa, FL, USA, 1981. [Google Scholar]
- Hart, P.M.; Wearing, A.J.; Headey, B. Assessing Police Work Experiences: Development of the Police Daily Hassles and Uplifts Scales. J. Crim. Justice 1993, 21, 553–572. [Google Scholar] [CrossRef]
- Kukić, F.; Subošić, D.; Heinrich, K.M.; Greco, G.; Koropanovski, N. Psychometric Properties of the Serbian Version of the Operational and Organizational Police Stress Questionnaires. Sustainability 2021, 13, 13662. [Google Scholar] [CrossRef]
- Queirós, C.; Passos, F.; Bártolo, A.; Marques, A.J.; Fernandes da Silva, C.; Pereira, A. Burnout and Stress Measurement in Police Officers: Literature Review and a Study with the Operational Police Stress Questionnaire. Front. Psychol. 2020, 11, 587. [Google Scholar] [CrossRef]
- Queirós, C.; Passos, F.; Bártolo, A.; Faria, S.; Monteiro Fonseca, S.; Marques, A.J.; Silva, C.F.; Pereira, A. Job Stress, Burnout and Coping in Police Officers: Relationships and Psychometric Properties of the Organizational Police Stress Questionnaire. Int. J. Environ. Res. Public Health 2020, 17, 6718. [Google Scholar] [CrossRef]
- Setti, I.; Argentero, P. Lo Stress Negli Operatori Di Polizia Locale: Contributo Alr Adattamento Italiano Di Uno Strumento per La Misura Di Stressor Operativi e Organizzativi. G. Ital. Med. Lav. Ed Ergon. 2013, 35, 157–162. [Google Scholar]
- Rolstad, S.; Adler, J.; Rydén, A. Response Burden and Questionnaire Length: Is Shorter Better? A Review and Meta-Analysis. Value Health 2011, 14, 1101–1108. [Google Scholar] [CrossRef]
- Arafat, S.M.; Chowdhury, H.; Qusar, M.M.A.; Hafez, M.A. Cross Cultural Adaptation and Psychometric Validation of Research Instruments: A Methodological Review. J. Behav. Health 2016, 5, 129–136. [Google Scholar] [CrossRef]
- WHO. WHO Guidelines on Translation and Adaptation of Instruments. 2018; pp. 1–5. Available online: http://www.who.int/substance_abuse/research_tools/translation/en/ (accessed on 30 March 2023).
- Yadav, B.; Kc, A.; Bhusal, S.; Pradhan, P.M.S. Prevalence and Factors Associated with Symptoms of Depression, Anxiety and Stress among Traffic Police Officers in Kathmandu, Nepal: A Cross-Sectional Survey. BMJ Open 2022, 12, e061534. [Google Scholar] [CrossRef] [PubMed]
- McCreary, D.R.; Fong, I.; Groll, D.L. Measuring Policing Stress Meaningfully: Establishing Norms and Cut-off Values for the Operational and Organizational Police Stress Questionnaires. Police Pract. Res. 2017, 18, 612–623. [Google Scholar] [CrossRef]
- Weiss, D.S.; Marmar, C.R. The Impact of Event Scale—Revised. In Assessing Psychological Trauma and PTSD; Wilson, J., Keane, T.M., Eds.; Guilford Press: New York, NY, USA, 1996; pp. 399–411. [Google Scholar]
- Maercker, A.; Schützwohl, M. Erfassung von Psychischen Belastungssfolgen: Die Impact of Event Skala-Revidierte Version. Diagnostica 1998, 44, 130–141. [Google Scholar]
- Demerouti, E.; Bakker, A.B.; Vardakou, I.; Kantas, A. The Convergent Validity of Two Burnout Instruments: A Multitrait-Multimethod Analysis. Eur. J. Psychol. Assess. 2003, 19, 12–23. [Google Scholar] [CrossRef]
- Delgadillo, J.; Saxon, D.; Barkham, M. Associations between Therapists’ Occupational Burnout and Their Patients’ Depression and Anxiety Treatment Outcomes. Depress. Anxiety 2018, 35, 844–850. [Google Scholar] [CrossRef]
- Snaith, R.P.; Zigmond, A.S. The Hospital Anxiety and Depression Scale. Acta Psychiatr. Scand. 1986, 67, 361–370. [Google Scholar] [CrossRef]
- Herrmann-Lingen, C.; Buss, U.; Snaith, R.P. Hospital Anxiety and Depression Scale—Deutsche Version; Hans-Huber Verlag: Bern, Switzerland, 2011. [Google Scholar]
- Bjelland, I.; Dahl, A.A.; Tangen Haug, T.; Neckelmann, D. The Validity of the Hospital Anxiety and Depression Scale An Updated Literature Review. J. Psychosom. Res. 2002, 52, 69–77. [Google Scholar] [CrossRef]
- Béland, S.; Cousineau, D. Adieu Coefficient Alpha de Cronbach! J’ai Trouvé plus Fidèle Que Toi…. Rev. Psychoeduc. 2018, 47, 449–460. [Google Scholar] [CrossRef]
- Briggs, S.R.; Cheek, J.M. The Role of Factor Analysis in the Development and Evaluation of Personality Scales. J. Pers. 1986, 54, 106–148. [Google Scholar] [CrossRef]
- Tobias, S.; Carlson, J.E. Brief Report: Bartlett’s Test of Sphericity and Chance Findings in Factor Analysis. Multivar. Behav. Res. 1969, 4, 375–377. [Google Scholar] [CrossRef] [PubMed]
- Dziuban, C.D.; Shirkey, E.C. When Is a Correlation Matrix Appropriate for Factor Analysis? Some Decision Rules. Psychol. Bull. 1974, 81, 358–361. [Google Scholar] [CrossRef]
- Hoyle, R.; Duvall, J. Determining the Number of Factors in Exploratory and Confirmatory Factor Analysis. In The SAGE Handbook of Quantitative Methodology for the Social. Sciences; SAGE Publications, Inc.: Thousand Oaks, CA, USA, 2012. [Google Scholar]
- Osborne, J.W. What Is Rotating in Exploratory Factor Analysis? Pract. Assess. Res. Eval. 2015, 20, 2. [Google Scholar]
- Mirabelli, J.; Jensen, K.; Vohra, S.R.; Johnson, E. Exploring the Exploratory Factor Analysis: Comparisons and Insights from Applying Five Procedures to Determining EFA Item Retention. In Proceedings of the ASEE Annual Conference and Exposition, Conference Proceedings, Minneapolis, MN, USA, 26–29 June 2022. [Google Scholar]
- Samuels, P. Advice on Exploratory Factor Analysis; Birmingham City University: Birmingham, UK, 2017. [Google Scholar]
- Bandalos, D.L.; Finney, S.J. Factor Analysis Exploratory and Confirmatory. In Thew Reviewer’s Guide to Quantitative Methods in the Social Sciences; Routledge: New York, NY, USA, 2018. [Google Scholar]
- Kline, R.B. Promise and Pitfalls of Structural Equation Modeling in Gifted Research. In Methodologies for Conducting Research on Giftedness; American Psychological Association: Washington, DC, USA, 2010. [Google Scholar]
- Bentler, P.M. Comparative Fit Indexes in Structural Models. Psychol. Bull. 1990, 107, 238–246. [Google Scholar] [CrossRef] [PubMed]
- Steiger, J.H.; Shapiro, A.; Browne, M.W. On the Multivariate Asymptotic Distribution of Sequential Chi-Square Statistics. Psychometrika 1985, 50, 253–263. [Google Scholar] [CrossRef]
- Hooper, D.; Coughlan, J.; Mullen, M.R. Structural Equation Modelling: Guidelines for Determining Model Fit. Electron. J. Bus. Res. Methods 2008, 6, 53–60. [Google Scholar]
- Hu, L.T.; Bentler, P.M. Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Struct. Equ. Model. 1999, 6, 1–55. [Google Scholar] [CrossRef]
- Stevens, J. Applied Multivariate Statistics for the Social Sciences; Lawrence, E., Ed.; Psychology Press: New York, NY, USA, 1992. [Google Scholar]
- L’analyse Factorielle Confirmatoire. Available online: http://www.mapageweb.umontreal.ca/durandc/enseignement/methodesquantitatives/facteur9.pdf. (accessed on 16 August 2023).
- Weisberg, S. Yeo-Johnson Power Transformations; Department of Applied Statistics, University of Minnesota: Minneapolis, MN, USA, 2001. [Google Scholar]
- Schober, P.; Schwarte, L.A. Correlation Coefficients: Appropriate Use and Interpretation. Anesth. Analg. 2018, 126, 1763–1768. [Google Scholar] [CrossRef]
- Holm, S. A Simple Sequentially Rejective Multiple Test Procedure. Scand. J. Statist 1979, 6, 65–70. [Google Scholar]
- Cook, D.A.; Beckman, T.J. Current Concepts in Validity and Reliability for Psychometric Instruments: Theory and Application. Am. J. Med. 2006, 119, 166.e7–166.e16. [Google Scholar] [CrossRef]
- Kirschbaum, C.; Pirke, K.M.; Hellhammer, D.H. The “Trier Social Stress Test”—A Tool for Investigating Psychobiological Stress Responses in a Laboratory Setting. Neuropsychobiology 1993, 28, 76–81. [Google Scholar] [CrossRef] [PubMed]
- Landman, A.; Nieuwenhuys, A.; Oudejans, R.R.D. Decision-Related Action Orientation Predicts Police Officers’ Shooting Performance under Pressure. Anxiety Stress. Coping 2016, 29, 570–579. [Google Scholar] [CrossRef] [PubMed]
- Scullin, M.K.; Hebl, M.R.; Corrington, A.; Nguyen, S. Experimental Sleep Loss, Racial Bias, and the Decision Criterion to Shoot in the Police Officer’s Dilemma Task. Sci. Rep. 2020, 10, 20581. [Google Scholar] [CrossRef]
- Blumberg, D.M.; Schlosser, M.D.; Papazoglou, K.; Creighton, S.; Kaye, C.C. New Directions in Police Academy Training: A Call to Action. Int. J. Environ. Res. Public Health 2019, 16, 4941. [Google Scholar] [CrossRef] [PubMed]
Items | Operational | Organizational | Communalities | |
---|---|---|---|---|
PSQ-G-Op-7 | Managing your social life outside of work Management des soziales Lebens ausserhalb der Arbeit | 0.74 | - | 0.57 |
PSQ-G-Op-8 | Not enough time available to spend with friends and family Zu wenig Zeit für Freunde und Familie | 0.82 | - | 0.72 |
PSQ-G-Op-11 | Finding time to stay in good physical condition Die Zeit finden, um in guter körperlicher Verfassung zu bleiben | 0.66 | - | 0.48 |
PSQ-G-Op-12 | Fatigue (e.g., shift work, over-time) Ermüdung (z. B. Schichtarbeit, Überstunden) | 0.67 | - | 0.55 |
PSQ-G-Op-18 | Limitations to your social life (e.g., who your friends are, where you socialize) Einschränkung im sozialen Leben (z. B. Wer Ihre Freunde sind, wo Sie sich treffen) | 0.69 | - | 0.51 |
PSQ-G-Op-19 | Feeling like you are always on the job Das Gefühl, ständig im Einsatz zu sein | 0.67 | - | 0.55 |
PSQ-G-Op-20 | Friends/family feel the effects of the stigma associated with your job Freunde/Familie spüren die Auswirkung des Berufsstigmas | 0.66 | - | 0.52 |
PSQ-G-Org-4 | Excessive administrative duties Übermässige administrative Aufgaben | - | 0.76 | 0.6 |
PSQ-G-Org-5 | Constant changes in policy/legislation Ständige Änderungen in der Politik/Gesetzgebung | - | 0.56 | 0.34 |
PSQ-G-Org-6 | Staff shortages Personalmangel | - | 0.66 | 0.53 |
PSQ-G-Org-7 | Bureaucratic red tape Bürokratischer Aufwand | - | 0.85 | 0.75 |
PSQ-G-Org-8 | Too much computer work Zu viel Computerarbeit | - | 0.63 | 0.43 |
PSQ-G-Org-13 | Lack of resources Ressourcenmangel | - | 0.64 | 0.52 |
PSQ-G-Org-14 | Unequal sharing of work responsibilities Ungleiche Aufteilung der Arbeitsaufgaben | - | 0.53 | 0.38 |
SS Loadings | 3.91 | 3.54 | ||
Explained Variance | 27.9% | 25.3% |
Indices | PSQ-G Observed Value | PSQ-G-14 Item Version Observed Value | Acceptable Threshold |
---|---|---|---|
Model χ2/df | 11.37 | 10.67 | <5.0 |
CFI 1 | 0.96 | 0.98 | >0.90 |
IFI 2 | 0.96 | 0.98 | >0.90 |
NNFI 3 | 0.95 | 0.98 | >0.90 |
RMSEA 4 | 0.07 | 0.06 | <0.10 |
GFI 5 | 0.96 | 0.99 | >0.90 |
AGFI 6 | 0.96 | 0.98 | >0.90 |
PSQ-G | PSQ-G-14 Item Version | |||||
---|---|---|---|---|---|---|
Dimensions | Total | Oper | Orga | Total | Oper | Orga |
PSQ-G Total | ||||||
PSQ-G Operational | 0.93 *** | 0.88 *** | ||||
PSQ-G Organisational | 0.93 *** | 0.73 *** | 0.88 *** | 0.55 *** | ||
OLBI Disengagement | 0.44 *** | 0.39 *** | 0.42 *** | 0.40 *** | 0.36 *** | 0.35 *** |
OLBI Exhaustion | 0.63 *** | 0.61 *** | 0.56 *** | 0.64 *** | 0.61 *** | 0.51 *** |
IES-R Hyperarousal | 0.44 *** | 0.41 *** | 0.40 *** | 0.39 *** | 0.37 *** | 0.32 *** |
IES-R Intrusion | 0.37 *** | 0.36 *** | 0.33 *** | 0.32 *** | 0.31 *** | 0.26 *** |
IES-R Avoidance | 0.38 *** | 0.35 *** | 0.34 *** | 0.33 *** | 0.31 *** | 0.28 *** |
HADS Anxiety | 0.50 *** | 0.48 *** | 0.44 *** | 0.46 *** | 0.47 *** | 0.35 *** |
HADS Depression | 0.50 *** | 0.47 *** | 0.46 *** | 0.49 *** | 0.48 *** | 0.37 *** |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Willemin-Petignat, L.; Anders, R.; Ogi, S.; Putois, B. Validation and Psychometric Properties of the German Operational and Organizational Police Stress Questionnaires. Int. J. Environ. Res. Public Health 2023, 20, 6831. https://doi.org/10.3390/ijerph20196831
Willemin-Petignat L, Anders R, Ogi S, Putois B. Validation and Psychometric Properties of the German Operational and Organizational Police Stress Questionnaires. International Journal of Environmental Research and Public Health. 2023; 20(19):6831. https://doi.org/10.3390/ijerph20196831
Chicago/Turabian StyleWillemin-Petignat, Lauriane, Royce Anders, Sabrina Ogi, and Benjamin Putois. 2023. "Validation and Psychometric Properties of the German Operational and Organizational Police Stress Questionnaires" International Journal of Environmental Research and Public Health 20, no. 19: 6831. https://doi.org/10.3390/ijerph20196831