Validation of the Hungarian Version of the COVID Stress Scale (CSS-H)
Abstract
:1. Introduction
2. Materials and Methods
Perceived Stress Scale (PSS-14)
WHO Well-Being Inventory Short Version (WBI-5)
3. Results
Confirmatory Factor Analysis (CFA), Internal Reliability, and Validity
4. Discussion
5. Conclusions
6. Limitation
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Appendix A
Veszély (Danger) | |
Aggódom, hogy elkapom a vírust. | D1 |
Aggódom, hogy nem tudom megvédeni a családom a vírustól. | D2 |
Aggódom, hogy egészségügyi rendszerünk nem lesz képes megvédeni szeretteimet. | D3 |
Aggódom, hogy az egészségügyi rendszerünk nem képes megvédeni a vírustól. | D4 |
Aggódom, hogy az alapvető higiéniás szabályok betartása (pl. kézmosás) nem elegendők, hogy megvédjenek a vírustól. | D5 |
Aggódom, hogy a szociális távolságtartás nem elegendő, hogy megvédjen a vírustól. | D6 |
Szocioökonómiai Következmények (Socio-Economic Concesquences) | |
Aggódom, hogy az élelmiszerüzletek kifogynak az élelmeből. | SE1 |
Aggódom, hogy az élelmiszerüzletek bezárnak. | SE2 |
Aggódom, hogy az élelmiszerüzletek kifogynak a tisztító és fertőtlenítő szerekből. | SE3 |
Aggódom, hogy a boltokból elfogynak a megfázás és nátha elleni gyógyszerek. | SE4 |
Aggódom, hogy az üzletek kifogynak az ivóvízből. | SE5 |
Aggódom, hogy a gyógyszertárak kifogynak a vényköteles gyógyszerekből. | SE6 |
Idegenellenesség (Xenophobia) | |
Aggódom, hogy a külföldiek terjesztik a vírust hazánkban. | X1 |
Ha külföldi ételeket kínáló étterembe megyek, akkor aggódom, hogy elkapom a vírust. | X2 |
Aggódom, hogy külföldiekkel kapcsolatba kerüljek, mert ők hordozhatják a vírust. | X3 |
Ha találkozom egy külföldivel, akkor aggódni kezdek, hogy ő esetleg hordozza vírust. | X4 |
Ha egy liftben lennék egy csoport külföldivel, aggódnék, hogy ők vírussal fertőzöttek. | X5 |
Aggódom, hogy a külföldiek terjesztik a vírust, mert nem olyan tiszták/higiénikusak, mint mi. | X6 |
Megfertőződés (Contamination) | |
Aggódom, hogy ha hozzáérek valamihez nyilvános helyen (pl. korláthoz, kilincshez), akkor elkaphatom a vírust. | C1 |
Aggódom, hogy ha valaki köhög vagy tüsszent a közelemben akkor elkapom a vírust. | C2 |
Aggódom, hogy a környezetemben lévő emberek megfertőznek a vírussal. | C3 |
Aggódom a készpénzes fizetés miatt. | C4 |
Aggódom, hogy elkaphatom a vírust, ha pénzhez nyúlok vagy bank automatát használok. | C5 |
Aggódom, hogy a leveleim beszennyeződnek/fertőződnek a postás által. | C6 |
Traumatikus Stressz (Traumatic Stress) | |
Nehezen tudtam koncentrálni, mert folyamatosan a vírusra gondoltam. | T1 |
Akaratom ellenére a vírussal kapcsolatos nyugtalanító képek ugrottak be. | T2 |
Alvási problémáim voltak a vírussal kapcsolatos aggodalmaim miatt. | T3 |
Akkor is a vírusra gondoltam, amikor nem akartam. | T4 |
A vírussal kapcsolatos figyelemfelhívó tájékoztatók fizikai tüneteket váltottak ki belőlem, úgy mint izzadás vagy szívdobogás érzés. | T5 |
A vírussal kapcsolatos rossz álmaim voltak. | T6 |
Megszállott Keresés (Compulsive Checking) | |
Kutattam az interneten a COVID-19 gyógymódjai után. | CH1 |
Tanácsot kértem egészségügyi szakemberektől (pl. orvostól, gyógyszerésztől) a COVID-19-el kapcsolatban. | CH2 |
COVID-19-el kapcsolatos YouTube videókat néztem. | CH3 |
Ellenőriztem a testemet a fertőzés jeleit keresve (pl. megmértem a lázamat). | CH4 |
Megnyugtatást kértem a családomtól és a barátaimtól a COVID-19-miatt. | CH5 |
A COVID-19-re vonatkozó posztokat követtem a közösségi médiában. | CH6 |
References
- Government Decree 41/2020. (III. 11.) on the Prevention of Human Pandemics that Threaten the Safety of Life and Property, and Averting the Consequences Thereof, Protecting the Health and Life of Hungarian Citizens and the Life and Health of the Citizens. Available online: https://magyarkozlony.hu/dokumentumok/af0a665e93020a1bb69193ed9a8379f516854bf7/megtekintes (accessed on 24 September 2022).
- Government Decree 71/2020. (III. 27.) on Curfew Restrictions. Available online: https://njt.hu/jogszabaly/2020-71-20-22 (accessed on 24 September 2022).
- Act CIX of 202 on Protection against the Second Wave of the Coronavirus Pandemic. Available online: https://magyarkozlony.hu/dokumentumok/e35363d964683da1d1a8b57aa9220fe36dfb5f7f/megtekintes (accessed on 24 September 2022).
- Cheng, S.K.; Wong, C.W.; Tsang, J.; Wong, K.C. Psychological Distress and Negative Appraisals in Survivors of Severe Acute Respiratory Syndrome (SARS). Psychol. Med. 2004, 34, 1187–1195. [Google Scholar] [CrossRef]
- Rubin, G.J.; Amlot, R.; Page, L.; Wessely, S. Public Perceptions, Anxiety, and Behaviour Change in Relation to the Swine Flu Outbreak: Cross Sectional Telephone Survey. BMJ 2009, 339, b2651. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Qiu, J.; Shen, B.; Zhao, M.; Wang, Z.; Xie, B.; Xu, Y. A Nationwide Survey of Psychological Distress among Chinese People in the COVID-19 Epidemic: Implications and Policy Recommendations. Gen. Psychiatr. 2020, 33, e100213. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Wang, C.; Pan, R.; Wan, X.; Tan, Y.; Xu, L.; Ho, C.S.; Ho, R.C. Immediate Psychological Responses and Associated Factors during the Initial Stage of the 2019 Coronavirus Disease (COVID-19) Epidemic among the General Population in China. Int. J. Environ. Res. Public Health 2020, 17, 1729. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Santabárbara, J.; Lasheras, I.; Lipnicki, D.M.; Bueno-Notivol, J.; Pérez-Moreno, M.; López-Antón, R.; de la Cámara, C.; Lobo, A.; Gracia-García, P. Prevalence of Anxiety in the COVID-19 Pandemic: An Updated Meta-Analysis of Community-Based Studies. Prog. Neuropsychopharmacol. Biol. Psychiatry 2021, 109, 110207. [Google Scholar] [CrossRef] [PubMed]
- Chi, X.; Becker, B.; Yu, Q.; Willeit, P.; Jiao, C.; Huang, L.; Hossain, M.M.; Grabovac, I.; Yeung, A.; Lin, J.; et al. Prevalence and Psychosocial Correlates of Mental Health Outcomes Among Chinese College Students During the Coronavirus Disease (COVID-19) Pandemic. Front. Psychiatry 2020, 11, 803. [Google Scholar] [CrossRef]
- Baral, I.A.; Bhagawati, K.C. Post Traumatic Stress Disorder and Coping Strategies among Adult Survivors of Earthquake, Nepal. BMC Psychiatry 2019, 19, 118. [Google Scholar] [CrossRef] [Green Version]
- Salfi, F.; D’Atri, A.; Tempesta, D.; Ferrara, M. Sleeping under the Waves: A Longitudinal Study across the Contagion Peaks of the COVID-19 Pandemic in Italy. J. Sleep Res. 2021, 30, e13313. [Google Scholar] [CrossRef]
- Yuksel, D.; McKee, G.B.; Perrin, P.B.; Alzueta, E.; Caffarra, S.; Ramos-Usuga, D.; Arango-Lasprilla, J.C.; Baker, F.C. Sleeping When the World Locks down: Correlates of Sleep Health during the COVID-19 Pandemic across 59 Countries. Sleep Health 2021, 7, 134–142. [Google Scholar] [CrossRef]
- Ettman, C.K.; Abdalla, S.M.; Cohen, G.H.; Sampson, L.; Vivier, P.M.; Galea, S. Prevalence of Depression Symptoms in US Adults before and during the COVID-19 Pandemic. JAMA Netw. Open 2020, 3, e2019686. [Google Scholar] [CrossRef]
- Huang, Y.; Zhao, N. Generalized Anxiety Disorder, Depressive Symptoms and Sleep Quality during COVID-19 Outbreak in China: A Web-Based Cross-Sectional Survey. Psychiatry Res. 2020, 288, 112954. [Google Scholar] [CrossRef] [PubMed]
- Deng, J.; Zhou, F.; Hou, W.; Silver, Z.; Wong, C.Y.; Chang, O.; Drakos, A.; Zuo, Q.K.; Huang, E. The Prevalence of Depressive Symptoms, Anxiety Symptoms and Sleep Disturbance in Higher Education Students during the COVID-19 Pandemic: A Systematic Review and Meta-Analysis. Psychiatry Res. 2021, 301, 113863. [Google Scholar] [CrossRef] [PubMed]
- Szabó, C.; Pukánszky, J.; Kemény, L. Psychological Effects of the COVID-19 Pandemic on Hungarian Adults. Int. J. Environ. Res. Public Health 2020, 17, 9565. [Google Scholar] [CrossRef]
- Csikos, G.; Törő, K.; Mokos, J.; Rózsa, S.; Kövesdi, A.; Hadházi, É.; Földi, R. Examining Perceptions of Stress, Wellbeing and Fear among Hungarian Adolescents and Their Parents under Lockdown during the COVID-19 Pandemic. PsyArXiv. Available online: https://psyarxiv.com/feth3/ (accessed on 24 September 2022).
- Stauder, A.; Konkoly Thege, B. Az észlelt stressz kérdőív (pss) magyar verziójának jellemzői. Mentálhigiéné és Pszichoszomatika 2006, 7, 203–216. [Google Scholar] [CrossRef] [Green Version]
- Morvay-Sey, K.; Trpkovici, M.; Ács, P.; Paár, D.; Pálvölgyi, Á. Psychological Responses of Hungarian Students during the First Wave of the COVID-19 Pandemic. Int. J. Environ. Res. Public Health 2022, 19, 11344. [Google Scholar] [CrossRef] [PubMed]
- Rucska, A.; Lakatos, C. Population Stress Reactions in North-East Hungary during the Pandemic. Eur. J. Mark. Econ. 2021, 4, 103. [Google Scholar] [CrossRef]
- Taylor, S.; Landry, C.A.; Paluszek, M.M.; Fergus, T.A.; McKay, D.; Asmundson, G.J.G. COVID Stress Syndrome: Concept, Structure, and Correlates. Depress. Anxiety 2020, 37, 706–714. [Google Scholar] [CrossRef]
- Taylor, S.; Landry, C.A.; Paluszek, M.M.; Fergus, T.A.; McKay, D.; Asmundson, G.J.G. Development and Initial Validation of the COVID Stress Scales. J. Anxiety Disord. 2020, 72, 102232. [Google Scholar] [CrossRef]
- Abbady, A.S.; El-Gilany, A.-H.; El-Dabee, F.A.; Elsadek, A.M.; ElWasify, M.; Elwasify, M. Psychometric Characteristics of the of COVID Stress Scales-Arabic Version (CSS-Arabic) in Egyptian and Saudi University Students. Middle East Curr. Psychiatry 2021, 28, 14. [Google Scholar] [CrossRef]
- Khosravani, V.; Asmundson, G.J.G.; Taylor, S.; Sharifi Bastan, F.; Samimi Ardestani, S.M. The Persian COVID Stress Scales (Persian-CSS) and COVID-19-Related Stress Reactions in Patients with Obsessive-Compulsive and Anxiety Disorders. J. Obs. Compuls. Relat. Disord. 2021, 28, 100615. [Google Scholar] [CrossRef]
- Galanis, P.; Vraka, I.; Katsiroumpa, A.; Konstantakopoulou, O.; Siskou, O.; Zogaki, E.; Kaiteliodu, D. Cross-Cultural Adaptation and Validation of the “COVID Stress Scales” in Greek. medRxiv 2022. [Google Scholar] [CrossRef]
- Milic, M.; Dotlic, J.; Rachor, G.S.; Asmundson, G.J.G.; Joksimovic, B.; Stevanovic, J.; Lazic, D.; Stanojevic Ristic, Z.; Subaric Filimonovic, J.; Radenkovic, N.; et al. Validity and Reliability of the Serbian COVID Stress Scales. PLoS ONE 2021, 16, e0259062. [Google Scholar] [CrossRef] [PubMed]
- Noe-Grijalva, M.; Polo-Ambrocio, A.; Gómez-Bedia, K.; Caycho-Rodríguez, T. Spanish Translation and Validation of the COVID Stress Scales in Peru. Front. Psychol. 2022, 13, 840302. [Google Scholar] [CrossRef] [PubMed]
- Mîndrilă, D. Maximum Likelihood (ML) and Diagonally Weighted Least Squares (DWLS) Estimation Procedures: A Comparison of Estimation Bias with Ordinal and Multivariate Non-Normal Data. Int. J. Digit. Soc. 2010, 1, 60–66. [Google Scholar] [CrossRef]
- Koğar, H.; Yilmaz Koğar, E. Comparison of Different Estimation Methods for Categorical and Ordinal Data in Confirmatory Factor Analysis. Egit. Psikol. Olcme Deger. Derg. 2015, 6, 351–364. [Google Scholar] [CrossRef] [Green Version]
- JASP; Version 0.14.1; JASP Team: Amsterdam, The Netherlands, 2020.
- Hu, L.; Bentler, P.M. Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Struct. Equ. Model. 1999, 6, 1–55. [Google Scholar] [CrossRef]
- Tavakol, M.; Dennick, R. Making Sense of Cronbach’s Alpha. Int. J. Med. Educ. 2011, 2, 53–55. [Google Scholar] [CrossRef]
- Susánszky, É.; Konkoly Thege, B.; Stauder, A.; Kopp, M. A who jól-lét kérdőív rövidített (wbi-5) magyar változatának validálása a hungarostudy 2002 országos lakossági egészségfelmérés alapján. Mentálhigiéné és Pszichoszomatika 2006, 7, 247–255. [Google Scholar] [CrossRef]
Representative Sample (n = 1200) | Sample of Students (n = 350) | |
---|---|---|
Age (years) | 43.37 ± 15.13 | 25.36 ± 8.48 |
Gender | ||
Male | 580 (48.3%) | 64 (18.2%) |
Female | 620 (51.7%) | 287 (81.8%) |
Age category | ||
Age category 18–29 | 276 (23.0%) | |
Age category 30–39 | 209 (17.4%) | |
Age category 40–49 | 305 (25.4%) | |
Age category 50–59 | 193 (16.1%) | |
Age category 60–69 | 217 (18.1%) | |
Marital status | ||
Single | 410 (34.2%) | 204 (58.1%) |
Living with a partner | 262 (21.8%) | 103 (29.3%) |
Married | 510 (42.5%) | 44 (12.5%) |
Widow | 8 (0.7%) | |
Other | 10 (0.8%) | |
Educational level | ||
Primary | 243 (20.3%) | |
Skilled worker | 320 (26.7%) | |
Secondary | 382 (31.8%) | |
University degree | 255 (21.3%) | |
Settlement type | ||
Budapest | 214 (17.8%) | 25 (7.1%) |
County seat | 196 (29.4%) | 140 (39.9%) |
Other city | 437 (36.4%) | 107 (30.5%) |
Village | 353 (29.4%) | 79 (22.5%) |
Representative Sample (n = 1200) | Student Sample (n = 350) | |||
---|---|---|---|---|
5-Factor Model | 6-Factor Model | 5-Factor Model | 6-Factor Model | |
χ2 | 3442.289 *** | 2879.785 *** | 563.627 | 397.409 |
CFI (≤0.950) | 0.947 | 0.958 | 1.000 | 1.000 |
TLI (≤0.950) | 0.943 | 0.954 | 1.002 | 1.015 |
SRMR (≤0.080) | 0.087 | 0.080 | 0.070 | 0.060 |
RMSEA (≤0.060) | 0.064 | 0.058 | 0.000 | 0.000 |
Question | Representative Sample (n = 1200) | Student Sample (n = 350) | |||
---|---|---|---|---|---|
Factor Loading | Cronbach-Alpha 1 | Factor Loading | Cronbach-Alpha | ||
Danger | 0.907 | 0.878 | |||
I am worried about catching the virus. | D1 | 0.713 | 0.909 | 0.692 | 0.876 |
I am worried that I can’t keep my family safe from the virus. | D2 | 0.798 | 0.888 | 0.930 | 0.86 |
I am worried that our healthcare system won’t be able to protect my loved ones. | D3 | 0.774 | 0.882 | 0.885 | 0.849 |
I am worried our healthcare system is unable to keep me safe from the virus. | D4 | 0.778 | 0.887 | 0.962 | 0.853 |
I am worried that basic hygiene (e.g., handwashing) is not enough to keep me safe from the virus. | D5 | 0.767 | 0.887 | 0.994 | 0.845 |
I am worried that social distancing is not enough to keep me safe from the virus. | D6 | 0.790 | 0.885 | 1.002 | 0.852 |
Socio-Economic Consequences | 0.911 | 0.936 | |||
I am worried about grocery stores running out of food. | SE1 | 0.462 | 0.895 | 0.674 | 0.923 |
I am worried that grocery stores will close down. | SE2 | 0.383 | 0.905 | 0.701 | 0.931 |
I am worried about grocery stores running out of cleaning or disinfectant supplies. | SE3 | 0.442 | 0.885 | 0.845 | 0.916 |
I am worried about grocery stores running out of cold or flu remedies. | SE4 | 0.576 | 0.887 | 0.813 | 0.921 |
I am worried about grocery stores running out of water. | SE5 | 0.342 | 0.894 | 0.669 | 0.926 |
I am worried about pharmacies running out of prescription medicines. | SE6 | 0.619 | 0.906 | 0.884 | 0.929 |
Xenophobia | 0.880 | 0.927 | |||
I am worried that foreigners are spreading the virus in my country. | X1 | 0.520 | 0.847 | 0.796 | 0.917 |
If I went to a restaurant that specialized in foreign foods, I’d be worried about catching the virus. | X2 | 0.563 | 0.881 | 0.565 | 0.923 |
I am worried about coming into contact with foreigners because they might have the virus. | X3 | 0.515 | 0.842 | 0.671 | 0.904 |
If I met a person from a foreign country, I’d be worried that they might have the virus. | X4 | 0.521 | 0.843 | 0.651 | 0.903 |
If I was in an elevator with a group of foreigners, I’d be worried that they were infected with the virus. | X5 | 0.735 | 0.9 | 0.839 | 0.919 |
I am worried that foreigners are spreading the virus because they’re not as clean as we are. | X6 | 0.509 | 0.848 | 0.670 | 0.911 |
Contamination | 0.914 | 0.897 | |||
I am worried that if I touched something in a public space (e.g., handrail, door handle), I would catch the virus. | C1 | 0.784 | 0.891 | 0.783 | 0.878 |
I am worried that if someone coughed or sneezed near me, I would catch the virus. | C2 | 0.831 | 0.896 | 0.804 | 0.875 |
I am worried that people around me will infect me with the virus. | C3 | 0.708 | 0.895 | 0.692 | 0.884 |
I am worried about taking changes in cash transactions. | C4 | 0.675 | 0.907 | 0.714 | 0.879 |
I am worried that I might catch the virus from handling money or using a debit machine. | C5 | 0.655 | 0.887 | 0.670 | 0.868 |
I am worried that my mail has been contaminated by mail handlers. | C6 | 0.473 | 0.913 | 0.702 | 0.888 |
Traumatic Stress | 0.844 | 0.929 | |||
I had trouble concentrating because I kept thinking about the virus. | T1 | 0.494 | 0.801 | 0.553 | 0.917 |
Disturbing mental images about the virus popped into my mind against my will. | T2 | 0.424 | 0.806 | 0.588 | 0.923 |
I had trouble sleeping because I worried about the virus. | T3 | 0.298 | 0.815 | 0.428 | 0.91 |
I thought about the virus when I didn’t mean to. | T4 | 0.509 | 0.818 | 0.715 | 0.911 |
Reminders of the virus caused me to have physical reactions, such as sweating or a pounding heart. | T5 | 0.305 | 0.839 | 0.787 | 0.92 |
I had bad dreams about the virus. | T6 | 0.248 | 0.828 | 0.665 | 0.918 |
Compulsive Checking | 0.793 | 0.783 | |||
Searched the Internet for treatments for COVID-19. | CH1 | 0.557 | 0.738 | 0.876 | 0.74 |
Asked health professionals (e.g., doctors or pharmacists) for advice about COVID-19. | CH2 | 0.650 | 0.735 | 0.848 | 0.752 |
Checked YouTube videos about COVID-19. | CH3 | 0.211 | 0.788 | 0.868 | 0.751 |
Checked your own body for signs of infection (e.g., taking your temperature). | CH4 | 0.917 | 0.741 | 0.649 | 0.745 |
Sought reassurance from friends or family about COVID-19. | CH5 | 0.671 | 0.763 | 0.697 | 0.757 |
Checked social media posts concerning COVID-19. | CH6 | 0.331 | 0.791 | 0.563 | 0.757 |
Representative Sample (n = 1200) | Student Sample (n = 350) | |||
---|---|---|---|---|
WBI-5 | PSS | WBI-5 | PSS | |
CSS-H total | −0.114 *** | 0.112 *** | −0.199 *** | 0.300 *** |
CSS-H danger | −0.112 *** | 0.145 *** | −0.170 *** | 0.245 *** |
CSS-H socio-economic consequences | −0.140 *** | 0.191 *** | −0.145 *** | 0.233 *** |
CSS-H Xenophobia | −0.052 | 0.112 *** | −0.064 | 0.088 |
CSS-H contamination | −0.007 | −0.003 | −0.080 | 0.166 *** |
CSS-H traumatic stress | −0.306 *** | 0.121 *** | −0.201 *** | 0.295 *** |
CSS-H compulsive checking | −0.031 | 0.045 | −0.135 ** | 0.175 *** |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Pálvölgyi, Á.; Morvay-Sey, K.; Ács, P.; Paár, D. Validation of the Hungarian Version of the COVID Stress Scale (CSS-H). Int. J. Environ. Res. Public Health 2022, 19, 12602. https://doi.org/10.3390/ijerph191912602
Pálvölgyi Á, Morvay-Sey K, Ács P, Paár D. Validation of the Hungarian Version of the COVID Stress Scale (CSS-H). International Journal of Environmental Research and Public Health. 2022; 19(19):12602. https://doi.org/10.3390/ijerph191912602
Chicago/Turabian StylePálvölgyi, Ágnes, Kata Morvay-Sey, Pongrác Ács, and Dávid Paár. 2022. "Validation of the Hungarian Version of the COVID Stress Scale (CSS-H)" International Journal of Environmental Research and Public Health 19, no. 19: 12602. https://doi.org/10.3390/ijerph191912602