Next Article in Journal
Compositional Data Analysis of 16S rRNA Gene Sequencing Results from Hospital Airborne Microbiome Samples
Next Article in Special Issue
Working Conditions and Wellbeing among Prison Nurses during the COVID-19 Pandemic in Comparison to Community Nurses
Previous Article in Journal
And Still She Rises: Policies for Improving Women’s Health for a More Equitable Post-Pandemic World
Previous Article in Special Issue
Ultra-Orthodox Nursing Students’ Cultural Challenges Inside and Outside Their Community during the COVID-19 Pandemic
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 19
Issue 16
10.3390/ijerph191610106
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Psychometric Properties of the WHO-5 Well-Being Index among Nurses during the COVID-19 Pandemic: A Cross-Sectional Study in Three Countries

by
Mariela Loreto Lara-Cabrera
1,2,*,
Moisés Betancort
3,
Amparo Muñoz-Rubilar
4,
Natalia Rodríguez-Novo
5,
Ottar Bjerkeset
6 and
Carlos De las Cuevas
7,8
1
Department of Mental Health, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology (NTNU), 7091 Trondheim, Norway
2
Nidelv Community Mental Health Centre, Division of Psychiatry, St Olavs Hospital Trondheim University Hospital, 7006 Trondheim, Norway
3
Department of Clinical Psychology, Psychobiology and Methodology, Universidad de La Laguna, 38200 San Cristóbal de La Laguna, Spain
4
Faculty of Health Sciences, Universidad Central de Chile, Santiago 8370178, Chile
5
Departament of Nursing, Universidad de La Laguna, 38200 San Cristóbal de La Laguna, Spain
6
Faculty of Nursing and Health Sciences, Nord University, Levanger Campus, 8026 Levanger, Norway
7
Department of Internal Medicine, Dermatology and Psychiatry, Universidad de La Laguna, 38200 San Cristóbal de La Laguna, Spain
8
Instituto Universitario de Neurociencia (IUNE), Universidad de La Laguna, 38200 San Cristóbal de La Laguna, Spain
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(16), 10106; https://doi.org/10.3390/ijerph191610106
Submission received: 22 July 2022 / Revised: 4 August 2022 / Accepted: 9 August 2022 / Published: 16 August 2022
(This article belongs to the Special Issue Nursing and COVID-19 Ⅱ)
Browse Figures
Review Reports Versions Notes

Abstract

:
Nurses’ well-being has been increasingly recognised due to the ongoing pandemic. However, no validation scales measuring nurses’ well-being currently exist. Thus, we aimed to validate the WHO-5 Well-Being Index (WHO-5) in a sample of nurses. A cross-sectional multinational study was conducted, and a total of 678 nurses who worked during the COVID-19 pandemic in Spain (36.9%), Chile (40.0%) and Norway (23.1%) participated in this study. The nurses completed the WHO-5, the Patient Health Questionnaire-2 (PHQ-2), the Generalized Anxiety Disorder-2 (GAD-2) and three questions about the quality of life (QoL). The WHO-5 demonstrated good reliability and validity in the three countries. Cronbach’s alphas ranged from 0.81 to 0.90. High correlations were found between the WHO-5 and the psychological well-being dimension of QoL, and negative correlations between the WHO-5 and PHQ-2. The unidimensional scale structure was confirmed in all the countries, explaining more than 68% of the variance. The item response theory likelihood ratio model did not show discernible differences in the WHO-5 across the countries. To conclude, the WHO-5 is a psychometrically sound scale for measuring nurses’ well-being during a pandemic. The scale showed strong construct validity for cross-cultural comparisons; however, more research is required with larger sample sizes.

1. Introduction

Psychological well-being is a relative rather than an absolute concept [1]. Thus, one’s satisfaction or happiness is influenced by a blend of objective reality and one’s subjective reactions to it. This is affected by how well a person functions and how much their aspirations differ from their current situation [1,2]. As a part of the quality of life (QoL) concept, well-being is measured via diverse self-rated scales, although no consensus exists on a gold standard [3,4]. However, in recent years, collecting self-rated well-being data has become valuable for understanding well-being among the general population [5], in research [6,7], in clinical settings [7] and for understanding healthcare worker-reported outcomes in the workplace [5,8].
Nursing professionals frequently face burdensome workloads and are exposed to severe emotional demands and high perceived stress levels [9]. This is further complicated by the likelihood of understaffing and working during stressful events, such as a global pandemic. Furthermore, having to care for patients in an unsafe environment while exposed to personal risk can negatively affect nurses’ physical health [10] and psychological well-being [10,11]. In addition to a potential reduction in work performance, these factors can be associated with anxiety and depression symptoms [12,13] with deterioration of psychological well-being [11,14]. Nurses’ well-being is a significant determinant of a hospital’s ability to provide patient care [9]. As significant concerns for nurses’ well-being have been documented during the current global pandemic [5,11,15]; it is crucial to have a reliable self-reported scale that can adequately assess the well-being of nursing professionals. Thus, a critical nursing research goal is to capture and improve nurses’ well-being worldwide, and the WHO-5 Well-Being Index (WHO-5) is potentially useful for measuring this [7].
The WHO-5 reflects positive affections, and this short scale captures subjective psychological well-being by measuring affective and hedonic dimensions of well-being [2,16]. This self-rated scale was developed to enable primary healthcare general practitioners to screen patients for signs of depression to reduce relapse of depression symptoms and suicide rates [17,18]. Since its development, the scale has been used to guide clinical practice worldwide [7]. As a generic self-rated well-being scale, previous research on its psychometric properties has focused primarily on students and patients in different settings, such as general practice, private clinics, and hospital settings [6,7]. In addition, it is increasingly used as a reliable measure to monitor depression [19], with excellent clinimetric cross-cultural sensitivity to detect depression [20]. Extensive research and translations into the languages of over 30 countries are among the advantages of the WHO-5, allowing the understanding of mental health from a well-being perspective. However, although previous work has reported adequate internal consistency and structural validity of the scale in several research fields [1,7], no cross-cultural validation scales measuring nurses’ well-being currently exist.
When considering using a previously developed self-rated scale, examining validation and adaptation to specific context conditions of the population is recommended to ensure that the scale measures the originally intended construct [21]. Hence, researchers can determine the items’ suitability to capture the construct in advance, increasing the certainty that the scale would provide reliable information. This would give the information required to justify using the scale if appropriate for the specific new population. Although the WHO-5 was first validated as a scale for psychological well-being among patients, other factors can affect the scale’s psychometric properties. These factors could include cultural and socioeconomic background [22], and other factors that can highlight whether the hypothesised factor structure is the same across groups [21]. A recent validation study using item response theory (IRT) suggested that cross-cultural validation studies are needed for the WHO-5 [23]. This recommendation is consistent with recent studies suggesting that the cross-cultural validity of well-being scales remains an unexplored question [24]. These recommendations align with Boer et al. [25], suggesting that comparisons between countries may require assurance of measurement comparability before reliable conclusions can be drawn. However, despite previous use of the WHO-5 Well-Being Index in nursing studies [26], measurement invariance investigations of the WHO-5 have yet to be conducted among nurses. Furthermore, evidence-based psychometric evaluations in a pandemic context are relatively scarce.
The present study aimed to investigate the validity of the WHO-5 Well-Being Index among clinical nurses working in health services in Spain, Chile and Norway. This was performed by examining the internal consistency and conducting factor and IRT analyses, including assessing measurement invariance and differential item functioning (DIF) across countries and comparing the results obtained. Several a priori research hypotheses were tested to investigate the internal structure of the WHO-5. First, it was hypothesised that the WHO-5 would have good internal consistency, with Cronbach’s alpha coefficients exceeding 0.75. Second, as previous research has suggested that subjective well-being is part of the concept of perceived QoL [27], we also expected a priori that the WHO-5 would show high and strong correlations with questions about QoL. As validation studies in recent years have suggested that psychological problems affect subjective well-being [28,29], we also expected that core anxiety symptoms would have a negative association with the WHO-5 and that the WHO-5 would be negatively associated with core symptoms of depression. Finally, it was hypothesised that the WHO-5 would have adequate structural validity and a good fit in a one-factor solution based on prior studies [7].

2. Materials and Methods

This cross-sectional multinational study with nonprobability snowball sampling was conducted following the guidelines of Consensus-Based Standards for the Selection of Health Measurement Instruments [30]. An online survey was used to collect the data, and the STROBE reporting guideline was followed.

2.1. Sample/Participants

The recruitment of nurses followed three steps. First, schools’ management, nurse educators and the teaching staff at three universities invited nurses working in non-emergency clinical settings, including university hospitals, non-teaching hospitals and public community local health settings. Second, the survey was posted on the web pages of the associations of nurses. Finally, nurses connected to the university campus and potential participants were kindly asked to invite other nurses by forwarding the information about the study to other networks and via social media. Data were obtained during June and July 2020. Nurses were recruited to participate in the online survey by sending a welcoming email containing a hyperlink to the survey to all the nurses registered in professional associations in the areas of study (Tenerife Island in Spain, Santiago in Chile and Mid and West Norway).
Inclusion criteria were direct care nursing staff, working in inpatient wards, and employed by the hospitals. In the survey, questions about current working position were included, that is, whether they were involved with clinical, academic or administrative work, or were working with nursing education at the university. Participants were included if they were nurses, actively providing direct patient care in their respective countries, and agreed to participate.

2.2. Data Collection

We asked the participants to anonymously provide their sociodemographic information, through self-reporting, as part of the different questionnaires in the online survey. All the items were set as voluntary. To ensure that participants did not answer repeatedly, the online survey was set to reject multiple responses from the same IP address. We designed the survey to avoid burden on the respondents, maximise data quality and maintain ethically sound research. In addition, the online survey was designed so it was easy for the nurses to navigate. It was planned a priori to calculate item response rates and to exclude participants omitting answers/missing (if 25% or fewer items were missing). However, all participants answered the WHO-5 completely without omissions.
Before carrying out the investigation, the survey was piloted by five nurses and two professors. They examined the content validity of the items, reviewed their relevance, and provided feedback to ensure language representation for ease of understanding.

2.3. Measures

2.3.1. WHO-5 Well-Being Index

The nurses self-reported their well-being during the past two weeks. The scale has five items depicting feeling cheerful (Item 1: ‘I have felt cheerful and in good spirits’), feeling calm (Item 2: ‘I have felt calm and relaxed’), feeling active (Item 3: ‘I have felt active and vigorous’), feeling rested when waking up (Item 4: ‘I woke up feeling fresh and rested’) and feeling that one’s life is filled with exciting things (Item 5: ‘My daily life has been filled with things that interest me’). The response options ranged from 0 to 5, with 0 representing ‘at no time’ and 5 ‘all the time’ [6,7]. In the present study, the WHO-5 Well-Being Index was calculated as the sum of the scores of the responses, ranging from 0 (the worst imaginable well-being) to 25 (the best imaginable well-being). We used the Spanish version of the WHO-5, and this version was validated and tested for clarity in a sample of outpatients in community mental health settings [31]. The Norwegian version we used was validated among adolescents [32].

2.3.2. Quality of Life

The nurses’ self-reported QoL was assessed using the Multidimensional Quality of Life Index (MQLI). The MQLI is a self-administered questionnaire. The items evaluated their physical well-being, psychological/emotional well-being and overall QoL on a 10-point line [27,33]. Responses to these three questions were scored from 0 (representing ‘poor’) to 10 (indicating ‘excellent’) by placing a mark on the value representing their experiences. The reliability and validity of the MQLI were established in the original validation study (Cronbach’s alpha 0.92) and in the Norwegian validation study (Cronbach’s alpha 0.73) [27,33]; however, investigations about the validity and reliability of the MQLI-3 items have not been conducted among nurses.

2.3.3. Anxiety and Depression

The nurses’ self-reported anxiety was assessed using the Generalized Anxiety Disorder 2 (GAD-2) scale during the past two weeks [34]. In the present study, the GAD-2 was used as a self- administered questionnaire, and nurses were asked to report the presence of each symptom during the last 14 days. The questionnaire assessed how often they have been nervous (‘feeling nervous, anxious or on edge’) and worried (‘not being able to stop or control worrying’). The responses were provided on a Likert scale, from 0 (representing ‘not at all’) to 3 (representing ‘nearly every day’). The construct validity of the PHQ-2 was established in the original validation study [34].
The nurses’ self-reported depression was assessed using the Patient Health Questionnaire-2 (PHQ-2) scale during the past two weeks [35]. In the present study, the PHQ-2 was used as a self-administered questionnaire. The questionnaire asks how often a person has been bothered by feeling a lack of interest (‘little interest or pleasure in doing things’) and feeling sad (‘feeling down, depressed, or hopeless’). Nurses were asked to report the presence of each symptom during the last 14 days. Responses are provided on a Likert scale between 0 and 3, where 0 represents ‘not at all’, 1 represents ‘several days’, 2 represents ‘more than half the days’, and 3 represents ‘nearly every day’. The PHQ-2 is widely used and considered to be a reliable measure. The construct and criterion validity of the PHQ-2 were established in the original validation study [35].

2.4. Data Analysis

The data were analysed using IBM SPSS Statistics for Macintosh, Version 25.0 (IBM Corp., Armonk, NY, USA), and R library psych with ULLRToolbox. Values were described with means, standard deviations, frequencies and percentages. Each survey was examined for completeness, floor, and ceiling effects. Internal consistency was calculated using Cronbach’s alpha, and factor analyses were performed using principal component and minimum rank analysis. Two studies were conducted to assess the WHO-5 Well-Being Index invariance through the three samples (countries). First, an analysis was generated from IRT to study the consistency of the scale in a situation of invariance. A DIF study was conducted to assess item stability across different samples and test a potential source of systematic measurement bias in item responses regarding culture. The likelihood ratio chi-square test, the Nagelkerke and McFadden’s pseudo-R were computed as magnitude measures with a minimum cell count of six. The study of the differential behaviour of the item allowed us to study the invariance of the construct through different groups of participants [36].
Simultaneously, a study of the construct invariance was conducted through a confirmatory factor analysis in which configurational and metric invariance across groups were tested [37,38]. The IRT analysis was conducted following a logistic ordinal regression differential item functioning model under invariance criteria [39], using the country variable as a grouping variable. Three search criteria for items were used according to the country (Spain, Chile, and Norway): chi-square, R2 and beta. None of the cases was flagged. Our aim was to verify the linear item invariance [40] comprising the construct according to the country variable. The proposed models were compared following Satorra and Bentler approach [41].
Sample size estimates were based on factor analysis, requiring at least 10 participants per variable to achieve replicable findings, following the guidelines of Consensus-Based Standards for the Selection of Health Measurement Instruments [30].

2.5. Ethical Approval

The Research Ethics Committee of the Canary Islands Health Service, Spain, first approved the study (CHUC_2020_33), and subsequently, we obtained approvals in Chile and Norway (27/2020 and 155172). All the participants provided informed consent before participation.

3. Results

Completed data were obtained from 678 nurses. Their mean age was 39.3 years (standard deviation (SD) = 12.1), ranging from 36 to 48 years, and most nurses were female (74.5% for Chile, 88.9% for Norway, and 80.8% for Spain). There were no missing values. None of the items have floor/ceiling effects. The mean scores for each of the measures used in this study are shown in Table 1.
The mean WHO-5 score for the global sample was 13.0 (SD = 5.1), the median score was 13.0, and the skewness was −0.17 (SE = 0.94). In the samples in Chile, Norway, and Spain, the WHO-5 items registered high correlations with each other (Chile: from 0.56 to 0.75; Norway: from 0.31 to 0.51; Spain: from 0.59 to 0.75), indicating that they measured the same construct. Similarly, the WHO-5 items showed a high correlation with the total scale score (Chile: from 0.70 to 0.82, Norway: from 0.53 to 0.73; and Spain: from 0.64 to 0.78).
Table 1 also shows the results regarding the hypotheses and correlations. Strong correlations were expected based on the assumption that the WHO-5 Well-Being Index is part of the concept of perceived QoL, measured using the MQLI-3. These were supported by the WHO-5 Well-Being Index and physical well-being (r = 0.662 for Chile, r = 0.683 for Norway, and r = 0.592 for Spain), psychological/emotional well-being (r = 0.738 for Chile, r = 0.610 for Norway, and r = 0.721 for Spain), and overall QoL (r = 0.724 for Chile, r = 0.584 for Norway, and r = 0.630 for Spain).
Based on previous studies, we expected that the WHO-5 Well-Being Index is a valid measure in the context of mental health, and strong correlations were expected with core symptoms of anxiety (GAD-2) and depression (PHQ-2). Table 1 shows adequate negative correlations obtained with GAD-2 (r ranging from −0.39 to −0.77) and PHQ-2 (r ranging from −0.56 to −0.73).
The WHO-5 Well-Being Index showed high internal consistency in the three countries (Table 2, Chile-Cronbach’s alpha = 0.903; Spain-Cronbach’s alpha = 0.883; and Norway-Cronbach’s alpha = 0.810). No item deletion improved Cronbach’s alpha in any of the samples studied.
The unidimensionality of the WHO-5 Well-Being Index was confirmed through factor analysis using principal component analysis as an extraction method. A single-factor structure was demonstrated, explaining 72.5% in Chile (factor loadings between 0.80 and 0.90), 57.7% in Norway (factor loadings between 0.70 and 0.84) and 68.7% of the variance in Spain (factor loadings between 0.77 and 0.87).
Table 2 shows the factor loadings. The Kaiser–Meyer–Olkin measures of sampling adequacy were 0.859 for Chile, 0.793 for Norway and 0.846 for Spain, indicating sample adequacy. Bartlett’s test of sphericity values were 672.275 (Spain), 859.431 (Chile) and 257.384 (Norway; df = 10, p < 0.0001), all of them indicating an underlying structure in the scale and that factor analyses were justified in the samples.
The comparison data of both models can be seen in Table 3. As shown in Figure 1, a broad overlap was found between the Spain and Chile distributions, although the Norway sample showed a higher mean well-being score than Spain and Chile samples. With this setting in two iterations, three items were identified (flagged) as potential sources of differences regarding country: Item 1 (‘I have felt cheerful and in good spirits’), Item 3 (‘I have felt active and vigorous’) and Item 4 (‘I woke up feeling fresh and rested’; see Figure 1).
Figure 2 shows the item true score function with a test for differential item functioning models (uniform vs. nonuniform) and item response function for Items 1, 3 and 4 with regression parameter values by country, indicating that the items with differential behaviour depending on the country were Items 1, 3 and 4. A differential effect was found in response to Item 1 depending on the type of country [Pr( χ 12 2 ,2) < 0.001]. The slope for the Norwegian sample was lower than that of the Spanish and Chilean samples (1.95 vs. 3.71 and 3.35). Data found in the item true score function showed that the responses of the Norwegian sample for this item were in a low–medium range of the trait compared to the Spanish and Chileans (Figure 2b). Item 3 showed a differential effect of the item [Pr( χ 12 2 ,2) < 0.001]. Differential behaviour was evident: the second graph of true item scores for Item 3 showed greater homogeneity between the three samples. Finally, Item 4, ‘I have felt cheerful and in good spirits’, also showed differential behaviour according to the country [Pr( χ 12 2 ,2) < 0.001]. Figure 2f shows the trait values according to the true response function, where the Norwegian sample showed higher trait values than the Spanish and Chilean samples.
The values of the differential-corrected and differential-uncorrected raw data per participant and group regarding the central 50% of the distribution showed an interquartile range between −0.04 and 0.02 with a median value of approximately 0.0. The differential behaviour of the scale according to the countries showed some spurious differences between the raw values and values according to the differential. The IRT differential item analysis showed a spurious bias response effect regarding Items 1, 3 and 4. We then considered whether some items exhibiting differential behaviour affected the internal validity of the scale structure according to the countries. Our aim was to verify the linear item invariance comprising the construct according to the country variable. The comparison of the configurational invariance, assuming the same measurement model per country, and the invariance in the beta regression coefficients (per country) were significant [χ2 diff(4) = 23, p < 0.001)]. A statistical significance was found, which reflected as a small effect size (w = 0.01). It was assumed that factorial weights differed by country. This spurious difference (located in the weights of Items 1, 3 and 4) was lower on average in the Norwegian sample (see Figure 2).

4. Discussion

This study aimed to investigate the validity of the WHO-5 Well-Being Index for nurses by examining internal consistency and conducting factor and IRT analyses. This was conducted to investigate the WHO-5’s scale construct validity across three countries: Spain, Chile, and Norway.
Construct validity based on a priori hypothesis testing was supported. Contrary to previous studies showing low Cronbach’s alpha [42], the WHO-5 Well-Being Index showed high internal consistency in the three countries, with Cronbach’s alpha varying from 0.810 to 0.903 (Norway to Chile). These findings are within the range of Cronbach’s alpha reported in validation studies among medical educators in Hong Kong [43], outpatients with epilepsy in Denmark [44], adults living with epilepsy and HIV in Kenya [45] and among Chinese university students [46].
Regarding hypotheses concerning well-being and QoL, our study revealed high correlation values between the WHO-5 Well-Being Index and the psychological/emotional well-being dimension of the MQLI and the overall QoL. These correlations are consistent with those Mundal et al. [27] reported in a previous validation study. Our results also indicated adequate negative correlations between well-being and anxiety, consistent with a previous study that found strong correlations between the WHO-5 Well-Being Index and anxiety [29]. Additionally, adequate negative correlations were found between well-being and depression, consistent with previous studies reporting that the WHO-5 correlated negatively with depression [28,47,48,49,50,51,52]. Together with the obtained internal consistency values, these findings support the construct validity of the well-being scale.
The unidimensionality of the WHO-5 was confirmed through factor analysis, with values from 57.7% (for the Norwegian sample) to 72.5% (for the Chilean sample). Our findings are consistent with prior research founding a one-factor structure [7,52], indicating that the WHO-5 can be used to measure the well-being of nurses in different countries for cross-cultural investigations. Notably, as IRT DIF analysis revealed, the WHO-5 performed differently for the well-being construct in the Norwegian sample than for the Spanish and Chilean ones. However, the differential patterns found were associated with negligible effect sizes below 0.13 [53]. Additionally, the Norwegian nurses had a greater probability of responding with high values on the scale than the Spanish and Chilean. This suggests that these items behave slightly differently depending on the country. Cultural differences are likely to have caused the differences in responses to the items. When measuring well-being in countries with different economic situations [22], for instance, developed countries such as Norway compared to other countries such as Chile, this difference in economic well-being could also be a source of bias.
It is noteworthy that differences between the samples could be explained by the impact of COVID-19, since Chile and Spain were hit much harder than Norway, specifically during the data collection period. As prior studies have suggested [54,55,56], factors such as self-perceived job insecurity, ethical dilemmas and stringency of government responses may affect well-being. Nevertheless, nurses in the Norwegian sample reported higher values when comparing the means between the three countries. These combined findings emphasize that nurses from Norway reported better well-being than those in Spain and Chile during the pandemic. These results appear consistent with studies reporting that the WHO-5 Well-Being Index can differentiate between populations [31,43,45]. However, further research, using several measurement points, is needed to investigate whether the nurses’ mental well-being changes over time and whether the WHO-5 Well-Being Index can capture these changes.
Although it is unknown whether the pandemic might explain these differences or whether the differences might be explained by language differences in how nurses perceived their well-being, it is noteworthy that the overall mean of the WHO-5 was significantly lower for nurses from Chile and Spain, as this was higher compared to the WHO-5 means reported in a similar COVID-19 study in Vietnam [57]. Nurses in Chile and Spain had mean scores below 13, corresponding to depression. Our findings regarding the lack of well-being reported in all the countries have implications for government policies/policymakers, showing that they should focus on nurses’ well-being. Additionally, nurses in the three countries reported variations in their well-being with a scale that also detects depression [7]. Our findings suggest that the COVID-19 pandemic influenced how nurses struggled with feeling ‘calm and relaxed’ and ‘active and vigorous’ and waking up ‘feeling fresh and rested’. Such information will guide researchers seeking interventions to enhance well-being in different cultures.
Notably, nurses in Chile and Spain, countries hit hard by COVID-19, struggle more with mental health problems. This finding is in line with a prior study [58]. In countries where depression is associated with stigma [59], the WHO-5 Well-Being Index will be a better alternative to measure depression and lack of well-being. Thus, measuring nurses’ well-being can guide hospital administrators in implementing strategies to protect nursing staff without time constraints and psychological burdens being viewed as a stigma. In addition, collecting such information in different countries can guide researchers in developing methods to improve nurses’ well-being across countries and cultures.
Although the study’s multi-country design, involving collecting data in three countries, and rigorous statistical analyses are strengths, the study has limitations. First, the nurses studied were convenience-sampled, using a non-probability snowball sampling approach, limiting the possibility to know the response rate of nurses who refused to participate in the study. Second, the sample is limited, as demographic differences existed between the countries. Finally, cultural differences may have caused the differences regarding Item 1, as our result suggested that this item could be understood differently in different countries. Nevertheless, while accepting this final limitation, it must be noted that when measuring well-being in countries with different economic situations, such as developed countries such as Norway as compared to countries such as Chile, this difference in economic well-being could be a source of bias. However, further studies are required due to the relatively limited sample size.

5. Conclusions

The WHO-5 Well-Being Index demonstrated its utility as a cross-cultural ultra-brief questionnaire for measuring subjective psychological well-being in Spanish, Chilean and Norwegian nurses. The scale showed high internal consistency in the three countries. Although the unidimensionality of the WHO-5 was confirmed through factor analysis, we found a non-invariance effect on the weights of items, and Item 1 appears somewhat less stable when comparing the Norwegian sample with the Spanish and Chilean samples. Although our findings support the scale’s construct validity, allowing comparative analyses between countries, more research is required with larger sample sizes.

Author Contributions

Conceptualization, M.L.L.-C.; writing—original draft preparation, M.L.L.-C., A.M.-R. and C.D.l.C.; data collection, A.M.-R., O.B. and N.R.-N.; formal analysis, M.B. and C.D.l.C.; methodology, M.B. and C.D.l.C.; data curation, A.M.-R.; project administration and funding acquisition, M.L.L.-C.; writing—review and editing, A.M.-R., M.B., O.B., N.R.-N., C.D.l.C. and M.L.L.-C. All authors have read and agreed to the published version of the manuscript.

Funding

The corresponding author was funded by a post-doctoral grant while planning and conducting the study, grant number 90327500/2018, from the Central Norway Regional Health Authority.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki. The Research Ethics Committee of the Canary Islands Health Service, Spain, first ap-proved the study, and subsequently we obtained approvals in Chile and Norway (CHUC_2020_33, 155172 and 27/2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Due to the sensitive nature of the questions asked in this study, survey respondents were assured raw data would remain confidential and would not be shared. The data are not publicly available due to data protection regulations.

Acknowledgments

We are grateful to the nurses and organisations supporting this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. McDowell, I. Measures of self-perceived well-being. J. Psychosom. Res. 2010, 69, 69–79. [Google Scholar] [CrossRef] [PubMed]
  2. Kusier, A.O.; Folker, A.P. The Well-Being Index WHO-5: Hedonistic foundation and practical limitations. Med. Humanit. 2019, 30, 30. [Google Scholar] [CrossRef] [PubMed]
  3. Linton, M.J.; Dieppe, P.; Medina-Lara, A. Review of 99 self-report measures for assessing well-being in adults: Exploring dimensions of well-being and developments over time. BMJ Open 2016, 6, e010641. [Google Scholar] [CrossRef] [PubMed]
  4. Lindert, J.; Bain, P.A.; Kubzansky, L.D.; Stein, C. Well-being measurement and the WHO health policy Health 2010: Systematic review of measurement scales. Eur. J. Public Health 2015, 25, 731–740. [Google Scholar] [CrossRef]
  5. De Kock, J.H.; Latham, H.A.; Leslie, S.J.; Grindle, M.; Munoz, S.A.; Ellis, L.; Polson, R.; O’Malley, C.M. A rapid review of the impact of COVID-19 on the mental health of healthcare workers: Implications for supporting psychological well-being. BMC Public Health 2021, 21, 104. [Google Scholar] [CrossRef]
  6. Lara-Cabrera, M.L.; Bjorkly, S.; De Las Cuevas, C.; Pedersen, S.A.; Mundal, I.P. Psychometric properties of the Five-item World Health Organization Well-being Index used in mental health services: Protocol for a systematic review. J. Adv. Nurs. 2020, 76, 2426–2433. [Google Scholar] [CrossRef]
  7. Topp, C.W.; Ostergaard, S.D.; Sondergaard, S.; Bech, P. The WHO-5 Well-Being Index: A systematic review of the literature. Psychother. Psychosom. 2015, 84, 167–176. [Google Scholar] [CrossRef]
  8. Blasco-Belled, A.; Tejada-Gallardo, C.; Fatsini-Prats, M.; Alsinet, C. Mental health among the general population and healthcare workers during the COVID-19 pandemic: A meta-analysis of well-being and psychological distress prevalence. Curr. Psychol. 2022, 1–12. [Google Scholar] [CrossRef]
  9. Hall, L.H.; Johnson, J.; Watt, I.; Tsipa, A.; O’Connor, D.B. Healthcare Staff Wellbeing, Burnout, and Patient Safety: A Systematic Review. PLoS ONE 2016, 11, e0159015. [Google Scholar] [CrossRef]
  10. Fernandez, R.; Lord, H.; Halcomb, E.; Moxham, L.; Middleton, R.; Alananzeh, I.; Ellwood, L. Implications for COVID-19: A systematic review of nurses’ experiences of working in acute care hospital settings during a respiratory pandemic. Int. J. Nurs. Stud. 2020, 111, 103637. [Google Scholar] [CrossRef]
  11. Dragioti, E.; Tsartsalis, D.; Mentis, M.; Mantzoukas, S.; Gouva, M. Impact of the COVID-19 pandemic on the mental health of hospital staff: An umbrella review of 44 meta-analyses. Int. J. Nurs. Stud. 2022, 131, 104272. [Google Scholar] [CrossRef] [PubMed]
  12. Zheng, R.; Zhou, Y.; Fu, Y.; Xiang, Q.; Cheng, F.; Chen, H.; Xu, H.; Fu, L.; Wu, X.; Feng, M.; et al. Prevalence and associated factors of depression and anxiety among nurses during the outbreak of COVID-19 in China: A cross-sectional study. Int. J. Nurs. Stud. 2021, 114, 103809. [Google Scholar] [CrossRef] [PubMed]
  13. Slusarska, B.; Nowicki, G.J.; Niedorys-Karczmarczyk, B.; Chrzan-Rodak, A. Prevalence of Depression and Anxiety in Nurses during the First Eleven Months of the COVID-19 Pandemic: A Systematic Review and Meta-Analysis. Int. J. Environ. Res. Public Health 2022, 19, 1154. [Google Scholar] [CrossRef]
  14. Huerta-Gonzalez, S.; Selva-Medrano, D.; Lopez-Espuela, F.; Caro-Alonso, P.A.; Novo, A.; Rodriguez-Martin, B. The Psychological Impact of COVID-19 on Front Line Nurses: A Synthesis of Qualitative Evidence. Int. J. Environ. Res. Public Health 2021, 18, 2975. [Google Scholar] [CrossRef]
  15. Lara-Cabrera, M.L.; Betancort, M.; Muñoz-Rubilar, C.A.; Rodríguez Novo, N.; De las Cuevas, C. The Mediating Role of Resilience in the Relationship between Perceived Stress and Mental Health. Int. J. Environ. Res. Public Health 2021, 18, 9762. [Google Scholar] [CrossRef] [PubMed]
  16. World Health Organization. Use of well-being measures in primary health care-the DepCare project health for all. Target 1998, 12, E60246. [Google Scholar]
  17. Bech, P. Clinical Psychometrics; John Wiley & Sons: New York, NY, USA, 2012. [Google Scholar]
  18. World Health Organization. Wellbeing Measures in Primary Health care/The DepCare Project: Report on a WHO Meeting: Stockholm, Sweden, 12–13 February 1998; World Health Organization Regional Office for Europe: Copenhagen, Denmark, 1998. [Google Scholar]
  19. Newnham, E.A.; Hooke, G.R.; Page, A.C. Monitoring treatment response and outcomes using the World Health Organization’s Wellbeing Index in psychiatric care. J. Affect. Disord. 2010, 122, 133–138. [Google Scholar] [CrossRef]
  20. Carrozzino, D.; Christensen, K.S.; Patierno, C.; Woźniewicz, A.; Møller, S.B.; Arendt, I.-M.T.P.; Zhang, Y.; Yuan, Y.; Sasaki, N.; Nishi, D.; et al. Cross-cultural validity of the WHO-5 Well-Being Index and Euthymia Scale: A clinimetric analysis. J. Affect. Disord. 2022, 311, 276–283. [Google Scholar] [CrossRef]
  21. Boateng, G.O.; Neilands, T.B.; Frongillo, E.A.; Melgar-Quinonez, H.R.; Young, S.L. Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer. Front. Public Health 2018, 6, 149. [Google Scholar] [CrossRef]
  22. Lomas, T. Positive cross-cultural psychology: Exploring similarity and difference in constructions and experiences of wellbeing. Int. J. Wellbeing 2015, 5, 60–77. [Google Scholar] [CrossRef]
  23. Sischka, P.E.; Costa, A.P.; Steffgen, G.; Schmidt, A.F. The WHO-5 well-being index–validation based on item response theory and the analysis of measurement invariance across 35 countries. J. Affect. Disord. Rep. 2020, 1, 100020. [Google Scholar] [CrossRef]
  24. Cooke, P.J.; Melchert, T.P.; Connor, K. Measuring Well-Being:A Review of Instruments. Couns. Psychol. 2016, 44, 730–757. [Google Scholar] [CrossRef]
  25. Boer, D.; Hanke, K.; He, J. On detecting systematic measurement error in cross-cultural research: A review and critical reflection on equivalence and invariance tests. J. Cross-Cult. Psychol. 2018, 49, 713–734. [Google Scholar] [CrossRef]
  26. Bolier, L.; Ketelaar, S.M.; Nieuwenhuijsen, K.; Smeets, O.; Gartner, F.R.; Sluiter, J.K. Workplace mental health promotion online to enhance well-being of nurses and allied health professionals: A cluster-randomized controlled trial. Internet Interv. 2014, 1, 196–204. [Google Scholar] [CrossRef]
  27. Mundal, I.; Laake, P.; Mezzich, J.; Bjørkly, S.K.; Lara-Cabrera, M.L. Assessment of the Quality of Life in Parents of Children With ADHD: Validation of the Multicultural Quality of Life Index in Norwegian Pediatric Mental Health Settings. Front. Psychol. 2021, 12, 638006. [Google Scholar] [CrossRef]
  28. Hajos, T.R.; Pouwer, F.; Skovlund, S.E.; Den Oudsten, B.L.; Geelhoed-Duijvestijn, P.H.; Tack, C.J.; Snoek, F.J. Psychometric and screening properties of the WHO-5 well-being index in adult outpatients with Type 1 or Type 2 diabetes mellitus. Diabet. Med. 2013, 30, e63–e69. [Google Scholar] [CrossRef]
  29. Ghaheri, A.; Omani-Samani, R.; Sepidarkish, M.; Hosseini, M.; Maroufizadeh, S. The Four-item Patient Health Questionnaire for Anxiety and Depression: A Validation Study in Infertile Patients. Int. J. Fertil. Steril. 2020, 14, 234–239. [Google Scholar] [CrossRef]
  30. Mokkink, L.B.; Prinsen, C.; Patrick, D.L.; Alonso, J.; Bouter, L.; de Vet, H.C.; Terwee, C.B.; Mokkink, L. COSMIN methodology for systematic reviews of patient-reported outcome measures (PROMs). User Man. 2018, 27, 1171–1179. [Google Scholar]
  31. Lara-Cabrera, M.L.; Mundal, I.P.; De Las Cuevas, C. Patient-reported well-being: Psychometric properties of the world health organization well-being index in specialised community mental health settings. Psychiatry Res. 2020, 291, 113268. [Google Scholar] [CrossRef]
  32. Christensen, K.S.; Haugen, W.; Sirpal, M.K.; Haavet, O.R. Diagnosis of depressed young people--Criterion validity of WHO-5 and HSCL-6 in Denmark and Norway. Fam. Pract. 2015, 32, 359–363. [Google Scholar] [CrossRef]
  33. Mezzich, J.E.; Cohen, N.L.; Ruiperez, M.A.; Banzato, C.E.; Zapata-Vega, M.I. The Multicultural Quality of Life Index: Presentation and validation. J. Eval. Clin. Pract. 2011, 17, 357–364. [Google Scholar] [CrossRef] [PubMed]
  34. Kroenke, K.; Spitzer, R.L.; Williams, J.B.; Monahan, P.O.; Lowe, B. Anxiety disorders in primary care: Prevalence, impairment, comorbidity, and detection. Ann. Intern Med. 2007, 146, 317–325. [Google Scholar] [CrossRef] [PubMed]
  35. Kroenke, K.; Spitzer, R.L.; Williams, J.B. The Patient Health Questionnaire-2: Validity of a two-item depression screener. Med. Care 2003, 41, 1284–1292. [Google Scholar] [CrossRef] [PubMed]
  36. Xu, H.; Tracey, T.J.G. Development of an abbreviated Career Indecision Profile-65 using item response theory: The CIP-Short. J. Couns. Psychol. 2017, 64, 222–232. [Google Scholar] [CrossRef]
  37. Vandenberg, R.J.; Lance, C.E. A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research. Organ. Res. Methods 2000, 3, 4–70. [Google Scholar] [CrossRef]
  38. Greiff, S.; Scherer, R. Still comparing apples with oranges? Some thoughts on the principles and practices of measurement invariance testing. Eur. J. Psychol. Assess. 2018, 34, 141–144. [Google Scholar] [CrossRef]
  39. Choi, S.W.; Gibbons, L.E.; Crane, P.K. lordif: An R Package for Detecting Differential Item Functioning Using Iterative Hybrid Ordinal Logistic Regression/Item Response Theory and Monte Carlo Simulations. J. Stat. Softw. 2011, 39, 1–30. [Google Scholar] [CrossRef]
  40. Elosua, P. Evaluación progresiva de la invarianza factorial entre las versiones original y adaptada de una escala de autoconcepto. Psicothema 2005, 17, 356–362. [Google Scholar]
  41. Satorra, A.; Bentler, P.M. A scaled difference chi-square test statistic for moment structure analysis. Psychometrika 2001, 66, 507–514. [Google Scholar] [CrossRef]
  42. Faruk, M.O.; Alam, F.; Chowdhury, K.U.A.; Soron, T.R. Validation of the Bangla WHO-5 Well-being Index. Glob. Ment. Health (Camb) 2021, 8, e26. [Google Scholar] [CrossRef]
  43. Chan, L.; Liu, R.K.W.; Lam, T.P.; Chen, J.Y.; Tipoe, G.L.; Ganotice, F.A. Validation of the World Health Organization Well-Being Index (WHO-5) among medical educators in Hong Kong: A confirmatory factor analysis. Med. Educ. Online 2022, 27, 2044635. [Google Scholar] [CrossRef] [PubMed]
  44. Schougaard, L.M.V.; de Thurah, A.; Bech, P.; Hjollund, N.H.; Christiansen, D.H. Test-retest reliability and measurement error of the Danish WHO-5 Well-being Index in outpatients with epilepsy. Health Qual. Life Outcomes 2018, 16, 175. [Google Scholar] [CrossRef] [PubMed]
  45. Chongwo, E.; Ssewanyana, D.; Nasambu, C.; Mwangala, P.N.; Mwangi, P.M.; Nyongesa, M.K.; Newton, C.R.; Abubakar, A. Validation of a Swahili version of the World Health Organization 5-item well-being index among adults living with HIV and epilepsy in rural coastal Kenya. Glob. Health Res. Policy 2018, 3, 26. [Google Scholar] [CrossRef] [PubMed]
  46. Fung, S.F.; Kong, C.Y.W.; Liu, Y.M.; Huang, Q.; Xiong, Z.; Jiang, Z.; Zhu, F.; Chen, Z.; Sun, K.; Zhao, H.; et al. Validity and Psychometric Evaluation of the Chinese Version of the 5-Item WHO Well-Being Index. Front. Public Health 2022, 10, 872436. [Google Scholar] [CrossRef] [PubMed]
  47. Roldan-Merino, J.; Hurtado-Pardos, B.; Molina-Raya, L.; Bande, D.; Casas, I.; Farres-Tarafa, M. Psychological impact of the COVID-19 pandemic on nursing students in the first wave: A cross-sectional survey. Nurs. Open 2022, 9, 2003–2012. [Google Scholar] [CrossRef]
  48. Perera, B.P.R.; Jayasuriya, R.; Caldera, A.; Wickremasinghe, A.R. Assessing mental well-being in a Sinhala speaking Sri Lankan population: Validation of the WHO-5 well-being index. Health Qual. Life Outcomes 2020, 18, 305. [Google Scholar] [CrossRef]
  49. Omani-Samani, R.; Maroufizadeh, S.; Almasi-Hashiani, A.; Sepidarkish, M.; Amini, P. The WHO-5 Well-Being Index: A Validation Study in People with Infertility. Iran. J. Public Health 2019, 48, 2058–2064. [Google Scholar] [CrossRef]
  50. Cichon, E.; Kiejna, A.; Kokoszka, A.; Gondek, T.; Rajba, B.; Lloyd, C.E.; Sartorius, N. Validation of the Polish version of WHO-5 as a screening instrument for depression in adults with diabetes. Diabetes Res. Clin. Pract. 2019, 159, 107970. [Google Scholar] [CrossRef]
  51. Kwon, M.; Kim, H. Psychological Well-Being of Female-Headed Households Based on Age Stratification: A Nationwide Cross-Sectional Study in South Korea. Int. J. Environ. Res. Public Health 2020, 17, 6445. [Google Scholar] [CrossRef]
  52. Suhaimi, A.F.; Makki, S.M.; Tan, K.A.; Silim, U.A.; Ibrahim, N. Translation and Validation of the Malay Version of the WHO-5 Well-Being Index: Reliability and Validity Evidence from a Sample of Type 2 Diabetes Mellitus Patients. Int. J. Environ. Res. Public Health 2022, 19, 4415. [Google Scholar] [CrossRef]
  53. Cohen, J. Statistical Power Analysis For The Behavioral Sciences (rev ed.). Hillsdale, NJ: Erlbaum, 1988. Percept. Mot. Ski. 1988, 67, 1007. [Google Scholar]
  54. Russo, C.; Terraneo, M. Mental Well-being Among Workers: A Cross-national Analysis of Job Insecurity Impact on the Workforce. Soc. Indic. Res. 2020, 152, 421–442. [Google Scholar] [CrossRef]
  55. Long, D.; Haagsma, J.A.; Janssen, M.F.; Yfantopoulos, J.N.; Lubetkin, E.I.; Bonsel, G.J. Health-related quality of life and mental well-being of healthy and diseased persons in 8 countries: Does stringency of government response against early COVID-19 matter? SSM Popul. Health 2021, 15, 100913. [Google Scholar] [CrossRef] [PubMed]
  56. Munoz-Rubilar, C.A.; Carrillos, C.P.; Mundal, I.P.; Cuevas, C.L.; Lara-Cabrera, M.L. The duty to care and nurses’ well-being during a pandemic. Nurs. Ethics 2022, 29, 527–539. [Google Scholar] [CrossRef] [PubMed]
  57. Hoang, T.D.; Colebunders, R.; Fodjo, J.N.S.; Nguyen, N.P.T.; Tran, T.D.; Vo, T.V. Well-Being of Healthcare Workers and the General Public during the COVID-19 Pandemic in Vietnam: An Online Survey. Int. J. Environ. Res. Public Health 2021, 18, 4737. [Google Scholar] [CrossRef] [PubMed]
  58. Saragih, I.D.; Tonapa, S.I.; Saragih, I.S.; Advani, S.; Batubara, S.O.; Suarilah, I.; Lin, C.J. Global prevalence of mental health problems among healthcare workers during the Covid-19 pandemic: A systematic review and meta-analysis. Int. J. Nurs. Stud. 2021, 121, 104002. [Google Scholar] [CrossRef]
  59. Yang, F.; Yang, B.X.; Stone, T.E.; Wang, X.Q.; Zhou, Y.; Zhang, J.; Jiao, S.F. Stigma towards depression in a community-based sample in China. Compr. Psychiatry 2020, 97, 152152. [Google Scholar] [CrossRef]
Ijerph 19 10106 g001 550
Figure 1. Graphic representation of the population latent trait distribution in the three countries.
Figure 1. Graphic representation of the population latent trait distribution in the three countries.
Ijerph 19 10106 g001
Ijerph 19 10106 g002 550
Figure 2. Item true score function with test for differential items functioning models (uniform vs. nonuniform) and item response function for Items 1 (a,b), 3 (c,d) and 4 (e,f) with regressions parameters values by country.
Figure 2. Item true score function with test for differential items functioning models (uniform vs. nonuniform) and item response function for Items 1 (a,b), 3 (c,d) and 4 (e,f) with regressions parameters values by country.
Ijerph 19 10106 g002
Table
Table 1. Means (M), standard deviation (SD, ±) and bivariate correlations of the study variables.
Table 1. Means (M), standard deviation (SD, ±) and bivariate correlations of the study variables.
VariablesSpain
(n = 250)		Chile
(n = 271)		Norway
(n = 157)
WHO-5 Total Score, mean, SD ***12.4 ± 4.911.9 ± 5.316.0 ± 3.7
MQLI-physical well-being, mean, SD ***6.5 ± 2.36.1 ± 2.46.5 ± 2.1
MQLI-emotional well-being, mean, SD ***6.2 ± 2.55.8 ± 2.77.0 ± 1.9
MQLI-quality of life, mean, SD ***6.9 ± 2.46.4 ± 2.57.6 ± 1.8
GAD-2, mean, SD ***2.5 ± 1.72.9 ± 1.81.2 ± 1.1
PHQ-2, mean, SD ***2.0 ± 1.72.2 ± 1.71.1 ± 1.0
Correlations MQLI-physical well-being and WHO-50.592 **0.662 **0.683 **
Correlations MQLI-emotional well-being and WHO-50.721 **0.738 **0.610 **
Correlations MQLI-quality of life and WHO-50.630 **0.724 ***0.584 **
Correlations GAD-2 and WHO-5−0.650 **−0.733 **−0.390 **
Correlations PHQ-2 and WHO-5−0.726 **−0.698 **−0.563 **
** p < 0.01. *** p < 0.001. GAD-2 = Generalized Anxiety Disorder-2; MQLI = Multidimensional Quality of Life Index; PHQ-2 = Patient Health Questionnaire-2; WHO-5 = WHO-5 Well-Being Index.
Table
Table 2. Means (M), standard deviation (SD, ±), factor loading and Cronbach’s alpha for the three samples.
Table 2. Means (M), standard deviation (SD, ±), factor loading and Cronbach’s alpha for the three samples.
WHO-5 ItemSpain
(n = 250)		Chile
(n = 271)		Norway
(n = 154)
Mean
± SD		Factor LoadingMean
± SD		Factor LoadingMean
± SD		Factor Loading
WHO-Item 1: Feeling cheerful2.7 ± 1.10.8692.7 ± 1.10.8533.7 ± 0.60.699
WHO-Item 2: Feeling calm2.4 ± 1.10.8672.2 ± 1.20.8743.3 ± 0.90.725
WHO-Item 3: Feeling active2.6 ± 1.20.8432.4 ± 1.20.8963.0 ± 1.10.730
WHO-Item 4: Feeling rested2.2 ± 1.20.7942.1 ± 1.30.8322.6 ± 1.20.843
WHO-Item 5: Feeling that one’s life is filled with interesting things2.5 ± 1.30.7682.5 ± 1.30.8013.4 ± 0.90.792
Cronbach’s alpha0.8830.9030.810
Table
Table 3. Comparison data between models.
Table 3. Comparison data between models.
ModelsDfAICBICChi-SquareChi-Square DiffDf Diff
Model 1158771.58907.982.918
Model 2238801.78800.3128.37653.4458 ***
*** p < 0.001. AIC = Akaike Information Criteria; BIC = Bayes Information Criteria; Df diff = Degree of Freedom differential analysis.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lara-Cabrera, M.L.; Betancort, M.; Muñoz-Rubilar, A.; Rodríguez-Novo, N.; Bjerkeset, O.; De las Cuevas, C. Psychometric Properties of the WHO-5 Well-Being Index among Nurses during the COVID-19 Pandemic: A Cross-Sectional Study in Three Countries. Int. J. Environ. Res. Public Health 2022, 19, 10106. https://doi.org/10.3390/ijerph191610106

AMA Style

Lara-Cabrera ML, Betancort M, Muñoz-Rubilar A, Rodríguez-Novo N, Bjerkeset O, De las Cuevas C. Psychometric Properties of the WHO-5 Well-Being Index among Nurses during the COVID-19 Pandemic: A Cross-Sectional Study in Three Countries. International Journal of Environmental Research and Public Health. 2022; 19(16):10106. https://doi.org/10.3390/ijerph191610106

Chicago/Turabian Style

Lara-Cabrera, Mariela Loreto, Moisés Betancort, Amparo Muñoz-Rubilar, Natalia Rodríguez-Novo, Ottar Bjerkeset, and Carlos De las Cuevas. 2022. "Psychometric Properties of the WHO-5 Well-Being Index among Nurses during the COVID-19 Pandemic: A Cross-Sectional Study in Three Countries" International Journal of Environmental Research and Public Health 19, no. 16: 10106. https://doi.org/10.3390/ijerph191610106

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop