Next Article in Journal
Successful Aging among Immigrant and Canadian-Born Older Adults: Findings from the Canadian Longitudinal Study on Aging (CLSA)
Next Article in Special Issue
Musculoskeletal Pain in Undergraduate Students Is Significantly Associated with Psychological Distress and Poor Sleep Quality
Previous Article in Journal
Burden of Disease Due to Ambient Particulate Matter in Germany—Explaining the Differences in the Available Estimates
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Validation of the Brief Perceived Positive Lockdown Impact Scale PPLIS-4

by
Aleksandra M. Rogowska
1,
Dominika Ochnik
2,
Karolina Chilicka
3,*,
Iuliia Pavlova
4 and
Cezary Kuśnierz
5
1
Institute of Psychology, University of Opole, 45-052 Opole, Poland
2
Faculty of Medicine, University of Technology, 40-555 Katowice, Poland
3
Department of Health Sciences, University of Opole, 45-040 Opole, Poland
4
Department of Theory and Methods of Physical Culture, Lviv State University of Physical Culture, 79007 Lviv, Ukraine
5
Faculty of Physical Education and Physiotherapy, Opole University of Technology, 45-758 Opole, Poland
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(20), 13198; https://doi.org/10.3390/ijerph192013198
Submission received: 24 August 2022 / Revised: 11 October 2022 / Accepted: 12 October 2022 / Published: 13 October 2022
(This article belongs to the Special Issue Mental Health and Well-Being during Emerging Adulthood)

Abstract

:
Background: Although research showed that positive aspects of the lockdown were perceived during the pandemic, there are no tools to test the positive impact of mandatory social isolation on life. The present study aims to validate a newly developed, brief, four-item perceived positive lockdown impact scale (PPLIS-4). Methods: A cross-sectional online survey study was formed among 4370 adults in three samples: Sample 1 consisted of university students from Poland and Ukraine, Sample 2 consisted of Polish university students under 26 (emerging adults), and Sample 3 consisted of Polish and Ukrainian adults above 25 (non-emerging adults). The standardized questionnaire was used for criterion validity to measure life satisfaction (SWLS), perceived stress (PSS-10), anxiety (GAD-7), and depression (PHQ-9). Results: The exploratory factor analysis (EFA) showed a one-factor solution in Sample 1 in Polish and Ukrainian university students. The confirmatory factor analysis (CFA) and confirmatory composite analysis (CCA) showed the one-factor structure appropriate for the PPLIS-4 among emerging and non-emerging adults. Criterion validity was also confirmed since the PPLIS-4 was positively related to the SWLS and negatively related to stress, anxiety, and depression. Conclusions: The PPLIS-4 is a short but valid questionnaire to assess the positive aspects of lockdown. The PPLIS-4 can be used during the COVID-19 pandemic to measure some positive effects of changes in lifestyle as an aspect of resilience.

1. Introduction

The COVID-19 pandemic impacted the mental health and well-being of populations worldwide [1,2]. Studies showed that stress, anxiety, and depression increased significantly during the subsequent pandemic waves [3,4,5,6]. Gender differences were shown during the pandemic, with women experiencing higher levels of stress, anxiety, and depression than men [7,8,9,10,11]. Additionally, young adults [12,13,14,15,16], particularly university students, were found to be the most vulnerable population [7,8,9,17,18,19]. Indeed, emerging adulthood is a challenging period related to self-focus, the feeling of being between adolescence and adulthood, optimistic thinking about the future, the exploration of identity, and instability within social roles [20]. Research showed that mental health and life satisfaction significantly declined among emerging adults during the COVID-19 pandemic due to limited peer contact, worsening financial situations, and returning to the parental home from dormitories [21]. However, other research showed no changes in mental health among emerging adults [22], or even better mental health and well-being during the first lockdown compared to the pre-pandemic period [23]. Therefore, more research is required to explain these inconsistencies among emerging adults during the pandemic.
The adverse consequences of the COVID-19 pandemic were not the only ones demonstrated. Resilience was also noted since restriction-related changes in lifestyle, and various difficulties became challenges for some people to survive and improve their quality of life [24,25]. Adaptation to changing life patterns forced new habits to promote healthy behavior, such as maintaining personal hygiene, increasing physical activity, eating a healthy diet, or consuming less alcohol or substances [26,27,28,29,30,31]. Spending more time with family and friends during the lockdown, improving parenthood and relationship quality, and increasing donations and solidarity positively impacted human life during the pandemic [26,28,29,30,32,33]. Business growth and innovations were observed in many sectors, particularly in handicraft and domestic production, as well as areas related to online business, informatics, new digital technologies, and online software, like Zoom, video games, services for distance learning and working, and telemedicine [26,32]. Many people reported increased activity in realizing interests and hobbies (creativity, music, art, reading books, watching films), learning new skills, and exploring new technology during social isolation [27,29,32]. However, Sudo [34] showed that disparities in economic status contributed to lifestyle changes, increasing the positive effects of the pandemic among socially advantaged people, but decreasing well-being in socially disadvantaged individuals.
Although the previous research showed that some people found some positive aspects of the COVID-19 pandemic, little is known about whether those individuals showed better mental health and well-being than persons who did not perceive any positive impact of the pandemic on their life. The lack of such research is related to the lack of measurement methods for assessing the perceived positive impact of the pandemic on human life. Previously mentioned studies [26,27,28,29,30,31,32,33,34] used self-developed single questions, which were never validated. The present study demonstrates the validation of a newly developed short measure to assess the perceived positive lockdown impact on life during the COVID-19 pandemic. Since young people are the group most vulnerable to mental health issues, the study will be validated with the newly developed scale in the sample of emerging adults in comparison to older adults. Furthermore, country and gender differences will be examined to verify the structure of the scale in a cross-cultural context. The criterion validity will be tested on dimensions of well-being. We expect higher scores on the perceived positive impact of lockdown will be related to higher life satisfaction and lower stress, anxiety, and depression levels.

2. Materials and Methods

2.1. Study Design and Procedure

Three cross-sectional online survey studies were performed in Poland and Ukraine during the COVID-19 pandemic. Three samples were recruited at different times.

2.1.1. Sample 1

The study in Sample 1 was performed in November 2020 during the second pandemic wave and included Polish and Ukrainian university students. The inclusion criteria consisted of being a university student and being above 18 years old. Individuals from Poland were recruited from the Opole University of Technology and the University of Opole between 3 and 27 November 2020. Ukrainian participants were recruited from the Lviv State University of Physical Culture, Lviv Polytechnic National University, and Ternopil Volodymyr Hnatiuk National Pedagogical University between 2 and 26 November. In both countries, classes were performed at universities remotely online, using e-learning services (like Moodle or Teams). The restriction levels during the data collected were assessed using the Stringency Index (SI, ranging from 0 to 100), indicating SI = 75.19 for Poland and SI = 60.35 for Ukraine [35]. Online learning was performed in November 2020, so university teachers encouraged students to participate in the study during their online classes. Students were invited to share the link to the survey using the Moodle and Teams online educational platforms. Participants were also invited to the study via university students’ groups on Facebook, Viber, and Telegram. The studies were anonymous and voluntary. Participants’ personal data was not obtained, and no compensation was offered as an incentive to participate. The minimal sample size for factor analysis is 100 people. However, 300 is considered a good size, 500 is very good, and 1000 or more is excellent [36]. Among Ukrainian students, 1713 responded to the invitation, but 64 refused, so the final sample consisted of 1649 individuals. Among Polish university students, 1699 responded to the invitation, but 118 did not agree, so the final sample included 1581 individuals. The total of Sample 1 consisted of 3230 university students from both countries.

2.1.2. Sample 2

Study Sample 2 was recruited between 14 April and 16 June 2021 among university students from the Opole University of Technology (Poland) during the third wave of the COVID-19 pandemic. At that time, classes were performed online at the university, and the restriction level was SI = 63.57 [35]. The inclusion criteria consisted of being a university student and being between the ages of 18 and 25 (as a criterion of an emerging adult). Similar to the previous study, e-learning was conducted during the third wave of the COVID-19 pandemic; therefore, the invitation to the survey was disseminated during online classes and via social media in the same way as in the previous study. Initially, 482 people responded to the invitation, but nine refused, and 25 did not meet the age criteria, so the final sample included 448 emerging adults.

2.1.3. Sample 3

Study Sample 3 was recruited during the second wave of the COVID-19 pandemic among adults from Poland (from 19 November 2020 to 15 January 2021) and Ukraine (from 14 December 2020 to 17 February 2021). The restriction level (SI) was 75.19 and 57.54 in Poland and Ukraine, respectively [35]. The exclusion criterion was being under the age of 26 (representing emerging adults). The online survey was disseminated using the snowball technique among friends, family members, and private groups on Facebook. Additionally, the authors of the study shared links to an online survey form via personal and institutional emailing lists, primarily among colleagues, namely administrative and academic staff at the Opole University of Technology, the University of Opole, the University of Technology in Katowice from Poland, and the Lviv State University of Physical Culture from Ukraine. Among the 743 people who answered the invitation, seven refused the study, while 84 were excluded because they did not meet the criteria (i.e., they were aged below 26). Therefore, 652 non-emerging adults were included in the final sample.

2.2. Measurement

The online survey was prepared using Google Forms and consisted of several parts, like (1) information about the study and informed consent; (2) demographic information; (3) a newly developed scale of perceived positive lockdown consequences; (4) standardized questionnaires to measure life satisfaction, perceived stress, anxiety, and depression. The survey was developed in Polish and English, and then translated into Ukrainian and back-translated due to the guideline for translation and cross-cultural adaptation [37,38]. No missing data were reported in Sample 1, Sample 2, and Sample 3, as all responses were mandatory in the Google form.

2.2.1. Perceived Positive Lockdown Impact

Ochnik et al. [39] developed the Perceived Positive Lockdown Impact Scale (PPLIS) to assess the positive aspects of compulsory social isolation during the COVID-19 pandemic-related lockdown. The question on the scale was, “I think that the situation associated with the coronavirus pandemic (COVID-19) has positively affected my life through…” Participants rated on a 7-item Likert scale (from 1 = Strongly disagree to 7 = Strongly agree) the extent to which the current situation associated with the Coronavirus pandemic may positively affect their lives in the following four aspects: (1) spending more quality time with family; (2) spending more quality time with friends; (3) spending more time relaxing and on entertainment; (4) spending more time on personal development and interests (hobby). The PPLIS is presented in Appendix A, Table A1 (in English), Table A2 (in Polish), and Table A3 (in Ukrainian). The higher the PPLIS scores, the more positive consequences were perceived during the pandemic. The psychometric properties and validation of the PPLIS are presented in the following parts of the article.

2.2.2. Satisfaction with Life

The Satisfaction with Life Scale (SWLS) was developed by Diener et al. [40] to measure global cognitive judgments concerning how much a person is satisfied with their life. The scale includes five items and a seven-point Likert scale (from 1 = Strongly disagree to 7 = Strongly agree). Total scores range from 5 to 35. Higher scores indicate a higher level of life satisfaction. The internal consistency (Cronbach’s α) of the SWLS was high and ranged from 0.79 to 0.89 in various studies [41]. In the current study, Cronbach’s α was 0.83 in Sample 1.

2.2.3. Perceived Stress

The Perceived Stress Scale (PSS-10) was developed for a global assessment of psychological stress [42]. The questionnaire consisted of ten items. Respondents indicated how often they experienced a given behavior in the month preceding the test, using a 5-point Likert scale (ranging from 0 = Never to 4 = Very often). Higher scores mean a higher level of perceived stress. The internal consistency of the PSS-10, assessed by Cronbach’s α, was 0.78 in the previous study [43], and currently, in Sample 1, Cronbach’s α = 0.86.

2.2.4. Anxiety

The 7-item Generalized Anxiety Disorder (GAD-7) scale was developed to assess anxiety risk, considered as a state, in the general population, consistent with the Diagnostic and Statistical Manual of Mental Disorders, fifth edition (DSM-V) criteria [44]. Participants self-rated how often they experienced anxiety symptoms in the two weeks preceding the test using a 4-point Likert scale (0 = Not at all, 1 = Several days, 2 = More than half the days, and 3 = Nearly every day). Scores above 10 points indicate an anxiety disorder risk. The Cronbach’s α for the GAD-7 in the original study was 0.92 [44], and 0.92 in Sample 1.

2.2.5. Depression

Depression symptoms were assessed using the Patient Health Questionnaire (PHQ-9) developed by Kroenke et al. [45] to screen for depression symptoms according to DSM-V diagnostic criteria. Participants used a Likert-type response scale (ranging from 0 = Not at all to 3 = Nearly every day). A cutoff score of 11 or above is recommended for screening a major depressive disorder risk. The internal consistency reliability of the original version measured by Cronbach’s α equals 0.86 [46]. The Cronbach’s α = 0.89 was found in this study for Sample 1.

2.3. Participants

Sample 1 consisted of 3230 university students, aged between 18 and 59 (M = 21.40, SD = 3.46), including 1581 individuals from Poland (48.95%) and 1649 from Ukraine (51.05%). In the sample, 1912 (59.20%) were women, and 1318 (40.80%) were men. Participants represented various faculties of technical and humanistic university types, including economy and political sciences (e.g., social communication, human resources and management, economy, politics, and law), engineering (automatics, mechanical engineering, electrical engineering, logistic, architecture and construction, energy, and transport technologies), health sciences (nursing, cosmetology, emergency, physiotherapy, physical education, and tourism and recreation), humanities (e.g., languages, fine arts, archeology, culture, and history), information technologies (e.g., computer sciences and informatics), social sciences (e.g., sociology, psychology, and pedagogy), and science (e.g., chemistry, biology, geography, math, and physics). Individuals studied at bachelor (82.90%), master (16.94%), and postgraduate or doctoral (0.16%) levels, representing the first (34.24%), second (31.05%), third (19.98%), fourth (12.20%), and fifth (3.53%) year of study. Participants studied full-time (91.77%) and part-time (8.23%).
Sample 2 included 448 emerging adults, aged between 19 and 25 (M = 21.53, SD = 1.51), including 237 women (52.90%) and 211 men (47.10%). Participants represented all faculties of the Opole University of Technology, including civil engineering and architecture (12.72%), economics and management (22.54%), electrical engineering, automatic control and informatics (19.20%), production engineering and logistics (3.79%), mechanical (4.91%), and physical education and physiotherapy (36.83%). Participants studied at bachelor’s (69.20%), master’s (14.73%), and postgraduate or doctoral (16.07%) levels, and they represented first the (34.38%), second (34.38%), third (23.88%), fourth (5.58%), and fifth (1.79%) year of study. The sample included full-time (92.86%) students and part-time (7.14%) studies.
Sample 3 consisted of 652 adults ranging in age between 26 and 72 (M = 41.56, SD = 9.50) from Poland (n = 332, 50.90%) and Ukraine (n = 320, 49.10%). In the sample, 450 (69.00%) were women, 123 (18.90%) were single, and 490 (75.20%) had children. Mean work experience (seniority) was 17 years (ranging from 0 to 53 years, M = 17.28, SD = 9.68). Participants worked in various job sectors, including higher education (n = 372, 57.06%), administration (n = 101, 15.49%), primary and high school education (n = 41, 6.29%), services (n = 27, 4.14%), healthcare (n = 24, 3.68%), uniformed service (n = 19, 2.91%), production (n = 13, 1.99%), and management (n = 12, 2.15%), trade (n = 9, 1.38%), library (n = 8, 1.23%), logistics (n = 8, 1.23%), and engineering and mechanics (n = 3, 0.46%). Nine participants (1.38%) were unemployed, one was on maternity leave, and one retired.

2.4. Statistical Analysis

Descriptive statistics were calculated, including a range of scores, mean (M), standard deviation (SD), median (Mdn.), skewness, and kurtosis. Pearson’s correlations were calculated to examine associations between variables.
The structural validation was tested using exploratory factor analysis (EFA), with the principal components estimation method (without rotation). EFA was performed in Sample 1 twice: in Polish (n = 1581) and Ukrainian (n = 1649) groups of university students. We replicated the EFA to establish the factor structure of the PPLIS across countries. The correlation matrix between the items of the PPLIS, the Kaiser–Meyer–Olkin (KMO), and Bartlett’s test of sphericity were initially performed to explore the data’s properties. Subsequently, the CFA with maximum likelihood (ML) estimation method was conducted in Sample 2 of Polish university students under 26 as an emerging adults group (n = 448) and replicated in Sample 3 of adults above 25 years old as a non-emerging adults group (n = 652). All structural models were evaluated using several goodness-of-fit criteria, including ML χ2, df and p-value, standardized root mean squared residual (SRMR ≤ 0.08 is acceptable), root mean square error of approximation (RMSEA; acceptable fit if ≤0.08, adequate fit if <0.06, and good if <0.04), and comparative fit index (CFI is acceptable if ≥0.90, and good if >0.95) [47]. The measurement invariance (MI) was examined in a configural model using multigroup CFA (MGCFA) to check whether the factor structure varies across genders and countries. Chen [48] suggests a change of ≤−0.005 in CFI, supplemented by a change of ≥0.010 in RMSEA, as an indicator of non-invariance when the compared sample sizes are unequal. We also used composite reliability (CR > 0.60 is adequate) and average variance extracted (AVE > 0.50 is adequate, but AVE > 0.40 is still acceptable if CR > 0.60) statistics for confirmatory composite analysis (CCA) assessment [47,49].
Pearson’s correlation and multiple linear regression analysis (with life satisfaction as a dependent variable) were performed for associations between PPLIS, life satisfaction, stress, and depression to examine criterion validity. Additionally, an independent samples t-test was conducted to examine intergroup differences between emerging and non-emerging adults in PPLIS, life satisfaction, stress, and depression.
Descriptive statistics were performed using JASP ver. 0.16.1.0. for Windows. All structural analyses were conducted using IBM SPSS ver. 26 and AMOS ver. 26 software for Windows. Confirmatory composite analysis (CCA) was assessed using the AMOS ver. 26 plugin Master Validity Tool created by Gaskin et al. [50].

3. Results

3.1. Exploratory Factor Analysis

Initially, the parametric properties were examined (Table 1) in Sample 1 (N = 3230). All items showed good parametric properties, including that skewness and kurtosis ranged between ±1, and all correlations were significant on p < 0.001, with values above r = 0.30.
The EFA with principal components extraction method was performed for Sample 1 of university students, and separately for Polish (n = 1581) and Ukrainian (n = 1649) participants, to replicate results in different countries. In the first step, the Kaiser–Mayer–Olkin (KMO) measure of adequacy and Bartlett’s test of sphericity were conducted. The results showed an average value of KMO = 0.76 for Polish and Ukrainian students. Furthermore, an adequate Bartlett’s test was found for the Polish sample χ2(6) = 1874.98, p < 0.001, and the Ukrainian group χ2(6) = 1864.21, p < 0.001, indicating that a correlation between the items in the PPLIS-4 and factor analysis is plausible. According to the Kaiser Criterion (eigenvalue greater than 1) and Cattell’s scree plot, the one-factor solution was found for Polish and Ukrainian university students. The factor loadings were 0.69, 0.73, 0.85, and 0.83 in the Polish sample; and 0.74, 0.76, 0.81, and 0.81 in the Ukrainian group for items PPLIS1, PPLIS2, PPLIS3, and PPLIS4, respectively. The first component explained 60.89% of perceived positive lockdown consequences in Poland and 60.83% in Ukraine. The next components explained, respectively, 16.46%, 14.40%, and 8.25% in the Polish sample, and 16.08%, 13.70%, and 9.40% in the Ukrainian group of university students.

3.2. Confirmatory Factor and Composite Analyses

The CFA was conducted for Sample 2 of Polish emerging adults (university students under 26, N = 448) and Sample 3 (Polish and Ukrainian adults aged above 25 years old, N = 652) separately. As shown in Figure 1a, the loading weight ranged between 0.50 and 0.80. The fit indices were excellent for Sample 2, χ2(1) = 2.13, p = 0.144, SRMR = 0.010, CFI = 0.997, RMSEA = 0.050 (90%CI = 0.000, 0.147). Considering the confirmatory composite analysis (CCA), Cronbach’s α = 0.76, CR = 0.754, and AVE = 0.445, suggesting that the structure is acceptable [49]. The CFA loadings for Sample 3 ranged between 0.63 and 0.85, as presented in Figure 1b. The fit indices were excellent for Sample 3, χ2(2) = 0.83, p = 0.661, SRMR = 0.005, CFI = 1.000, RMSEA = 0.000 (90%CI = 0.000, 0.060). The CCA was also adequate for Sample 3, including Cronbach’s α = 0.82, CR = 0.828, and AVE = 0.55. Configural multigroup measurement invariance was examined across genders and countries. The baseline model was compared to the unconstrained model for genders in Sample 2. The unconstrained model showed a good fit, χ2(2) = 1.966, p = 0.374, SRMR = 0.016, CFI = 0.100, RMSEA = 0.000 (90%CI = 0.000, 0.093), showing that the structure of PPLIS is invariant across genders. The configural MI was examined in Sample 3. The results repeated previous findings, demonstrating that the one-factor structure is invariant across gender, χ2(4) = 2.509, p = 0.643, SRMR = 0.006, CFI = 0.100, RMSEA = 0.000 (90%CI = 0.000, 0.048). Similarly, Polish and Ukrainian university students do not differ in factor structure, χ2(4) = 3.498, p = 0.478, SRMR = 0.015, CFI = 0.100, RMSEA = 0.000 (90%CI = 0.000, 0.056).

3.3. Criterion Validity

Criterion validity was examined using correlation and regression analysis to assess associations between the PPLIS and such variables as life satisfaction, perceived stress, self-rated physical health, anxiety, and depression. The analysis was performed for Sample 1 (Figure 2). Convergent validity was confirmed since the perceived positive impact of lockdown was related positively to life satisfaction. Discriminant validity was also supported by the significant negative association between the perceived positive impact of lockdown and mental health issues, like perceived stress, anxiety, and depression.
Linear regression was conducted for life satisfaction as a dependent variable, and the PPLIS, perceived stress, anxiety, and depression, as predictors. All variables were significant predictors of life satisfaction, and the regression model explained 31% of life satisfaction variance, R = 0.56, R2 = 0.31, F(4, 3229) = 360.69, p < 0.001 (Table 2).
The Student’s t-test was performed to explore differences between emerging and non-emerging adults in the sample of university students (N = 3230). The analysis showed that emerging adults scored significantly higher (with medium effect size) than non-emerging adults in perceived positive lockdown impact on life (Table 3). No significant differences were found between samples in life satisfaction, stress, anxiety, and depression.

4. Discussion

This study aimed to validate the scale of the perceived positive impact of lockdown. Several statistical tests were performed. The one-factor structure of the PPLIS-4 was confirmed twice in Polish and Ukrainian samples of university students using the EFA. Similarly, the construct was further validated using CFA twice in both emerging adults and non-emerging adult samples. The parametric properties of particular items and composite scores were good, and the one-factor model showed an excellent fit in both samples. Furthermore, the multigroup measurement invariance was supported across countries and genders, evidencing that the scale can be used in various cross-cultural contexts. Replicating our statistical analyses, we demonstrated that the four-item brief PPLIS-4 is valid and can be used in further studies.
The assumption of associations between the perceived positive impact of lockdown on life and well-being dimensions was confirmed in this study. The positive association of PPLIS-4 was found with life satisfaction as a general cognitive dimension of well-being, relating to various areas of life. Additionally, a negative relationship was presented between PPLIS-4 and such mental health issues as perceived stress, anxiety, and depression. Moreover, a higher value was demonstrated for intercorrelation between PPLIS-4 and life satisfaction (r = 0.34) than between PPLIS-4 and mental health issues (r ranged from −0.24 to −0.26). Furthermore, the regression model showed that the perceived positive lockdown impact was a significant predictor of life satisfaction, even controlling for stress, anxiety, and depression. These results show that the perceived positive impact of lockdown is closer to well-being than mental health, confirming the convergent validation. However, longitudinal research is needed in the future to verify whether the perceived positive impact of lockdown is a predictor of well-being.
This study found significant differences between emerging and non-emerging adults in PPLIS-4, but not in life satisfaction, stress, anxiety, and depression. The results seem consistent with previous longitudinal findings, which showed that mental health problems did not increase during the pandemic among emerging adults from the Netherlands [22]. In the other study, Lithuanian and German emerging adults even presented a decrease in stress and anxiety symptoms, alongside an increase in positive mental health indices during the first wave of the COVID-19 pandemic compared to the pre-pandemic period [23]. More than 80% of emerging adults demonstrated positive changes indicating resilience. Although the differences were not examined between emerging and non-emerging adults in previous studies, the studies mentioned above seem to support the current results and Arnett’s [20] observations that emerging adults are more optimistic about the future than other populations, which may be a resilience factor preventing the deterioration of mental health and well-being during a crisis.
The strength of this study is that statistical analyses were conducted in a large sample size, replicating EFA and CFA results. Considering all three samples, the number of all participants in the study was 4370. However, the limitation of this study is that most of these individuals were emerging adults, so comparison with non-emerging adults should be treated with caution. The other limitation of this study is that the samples of emerging adults consisted exclusively of university students. More research is necessary for the future, with more balanced groups regarding emerging and non-emerging adults, and those studying and not. The present study compared only two countries: Poland and Ukraine. The PPLIS-4 should be validated in various countries to verify its pertinence. Additionally, we used life satisfaction and selected mental health symptoms to examine the criterion validity of the PPLIS-4. The other variables can be used in future studies to confirm convergent validation of the PPLIS-4, including various dimensions of well-being, optimism, hope, and resilience. Finally, the study was cross-sectional. Longitudinal research should be performed to examine the stability of the PPLIS-4 across various time points and to explore the predictive value of the perceived positive lockdown impact on life with individual differences in other positive and negative dimensions of mental health and well-being. This study is quantified and fails to explain the social and cultural reasons behind the perceived positive effects of the COVID-19 pandemic. Future research may use qualitative methods, such as interviews or case studies, to shed more light on this positive aspect of the COVID-19 pandemic.

5. Conclusions

The study showed that the PPLIS-4 is a valid instrument to measure the positive effects of the lockdown among emerging and non-emerging adults. The study showed good parametric properties of the scale and its invariance across countries and genders. Although more research is required to confirm the present results in cross-cultural studies, the tool can be used in the adult population during mandatory social isolation in the future. PPLIS-4 can be used to assess perceived positive life changes during the pandemic lockdown and can be modified in various therapeutic situations for people who are socially isolated due to chronic diseases or disabilities.

Author Contributions

Conceptualization: A.M.R. and D.O.; methodology: A.M.R.; software: A.M.R.; validation: A.M.R., D.O., K.C., I.P. and C.K.; formal analysis: A.M.R.; investigation: A.M.R., D.O., K.C., I.P. and C.K.; resources: A.M.R.; data curation: A.M.R., I.P. and C.K.; writing—original draft preparation: A.M.R.; writing—review and editing: A.M.R., D.O., K.C., I.P. and C.K.; visualization: A.M.R.; supervision: A.M.R., D.O., K.C., I.P. and C.K.; project administration: A.M.R., I.P. and D.O.; funding acquisition: A.M.R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the University Research Ethics Committee at the University of Opole (Decision No. 7, 29 October 2020) and by the Bioethics Committee of the Lviv State University of Physical Culture (Decision No. 6, 16 December 2020) for Sample 1; the Opole University of Technology (No. 1/2021, 19 April 2021) for Sample 2; and the University Research Ethics Committee at the Katowice Business University (Decision No. 4/2020, 8 December 2020) and by the Bioethics Committee of the Lviv State University of Physical Culture (Decision No. 6, 16 December 2020) for Sample 3.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The datasets used and analyzed during the current study are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. The Perceived Positive Lockdown Impact Scale (PPLIS-4).
Table A1. The Perceived Positive Lockdown Impact Scale (PPLIS-4).
I Think the Situation Related to
the COVID-19 Pandemic
Has Positively Affected My Life Through:
Completely Completely
Disagree Agree
1Spending more time with family1234567
2Spending more time with friends1234567
3Spending more time relaxing and on entertainment1234567
4Spending more time on personal development
and interests (hobbies)
1234567
Table A2. Skala Postrzeganego Pozytywnego Wpływu Kwarantanny (SPPWK-4).
Table A2. Skala Postrzeganego Pozytywnego Wpływu Kwarantanny (SPPWK-4).
Uważam, że sytuacja związana
z pandemią COVID-19,
pozytywnie wpłynęła na moje życie poprzez:
Zdecydowanie Zdecydowanie
się nie zgadzam się zgadzam
1Spędzanie więcej czasu z rodziną1234567
2Spędzanie więcej czasu z przyjaciółmi1234567
3Poświęcanie więcej czasu na odpoczynek
i rozrywkę
1234567
4Poświęcanie więcej czasu na rozwój osobisty
i zainteresowania (hobby)
1234567
Table A3. Шкала сприйняття позитивного впливу локдауну (ШСПВЛ-4).
Table A3. Шкала сприйняття позитивного впливу локдауну (ШСПВЛ-4).
Я вважаю, що ситуація, пов’язана
з пандемією COVID-19,
позитивно вплинула на моє життя, оскільки:
Повністю Повністю
не погоджуюся погоджуюся
1я проводжу більше часу з сім’єю1234567
2я проводжу більше часу з друзями1234567
3я витрачаю більше часу на відпочинок та розваги1234567
4я витрачаю більше часу на власний розвиток та зацікавлення (хобі)1234567

References

  1. Nochaiwong, S.; Ruengorn, C.; Thavorn, K.; Hutton, B.; Awiphan, R.; Phosuya, C.; Ruanta, Y.; Wongpakaran, N.; Wongpakaran, T. Global prevalence of mental health issues among the general population during the coronavirus disease-2019 pandemic: A systematic review and meta-analysis. Sci. Rep. 2021, 11, 10173. [Google Scholar] [CrossRef] [PubMed]
  2. Robinson, E.; Sutin, A.R.; Daly, M.; Jones, A. A systematic review and meta-analysis of longitudinal cohort studies comparing mental health before versus during the COVID-19 pandemic in 2020. J. Affect. Disord. 2021, 296, 567–576. [Google Scholar] [CrossRef] [PubMed]
  3. Aknin, L.; De Neve, J.E.; Dunn, E.; Fancourt, D.; Goldberg, E.; Helliwell, J.F.; Jones, S.P.; Karam, E.; Layard, R.; Lyubomirsky, S.; et al. Mental health during the first year of the COVID-19 pandemic: A review and recommendations for moving forward. Perspect. Psychol. Sci. 2022, 17, 915–936. [Google Scholar] [CrossRef] [PubMed]
  4. Bonsaksen, T.; Leung, J.; Schoultz, M.; Thygesen, H.; Price, D.; Ruffolo, M.; Geirdal, A.Ø. Cross-national study of worrying, loneliness, and mental health during the COVID-19 pandemic: A comparison between individuals with and without infection in the family. Healthcare 2021, 9, 903. [Google Scholar] [CrossRef] [PubMed]
  5. Daly, M.; Sutin, A.R.; Robinson, E. Longitudinal changes in mental health and the COVID-19 pandemic: Evidence from the UK Household Longitudinal Study. Psychol. Med. 2020, 1–10. [Google Scholar] [CrossRef]
  6. Gamonal-Limcaoco, S.; Montero-Mateos, E.; Lozano-López, M.T.; Maciá-Casas, A.; Matías-Fernández, J.; Roncero, C. Perceived stress in different countries at the beginning of the coronavirus pandemic. Int. J. Psychiatry Med. 2022, 57, 309–322. [Google Scholar] [CrossRef]
  7. Deng, J.; Zhou, F.; Hou, W.; Silver, Z.; Wong, C.Y.; Chang, O.; Drakos, A.; Zuo, Q.K.; Huang, E. The prevalence of depressive symptoms, anxiety symptoms and sleep disturbance in higher education students during the COVID-19 pandemic: A systematic review and meta-analysis. Psychiatry Res. 2021, 301, 113863. [Google Scholar] [CrossRef]
  8. Ochnik, D.; Rogowska, A.M.; Kuśnierz, C.; Jakubiak, M.; Schütz, A.; Held, M.J.; Arzenšek, A.; Benatov, J.; Berger, R.; Korchagina, E.V.; et al. Mental health prevalence and predictors among university students in nine countries during the COVID-19 pandemic: A cross-national study. Sci. Rep. 2021, 11, 18644. [Google Scholar] [CrossRef]
  9. Rogowska, A.M.; Ochnik, D.; Kuśnierz, C.; Chilicka, K.; Jakubiak, M.; Paradowska, M.; Głazowska, L.; Bojarski, D.; Fijołek, J.; Podolak, M.; et al. Changes in mental health during three waves of the COVID-19 pandemic: A repeated cross-sectional study among Polish university students. BMC Psychiatry 2021, 21, 627. [Google Scholar] [CrossRef]
  10. Rogowska, A.; Kuśnierz, C.; Bokszczanin, A. Examining anxiety, life satisfaction, general health, stress and coping styles during COVID-19 pandemic in Polish sample of university students. Psychol. Res. Behav. Manag. 2020, 13, 797–811. [Google Scholar] [CrossRef]
  11. Solomou, I.; Constantinidou, F. Prevalence and predictors of anxiety and depression symptoms during the COVID-19 pandemic and compliance with precautionary measures: Age and sex matter. Int. J. Environ. Res. Public Health 2020, 17, 4924. [Google Scholar] [CrossRef] [PubMed]
  12. Huang, Y.; Zhao, N. Mental health burden for the public affected by the COVID-19 outbreak in China: Who will be the high-risk group? Psychol. Health Med. 2021, 26, 23–34. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Liang, L.; Ren, H.; Cao, R.; Hu, Y.; Qin, Z.; Li, C.; Mei, S. The effect of COVID-19 on youth mental health. Psychiatr. Q. 2020, 91, 841–852. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Pierce, M.; Hope, H.; Ford, T.; Hatch, S.; Hotopf, M.; John, A.; Kontopantelis, E.; Webb, R.; Wessely, S.; McManus, S.; et al. Mental health before and during the COVID-19 pandemic: A longitudinal probability sample survey of the UK population. Lancet Psychiatry 2020, 7, 883–892. [Google Scholar] [CrossRef]
  15. Rodríguez-Rey, R.; Garrido-Hernansaiz, H.; Collado, S. Psychological impact and associated factors during the initial stage of the coronavirus (COVID-19) pandemic among the general population in Spain. Front. Psychol. 2020, 11, 1540. [Google Scholar] [CrossRef]
  16. Niedzwiedz, C.L.; Green, M.J.; Benzeval, M.; Campbell, D.; Craig, P.; Demou, E.; Leyland, A.; Pearce, A.; Thomson, R.; Whitley, E.; et al. Mental health and health behaviours before and during the initial phase of the COVID-19 lockdown: Longitudinal analyses of the UK Household Longitudinal Study. J. Epidemiol. Commun. Health 2020, 75, 224–231. [Google Scholar] [CrossRef] [PubMed]
  17. Aristovnik, A.; Keržič, D.; Ravšelj, D.; Tomaževič, N.; Umek, L. Impacts of the COVID-19 pandemic on life of higher education students: A global perspective. Sustainability 2020, 12, 8438. [Google Scholar] [CrossRef]
  18. Fruehwirth, J.C.; Biswas, S.; Perreira, K.M. The COVID-19 pandemic and mental health of first-year college students: Examining the effect of COVID-19 stressors using longitudinal data. PLoS ONE 2021, 16, e0247999. [Google Scholar] [CrossRef]
  19. Son, C.; Hegde, S.; Smith, A.; Wang, X.; Sasangohar, F. Effects of COVID-19 on college students’ mental health in the United States: Interview survey study. J. Med. Internet Res. 2020, 22, e21279. [Google Scholar] [CrossRef] [PubMed]
  20. Arnett, J.J. Emerging Adulthood: The Winding Road from the Late Teens Though the Twenties, 2nd ed.; Oxford University Press: Oxford, UK, 2014. [Google Scholar]
  21. Preetz, R.; Filser, A.; Brömmelhaus, A.; Baalmann, T.; Feldhaus, M. Longitudinal Changes in Life Satisfaction and Mental Health in Emerging Adulthood during the COVID-19 Pandemic. Risk and Protective Factors. Emerg. Adulthood 2021, 9, 602–617. [Google Scholar] [CrossRef]
  22. Van den Berg, Y.H.M.; Burk, W.J.; Cillessen, A.H.N.; Roelofs, K. Emerging Adults’ Mental Health During the COVID-19 Pandemic: A Prospective Longitudinal Study on the Importance of Social Support. Emerg. Adulthood 2021, 9, 618–630. [Google Scholar] [CrossRef] [PubMed]
  23. Truskauskaite-Kuneviciene, I.; Brailovskaia, J.; Margraf, J.; Kazlauskas, E. Evidence on Resilient Initial Response to COVID-19 Pandemic among Youth: Findings from the Prospective Study of Mental Health in Two European Countries. Emerg. Adulthood 2021, 9, 566–575. [Google Scholar] [CrossRef]
  24. Beckstein, A.; Chollier, M.; Kaur, S.; Ghimire, A.R. Mental Wellbeing and Boosting Resilience to Mitigate the Adverse Consequences of the COVID-19 Pandemic: A Critical Narrative Review. SAGE Open 2022, 12. [Google Scholar] [CrossRef]
  25. Seaborn, K.; Chignell, M.; Gwizdka, J. Psychological resilience during COVID-19: A meta-review protocol. BMJ Open 2021, 11, e051417. [Google Scholar] [CrossRef] [PubMed]
  26. Amirudin, A.; Syamsul, M.; Marnani, C.S.; Rahmah, N.A. Positive impacts among the negative impacts of the COVID-19 pandemic for community life. E3S Web Conf. 2021, 331, 01008. [Google Scholar] [CrossRef]
  27. Ceylan, M. Are the effects of pandemics on our life always bad? Positive effects of COVID-19 on our life. Educ. Res. Rev. 2021, 16, 382–388. [Google Scholar] [CrossRef]
  28. Hamrouni, A.M.; Sharif, R.S.; Sharif, S.I.; Hassanein, M.M.; Abduelkarem, A.R. Impacts of COVID-19 Pandemic on Geopolitics, Health, Economics, Education and Sociocultural Events. Risk Manag. Health Policy 2022, 15, 935–943. [Google Scholar] [CrossRef]
  29. Kamdi, P.S.; Deogade, M.S. The hidden positive effects of COVID-19 pandemic. Int. J. Res. Pharm. Sci. 2020, 11, 276–279. [Google Scholar] [CrossRef]
  30. Lenka, R. COVID-19—A blessing in disguise for humanity. Psychol. Educ. 2020, 57, 1222–1230. [Google Scholar] [CrossRef]
  31. Samji, H.; Dove, N.; Ames, M.; Barbic, S.; Sones, M.; Leadbeater, B. Impacts of the COVID-19 Pandemic on the Health and Well-Being of Young Adults in British Columbia. Report of British Columbia Centre for Disease Control (July 2021). Available online: http://www.bccdc.ca/health-professionals/data-reports/covid-19-young-adults (accessed on 17 August 2022).
  32. Karunathilake, K. Positive and negative impacts of COVID-19, an analysis with special reference to challenges on the supply chain in South Asian countries. J. Soc. Econ. Dev. 2021, 23, 568–581. [Google Scholar] [CrossRef]
  33. Walsh, A.R.; Stephenson, R. Positive and negative impacts of the COVID-19 pandemic on relationship satisfaction in male couples. Am. J. Men’s Health 2021, 15. [Google Scholar] [CrossRef] [PubMed]
  34. Sudo, N. The positive and negative effects of the COVID-19 pandemic on subjective well-being and changes in social inequality: Evidence from prefectures in Japan. SSM-Popul. Health 2022, 17, 101029. [Google Scholar] [CrossRef] [PubMed]
  35. Hale, T.; Angrist, N.; Goldszmidt, R.; Kira, B.; Petherick, A.; Phillips, T.; Webster, S.; Cameron-Blake, E.; Hallas, L.; Majumdar, S.; et al. A global panel database of pandemic policies (Oxford COVID-19 Government Response Tracker). Nat. Hum. Behav. 2021, 5, 529–538. [Google Scholar] [CrossRef]
  36. Comrey, A.; Lee, H. A First Course in Factor Analysis; Erlbaum: New York, NY, USA; Hillsdale, MI, USA, 1992. [Google Scholar]
  37. Wild, D.; Grove, A.; Martin, M.; Eremenco, S.; McElroy, S.; Verjee-Lorenz, A.; ISPOR Task Force for Translation and Cultural Adaptation. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: Report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health 2005, 8, 94–104. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Wild, D.; Eremenco, S.; Mear, I.; Martin, M.; Houchin, C.; Gawlicki, M.; Hareendran, A.; Wiklund, I.; Chong, L.Y.; von Maltzahn, R.; et al. Multinational trials—Recommendations on the translations required, approaches to using the same language in different countries, and the approaches to support pooling the data: The patient-reported outcomes translation and linguistic validation good research practices task force report. Value Health 2009, 12, 430–440. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  39. Ochnik, D.; Rogowska, A.M.; Kuśnierz, C.; Jakubiak, M.; Pavlova, I.; Arzenšek, A.; Blažková, I.; Korchagina, E.; Schütz, A.; Aslan, I.; et al. Mental Health of Undergraduates during the COVID-19 Pandemic. OSF Registered Project, 4 October 2020. Available online: https://osf.io/wfsqb/ (accessed on 17 August 2022).
  40. Diener, E.; Emmons, R.A.; Larsen, R.J.; Griffin, S. The Satisfaction With Life Scale. J. Pers. Assess. 1985, 49, 71–75. [Google Scholar] [CrossRef] [PubMed]
  41. López-Ortega, M.; Torres-Castro, S.; Rosas-Carrasco, O. Psychometric properties of the Satisfaction with Life Scale (SWLS): Secondary analysis of the Mexican Health and Aging Study. Health Qual. Life Outcomes 2016, 14, 170. [Google Scholar] [CrossRef] [Green Version]
  42. Cohen, S.; Kamarck, T.; Mermelstein, R. A global measure of perceived stress. J. Health Soc. Behav. 1983, 24, 385–396. [Google Scholar] [CrossRef]
  43. Cohen, S.; Williamson, G. Perceived Stress in a Probability Sample of the United States. In The Social Psychology of Health: Claremont. Symposium on Applied Social Psychology; Spacapan, S., Oskamp, S., Eds.; Sage: Newbury Park, ON, Canada, 1988; pp. 31–67. [Google Scholar]
  44. Spitzer, R.L.; Kroenke, K.; Williams, J.B.; Löwe, B. A brief measure for assessing generalized anxiety disorder: The GAD-7. Arch. Intern. Med. 2006, 166, 1092–1097. [Google Scholar] [CrossRef] [Green Version]
  45. Kroenke, K.; Spitzer, R.L.; Williams, J.B. The PHQ-9: Validity of a brief depression severity measure. J. Gen. Intern. Med. 2001, 16, 606–613. [Google Scholar] [CrossRef]
  46. Carroll, H.A.; Hook, K.; Perez, O.F.R.; Denckla, C.; Vince, C.C.; Ghebrehiwet, S.; Ando, K.; Touma, M.; Borba, C.P.C.; Fricchione, G.L.; et al. Establishing reliability and validity for mental health screening instruments in resource-constrained settings: Systematic review of the PHQ-9 and key recommendations. Psychiatry Res. 2020, 291, 113236. [Google Scholar] [CrossRef] [PubMed]
  47. Hu, L.T.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. 1999, 6, 1–55. [Google Scholar] [CrossRef]
  48. Chen, F.F. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct. Equ. Model. 2007, 14, 464–504. [Google Scholar] [CrossRef]
  49. Fornell, C.; Larcker, D. Evaluating structural equation models with unobservable variables and measurement error. J. Market. Res. 1981, 18, 39–50. [Google Scholar] [CrossRef]
  50. Gaskin, J.; James, M.; Lim, J. Master Validity Tool. AMOS Plugin. 2019. Available online: http://statwiki.gaskination.com/index.php?title=Main_Page (accessed on 17 August 2022).
Figure 1. Results of Confirmatory Factor Analysis for (a) Sample 2 and (b) Sample 3. PPLIS = Perceived Positive Lockdown Impact Scale. Numbers by arrows represent standardized loading weights (β); e1–e4 = error variance.
Figure 1. Results of Confirmatory Factor Analysis for (a) Sample 2 and (b) Sample 3. PPLIS = Perceived Positive Lockdown Impact Scale. Numbers by arrows represent standardized loading weights (β); e1–e4 = error variance.
Ijerph 19 13198 g001
Figure 2. Pearson’s correlations between the perceived positive lockdown impact scale (PPLIS) and well-being dimensions: life satisfaction, perceived stress, anxiety, and depression. N = 3230, *** p < 0.001. Violet represents a positive correlation and red a negative correlation.
Figure 2. Pearson’s correlations between the perceived positive lockdown impact scale (PPLIS) and well-being dimensions: life satisfaction, perceived stress, anxiety, and depression. N = 3230, *** p < 0.001. Violet represents a positive correlation and red a negative correlation.
Ijerph 19 13198 g002
Table 1. Descriptive statistics for perceived positive lockdown consequences scale (PPLIS) in Sample 1 (N = 3230).
Table 1. Descriptive statistics for perceived positive lockdown consequences scale (PPLIS) in Sample 1 (N = 3230).
ItemsRangeMSDSkew.Kurt.Pearson’s Correlations
PPLIS1PPLIS2PPLIS3PPLIS4
PPLIS11–74.421.89−0.29−0.94
PPLIS21–73.231.930.50−0.890.44 ***
(0.41, 0.47)
PPLIS31–73.881.930.06−1.100.44 ***
(0.41, 0.47)
0.48 ***
(0.46, 0.51)
PPLIS41–74.091.96−0.06−1.150.46 ***
(0.43, 0.48)
0.49 ***
(0.46, 0.52)
0.64 ***
(0.62, 0.66)
PPLIS
Total score
4–2815.626.070.04−0.660.74 ***
(0.72, 0.75)
0.77 ***
(0.75, 0.78)
0.82 ***
(0.80, 0.83)
0.83 ***
(0.81, 0.84)
Note. PPLCS = perceived positive lockdown consequences scale. *** p < 0.001.
Table 2. Multiple linear regression for life satisfaction (N = 3230).
Table 2. Multiple linear regression for life satisfaction (N = 3230).
VariableBSE Bβtp
Intercept25.300.40 62.83<0.001
Stress−0.300.02−0.37−17.57<0.001
Anxiety0.300.030.269.85<0.001
Depression−0.330.02−0.34−13.26<0.001
PPLIS0.220.020.2214.43<0.001
Note. PPLIS = Perceived Positive Lockdown Impact Scale.
Table 3. Student’s t-test for differences between emerging and non-emerging adults (N = 3230).
Table 3. Student’s t-test for differences between emerging and non-emerging adults (N = 3230).
VariableEmerging Adults
(n = 3042)
Non-Emerging Adults (n = 188)t(3228)pd
PPLIS15.786.0313.116.21−5.87<0.001−0.44
Life satisfaction21.746.0521.526.19−0.490.620−0.04
Stress20.497.4120.427.53−0.130.900< 0.01
Anxiety6.735.257.476.051.850.0600.14
Depression8.516.218.786.580.570.5700.04
Note. PPLIS = Perceived Positive Lockdown Impact Scale.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Rogowska, A.M.; Ochnik, D.; Chilicka, K.; Pavlova, I.; Kuśnierz, C. Validation of the Brief Perceived Positive Lockdown Impact Scale PPLIS-4. Int. J. Environ. Res. Public Health 2022, 19, 13198. https://doi.org/10.3390/ijerph192013198

AMA Style

Rogowska AM, Ochnik D, Chilicka K, Pavlova I, Kuśnierz C. Validation of the Brief Perceived Positive Lockdown Impact Scale PPLIS-4. International Journal of Environmental Research and Public Health. 2022; 19(20):13198. https://doi.org/10.3390/ijerph192013198

Chicago/Turabian Style

Rogowska, Aleksandra M., Dominika Ochnik, Karolina Chilicka, Iuliia Pavlova, and Cezary Kuśnierz. 2022. "Validation of the Brief Perceived Positive Lockdown Impact Scale PPLIS-4" International Journal of Environmental Research and Public Health 19, no. 20: 13198. https://doi.org/10.3390/ijerph192013198

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop