Next Article in Journal
How Advanced Practice Nurses Can Be Better Managed in Hospitals: A Multi-Case Study
Previous Article in Journal
Long-Term Glucose Forecasting for Open-Source Automated Insulin Delivery Systems: A Machine Learning Study with Real-World Variability Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Reliability and Validity of the Defeat Scale among Internal Migrant Workers in China: Decadence and Low Sense of Achievement

1
School of Public Health, Shanghai Jiao Tong University School of Medicine, Shanghai 200025, China
2
Shenzhen Longhua District Center for Disease Control and Prevention, Shenzhen 518109, China
3
JC School of Public Health and Primary Care, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong 999077, China
4
School of Public Health (Shenzhen), Sun Yat-Sen University, Shenzhen 528406, China
5
Kirby Institute, University of New South Wales, Sydney 4385, Australia
6
School of Media and Communication, Shenzhen University, Shenzhen 518061, China
7
Sanlin Community Health Service Center, No. 375, Sanlin Road, Shanghai 200124, China
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Healthcare 2023, 11(6), 781; https://doi.org/10.3390/healthcare11060781
Submission received: 23 December 2022 / Revised: 8 February 2023 / Accepted: 16 February 2023 / Published: 7 March 2023

Abstract

:
Introduction: Internal migrant workers have a great chance to experience defeat due to their low social status and economic situation. It has been reported that defeat might play a prospective role in predicting depression and anxiety; however, defeat is rarely explored among internal migrant workers due to the lack of appropriate measurement scales. The defeat scale (DS) can measure the feeling of defeat, social hierarchy reduction, and loss in social struggle. But its reliability and validity among internal migrant workers have not been reported. This study aimed to verify the content validity and structural validity of the DS among internal migrant workers in China and to explore its correlations with anxiety and depression. Methods: 1805 internal migrant workers (IMWs) were recruited by stratified multistage sampling from 16 factories in Shenzhen, China. The content validity index (CVI) was used to assess content validity. Cronbach’s coefficient alpha of each factor and the total scale were calculated to assess the reliability of DS. The scree test was used to determine the number of factors. Convergent validity and discriminant validity were estimated by calculating the average variance extracted and composite reliability. Logistic regression was performed to explore the effects of DS scores on anxiety and depression. Results: Mean score of DS among IMWs was 18.42 ± 9.40. There were 606 (33.6%) IMWs who were considered to have depression symptoms, and 524 (29.0%) IMWs were considered to have anxiety symptoms. A two-factor model was obtained and fitted well (CFI = 0.956, GFI = 0.932, IFI = 0.956, RMSEA = 0.068, SRMR = 0.052). Cronbach’s alpha reliability coefficient for the DS was 0.92. Logistic regression showed that DS scores were positively associated with anxiety and depression among IMWs. Conclusions: DS performed well among IMWs on content validity and structural validity, and it was suitable as a measurement instrument to assess defeat among this population. Defeat was positively associated with anxiety and depression and might play an important role in the mental health of IMWs.

1. Introduction

Since the 1980s, China has experienced rapid urbanization accompanied by massive migration from rural to urban areas. Internal migrant workers (IMWs) are registered in rural areas but work in big cities that are not part of the registered area [1]. Some of them go out to work only during the slack season, while some are permanently employed in cities [2]. In April 2021, data released by the National Bureau of Statistics showed that there were 285.6 million IMWs in China, accounting for 20% of the total population [3,4]. The living environment of IMWs in the city is not friendly, and the resulting various psychological problems attract much attention. However, few studies focus on their sense of defeat.
Defeat was included in the framework of social hierarchy theory [5]. It refers to the subjective feeling of defeat in a struggle and powerlessness, which is associated with the loss of social status and the failure of personal goals. Some studies reported that defeat was important in predicting the development of psychopathological syndromes, such as anxiety and depression [6]. Gilbert proposed three major categories of events that can trigger the sense of defeat: (1) failure to obtain or maintain access to social or material resources, (2) social slights or attacks from others, (3) “attacks” launched from within the individual, for example, in the form of excessive self-criticism, unfavorable social comparison processes, and unattainable goals [7]. IMWs might experience all these events and feel defeated in an unfriendly urban living environment.
IMWs are believed to be unfairly treated in urban life, characterized primarily by marginalization in multiple aspects of urban society, including housing, employment, education, health, and other services [8,9]. They are also deprived of some social welfare because of China’s household registration system [10]. These can be considered the first type of events that can induce a sense of defeat.
Some studies found that IMWs were more likely to experience discrimination, stigmatization, and spatial exclusion in their host cities [11,12,13]. Becker’s taste-based model of discrimination posits that discrimination is fundamentally an irrational prejudice that is indulged by employers [14]. It is quite possible that some urban employers consider IMWs to be inferior and refuse to believe that it is possible for IMWs to have the same productive characteristics as the majority of the urban population. IMWs live in cities with their rural lifestyles, behaviors, and dialects, but these are considered rude and uncivilized. In addition, the majority of IMWs have low levels of education and less urban working experience, which makes them receive less reward for the same work compared with their urban colleagues [15]. This can be considered the second type of event that can induce a sense of defeat.
According to previous studies, IMWs often work in dirty, dangerous, demanding, long-term and low-paying jobs in cities that other local citizens do not want to do [16,17,18,19,20], and they often live in crowded, chaotic, and unhealthy communities [21]. Such work and life environments might lead them to consider themselves losers. In addition, they may also blame themselves for their children’s inability to successfully receive education in big cities [22]. Another point worth noting is that IMWs work in cities for long periods of time, and the guilt of not being able to take care of their families adds to their frustration and stress [23]. This can be considered the third type of event that can induce a sense of defeat.
There is a great chance that IMWs might feel defeated due to the trigger events. It is necessary to pay attention to their sense of defeat. However, defeat is rarely explored among IMWs. One of the possible reasons could be the lack of suitable measurement scales. The defeat scale (DS) can measure the feeling of failure, social hierarchy reduction, and loss in social struggle [5]. It has been reported to be effective in multiple populations, such as students, prison inmates, and depressed people in the UK, Internet users in Germany, and university students in Turkey [5,24,25]. But it has not been validated in IMWs. Therefore, the purpose of this study is to apply the DS to IMWs and to report results on the reliability and validity tests. In addition, we will explore its correlations with anxiety and depression.

2. Methods

2.1. Sample Size

This study was designed to test the reliability and validity of the DS in IMWs. The sample size required in scale method studies is at least 10 times the number of scale items [26,27]. For this study, the DS was composed of 16 items, thus requiring a minimum sample size of 160 participants. This study recruited a sample of 1805 migrant workers, which was considered adequate for the purposes of this study.

2.2. Sampling

The city of Shenzhen boasts a resident population of 17.68 million, making it the largest internal migrant city in China. This large population of internal migrants is predominantly comprised of workers employed in factories, making Shenzhen a suitable location for sampling in studies related to this demographic. According to the report of Shenzhen Statistical Yearbook, 9.2%, 48.4%, 3.7%, 0.8%, 0.6%, 4.3%, and 0.4% of the industrial manufacturing workers in Longhua District engaged in the machinery processing industry, electronic device manufacturing industry, printing and dyeing industry, chemical material industry, melting industry, and garment industry [28]. Based on the size of factories, 16 factories, including 4 machinery processing factories, 3 electronic device manufacturing factories, 3 printing and dyeing factories, 2 chemical material factories, 1 melting factory, 1 garment factory, 1 food and beverage manufacturing factory, and 1 other factory were randomly selected. Then three to four workshops were then randomly selected from each factory. Eligible participants were (1) aged 18 or above and (2) working full-time in local factories. All workers who met the inclusion criteria were invited to participate in a survey conducted by the Center for Disease Control and Prevention, Longhua District.

2.3. Data Collection

Eligible participants were invited to pay a visit to the Longhua District Center for Disease Control and Prevention. Trained fieldworkers briefed participants about the study and confirmed their eligibility to join the study. They were anonymous in this study and had the right to withdraw at any time without any consequences. Written informed consent was obtained from 2700 workers in the selected workshops, and 2023 workers completed a self-administered questionnaire. 218 cases were eliminated because they were not IMWs, and finally, we got 1805 samples of IMWs. The study was approved by the Ethics Committee of the School of Public Health, Sun Yat-Sen University (2019/3) and conducted under the guidelines of the Declaration of Helsinki.

2.4. Measurements

2.4.1. Defeat Scale

The DS, developed by Gilbert et al. in 1998, is a one-factor scale consisting of 16 items that assess individuals’ perceptions of losing rank position and failed struggle during the past seven days. The Chinese version of the DS still retains 16 items, but a two-factor structure was reported in some studies [29,30]. Items of DS are Likert-scaled and include options between zero (rarely) to four (always). Among 16 items, 3 items were positively worded (e.g., “I feel that I am a successful person.”) and were scored in the opposite direction. The total score of DS ranges from 0 to 64, and the higher the score is, the stronger the sense of defeat is [5].

2.4.2. Generalized Anxiety Disorder-7

The GAD-7 is a self-rated screening tool for the rapid detection of possible anxiety disorders. It consists of seven questions and is rated on a 4-point Likert scale [31]. A cutoff value of ≥5 was used for diagnosing anxiety. It has been validated in patients from China, Iran, and Ecuador in Chinese, and Spanish, respectively [32,33,34].

2.4.3. Revised Version of the Center for Epidemiologic Studies Depression Scale

A revised version of the Center for Epidemiologic Studies Depression Scale (CES-D-10) was obtained by reducing 20 items from the original version to 10 items. CES-D-10 has demonstrated strong psychometric properties, indicated by good reliability and construct validity [35]. A score of 10 is recommended as the cutoff value of CES-D-10 [35] and the Chinese version of the CES-D-10 has also been widely used by various groups of people in China [28,36,37].

2.5. Statistical Methods

2.5.1. Content Validity

Content validity reflects the degree to which items of a scale instrument are relevant to and representative of the targeted construct for a particular assessment purpose. The content validity index (CVI) is the most widely used method to quantify the content validity of a scale [38]. It can be calculated for each item (I-CVI) and for the content validity index of the entire instrument (Average—CVI).
The CVI is based on expert ratings of each item based on the content relevance or representativeness of the scale, usually on a 4-point Likert scale from 1 (not relevant or not representative) to 4 (extremely relevant or representative). For each item, the I-CVI can be calculated by counting the number of experts who rated the item as 3 or 4 and dividing that number by the total number of experts, that is, the proportion of agreement about the content validity of an item [39]. I-CVI ≥ 0.8 was considered to be acceptable [40]. Average-CVI (Ave-CVI) is defined as “the average proportion of items rated as 3 or 4 (valid) across the various experts” [41]. It is used to assess the overall content validity index of an instrument, and 0.8 is the lower limit for Ave-CVI to be acceptable [42]. In this study, 8 psychology experts participated in the content validity assessment of DS.

2.5.2. Structural Validity Test by Factor Analysis

Factor analysis is divided into two parts, namely exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) [43]. EFA is used to explore the main variables to create a model from a relatively large set of latent dimensions usually represented by a set of items [44,45,46,47]. CFA, as a form of structural equation modeling (SEM), is applied to test the proposed model by researchers [43]. In this study, the database (n = 1805) was randomly divided into group 1 (n = 856) and group 2 (n = 949), and EFA was performed first and CFA later.

Kaiser-Meyer-Olkin and Bartlett’s Test

Before conducting the factor analysis, the adequacy of the sample and the suitability of the data for factor analysis should be tested. The sampling adequacy can be assessed by examining the Kaiser-Meyer-Olkin (KMO) [43,48]. The results range from 0 to 1, and above 0.70 is considered sufficient for factor analysis. Bartlett’s test of Sphericity provides a chi-square output [48]. It indicates the matrix of items is not an identity matrix. The results should be significant (p < 0.05) for factor analysis [49,50].

Screen Test

The scree test is the best choice for determining the number of factors [43,51]. The scree test plot consists of eigenvalues and factors, and it is reliable when the sample size is at least 200. The scree test can separate the important or major factors from the minor or insignificant factors [52]. In the scree test plot, the number of data points above the break (not including the point at which the break occurs) is the number of factors to retain.

Confirmatory Factor Analysis

Based upon the exploratory model, confirmatory factor analysis (CFA) was executed by the maximum likelihood (ML) algorithm in t group 2 (n = 949). Goodness-of-fit index (GFI, expected to be >0.9), comparative fit index (CFI, expected to be >0.9), incremental fit index (IFI, expected to be >0.9), normed fit index (NFI, expected to be >0.9), Tucker-Lewis Index (TLI, expected to be >0.9), Chi-square to degrees of freedom ratio (CMIN/DF, expected to be <5), root mean square error of approximation (RMSEA, expected to be <0.08) and standardized root mean square residual (RMR, expected to be <0.08) were utilized to assess the goodness of fit of the model [53,54].

2.5.3. Reliability Test

Reliability is broadly defined in the population as the ratio of the variance of true scores to the variance of observed scores, while Cronbach’s coefficient alpha is a statistic for assessing scale reliability based on internal consistency [55]. Cronbach’s coefficient alpha of each factor and the total scale were calculated. Cronbach’s coefficient alpha ≥ 0.7 represents a good correlation, and alpha < 0.5 represents an unacceptable correlation [48,56].

2.5.4. Validity Test

Convergent Validity

Convergent validity was used to assess the degree of interrelationship for the items of each factor, and it was estimated by calculating the average variance extracted (AVE) and composite reliability (CR) [48,57]:
A V E = n = i n λ 2 n ,
C R = i = 1 n λ i 2 i = 1 n λ i + c = 1 n δ i .
n   = Number of items for each factor; i = c = 1,2…n; λ = factor loadings; δ = item error).
Estimates of AVE ≥ 0.50 and CR ≥ 0.70 were considered to indicate a strong interrelationship of items [50,54]. Items with convergent validity factors have a high degree of similarity, measuring similar content [58,59].

Discriminant Validity

The discriminant validity assesses whether the items that reflect a factor are not strongly correlated with another factor [54]. AVE and Correlation coefficient between factors can help us determine the discriminant validity between factors. If the square root of the AVE of any two factors is greater than their correlation coefficients, then the two factors are considered to have discriminant validity [57,60]. The factors with discriminant validity differ in what they measure.

2.5.5. Logistic Regression

IMWs with GAD-7 scores greater than 4 were considered to be suffering from anxiety, and IMWs with CES-D-10 scores greater than 10 were considered to be suffering from depression. Logistic regression was performed to explore the effect of DS scores on anxiety and depression.

3. Results

3.1. Descriptive Data

The average age of the participants was 32.0 (27.0–37.0) years old. Most IMWs (53.6%) were married, and 1214 (67.3%) were male. More than 80% of IMWs were of Han nationality. Most of the IMWs’ monthly income was 464.00–773.18$. The mean score of DS among IMWs was 18.42 ± 9.40. This was higher than students (17.2 ± 10.8, n = 302) and lower than depressed people (47.2 ± 10.9, n = 90) and high-stress mothers (23.4 ± 1.4, n = 76) [5]. There were 606 (33.6%) IMWs who were considered to have depression symptoms, and 524 (29.0%) IMWs were considered to have anxiety symptoms. A meta-analysis that included 44,365 IMWs reported that the overall prevalence of depression and anxiety among IMWs was 38.99% and 27.31%, respectively [61]. These were similar to the results of this study. The sociodemographic characteristics of group 1 and group 2 are summarized in Table 1. There was no statistically significant difference between the characteristics of the training and validation datasets, which indicated that the random assignment to each subset was successful.

3.2. Content Validity

Eight psychologists were invited to assess the degree to which items of the DS are relevant to and representative of defeat. The rating of the experts is displayed in Table 2. The relevance and representativeness of the 13 items on defeat were recognized by all experts, and all items had an I-CVI greater than 0.8. Based on the I-CVI of each item, the Ave-CVI of DS was calculated as 0.977, which was greater than 0.8.

3.3. Exploratory Factor Analysis

The value of KMO statistics was 0.943 > 0.6, which indicated that sampling was adequate. Bartlett’s test was significant ( χ 2   = 9391.978, p < 0.001), which showed the matrix of items was not an identity matrix. The factor analysis was appropriate for the data set.
According to the scree test (Figure 1), two initial factors were obtained using principal component analysis and orthogonal rotation. Factor 1 contained 13 items, and factor 2 contained the remaining items 2, 4, and 9. The eigenvalues of the two factors were 8.180 and 1.773, respectively, and the cumulative variance contribution rate was 62.208% (Table 3). The factor loading for each item was >0.5 (Table 4).

3.4. Confirmatory Factor Analysis

The results of CFA showed the DS should be regarded as a two-factor scale. However, the study of Gilbert et al. indicated that the DS should be a one-factor scale. Therefore, factor loadings and fit indices of one-factor and two-factor models in CFA were compared to determine the dimensionality of the DS. The results of factor loadings indicated that the two-factor model performed better than the one-factor model (Table 5). A comparison of fit indices revealed that the two-factor model was acceptable while the one-factor model was not (Table 6).

3.5. Reliability

The Cronbach’s alpha of all 16 items was 0.924, while the Guttman split-half coefficient was 0.88. The Cronbach’s alpha of the two factors was 0.946 and 0.691, respectively. The DS had acceptable internal consistency reliability among IMWs.

3.6. Convergent Validity and Discriminant Validity

Based on the factor loadings derived from the CFA, the AVE and CR of the two factors could be calculated. The AVE = 0.5744, CR = 0.945 in factor 1 and AVE = 0.625, CR = 0.830 in factor 2. The correlation coefficient of the two factors was 0.22. These results suggested that the DS had convergent validity and discriminant validity among IMWs.

3.7. Logistic Regression

One-factor logistic regression was performed to explore the effects of DS scores on anxiety and depression among the IMWs. For depression, β = 0.127, p < 0.0001, and for anxiety, β = 0.131, p < 0.0001. The specific results are shown in Table 7.

4. Discussion

The results of the content validity test revealed that the information captured by the DS is germane to and reflects defeat. This demonstrates that the DS is a suitable instrument to be introduced to IMWs to quantify defeat. The Kaiser–Meyer–Olkin and Bartlett’s Test of Sphericity suggested that the data collected in this study was amenable to factor analysis. The extraction method of EFA employed in this study was the principal component analysis. After extraction and rotation, two distinct components with eigenvalues greater than 1 were identified. The first component accounted for 51.126% of the total variance, with an eigenvalue of 8.180, while the second component explained 11.082% of the variance, with an eigenvalue of 1.773. The two components thus explained 62.208% of the common variance. The proportion of the total variance explained by the retained factors exceeding 50% was considered reasonable [48]. These results suggested that the DS could extract no more than two factors among IMWs.
The scree test plot was utilized to identify the optimal number of factors. As shown in Figure 1, eigenvalues were represented on the Y-axis, and the 16 component numbers were displayed on the X-axis. The factors were initially extracted with high eigenvalues, followed by smaller factors. The scree test plot showed that the two factors with eigenvalues greater than 1 accounted for a majority of the total variability, while the other factors accounted for a negligible proportion and were deemed to be of lesser significance. Consequently, the two-factor model is deemed to be the optimal choice among the IMWs.
However, Gilbert’s study suggested that the DS should be a one-factor scale [5]. We performed CFA for one-factor and two-factor models, respectively, to compare their fitting. The results indicated that the factor loadings of three reverse items (item 2, item 4, and item 9) in the one-factor model were below 0.4, suggesting that the three reverse items are not representative of the one-factor model [48]. In contrast, they performed well in factor 2 of the two-factor model. The fit of the two models was also noticeably different, as the GFI, RFI, TLI, IFI, and RMSEA indices of the one-factor model failed to reach acceptable levels, whereas they all fit well in the two-factor model. It is important to note that the CMIN/DF value may be unstable due to the sample size, which is a disadvantage when using this index to evaluate the goodness of fit. In this study, 1805 IMWs were included, far surpassing the minimum sample size requirement of 160. This may result in significantly high CMIN, leading to a higher CMIN/DF [62,63]. However, in this study, the CMIN/DF values for both the one-factor and two-factor models in the CFA were comparable due to the same sample size. Despite the fact that the CMIN/DF values for both models were greater than 5, the results of the two-factor model were closer to 5. Therefore, the two-factor model should be the superior option among IMWs.
Factor 1 was labeled as “Decadence” and comprised 13 items that described various forms of failure, such as in competition (e.g., item 15), low social status (e.g., item 10), loss of motivation (e.g., item 16), and loss of confidence (e.g., item 8). Factor 2, consisting of three items, described individuals who were successful (item 2 and item 4) and powerful (item 9). However, these items were scored in reverse, leading to the labeling of Factor 2 as “Low Achievement”.
The results of AVE and CR indicated that the two factors of the DS demonstrated convergent validity among IMWs. The 13 items of Factor 1 (Decadence) were highly similar and contributed to the measurement of decadence, while the three items of Factor 2 (Low Achievement) were also highly similar and contributed to the measurement of low achievement. The AVE of Factor 1 (Decadence) and Factor 2 (Low Achievement) were higher than their correlation coefficients, indicating the presence of discriminant validity among IMWs. This implies that the measure of decadence, as captured by Factor 1, is distinct from the measure of low achievement, as captured by Factor 2.
The regression results showed a positive association between the DS score (as a covariate) and both depression and anxiety (as dependent variables). The beta coefficient (β) was 0.127, and the odds ratio (OR) was 1.136 (95% CI: 1.120, 1.152) when depression was the dependent variable, and β = 0.131 and OR = 1.140 (95% CI: 1.124, 1.156) when anxiety was the dependent variable. These results suggest that an increase in defeat (as measured by the DS score) is associated with an increase in both depression and anxiety among IMWs. Specifically, for every 1 unit increase in the DS score, the probability of suffering from depression increases by 0.136, and the probability of suffering from anxiety increases by 0.140. This highlights the potential importance of defeat in the mental health of IMWs.
IMWs are also at risk for a variety of mental health problems and suicidal ideation or behavior [63,64,65,66,67]. In addition, defeat is also associated with post-traumatic stress disorder and suicide [64,65,66,67]. The introduction of DS may facilitate the study of defeat and other mental health in IMWs.

5. Limitations

Several limitations of the present study should be acknowledged. Firstly, the recruitment was conducted using a stratified multi-stage sampling method, and as a result, all internal migrants within a workshop were included, which may result in homogeneity among participants and restrict the generalizability of the findings. Secondly, the measures were self-reported via questionnaires, which raises concerns regarding the subjectivity of the results and the potential for bias. Additionally, information regarding the occupation of the internal migrants was not collected, which would have provided valuable information. Finally, the cross-sectional nature of the study calls for further examination of the predictive relationship between DS scores and depression through longitudinal studies.

6. Conclusions

The “Healthy China Action Plan” (2019–2030) highlights the importance of promoting mental health in order to promote social stability and harmonious interpersonal relationships and enhance the public’s sense of well-being. The mental health of IMWs is a highly relevant issue. Research has consistently shown that this population is at a higher risk for various mental health problems, including suicidal thoughts or behaviors. Additionally, experiences of failure and trauma are associated with post-traumatic stress disorder and suicide [64,65,66,67]. These findings underscore the importance of further research into the mental health of IMWs. Our study found that the two-factor model’s DS is an effective and reliable measure of defeat among IMWs in China and also found a positive correlation between defeat and anxiety and depression, indicating that defeat may play a significant role in the mental health of IMWs in China. Consequently, the DS may aid in providing a more comprehensive evaluation of the psychological state of IMWs and furnish information for the development of targeted intervention measures.

Author Contributions

H.Z., K.Z. and Y.W. designed the study; Y.L., H.C. and D.X. designed and completed the questionnaire production; T.H., Z.W. and B.C. created the research database and entered research data; R.W., C.X. and X.Y. completed the statistical analysis of the data; S.L., Y.C. (Yaqi Chen) and Y.C. (Yingjie Chen) wrote the first draft of the article; M.S., Y.W. and F.H. have revised the first draft into the final draft. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Shanghai Three-Year Action Plan for Public Health under Grant (GWV-10.1-XK18, GWV-10.2-XD13); the High-Level Project of Medicine in Longhua, Shenzhen (HLPM201907020105); and the strategic collaborative innovation team (SSMU-ZLCX20180601).

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Ethics Committee of School of Public Health, Sun Yat-Sen University (2019/3).

Informed Consent Statement

Informed consent was obtained from all subjects participating in the study.

Data Availability Statement

Data are available on request due to privacy and ethical restrictions. The data presented in this study are available on request from the corresponding author. The data are not publicly available due to protection of participants’ privacy.

Acknowledgments

We acknowledge all participants involved in our research.

Conflicts of Interest

All authors declare no conflicts of interest.

References

  1. State Council. Several Opinions of the State Council on Solving the Problem of Migrant Workers. Available online: http://www.gov.cn/zhengce/content/2008-03/28/content_6668.htm (accessed on 22 June 2022).
  2. State Council. Regulations to Protect the Payment of Wages to Migrant Workers. Available online: http://www.gov.cn/zhengce/content/2020-01/07/content_5467278.htm (accessed on 22 June 2022).
  3. National Bureau of Statistics China. 2020 Migrant Worker Monitoring Survey Report. Available online: http://www.stats.gov.cn/tjsj/zxfb/202104/t20210430_1816933.html (accessed on 22 June 2022).
  4. National Bureau of Statistics of China. Data for 2020. Available online: https://data.stats.gov.cn/easyquery.htm?cn=C01&zb=A0301&sj=2020 (accessed on 22 June 2022).
  5. Gilbert, P.; Allan, S. The role of defeat and entrapment (arrested flight) in depression: An exploration of an evolutionary view. Psychol. Med. 1998, 28, 585–598. [Google Scholar] [CrossRef] [PubMed]
  6. Forkmann, T.; Stenzel, J.-S.; Rath, D.; Glaesmer, H.; Teismann, T. „Vom Leben geschlagen “–Validierung der deutschen Version der Defeat Scale (DS-d). PPmP-Psychother. Psychosom. Med. Psychol. 2018, 68, 300–308. [Google Scholar] [CrossRef] [Green Version]
  7. Gilbert, P. Varieties of submissive behavior as forms of social defense: Their evolution and role in depression. In Subordination and Defeat: An Evolutionary Approach to Mood Disorders and Their Therapy; Lawrence Erlbaum Associates Publishers: Mahwah, NJ, USA, 2000. [Google Scholar]
  8. Du, H.; Li, S.-m.; Hao, P. ‘Anyway, you are an outsider’: Temporary migrants in urban China. Urban Studies 2018, 55, 3185–3201. [Google Scholar] [CrossRef]
  9. Wu, W.; Wang, G. Together but unequal: Citizenship rights for migrants and locals in urban China. Urban Aff. Rev. 2014, 50, 781–805. [Google Scholar] [CrossRef]
  10. Xie, S. Quality matters: Housing and the mental health of rural migrants in urban China. Hous. Stud. 2019, 34, 1422–1444. [Google Scholar] [CrossRef]
  11. Lin, D.; Li, X.; Wang, B.; Hong, Y.; Fang, X.; Qin, X.; Stanton, B. Discrimination, perceived social inequity, and mental health among rural-to-urban migrants in China. Community Ment. Health J. 2011, 47, 171–180. [Google Scholar] [CrossRef] [Green Version]
  12. Han, D. Policing and racialization of rural migrant workers in Chinese cities. Ethn. Racial Stud. 2010, 33, 593–610. [Google Scholar] [CrossRef]
  13. Shen, J. Stuck in the suburbs? Socio-spatial exclusion of migrants in Shanghai. Cities 2017, 60, 428–435. [Google Scholar] [CrossRef] [Green Version]
  14. Becker, G. The Economics of Discrimination; University of Chicago Press: Chicago, IL, USA, 1957. [Google Scholar]
  15. Ip, P.T.T.; Peeren, E. Exploiting the distance between conflicting norms: Female rural-to-urban migrant workers in Shanghai negotiating stigma around singlehood and marriage. Eur. J. Cult. Stud. 2019, 22, 665–683. [Google Scholar] [CrossRef] [Green Version]
  16. Qiu, P.; Caine, E.; Yang, Y.; Chen, Q.; Li, J.; Ma, X. Depression and associated factors in internal migrant workers in China. J. Affect. Disord. 2011, 134, 198–207. [Google Scholar] [CrossRef] [Green Version]
  17. Shao, C.; Meng, X.; Cui, S.; Wang, J.; Li, C. Income-related health inequality of migrant workers in China and its decomposition: An analysis based on the 2012 China Labor-force Dynamics Survey data. J. Chin. Med. Assoc. 2016, 79, 531–537. [Google Scholar] [CrossRef] [Green Version]
  18. Zhong, B.L.; Liu, T.B.; Chan, S.S.M.; Jin, D.; Hu, C.Y.; Dai, J.; Chiu, H.F.K. Common mental health problems in rural-to-urban migrant workers in Shenzhen, China: Prevalence and risk factors. Epidemiol. Psychiatr. Sci. 2018, 27, 256–265. [Google Scholar] [CrossRef] [PubMed]
  19. Rafiq, S.; Nielsen, I.; Smyth, R. Effect of internal migration on the environment in China. Energy Econ. 2017, 64, 31–44. [Google Scholar] [CrossRef]
  20. Zhao, L.; Liu, S.; Zhang, W. New Trends in Internal Migration in China:Profiles of the New-generation Migrants. China World Econ. 2018, 26, 18–41. [Google Scholar] [CrossRef]
  21. Xiao, C.; Yang, Y.; Chi, G. Does the mental health of migrant workers suffer from long commute time? Evidence from China. J. Transp. Health 2020, 19, 100932. [Google Scholar] [CrossRef]
  22. China Statistical Yearbook. National Bureau of Statistics of China, 2019; China Statistics Press: Beijing, China, 2019.
  23. Cheng, Z.; Wang, H.; Smyth, R. Happiness and job satisfaction in urban China: A comparative study of two generations of migrants and urban locals. Urban Stud. 2014, 51, 2160–2184. [Google Scholar] [CrossRef] [Green Version]
  24. Slade, K.; Edelmann, R.; Worrall, M.; Bray, D. Applying the C ry of P ain Model as a predictor of deliberate self-harm in an early-stage adult male prison population. Leg. Criminol. Psychol. 2014, 19, 131–146. [Google Scholar] [CrossRef]
  25. Akın, A.; Uysal, R.; Çitemel, N.; Akın, Ü. The Validity and Reliability of Turkish Version of the Defeat Scale. Int. Online J. Educ. Sci. 2013, 5, 660–666. [Google Scholar]
  26. Joo, H.; Kang, H.H.; Moon, H.S.; Lee, S.H. Validity and reliability of the Korean version of the Wisconsin Smoking Withdrawal Scale. Korean J. Intern. Med. 2020, 36, 135–144. [Google Scholar] [CrossRef] [Green Version]
  27. Bobov, G.; Capik, C. The Reliability and Validity of the Religious Health Fatalism Scale in Turkish Language. J. Relig. Health 2020, 59, 1080–1095. [Google Scholar] [CrossRef] [PubMed]
  28. Weiss, R.B.; Aderka, I.M.; Lee, J.; Beard, C.; Bj?Rgvinsson, T.S. A Comparison of Three Brief Depression Measures in an Acute Psychiatric Population: CES-D-10, QIDS-SR, and DASS-21-DEP. J. Psychopathol. Behav. Assess. 2015, 37, 217–230. [Google Scholar] [CrossRef]
  29. Tang, H.; Wang, S.; Gong, R.; Wang, Z.; Cai, Y. Reliability and validity of defeat scale on anxiety and depression in medical students. J. Shanghai Jiaotong Univ. Med. Sci. 2019, 39, 84–88. [Google Scholar]
  30. Liu, S.; Yang, H.; Xu, C.; Dong, J.; Yu, X.; Cai, Y.; Yuan, D.; Wang, Y. Validity and reliability of the Chinese version of Defeat Scale in men who have sex with men. J. Shanghai Jiaotong Univ. Med. Sci. 2021, 41, 793–798. [Google Scholar]
  31. Spitzer, R.L.; Kroenke, K.; Williams, J.B.; Lowe, B. A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7. Arch. Intern. Med. 2006, 166, 1092–1097. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Tong, X.; An, D.; McGonigal, A.; Park, S.P.; Zhou, D. Validation of the Generalized Anxiety Disorder-7 (GAD-7) among Chinese people with epilepsy–ScienceDirect. Epilepsy Res. 2016, 120, 31–36. [Google Scholar] [CrossRef] [PubMed]
  33. Li, W.; Lukai; Rongjing, D.; Dayi, H.; Sheng, L. GW25-e4488 The value of Chinese version GAD-7 and PHQ-9 to screen anxiety and depression in cardiovascular outpatients. J. Am. Coll. Cardiol. 2014, 64, C222. [Google Scholar] [CrossRef] [Green Version]
  34. Zeng, Q.Z.; Yan-Ling, H.E.; Liu, H.; Miao, J.M.; Chen, J.X.; Hai-Nan, X.U. Reliability and validity of Chinese version of the Generalized Anxiety Disorder 7-item(GAD-7) scale in screening anxiety disorders in outpatients from traditional Chinese internal department. Chin. Ment. Health J. 2013, 27, 163–168. [Google Scholar]
  35. Bjorgvinsson, T.; Kertz, S.J.; Bigda-Peyton, J.S.; McCoy, K.L.; Aderka, I.M. Psychometric properties of the CES-D-10 in a psychiatric sample. Assessment 2013, 20, 429–436. [Google Scholar] [CrossRef] [Green Version]
  36. Mohebbi, M.; Nguyen, V.; Mcneil, J.J.; Woods, R.L.; Nelson, M.R.; Shah, R.C.; Storey, E.; Murray, A.M.; Reid, C.M.; Kirpach, B. Psychometric properties of a short form of the Center for Epidemiologic Studies Depression (CES-D-10) scale for screening depressive symptoms in healthy community dwelling older adults. Gen. Hosp. Psychiatry 2017, 51, 118–125. [Google Scholar] [CrossRef]
  37. Baron, E.C.; Davies, T.; Lund, C. Validation of the 10-item Centre for Epidemiological Studies Depression Scale (CES-D-10) in Zulu, Xhosa and Afrikaans populations in South Africa. BMC Psychiatry 2017, 17, 6. [Google Scholar] [CrossRef] [Green Version]
  38. Almanasreh, E.; Moles, R.; Chen, T.F. Evaluation of methods used for estimating content validity. Res. Soc. Adm. Pharm. 2019, 15, 214–221. [Google Scholar] [CrossRef] [PubMed]
  39. Polit, D.F.; Beck, C.T.; Owen, S.V. Focus on research methods. is the cvi an acceptable indicator of content validity? appraisal and recommendations. Res. Nurs. Health 2007, 30, 459–467. [Google Scholar] [CrossRef] [PubMed]
  40. Lynn, M.R. Determination and quantification of content validity. Nur. Res. 1986, 35, 382–385. [Google Scholar] [CrossRef]
  41. Polit, D.F.; Beck, C.T. The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Res. Nurs. Health 2006, 29, 489–497. [Google Scholar] [CrossRef] [Green Version]
  42. Davis, L.L. Instrument review: Getting the most from a panel of experts. Appl. Nurs. Res. 1992, 5, 194–197. [Google Scholar] [CrossRef]
  43. Taherdoost, H.; Sahibuddin, S.; Jalaliyoon, N. Exploratory factor analysis; concepts and theory. Adv. Appl. Pure Math. 2022, 27, 375–382. [Google Scholar]
  44. Pett, M.A.; Lackey, N.R.; Sullivan, J.J. Making Sense of Factor Analysis: The Use of Factor Analysis for Instrument Development in Health Care Research; Sage Publications: Thousand Oaks, CA, USA, 2003. [Google Scholar]
  45. Henson, R.K.; Roberts, J.K. Use of Exploratory Factor Analysis in Published Research. Educ. Psychol. Meas. 2006, 66, 393–416. [Google Scholar] [CrossRef] [Green Version]
  46. Thompson, B. Exploratory and Confirmatory Factor Analysis: Understanding Concepts and Applications; International Standard Book Number: 1-59147-093-5; American Psychological Association: Washington, DC, USA, 2004. [Google Scholar]
  47. Osborne, J.W. What is rotating in exploratory factor analysis? Pract. Assess. Res. Eval. 2015, 20, 2. [Google Scholar]
  48. Shrestha, N. Factor analysis as a tool for survey analysis. Am. J. Appl. Math. Stat. 2021, 9, 4–11. [Google Scholar] [CrossRef]
  49. Tabachnick, B.G.; Fidell, L.S. Using Multivariate Statistics, 6th ed.; Pearson: Boston, MA, USA, 2014. [Google Scholar]
  50. Hair, J.; Black, W.; Babin, B.; Anderson, R. Multivariate Data Analysis; Pearson Prentice Hall: Upper Saddle River, NJ, USA; Macmillan: New York, NY, USA, 2009; Volume 24, p. 899. [Google Scholar]
  51. Costello, A.B.; Osborne, J. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pract. Assess. Res. Eval. 2005, 10, 7. [Google Scholar]
  52. Ledesma, R.D.; Valero-Mora, P. Determining the number of factors to retain in EFA: An easy-to-use computer program for carrying out parallel analysis. Pract. Assess. Res. Eval. 2007, 12, 2. [Google Scholar]
  53. Browne, M.W.; Cudeck, R. Alternative ways of assessing model fit. Sociol. Methods Res. 1993, 154, 132–162. [Google Scholar] [CrossRef]
  54. Schumaher, M.; Milani, D.; Alexandre, N. Psychometric properties evaluation of the Psychological Empowerment Instrument in a Brazilian context. J. Nurs. Manag. 2019, 27, 404–413. [Google Scholar] [CrossRef]
  55. Yang, Y.; Green, S.B. Coefficient alpha: A reliability coefficient for the 21st century? J. Psychoeduc. Assess. 2011, 29, 377–392. [Google Scholar] [CrossRef]
  56. Moret, L.; Mesbah, M.; Chwalow, J.; Lellouch, J. Internal validation of a measurement scale: Relation between principal component analysis, Cronbach’s alpha coefficient and intra-class correlation coefficient. Rev. Epidemiol. Sante Publique 1993, 41, 179–186. [Google Scholar] [PubMed]
  57. Ju, X.; Brennan, D.; Parker, E.; Chrisopoulos, S.; Jamieson, L. Confirmatory factor analysis of the health literacy in dentistry scale (HeLD) in the Australian population. Community Dent Health 2018, 35, 140–147. [Google Scholar] [PubMed]
  58. Bagozzi, R.P. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error: A Comment. J. Mark. Res. 1981, 18, 375–381. [Google Scholar] [CrossRef]
  59. Segars, A.H. Assessing the unidimensionality of measurement: A paradigm and illustration within the context of information systems research. Omega 1997, 25, 107–121. [Google Scholar] [CrossRef]
  60. Chen, Y.; Zahedi, F.M. Individuals’ Internet Security Perceptions and Behaviors: Polycontextual Contrasts Between the United States and China. MIS Q. 2016, 40, 205–222. [Google Scholar] [CrossRef] [Green Version]
  61. Hasan, S.I.; Yee, A.; Rinaldi, A.; Azham, A.A.; Mohd Hairi, F.; Amer Nordin, A.S. Prevalence of common mental health issues among migrant workers: A systematic review and meta-analysis. PLoS ONE 2021, 16, e0260221. [Google Scholar] [CrossRef]
  62. Lauwerier, E.; Crombez, G.; Van Damme, S.; Goubert, L.; Vogelaers, D.; Evers, A.W. The Construct Validity of the Illness Cognition Questionnaire: The Robustness of the Three-factor Structure Across Patients with Chronic Pain and Chronic Fatigue. Int. J. Behav. Med. 2010, 17, 90–96. [Google Scholar] [CrossRef] [Green Version]
  63. Loo, R. A psychometric evaluation of the General Decision-Making Style Inventory. Personal. Individ. Differ. 2000, 29, 895–905. [Google Scholar] [CrossRef]
  64. Lester, D. Defeat and entrapment as predictors of depression and suicidal ideation versus hopelessness and helplessness. Psychol. Rep. 2012, 111, 498–501. [Google Scholar] [CrossRef] [PubMed]
  65. Willner, P.; Goldstein, R.C. Mediation of depression by perceptions of defeat and entrapment in high-stress mothers. Br. J. Med. Psychol. 2001, 74, 473–485. [Google Scholar] [CrossRef]
  66. Panagioti, M.; Gooding, P.A.; Tarrier, N. Hopelessness, defeat, and entrapment in posttraumatic stress disorder: Their association with suicidal behavior and severity of depression. J. Nerv. Ment. Dis. 2012, 200, 676–683. [Google Scholar] [CrossRef] [PubMed]
  67. Siddaway, A.P.; Taylor, P.J.; Wood, A.M.; Schulz, J. A meta-analysis of perceptions of defeat and entrapment in depression, anxiety problems, posttraumatic stress disorder, and suicidality. J. Affect. Disord. 2015, 184, 149–159. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Scree test of DS in IMWs.
Figure 1. Scree test of DS in IMWs.
Healthcare 11 00781 g001
Table 1. Characteristics of the participants in different groups.
Table 1. Characteristics of the participants in different groups.
All Participants
n = 1805
Group 1 n = 856Group 2 n = 949p
Age-Median (IQR)32 (27.0, 37.0)32 (27, 36)32.0 (27, 37)0.726
Gender 0.978
Male1214 (67.3%)576 (67.3%)638 (67.2%)
Female591 (32.7%)280 (32.7%)311 (32.8%)
Nation 0.256
Han nationality1524 (84.4%)714 (83.4%)810 (85.4%)
Ethnic minority281 (15.6%)142 (16.6%)139 (14.6%)
Education 0.198
Primary School and below64 (3.5%)30 (3.5%)34 (3.6%)
Junior High School995 (55.1%)493 (57.6%)502 (52.9%)
High School585 (32.4%)259 (30.3%)326 (34.4%)
junior college94 (5.2%)43 (5.0%)51 (5.4%)
Undergraduate19 (1.1%)12 (1.4%)7 (0.7%)
Other48 (2.7%)19 (2.2%)29 (3.1%)
Marriage 0.759
Unmarried with no boyfriend/girlfriend555 (30.7%)260 (30.4%)295 (31.1%)
Unmarried but with a boyfriend/girlfriend164 (9.1%)88 (10.3%)76 (8.0%)
Married967 (53.6%)441 (51.5%)526 (55.4%)
Divorce/widowhood47 (2.6%)24 (2.8%)23 (2.4%)
Others72 (4.0%)43 (5.0%)29 (3.1%)
Wage ($) * 0.201
Unknown56 (3.1%)17 (2.0%)39 (4.1%)
Less than 154.6725 (1.4%)13 (1.5%)12 (1.3%)
154.67–463.85141 (7.8%)49 (5.7%)92 (9.7%)
464.00–773.181099 (60.9%)552 (64.5%)547 (57.6%)
773.34–1082.51447 (24.8%)214 (25.0%)233 (24.6%)
1082.67–1546.52 29 (1.6%)8 (0.9%)21 (2.2%)
Over 1546.678 (0.4%)3 (0.4%)5 (0.5%)
Data are presented as n (%) or median (IQR). * Exchange rate reference time: 5 August 2021.
Table 2. Ratings on 16 items of DS by 8 experts.
Table 2. Ratings on 16 items of DS by 8 experts.
ItemsExpert 1Expert 2Expert 3Expert 4Expert 5Expert 6Expert 7Expert 8Number of AgreementsItem-CVI1
14444443481.000
23433243470.875
34343344481.000
44333344381.000
54444434381.000
64343444381.000
73334134470.875
84343344481.000
94333433481.000
104434344481.000
113323443470.875
124444444481.000
134334444481.000
144444344381.000
154433434381.000
164443344481.000
Table 3. Eigenvalues and total variance explained (n = 856).
Table 3. Eigenvalues and total variance explained (n = 856).
ComponentInitial EigenvaluesExtraction Sums of Squared LoadingsRotation Sums of Squared Loadings
Total% of VarianceCum%Total% of VarianceCum%Total% of VarianceCum%
18.18051.12651.1268.18051.12651.1267.88249.26349.263
21.77311.08262.2081.77311.08262.2082.07112.94462.208
30.9946.21368.421
40.9285.80274.222
50.5353.34177.564
60.4662.91580.479
70.4442.77683.256
80.3742.33885.593
90.3602.25087.843
100.3422.13689.980
110.3362.09992.079
120.3131.95494.033
130.2791.74295.775
140.2571.60897.383
150.2271.41898.801
160.1921.199100.000
Extraction Method: Principal Component Analysis. Cum means Cumulative.
Table 4. Item factor loadings of the two-factor model (n = 856) in EFA.
Table 4. Item factor loadings of the two-factor model (n = 856) in EFA.
Two-Factor Model
Item Factor 1Factor 2
item1I feel that I have not made it in life0.630
item2I feel that I am a successful person (R) 0.865
item3I feel defeated by life0.726
item4I feel that I am basically a winner (R) 0.881
item5I feel that I have lost my standing in the world0.664
item6I feel that life has treated me like a punchbag0.698
item7I feel powerless0.807
item8I feel that my confidence has been knocked out of me0.753
item9I feel able to deal with whatever life throws at me (R) 0.593
item10I feel that I have sunk to the bottom of the ladder0.773
item11I feel completely knocked out of action0.805
item12I feel that I am one of life’s losers0.863
item13I feel that I have given up0.819
item14I feel down and out0.857
item15I feel I have lost important battles in life0.832
item16I feel that there is no fight left in me0.814
Note: (R) means reverse coded item.
Table 5. Item factor loadings of the one-factor model and two-factor model (n = 949) in CFA.
Table 5. Item factor loadings of the one-factor model and two-factor model (n = 949) in CFA.
One-Factor ModelTwo-Factor Model
Item Factor 1Factor 2
item1I feel that I have not made it in life0.5870.586
item2I feel that I am a successful person (R)0.137 0.735
item3I feel defeated by life0.664 0.664
item4I feel that I am basically a winner (R)0.148 0.762
item5I feel that I have lost my standing in the world0.670 0.670
item6I feel that life has treated me like a punchbag0.650 0.650
item7I feel powerless0.789 0.788
item8I feel that my confidence has been knocked out of me0.692 0.691
item9I feel able to deal with whatever life throws at me (R)0.237 0.434
item10I feel that I have sunk to the bottom of the ladder0.747 0.733
item11I feel completely knocked out of action0.788 0.788
item12I feel that I am one of life’s losers0.837 0.838
item13I feel that I have given up0.827 0.827
item14I feel down and out0.880 0.880
item15I feel I have lost important battles in life0.845 0.845
item16I feel that there is no fight left in me0.824 0.825
Note: (R) means reverse coded item.
Table 6. Model fit indices of the one-factor and two-factor model (n = 949).
Table 6. Model fit indices of the one-factor and two-factor model (n = 949).
IndexAcceptable ValueOne-Factor ModelTwo-Factor Model
CMIN/DF<59.7515.343
GFI>0.90.8830.932
CFI>0.90.910 0.956
NFI>0.90.901 0.946
RFI>0.90.881 0.935
IFI>0.90.910 0.956
TLI>0.90.892 0.946
sRMR<0.080.0695 0.0522
RMSEA<0.080.096 0.068
Note: DF = degree of freedom, CMIN = chi-square fit statistics.
Table 7. Results of one-factor logistic regression.
Table 7. Results of one-factor logistic regression.
Dependent VariablesCovariatesβS.E.WalddfpOR (95%CI)
DepressionDS score0.1270.007315.1171<0.0011.136 (1.120, 1.152)
AnxietyDS score0.1310.007318.7431<0.0011.140 (1.124, 1.156)
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Liu, S.; Chen, Y.; Chen, Y.; Hu, T.; Wang, Z.; Wang, R.; Hu, F.; Xu, C.; Yu, X.; Liu, Y.; et al. Reliability and Validity of the Defeat Scale among Internal Migrant Workers in China: Decadence and Low Sense of Achievement. Healthcare 2023, 11, 781. https://doi.org/10.3390/healthcare11060781

AMA Style

Liu S, Chen Y, Chen Y, Hu T, Wang Z, Wang R, Hu F, Xu C, Yu X, Liu Y, et al. Reliability and Validity of the Defeat Scale among Internal Migrant Workers in China: Decadence and Low Sense of Achievement. Healthcare. 2023; 11(6):781. https://doi.org/10.3390/healthcare11060781

Chicago/Turabian Style

Liu, Shangbin, Yingjie Chen, Yaqi Chen, Tian Hu, Zixin Wang, Rongxi Wang, Fan Hu, Chen Xu, Xiaoyue Yu, Yujie Liu, and et al. 2023. "Reliability and Validity of the Defeat Scale among Internal Migrant Workers in China: Decadence and Low Sense of Achievement" Healthcare 11, no. 6: 781. https://doi.org/10.3390/healthcare11060781

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop