Next Article in Journal
Using Decision Trees to Examine Environmental and Behavioural Factors Associated with Youth Anxiety, Depression, and Flourishing
Previous Article in Journal
Factor Analysis Affecting Degree of Depression in Family Caregivers of Patients with Spinal Cord Injury: A Cross-Sectional Pilot Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Quality of Puhui Early Education Services in Chinese Teachers’ Perspectives: Evidence from a National Validation Study

1
Shanghai Institute of Early Childhood Education, Shanghai Normal University, Shanghai 200234, China
2
Institute of Early Childhood Education, Faculty of Education, East China Normal University, Shanghai 200062, China
3
Macquarie School of Education, Macquarie University, Sydney, NSW 2109, Australia
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(17), 10870; https://doi.org/10.3390/ijerph191710870
Submission received: 14 July 2022 / Revised: 17 August 2022 / Accepted: 30 August 2022 / Published: 31 August 2022
(This article belongs to the Section Children's Health)

Abstract

:
In this study, we examined the quality of Puhui early education services perceived by Chinese teachers with evidence from a national validation study. Firstly, using a stratified cluster sampling method, the Puhui Early Education Service Quality Scale (PEESQ) was developed and validated with 994 Chinese teachers. Secondly, the psychometric properties indicated that PEESQ is a reliable and valid scale with three dimensions: service adequacy, service balance, and public service welfare. Thirdly, descriptive statistics found that Chinese teachers generally appreciated the quality of Puhui services, ranking the construct of “public welfare” the highest and “service balance” the lowest. Finally, hierarchical regression analysis found that urbanicity positively predicted teacher evaluations after controlling for demographic and kindergarten factors. The findings imply that more funding support and policy attention should be provided to help enhance the quality of Puhui early education services (EES). Moreover, this study extends the framework of research on teacher evaluation of EES and provides useful tools to evaluate universal EES in China and beyond.

1. Introduction

China has been suffering from the “3A” problems of early education for decades. There are not enough kindergartens to serve the number of children who require them (accessibility), parents cannot afford tuition fees (affordability), and the services are of poor quality (accountability) [1,2]. To thoroughly solve the “3A” problems, the central government designed and launched the “Puhui” early education service (EES) system in 2010, subsidizing all public and some private kindergartens (ages 3–6) to provide an affordable and accountable service [3]. This educational innovation substantially enhanced the gross enrollment rate for EES from 50.9% in 2009 to 88.1% in 2021 [4,5]. However, this “great leap forward” in the quantity of EES does not necessarily translate into the enhancement of the quality of Puhui EES. Some studies explored the satisfaction of service receivers (i.e., parents and the public) and found that Chinese parents were mostly satisfied with Puhui EES [3,6], but no research has yet evaluated the service providers’ (i.e., teachers and principals) perceived quality of Puhui EES, which is more important for service improvement. To address this gap, we developed and validated a national scale to conduct a service quality evaluation with a large-scale sample of Chinese teachers.

2. Literature Review

2.1. The Quality of Puhui Early Education Service

Globally, international organizations and countries are working to improve EES’s affordability, availability, quality, and equity to enable as many families and children as possible to enjoy high-quality early education [7,8,9]. Many countries have implemented universal provision programs, accessible to children who meet age eligibility criteria, emphasizing the potential benefits for all children and the greater impact on disadvantaged children, such as the Universal Children Care Benefit and the Universal Child Care Program [10,11]. These programs are concerned with the equity of children’s access to EES, for such access is presented as a right of all children.
In China, the emergence of the Puhui EES is closely related to the social welfare and economic systems. On the one hand, the moderately inclusive shift of the Chinese social welfare system provides a suitable foundation and conditions for Puhui EES. On the other hand, to cope with the aging population crisis and increase the birth rates, the central government of China has highly prioritized the development of universal EES since 2010. In particular, the State Council’s Opinions on the Current Development of Early Childhood Education (hereafter “the opinions”) were enacted to establish a national Puhui EES system [12]. This system demands that governments at all levels subsidize and facilitate the development of affordable EES, aiming to solve the “3A” problems thoroughly [1]. Accordingly, all public and most private kindergartens were included in the Puhui EES [13]. In Chinese, Puhui (普惠) means “universally and generally involving all people with some beneficial, favorable, and kind offer”, and should be fairly good and inexpensive. Therefore, Puhui EES should be “universal, affordable, accessible, and accountable” for all needy families of young children aged 3 to 6 years [3]. Since the Puhui policy was implemented over a decade ago, the gross enrollment rate for EES jumped from 50.9% in 2009 to 88.1% in 2021 [4,5]. However, such data cannot fully reflect the effectiveness of the Puhui EES. Furthermore, a decade ago in China, most parents only wanted their children to “be able to enter a school”; more recently, parents have raised their standards and now want their children to “access…a high-quality school” [14]. Therefore, the focus of the Puhui EES has shifted from expanding coverage to improving the service quality.
To date, Chinese scholars have debated the definition of Puhui EES quality from various perspectives. Some define the Puhui EES quality as the degree of meeting young children’s developmental needs [15,16]. Some extend this definition by adding the need to entertain other stakeholders such as the government, community, organizers, parents, and teachers [17]. From our perspective, the quality of Puhui EES refers to the degree of being “affordable” and “accountable” in meeting young children’s educational needs. Accordingly, we need to develop a systematic and comprehensive scale to evaluate the “affordability” and “accountability” of Puhui EES. To develop this scale, we must generate the performance indicators of “affordability” and “accountability” of Puhui EES. In addition to the affordability–accountability constructs, the “structure–process” dichotomy has been extensively employed to evaluate the quality of EES [18]. Structural quality refers to facilities/resources, staff-to-child ratios, and staff qualifications. Process quality focuses on the interactions between the child and teacher, child and child, teacher and parent, and teacher and teacher. Adopting this framework, the Organization for Economic Co-Operation and Development identified seven aspects of quality: (1) interaction or process quality, (2) child outcome quality, (3) standards about parent/community outreach and involvement, (4) orientation quality, (5) structural quality, (6) educational concept and practice, and (7) operational quality. These aspects can be categorized under the two aforementioned types of quality, structure and process quality [7]. Aspects (1) to (3) are concerned with process quality, whereas (4) to (7) focus on structural quality. In China, the “input–output” model has also been adopted to develop quality indicators such as hardware input, software input, ontology output, functional output, and benefits [14,16]. Accordingly, the quality of Puhui EES has improved since 2010. However, the quality of overall EES (including non-Puhui services) is still lower than that of elementary education.
The above review indicates that Puhui EES quality has been evaluated based on affordability, accountability, structural quality, process quality, input quality, and output quality. However, there is no systematic approach that considers the policies and contexts of Puhui, preventing us from comprehensively measuring Puhui EES quality. Therefore, we proposed incorporating them into a holistic evaluation system with new constructs: service adequacy at the input level, service balance at the distribution level, and public service welfare at the output level. Accordingly, in this study, service adequacy mainly refers to the resource investment adequacy of the Puhui EES, including software and hardware, such as the child–teacher ratio. Meanwhile, service balance mainly refers to the resource distribution balance of the Puhui EES, including rural–urban and inter-kindergarten support, such as increasing financial support for rural kindergartens. Finally, public service welfare mainly refers to the output benefits to children and society of the Puhui EES, including personal and social benefits, such as providing family parenting. This three-construct framework is suitable for evaluating Puhui EES quality because it is consistent with the Puhui policy goals and focuses on the rooted problems of EES. This framework is based on the Input–Output–Outcome (IOO) model and the Service Quality (SERVQUAL) model [19,20]. Specifically, the IOO model connects the input, process, output, and result, reflecting the transformation and utilization of resources. It has been widely used in service quality evaluation and is associated with the logic model. In addition, the SERVQUAL model is mainly based on the difference theory, whose theoretical core is the Service Quality Gap Model (also called the Expectation Perception Model). The SERVQUAL model has five constructs: tangibility, reliability, responsiveness, assurance, and empathy. For example, based on the SERVQUAL model, a scholar constructed the service quality evaluation indicator of community education information, applying the perceived service quality quadrant to analyze and interpret the index importance to make the system more feasible [21]. We believe that this three-construct framework, based on the IOO and SERVQUAL models, could be developed into an evaluation tool of the quality of Puhui EES.

2.2. Service Quality Evaluation by Teachers

Teachers are viewed as the most valuable stakeholders when evaluating the quality of EES, including the Puhui EES. First, they are the service providers and play an active supporting/shaping role in quality assurance [22]. Second, their professionalism and performance, competency, and enthusiasm are critical to delivering quality services. Third, teacher evaluation could provide authentic evidence to judge the quality of Puhui EES [23]. Therefore, this study is dedicated to gathering teachers’ insights and self-evaluation of the quality of Puhui EES as insiders. In China, a previous study by Jiang and Pang interviewed kindergarten teachers and found that they highly valued the affordability of Puhui EES [24]. However, no studies have asked Chinese teachers to systematically evaluate the quality of Puhui EES because of the lack of reliable instruments. To address this gap, we developed and validated a scientific scale to evaluate service quality with Chinese teachers.
Teachers’ evaluations might be influenced by the program design, principal leadership, and their backgrounds [25]. For example, the central control of curriculum was a significant factor influencing Cypriot and English teachers’ evaluations [26]. Teacher’s age was also an important factor: preschool teachers aged 19–29 were more accepting of male teachers than other age groups, indicating that young teachers tended to agree with more progressive opinions than older teachers [27]. In China, the stability and rationality of program content and implementation, faculty benefits, and teachers’ teaching experience and backgrounds were identified as key factors [28,29]. In addition, the urbanicity and ratings of kindergarten might also affect teachers’ quality evaluation [3,6], but their real impact has not been confirmed in the Chinese context. In particular, China features a national rating system of kindergartens’ quality: exemplary, first-class, second-class, and third-class kindergartens. The exemplary kindergarten has the best quality, whereas the third class has the lowest. Furthermore, the Measures for Supervision and Evaluation of Kindergarten Running Behavior mandate regular quality evaluation by the local educational authorities, focusing on the hardware and software of each kindergarten [30]. In sum, teachers’ demographics and kindergarten attributes might influence teachers’ evaluations in multiple ways. In this study, we explore the above factors influencing teachers’ evaluation of the quality of Puhui EES.

2.3. The Context of This Study

While the Puhui EES has significantly progressed since 2010, many problems remain. For example, the quantity and quality of kindergarten teachers in lower-rated kindergartens lag behind those of high-rated ones [3,6]. Moreover, the urban–rural gaps might have exacerbated the diversity of the Puhui EES quality and thus have caused the growing opportunity gaps between urban and rural children [17]. To understand these developed–developing and rural–urban gaps, we must conduct a national survey study of the Puhui EES quality. Accordingly, we developed and validated a reliable scale for teachers’ service quality evaluation and explored the influential factors. In particular, the following questions guided this national study:
  • What are the psychometric properties of the service quality evaluation tool?
  • How do Chinese teachers view the quality of Puhui early education services?
  • What are the factors influencing Chinese teachers’ quality evaluation?

3. Materials and Methods

3.1. Participants

Stratified cluster sampling was conducted to recruit kindergarten teachers for this national survey study. First, we randomly selected three provinces to represent eastern, central, and western China: Shandong, Jiangxi, and Guizhou, respectively. Overall, the economic and ECE development levels of Shandong Province are relatively high, followed by Jiangxi Province and Guizhou Province. Second, we randomly sampled one city from each participating province, resulting in three participating cities: Qingdao, Shangrao, and Guiyang. Qingdao and Guiyang are both capital cities, and Shangrao is a relatively developed city in Jiangxi Province. These three cities have made great efforts and progress in developing Puhui EES. Third, we randomly sampled ten kindergartens from each city and distributed 1023 online questionnaires to their teachers. Fourth, 994 questionnaires were completed and returned, resulting in a high return rate of 97.2%. The high return rate was because the local government distributed and collected the questionnaires. Coincidently, there were no significant differences in the cities’ return rates (less than 1%).
The sample of this study covered the countryside (8.0%), villages (20.4%), counties (48.0%), and urban cities (23.6%) as administratively classified in China. According to the Department of Development Planning and Ministry of Education statistics, the ratio of urban to rural kindergarten teachers was about 3:7. Thus, the proportions of kindergarten teachers from the rural and urban areas in this study were close to this national norm. Their education levels ranged from junior high or below (4.2%), senior high (38.3%), junior college (42.5%), and undergraduate or above (15.0%). Since 2010, all public kindergartens have been included in the Puhui EES because they are commonly owned and sponsored by governmental organizations and tend to be affordable and accountable for all families in need. However, private kindergartens can be classified into two groups, Puhui and non-Puhui private kindergartens, based on whether they are subsidized by governments and provide affordable and quality services. Thus, most participants were from public kindergartens (80.0%), with a few from Puhui private kindergartens (20.0%). In particular, most of the participants were from exemplary kindergartens (69.2%), followed by first-class kindergartens (18.4%), second-class kindergartens (6.9%), and third-class kindergartens (5.5%). The participants’ demographic information is presented in Table 1.

3.2. Puhui Early Education Service Quality Scale (PEESQ)

The three-construct framework was adopted to develop the quality indicators for the service quality evaluation: service adequacy, service balance, and public service welfare. First, we extensively analyzed relevant policy documents and developed quality indicators of Puhui EES, grouping the items into three dimensions. Second, we consulted nine experts through three rounds of Delphi expert interviews to examine and validate the quality indicators. Some items were deleted based on the experts’ feedback. The chosen 34 items were classified into three dimensions. The first and the second authors reviewed and revised the 34 items to finalize the first draft of the instrument. Then, convenience and purposeful sampling were conducted to recruit 111 kindergarten teachers from seven provinces for the pilot study. They were asked to complete the survey online, providing feedback on the items’ wording and identifying any problems. Their feedback was collected and examined, and the corresponding items were refined to improve clarity and readability. The final version includes 32 items that can be classified into three dimensions (see Appendix A for the scale).
The Puhui Early Education Service Quality Scale (PEESQ) has two parts. The first part is a demographic survey collecting information about the respondents’ age, teaching experience, educational background, job position, school tenure, urbanicity, kindergarten type, and rating. The second part is the PEESQ, which comprises 32 items rated on a 5-point Likert scale (1 = extremely disagree to 5 = extremely agree; ordinary type) based on the participants’ judgments of and feelings about Puhui EES quality. Specifically, service adequacy contains seven items (e.g., child–teacher ratio, percentages of degree holders), service balance contains 12 items (e.g., expanding Puhui resources in rural areas, financial support for rural kindergartens), and public service welfare contains 13 items (e.g., effective teacher–child interaction, provide family parenting). The survey was conducted using the written form of Mandarin Chinese. For instance, item 1, “The child–teacher ratio meets standards”, belongs to the service adequacy construct and was written in Chinese as “幼儿和教师的配比符合标准”. The statistical means of each item, dimension, and construct were taken as the final scores. A high score indicates a high evaluation and a positive perception of the Puhui EES quality in this study.

3.3. Procedures

Ethical procedures were followed throughout the study. First, the study was approved by the ethics committee of the corresponding author’s university. Second, consent was obtained from the local governments, educational directors, and the principals of the participating kindergartens. Third, kindergarten teachers were briefed about the survey via an introduction at the beginning of the questionnaire. Finally, they were considered to consent to participate if they completed and returned the questionnaire.
The survey scale was created and collected online using www.wjx.cn, the leading online survey platform in China. All survey data were analyzed using IBM SPSS 26.0 (IBM, Armonk, NY, USA) and MPLUS 8.0 (Mplus Software, Jakarta, Indonesia). First, data cleaning was conducted to replace very few missing values (<0.5%) with the mean of the concerned variable. Next, the psychometric properties were analyzed using item analysis, exploratory factor analysis (EFA), and confirmatory factor analysis (CFA) to explore and verify the construct validity and reliability of the scale. Descriptive statistics were then employed to explore teachers’ overall evaluations of Puhui EES quality. Last, hierarchical regression analyses were conducted to examine the main effects and predictors.

4. Results

4.1. Psychometric Properties of PEESQ

Item analysis was adopted to test the adequacy of 32 items. After analyzing the items by extreme group testing, the item total correlation method, and internal consistency reliability value testing, we decided to keep them all. The reasons are as follows: (1) the CR value of each item was greater than 3.00, indicating good discrimination ability; (2) the correlation coefficients between items and the total score are between 0.63 and 0.88, greater than 0.40; (3) the Cronbach’s α coefficient of the scale was 0.981, above 0.7 [31,32,33].
EFA was conducted using SPSS version 26.0 on the first half (n = 497) of the sample to disclose the structure of PEESQ. First, the adaptability of the data was tested, and the fit for EFA was confirmed [KMO = 0.98, Bartlett spherical test χ2 = 19,059.03 (df = 496, p < 0.001)]. Then, a three-factor model was produced for the scale that can explain 72.39% of the total variation using principal axis factoring (PAF) with a direct oblimin method, indicating satisfactory construct validity. The eigenvalues of the three dimensions were 20.50, 1.37, and 1.30, respectively. The factor load of the item was between 0.69 and 0.89, all greater than 0.45; the degree of commonality was between 0.56 and 0.81, all greater than 0.2; and the common factor of the factor composition structure was also relatively stable. Accordingly, there was no need to delete any items. Finally, we adjusted the items according to the results of the exploratory factor analysis in Table 2. The variance explanation rate of the first factor was 4.05%, and the seven items included were all from the service adequacy construct, mainly referring to the investment of the Puhui EES; therefore, it was still named “service adequacy”. The variance explanation rate of the second factor was 4.27%. Most of the 12 items included were from the service balance construct, and some were from the original service adequacy and public service welfare constructs. Most of them refer to kindergarten support and urban and rural support; this factor was named “service balance”. The variance explanation rate of the third factor was 64.07%, and all 13 items were from the original public service welfare construct that referred to personal and social benefits. Therefore, it was named “public service welfare”. As a result, the PEESQ was confirmed to have three dimensions: service adequacy, service balance, and public service welfare.
CFA analysis was conducted using MPLUS version 8.0 to confirm the three-factor structure that the EFA result suggested with the second half (n = 497) of the data. Considering all items as continuous data, we used maximum likelihood estimation. The factor loads of the 32 items ranged from 0.61 to 0.93, and all reached a significant level (p < 0.001), indicating that the PEESQ has a good factor structure. As shown in Figure 1, the χ2/df of this scale was 2.73, which is less than 5, and the value of RMSEA was 0.02, which is less than 0.05 [34]; the values of CFI and TLI were 0.97 and 0.96, which are greater than 0.90 [35]; the value of SRMR was 0.05, which is less than 0.08 [36]. Thus, the CFA results confirmed the construct validity.
As shown in Table 3,the Cronbach’s α value for the PEESQ was 0.98, which is above 0.90, and the reliability of each factor ranged between 0.91 and 0.97; therefore, the entire scale was determined to have high reliability. Meanwhile, the split-half reliability ranged between 0.80 and 0.90, indicating that the internal consistency reliability ranged from excellent to acceptable [37]. In addition, the correlation matrix between three dimensions ranged from 0.69 to 0.77 (p < 0.000), indicating acceptable reliability.

4.2. Descriptive Analysis of Teachers’ Evaluation of the Quality of Puhui EES

The Puhui EES quality was recognized by the majority (75.8%) of Chinese teachers, with the means of the overall score being higher than 4.0 (M = 4.41, SD = 0.63). Specifically, teachers exhibited highly positive evaluations of public service welfare (M = 4.50, SD = 0.61), followed by service adequacy (M = 4.46, SD = 0.64) and service balance (M = 4.29, SD = 0.75). Among the 32 items, the two with the lowest mean scores were “teacher salary” (M = 3.90, SD = 0.59) and “educational funding” (M = 4.06, SD = 0.62), indicating relatively low satisfaction with financial investment.

4.3. Factors Affecting Teachers’ Quality Evaluation

Spearman correlation analysis was conducted to explore the variables correlated with teachers’ evaluations of Puhui EES quality. As shown in Table 4, the following variables were found to significantly correlate with teachers’ total evaluation scores (ps < 0.001): age (<20, 20–29, 30–39, ≥40), educational background (junior high or below, senior high, junior college, undergraduate or above), school tenure (yes, no), job position (ordinary, monitor, grade leader, director of nursing and teaching, principal), kindergarten rating (exemplary, first-class, second-class, third-class kindergarten), and urbanicity (countryside, village, county, and urban city).
We performed a three-step hierarchical regression analysis to identify the predictors of teacher evaluation. The significantly correlated variables were entered in three steps. In step 1, age and educational background were entered to control the influence of demographic variables. In step 2, kindergarten variables, including job position, school tenure, and kindergarten rating, were entered to explore the influence of kindergarten attributes on teacher evaluation. Finally, in step 3, we entered the urbanicity factor, countryside/villages and county/urban city, which is directly correlated with teacher evaluation.
The changes in R2 between the three steps indicated three key findings. First, demographic variables can only jointly explain 1.6% of the total evaluation scores, the lowest percentage in this study. Age and educational background were negative predictors of teachers’ evaluations. Second, the kindergarten-related variables jointly explained 11.2% of variation in the total score. The job position was a negative predictor of teachers’ evaluations, while school tenure and kindergarten ratings were positive. Finally, the urbanicity variable jointly explains 17.4% of the variation in the total score, which was the highest percentage in this study and was a positive predictor of teachers’ evaluations.
The hierarchical regression analysis revealed that urbanicity is a critical predictor of the teachers’ perceived quality: teachers in the countryside and villages have a relatively lower evaluation than those in counties and urban areas. In addition, job position, school tenure, and kindergarten rating significantly impacted teachers’ evaluations and account for 11.2% of the variation. A high level of teacher evaluation was associated with lower job positions, school tenure, and higher-rated kindergartens. Finally, while the demographic variables had the lowest interpretation rate for teacher evaluations, teachers’ ages and educational backgrounds still had negative effects on evaluations: low levels of teacher evaluation were associated with older ages and higher education levels (see Table 5).

5. Discussion

The main objective of this study was to understand how Chinese kindergarten teachers view the quality of Puhui EES. We created, validated, and applied the PEESQ scale to achieve this aim. This section discusses the major findings.

5.1. PEESQ Is Reliable and Valid

This study has validated the newly developed PEESQ, and its three dimensions have been confirmed: service adequacy at the input, service balance at the distribution, and public service welfare at the output. This is an advancement of the existing evaluation model in China, which focuses solely on the input and output, such as the outcome of children’s development [38]. PEESQ pays more attention to the overall process evaluation of Puhui quality and invites teachers to provide more specific suggestions for policy makers. The items of the PEESQ are related to the input, distribution, and output of the educational resources and services, all closely related to the policy goals and rooted problems inherent in the EES. While the PEESQ was developed to assess the quality of the Puhui EES, its use is not limited to Chinese contexts. The PEESQ can be used by researchers in other countries and regions to examine teachers’ perspectives of universal EES quality and to improve service effectiveness. The PEESQ could also be utilized to assess teachers’ perspectives of universal EES in other countries by selecting culturally appropriate dimensions in the scale.

5.2. Teachers Appreciated the Quality of Puhui EES

In this study, the mean score of the total quality evaluation was 4.41 (the full score was 5). Notably, “the evaluation” asserts that the social evaluation score of parents, teachers, and others should be higher than 4.25 in an EES evaluation survey [39]. This study exceeded the standard (M = 4.41) and indicates that the goals for developing the Puhui EES in China since 2010 have been achieved to an acceptable degree. Specifically, we found that the teachers rated the construct of public service welfare the highest, implying their satisfaction with the convenience and accessibility of Puhui EES. In contrast, they rated the construct of service balance the lowest, indicating some imbalance in the Puhui EES quality.
However, we found that teachers were most dissatisfied with “teacher salary” and “educational funding”. This finding is consistent with the existing study [40], which found that kindergarten teachers were disappointed with their salaries. This implies that more efforts should be made to enhance the compensation of kindergarten teachers, and more funding support should be provided to help enhance the quality of Puhui EES.

5.3. Factors Influencing Teachers’ Quality Evaluation

We identified urbanicity as the critical predictor of Chinese teachers’ quality evaluation. This finding indicates that kindergarten teachers in urban areas and counties have more positive evaluations than those in villages and rural areas. This urban–rural gap stems from the historical urban–rural differences in socioeconomic indicators and EES quality. To close the urban–rural gap in EES development and quality, governments have tried “all means” to implement universalized EES in rural China since 2010. However, rural areas still lag behind urban areas, as repeatedly reported in previous studies [15,17]. Furthermore, the quality of Puhui EES in rural areas was compromised because of the limited resources and unlimited teacher–child ratio. For instance, a rural teacher was responsible for a class of 70 children, whereas six urban teachers shared this workload [41]. These rural–urban differences have disappointed rural teachers with the EES system and, accordingly, downgraded their quality rating. To enhance the total quality of Puhui EES, the educational authorities must make more efforts to narrow the rural–urban gaps in resources and finance and thoroughly solve the inequalities between rural and urban teachers.
Second, we found that kindergarten ratings can also predict teachers’ quality evaluation. In particular, the teachers from third-class kindergartens scored significantly lower than those from other classes. This finding is consistent with the previous studies, which found that higher-rated kindergartens might receive more financial support and achieve higher quality; thus, these kindergarten teachers might have a higher positive evaluation of Puhui EES quality [14,40]. Moreover, compared with teachers from lower-rated kindergartens, teachers from higher-rated kindergartens might obtain higher salary guarantees and have a higher degree of social evaluation and status, which affects their evaluation of the Puhui EES quality.
Third, we found that job positions and school tenure can predict teachers’ evaluations. In particular, the teachers with higher job positions tended to make negative evaluations. On the one hand, this could be because higher positions require more effort, workload, and labor; thus, the teachers tend to be more exhausted and disappointed. On the other hand, it could also be that the higher position made them knowledgeable of the quality problems. Therefore, future studies should be conducted to confirm the real causes. Nevertheless, the finding that the teachers with school tenure tended to make positive evaluations is consistent with existing studies [42,43], as they have more security and stability and tend to evaluate the quality of Puhui EES positively. Therefore, it is necessary to improve the construction of China’s job position and school tenure systems to promote the quality of kindergarten teachers and the Puhui EES.

6. Conclusions

This is the first nationwide survey of kindergarten teacher evaluations of Puhui EES quality. First, the results indicate that the PEESQ scale is reliable and valid, with three dimensions confirmed: service adequacy, service balance, and public service welfare. Second, Chinese teachers appreciated the quality of Puhui EES, with the construct of public service welfare ranked the highest, followed by the constructs of service adequacy and service balance. Third, urbanicity positively predicted teacher evaluations after controlling for demographic and kindergarten factors.
Still, this national study has several limitations. Firstly, the surveyed population only included kindergarten teachers and did not include other relevant stakeholders, such as educational administrators, parents, and children. Secondly, the children’s development outcome was not adopted to indicate Puhui EES quality. Thirdly, a multidimensional evaluation, instead of sole reliance upon questionnaire data, should be conducted to avoid response biases such as the social expectation effect from different populations. Fourthly, since there is no pre-existing, authentic, or reliable Puhui EES quality assessment system, we could only examine the scale’s content and construct validities, leaving the criterion-based validity unexplored. Finally, the present study indicated that several factors might influence teacher evaluation of the Puhui EES quality. Further studies are needed to verify and examine such findings.
Nevertheless, with a validated scale, this is the first national survey study to explore teachers’ perspectives of Puhui EES quality in China. Its findings have many implications for policy making in China and beyond. The most noteworthy implication is that this study extends the framework of research on the quality of EES and provides useful tools to evaluate universal service quality. Since the ultimate purpose of the scale’s development is to explore how to achieve available, affordable, quality EES, it is valuable to decision makers worldwide who are dedicated to promoting universal EES [3,15,44]. The second implication is that the study revealed that disadvantaged populations, such as kindergarten teachers without school tenure, are not financially stable. It is thus necessary to increase these teachers’ salaries to ensure the effective, balanced, sustainable, and high-quality development of the Puhui EES. Finally, there are significant differences in quality between rural and urban areas and between kindergartens of different ratings, which warrants more public attention, further studies, and policy changes.

Author Contributions

Conceptualization, methodology, formal analysis, and writing—original draft preparation, Y.W. and H.L.; validation and writing—original draft preparation, Y.J., Y.Z. and X.L.; methodology, writing—review and editing, and supervision, H.L. and Y.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Major Projects of the National Social Science Fund of China, grant number 18ZDA336. The APC was funded by Major Projects of the National Social Science Fund of China, grant number 18ZDA336.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of East China Normal University (HR 072-2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to ethical requirements.

Conflicts of Interest

The authors declare no conflict of interest. The funder had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Appendix A. Puhui Early Education Service Quality Scale

DimensionDefinitionIndicators
Service adequacyService adequacy refers to the
resource investment adequacy
of the Puhui EES.
Child–teacher ratio
Percentage of teachers with ECE qualification certificate
Percentage of degree holders
Building area per child
Outdoor activity area per child
Picture books per child
Toys and teaching aids per child
Service balanceService balance refers to the
resource distribution balance
of the Puhui EES.
Financial investment for early childhood education
Early childhood education funding per child
Special funding for early childhood education
Staff investment
Salary guarantee for disadvantaged teachers
Balanced development of urban and rural kindergartens
Expand Puhui resources in rural areas
Financial support for rural kindergartens
Balanced development of different types of kindergartens
Support for Puhui private kindergartens
Support for disadvantaged kindergartens
Governance of kindergartens in urban communities
Public service welfarePublic service welfare refers to
the output benefits to children
and society of the Puhui EES.
Scientific education and care activities
Effective teacher–child interaction
Provide family parenting
Convenient transportation to kindergartens
Equal admission of children with local household registration
Affordable for most local families
Suitable pick-up time in line with parents’ normal working hours
Gross enrollment rate for children aged 3–6
Percentage of children in public kindergartens
Address the “3A” problems
Coverage rate of Puhui kindergartens
Construct public kindergartens in townships
Support for children from low-income families

References

  1. Li, H.; Yang, W.P.; Chen, J.J. From “Cinderella” to “beloved princess”: The evolution of early childhood education policy in China. Int. J. Child Care Educ. Policy 2016, 10, 2. [Google Scholar] [CrossRef]
  2. Xie, S.; Li, H. Accessibility, affordability, accountability, sustainability and social justice of early childhood education in china: A case study of Shenzhen. Child. Youth Serv. Rev. 2020, 118, 105359. [Google Scholar] [CrossRef] [PubMed]
  3. Zhou, Y.; Jiang, Y.; Zhang, B. Effectiveness of Puhui Kindergartens’ Development in China: A Parental Evaluation. Early Educ. Dev. 2021, 33, 490–507. [Google Scholar] [CrossRef]
  4. Ministry of Education, Government of China. Statistical Bulletin of National Education Development in 2010. 2011. Available online: http://www.moe.gov.cn/srcsite/A03/s180/moe_633/201203/t20120321_132634.html (accessed on 28 February 2022).
  5. Ministry of Education, Government of China. The Main Results of the National Education Statistics in 2021. 2022. Available online: http://www.moe.gov.cn/jyb_xwfb/gzdt_gzdt/s5987/202203/t20220301_603262.html (accessed on 28 February 2022).
  6. Hong, X.; Zhu, W.; Wu, D.; Li, H. Are parents satisfied with early childhood education service in urban China? Empirical evidence from the validation study of the parent satisfaction with educational experiences scale. Early Educ. Dev. 2020, 31, 200–217. [Google Scholar] [CrossRef]
  7. Organization for Economic Co-Operation and Development (OECD). Starting Strong II: Early Childhood Education and Care; OECD Publishing: Paris, France, 2006; pp. 22–27. [Google Scholar]
  8. Ruth, H.; Felicity, N. Quality, Affordable and Accessible Early Childhood Education and Care; East West Childcare Association: Victoria, Australia, 2014; p. 25. [Google Scholar]
  9. West, A. The preschool education market in England from 1997: Quality, availability, affordability and equity. Oxf. Rev. Educ. 2006, 32, 283–301. [Google Scholar] [CrossRef]
  10. Battle, K.; Torjman, S.; Mendelson, M. More than a Name Change: The Universal Childcare Benefit; Caledon Institute of Social Policy: Ottawa, ON, Canada, 2006; p. 25. [Google Scholar]
  11. Thorpe, K.; Cloney, D.; Tayler, C. Rethinking early childhood education and care: Implications for research and evaluation. Int. Encycl. Educ. 2010, 144–150. [Google Scholar] [CrossRef]
  12. Central Government of China. State Council’s Opinions on the Current Development of Early Childhood Education 2010. Available online: http://www.gov.cn/zwgk/2010-11/24/content_1752377.htm (accessed on 27 February 2022).
  13. Central Government of China. Several Views on the Deepening Reform and Normative Development of Preschool Education by the State Council 2018. Available online: http://www.gov.cn/gongbao/content/2018/content_5343737.htm (accessed on 27 February 2022).
  14. Li, R.L.; Zhu, X.Z.; Lv, P. A survey on public service satisfaction of township preschool education: Taking town W of Hangzhou as an example. Early Child. Educ. 2015, 7, 28–32. [Google Scholar] [CrossRef]
  15. Chen, R.H.; An, X.C. Evaluation and analysis of the public welfare level of preschool education in rural areas. J. China Soc. Educ. 2018, 11, 25–31. [Google Scholar]
  16. Liu, J.Y. Theoretical discussion on education indicators in basic education monitoring. Sch. Adm. 2008, 3, 35–37. [Google Scholar]
  17. Yang, W.A. Construction and evaluation of public welfare indicator of preschool education in China. Educ. Res. 2017, 38, 82–87. [Google Scholar]
  18. Howes, C.; Burchinal, M.; Pianta, R.; Bryant, D.; Early, D.; Clifford, R.; Barbarin, O. Ready to learn? Children’s pre-academic achievement in pre-Kindergarten programs. Early Child. Res. Q. 2008, 23, 27–50. [Google Scholar] [CrossRef]
  19. Gong, P.; Yang, Y.H. Fiscal decentralization, government scale and public service cost-benefit—An empirical analysis based on provincial panel data from 2002 to 2012. J. Pub. Adm. 2017, 10, 144–170. [Google Scholar] [CrossRef]
  20. Seth, N.; Deshmukh, S.G.; Vrat, P. Service quality models: A review. Int. J. Qual. Reliab. Manag. 2005, 22, 913–949. [Google Scholar] [CrossRef] [Green Version]
  21. Hu, S.X. Research on Design and Application of Service Quality Evaluation Index System of Community Education Informatization from the Perspective of SERVQUAL Model. Educ. Dev. Res. 2015, 35, 77–84. [Google Scholar]
  22. Grossman, P. Teaching: From a nation at risk to a profession at risk. Harv. Educ. Lett. 2003, 19, 1–4. Available online: http://www.edletter.org/past/issues/2003-jf/nation.shtml (accessed on 20 February 2022).
  23. Greaves, M.; Bahous, R. Adapting to change: Exploring early childhood educators’ perceptions of a child-centered curriculum. Early Child. Educ. J. 2021, 49, 581–592. [Google Scholar] [CrossRef]
  24. Jiang, Y.; Pang, L.J. Take supply-side reform as the main approach to improve the construction of public service system of generally beneficial preschool education. Educ. Dev. Res. 2019, 39, 17–25. [Google Scholar] [CrossRef]
  25. Kim, J.; Youngs, P. Promoting instructional improvement or resistance? A comparative study of teachers’ perceptions of teacher evaluation policy in Korea and the USA. J. Comp. Int. Educ. 2016, 46, 723–744. [Google Scholar] [CrossRef]
  26. Kyriakides, L. Primary teachers’ perceptions of policy for curriculum reform in mathematics. Educ. Res. Eval. 1997, 3, 214–242. [Google Scholar] [CrossRef]
  27. Ahmad, J.; Al-Zboon, E.; Alkhawaldeh, M.F.; Al Khatib, A. Jordanian mothers’ and female preschool teachers’ perceptions of men working in preschools. J. Men’s Stud. 2018, 26, 77–91. [Google Scholar] [CrossRef]
  28. Liu, L.; Zhu, L.; Liu, N.C. Research on the identification of university teachers’ scientific research evaluation policies from the perspective of target group: Based on a questionnaire survey of 20 “double first-class” universities. Educ. Res. Tsinghua Univ. 2020, 41, 73–82. [Google Scholar]
  29. Wu, W.S. Research on the relationship between policy perception and policy satisfaction of primary and middle school teachers. Educ. Res. Exp. 2015, 2, 92–96. [Google Scholar]
  30. Central Government of China. Measures for Supervision and Evaluation of Kindergarten Running Behavior 2017. Available online: http://www.gov.cn/xinwen/2017-05/16/content_5194458.htm (accessed on 27 February 2022).
  31. Ellis, S.; Caridi, O.; Lipshitz, R.; Popper, M. Perceived error criticality and organizational learning: An empirical investigation. Knowl. Process. Manag. 1999, 6, 166–175. [Google Scholar] [CrossRef]
  32. Ruffner, J.W.; McAnulty, D.M. Checking out the checklist: Evaluation of a job performance aid for assessing organizational resource management. Proc. Hum. Factors Soc. Annu. Meet. 1989, 33, 820–824. [Google Scholar] [CrossRef]
  33. Qiu, H.Z. Quantitative Research and Statistical Analysis; Wu Nan Book Publishing: Taipei, China, 2009; p. 33. [Google Scholar]
  34. McDonald, R.P.; Ho, M.H. Principles and practice in reporting structural equation analyses. Psychol. Methods 2002, 7, 64–82. [Google Scholar] [CrossRef]
  35. Müller, A.; De Lange, A.; Weigl, M.; Oxfart, C.; Van der Heijden, B. Compensating losses in bridge employment? Examining relations between compensation strategies, health problems, and intention to remain at work. J. Vocat. Behav. 2013, 83, 68–77. [Google Scholar] [CrossRef]
  36. Hu, L.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. 1999, 6, 1–55. [Google Scholar] [CrossRef]
  37. Tavakol, M.; Dennick, R. Making sense of Cronbach’s alpha. Int. J. Med. Educ. 2011, 2, 53–55. [Google Scholar] [CrossRef]
  38. Du, L.L. The preschool education public service based on parent satisfaction survey. Forum Cont. Educ. 2016, 4, 43–49. [Google Scholar] [CrossRef]
  39. Central Government of China. Measures for Supervision and Evaluation of Universal Preschool Education in County Areas 2020. Available online: http://www.gov.cn/xinwen/2020-03/02/content_5485800.htm (accessed on 27 February 2022).
  40. Song, Y.Q. Principal contradictions and reformation of public finance in early childhood education and care in China. China Econ. Educ. Rev. 2019, 4, 19–48. [Google Scholar]
  41. Song, Z.Q. Research on the Status Quo and Influencing Factors of Kindergarten Teachers’ Comprehensive Salary Satisfaction. Master’s Thesis, East China Normal University, Shanghai, China, 2020; p. 67, Unpublished. [Google Scholar]
  42. Xia, J. Experience and enlightenment on the construction of kindergarten teachers in rural China. Res. Presch. Educ. 2014, 7, 35–41. [Google Scholar]
  43. Zhou, B. A positive analysis of the influence of “post participation” upon the teacher professional development. Teach. Educ. Res. 2010, 22, 36–43. [Google Scholar] [CrossRef]
  44. Li, H.; Wong, J.M.S.; Wang, X.C. Affordability, accessibility, and accountability: Perceived impacts of the pre-primary education vouchers in Hong Kong. Early Child. Res. Q. 2010, 25, 125–138. [Google Scholar] [CrossRef]
Figure 1. CFA, confirmatory factor analysis; PEESQ, Puhui Early Education Service Quality Scale. Model fit: χ2 = 984.22, df = 360, χ2/df = 2.73, p < 0.000, CFI = 0.97, TLI = 0.96, SRMR = 0.05, RMSEA = 0.02 (90% CI [0.042, 0.043]), AIC = 92,262.40, BIC = 93,040.67.
Figure 1. CFA, confirmatory factor analysis; PEESQ, Puhui Early Education Service Quality Scale. Model fit: χ2 = 984.22, df = 360, χ2/df = 2.73, p < 0.000, CFI = 0.97, TLI = 0.96, SRMR = 0.05, RMSEA = 0.02 (90% CI [0.042, 0.043]), AIC = 92,262.40, BIC = 93,040.67.
Ijerph 19 10870 g001
Table 1. Participants’ characteristics (N = 994).
Table 1. Participants’ characteristics (N = 994).
Demographic CharacteristicsN%
Age
  <2056356.6%
  20–2929129.3%
  30–3911211.3%
  ≥40282.8%
Teaching experience
  <244812.8%
  3–531645.1%
  6–810231.8%
  9–153910.3%
  ≥16899.0%
Educational background
  Junior high or below424.2%
  Senior high38138.3%
  Junior college42242.5%
  Undergraduate or above14915.0%
School tenure
  Yes42442.7%
  No57057.3%
Job position
  Ordinary teacher76877.3%
  Monitor343.4%
  Grade leader585.8%
  Director494.9%
  Principal858.6%
Kindergarten rating
  Exemplary KG68869.2%
  First-class KG18318.4%
  Second-class KG686.9%
  Third-class KG555.5%
Kindergarten type
  Public KG79580.0%
  Puhui private KG19920.0%
Geographical area
  Urban city23423.6%
  County47748.0%
  Village20320.4%
  Countryside808.0%
Note: KG = kindergarten.
Table 2. Exploratory factor analysis results.
Table 2. Exploratory factor analysis results.
ItemFactor LoadingCommonality
Service AdequacyService BalancePublic Service Welfare
Q10.72 0.57
Q20.73 0.57
Q30.69 0.56
Q40.83 0.70
Q50.85 0.72
Q60.84 0.74
Q70.87 0.79
Q8 0.85 0.76
Q9 0.85 0.78
Q10 0.87 0.77
Q11 0.81 0.66
Q12 0.88 0.78
Q13 0.87 0.78
Q14 0.86 0.75
Q15 0.88 0.81
Q16 0.86 0.79
Q20 0.80 0.81
Q29 0.81 0.75
Q17 0.85 0.69
Q18 0.860.64
Q19 0.830.77
Q21 0.850.81
Q22 0.890.77
Q23 0.870.73
Q24 0.850.71
Q25 0.830.67
Q26 0.800.73
Q27 0.840.73
Q28 0.820.71
Q30 0.800.72
Q31 0.840.72
Q32 0.830.69
Total Explained Variance 72.39%
Note: The extraction method was principal axis factoring with a direct oblique rotation; rotation converged after 9 iterations.
Table 3. Item means, standard deviations, and reliability of PEESQ.
Table 3. Item means, standard deviations, and reliability of PEESQ.
ConstructMSDCronbach’s Alpha (α)Split-Half Reliability
Service adequacy4.460.640.910.82
Service balance4.290.750.970.90
Public service welfare4.500.610.970.80
Overall reliability4.410.630.980.90
Table 4. Correlation matrix.
Table 4. Correlation matrix.
Variables1234567
1. Total teacher evaluation score——
2. Age−0.116 **——
3. Educational background−0.009 **−0.332 **——
4. Job position−0.241 **0.396 *−0.108 **——
5. School tenure0.132 **−0.004 **0.332 **−0.145 **——
6. Kindergarten rating0.230 **0.060 **0.124 **0.119 **0.104 **——
7. Geographical area0.191 **0.090 **−0.215 **0.103 **0.207 **0.255 **——
Note: * p < 0.05, ** p < 0.01.
Table 5. Summary of hierarchical regression analysis predicting teacher evaluation.
Table 5. Summary of hierarchical regression analysis predicting teacher evaluation.
VariableβR2ΔR2F Value
Step 1 0.0168.02 ***
  Age−0.133 ***
  Educational background−0.053 ***
Step 2 0.1160.11225.95 ***
  Age−0.039 ***
  Educational background−0.030 ***
  Job position−0.185 ***
  School tenure0.119 ***
  Kindergarten rating0.222 ***
Step 3 0.180.17430.98 ***
  Age−0.05 ***
  Educational background−0.032 ***
  Job position−0.162 ***
  School tenure0.104 ***
  Kindergarten rating0.148 ***
  Geographical area0.215 ***
Note: *** p < 0.001.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wang, Y.; Jiang, Y.; Li, H.; Zhou, Y.; Liu, X. The Quality of Puhui Early Education Services in Chinese Teachers’ Perspectives: Evidence from a National Validation Study. Int. J. Environ. Res. Public Health 2022, 19, 10870. https://doi.org/10.3390/ijerph191710870

AMA Style

Wang Y, Jiang Y, Li H, Zhou Y, Liu X. The Quality of Puhui Early Education Services in Chinese Teachers’ Perspectives: Evidence from a National Validation Study. International Journal of Environmental Research and Public Health. 2022; 19(17):10870. https://doi.org/10.3390/ijerph191710870

Chicago/Turabian Style

Wang, Yifang, Yong Jiang, Hui Li, Yu Zhou, and Xinxin Liu. 2022. "The Quality of Puhui Early Education Services in Chinese Teachers’ Perspectives: Evidence from a National Validation Study" International Journal of Environmental Research and Public Health 19, no. 17: 10870. https://doi.org/10.3390/ijerph191710870

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop