1. Introduction
Nearly half of the disabilities that affect children in developing countries are due to visual impairment [
1]. The most common and easily treated cause of visual impairment is uncorrected refractive error. Among all children in the world who are visually impaired by refractive error, approximately half live in China [
2]. Although eyeglasses offer a safe, effective, and inexpensive solution to visual impairment caused by refractive error, recent studies have shown that as few as one in six children in lower- and middle-income areas of the developing world who need eyeglasses actually own them [
1].
In view of the large global burden of uncorrected pediatric refractive error, there is interest in addressing this condition and the subsequent impact on children’s lives. A recent, large randomized controlled trial in rural western China demonstrated that providing eyeglasses could significantly improve children’s educational outcomes [
1,
3]. The magnitude of the impact has been shown to be comparable to and potentially exceeding other in-school health care interventions, such as de-worming or nutritional supplements [
4]. Providing eyeglasses also has been shown to reverse decrements in self-reported visual function in children with even modest abnormalities in visual acuity (<6/9) [
5].
Although previous studies have focused mainly on the relationship between the correction of refractive error and educational outcomes, there is also concern that visual impairment and the absence of quality vision care for students may be a source of mental health problems [
6]. In particular, the literature highlights competitive education systems as putting adolescents at risk of various mental health problems that may be exacerbated by anything that inhibits learning. For myopic students, the inability to see clearly could be a serious barrier to learning, especially in settings in which the blackboard, a common teaching tool, is positioned at the front of the classroom [
1]. The inability to perform may itself be a source of anxiety, creating a cycle of poor achievement and worsening mental health [
7].
There is a growing literature on the role of vision correction as an educational input [
1,
3,
8]. A number of randomized studies have shown that correcting vision can improve scores on standardized tests. One study, for example, has shown that the provision of glasses in schools boosts standardized test scores among primary school students [
1]. A similarly study found that the existence of systematic screening and referrals for free refraction and prescription eyeglasses at a local vision clinic raised test scores for children in surrounding schools [
9]. Studies in other settings have shown similar positive results [
1,
3,
4]
There is also a consensus on the link between poor vision and mental health. Studies among adults and the elderly have found that vision correction is associated with better mental health, less worry, reduced frustration, and a higher sense of well-being [
10,
11]. A smaller literature documents a correlation between uncorrected myopia and mental health among children [
12].
However, comparatively little is known about how correcting vision may affect mental health in an educational context. The issue is especially important given the high degree of pressure to perform in many schooling environments, such as China, where only top-performing students in high-stake tests may enroll into high school and university, get recruited for satisfactory jobs, and enjoy opportunities that are off-limits to lower scoring students [
13]. The literature shows that competitive education systems put adolescents at risk of various mental health problems that may be exacerbated by anything that inhibits learning. For myopic students, the inability to see clearly could be a serious barrier to learning, especially in settings in which the blackboard, a common teaching tool, is positioned at the front of the classroom [
14]. The inability to perform in school might be a source of anxiety, creating a cycle of poor achievement and worsening mental health.
Despite the potential benefits of vision correction for mental health in these settings, there is also the possibility of negative impacts of wearing eyeglasses. Research suggests that a change in personal appearance due to eyeglasses wear can invite teasing from peers [
15,
16]. A recent study among students in the UK, for example, showed that students with glasses were far more likely to fall victim to bullying and name calling [
15]. Additional research has reported the negative stereotypes associated with eyeglasses wear across a variety of contexts [
17,
18]. Children who wear eyeglasses can be accused of “putting on airs” or trying to appear overly intellectual. Such teasing may spur a decline in psychological well-being [
15]. It is therefore possible that such negative impacts may obscure or even completely outweigh mental health gains accrued by being able to see clearly and improve in school.
For this reason, we are interested in particular about how study intensity serves to mediate the impact of vision correction on mental health. Study intensity, as reflected in the number of hours spent studying outside of class, has been shown to predict perseverance and passion for long-term goals [
19,
20,
21]. Studies have found that students who spend more time studying outside of class tend to be more disciplined and capable of self-control [
19], and have better academic performance and higher attendance in class [
14,
22]. Such students may be more likely to ignore teasing or concerns of personal appearance because the benefit gained in learning is perceived to be more important. Conversely, students that study less intensively, who often have lower levels of academic performance, may be relatively more concerned with appearance and peer interactions, and thus be more vulnerable to teasing or other “side effects” of glasses wear. In this way, study intensity may moderate the impact of glasses on mental health as much as, or more than, other student characteristics such as family background or household wealth.
The overall goal of this study is to evaluate the effect of correcting refractive error on the mental health of students in schools in rural China. In particular, given China’s highly competitive schooling system, we are interested in exploring the differential impacts of vision correction on students with varying degrees of study intensity. To meet this goal, we have three specific objectives. First, we want to examine the average effect of correcting refractive error on the mental health condition of myopic students. Second, we seek to identify important heterogeneous effects of providing eyeglasses on mental health to determine whether vision correction affects the mental health of different types of children differently. Finally, we explore the mechanisms that might help to explain why correcting refractive error may have different effects on the mental health of students of different study intensity.
2. Sampling, Data Collection, and Analytical Approach
The setting for the study is the public school system in two of China’s predominantly rural northwestern provinces, Shaanxi and Gansu. Success in China’s competitive public school system is overwhelmingly dependent on performance on high-stakes tests [
13], and only a fraction of students are able to move up through the school system and attend academic high school and college. Unfortunately, rural students often face a number of constraints, including poor access to quality health care, nutrition, and vision care. Further, rates of myopia are high among students in rural areas, approximately 20 to 30% in primary school, more than 50% in junior high, and as high as 90% upon completion of high school. As noted earlier, however, rates of eyeglasses wear remain very low among students.
We conducted a cluster-randomized controlled trial (hereafter, cluster-RCT) across 252 primary rural schools in China to study the impact of providing eyeglasses on the mental health of myopic students. In the trial, schools were randomly selected into the treatment group and the control group. Among 19,934 students in the 252 primary schools, 2851 myopic students who could potentially benefit from having eyeglasses were involved in the experiment. In the treatment group, fully subsidized eyeglasses were provided to eligible myopic students. In the control group, myopic students were given only eyeglasses prescriptions. Each myopic student was given a letter for their parents informing them of their child’s myopia status and prescription. No other action was taken. If the students in the control group opted to purchases glasses, they would also have to travel to the county seat and select an optical shop and purchase the eyeglasses.
2.1. Sampling
Sampling was conducted immediately prior to the implementation of the study during the 2012–2013 school year in one prefecture in Gansu Province and one prefecture in Shaanxi Province. By choosing two provinces that differ in terms of wealth and development, as measured by GDP per capita (Gansu is relatively poor, and Shaanxi is close to China’s overall average), we are able to increase the generalizability of our findings [
23]. Gansu’s GDP per capita, 3919 USD, was ranked the second poorest among China’s 31 provincial administrative regions in 2013. Shaanxi’s GDP per capita, 6883 USD, was ranked 12th [
24]. One prefecture in each province was selected, Tianshui in Gansu Province and Yulin in Shaanxi Province. In total, we collected data in 18 of the 19 counties in the two prefectures. One county was not included due to the small size of its population, the surveying of which would have substantially raised the cost of the survey.
To choose the sample schools and students in these two prefectures, we followed a three-step protocol. First, we obtained a list of all rural primary schools in the two prefectures from local county education bureaus. Second, to eliminate the potential spillovers, we randomly selected only one school from each school district (or town) in the sample frame. Finally, within each school, we randomly selected one class in each of the fourth and fifth grades (likely age range was 9–12 years old). In total, 19,934 students from 252 rural primary schools were selected.
2.2. Experimental Design
To ensure a balanced sample and to improve the power of the experimental design, an intervention assignment was stratified by location (county), school size, and eye examination results (i.e., the proportion of myopic students in each school) collected in the baseline survey. In total, this yielded a total of 45 strata, and our analysis takes this stratified randomization procedure into account [
25]. Two-thirds of the schools were randomly assigned to one of two treatment groups and the other one-third to a control group. Among the two treatment groups, half of the schools were assigned to a free eyeglasses treatment group and the other half to a voucher treatment group. Because the intervention in both treatment groups was almost the same (at least in the context of this study, as both sets of students received the same vision care and were given access to the kind of eyeglasses), we combined the two treatment groups into one.
Once the randomized assignment was completed, the implementation team launched the intervention. In the treatment group, every student was screened. Students with poor vision were identified through a two-step eye examination protocol (described in detail in
Section 2.3). A prescription for eyeglasses for each student with poor vision was produced by a professional optometrist. A letter that described this vision care program and a prescription for the student was sent to parents. In addition, information about vision care and the importance of wearing eyeglasses was given to students in the form of an in-class training program. Based on the prescription, a pair of free eyeglasses was produced for each myopic student. About four weeks after the baseline (October 2012) program optometrists dispensed free eyeglasses at schools for the free treatment group, and free eyeglasses were ready for pickup at a shop of a local optometrist for the voucher treatment group. There were not large differences in acceptance or the wearing of eyeglasses or in the impact on academic outcomes between the two treatment groups, which further supports the decision to combine the two treatment groups in this study.
In the control group, only the letter and a prescription for the student were given to the parents. No additional training was provided to the students. The students and their families were blind to the cluster-RCT.
2.3. Data Collection
We conducted a total of two waves of surveys: one at baseline and one at post-treatment. Each survey was administrated to all sample students in the 252 schools. The baseline survey was conducted in September 2012 at the beginning of fall semester. The post-treatment survey was conducted in June 2013 at the end of the spring semester.
2.3.1. Baseline Survey
Baseline surveys were administered to all students in a classroom in two blocks. In the first block, examiners administered questionnaires to students in regard to age, gender, eyeglasses wear, awareness of refractive status, knowledge of vision care, and boarding status at school. The questionnaires also contained a place for an estimate of the number of hours that each student studied after class per day. In this study, we use this measure as a proxy for each student’s study intensity. Each student was asked to record how much time he or she spends studying outside of school, drawing from a list of options that included “0–0.5 h,” “0.5–2 h”, or “more than 2 h.” Students who recorded studying more than 2 h were considered to maintain high study intensity, whereas those who indicated studying for less than half an hour per day were considered students of low study intensity.
The first block of the survey also included a parent survey form in which parents reported their migration status, family asses, and education. We collected detailed information on the migration status of each student’s parents. Specifically, the questions asked whether each parent had been migrated out of the area for work during the past six months. Field observations and interviews with key informants suggest that for most rural laborers in the study area, if they are working and living away from home for at least six months, it is almost certain that they were actually away from home for most or all of the entire year [
26,
27]. As a way of cross checking, we asked the homeroom teacher to verify the information on the parental migration status of each student. In our overall sample, around 12.5% of children are left behind children (that is, both parents have out-migrated), just a bit lower than estimates of the average of representative rural areas in China (15.7%) [
28].
The household survey also collected information on value of family assets that students would likely have difficulty answering. Caregivers were asked to fill out a checklist of thirteen household consumption assets: automobile, truck, motor bike, tractor, farming equipment, computer, internet, television, camera, washing machine, air conditioner, water heater, gas stove, refrigerator, kitchen ventilator, and flushable toilet. A value was attached to each asset (based on the National Household Income and Expenditure Survey, which is organized and published by the China National Bureau of Statistics) to produce a single metric of household asset holdings. Summing the value of all household consumption assets then produced our proxy variable for family wealth value [
29]. We did so because recent studies suggest using household asset indicators for household wealth is more reliable than self-reported income [
30].
In the second block, examiners administered a test that we used to assess the mental health condition of each student. In our study, we measured mental health with an instrument that researchers in China term the Mental Health Test (MHT). The MHT was developed by Prof. Bucheng Zhou of East China Normal University, who adapted it from the General Anxiety Test developed by Kiyoshi Suzuki in Japan [
31]. The MHT is a variation of the Children’s Manifest Anxiety Scale, which is an internationally standardized test for the anxiety of children that has been widely used in the United States and other developed countries [
32]. The MHT also has been widely applied in China [
7,
30]. The test has a reliability of 0.84–0.88 and a retest reliability of 0.78–0.86. Among the subcategories of the scale, we pay special attention to learning anxiety and physical anxiety, which are the two most common anxieties among rural students in China [
30]. The use of eyeglasses would give myopic students a clear view of the blackboard and learning materials, thus potentially reducing their anxiety towards learning and physical health.
According to the MHT scale, learning anxiety refers to a student’s fear of examinations or excessive concerns about test scores. Such as, worried about passing exams successfully, feel unhappy when the test scores are not good, feel anxious when student cannot remember what he/she has learned during an examination, and worry about getting a poor score when taking an exam. Physical anxiety refers to a student’s excessive concerns about his/her body, such as: always worried about there is something wrong in his/her body, often think that other students are prettier or more handsome than him/her, find it difficult to sleep at night, and unwilling to take medicine.
During the analysis, we normalized the anxiety scores against the control group’s baseline distribution. Higher scores represent higher levels of anxiety.
At the same time as the baseline survey, a two-step eye examination was administered to all students in the randomly selected classes in all sample schools. In the first step, a team of two trained staff administered visual acuity (VA) screenings, using Early Treatment Diabetic Retinopathy Study eye charts. Students who failed the VA screening test (the cutoff is a VA of either eye of less than or equal to 6/12, or 20/40) were enrolled in a second vision test that was conducted at each school one to two days after the first test. The second vision test was conducted by a team of one optometrist, one nurse, and one assistant. It involved cycloplegic automated refraction with subjective refinement to determine prescriptions for children’s eligibility for eyeglasses (the cutoff for myopia is ≤−0.5 diopters [D]). The eye examination team was trained by Zhongshan Ophthalmic Center (ZOC) at Sun Yat-sen University.
2.3.2. Post-Treatment Survey
In May 2013, approximately seven months after the eyeglasses were dispensed, a post-treatment survey was conducted. The post-treatment survey followed the same protocol as the baseline survey. As in the baseline survey, the examiners collected post-treatment MHT scores. As in the case of the baseline survey, we normalized scores, using the control group’s baseline distribution.
As we were conducting the post-treatment survey, we also conducted an unannounced spot check to collect information on the eyeglasses wear of myopic students. We also conducted an unannounced spot check to collect information on the eyeglasses wear of myopic students. A team of two examiners was sent to schools in advance of the rest of the survey team. Examiners were given a list of the students diagnosed with myopia in the baseline and recorded individual-level information on whether each student wears eyeglasses regularly when studying and outside of class. Eyeglasses wear is a binary variable based on whether students wear eyeglasses regularly.
Right after the spot check, a survey that is similar to the baseline one was administered to all students in a classroom. In addition, being aware that misperceptions about wearing eyeglasses might lead myopic students to be teased by their classmates, we asked each student whether myopic students were being teased in his or her class. Being teased is a binary variable. We also collect data on whether students consider wearing eyeglasses to be good looking. Specifically, we define eyeglasses are good looking as a binary variable taking the value of one if a student thinks wearing eyeglasses is good looking.
2.4. Summary Statistics, Balance, and Attrition
Given our sampling strategy, the results of our baseline survey are representative of students in poor rural areas in China. As seen in
Table 1, students in our sample are, on average, 10.51 years old (or 10 years, 6 months), which suggests that students started primary school (Grade 1), on average, at 7 years old. In our overall sample, 52% are male, which is similar to the sex ratio across poor areas of rural China [
12]. In our sample, only 8.7% of mothers and 13.3% of fathers completed more than 12 years of education. For adults of this age, the levels of education are also typical as across China, where only 11.3% of individuals aged 25–64 from rural areas finished upper secondary education [
30]. Finally, in our overall sample, 12.5% of children are left-behind children (that is, both parents have out-migrated). This level is similar to (or slightly lower than) estimates of the share of children who are left behind in China (15.7%) [
18].
To identify students with vision problems, optometrists who worked with the survey team conducted eye examinations with all students in the 252 sample schools. Of the total number of students in the overall sample (19,934), 2851 (14.3%) were myopic to a degree that they could benefit from having eyeglasses; these students were included in our analysis (
Table 1).
Random assignment successfully created a sample balanced between the treatment and control groups. Using student individual characteristics, family characteristics, and student mental health scores,
Table 1 shows that the groups were similar in terms of the measured characteristics. A joint significance test across all baseline characteristics also confirms that the study arms are balanced. We test this by regressing treatment status on all baseline characteristics reported in
Table 1 and test that the coefficients on all characteristics were jointly zero. The p-value of this test is 0.2344 (treatment group vs. control group). The attrition rate of the sample between baseline and post-treatment was 3.9%. In the RCT literature, this attrition rate is considered low [
33].
Table A1 indicates that there are no statistically significant differences in the rates of attrition between the treatment group and control group. Further, as seen in
Table A2, baseline characteristics are still well balanced between the control and treatment groups in terms of non-missing observations. In a later analysis, we control for these variables in the regression.
2.5. Statistical Approach
We use ordinary least squares (OLS) regression analysis to estimate the treatment effect and heterogeneous impacts.
First, we compare the post-treatment standardized MHT scores and learning anxiety scores of students between the treatment and control schools, controlling for baseline standardized math test scores and a set of controls with strata effect and school effect.
The specification of the model is as follows:
where
is the post-treatment standardized MHT scores, learning anxiety scores, and physical anxiety scores for student
i at school p in stratum
j, treatment dummy
takes the value of 1 if students were provided with free eyeglasses, and
is the standardized MHT, learning anxiety, and physical anxiety scores in the baseline.
is a vector of other baseline characteristics (described in
Table 1).
Given that providing free eyeglasses might have a heterogeneous impact on students with different study intensity at baseline, we use the following model to estimate the heterogeneous treatment effect:
where we add interaction terms of the treatment dummy and the indicator functions of the subgroup of study intensity at baseline
, which takes three values: 1, 2 and 3. The parameter
is a measure of the impact of providing free eyeglasses on the subgroup of students who study at a low level of intensity (0 to 0.5 h of studying per day after class);
measures the impact on the subgroup of students who study at a medium level of intensity (0.5 to 2 h of studying per day after class); and
measures the impact on the subgroup of students who study at a high level of intensity (greater than 2 h of studying per day after class).
4. Conclusions
In this study, we use a cluster-RCT to measure the effect of an eyeglasses promotion program in 252 Chinese rural primary schools on the mental health condition of myopic students. On average, the treatment has small and insignificant for Learning Anxiety and MHT, and a small but significant reduction in Physical Anxiety.
These average treatment effects mask important heterogenous effects, however. Heterogeneous analysis on the amount of time that students spend in studying after school reveals that the program reduces both Learning Anxiety and Physical Anxiety among students who study with a high degree of intensity. Children who study less intensively are shown to experience an increase in Learning Anxiety. Increased teasing of less studious students following their acceptance of eyeglasses may explain their rise in anxiety.
The strengths of the current study include its large sample size and randomized design. The study of the mental health impacts of myopia correction also fills a gap in the literature concerning refractive error care among children, particularly as it relates to their study intensity. Although the sample area was large, caution must be used in extrapolating the results across all rural areas of China or beyond.
The study can inform policy on the provision of vision care in schools in important ways. It is clear from earlier analyses that the timely correction of myopia boosts academic outcomes for students [
1]. In-school screenings and the subsidization of eyeglasses are also important drivers of eyeglasses acceptance and wear. Wear rates among students who need eyeglasses remain well below 100% in most contexts. To boost wear rates and minimize negative spillovers on mental health for some students, care should be taken in the classroom to eliminate teasing of students who are newly wearing eyeglasses, and encouragement should be offered to students of all types to recognize their eyeglasses as the valuable learning asset that they are.