1. Introduction
Marine environmental protection is a very important sustainability issue for the entire world. Relatedly, enhancing ocean literacy (OL) is a very important task for ensuring the sustainability of marine environmental resources. The National Oceanic and Atmospheric Administration (NOAA) explicitly defines OL according to marine science as “an understanding of the ocean’s influence on you and your influence on the ocean” [
1,
2]. Kean, Posnanski, Wisniewski, and Lundberg [
3] also indicate that people with OL can understand the basic origins and fundamental concepts of the ocean, disseminate knowledge regarding the ocean through meaningful approaches, and make precise conclusions regarding the ocean and its resources [
2,
3].
Enhancing the OL of students or the public can also promote the “Life below water” objective of the UN’s sustainable development goals (SDGs) for international development [
4]. Before upgrading OL, we must firstly understand which factors affect students’ OL. The present study determined the influences of students and schools on the ocean literacy of Taiwanese senior high school students. Student and school data are nested, which means they are clustered or embedded together. When an individual student is selected as an analysis sample, this student is considered first-level data and the school or classroom group is considered second-level data. In this type of data structure, the OL performance of a student is profoundly influenced by the school environment, such as school location, school region (coastal or noncoastal), and school size, as well as personal factors, such as the student’s gender, reading habits, attitude toward the ocean (ATO), and their family’s socioeconomic status. Therefore, student characteristics and school factors could influence the learning process and OL performance of a student.
Taiwan is an island nation, and thus, the lives of its people and national development are closely linked to the ocean. However, investigations into whether students or the public possess sufficient marine knowledge or OL are relatively scarce, which suggests that research on marine knowledge or OL is of relatively low importance in Taiwan. In addition, marine education has not received enough attention compared with other subjects, which may be the result of it not being a mainstream subject, such as math and languages. Nevertheless, understanding the marine knowledge or OL of students, focusing on the importance of the ocean’s ecological environment, and equipping students and the public with basic OL are critical educational concerns.
In Taiwan, two studies [
5,
6] have investigated the influence of students’ personal characteristics on their OL performance. In addition, other studies [
6,
7] have demonstrated the influence of school factors on students’ OL. However, few studies have conducted research to explore the relationship between OL and students’ personal level and school level; even fewer studies have targeted Taiwanese senior high school students. Moreover, early literature on OL did not clearly reveal how the total variance was simultaneously accounted for by student and school levels. In this study, therefore, a two-level hierarchical linear model was utilized in order to concurrently evaluate the impacts of both the student and school levels on the OL of Taiwanese senior high school students.
The various factors that influence the OL performance of students exist in a multilevel relationship, and while previous studies have determined that both school-related and student-related factors have effects on OL, these two types of influential factor occurred simultaneously and could not be separated. If researchers separate the influence of school factors, whether the variance in senior high school students’ OL is accounted for more by school or student factors cannot be determined, and thus, this topic must be addressed.
1.1. Relationship between Student-Level Predictors and OL
Theoretical and empirical evidence [
5,
6,
7] has indicated that several student-level factors affect students’ OL, such as students’ gender, parental education level, ATO, and frequency of reading ocean-themed books and magazines.
Numerous studies [
8,
9,
10] have revealed that students’ attitudes positively and substantially influence their learning outcomes. In addition, positive learning attitudes and learning motivations are exceptionally helpful for students’ learning and can effectively improve learning outcomes. Greely used students’ ATO as a mediation factor to determine their influence on students’ OL [
8]. The results revealed that content knowledge and environmental attitudes were remarkably influential on OL performance. Fortner and Mayer conducted research into the relationship between students’ marine knowledge and ATO and Great Lakes, revealing an exceptional correlation [
9]. Moreover, students who had a more positive ATO scored higher on marine knowledge. In Taiwan, Tsai et al. applied structural equation modeling to analyze the correlation of the OL and attitudes of students aged between 16 and 18 years [
10]. The study revealed that students with more positive ATO scored higher on OL, which indicated that ATO has a powerful and positive influence on students’ OL.
The relationship between socioeconomic factors and OL has not been extensively discussed in the literature. Furthermore, parental education level is usually considered one of the most stable socioeconomic factors because it establishes its influence on children at a young age, which then remains consistent over time [
11,
12]. Kalender and Berberoglu regarded parental education level as a critical indicator of socioeconomic status and determined that it was a substantial variance in student learning outcomes [
13]. Numerous studies have emphasized the relationship of parental education level with the scientific achievements of students [
13,
14,
15].
In addition, the present study identified students’ gender and frequency of reading ocean-themed books or magazines as crucial factors. Relevant studies have discussed the difference between male and female students in terms of OL [
5,
7,
16]. Chang proved that the OL scores of male and female Taiwanese junior high school students were not notably different [
5]. However, Lwo et al. revealed that female students scored remarkably higher in oceanography than male students [
7]. Greely conducted research on an oceanography camp exclusively for 30 teenage girls and found that marine exploration and experiences notably improved the girls’ marine knowledge and ATO [
8]. Zelezny, Chua, and Aldrich surveyed 1293 teenagers and revealed gender differences in various aspects of environmental literacy as well as diverse points of view on environmental topics [
17]. Chang suggested that students who frequently read ocean-themed books or magazines outperformed their peers who did so less frequently [
5]. Furthermore, Steel et al. found that newspapers and the Internet are likely to improve citizens’ knowledge about the ocean, whereas television and radio broadcasts negatively affect marine knowledge improvement [
16].
1.2. Relationship between School-Level Predictors and Achievement
Several studies have revealed that school-level predictors, such as location, had a critical effect on students’ learning outcomes [
5,
16]. In the United States (US), Steel et al. conducted research on 1233 US citizens regarding OL knowledge and revealed that people who lived in coastal states generally believed they had superior marine and coastal knowledge compared with those who lived in noncoastal states [
16]. Moreover, their research results revealed that people who lived in coastal states had higher accuracy rates on OL tests than did those who lived in noncoastal states. In Taiwan, Chang defined coastal and noncoastal schools based on whether the administrative area of the school is located near the ocean [
5]. The results of Chang’s study showed that students who attended coastal schools scored significantly higher than those who did not.
In addition to whether the school is near the ocean, its scale and distance to a city are some other factors that affect students’ learning outcomes. Kyei and Nemaorani revealed a negative correlation between school location and students’ math scores; specifically, students’ performance at city schools was lower than that of suburban schools [
18]. Lamb and Fullarton revealed that students in rural areas scored higher in math than did those in the city [
19]. Beck and Shoffstall revealed superior performance of students in rural areas compared with that of students from city and suburban areas [
20]. The Nippon Foundation Ocean Policy Research Foundation conducted a census on marine education in 6707 Japanese high schools and elementary schools, and revealed a remarkably high correlation between school location and the cognition level of marine education [
21]. In other words, the closer the school was to the sea, the higher the students’ cognition level of marine education was. In addition, schools’ location and implementation of marine education were exceptionally correlated; the closer the school was to the sea, the more marine education-related courses it implemented (both through textbooks and extracurricular activities). However, no relevant studies have determined the relationship between school location and students’ OL.
1.3. Research Purposes
The objective of the present study was to use hierarchical linear model to determine the influence of the personal characteristics of Taiwanese senior high school students and school-level predictors on their OL performance. Hierarchical linear modeling is the most appropriate statistical method for analyzing data that are organized in more than one level [
11,
22]. Thus, this study employed hierarchical linear model to determine factors influencing OL from the perspectives of student and school levels. The three research questions were as follows:
- (1)
What degree of variance in OL are the selected school-level and student-level factors responsible for?
- (2)
Which student-level factors (e.g., gender, frequency of reading ocean-themed books or magazines, and parental education level) are significantly related to OL?
- (3)
Which school-level factors (e.g., region, size, location, and frequency of marine education activities) are significantly related to OL?
2. Materials and Methods
2.1. Measurement Instruments
The scale established in this study contained 40 general OL knowledge question items. Its structure was based on the substantive connotations of marine education topics in the guidelines for 12-year compulsory education and comprised five learning topics, namely marine leisure, marine society, marine culture, marine science and technology, and marine resources and sustainability. A total of 19 different fundamental concepts are used to illustrate and explicate these topics, with each topic being delineated through the presentation of a series of those basic concepts (
Table 1). A committee comprised of 15 members developed the questionnaire, with the members of the committee consisting of marine scientists, senior high school teachers, and both formal and informal marine educators. Moreover, the aforementioned five issues and the associated 19 basic concepts were the primary basis for the question items developed for the questionnaire. On this basis, the committee discussed and determined which concepts could be assessed by written tests before designing the test accordingly. After the first stage of development, three test evaluation experts were asked to review and revise the questionnaire to fit the principles of multiple-choice questions. Subsequently, five scholars and experts conducted further discussions and revisions on each revised item with respect to its content to reach a consensus and ensure that the items fit the basic concepts of OL. All items are multiple-choice questions that have one correct answer out of four choices. Each correct answer counts for one point and each wrong answer counts for zero points; the total score is 40.
Table 2 presents the number of items in the OL questionnaire that feature the five factors and their corresponding numbers. The aforementioned procedure indicated that the development of this questionnaire had content validity.
Before the official test, a pretest was conducted and its results were employed to revise the items once more to establish the reliability and validity of the questionnaire. A total of 466 senior high school students participated in the pretest. Both the Cronbach’s
coefficient and construct reliability of the pretest data analysis were 0.91, meaning that both values were above the respective threshold values of 0.8 and 0.60 advocated by Fornell and Larcker [
23]. In other words, the scale had optimal internal consistency. Additionally, the average variance extracted analysis result was 0.53, which was higher than the 0.5 recommended by Bagozzi and Yi [
24]. In short, the analytical results showed that, overall, the questionnaire developed for the study had acceptable reliability and convergent validity.
In addition, confirmatory factor analysis was applied to test the construct validity of the questionnaire. The questionnaire was analyzed under the assumption of a one-factor model. The hypothesized model was determined and was found to fit the data adequately, with the specific goodness-of-fit indices being as follows: confirmatory fit index (CFI) = 0.92; root mean square error of approximation (RMSEA) = 0.02; and standardized root mean square residual (SRMR) = 0.09. A CFI value higher than 0.90 indicates acceptable goodness of fit [
25]. With respect to RMSEA values, a value higher than 0.1 indicates poor fit, a value above 0.08 but below or equal to 0.1 indicates a mediocre fit, a value above 0.05 but below 0.08 indicates a fair fit, and a value below or equal to 0.05 indicates a good fit [
26]. An SRMR value lower than 0.05 indicates a good fit, whereas one lower than 0.1 is a fair fit [
25]. The results indicated that the goodness-of-fit indices were all acceptable, which also indicated that the questionnaire was unidimensional and exhibited construct validity. The pretest results were analyzed using the Rasch model of item response theory; the overall difficulty was between −3.157 and 1.564 and the questionnaire discrimination was between 0.097 and 0.507. In other words, the difficulty level of this questionnaire was medium to easy, which fit the original setting for questionnaire development.
In addition to the OL questionnaire, this study surveyed student background variances (i.e., gender and ATO) and school background variances (i.e., school size, school location, and marine education activities). The items for ATO were modified from the Trends in International Mathematics and Science Study (TIMSS) international survey [
27]. The TIMSS international survey used three items (I enjoy learning science; science is boring; and I like science) to define science attitudes and explore the sources of variability in science performance. Similarly, the current study obtained attitudes regarding marine science by asking students to indicate agreement on the three revised items. The three revised statements were as follows: I enjoy learning marine knowledge; marine science is boring; and I like marine science. Each item is based on a four-point Likert scale (1 = strongly disagree; 2 = disagree slightly; 3 = slightly agree; and 4 = strongly agree). The second item was scored reversely. Higher scores indicated students had more positive attitudes toward marine science. In the Taiwan Social Change Survey [
28], school location was categorized into six groups: 6 = core urban; 5 = general urban; 4 = emerging cities and townships; 3 = traditional industrial sector cities and townships; 2 = general townships and villages; and 1 = rural areas).
Table 3 presents the coding of all the variables used.
2.2. Study Procedure
To determine the student- and school-level factors that influenced OL, standardization of the research procedure was required. The questionnaire in this study employed the paper-and-pencil test method and targeted Taiwanese senior high school students as respondents, who had to complete the questionnaire and background variance survey within 50 minutes. Additionally, school principals were asked to help with answering the survey for the school (e.g., the number of marine education activities the school organized within the most recent year). The participating students first indicated their agreement to take part in the study, after which they then answered the questionnaire anonymously. The development of this questionnaire, including expert revisions, was conducted from March to December 2016. The pretest was set in May and June 2017. Pretest analysis was conducted immediately after and the results were used to revise the questionnaire items once more to finalize the official questionnaire. For the testing conducted with the official questionnaire, the examiners, all of whom were high school teachers who had undergone training in how to conduct standardized testing, were sent to the participating schools. In order to ensure the highest level of accuracy, this testing with the official questionnaire was conducted in May and June of 2018. The testing was conducted throughout four regions of Taiwan, specifically, the Northern, Southern, Eastern, and Central regions, with a stratified random sampling approach being used to obtain the samples. Following the testing, the survey results were first double-checked to confirm that the data provided were correct and then archived.
2.3. Participants
Taiwanese senior high school students were recruited to participate in the formal test. First, stratified random sampling was applied to the Northern, Central, Southern, and Eastern regions of Taiwan, recruiting a total of 99 schools and 2038 students to participate. Invalid responses and missing data were eliminated to obtain a total of 1994 valid samples, among which 1021 were from male students (51.2%) and 973 were from female students (48.8%). In addition, 600 students were from the Northern region (30.1%), 618 were from the Central region (31.0%), 504 were from the Southern region (25.3%), and 272 were from the Eastern region (13.6%).
2.4. Data Analysis
Observational data regarding educational situations usually exist in the form of nested data structures, with students being nested within schools or within classrooms. Therefore, neglecting the influence of factors from different structural levels on observations may cause mistakes in interpreting the statistical analysis and research results [
22]. To mitigate the influence of multilevel data, hierarchical linear model must be employed to analyze data in a multilevel structure [
22].
Regarding the data analysis in this study, descriptive statistics was applied to the surveyed data. Moreover, a two-level hierarchical linear model data analysis method, in which the students effectively provided the level-1 data and the schools provided the level-2 data, was employed. The hierarchical linear model analysis included four steps. In step one (model 1), the unconditional model (null model) with no predictors was utilized, with the two levels and the OL performance of the students being utilized as the dependent variables. This first step/model yielded a measure of the proportions of the variance in OL within and between the schools. In step two (model 2), the significance of the correlation between the OL and the variance was verified by inputting level-1 predictors into model 1. In the third step, relevant variances of level-2 data were introduced to model 2 to verify the influence of these variances on OL. In the final step, step four (the full model), all of the two-level variables were included in the model. To avoid bias in inferring the population characteristics, a multiple imputation procedure was employed when data were missing.
4. Discussion
In the present study, a two-level hierarchical linear model was utilized to conduct an analysis and evaluation of how both the personal characteristics of students and school-level factors affect the OL of Taiwanese senior high school students. The results revealed that approximately three-quarters of the overall variance were attributed to differences between students and a quarter was attributed to differences between schools. Regarding student-level factors, ATO and reading ocean-themed books or magazines significantly affected students’ OL performance, and regarding school-level factors, school region and school location were substantial predictors of students’ OL.
Among the student-level factors, ATO and reading ocean-themed books or magazines were considerably influential, which supports the results of relevant studies [
8,
9,
10]. Students with a more positive ATO also scored higher in OL. Teacher or parental efforts in nurturing student learning attitudes remarkably improve the learning outcomes of various subjects. Enhancing students’ positive ATO eliminates any fear of the ocean they might have and increases their OL performance. Therefore, the outcome of nurturing positive learning attitudes in students is exceptional. Furthermore, the results revealed that reading ocean-themed books or magazines is a crucial factor that affects students’ OL; students reading ocean-themed books or magazines frequently outperformed peers who did so less frequently.
Regarding school-level factors, school region and school location were substantial predictors for OL. However, our results were inconsistent with those of other studies in terms of school region [
7,
16]. Steel et al. revealed that US citizens living in coastal states had more marine and coastal knowledge as well as higher OL scores [
16]. Moreover, the results of Chang showed that junior high school students who attended coastal schools scored significantly higher than those who did not [
7], whereas the present study revealed that the OL performance of students from coastal senior high schools was inferior to that of students from noncoastal schools. Another factor influencing students’ OL performance is school location. This study’s results revealed that OL performance declined as school location moved toward rural areas. In other words, senior high school students in schools closer to core urban areas scored higher in the OL questionnaire. These results were inconsistent with the Nippon Foundation Ocean Policy Research Foundation study [
21]. Considering the abovementioned two indicators, the authors speculated that the geographic environment of Taiwan is closely related to these results. As an island nation, Taiwan is surrounded by the ocean. Therefore, even if a school is not located in a coastal region, students can still reach the coast in two or three hours by public transport or with their parents by car. However, the urban–rural gap has a greater effect, particularly because in Taiwan schools closer to urban areas receive more educational resources than do those located in rural areas. Moreover, coastal regions mostly feature fishing villages, which are more likely to be classified as general townships and villages or rural areas. As a result, even if a school was located in a coastal region, marine education resources for its students are fewer than those for students in schools in core urban areas. Therefore, marine knowledge acquisition and students’ OL performance were affected by school location rather than school region. The OL survey results obtained were consistent with relevant studies on student learning outcomes [
29,
30], which indicated that Taiwanese students’ performance diminished from cities, towns, villages, to remote villages.
The questionnaire used in this study was developed through a rigorous process that ensured its compliance with various psychometric criteria (e.g., reliability and validity). Therefore, the study can help teachers to understand their students’ ocean literacy levels, and to adopt effective measures that cater to the varying levels of ocean literacy among their students. In this manner, teachers will be able to provide the appropriate guidance and assistance, such that the educational objective of teaching according to individual differences is met. The study limited its discussion to student- and school-related factors since it only focused on the effects of these factors on ocean literacy. However, there are in fact a variety of other factors that also influence the performance of students. Many studies have indicated that the teachers who provide instruction, particularly those with teaching experience and relevant majors, can significantly influence the learning outcomes of students. For this reason, future research should simultaneously investigate student-, teacher-, and school-related factors and utilize three-level HLM to analyze the data collected, so as to understand the influence of three-level variables on ocean literacy. The study’s second limitation relates to the use of Taiwan-based marine education topics as the testing framework for ocean literacy, and the collection of data only from Taiwanese students, which meant that it was not possible to compare the ocean literacy performance of students from different countries. However, given that the National Marine Electronics Association (NMEA) has already published the definition of ocean literacy and the ocean literacy principles for grades K–12, future research could compare the content differences between Taiwan’s marine education curriculum and the NMEA’s ocean literacy principles, and seek to develop assessment tools for both areas that are similar and different. This will facilitate future cross-border comparisons of students’ ocean literacy. The third research limitation has to do with the fact that this study was a cross-sectional study. Going forward, longitudinal studies could be conducted to explore the long-term development of ocean literacy among students. This will not only enable us to further understand the development of ocean literacy among senior high students, but also allow us to form a more accurate picture of the development process that these students undergo with respect to ocean literacy. Furthermore, such efforts will also contribute to the generation of normative developmental data regarding the ocean literacy of students, which will be useful to front-line educators.