Next Article in Journal
How to Improve the Corporate Sustainable Development?—The Importance of the Intellectual Capital and the Role of the Investor Confidence
Previous Article in Journal
Estimating the Total Volume of Running Water Bodies Using Geographic Information System (GIS): A Case Study of Peshawar Basin (Pakistan)
Previous Article in Special Issue
OKAPI, an Emotional Education and Classroom Climate Improvement Program Based on Cooperative Learning: Design, Implementation, and Evaluation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Adolescents’ Emotions in Spanish Education: Development and Validation of the Social and Emotional Learning Scale

by
Francisco D. Fernández-Martín
1,
Antonio-José Moreno-Guerrero
2,
José-Antonio Marín-Marín
2 and
José-María Romero-Rodríguez
2,*
1
Department of Developmental and Educational Psychology, University of Granada, 18071 Granada, Spain
2
Department of Didactics and School Organization, University of Granada, 18071 Granada, Spain
*
Author to whom correspondence should be addressed.
Sustainability 2022, 14(7), 3755; https://doi.org/10.3390/su14073755
Submission received: 14 January 2022 / Revised: 17 March 2022 / Accepted: 17 March 2022 / Published: 22 March 2022

Abstract

:
The aim of this study was to develop and validate a scale for measuring the different areas of competence of the social and emotional learning model in students in compulsory secondary education. For this purpose, following the recommendations and quality standards established by the specialised literature, the Social and Emotional Learning Scale was constructed and administered to a convenience sample of 1385 students in compulsory secondary education. The results reveal adequate reliability of the instrument and fairly satisfactory fit indices for the structural model proposed. In addition, external evidence is provided for the validity of the instrument with the variables life satisfaction and school performance. The Social and Emotional Learning Scale is of satisfactory metric quality and provides a detailed and consolidated picture of adolescents’ level of self-awareness, social awareness, self-control, interpersonal skills and responsible decision making, which provides students with an instrument that can help to understand their interpersonal and intrapersonal skills and to establish mechanisms for their improvement.

1. Introduction

The need to urgently address the increasingly worrying incidence of social, emotional and behavioural problems among pupils in compulsory education, as well as to stimulate protective factors that increase their productivity and well-being, has led educational professionals in recent years to considerably increase their interest in social and emotional learning [1,2,3,4]. This component of students’ personal and socioemotional development involves the ability to coordinate cognition, affect and behaviour [5], and is conceived as the process through which a person acquires and effectively uses the knowledge, skills and attitudes necessary to develop healthy identities, manage emotions, formulate and achieve positive personal and collective goals, feel and show empathy for others, initiate and maintain positive and supportive interpersonal relationships, manage interpersonal situations constructively and make responsible and caring decisions [6,7,8,9,10].

2. Literature Review

Social and emotional learning equips learners with the necessary tools to deal effectively and efficiently with the various tasks and challenges of their daily lives, leading to increased performance and satisfaction [2,3,10]. In fact, the accumulated evidence from basic and applied research on this construct has led to a rapid and wide diversification and incorporation in schools of programmes and practices aimed at promoting the following socioemotional competences among their students [1,5,6,11]: (a) self-awareness, i.e., the skills to accurately recognise one’s own emotions, thoughts, values and how they influence behaviour, including the skills to assess one’s own strengths and limitations with confidence, optimism and a growth mindset; (b) social awareness, seen as the skills to empathise with and understand the perspective of others, from diverse contexts and cultures, including the skills to defend one’s own ideas without belittling others; (c) self-control, or the ability to successfully regulate one’s emotions, thoughts and behaviour in different situations, including the skills to set school goals and work towards their achievement, with self-discipline and self-motivation, using planning and organisational strategies; (d) interpersonal skills, conceived as the skills to establish and maintain healthy and nurturing relationships with diverse individuals and groups, including the ability to communicate clearly and effectively, listen actively and cooperate with others; and (e) responsible decision making, i.e., the skills to make constructive decisions about personal behaviour and social interactions based on ethical standards, safety and social norms, including the realistic assessment of the consequences of various actions and consideration of personal well-being and that of others, as well as the identification of problems, proposal of solutions and implementation of actions that contribute to the improvement of the immediate environment.
Social and emotional learning is a strong predictor of school achievement and is strongly related to psychological well-being and high levels of curiosity, motivation, optimism, creativity and prosocial behaviour among children and adolescents from diverse racial, ethnic and socioeconomic backgrounds, with and without emotional and behavioural problems, from different educational levels and environments [11]. This is reflected in the many systematic reviews that have been carried out to determine the impact of intervention measures based on this socioemotional component [8,9,12,13,14,15,16,17,18,19,20,21].
For their part, numerous studies have established causal links between programmes and practices based on the social and emotional learning model and certain improvements in the socioemotional, behavioural and school level of their participants, even generating effects on the rest of the members of the educational community (e.g., in the case of teachers, higher rates of effectiveness and achievements in their teaching planning have been identified).
Evidently, for the evaluation of the effectiveness of such programmes and practices, various measurement instruments have been used for the different competence areas of the social and emotional learning model (i.e., self-awareness, social awareness, self-control, relationship skills and responsible decision making). Among these, the batteries, surveys and guides developed by CASEL [22], Panorama Education [23] or the Organisation for Economic Co-operation and Development [3] should be highlighted at an international level. However, the evaluative research on social and emotional learning carried out in the Spanish context has relied more on the use of other instruments [15], such as the Emotional Intelligence Inventory [24], the Socialization Battery 3 [25] or the Trait Emotional Intelligence Questionnaire [26], tests that unfortunately do not assess all the areas of competence of this model. This has stimulated the frequent use of the Social Emotional Competence Questionnaire [27] in recent years, despite the fact that its adaptation and validation have proven to be inconclusive in the Spanish population [28,29].
Therefore, in response to the growing interest of Spanish professionals and educational centres in the implementation of programmes, practices and actions based on the social and emotional learning model, especially as a preventive measure against the problems of educational exclusion that their students usually present [3,4], it seems essential to develop self-report measures to assess their effectiveness on socioemotional competences. Specifically, the purposes of this research were, firstly, to develop a scale to measure the different areas of competence of the social and emotional learning model (i.e., self-awareness, social awareness, self-control, relationship skills and responsible decision making) of students in compulsory secondary education; and secondly, to validate the theoretical framework and examine the psychometric properties of the scale in a sample of students in compulsory secondary education.

3. Method

3.1. Participants

The sample consisted of 1385 students in compulsory secondary education, of whom 362 were in the first year (26.14%), 358 in the second year (25.84%), 339 in the third year (24.48%) and 326 in the fourth year (23.54%) in five secondary schools in the autonomous city of Ceuta (Spain). The mean age of the participants was 15.77 years (SD = 1.66), ranging from 12 to 18 years, while their gender distribution was 797 males (57.54%) and 588 females (42.46%).
The sample selection procedure was non-probabilistic, by convenience [30], while the sample size was determined according to the objective of the work, being above the minimum established in different simulation studies for structural models similar to those proposed in this work [31]. However, for greater certainty, the minimum sample size required for the structural complexity of the specified model was calculated (N = 200), considering the number of observed (30) and latent (5) variables, the expected effect size (0.10), the associated probability (0.05) and the desired levels of statistical power (0.80) [32].

3.2. Measures

The Social and Emotional Learning Scale is a Likert-type scale consisting of 30 items of estimation scored with 1 to 4 points (i.e., 1 = never; 2 = occasionally; 3 = often; 4 = always), grouped into 5 areas of socioemotional competence, such as self-awareness, social awareness, self-control, relationship skills and responsible decision making. This instrument, whose psychometric properties are presented in this research work, has been constructed with the purpose of measuring the different areas of competence of the social and emotional learning model in students in compulsory secondary education.
The Spanish adaptation of the Life Satisfaction Scale is a Likert-type scale composed of 5 items of estimation scored with 1 to 7 points (i.e., 1 = do not agree at all; 2 = disagree; 3 = slightly disagree; 4 = neither agree nor disagree; 5 = slightly agree; 6 = agree; 7 = strongly agree), which yields a total score for each participant considering the average of its items [33]. This scale was chosen because it is one of the few that measures subjective well-being or level of life satisfaction in adolescents and young adults, as well as for the adequacy of its psychometric properties, i.e., a Cronbach’s alpha (α) of 0.85 and tests showing excellent goodness-of-fit indices that confirm its internal structure [33]. In the sample of this study, it yielded an α of 0.82 and a McDonald’s omega (ω) of 0.83, while the Confirmatory Factor Analysis (CFA) showed adequate goodness-of-fit indices and statistics: chi-square (χ2) (5; N = 1385) = 6.13; p < 0.29; χ2/degrees of freedom (df) = 1.24; Comparative Fit Index (CFI) = 0.99; Goodness of Fit Index (GFI) = 0.98; Standardised Root Mean Squared Residual (SRMR) = 0.03; Root Mean Squared Error of Approximation (RMSEA) = 0.02 (90% confidence interval (CI) = 0.00–0.08).
The Sociodemographic and School Data Questionnaire is an ad hoc self-report composed of five items with different response alternatives, aimed at collecting relevant sociodemographic (i.e., age and gender) and school (i.e., secondary school, grade and performance in the last grade) information from the participants.

3.3. Design and Procedure

In this work, as part of a research project aimed at evaluating the impact of a social and emotional learning programme among students in compulsory secondary education, an instrumental methodological design was adopted [34]. This research was approved by the Ethics Committee of the University of Granada (1736/CEIH/2020).
The construction and validation process of the Social and Emotional Learning Scale was developed following the recommendations and quality standards established by the specialised literature [35]. In this sense, in a first phase, as a result of a systematic review, the operational definition of the construct was established, identifying and defining its facets or domains.
In the second phase, once the requirements for the application of the instrument had been determined, the items for the different areas of competence or domains of social and emotional learning were developed. To this end, 23 items from the instruments specified below were initially adapted linguistically and culturally: (a) Social Emotional Competence Questionnaire [27]; (b) Brief Self-Control Scale [36]; (c) Brief Version of the Revised Social Problem Solving Inventory [37]; (d) Youth Teamwork Scale [38]; and (e) Civic Engagement Scale [39]. The procedure that we followed for the adaptation of these items was back-translation [40], which involved the following actions: (a) two professional translators independently generated their own Spanish version of the items; (b) the linguistic and cultural equivalence of these translations was reviewed and analysed by three specialists, who, after making some adjustments, proposed a consensus translation, on which a third professional translator performed a back translation into English; and (c) the degree of comprehensibility of the items in Spanish was assessed by a committee of three specialists. Subsequently, 7 new items were constructed to reflect the specific characteristics of the competence areas of the social and emotional learning model for students in compulsory secondary education.
In the third phase, four international experts examined the content validity of the Social and Emotional Learning Scale by assessing the representativeness, relevance, diversity, clarity, simplicity and comprehensibility of the items, as well as the need to eliminate or include items for any of the competence areas [35]. The Social and Emotional Learning Scale was modified several times until it was in line with the experts’ comments, finally confirming its approval. A pilot study was also carried out with a small sample of students in compulsory secondary education (N = 46). This pilot test allowed us to confirm the direction and meaning of the psychometric properties of the Social and Emotional Learning Scale, the approximate time needed to complete it and the appropriate content and format of its items [35].
Finally, in the fourth phase, once the relevant institutional permissions had been requested and granted, the management teams of the city’s secondary schools were contacted in order to request their voluntary participation in the research. For this, the purpose and procedure to be carried out in the study were explained to them, and then, once they had accepted the proposal to participate, they signed the agreements and informed consent forms. The families or guardians of the compulsory secondary education pupils were also informed and signed the appropriate informed consent forms. The instruments were administered collectively, during class time, in each of the participants’ reference class groups using the computer-assisted web interview technique [41]. This process was carried out by a member of the research team, who first informed the compulsory secondary school students of the purpose of the study, the voluntary nature of their participation and the confidentiality of their responses. The written instructions were then supplemented with oral explanations by the researcher and the questions raised by the participants were answered. They completed the Social and Emotional Learning Scale in 20–25 min. Data were collected in February 2021. The psychometric properties of the Social and Emotional Learning Scale were assessed, and then we used the scale to study the different areas of socioemotional competence in the participants.

3.4. Data Analysis

First, descriptive analysis of the collected data was performed, and the data were checked for distribution, linearity, outliers, missing and influential values [42]. Second, in order to examine the theoretical structure of the Social and Emotional Learning Scale, a CFA of five first-order correlated factors was carried out. The CFA was estimated by the Weighted Least Squares (WLS) method, using different indices to assess its goodness of fit [43,44]: (a) χ2, which should not be statistically significant, although due to its sensitivity to sample size, the χ2/df ratio can also be considered, which should be less than 5 points; (b) CFI and GFI, which should yield values above 0.90 points; and (c) SRMR and RMSEA, which should yield values below 0.08 points.
Third, to assess the reliability of the Social and Emotional Learning Scale, internal consistency and composite reliability were calculated. Specifically, to assess internal consistency, we calculated the α and ω, which should yield coefficients greater than 0.70, while to assess composite reliability, we used the Composite Reliability Index (CRI) and the Average Variance Extracted (AVE), which should have values greater than 0.70 and 0.50, respectively [45].
Fourthly, in order to obtain external evidence of validity of the Social and Emotional Learning Scale, the different competence areas of the social and emotional learning model (i.e., self-awareness, social awareness, self-control, interpersonal skills and responsible decision making) were correlated (Pearson’s r) with others theoretically linked to this factor in the literature, such as life satisfaction and school performance. Likewise, after checking the absence of normal distribution in the scores by means of the Kolmogorov–Smirnov test, the Mann–Whitney U-test for 2 independent samples and the Kruskal–Wallis H-test for independent samples were performed in order to identify differences in the areas of competence of the model according to the variables sex, age and school performance. However, given the impossibility of performing multivariate contrasts, the error rate per family, resulting from the multiple comparisons problem, was controlled with the Bonferroni correction.
Statistical analyses were performed using the Statistical Package for Social Sciences (SPSS) v26 (IBM Corp., Armonk, NY, USA), JASP v0.11.1 (The JASP Team, Amsterdam, The Netherland) and STATA v17 (StataCorp., College Station, TX, USA).

4. Results

Descriptive statistics for the different items of the Social and Emotional Learning Scale are shown in Table 1. The skewness and kurtosis values, as well as the Kolmogorov–Smirnov statistic, reveal a non-normal univariate distribution for all items, while the multivariate Mardia skewness (47.47, χ2 = 10,983.17; p < 0.001) and kurtosis (1083.88; χ2 = 2767.60; p < 0.001) coefficients indicate that the joint distribution of the items is not normal; (χ2 = 10,983.17; p < 0.001) and kurtosis (1083.88; χ2 = 2767.60; p < 0.001) indicate that the joint distribution of the items does not conform to the multivariate normal distribution, justifying the choice of the WLS estimator for the CFA. No missing values were detected, and outliers identified through the Mahalanobis distance were processed using robust estimators. Descriptive analysis of the items reveals mean scores ranging from 2.36 (SD = 1.01) for item 28 to 3.49 (SD = 0.75) for item 4. In turn, the results of the CFA model of five first-order correlated factors yield quite satisfactory goodness-of-fit indices and statistics: χ2 (395; N = 1385) = 1087.29; p > 0.05; χ2/df = 2.75; CFI = 0.97; GFI = 0.98; SRMR = 0.05; RMSEA = 0.04 (90% CI = 0.03–0.04). All items showed factor loadings above 0.4 (Table 1). The correlations between the different competence areas of the Social and Emotional Learning Scale ranged from 0.38 (self-awareness and social awareness) to 0.70 (self-awareness and self-control).
Regarding the internal consistency of the Social and Emotional Learning Scale, the results reveal an α and ω of 0.90 for the total scale, with scores ranging from 0.70 in the area of self-awareness competence to 0.84 in the area of self-control competence, although it is necessary to mention that the elimination of any item would generate a reduction in these coefficients.
On the other hand, the results related to the external evidence of validity of the instrument reveal a consistent pattern of positive relationships between the different areas of competence of the Social and Emotional Learning Scale, including between them and the rest of the variables included in the study (i.e., level of life satisfaction and school performance). The LRC and AVE are also shown (Table 2).
Finally, the significance level for each of the multiple comparison tests was adjusted with the Bonferroni correction, being 0.01 for the different contrasts (0.05/5). In this line, the results of the comparisons according to the gender variable reveal statistically significant differences in favour of females in the area of social awareness competence (U = 204,839.00, p < 0.01), as well as in favour of males in the area of self-control competence (U = 213,923.50, p < 0.01), while according to the age variable, no statistically significant differences were observed. Similarly, statistically significant differences were found in the different competency areas of the Social and Emotional Learning Scale as a function of school performance, with participants with higher school performance scoring higher in the competency areas of the model (Table 3).

5. Discussion and Conclusions

The purpose of this research was to develop and validate a scale aimed at measuring the different areas of competence of the social and emotional learning model (i.e., self-awareness, social awareness, self-control, relationship skills and responsible decision making) in students in compulsory secondary education. Therefore, based on the results obtained, the main conclusion of this study is that the Social and Emotional Learning Scale has an adequate metric quality, with satisfactory levels of validity and reliability.
Indeed, the factor structure of the Social and Emotional Learning Scale model, with a high level of similarity to that of the Social Emotional Competence Questionnaire [27], yielding an excellent fit of the proposed structural model, provides evidence in favour of the instrument and the underlying theoretical construct measure [43], while reliability shows adequate levels of internal consistency and composite reliability of the instrument as a whole and in each of the different competence areas of the social and emotional learning model [45]. Therefore, these results support its use to assess socioemotional competencies in adolescents, i.e., how they are aware of themselves and others, as well as to measure how they respond to the contexts of family, school and community, in personal, social and ethical terms [1,5,6,7,8,9,10].
In terms of external evidence of the validity of the Social and Emotional Learning Scale, the different competency areas of the social and emotional learning model were shown to be positively linked to the level of life satisfaction and school achievement, as reported in the literature [2,3]. These results clearly show that social and emotional learning stimulates students to develop the tools they need to successfully deal with different situations in their school and personal lives [2,10]. Hence, over the past few years, a huge number of programmes and practices based on this model have proliferated as intervention measures to address the problems of educational exclusion that students in compulsory education often present [3,4].
Nevertheless, in conclusion, it can be stated that the empirical evidence provided in this work supports the use of the Social and Emotional Learning Scale to obtain a detailed and consolidated picture of adolescents’ level of self-awareness, social awareness, self-control, interpersonal skills and responsible decision making. Likewise, this research represents an advance in evaluative research on this construct in the Spanish context [15], especially considering the absence of adequate instruments to evaluate the effectiveness of social and emotional learning programmes and practices. This scale is a tool that, in addition to measuring the different areas of competence of the social and emotional learning model, can help to predict certain improvements at the socioemotional, behavioural and school levels in students in compulsory secondary education and, therefore, increase performance and success in different domains or environments (e.g., school, work, personal, etc.).

Limitations and Future Studies

When using the Social and Emotional Learning Scale, and also with a view of future research, it is necessary to take into account certain aspects. Firstly, in relation to the linguistic and cultural adaptation of the items, the results of other research carried out in the Spanish context could not be considered, as recommended by López-Walle et al. [46].
Secondly, with regard to the characteristics of the participants, their homogeneity may have affected the results obtained with respect to the psychometric properties of the instrument, which may generate limitations when used with other populations. In this sense, in future research, it would be appropriate to extend the analyses of the psychometric properties of the Social and Emotional Learning Scale (e.g., temporal stability or test/retest reliability, predictive validity on other psychological and educational variables), as well as to replicate and refine the results obtained in this study with larger and more representative samples from a probability sampling.

Author Contributions

Conceptualisation, J.-M.R.-R. and A.-J.M.-G.; methodology, J.-A.M.-M. and F.D.F.-M.; software, A.-J.M.-G.; formal analysis, J.-A.M.-M.; investigation, A.-J.M.-G., J.-A.M.-M., F.D.F.-M. and J.-M.R.-R.; writing—original draft preparation, A.-J.M.-G., J.-A.M.-M. and J.-M.R.-R.; writing—review and editing, A.-J.M.-G., J.-A.M.-M., F.D.F.-M. and J.-M.R.-R.; visualisation, F.D.F.-M.; supervision, J.-M.R.-R. All authors have read and agreed to the published version of the manuscript.

Funding

This work was funded by Porticus and the Tomillo Foundation, through the R+D+i Project entitled Evaluation of the Itinerario + Educational Model—Phase I.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by Ethics Committee of University of Granada (protocol code 1736/CEIH/2020, approved on 4 November 2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Jagers, R.J.; Rivas-Drake, D.; Williams, B. Transformative Social and Emotional Learning (SEL): Toward SEL in service of educational equity and excellence. Educ. Psychol. 2019, 54, 162–184. [Google Scholar] [CrossRef]
  2. Oberle, E.; Domitrovich, C.E.; Meyers, D.C.; Weissberg, R.P. Establishing systemic social and emotional learning approaches in schools: A framework for schoolwide implementation. Camb. J. Educ. 2016, 46, 277–297. [Google Scholar] [CrossRef]
  3. Organisation for Economic Co-operation and Development. Beyond Academic Learning: First Results from the Survey of Social and Emotional Skills; OECD Publishing: Paris, France, 2021. [Google Scholar] [CrossRef]
  4. Tarabini, A.; Jacovkis, J.; Montes, A. The Factors of Educational Exclusion in Spain: Mechanisms, Profiles and Spaces for Intervention; UNICEF: Madrid, Spain, 2017; Available online: https://www.unicef.es/sites/unicef.es/files/comunicacion/Factores_de_exclusion_educativa_en_espana.pdf (accessed on 13 January 2022).
  5. Mahoney, J.L.; Weissberg, R.P.; Greenberg, M.T.; Dusenbury, L.; Jagers, R.J.; Niemi, K.; Schlinger, M.; Schlund, J.; Shriver, T.P.; VanAusdal, K.; et al. Systemic Social and Emotional Learning: Promoting educational success for all preschool to high school students. Am. Psychol. 2020, 76, 1128–1142. [Google Scholar] [CrossRef]
  6. Collaborative for Academic, Social, and Emotional Learning. CASEL’s SEL Framework. 2021. Available online: https://casel.org/sel-framework/ (accessed on 13 January 2022).
  7. Durlak, J.A.; Weissberg, R.P.; Dymnicki, A.B.; Taylor, R.D.; Schellinger, K.B. The impact of enhancing students’ social and emotional learning: A Meta-Analysis of school-based universal interventions. Child Dev. 2011, 82, 405–432. [Google Scholar] [CrossRef]
  8. Payton, J.; Weissberg, R.P.; Durlak, J.A.; Dymnicki, A.B.; Taylor, R.D.; Schellinger, K.B.; Pachan, M. The Positive Impact of Social and Emotional Learning for Kindergarten to Eighth-Grade Students: Findings from Three Scientific Reviews; Collaborative for Academic, Social, and Emotional Learning: Chicago, IL, USA, 2008. [Google Scholar]
  9. Taylor, R.D.; Oberle, E.; Durlak, J.A.; Weissberg, R.P. Promoting positive youth development through school-based social and emotional learning interventions: A meta-analysis of follow-up effects. Child Dev. 2017, 88, 1156–1171. [Google Scholar] [CrossRef]
  10. Weissberg, R.P.; Durlak, J.A.; Domitrovich, C.E.; Gullotta, T.P. Social and emotional learning: Past, present and future. In Handbook of Social and Emotional Learning: Research and Practice; Durlak, J.A., Domitrovich, C.E., Weissberg, R.P., Gullotta, T.P., Eds.; Guilford Press: New York, NY, USA, 2015; pp. 3–19. [Google Scholar]
  11. National Commission on Social, Emotional, and Academic Development. From a Nation at Risk to a Nation at Hope; The Aspen Institute: Washington, DC, USA, 2019; Available online: http://nationathope.org/wp-content/uploads/2018_aspen_final-report_full_webversion.pdf (accessed on 13 January 2022).
  12. Corcoran, R.P.; Cheung, A.C.K.; Kim, E.; Xie, C. Effective universal school-based social and emotional learning programs for improving academic achievement: A systematic review and meta-analysis of 50 years of research. Educ. Res. Rev. 2018, 25, 56–72. [Google Scholar] [CrossRef]
  13. Diekstra, R.F.W. Effectiveness of school-based social and emotional education programmes worldwide. In Social and Emotional Education: An International Analysis; Clouder, C., Ed.; Fundacion Marcelino Botin: Cantabria, Spain, 2008; pp. 255–312. [Google Scholar]
  14. Durlak, J.A.; Weissberg, R.P.; Pachan, M. A meta-analysis of after-school programs that seek to promote personal and social skills in children and adolescents. Am. J. Commun. Psychol. 2010, 45, 294–309. [Google Scholar] [CrossRef]
  15. Fernández, F.D.; Romero-Rodríguez, J.M.; Marín, J.A.; Gómez, G. Social and emotional learning in the Ibero-American context: A systematic review. Front. Psychol. 2021, 12, 738501. [Google Scholar] [CrossRef]
  16. Jagers, R.J.; Harris, A.; Skoog, A. A review of classroom-based SEL programs at the middle school level. In Handbook of Social and Emotional Learning: Research and Practice; Durlak, J.A., Domitrovich, C.E., Weissberg, R.P., Gullotta, T.P., Eds.; Guilford Press: New York, NY, USA, 2015; pp. 167–180. [Google Scholar]
  17. Murano, D.; Sawyer, J.E.; Lipnevich, A.A. A meta-analytic review of preschool social and emotional learning interventions. Rev. Educ. Res. 2020, 90, 227–263. [Google Scholar] [CrossRef]
  18. Sabey, C.V.; Charlton, C.T.; Pyle, D.; Lignugaris-Kraft, B.; Ross, S.W. A review of classwide or universal social, emotional, behavioral programs for students in kindergarten. Rev. Educ. Res. 2017, 87, 512–543. [Google Scholar] [CrossRef]
  19. Sklad, M.; Diekstra, R.; De Ritter, M.; Ben, J.; Gravesteijn, C. Effectiveness of school-based universal social, emotional, and behavioral programs: Do they enhance students’ development in the area of skill, behavior, and adjustment? Psychol. Sch. 2012, 49, 892–909. [Google Scholar] [CrossRef]
  20. Wigelsworth, M.; Lendrum, A.; Oldfield, J.; Scott, A.; ten Bokkel, I.; Tate, K.; Emery, C. The impact of trial stage, developer involvement and international transferability on universal social and emotional learning programme outcomes: A meta-analysis. Camb. J. Educ. 2016, 46, 347–376. [Google Scholar] [CrossRef]
  21. Yang, W.P.; Datu, J.A.D.; Lin, X.Y.; Lau, M.M.; Li, H. Can early childhood curriculum enhance social-emotional competence in low-income children? A meta-analysis of the educational effects. Early Educ. Dev. 2019, 30, 36–59. [Google Scholar] [CrossRef]
  22. Collaborative for Academic, Social, and Emotional Learning. SEL Assessment Guide. 2021. Available online: https://measuringsel.casel.org/access-assessment-guide/ (accessed on 13 January 2022).
  23. Panorama Education. Survey Instruments; Panorama Education: Boston, MA, USA, 2021; Available online: https://www.panoramaed.com/resources (accessed on 13 January 2022).
  24. Bar-On, R.; Parker, J.D.A. EQ-i: YV. Inventario de Inteligencia Emocional de Bar-on: Versión Para Jóvenes; TEA Ediciones: Madrid, Spain, 2018. [Google Scholar]
  25. Silva, F.; Martorell, M.C. Batería de Socialización; TEA Ediciones: Madrid, Spain, 1995. [Google Scholar]
  26. Petrides, K.V. Psychometric properties of the Trait Emotional Intelligence Questionnaire (TEIQue). In Assessing Emotional Intelligence; Parker, J., Saklofske, D., Stough, C., Eds.; Springer: Berlin/Heidelberg, Germany, 2009; pp. 85–101. [Google Scholar] [CrossRef]
  27. Zhou, M.; Ee, J. Development and validation of the Social Emotional Competence Questionnaire (SECQ). Int. J. Emot. Educ. 2012, 4, 27–42. [Google Scholar]
  28. Aguilar, P.; López-Cobo, I.; Cuadrado, F.; Benítez, I. Social and emotional competences in Spain: A comparative evaluation between Spanish needs and an international framework based on the experiences of researchers, teachers, and policymakers. Front. Psychol. 2019, 10, 2127. [Google Scholar] [CrossRef]
  29. Zych, I.; Ortega-Ruiz, R.; Muñoz-Morales, R.; Llorent, V. Dimensions and psychometric properties of the Social and Emotional Competencies Questionnaire (SEC-Q) in youth and adolescents. Rev. Latinoam. Psicol. 2018, 50, 98–106. [Google Scholar] [CrossRef]
  30. Kalton, G. Introduction to Survey Sampling; Sage: Riverside County, CA, USA, 2020. [Google Scholar]
  31. Tomarken, A.J.; Waller, N.G. Structural equation modeling: Strengths, limitations, and misconceptions. Annu. Rev. Clin. Psychol. 2005, 1, 31–65. [Google Scholar] [CrossRef] [Green Version]
  32. Soper, D.S. A-priori Sample Size Calculator for Structural Equation Models. 2021. Available online: https://www.danielsoper.com/statcalc/calculator.aspx?id=89 (accessed on 13 January 2022).
  33. Núñez, J.L.; Martín-Albo, J.; Domínguez, E. Psychometric properties of the Satisfaction with Life Satisfaction Scale in physically active subjects. Rev. Psicol. Deporte 2010, 19, 291–304. [Google Scholar]
  34. Ato, M.; López, J.J.; Benavente, A. A classification system for research designs in Psychology. Ann. Psychol. 2013, 29, 1038–1059. [Google Scholar] [CrossRef] [Green Version]
  35. Muñiz, J.; Fonseca-Pedrero, E. Ten steps to test construction. Psicothema 2019, 31, 7–16. [Google Scholar] [CrossRef]
  36. Morean, M.E.; DeMartini, K.S.; Leeman, R.F.; Pearlson, G.D.; Anticevic, A.; Krishnan-Sarin, S.; Krystal, J.H.; O’Malley, S.S. Psychometrically improved, abbreviated versions of three classic measures of impulsivity and self-control. Psychol. Assess. 2014, 26, 1003–1020. [Google Scholar] [CrossRef] [Green Version]
  37. Maydeu-Olivares, A.; Rodríguez-Fornells, A.; Gómez-Benito, J.; D’Zurilla, T.J. Psychometric properties of the Spanish adaptation of the Social Problem- Solving Inventory-Revised (SPSI-R). Personal. Individ. Differ. 2000, 29, 699–708. [Google Scholar] [CrossRef] [Green Version]
  38. Lower, L.M.; Newman, T.J.; Anderson-Butcher, D. Validity and reliability of the Teamwork Scale for Youth. Res. Soc. Work Pract. 2015, 27, 716–725. [Google Scholar] [CrossRef]
  39. Doolittle, A.; Faul, A.C. Civic Engagement Scale: A Validation Study; Sage Open: Riverside County, CA, USA, 2013. [Google Scholar] [CrossRef]
  40. Muñiz, J.; Elosua, P.; Hambleton, R.K. Guidelines for Translation and Adaptation of Tests: Second Edition. Psicothema 2013, 25, 151–157. [Google Scholar] [CrossRef] [Green Version]
  41. Couper, M.P.; Bosnjak, M. Internet surveys. In Handbook of Survey Research; Mardsen, P.V., Wright, J.D., Eds.; Emerald Group: Bingley, UK, 2010; pp. 527–550. [Google Scholar]
  42. Tabachnick, B.G.; Fidell, L.S. Using Multivariate Statistics, 7th ed.; Pearson: London, UK, 2019. [Google Scholar]
  43. Hu, L.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. Multidiscip. J. 1999, 6, 1–55. [Google Scholar] [CrossRef]
  44. Kline, R.B. Principles and Practice of Structural Equation Modeling, 4th ed.; Guilford Publications: New York, NY, USA, 2015. [Google Scholar]
  45. Hair, J.; Black, W.; Babin, B.J.; Anderson, R.; Tatham, R. Multivariate Data Analysis, 6th ed.; Pearson International Edition: London, UK, 2014. [Google Scholar]
  46. López-Walle, J.; Balaguer, I.; Meiá, J.L.; Castillo, I.; Tristán, J. Adaptation of the Task and Ego Orientation in Sport Questionnaire (TEOSQ) to the Mexican population. Rev. Psicol. Deporte 2011, 20, 523–536. [Google Scholar]
Table 1. Descriptive statistics of the Social and Emotional Learning Scale.
Table 1. Descriptive statistics of the Social and Emotional Learning Scale.
Areas of Competence/ItemsM (SD)SKK-SSFESE
Self-awareness
1.
I can easily describe my emotions
2.66 (1.02)−0.01−1.210.23 ***0.470.03
2.
I understand my moods and feelings
2.91 (0.93)−0.33−0.920.20 ***0.440.03
3.
I know how my emotions influence what I do
3.10 (0.87)−0.51−0.790.25 ***0.610.02
4.
I am confident that I can successfully complete any school assignment
3.49 (0.75)−1.331.020.38 ***0.430.02
5.
I try my best when doing difficult homework or schoolwork, as this is what allows me to improve
3.27 (0.81)−0.80−0.200.29 ***0.510.02
Social awareness
6.
I can easily recognise how another person is feeling by their facial expressions, gestures, tone of voice, etc.
3.27 (0.81)−0.80−0.200.29 ***0.510.02
7.
It is easy for me to understand why people feel the way they do
2.56 (0.98)0.02−1.030.22 ***0.450.03
8.
If someone close to me is sad or happy, upset or nervous, I have a pretty good idea why
2.66 (0.95)−0.01−1.010.23 ***0.540.03
9.
I am respectful of anyone’s ideas, even if they are different from mine
3.41 (0.79)−1.160.500.35 ***0.420.03
10.
I find it easy to defend my ideas without putting anyone down
3.08 (0.94)−0.07−0.520.25 ***0.500.03
Self-control
11.
I know how to stay calm when I feel under pressure
2.82 (0.99)−0.23−1.090.20 ***0.530.02
12.
Whatever happens to me, I can keep calm
2.88 (0.96)−0.34−0.950.20 ***0.500.02
13.
When I am angry with someone, I calm down and then talk to him/her about it
3.40 (0.87)−1.24−0.490.37 ***0.520.03
14.
I am clear about my school goals
3.12 (0.84)−0.61−0.520.25 ***0.560.02
15.
I am able to work effectively to achieve long-term school goals
2.91 (0.94)−0.37−0.890.20 ***0.530.02
16.
I am disciplined (i.e., I follow certain routines to do my homework accurately)
2.94 (0.90)−0.36−0.820.21 ***0.560.02
17.
I concentrate easily on the schoolwork I have to do
3.04 (0.87)−0.45−0.740.22 ***0.600.02
18.
I carefully plan my homework according to my goals
2.67 (0.93)−0.04−0.920.22 ***0.500.02
19.
I resist any temptation or distraction while doing my homework
3.28 (0.85)−0.89−0.230.31 ***0.560.02
20.
If I commit to a school assignment, I do it. I know how to motivate myself
3.14 (0.84)−0.34−1.310.27 ***0.400.02
Relationship skills
21.
I use appropriate verbal language when conversing with friends, family, classmates, etc.
3.26 (0.83)−0.83−0.200.29 ***0.460.02
22.
I am confident in my ability to work as part of a team in class
2.89 (0.91)−0.37−0.760.22 ***0.520.02
23.
I treat all members of my team in class in the same way, politely and respectfully
3.22 (0.85)−0.76−0.380.28 ***0.460.02
24.
I offer help or help others when I think they need it
3.14 (0.92)−0.71−0.590.28 ***0.400.03
25.
I get on well with my classmates
3.23 (0.82)−0.70−0.460.28 ***0.460.02
Responsible decision making
26.
When I have to make a decision or face a problem… I think of all possible options or coping strategies before I act or decide
3.04 (0.90)−0.45−0.840.24 ***0.510.02
27.
When I have to make a decision or face a problem… I consider the advantages and disadvantages of each option or strategy before acting or deciding
2.67 (0.97)−0.06−1.040.21 ***0.550.02
28.
When I have to make a decision or face a problem… I check that my decisions or actions are having positive results
2.36 (1.01)0.25−1.030.23 ***0.480.03
29.
I care about the welfare of my environment or community
2.69 (1.01)−0.15−1.110.19 ***0.420.03
30.
I help members of my environment or community
3.30 (0.85)−1.030.220.31 ***0.410.03
M: mean; SD: standard deviation; S: skewness; K: kurtosis; K-S: Kolmogorov–Smirnov; SFE: standardised factorial saturation; SE: standard error; *** p < 0.001.
Table 2. Correlations and reliability of the Social and Emotional Learning Scale.
Table 2. Correlations and reliability of the Social and Emotional Learning Scale.
Areas of Competence/Variable1234567
1.
Self-awareness
-
2.
Social awareness
0.38 *-
3.
Self-control
0.70 *0.41 *-
4.
Relationship skills
0.59 *0.49 *0.58 *-
5.
Responsible decision making
0.46 *0.43 *0.53 *0.57 *-
6.
LS
0.80 *0.69 *0.82 *0.81 *0.77 *-
7.
AP
0.75 *0.73 *0.76 *0.68 *0.58 *0.93 *-
M3.092.953.023.152.813.006.44
SD0.590.590.570.570.610.462.47
α0.700.740.840.770.740.82-
ω0.710.750.840.780.760.83-
CRI0.770.770.770.780.770.77-
AVE0.670.670.670.720.670.67-
LS: life satisfaction; AP: academic performance; M: mean; SD: standard deviation; α: Cronbach’s alpha; ω: McDonald’s omega; CRI: composite reliability index; AVE: average variance extracted; * p < 0.001.
Table 3. Comparisons of the competence areas of the Social and Emotional Learning Scale as functions of the variables sex, age and academic performance.
Table 3. Comparisons of the competence areas of the Social and Emotional Learning Scale as functions of the variables sex, age and academic performance.
Areas of Competence/VariableGender (U)Age (H)Academic Performance (H)
1.
Self-awareness
233,145.5010.92660.62 *
2.
Social awareness
204,839.00 *12.86520.71 *
3.
Self-control
213,923.50 *5.28674.92 *
4.
Relationship skills
228,387.5014.78411.11 *
5.
Responsible decision making
230,378.0011.09310.78 *
H = H of Kruskal–Wallis test; U = U of Mann–Whitney test; * p < 0.01.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Fernández-Martín, F.D.; Moreno-Guerrero, A.-J.; Marín-Marín, J.-A.; Romero-Rodríguez, J.-M. Adolescents’ Emotions in Spanish Education: Development and Validation of the Social and Emotional Learning Scale. Sustainability 2022, 14, 3755. https://doi.org/10.3390/su14073755

AMA Style

Fernández-Martín FD, Moreno-Guerrero A-J, Marín-Marín J-A, Romero-Rodríguez J-M. Adolescents’ Emotions in Spanish Education: Development and Validation of the Social and Emotional Learning Scale. Sustainability. 2022; 14(7):3755. https://doi.org/10.3390/su14073755

Chicago/Turabian Style

Fernández-Martín, Francisco D., Antonio-José Moreno-Guerrero, José-Antonio Marín-Marín, and José-María Romero-Rodríguez. 2022. "Adolescents’ Emotions in Spanish Education: Development and Validation of the Social and Emotional Learning Scale" Sustainability 14, no. 7: 3755. https://doi.org/10.3390/su14073755

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop