1. Introduction
The use of information and communication technology (ICT) resources has changed the way we relate to each other [
1]. These advances in technology have also been transferred to the education system, providing teachers with material and immaterial resources that have allowed them to delve deeper into the teaching–learning process, which facilitates their work.
Not only is digital teaching competence (DTC) important in the educational field, but digitization and competence in the use of ICTs is a key element when working in any field of work. Digital competence should help to achieve the highest level of performance in professional tasks [
2], but only 26% of organizations are prepared to face the changes brought about by new technologies [
3].
This relevant finding has not been reflected in data on citizens’ digital competence. In 2015, 44.5% of the EU population aged 16–74 did not have sufficient digital skills to manage socially and economically [
4].
The importance of DTC has been considered by institutions as a basic competence required by pupils, and given that teachers are faced with a student body that joins the education system with a high level of use of ICTs [
5], it should be a fundamental competence for teachers.
However, if the use of ICT resources was previously seen as an important element both in educational development and in the workplace, recent global events have shown that the use of ICTs must be a fundamental requirement for dealing with exceptional situations, such as the current COVID-19 situation, which could change the educational and professional models we have had until now. This pandemic has caused teaching, which for the most part was carried out face-to-face, to become virtualized at a rapid pace for all levels of the whole educational community. In the literature, this phenomenon has been referred to as “Emergency Remote Teaching (ERT)” [
6].
The necessity to virtualize teaching has exposed many shortcomings that may have been thought overcome [
7], and which will surely be addressed by the academic world soon [
8,
9,
10,
11,
12,
13].
Today’s teachers cannot be classified as digital natives, as their ICT skills are based on the knowledge that they have had to learn throughout their lives. This raises many doubts as to whether the level of competence they have achieved is high enough to supervise a process in which the real protagonists have a higher level [
14]. In fact, for teachers, there is still a long way to go to achieve sufficient initial training, as well as the professional development that this may involve [
15,
16].
In order to overcome these shortcomings, it is important to define a model so that teachers can acquire this competence and overcome the existing gap between their own knowledge and the actual implementation of this knowledge in the teaching methods [
2,
14], and also to overcome the numerous complaints about the type of teaching that is being given, supposedly in a virtual manner, which in many cases simply consists of sharing notes on a virtual campus. Furthermore, it is necessary for teachers to acquire a series of skills that will enable them to keep up with the new reality demanded by students [
17,
18,
19].
Within the educational field, it is not enough to consider digital competence as an element that allows access to the use of ICTs; it must also be considered as a key element of participation in today’s society [
20].
In order to establish a strategy for the teaching staff to acquire digital teaching competences, it is imperative to know their level of competence beforehand [
16,
21,
22,
23,
24,
25,
26], in order to be able to provide training and to improve the acquisition of digital teaching competence.
It should not be forgotten that competence goes far beyond the possession of knowledge. The need for digital competences to be closely related to the knowledge of the subject and the pedagogy used must be taken into account, as well as the fact that it is not possible to analyze each dimension independently if we want to discuss a genuine use of digital competence in the eyes of students [
27,
28,
29,
30,
31].
When it comes to measuring digital teaching competence, both authors [
32] and institutions recognize its importance, and institutions are aware of the need to measure this competence. In fact, the European Commission, in the ‘opening up education’ framework, highlights the importance of developing ‘... digital competence frameworks and self-assessment tools for students, teachers and organizations’ [
33].
This importance is reflected in the fact that the European Commission itself proposes a self-assessment model for citizens’ digital competences in which five assessment areas are recognized, such as information processing, communication, content creation, security, and problem-solving [
34]. In this sense, INTEF (National Institute of Technology and Professional Development of Spain) determines that there are the same five competence areas and a total of 21 competences, measured on the basis of six levels of digital competence achievement by the teaching staff [
20].
INTEF is the institution that has identified and defined the digital teaching competences in Spain through its common framework reports. INTEF [
20] defines digital teaching competence as ‘the set of competences that 21st century teachers must develop to improve the efficacy of their educational practice and for their own ongoing professional development’. These competences are determined in the common framework of digital competence for teachers, which establishes the key digital competences for the teaching staff to adapt to the needs of the present and the future [
20]. Due to the administrative composition of Spain, INTEF has tried to reach a consensus on the common framework of digital competence for teachers with Autonomous Communities. In any case, and due to Spain’s administrative composition, some Autonomous Communities have developed their own models for measuring digital competence, such as Extremadura, the Basque Country, and Catalonia; others have referred directly to INTEF, such as Asturias, Galicia, and Navarre. This disparity between the Autonomous Communities has created certain differences when it comes to measuring, comparing, and identifying needs [
35].
This article presents the selected questionnaire and the final sample that participated in the study in the Materials and Methods section. In the Results section, we include both a general data analysis and one that is differentiated by areas, and the reader will find tables of the percentage values of responses to the items by gender. Subsequently, the open-ended questions that enrich the results are analyzed.
2. Materials and Methods
The main objective of this study is to discover Spanish secondary school teachers’ self-perception of their level of digital teaching competence. In order to do so, teachers are evaluated and classified according to the different levels of digital teaching competence, their training deficiencies in relation to digital teaching competence are identified, and education policies aimed at improving digital teaching competence are proposed.
The following research questions have been posed:
- (1)
Have teachers perceived themselves as digitally competent to deliver ERT? [
36].
- (2)
Which actions have teachers carried out and which technologies have they used?
2.1. Sample
The study was carried out on secondary education and sixth form teaching staff of public, private, and state-subsidized schools in Spain.
A total of 208 questionnaires were collected, of which 31 were initially discarded because they were submitted by teaching staff working outside Spain, and thus outside the scope of this study. This sample is non-representative and unintentional. The questionnaire was distributed through the usual channels of communication with schools.
The final sample is made up of 177 participants, of which 36.7% are male and 63.3% are female. The mean age of the group is 45 (with a standard deviation of 8.36) years.
2.2. Digital Teaching Competence (DTC) Questionnaire
The questionnaire created by Tourón et al. [
25] was used as a starting point for the data collection and assessment of teachers’ impression of digital teaching competence, which was published in the article ‘Construct validation of a questionnaire to measure teachers’ digital competence (TDC)’. This questionnaire was chosen because it has been validated by more than 400 teachers, it is a fairly current questionnaire, and it corresponds perfectly with the object of the study. The aforementioned questionnaire contains a total of 54 items (see
Table 1) grouped into five categories (information, communication, content creation, security, and problem-solving) in which the teachers’ knowledge and level of use of ICTs are assessed on a seven-point Likert scale (where 1 represents ‘I don’t use it or I don’t know it’, and 7 represents ‘I use it frequently or I know it well’).
In addition, the questionnaire was enriched with a series of open-ended questions that could provide us with more information on the effects of confinement on teachers when carrying out their work (see
Table 2).
Open-ended questions were included at the end of the questionnaire in order to obtain more information regarding the current situation caused by COVID-19, which has led to the need to transition from face-to-face teaching to virtual teaching. These questions helped us to understand the feelings and thoughts of teachers better.
The questionnaires were distributed to teachers in several ways. Firstly, the questionnaire was sent to the headteachers of schools, as well as to the heads of studies at secondary schools, so that they could disseminate it among their teaching staff; this was reinforced by us sending it to fellow teachers, so that they would circulate it among their colleagues. It was also disseminated via social networks such as Facebook and Twitter. Questionnaires were distributed between 20 and 30 May 2020.
This questionnaire was implemented using the ‘Google Forms’ tool, because the received responses can be monitored in real-time and because it is also possible to download them in .xls format, which allows for better processing and avoids coding errors.
Once the data had been collected and downloaded, they were analyzed using the SPSS software (IBM Corp. SPSS statistics, v. 24, Armonk, NY, USA), which carried out a descriptive analysis of the data obtained in the study. The level of digital teaching competence analyzed in the study establishes levels of competence similar to those established in the Common European Framework of References for Languages (CEFR), based on the percentages previously assigned by the reference study [
25] (see
Table 3).
This assessment is based on the questionnaire by Tourón et al. [
25], and validated and based on the competences set out by INTEF in the common framework of digital competence for teachers, with the aim of discovering what is the current state of digital teaching competence.
The percentages referred to in
Table 3 are the result of converting the direct scores of the Likert scale into percentages, as used in the reference article [
25], without weighting between the different items.
Once the results are obtained, we can assess the self-perception of teachers’ digital teaching competence in order to discover their results in aggregate or individually.
3. Results
Data collection resulted in 208 responses, of which 31 came from foreign countries and were thus discarded. Of the valid responses (177), 65 were from men and 112 from women. In terms of age, the mean age of the group was 45 (with a standard deviation of 8.36).
Regarding teaching experience, a wide range of experience (in years) has been observed, although the majority of the teachers who completed the questionnaire had an average of 14.9 years of teaching experience.
A global analysis of the results on knowledge and use of digital competence items is presented in
Table 4 (the color coding is a visual aid that aims to detect low values of the level of digital competence).
The data presented in
Table 4 show, as expected, that the knowledge of items is higher than their use in all cases except for one; in this case, the use of the item is higher than its knowledge, which shows that the results make sense in terms of the responses collected. It is evident that the most well-known items are used more frequently, with respondents reporting over 84% in the knowledge of, and over 80% in the use of, items 4 (solutions for management and storage in the ‘cloud’, file sharing, granting access privileges, etc.), 10 (tools for online communication: forums, instant messaging, chats, videoconferences, etc.), and 11 (tools for storage and management of shared files and content, e.g., Drive, Box, Dropbox, Office 365, etc.).
On the other hand, item 19 (augmented reality-based content tools) has by far the lowest values, while item 36 (tools for recovering deleted, damaged, or inaccessible files, files with formatting errors, etc.) also has low values.
Regarding the knowledge of items (
Figure 1), of the 54 items studied, 23 items are rated C1, 26 items B2, and 5 items A2. In terms of the use of items, of the 54 items studied, 8 items are rated C1, 31 items B2, 13 items Bl, and only 1 item is rated as A2.
If we separate by gender, we can see the score levels achieved by men and women in
Table 5, both in knowledge and use of the items outlined in the questionnaire.
In the knowledge of items, men achieve the highest score in 5 items, while women do not achieve the highest score in any item. In the use of items, neither men nor women achieve the highest level.
A Cl level of knowledge is achieved by men in 29 items and by women in only 9 items. A C1 level of use is achieved by men in 18 items and by women in 7 items.
A B2 level of knowledge is achieved by men in 19 items and by women in 38 items. Men achieve a B2 level of use in 20 items, while women achieve this level in 31 items.
A Bl level of knowledge is achieved by men in one item and by women in seven items. Both men and women achieve a B1 level of use in 15 items.
With respect to the A2 level, no items are classified at this level in terms of knowledge; but with respect to the level of use, each gender achieved this level in one item.
3.1. Results in Terms of Areas with Aggregated Indices
Within the theoretical framework, digital competence can be grouped into several areas, by aggregating each item as belonging to a certain area.
3.1.1. Information Area
In order to calculate the digital competence in the area of information, eight items are considered from the theoretical framework of this study, which are the knowledge and use of identifying, locating, retrieving, storing, organizing, and analyzing digital information, and judging its relevance and purpose.
The results obtained for these items are presented in
Table 6.
The overall level achieved by the respondents is a B2 or ‘upper intermediate’ level, both in use and knowledge of items in the area of information.
When separated by gender, the results show that men achieve an ‘advanced’ C1 level of knowledge, although not the maximum, while women remain at the B2 or ‘upper intermediate’ level. As a whole, the aggregate of teaching staff achieves an ‘upper intermediate’ level. Regarding the use of items in the area of information, there are fewer differences between men and women, and although an ‘upper intermediate’ level is achieved, its score is somewhat lower.
3.1.2. Communication Area
In order to calculate digital competence in the area of communication, nine items are considered from the theoretical framework of this study. The results obtained for these items are presented in
Table 7.
Overall, the respondents achieve a C1 or ‘advanced’ level of knowledge, but only a B2 or ‘upper intermediate’ level of use.
When separated by gender, both men and women achieve a Cl ‘advanced’ level.
As a whole, the aggregate of teaching staff achieves a B2 level of use, with minimal differences between men and women; and although an ‘upper intermediate’ level is achieved, the score for the level of use is somewhat lower than that of knowledge.
3.1.3. Content Creation Area
The area of content creation analyzes the knowledge and use of creating and editing new content (from word processing to images and video), integrating and re-elaborating previous knowledge and content, producing creative expressions, media products and programming, and addressing and enforcing the rights of intellectual property licenses.
In order to calculate digital competence in the area of content creation, 16 items are considered from the theoretical framework of this study.
The results obtained from these items are presented in
Table 8.
In general, the respondents achieve a B2 or ‘upper intermediate’ level of knowledge, and likewise a B2 or ‘upper intermediate’ level of use.
Separated by gender, both men and women achieve a B2 or ‘upper intermediate’ level of knowledge.
As a whole, the aggregate of teaching staff achieves a B2 level of use, with minimal differences between men and women; and although men achieve an ‘upper intermediate’ level and women achieve a ‘lower intermediate’ level, the difference is almost negligible (1.23%), and is due to the jump in the scale.
As usual, the use of items is lower than their knowledge, and in this case (content creation area), by 7.82%.
3.1.4. Security Area
The security area analyzes personal protection, data protection, digital identity protection, security measures, and safe and sustainable use.
In order to calculate digital competence in the area of security, nine items are considered from the theoretical framework of this study.
The results obtained are presented in
Table 9, which shows the items differentiated by knowledge and use, as well as by the gender of the teachers surveyed.
Overall, the respondents achieve a B2 or ‘upper intermediate’ level of knowledge, and a B2 or ‘upper intermediate’ level of use.
Separated by gender, men achieve an ‘advanced’ Cl level of knowledge, and women achieve a B2 or ‘upper intermediate’ level of knowledge.
As a whole, the aggregate of teaching staff achieves a B2 level of use; although there is a difference of 6.18% between men and women, an ‘upper intermediate’ level is achieved by both genders.
As usual, the use of items is lower than their knowledge, and in this case (security area), by 3.35%.
3.1.5. Problem-Solving Area
The problem-solving area analyzes the knowledge and use of identifying needs and digital resources, making informed decisions about the most appropriate digital tools according to purpose or need, solving conceptual problems by digital means, using technologies creatively, solving technical problems, and updating one’s own and others’ competence.
In order to calculate digital competence in the area of problem-solving, 12 items were considered from the theoretical framework of this study.
The results obtained are presented in
Table 10.
In general, respondents achieve a B2 or ‘upper intermediate’ level of knowledge and a B2 or ‘upper intermediate’ level of use.
Separated by gender, men achieve an ‘advanced’ C1 level of knowledge, and women achieve a B2 or ‘upper intermediate’ level, with a difference of 7.9%.
As a whole, the aggregate of teaching staff achieves a B2 level of use; although there is a difference of 4.94% between men and women, an ‘upper intermediate’ level is achieved by both.
3.2. Overall Results
In this section, we will discuss the results achieved when taking all items into consideration.
As shown in
Table 11, there is a difference of 5.14% between the knowledge and use of the items reported by teachers. In any case, both men and women achieve a B2 ‘upper intermediate’ level of both knowledge and use of items.
There is a difference of 7.23% between men and women in knowledge, which puts men at a C1 or ‘advanced’ level of knowledge, while women remain at a B2 or ‘upper intermediate’ level.
The difference narrows to 3.24% in the case of use, where both men and women achieve a B2 or ‘upper-intermediate’ level.
3.3. Contributions to Open-Ended Questions
The open-ended questions were included to provide those who took the survey with an opportunity to raise a number of issues that are more difficult to address in a closed questionnaire, which has, in turn, allowed us to enrich the study with more information.
3.3.1. Did You Perceive a Change in Your Own Digital Competence as a Teacher during Confinement? Can You Describe Your ‘Before’ and ‘After’?
Although close to 8% of the respondents conveyed that their digital teaching competence has not been altered by confinement, many others have stated that it has been altered.
In fact, several relevant elements are expressed in the questionnaire. Firstly, many of the teachers state that they have had to seek new resources that they had not previously considered, in order to provide solutions to new problems caused by confinement.
Furthermore, many of them report that they have been forced to increase the use of tools that they were already familiar with and had not needed to use or had not used regularly. Respondents also commented that the use of ICTs is now here to stay, as a habit of use has been created that they believe will be maintained.
Some respondents also mentioned an increase in collaborative work with colleagues and students, where previously the use of ICTs was more focused on individual work.
Some expressed that, out of necessity, they have lost their ‘fear’ of using ICTs, and many respondents said that they had to rapidly learn ICTs during the confinement.
3.3.2. Observations and Suggestions
In this section, a wide variety of answers were received. There were quite a few complaints regarding the length of the questionnaire and the clarity of the questions. Interesting contributions have also been made, such as teachers feeling abandoned by the administration until they encountered this problem, and that they had to solve the problem without formal training.
Some respondents expressed their weariness regarding the issue of digital teaching competence, as they do not consider it to be a fundamental element that should be required of teaching staff.
On the other hand, there are also respondents who have expressed appreciation, because they believe the questionnaire has given them an opportunity to reflect on their position in terms of competence, and to rethink their future in digital teaching competence.
3.3.3. Describe Briefly What Actions You Have Carried Out and What Technologies You Have Used
A great diversity of responses was encountered in this section. Some respondents said they had used resource repositories to deliver their lessons, such as YouTube and other video or image repositories. Some stated that they used videoconferencing for synchronous classes, using multiple platforms such as Meet, Teams, or Zoom, while others reported using software to record lessons so that they could upload them to platforms or YouTube channels. Some respondents digitized their notes and uploaded them to platforms for the students to download.
The highest number of respondents reported using Google tools, including Classroom as well as other tools included in G-suite.
3.3.4. What Content Do You Think You Need Specific Training on? Please Answer Briefly
Respondents have reported a great diversity of training needs in order to improve their digital teaching competence. Some consider that they require training in all of the areas covered in the questionnaire, which indicates that they consider themselves to have a low level of digital teaching competence.
Many respondents also believe that they require training in terms of content creation, especially in audiovisual content, and many have highlighted the need for training in data protection laws and content licensing.
3.4. Limitations of the Study
We have presented an original study with the participation of secondary and sixth form teachers who were working at this stage of education during confinement in Spain due to COVID-19, from March to June 2020. Their participation was essential to be able to conduct the study. The final sample size was smaller than expected, since the first research report was to be delivered by the end of June 2020. We believe that this study is a good step towards proposing future research that will include a larger number of participants. This sample is not intended to generalize the results, but it is necessary in order to raise new research objectives.
4. Conclusions
The confinement brought about by the COVID-19 pandemic was a complex time for society in general; however, it is worth acknowledging the work of teachers, at a global level, in their rapid adaptation to what has been called Emergency Remote Teaching [
6]. This situation “has had effects on the social, political, educational, and economic inequalities that have amplified the effects of the pandemic” [
37]. Among the most affected vulnerable communities are low-income families and women [
36]. In this context of uncertainty, we can see from their self-perception of their digital teaching competence that secondary and sixth form teachers consider themselves to be ready to move from Emergency Remote Teaching to a teaching model based on blended learning.
This study has allowed for certain conclusions to be drawn, both from a theoretical and a practical perspective. With regard to the objectives set, we can conclude that the main objective has been met; it has been possible to adequately assess the level of digital teaching competence that teachers consider themselves to have in the field of secondary education.
The teachers’ self-assessments are quite high for the level that was expected, given the ‘noise’ that was made in the educational field regarding the limitations of ICTs, and the effort that teachers had to make in order to adapt their teaching with the use of ICTs during the COVID-19 pandemic.
We believe that future studies should employ an independent and objective evaluation, which is not based on teachers’ own perceptions of their knowledge and use of ICT in education.
From a theoretical standpoint, we conclude that the evolution of the use of ICT-based elements in society has led to the introduction of ICT tools in the education system.
The rapid evolution of the ICT world means that training and knowledge becomes obsolete in a short period of time, which is why it is imperative for teachers to receive ongoing training for digital teaching competence, which should be examined regularly.
In addition, the application of ICTs within the education system was developed merely as a substitute for tools, thus becoming an instrumental element without any true integration of ICT knowledge and pedagogy as required by the TPACK model.
The items assessed to measure digital teaching competence need to be constantly reviewed due to the rapid changes in the ICT world.
It can be stated that, given the importance of education and educational training, and therefore the subject we are dealing with, digital teaching competence, the self-assessment of this competence deserved greater development. Taking a model as general as INTEF’s as a reference means that the assessment of this competence loses some rigor for a group as specific as teaching staff. The research conducted, together with other studies with the same objective (but with a different model and instrument), show that the political–educational model of digital competence should be revised. Similarly, the assessment model of digital teaching competence needs to be revised in order to move from a model based solely on self-perceptions to a model based on the complementary implementation of skills such as portfolios [
25].
It would also be interesting for official bodies to develop a unified certification, with the same rigor as that of languages, in order to be able to genuinely assess the digital teaching competences. Although the tools highlighted in this study are tested and academically valid, an actual certification system would make it possible to draw a map of the teaching staff.
The following conclusions can be drawn from the empirical part of the study:
Teachers consider themselves to have an upper intermediate level (C1) of both knowledge and use of the tools that define digital teaching competence. This conclusion is similar to the result of another study with similar characteristics to ours [
36], with a group of teachers at the secondary school level, which was carried out with a group of teachers in which those at secondary school level comprised 38.3% of the sample, or 176 participants. It concludes that the higher the level of the stage at which teachers work, the greater the need for digital competence.
In aggregate, of all the items studied, there are only two in which women consider themselves to have more knowledge than men. In the rest of the items, men consider themselves to have more knowledge. Thus, we can state that the digital teaching competence of men is greater than that of women. These differences are also significant, as there is a difference of more than 5% in 37 items.
With respect to the use of the items studied, the conclusions are similar to those of the knowledge of the items studied. Women report higher use of items than men in only 10 items. However, it should be noted that the differences between men and women are lower in this section; the difference between men and women exceeds 15% in only 12 items. Similar results have been found in the study with pre-service secondary school teachers by Jimenez-Hernández et al., which uses the DigCompEdu model [
38] and another instrument [
39,
40].
When studying the different areas in which the proposed score can be divided, respondents consider themselves to have an upper intermediate level of knowledge in all areas, which is exactly the same as for their use, although the levels of use are always lower than the levels of knowledge. Only in the area of communication do respondents consider themselves to have a high level of knowledge.
Finally, we do not wish to conclude this study without proposing a series of improvements, such as the following:
It has become clear that there is a significant gap between the knowledge and level of use of ICTs, so it can be concluded that, overall and regarding ICT training, teachers are sufficiently trained, but they need tools and motivation to put their knowledge into practice. In other specific areas where teachers do not have the desired knowledge, training should therefore be provided by the administration in order to meet this need.
In the future, it would be interesting to measure digital teaching competence over time, in order to obtain an analysis that would allow us to see how their competence evolves. By maintaining this study over time, we could analyze whether the learning policies for this competence are having an effect, or whether the administration is simply playing to the crowd. It would be interesting to carry out this study from now on, to find out whether the obligatory use of ICTs brought about by COVID-19 will merely become an anecdote, or whether it will change the training paradigm, including, once and for all, true integration of ICTs.