This section presents the results according to the proposed objectives: (1) Perception of DIC and its linkage with the EBEI steps and (2) evidence-based educational innovation model linked to DIC.
3.1. Bimodal Teachers’ Perceptions of the DIC and Their Link to EBEI
The DC-OER scale consisted of 16 items, with five Likert-type response options: No mastery, little mastery, fair mastery, good mastery, and excellent mastery. Thus, the scale measured the subjects’ perceived DIC in each aspect considered, that is, their specific self-efficacy in this domain [
33,
34]. Of the 16 items of the scale, four corresponded to competencies in information search, selection, and evaluation (Ia, Ib, Ic and Id); three items corresponded to competencies in information storage and retrieval (IIa, IIb, IIc); three items corresponded to competencies in information communication and dissemination (IIIa, IIIb, IIIc); finally, six items corresponded to competencies in the use of OER (IVa, IVb, IVc, IVd, IVe, IVf).
Table 1 shows the means and standard deviations obtained in the scale items by the sample of subjects. Those items below three would show lower proficiency in the skill assessed, while scores above three would indicate higher proficiency.
Once the quantitative results were obtained, it became necessary to complement them qualitatively to understand how natural the DIC occurrences were. The experience in applying them during the development of the innovation proposal with EBEI (the integrating task) corresponds to category 2. To this end, 15 professors (seven with master’s degrees and eight with doctoral degrees) participating in the quantitative phase in the four areas of knowledge were interviewed. Their interview responses were coded, categorized, and subcategorized based on the literature as described below.
Category: Search, selection, and evaluation of information. This aspect was relevant for the teaching and research performance and necessary for the task’s development. We inquired about the teachers’ sources-of-information preferences, the main problems accessing the information to present, the information search techniques applied, and the procedure followed in selecting and evaluating the information incorporated into the task.
Regarding the professors’ responses to information sources (which they used to perform the integrative task), as shown in
Figure 1, the Scopus database was their primary source of consultation (to a lesser extent, the WOS and Science Direct databases), followed by the Google Scholar search engine. Official data websites for data statistics, bulletins, and notifications were other sources consulted, depending on the nature of the subjects or search purposes. Additionally, open-access information sources, such as educational resources available in repositories or open sites, were consulted by some teachers. Google databases, ResearchGate, Mendeley, and social networks also served this purpose for teachers. Therefore, the teachers indicated that this competency allowed them to delimit the object of innovation (step I of EBEI) and search for evidence (step II of EBEI). Through the consultation sources, they identified the educational practice they proposed to improve and provided evidence of good practices.
Regarding the problems in accessing information, all the interviewees agreed that access to relevant information in paid databases was the main one. According to one interviewee, “This is a concern because there is much good information that cannot be accessed” (E062). Likewise, some teachers indicated that access to the databases available through the virtual library was limited from their homes because “it can only be accessed from the university premises” (E065). To a lesser extent, some indicated language as another research problem since “most of the good information is in English, which makes interpretation difficult” (E066). Likewise, lack of time turned out to be an essential factor. According to most of them, “time is necessary to make a good search and selection of information” (E069), and “There is so much to read, and it takes time” (E066). Finally, two interviewees (E063, E069) pointed out that the lack of knowing information search strategies prevented them from doing an advanced search for information. It can be inferred that these problems had some impact on the task’s development, especially in the consultation and citation of paid information because they could only access the summary or abstract.
Regarding the search techniques applied by the interviewees,
Figure 2 shows that the most frequently used technique was the keyword search according to their research purposes. This form of research is closely linked, as indicated by the highlighted (thick) lines, to the use of operators and years of publication (no more than five years old). Another technique was the search by author(s) and the search by journal name. The teachers indicated that applying these search techniques allowed them to specify and refine the results to develop steps I (delimiting the object of innovation) and II (search for evidence).
Regarding selecting and evaluating the information, the professors selected and evaluated the information per the search purposes and the innovation they proposed. Only then did they establish the timeliness of the information (no more than five years old). Likewise, another important criterion was that the authors of the selected information were referents in the subject (i.e., they mainly were cited) and that the information found would be helpful for the student. They indicated that these competencies favored the fulfillment of steps I (delimiting the object of innovation), II (search for evidence) to support the proposal with other good practices, IV (application of the innovation) in identifying the phases of the innovation, and the instruments to evaluate the innovation (step V). Additionally, the professors reported that they selected the information based on the ranking of the journals and the preference for open information or a creative commons license.
Category: Information storage. In this aspect, the responses were diverse. Most interviewees indicated that their primary technological tool for information storage to develop their task was their personal computer, and OneDrive was their preferred storage manager. The latter was especially preferred because it allowed teachers to store in the cloud the information required to delimit the innovation (step I of EBEI) and the information resulting from fulfilling step II of EBEI; thus, having it available from anywhere with internet access. It is noteworthy that they considered the bibliographic manager Mendeley as a tool for storing, organizing, and consulting the information that served them to develop their task. “Mendeley is a tool that, besides allowing citation and bibliography management, serves well to store information and consult and analyze it” (E063); “Mendeley allowed me to organize the information in folders by research variables,” said one of the respondents (E065). Additionally, some pointed to social and open networks such as YouTube that allowed them to store recorded videos, which were part of their innovations. In addition, they had the institutional virtual learning platform and the repository of open educational resources, which was generally used to store resources produced for students and others who were participating in the innovation project proposals.
Category: Use and processing of information. In this category, teachers indicated that they used it to formulate, implement, and evaluate the innovation (steps III, IV, and V of EBEI). For this, they applied the following criteria: they proceeded to contrast it: “I contrasted the selected information with what I intended to do” (E063); “I contrasted the information among authors and incorporated my interpretation” (E065). They then synthesized the main ideas through diagrams, mind maps, graphic organizers, and matrices. Another said: “I always do mental maps of what I am reviewing, then I decide my central theme, and I gather everything linked to it” (E063). Another noted: “It helps me a lot to work with a matrix where I can record the most relevant data” (E066). Thus, many teachers indicated that they proceeded to create knowledge, respecting authorship. “I quote the authors that help me support my project” (E070); “I start writing my ideas, comparing them with what other authors say, quoting them, of course.” (E072). It is striking that organizing the selected information was not considered a starting point within this category; perhaps they regarded it as implicit in the process.
Category: Communication and dissemination of information. The findings presented in
Figure 3 indicated that the preferred means of the interviewees to communicate and disseminate the innovation results (EBEI step VI) were journals (open or closed). “I always choose to look for the highest Q1 journals, and, if not accepted, I try to improve the article for another journal” (E060), said one interviewee. “The truth is that I have never considered publishing only in open access. When I see events of interest to me and my work has a relevant impact both in journals and in congresses, only then do I send” (E067).
The second primary means of dissemination were congresses or conferences. “The interesting thing about these works is that I prepare the results to present them as papers in congresses” (E061); “The results of innovations I like to disseminate more often in congresses with ISBN proceedings” (E062). It is also interesting to know that the events of the institution under study (Research or Innovate UTPL) are attractive and acceptable by the teachers to publish their research: “The university provides spaces to disseminate the results of innovation practices” (E070); “I take advantage of Investiga UTPL to present research results” (E063); “In local university events, we present post-type results” (E068); “In the spaces of good teaching practices we were asked to present the information and results we have obtained from this good practice” (E068).
To a lesser degree, academic networks such as ResearchGate, Google Scholar, and Academia Edu served as open technological means to communicate or disseminate information about innovation or research. They can also be used as a tool for research management: “Through these academic networks, I can check my citations” (E062). Likewise, social networks, Web 2.0 tools, and books were interesting means of communicating and disseminating information.
Figure 3 presents the findings described above. In this figure, the line’s thickness indicates the teacher’s level of interest in publishing through that source. These findings allow visualizing the teachers’ interest in disseminating and publishing the innovations (step VI of EBEI) in journals and conferences.
The qualitative results described above complemented the quantitative results since the aim was to deepen the teacher’s experience in applying the DIC while developing the task that included the steps of the EBEI methodology. These results highlight some warning points that should be considered. These warning points mainly relate to the problems of information access. Paid databases, language, lack of time, and lack of knowledge of information search strategies hindered compliance with steps I and II of EBEI requested in the task. Second, concerning the competencies of selection and evaluation of information, few teachers mentioned verifying the licenses to use information, also necessary to enrich steps III, IV, and V of EBEI. Third, concerning information storage competencies, most interviewees coincided in using computers as technological storage resources, thus showing a lack of knowledge of other information storage sources, especially those with open characteristics. Finally, regarding the competency of communication and dissemination of information directly related to step VI of EBEI, attention should be paid to those aspects that allow teachers to share information to generate synergies and collaborate with the help of technology.
3.2. Evidence-Based Model of Educational Innovation Linked to the DIC
Based on the results in the previous section, we observed that DIC are necessary for the fulfillment of the EBEI steps, so a close relationship between the two can be inferred. Therefore, the educational innovation model linked to DIC considers the philosophical, theoretical, practical, political, and operational components proposed in teaching practice [
35].
Figure 4 presents the proposed innovation model.
As shown in
Figure 4, the proposed model is guided by UNESCO’s sustainable development goal 4 (SDG4), which seeks to improve the quality of education to improve people’s lives through sustainable development (political component or practical orientation) [
36]. The ultimate goal of the model (the philosophical component) is for participating teachers to renew or update their practices by analyzing and disseminating innovative evidence supported by the DIC. This model is proposed as a theoretical teaching-learning model for applying knowledge (the theoretical component). Therefore, it seeks innovation in teaching practices, and its application depends on teachers’ creativity. Hence, the innovation model intends that educational institutions find opportunities for internal innovation (the operational component), so from understanding reality, teachers individually or collaboratively propose innovative solutions with social impact through applying knowledge, decision making, and research [
35].
The proposed model presents a six-step cycle of EBEI linked to DIC. It focuses on the participant, whose primary purpose is to improve their learning by formulating and implementing innovations based on evidence to solve a problem or respond to a need. The six steps of EBEI are (1) delimiting the object of innovation, (2) searching for evidence, (3) formulating the innovation. The teachers execute the steps: (4) Applying the innovation, (5) evaluating the innovation, and (6) diffusing and communicating the innovation sequentially [
31], creatively implementing the innovation with the support of the DIC. Based on the evidence of good practice, the design and implementation of innovative proposals respond to a need or problem. The innovation results are disseminated and published as new evidence, contributing to the teacher’s professional performance, as indicated by this research’s results, which support the model’s usefulness.
Executing step I, delimiting the object of innovation, is vital because it defines, as [
37] points out, the need for change, the clarity offered by the transformation, the field it covers, and its practicality. This step must always be understood and appreciated with care [
2]. It requires the competency of search, selection, evaluation, and storage of information that help delimit the subject from a critical analysis of evidence relevant to the innovation proposed. The delimitation requires that the selected innovation is relevant, practical, and pertinent. It must lead to asking valuable questions that contribute new knowledge about educational innovation.
On the other hand, in step II, the search for evidence or proven good practices goes hand in hand with the DIC (i.e., the correlation is very close) and this step becomes an essential and highly beneficial condition in the model. In this step, information search, selection, and evaluation skills are particularly required. This competency makes it possible to search for information in reliable, valid, and refereed sites such as paid databases or open databases in English and Spanish (see
Figure 1). It is also possible to search for information by applying sensitive search techniques that facilitate the inclusion of relevant information, exclude irrelevant information, as shown in
Figure 2, and critically evaluate and analyze the selected evidence. The information found should be critically evaluated and analyzed to determine its correlation with the search purposes, the timeliness of the information, the relevance of the author of the publication, and the information’s usefulness for students.
In short, step III requires reflection and decision-making to formulate the innovation and know what has succeeded in other contexts. Hence, step II must be carried out with care and much attention [
38]. The close relationship with information storage or management competency is also highlighted here, given that the information or evidence of good practices must be downloaded, stored, and organized for consultation. Its purpose is to support grounded knowledge for relevant decisions. The results pointed to Mendeley’s bibliographic reference manager as a technological tool that allows this activity in the present investigation. Thus, in this step II, the need to apply research strategies can be glimpsed since they relate to the purposes pursued. Therefore, in line with [
39], research is inherent to the educational process and essential to better learning.
To fulfill step III, formulating the innovation, teachers must pay much attention since its development should reflect the improvement of some aspects of educational practice. As described by [
40], the formulation of innovation represents an opportunity for teachers to reflect on their practice, have greater empathy in their working relationships, and develop the exercise of research. Consequently, step III considers those ideas for processes, strategies, or activities that result from evaluating evidence applied in other successful contexts. In this step, the digital competency of using and processing information is fundamental; that is to say, it is required to contrast the evaluated information, synthesize the main ideas, and create new knowledge respecting the authorship, as shown in the results.
Step IV, applying the innovation, is conditioned by fulfilling the previous step. Formulating the innovation is necessary to apply it. Thus, the digital competence of searching, selecting, evaluating, and using information is required. In this step, the implementation of the innovation usually differs from what was initially planned, sometimes positively and sometimes negatively. When the innovation receives the expected acceptance and more participants are involved, no resistance to change is observed.
On the other hand, when there is no participation of the people involved, there is resistance to change. Hence, to fulfill this step, the person in charge must be prepared for the unexpected. Creativity becomes crucial to face the unexpected events that may arise when applying the innovation and making changes. In any case, preparation always has an advantage, especially when the project is integrated with specific conceptual and methodological coherence. The innovation’s objective is detailed in interventional phases, the sample of participants is defined, and the data analysis techniques and the instruments to be used are proposed. It is in these aspects that the DIC are relevant. They allow using the critically evaluated information to design the interventional phases and instruments and determine the sample and the data analysis techniques based on the evidence. Therefore, in this step, it is essential to know in detail the conditions required for its implementation, establish contacts with the people involved, and prepare the necessary materials. In line with [
39], we recommend documenting the processes of applying or implementing the innovation, recording what happens, the changes that occur, how they are addressed, and the decisions. This information will be vital for the next step, which is the evaluation.
The evaluation of innovation, to fulfill step V, must be applied to the innovation to evaluate it. In this step, it is necessary to define and apply the instruments to evaluate the innovation. The qualitative, quantitative, or mixed data analysis techniques assess if the innovation implemented had the expected impact. Therefore, whether the achievement of the objectives is verified or not, the question in step I is answered. This step allows determining if the changes achieved the expected levels. Therefore, the methods’ results according to the objectives follow in the subsequent discussion. The conclusions derived from the innovation try to give meaning and provide knowledge about it. For the development of these aspects, the competencies of search, selection, evaluation, and use of information are necessary because they allow corroborating or counteracting the results obtained with the proven evidence in other studies.
Finally, to complete step VI, publication and dissemination of the innovation, steps I to V must be completed. The link with the information communication competencies is highlighted since these allow the teacher to select the most appropriate technological platforms for the publication and dissemination of the innovation’s results. Once the six steps of the model have been fulfilled, the transfer of acquired knowledge can be achieved, and the new evidence can guide teaching practice. The results indicated that the preferred means for publishing and disseminating innovation results are peer-reviewed journals (open or closed), congresses, institutional conferences, and social sites such as ResearchGate (see
Figure 3).
3.3. Analysis and Interpretation of Results
The following is the analysis and interpretation of the main results responding to the research objective to analyze the relationship between the perceived capacity of university teachers’ DIC and the implementation of innovative actions based on EBEI evidence. For the analysis and interpretation, the quantitative results on the perception of DIC were the starting point. Therefore, their contribution was based on making known the level of DIC perception held by the teacher. Those items below 3 would show lower competence in the assessed skill, while scores above 3 would indicate higher competence. Then, qualitatively, through interviews with teachers, we proceeded to deepen and complement the quantitative results. The interview was oriented to learn about the application of the DIC in the development of the task that integrated the steps of the EBEI.A teacher with advanced digital competencies ensures optimal use of information. The quantitative findings found in the search, selection, and evaluation of information show that bimodal university teachers presented higher digital competencies, with a mean higher than 3 in the items Ia, Ib, Ic, Id of
Table 1. These findings are corroborated in light of the qualitative results. According to the literature, the digital competence of searching, selecting, and evaluating information allows the teacher to leverage the contents available on the internet and critically evaluate them for their teaching and research functions [
1,
18]. Consequently, bimodal teachers with competency in searching, selecting, and evaluating information available on the internet take advantage of the content potential for their teaching and research functions. They must select their information with quality criteria (reliability, veracity, and suitability) and analyze it critically.
Additionally, a teacher with the skills to navigate and search for information on the internet is positioned to find relevant information for the teaching task. Thus, in the quantitative results in item (Ia) of
Table 1, we can see that bimodal university teachers perceive themselves as having a good command of the skills to surf the internet and search for information. These results coincide with the qualitative results of
Figure 1, which indicates that the primary sources of information chosen on the Internet are Scopus and Google Scholar, followed by other sources. This aspect contributed to steps I and II of EBEI because it was necessary to identify the educational practice that the teacher wants to improve supported by evidence and qualitatively supported in the findings. These findings are similar to those found in the study by [
16]. Teachers present a high self-perception in the ability to search for information and locate it quickly and efficiently. Therefore, it can be deduced that bimodal teachers have a good command of how to search for information, locate it, and integrate it into teaching and research activities, competencies necessary for steps I (delimitation) and II (search for evidence) of EBEI.
The use of information search techniques allows the teacher to find information with greater precision. In item (Ib) of
Table 1, the quantitative results indicate that the bimodal teacher uses logical operators and keywords as basic information search techniques. These findings are corroborated with those represented in
Figure 2. A close relationship is expressed between the keyword search and operators’ support, contributing to the fulfillment of steps I and II of EBEI. [
14] states that a citizen must rethink his search practice, learning information search techniques, from basic to complex, to refine the results. Therefore, bimodal teachers consistently command basic search techniques to locate information in various sources, required for steps I (delimitation) and II (search for evidence) of EBEI. However, training in advanced search techniques that help refine the targeted information is recommended.
A characteristic of the DC is that it allows the teacher to select the information and treat it as creatively as possible. In item (Ic) of
Table 1, the teachers state that they select the information by establishing criteria that allow them to choose what is consistent with the search purposes, and they verify its license for use. This aspect is closely related to step II of EBEI. These results are corroborated with the findings described qualitatively. However, we observed that, in this process, verifying the license of use is mentioned infrequently. In this aspect, in the opinion of [
2], the trend in educational innovation is toward open education (i.e., where the potential offered by OER for teaching or research can be exploited). In this sense, it can be inferred that, although teachers perceive themselves as having regular competencies in information selection, it is necessary to reinforce training and awareness. Awareness of information containing creative commons licenses must be brought to bear since they constitute innovative teaching-learning and research.
A teacher with digital competencies can determine the value of information. In item (Id) of
Table 1, teachers indicated that they perceive themselves as critical evaluators of the information found. This is corroborated with the qualitative findings for evaluating the credibility of the information found and analyzing it critically for decision making and knowledge construction. This information is considered when formulating the innovation, especially in analyzing the needs of the educational context (international, national, local) that correspond to step III of EBEI. Consistent with [
15], one way of understanding information analysis is by critical thinking (i.e., when people determine the validity and value of the information). From this, it can be inferred that bimodal teachers have the competency to analyze information and critically evaluate it to link it to the development or formulation of an innovative project later.
Another characteristic of CDI is that the teacher can store and retrieve it. The quantitative findings determine a regular domain in item IIc of
Table 1 regarding the teacher’s understanding of the risks and advantages of storing information publicly or privately. This result is consistent with the guidelines stated by [
18,
20] and researchers [
14]. Consequently, it can be seen that bimodal teachers know and use technological tools and information storage and retrieval techniques, which allows them to be applied for specific purposes and contexts.
Among other teacher-DIC requirements is that of storing information in open or private sites. In this sense, the quantitative findings indicate that bimodal teachers have deficiencies (means below 3) in competencies IIa (2.88) and IIb (2.43) in
Table 1. These deficiencies are related to the storage of information in open access repositories, open sites (blog, wiki), and the aggregation of metadata and creative commons licenses to the information they produce and store. It is also corroborated by the results obtained qualitatively, where it can be seen that the information declared mainly highlights the use of the computer as the primary information storage technology. Therefore, we observed that there is a lack of knowledge of other storage sources. This aspect is essential for storing the selected information to integrate it in step III of EBEI (formulation of the innovation). However, these results contrast with those found in [
19], where higher values were evidenced in teachers’ storage and retrieval of information competency. From this, it can be inferred that it is necessary to reinforce training in this competence, emphasizing labeling or metadata management. The teacher must provide visibility of knowledge of open sites and stored information that facilitate collaborative work and the formulation of the innovative project, especially when it is a group project.
On the other hand, a teacher trained in DIC must know how to communicate information by different technological means. In this category, the quantitative results reflect high indexes in items IIIa and IIIb of
Table 1 about selecting the technological means of communication that best suit teachers’ purposes and transmit ideas in written and verbal form with synchronous and asynchronous communication technologies. Finally, we mention that these findings could be because the communication system of the institution under study is thoroughly planned (teaching plan). All of its bimodal professors must maintain continuous contact with the students of both study modalities (face-to-face and distance) through the EVA and synchronous tools such as Zoom, which aligns with the qualitative results. It is consistent with what is indicated by [
21] on communicating information effectively through acquired knowledge and relevant competencies. These results infer that bimodal teachers are trained and can communicate in digital environments and share resources to perform their tasks or specific purposes effectively.
Being an informationally competent subject, moreover, means being able to disseminate information. However, in competency IIIc (2.79) in
Table 1, the results also point out that teachers present deficiencies in disseminating the information they produce in open sites or private sites. However, these findings contrast with the results found qualitatively. The teachers indicated that the information they construct is disseminated mainly in journals (open or closed), refereed conferences, events of the institution, among others. That coincides with the results found in the tasks completing step VI of EBEI (publication and dissemination of innovation). The participants indicated their interest in disseminating innovations in open or closed technological media. Hence, we recommend disseminating the information (results of innovations or research) and avoiding a substantial delay, especially scientific information in open access [
22]. These results infer that it is necessary to reinforce the competencies and motivation to disseminate more information about innovations in open sites that contribute to broadening knowledge.
Another fundamental characteristic of DIC is knowing how to use information appropriately. The quantitative findings showed that bimodal teachers perceive themselves as having good competencies in the items IVa, IVb, IVc, and IVd. These results are also favored because the teaching plan establishes the use of OER (videos, images, articles, open software, among others) to reinforce learning and teaching research. Thus, consulting and citing articles in open databases to support research is a factor to be considered. In addition, bimodal teachers promote using OER with their colleagues, students, and stakeholders in their environment. For this, they consider the steps described qualitatively about how the teachers use and process the selected information to build new knowledge and formulate, implement, and evaluate innovation (steps III, IV, and V). These findings are corroborated by [
17], who mentions that teachers prefer to consult information in open sites. Additionally, [
18] points out that those who possess high skills in using and processing information can do it critically, synthesize it, and construct new knowledge. Therefore, when teachers process information critically, it can be inferred that it leads them to contrast information, synthesize ideas, respect authorship, and construct new knowledge, fulfilling steps III, IV, and V of EBEI in the task.
On the other hand, an informationally competent teacher should collaborate with other academic groups and help students become collaborative and engaged citizens. The quantitative results found in items IVe (2.81) and IVf (2.28) of
Table 1 show that teachers perceive themselves as having low competencies in promoting open publishing among colleagues, students, and the environment and the intention to collaborate in academic networks for discussion and research.
However, these results contrast with those in the interview, where it was possible to appreciate the teachers’ interest in publishing their innovations (step VI of EBEI) in peer-reviewed journals (open or closed), in peer-reviewed congresses, and institutional academic conferences. These spaces precisely allow the dissemination of information, collaboration, and exchange of experiences. These aspects are crucial and must necessarily be developed by the teacher to foster collaboration, exchange, and construction of knowledge as a collective learning process [
23]. These results, moreover, are similar to those found by [
17], who points out that only a minimal number of teachers choose to publish information openly. These results infer that the use of technological spaces to disseminate and communicate information, the results of innovation projects, and the advantages offered need to be encouraged throughout the academic community and especially among teachers.
In Education 4.0, the role of the teacher should be transformational. In developing the proposed innovation model, oriented to teachers renewing or updating their practices based on the analysis and dissemination of evidence, the DIC is necessary and relevant for the sequential fulfillment of the steps comprising it. This is consistent with SDG4 that seeks to improve the quality of education [
36]. Therefore, it can be inferred that the proposed innovation model contributes to Education 4.0, and this model, in turn, has a close relationship with the DIC.