Next Article in Journal
The Impact of Ownership Structure on Technological Innovation and Energy Intensity: Evidence from China
Next Article in Special Issue
E-Learning Readiness Assessment Using Machine Learning Methods
Previous Article in Journal
Assessment of Soil Sustainability Using the LUCAS Database in the Southwest Region of Romania
Previous Article in Special Issue
Integrating Communication and Task–Technology Fit Theories: The Adoption of Digital Media in Learning
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Acceptance of Mobile Learning Technology by Teachers: Influencing Mobile Self-Efficacy and 21st-Century Skills-Based Training

by
Nisar Ahmed Dahri
1,
Waleed Mugahed Al-Rahmi
2,*,
Abeer S. Almogren
3,
Noraffandy Yahaya
2,
Muhammad Saleem Vighio
1,
Qusay Al-maatuok
4,
Ali Mugahed Al-Rahmi
5 and
Ahmad Samed Al-Adwan
6
1
Faculty of Science, Quaid-e-Awam University of Engineering, Science and Technology, Nawabshah 67450, Pakistan
2
Faculty of Social Sciences and Humanities, School of Education, University Teknologi Malaysia, Johor 81310, Malaysia
3
Department of Visual Arts, Arts College, King Saud University, Riyadh 145111, Saudi Arabia
4
School of Digital, Technologies and Arts, Staffordshire University, Stoke-on-Trent ST4 2DF, UK
5
Faculty of Technology Management and Business, Universiti Tun Hussein Onn Malaysia, Johor 86400, Malaysia
6
Department of Business Technology, Business School, Al-Ahliyya Amman University, Amman 82822, Jordan
*
Author to whom correspondence should be addressed.
Sustainability 2023, 15(11), 8514; https://doi.org/10.3390/su15118514
Submission received: 31 March 2023 / Revised: 16 May 2023 / Accepted: 18 May 2023 / Published: 24 May 2023

Abstract

:
This study aimed to investigate the factors influencing the acceptance of mobile learning technology for 21st-century skills-based training among teachers in Saudi Arabia and Pakistan. This study adopted the Unified Theory of Acceptance and Use of Technology (UTAUT) model, which included constructs such as performance expectancy, effort expectancy, facilitating conditions, social influence, mobile self-efficacy, student self-efficacy, behavioural intention, 21st-century skills-based training, and creative thinking skills. A survey was conducted with 619 teachers from Saudi Arabia and Pakistan who participated in a two-week mobile learning-based training session. The data were analysed using structural equation modeling (SEM). The results show that all hypotheses were supported, indicating a positive relationship between the constructs and the acceptance and use of mobile learning technology for 21st-century skills-based training. This study’s findings suggest that by emphasising factors such as performance expectancy, effort expectancy, facilitating conditions, social influence, mobile self-efficacy, and student self-efficacy when designing mobile learning interventions, teachers will be more likely to accept and use mobile learning technology for 21st-century skills-based training and contributed to sustainability by providing increased access to quality education.

1. Introduction

The rapidly evolving job market and changing demands of the modern workplace require individuals to possess a new set of skills, such as 21st-century skills. These skills include critical thinking, creativity, collaboration, communication, digital literacy, and adaptability, among others [1,2]. In response to this demand, educational institutions have begun incorporating 21st-century skills-based training into their curricula to prepare students and teachers for the future workforce. Additionally, the emergence of mobile learning (M-learning) has provided a convenient and flexible means of delivering 21st-century skills-based training to learners [1,2,3]. M-learning allows learners to access educational resources and materials anytime and anywhere through mobile tools such as smartphones and tablets [4,5]. With the rising use of mobile phones, M-learning has become an attractive option for learners who wish to acquire new skills or update their existing ones. The convenience and flexibility of M-learning have made it an effective tool for delivering 21st-century skills-based training to learners.
Globally, the COVID-19 epidemic has disrupted education systems, causing schools to close and to switch to online or distant learning. This sudden shift has posed significant challenges for teachers unprepared for this new teaching mode [6,7]. In the context of Pakistan and Saudi Arabia, like many other countries, teachers faced numerous challenges in adapting to online or distance learning, such as a lack of technical skills, limited access to technology and internet connectivity, and inadequate training and support [5,8,9,10].
Teacher training programs have traditionally relied on face-to-face interactions between trainers and trainees. In Pakistan, workshops and seminars conducted by government and non-governmental organisations have been the primary approach to teacher training [9,10,11]. However, this approach has several limitations, including limited access to training opportunities for teachers in remote areas and limited opportunities for ongoing professional development [8,12,13]. To address these challenges, there has been a shift towards mobile-based training for teachers in Sindh, Pakistan, offering greater flexibility and access to training opportunities, regardless of their location [14,15,16]. In line with this, the government launched the mobile application “Sindh Taaleem” to provide training opportunities for teachers [6,11,17].
Similarly, in Saudi Arabia, there is a need to improve the quality of education, as highlighted in the TIMSS 2019 report, which showed that Saudi Arabian students in grades 4 and 8 performed below the international average in math and science subjects [18]. The Ministry of Education in Saudi Arabia has introduced initiatives for teachers’ professional development to enhance education quality and improve student learning outcomes. Leading programs such as the Teachers’ Professional Growth Program (TPGP) and the National Center for Professional Development (NCPD) aim to enhance teaching practices and offer courses in areas such as instructional design, assessment, evaluation, classroom management, leadership, and educational technology [19,20,21,22]. The Ministry has also implemented the E-learning Program, providing online training courses for teachers in educational technology and instructional design [19,20].
In both Saudi Arabia and Pakistan, mobile-based training programs for teachers have gained less attention as effective approaches to enhance their knowledge and skills, Motivated by the importance of teacher training and the growing interest in mobile-based training programs [23,24], this study aims to investigate the factors influencing the adoption of mobile-based training among teachers in Pakistan and Saudi Arabia. By examining the empirical significance of these factors, we seek to understand their impact on teachers’ acceptance and intention to use mobile-based training programs.
In the context of developing countries, the use of mobile-based learning can contribute to sustainability by providing increased access to quality education, particularly for marginalized populations such as rural and low-income communities. Mobile-based learning can also help develop 21st-century skills that are crucial for promoting sustainable development and improving the employability of graduates. However, the adoption of mobile-based learning among teachers in developing countries is often hindered by various factors, including a lack of technical skills, inadequate infrastructure, and negative attitudes toward the use of technology in education.
By examining the factors that influence teachers’ behavioural intention to adopt mobile-based learning for 21st-century skills-based training, this study has the potential to contribute to the promotion of sustainable development in education. By incorporating 21st-century skills-based training into education, learners can develop the skills necessary to address environmental, social, and economic issues and promote sustainable development [25]. Therefore, understanding the factors that influence the adoption of mobile-based learning for 21st-century skills-based training can contribute to the development of more sustainable educational practices.
We have studied various technology acceptance models to understand the factors influencing technology adoption by teachers. Various studies [26,27,28,29,30] have focused on examining the acceptance of technology in education, particularly in response to the COVID-19 pandemic. Each study used different models and variables to investigate various aspects of technology adoption, including students’ actual use of e-learning platforms [26,30], the impact of mobile learning on art education, the use of personal learning environments for self-regulated learning, and the intention of art teachers and lecturers to continue using blackboards.
In recent years, despite the many benefits of M-learning, the technology has not been widely accepted by teachers, who play a decisive role in implementing and finding success with M-learning programs [31]. Almogren and Aljammaz examined the effect of mobile learning (M-learning) on art education at King Saud University, using the technology acceptance model (TAM) and social cognitive theory (SCT). This study collected data from 124 students and analysed the relationship between students’ attitudes, perceived ease of use, usefulness, self-efficacy, and behavioural intentions toward M-learning. The results show that integrating SCT and TAM improves the prediction of students’ attitudes and intentions toward M-learning. Additionally, self-efficacy significantly predicted students’ attitudes and intentions toward M-learning. Almogren also explored the intention of art education lecturers to continue to use the blackboard during and after the COVID-19 pandemic using the Unified Theory of Acceptance and Use of Technology (UTAUT) and the technology acceptance model (TAM). This study collected data from 130 art education lecturers through a survey to measure behavioural intention, perceived usefulness, ease of use, social influence, and other variables.
Among these models, the Unified Theory of Acceptance and Use of Technology (UTAUT) has gained popularity due to its comprehensive nature and ability to predict technology adoption in different contexts [32]. investigate the readiness and acceptance of mobile learning technology among pre-service teachers in Pakistan through the COVID-19 pandemic. This study aims to identify the factors affecting pre-service teachers’ readiness and acceptance of mobile learning technology. This study collected data from 306 pre-service teachers using a survey instrument based on the UTAUT model. The results proved that performance expectancy, effort expectancy, social influence, and facilitating conditions were significant predictors of pre-service teachers’ intention to use mobile learning technology. Moreover, this study learned that pre-service teachers’ technology readiness and self-efficacy influenced their acceptance of mobile learning technology. Through various studies on technology acceptance in Pakistan and Saudi Arabia have focused on exploring the factors that influence the adoption and acceptance of various types of technology, including mobile learning, e-learning, and online learning platforms [33,34,35,36]. These studies have used various models and variables such as UTAUT, TAM, and social cognitive theory to understand the complex nature of technology adoption and acceptance in different contexts. The studies have identified several factors influencing technology adoption, including performance expectancy, effort expectancy, facilitating conditions, perceived usefulness, ease of use, self-efficacy, social influence, and infrastructure. Additionally, cultural and socio-economic factors have also been found to play a role in technology adoption and acceptance in Pakistan and Saudi Arabia.
Moreover, UTAUT includes four fundamental constructs: performance expectancy, effort expectancy, social influence, and facilitating conditions, which have been identified as important in technology adoption. However, this study intends to examine the elements that affect teachers’ acceptance of M-learning technology, focusing on mobile self-efficacy and acceptance of 21st-century skills-based training. There is still a significant gap between the potential of the technology and its actual implementation in educational settings [8,37]. In addition to these constructs, other factors such as mobile self-efficacy, students’ self-efficacy, creative thinking skills, 21st-century skills-based training, and behavioural intention to use have also been identified as important in technology adoption. In this paper, we propose a model based on UTAUT to examine the factors influencing the behavioural intention of teachers towards using mobile-based learning for 21st-century skills-based training in a developing country context.

2. Proposed Research Model and Hypothesis

UTAUT has gained popularity due to its comprehensive nature and ability to predict technology adoption in different contexts [30,31]. Several studies have validated the effectiveness of UTAUT in predicting the adoption of various technologies, such as mobile banking, social media [7,27,38], and online shopping [39]. Additionally, UTAUT has been used to compare technology adoption between different cultures and countries. The model’s ability to incorporate multiple factors influencing technology adoption has made it a valuable tool for understanding user behaviour [40,41,42]. These models have been widely used in various contexts and validated by several studies. Organisations can use these models to design and implement technology that is more likely to be accepted and used by users [4,42,43,44,45,46].
The UTAUT model has been widely adopted in research due to its high success rate, accounting for up to 70% of the variance in behavioural intention to use IT or information systems. It surpasses other comparable models in explaining technology acceptance and offers a comprehensive framework derived from eight theories in social psychology and sociology [44]. Its effectiveness in predicting user acceptance of IT in diverse contexts and its relatively recent emergence further contribute to its relevance and applicability [4,42]. The UTAUT model’s four primary constructs—performance expectancy, effort expectancy, social influence, and facilitating conditions—along with its moderators, such as gender, age, experience, and voluntariness of use, play a crucial role in understanding behavioural intention and use behaviour [47]. Its widespread adoption and customization by researchers highlight its value in comprehending technology acceptance. The proposed model is based on the UTAUT model, providing a comprehensive framework for understanding the factors influencing technology acceptance. UTAUT includes four fundamental constructs: Performance Expectancy (PE), Effort Expectancy (EE), Social Influence (SI), and Facilitating Conditions (FC). In addition to these constructs, other factors such as Mobile Self-efficacy (MSE), Students’ Self-efficacy (SSE), Creative Thinking Skills (CreT), 21st-Century skills-based Training (TRG), and Behavioural Intention (BI) to Use have also been identified as important in technology adoption. The model aims to examine the factors influencing the behavioural intention of teachers towards using mobile-based learning for 21st-century skills-based training. The proposed model can be depicted as follows; see Figure 1.
Definitions of constructs and proposed hypothesis.

2.1. Performance Expectancy (PE)

PE refers to a teacher’s belief that utilising a specific technology will improve their performance. In the context of mobile learning and training acceptance, studies have shown that PE significantly influences individuals’ acceptance of mobile learning and training [24,42]. For instance, research by Hossain et al. (2021) found that PE positively affected the intention to use mobile learning among university students [48]. PE allows the teachers to carry out the CPD activities to enhance their performance in terms of knowledge and skills and bring positive change in their behaviour [42,45,49,50,51,52].

2.2. Effort Expectancy (EE)

EE is an individual’s perception of the ease of use of a particular technology. In mobile learning and training acceptance, EE has significantly affected individuals’ intention to use mobile learning. Studies have shown that when individuals perceive mobile learning as easy to use, they are more likely to adopt it. For instance, a study by Amin et al. (2019) found that EE significantly impacted the intention to use mobile learning among higher education students [24]. Moreover, effort expectancy is deemed to have a more influence on behavioural intention [42,45,49,50,51,52].

2.3. Facilitating Conditions (FC)

FC refers to the resources and support individuals can use a particular technology. FC has significantly affected individuals’ intention to use mobile learning in mobile learning and training acceptance. Studies have shown that when individuals have access to resources and support, they are more likely to adopt mobile learning. For instance, a study by Aijaz et al. (2019) found that FC significantly impacted university students’ intention to use mobile learning [45]. FC is considered a significant predictor of assessing how people utilise information systems. Examples of supporting facilities include individual assistance, training, resources to enhance skills and knowledge, and access to a system [42,45,49,50,51,52].

2.4. Social Influence (SI)

SI refers to the impact social factors, such as peers and family, have on an individual’s decision to use a particular technology. In mobile learning and training acceptance, SI has significantly affected individuals’ intention to use mobile learning. Studies have shown that when individuals perceive social support for mobile learning, they are more likely to adopt it. For instance, Alismaiel et al. (2022) found that SI significantly impacted undergraduate students’ intention to use mobile learning [7].

2.5. Students’ Self-Efficacy (SSE)

SSE refers to an individual’s belief in their ability to learn and achieve academic success. SSE has significantly affected individuals’ intention to use mobile learning in mobile learning and training acceptance. Studies have shown that individuals with high levels of SSE are more likely to adopt mobile learning. For instance, a study by Wang et al. (2018) found that SSE significantly impacted undergraduate students’ intention to use mobile learning [52].

2.6. 21st-Century Skills-Based Training (TRG)

Next, 21st-Century Skills-based Training (TRG) refers to training programs that aim to develop skills such as communication, collaboration, critical thinking, and creativity, essential for success in the 21st century. In mobile learning and training acceptance, TRG has been found to significantly affect individuals’ intention to use mobile learning [53]. Studies have shown that when individuals perceive mobile learning as a means to develop 21st-century skills, they are more likely to adopt it. For instance, a study by Tohani et al. (2018) found that TRG significantly impacted the intention to use mobile learning among students [54].

2.7. Creative Thinking Skills (CreT)

CreT refers to an individual’s ability to think creatively and develop innovative solutions to problems. In mobile learning and training acceptance, CreT has been found to significantly affect individuals’ intention to use mobile learning [55]. Studies have shown that when individuals perceive mobile learning as a means to develop creative thinking skills, they are more likely to adopt it. For instance, a study by Alzahrani et al. (2020) found that CreT had a significant impact on the intention to use mobile learning among gifted students [56].

2.8. Mobile Self-Efficacy (MSE)

MSE refers to an individual’s belief in using mobile technology effectively. MSE has been found to significantly affect individuals’ intention to use mobile learning in mobile learning and training acceptance. Studies have shown that individuals with high levels of MSE are more likely to adopt mobile learning. A study by Chao found that MSE had a significant impact on the intention to use mobile learning among university students [57]. Therefore, this study proposed the following hypothesis.

2.9. Behavioural Intention (BI)

BI refers to an individual’s intention to use a particular technology. BI has been found to affect individuals’ actual use of mobile learning in mobile learning and training acceptance. Studies have shown that when individuals have a solid intention to use mobile learning, they are more likely to actually adopt it [4,45,58]. It refers to the participants’ intention towards the use of mobile-based CPD for an improved professional career [42,45,49,50,51,59,60,61,62]. The UTAUT model and its constructs provide a useful framework for understanding the factors that influence technology adoption in the context of teacher training during the pandemic, as shown in Figure 2. Performance Expectancy, Effort Expectancy, Social Influence, and Facilitating Conditions are essential factors to consider, as well as other factors such as Mobile Self-efficacy, Students’ Self-efficacy, Creative Thinking Skills, 21st-Century Skills-based Training, and Behavioural Intention to Use. By addressing these factors, teacher training programs can increase the adoption and effective use of technology in the classroom.
The proposed research model of this is illustrated in Figure 2.
H1 
= PE → BI: Performance Expectancy (PE) will positively affect Behavioural Intention (BI) towards using mobile-based learning for 21st-century skills-based training.
H2 
= PE → MSE: Performance Expectancy (PE) will positively affect Mobile Self-efficacy (MSE) towards using mobile-based learning for 21st-century skills-based training.
H3 
= EE → BI: Effort Expectancy (EE) will positively affect Behavioural Intention (BI) toward using mobile-based learning for 21st-century skills-based training.
H4 
= EE → MSE: Effort Expectancy (EE) will positively affect Mobile Self-efficacy (MSE) toward using mobile-based learning for 21st-century skills-based training.
H5 
= FC → BI: Facilitating Conditions (FC) will positively affect Behavioural Intention (BI) toward using mobile-based learning for 21st-century skills-based training.
H6 
= FC → MSE: Facilitating Conditions (FC) will have a positive effect on Mobile Self-efficacy (MSE) toward using mobile-based learning for 21st-century skills-based training.
H7 
= SI → BI: Social Influence (SI) will positively affect Behavioural Intention (BI) toward using mobile-based learning for 21st-century skills-based training.
H8 
= SI → TRG: Social Influence (SI) will positively affect 21st-Century Skills-based Training (TRG) for using mobile-based learning.
H9 
= SSE → BI: Students’ Self-efficacy (SSE) will positively affect Behavioural Intention (BI) toward using mobile-based learning for 21st-century skills-based training.
H10 
= SSE → TRG: Students’ Self-efficacy (SSE) will positively affect 21st-Century Skills-based Training (TRG) for using mobile-based learning.
H11 
= CreT → TRG: Creative Thinking Skills (CreT) will have a positive effect on 21st-Century Skills-based Training (TRG) for mobile-based learning.
H12 
= TRG → BI: 21st-Century Skills-based Training (TRG) will have a positive effect on Behavioural Intention (BI) toward using mobile-based learning for 21st-century skills-based training.

3. Research Methods

3.1. Study Sample and Data Collection

The study sample of this research study comprised teachers working in Saudi Arabia and Pakistan. The sample involved 700 in-service schoolteachers from both countries selected using a random sampling technique. According to [63,64], an appropriate sample size for structural equation model analysis (SEM) is a minimum of 150 participants. According to another study, a straightforward SEM model requires at least 200 participants or 5 occurrences per item. [42,43], while some studies suggested the lowest possible sample size of 351 participants. As this study is based on 36 observed indicators, the minimum sample size required is 36 × 5 = 180 participants. The teachers underwent a 12-day mobile learning training program. The MS Teams application was used as a valuable platform for teachers and teacher educators to engage in discussions about teaching and learning. It offers real-time communication through text, audio, and video functionalities. Various key features were used for the two-week training program such as polls, quizzes, and more. Its continuous assistance feature enables teachers and experts to actively participate and exchange ideas. Additionally, also used a wide range of useful resources, including textbooks, curriculum materials, training manuals, lesson plans, worksheets, videos, and audio files. It also offers tools for classroom observation, assessment, online assignment submission, help and FAQ support, rewards, and the option to export reports.
During the two-week training program, we leveraged the capabilities of MS Teams extensively. We utilised its online classroom feature, discussion rooms, chat rooms, and dedicated spaces for group work. These features facilitated collaborative learning and engagement among participants. The 4Cs (Communication, Collaboration, Critical Thinking, and Creativity) aspects of MS Teams played a crucial role in enhancing the training experience. The application encouraged effective communication and interaction, supported collaborative work among participants, fostered critical thinking through discussions and activities, and provided opportunities for creative exploration and problem-solving. Overall, MS Teams proved to be a valuable tool in delivering the training and creating an engaging learning environment, and subsequently, a survey was shared with them via WhatsApp groups after the completion of training. The survey’s purpose and guidelines were explained to the participants, and they were requested to fill it out honestly and provide accurate information. After reviewing the responses, 619 questionnaires were considered for analysis, while some others were excluded because of incomplete or missing information.

3.2. Instrument Development Methodology

A survey was developed using an extensive review of the pertinent literature to assess the variables determined in this research. The questionnaire was divided into two sections. The initial part included demographic inquiries that gathered the participants’ personal information, such as age, gender, educational level, and teaching experience. The second section contained queries related to the variables recognised in this study. The variables were rated using a 5-point Likert scale that ranged from strongly disagree to strongly agree. The questionnaire contained 36 items, with each variable consisting of 3–5 items, as specified in Table 1 and Appendix A. The questionnaire items were evaluated and revised based on feedback from domain experts (see Appendix A). A preliminary test was conducted with 50 teachers to evaluate the items’ clarity and comprehensibility and identify potential issues with the research tool. The data consistency was checked using Cronbach’s alpha method, and the outcomes indicated that Cronbach’s alpha values for all variables were over 0.7, demonstrating acceptable levels of internal consistency [63,65]. Consequently, the survey was determined to be valid and reliable for use in the research. Table 1 displays the variables, the number of items in each variable, and the associated Cronbach’s alpha values obtained from the preliminary examination.
The tool is composed of 36 items grouped into several constructs, as follows:
Performance Expectancy (PE)—this construct assesses users’ perceptions of how mobile learning can improve their learning results, motivation, and performance. It consists of four items (PE1–PE4).
Effort Expectancy (EE)—this construct assesses users’ perceptions of how easy it is to use and become skillful at using mobile learning. It consists of four items (EE1–EE4).
Facilitating Conditions (FC)—This construct assesses users’ perceptions of the resources, knowledge, and compatibility of mobile learning with their learning style. It consists of four items (FC1–FC4).
Social Influences (SI)—This construct assesses users’ perceptions of the influence of others on their use of mobile learning. It consists of four items (SI1–SI4).
Mobile Self-efficacy (MSE)—This construct assesses users’ confidence in their ability to use mobile learning. It consists of four items (MSE1–MSE4).
Creative Thinking Skills (CreT)—This construct assesses users’ ability to generate and develop new ideas. It consists of four items (CreT1–CreT4).
Students’ Self-efficacy (SSE)—This construct assesses users’ confidence in using the mobile learning system. It consists of five items (SSE1–SSE5).
Twenty-first-century Skills-based Training (TRG)—This construct assesses users’ perceptions of the training program’s effectiveness in improving their understanding and confidence in developing 21st-century skills. It consists of four items (TRG1–TRG4).
Behavioural Intention to Use (BI)—This construct assesses users’ intention to use mobile learning for future training activities and professional development. It consists of three items (BI1–BI3). This tool provides a comprehensive assessment of users’ beliefs and perceptions about mobile learning. It covers various constructs. The results of this assessment can be useful in designing and improving mobile learning programs that meet users’ needs and expectations.

3.3. Data Analysis

The data were analysed using statistical software such as SPSS and AMOS. The data were summarised using descriptive statistics. Analysing the relationships between variables and testing hypotheses required the use of inferential statistics such as correlation, regression, and path analysis [25,42,51,63,65].

3.4. Ethical Considerations

The research was carried out following ethical principles and standards, and all the participants were given informed consent before participating. The confidentiality and anonymity of the participants’ responses were guaranteed, and the data collected was exclusively utilised for research purposes.

3.5. Model Analysis

This study aims to test the structural relationship between nine variables and the actual use and acceptance of mobile learning technology based on 21st-Century Skills-based Training. Structural equation modeling (SEM) was employed to examine the research model to accomplish this aim. The process of assessing the research model is elaborated below.

3.5.1. Reliability Analysis

First, a reliability analysis using Cronbach’s alpha was conducted to evaluate the internal consistency of the questionnaire items. The pilot study results showed that Cronbach’s alpha values for all the constructs were higher than 0.7, indicating acceptable levels of internal consistency [63,65].

3.5.2. Validity Analysis

Next, the measurement model [65] was used to evaluate the convergent and discriminant validity of the constructs. To assess convergent validity, three criteria recommended by Fornell and Larcker [69] were considered: factor loading, average variance extracted (AVE), and composite reliability (CR). As indicated in Table 3, all factor loadings must exceed 0.5, which is considered suitable for further analysis according to recommendations by Hair et al. [65], Churchill [70], and Pallant and Manual [71]. Additionally, the AVE values obtained should be greater than 0.5, which is deemed acceptable for further analysis as suggested by Hair et al [65]. Likewise, the CR values for all constructs should also be above 0.8. Cronbach’s alpha was used to assess the internal consistency of the data, and the reliability coefficients must meet the recommended level of >0.7. These findings demonstrate good reliability and satisfactory internal consistency of the instruments [65,72], confirming the convergent validity of the constructs based on the fulfilled criteria.
To examine discriminant validity, the correlation among items and the difference in variance or covariance among factors were considered [65,73]. The square root of the AVE (diagonal values) and correlation coefficients of all factors (off-diagonal values) were considered. It is evident that all diagonal values (square root of the AVE) exceed the off-diagonal values (correlation coefficients) of other factors. This confirms the discriminant validity at the construct level [65,69,72].
Discriminant validity measures how well a set of variables can be distinguished. In other words, it assesses whether each variable measures a unique and distinct construct. To assess discriminant validity, compare the correlation between each variable and its construct (i.e., the diagonal element) to the correlations between the variable and all other constructs (i.e., the off-diagonal elements). If the diagonal element is higher than the off-diagonal elements, there is evidence for discriminant validity [38,43,51,74,75].

3.5.3. Confirmatory Factor Analysis (CFA)

CFA was used to evaluate the model fit indices of the research model. The model fit indices used to assess the goodness of fit of the research model included Chi-square (χ2), normed Chi-square (χ2/df), comparative fit index (CFI), Tucker–Lewis’s index (TLI), root mean square error of approximation (RMSEA), and standardized root mean square residual (SRMR). A good model fit is indicated by χ2/df values less than 3, CFI and TLI values greater than 0.90, and RMSEA and SRMR values less than 0.08.

3.5.4. Path Analysis

Finally, path analysis was used to examine the proposed hypotheses and analyse the path coefficients between the variables included in the structural model. We tested the hypothesised relationships between the constructs by estimating the direct and indirect effects of the exogenous and endogenous variables in the research model.

4. Results and Data Analysis

4.1. Demographic Data Analysis

The demographic data table provides information about the distribution of participants based on specific variables such as gender, age, education, occupation, daily time spent on social media, and favourite time to use social media. Table 2 shows some potential analyses. Gender: the sample population is predominantly male, with 404 (65.3%) participants, with females comprising the remaining 215 (35.6%). Age: Most educators fall under the age bracket of 31–40 (62.6%), while 29.1% are between the ages of 20–30. The remaining 8.1% are aged between 41–50, and there are no participants aged between 51–60. Education: The majority of the sample population holds a Master’s/M.Phil. Degree (62.6%), while 35.1% have a bachelor’s degree. Only 0.8% of the participants have a Ph.D., and the remaining 1.6% have other academic qualifications. Professional: most educators have an M.Ed. degree (58.3%), followed by a B.Ed. (31.5%). ADE and other qualifications are held by 9.5% and 0.8% of the sample population, respectively. Teaching Experience: Nearly half of the educators have 1–5 years of experience (51.8%), while 34.5% have 6–10 years of experience. Only 13.9% of the participants have 11–20 years of experience. No. Of CPD training received: Most educators have received 1–5 CPD (Continuous Professional Development) training sessions (93.9%), while only 6.3% have attended 6–10 sessions. No participant has attended more than ten sessions. Daily time spent on social media: Most participants (60%) spent 1–2 hours per day on social media and their favourite time to use social media (40%) is in the evening.

4.2. Assessment of Measurement Model

4.2.1. Reliability and Validity of Model

Table 3 presents the measurement models of factor loadings, AVE, CR, and Cronbach’s alpha for each of the nine constructs. All constructs are reliable and Cronbach’s alpha measures internal consistency or reliability. When interpreting the results of convergent validity measures, Cronbach’s alpha values range from 0.782 to 0.944, exceeding the recommended minimum value of 0.7. High values of Cronbach’s alpha indicate that the items are highly correlated, indicating a high degree of reliability.
Additionally, all constructs’ CR values are above 0.7, indicating that the constructs’ measurement model has an excellent internal consistency, as highlighted in Table 3. All constructs exhibit adequate convergent validity regarding the AVE values, with values ranging from 0.554 to 0.720, exceeding the recommended minimum value of 0.5. Thus, more than 50% of the variance in each construct is accounted for by its measures, indicating adequate convergent validity. As a result, all factor loadings are above the recommended minimum value of 0.7, indicating good discriminant validity for each construct. The performance expectancy (PE) construct has the highest factor loadings, ranging from 0.816 to 0.900, followed by students’ self-efficacy (SSE) and behavioural intention to use (BI) constructs, with factor loadings ranging from 0.812 to 0.823 and 0.813 to 0.822, respectively. The facilitating conditions (FC) construct has the lowest factor loadings, ranging from 0.721 to 0.792. Overall, the measurement model’s results indicate that the constructs exhibit good reliability, convergent validity, and discriminant validity, suggesting that the model is adequate for further analysis.
Table 3. Standardized items loading, AVE, CR, and alpha values.
Table 3. Standardized items loading, AVE, CR, and alpha values.
ConstructItemFactor LoadingAVECRCronbach’s Alpha
PEPE10.8160.7200.8810.897
PE20.862
PE30.900
PE40.814
EEEE10.7610.6270.8080.856
EE20.790
EE30.795
EE40.819
FCFC10.7740.5820.7650.845
FC20.792
FC30.764
FC40.721
SISI10.7050.6590.8360.903
SI20.836
SI30.860
SI40.838
MSEMSE10.7860.6860.8570.944
MSE20.868
MSE30.862
MSE40.794
SSESSE10.8230.6930.8870.822
SSE20.845
SSE30.863
SSE40.819
SSE50.812
TRGTRG10.7000.5540.7330.919
TRG20.721
TRG30.793
TRG40.760
CreTCreT10.8150.6230.8050.872
CreT20.854
CreT30.775
CreT40.707
BIBI10.8220.6680.8020.933
BI20.813
BI30.817

4.2.2. Discriminant Validity

Looking at Table 4, we can see that the variables have generally good discriminant validity. The diagonal elements (in bold) are higher than the off-diagonal elements, indicating that each variable measures a unique construct. For example, the correlation between PE and its construct is 0.849, while the correlations between PE and all other constructs range from 0.079 to 0.25.
Similarly, the correlation between EE and its construct is 0.792, while the correlations between EE and all other constructs range from 0.203 to 0.443. It is also worth noting that some constructs are more strongly related to each other than others. For example, FC and SI correlate by 0.34, while TRG and CreT correlate by 0.259. This suggests that these constructs may be measuring similar underlying factors. Overall, the results suggest that the variables in this analysis have good discriminant validity, meaning they measure unique and distinct constructs.

4.2.3. Goodness of Fit Measures

Table 5 shows the goodness of fit measures for the model, which assesses how well the model fits the data. The absolute fit measures include χ2, the Chi-square test statistic, degrees of freedom (df), and χ2/df, ideally between 1 and 3. In this case, the obtained value of χ2 is 1323, and the degrees of freedom are 554, resulting in an χ2/df of 2.389, indicating an acceptable fit. The goodness of fit index (GFI) obtained value of 0.889 is slightly below the recommended criteria of 0.90, while the root mean square error of approximation (RMSEA) value of 0.047 is below the recommended criteria of 0.05, indicating a good fit for the model. The incremental fit measures include the normed fit index (NFI) and comparative fit index (CFI), ideally above 0.90. In this case, the obtained values of NFI and CFI are 0.900 and 0.939, respectively, indicating an acceptable fit for the model. The parsimony fit measure is the adjusted goodness of fit index (AGFI), which should ideally be above 0.90. In this case, the obtained value of AGFI is 0.867, slightly below the recommended criteria but still acceptable.
Overall, the goodness of fit measures indicate that the model has an acceptable to good fit to the data.

4.2.4. Hypothesis Testing

The path analysis and hypothesis testing show the relationships between different factors in this study and whether these relationships are significant or not. The results suggest that all hypotheses are supported with a p-value less than 0.05, as shown in Table 6. The accepted hypothesis, H1, indicates that the relationship between performance expectancy (PE) and behavioural intention to use (BI) is positive but not significant. On the other hand, the relationships between PE and mobile self-efficacy (MSE), effort expectancy (EE) and BI, EE, and MSE, facilitating conditions (FC) and BI, FC, and MSE, social influence (SI) and 21st-Century Skills-based Training (TRG), students’ self-efficacy (SSE) and BI, SSE and TRG, creative thinking skills (CreT) and TRG, and TRG and BI are all positive and significant. These results show the importance of considering factors such as performance expectancy, mobile self-efficacy, effort expectancy, facilitating conditions, social influence, students’ self-efficacy, creative thinking skills, and training when studying technology adoption among teachers at universities, which includes the visual arts.
Additionally, this study highlights the significance of behavioural intention to use as a predictor of actual technology usage among teachers. The path analysis and hypothesis testing Table 6 of the structural model indicate the relationship between different variables and the estimates, standard errors, t-values, and critical ratio (C.R.) values. The results show that all hypotheses are supported, as the p-values are less than 0.05.
The coefficients of the predictor variable (PE) and the regression model’s intercept were both statistically significant (p < 0.001), and the overall model was significant (F = 1.041, p < 0.001). These results indicate a statistically significant positive relationship between the predictor variable (PE) and the outcome variable (BI). The effect size of the relationship was small (β = 0.056), suggesting that while there is a significant relationship, the impact of PE on BI is relatively modest. Overall, this hypothesis was accepted. H2: the relationship between PE and MSE is positive and significant, as the estimate is 0.073 with a standard error of 0.055, resulting in a t-value of 1.322 and a p-value of less than 0.001. H3: the relationship between EE and BI is positive and significant, as the estimate is 0.211 with a standard error of 0.043, resulting in a t-value of 4.898 and a p-value of less than 0.001. H4: the relationship between EE and MSE is positive and significant, as the estimate is 0.247 with a standard error of 0.048, resulting in a t-value of 5.16 and a p-value of less than 0.001.
H5: the relationship between FC and BI is positive and significant, as the estimate is 0.271 with a standard error of 0.056, resulting in a t-value of 4.871 and a p-value of less than 0.001. H6: the relationship between FC and MSE is positive and significant, as the estimate is 0.317 with a standard error of 0.052, resulting in a t-value of 6.087 and a p-value of less than 0.001. H7: the relationship between SI and BI is negative and significant, as the estimate is −0.128 with a standard error of 0.04, resulting in a t-value of −3.203 and a p-value of 0.001.H8: the relationship between SI and TRG is positive and significant, as the estimate is 0.106 with a standard error of 0.032, resulting in a t-value of 3.307 and a p-value of less than 0.001.H9: the relationship between SSE and BI is positive and significant, as the estimate is 0.106 with a standard error of 0.047, resulting in a t-value of 2.236 and a p-value of 0.025. H10: the relationship between SSE and TRG is positive and significant, as the estimate is 0.209 with a standard error of 0.037, resulting in a t-value of 5.705 and a p-value of less than 0. 001.H11: the relationship between CreT and TRG is positive and significant, as the estimate is 0.125 with a standard error of 0.034, resulting in a t-value of 3.665 and a p-value of less than 0.001. H12: the relationship between TRG and BI is positive and significant, as the estimate is 0.403 with a standard error of 0.069, resulting in a t-value of 5.872 and a p-value of less than 0.001.
H13: 
MSE → BI: The coefficients of the predictor variable (MSE) and the regression model’s intercept were both statistically significant (p < 0.001), and the overall model was highly significant (F = 4.898, p < 0.001). These results indicate a statistically significant positive relationship between the predictor variable (MSE) and the outcome variable (BI). The effect size of the relationship was moderate (β = 0.211), suggesting that the impact of MSE on BI is relatively stronger than that of PE on BI. Overall, this hypothesis was also accepted. However, these results suggest that all of the predictor variables tested have a statistically significant impact on either BI, MSE, or TRG and that these relationships are generally positive. The results of this study reveal compelling insights into the adoption of mobile learning technology among teachers.
The proposed model accounted for 27.0% of the variance in behavioural intention. However, when the identified factors related to M-learning were removed from the model, the variance explained by the model decreased to 19.0%. The higher variance explained by the model, along with the statistically significant results, particularly in relation to the factors associated with mobile technology.
These findings underscore the critical role of self-efficacy in teachers’ confidence and competence in utilising mobile devices for teaching, as well as the importance of equipping them with 21st-century skills through targeted training programs. By addressing these factors, educational institutions can empower teachers to effectively integrate mobile learning technology into their instructional practices, ultimately enhancing the quality of education and preparing students for the challenges of the 21st century.

5. Discussion

The results of this study indicated that Performance Expectancy (PE), Effort Expectancy (EE), Facilitating Conditions (FC), and Mobile Self-Efficacy (MSE) were significant predictors of BI to use mobile-based learning. Specifically, EE and FC had the highest impact on BI, followed by MSE and PE. These findings are consistent with previous studies, emphasising the importance of these constructs in technology adoption.
Furthermore, this study found that Social Influence (SI), Students’ Self-efficacy (SSE), Creative Thinking Skills (CreT), and 21st-Century Skills-based Training (TRG) were significant predictors of BI and MSE. Notably, TRG had the highest impact on BI and MSE, SSE, CreT, and SI. These findings highlight the importance of providing adequate training and support to teachers to enhance their skills and self-efficacy in mobile-based learning.
Regarding Performance Expectancy (PE), this study found a substantial positive impact on teachers’ BI toward mobile-based learning, supporting H1 and H2, which assesses respondents’ perceptions of how training through mobile learning can improve their learning results, enhance their learning motivation, increase their performance in learning activities, and be useful in their professional development, which is consistent to the findings of previous studies [4,42,76]. However, this finding could be because this study’s participants were motivated to utilise technology in their teaching practices. Effort Expectancy (EE) had a significant positive impact on teachers’ behavioural intention toward mobile-based learning. Effort Expectancy (EE) also had a significant positive impact on teachers’ BI toward mobile-based learning. This study confirmed H3, which proposed that EE positively affects BI, with a large effect size. This finding aligns with previous research and H4 suggested that EE positively affects the MSE. This finding is consistent with previous research [42,45,77], which has shown that perceived ease of use is a crucial factor in technology adoption.
Facilitating Conditions (FC) were found to have a significant positive effect on teachers’ BI toward mobile-based learning, supporting H5. The availability of resources and support from the school administration and colleagues can facilitate the adoption of mobile-based learning among teachers. This result is consistent with previous studies emphasising the importance of facilitating conditions in technology adoption [42,45,77].
In contrast, Social Influence (SI) was found to have a significant negative influence on teachers’ BI toward mobile-based learning, contradicting H7 and H8. This suggests that the pressure from colleagues and peers to adopt new technology may not always be effective and can even hinder the adoption process, which is consistent with the findings of previous studies [4,7,45].
Students’ Self-efficacy (SSE) was found to have a significant positive impact on teachers’ BI toward mobile-based learning, supporting H9 and H10. This finding highlights the importance of teachers’ belief in their students’ ability to learn and benefit from mobile-based learning. This finding also highlights the importance of teachers’ belief in their students’ ability to learn and benefit from mobile-based learning, which is consistent with the findings of previous studies [66,67].
Creative Thinking Skills (CreT) and 21st-Century Skills-based Training (TRG) were found to have a significant positive impact on teachers’ BI toward mobile-based learning. This finding supports H11, emphasising the importance of providing teachers with training and resources to enhance their creative thinking skills and develop 21st-century skills-based training, which is consistent with the findings of the previous study.
The strongest predictor of BI was 21st-Century Skills-based Training (TRG), with a significant direct effect. This finding supports H12, indicating that providing teachers with training on effectively integrating mobile-based learning into their teaching practices can significantly impact their intention to use this technology and results are consistent with previous studies [66,68].
Mobile Self-efficacy (MSE) was also found to have a significant positive impact on teachers’ BI toward mobile-based learning. This finding supports H13, indicating that teachers who feel confident and capable of using mobile-based learning technologies are more likely to have a positive intention to adopt and utilise them in their teaching practices.
This finding highlights the importance of teachers’ confidence in using mobile technology in their teaching practices. Finally, Behavioural Intention to Use (BI) is measured by three items (BI1–BI3), which assess respondents’ intentions to attend training through mobile learning in their future training activities, to use mobile learning to improve their 21st-century learning skills and to use mobile learning in the next two months for their professional development. The result was also consistent with other studies [4,45,58]
This study’s findings have significant implications for teachers’ professional development policymakers, teacher educators, and teachers or practitioners. By recognizing the factors that influence teachers’ behavioural intention to use mobile-based learning, policymakers can design effective strategies and policies to promote its adoption. It is crucial to provide adequate training and support to teachers to enhance their skills and self-efficacy in mobile-based learning. This could include workshops, professional development programs, and resources specifically designed to help teachers integrate technology effectively into their classrooms.
Moreover, this study’s findings suggest that mobile-based learning can be advantageous in improving 21st-century skills among teachers. This study revealed that Performance Expectancy (PE), Effort Expectancy (EE), Facilitating Conditions (FC), and Mobile Self-efficacy (MSE) significantly influence teachers’ behavioural intention to use mobile-based learning. Additionally, Social Influence (SI), Students’ Self-efficacy (SSE), Creative Thinking Skills (CreT), and 21st-Century Skills-based Training (TRG) were identified as important predictors of behavioural intention.
It is important to acknowledge that this study did not specifically focus on the distinction between 21st-century skills and training for those skills. This study aimed to explore the factors influencing teachers’ intention to use mobile-based learning and their impact on 21st-century skills-based training. Future research could delve deeper into examining the relationship between training characteristics and the development of 21st-century skills among teachers.
Overall, this study contributes to the existing literature by providing insights into the factors that influence teachers’ intention to adopt mobile-based learning and their implications for enhancing 21st-century skills. It is recommended that future research further investigates the actual skill gains resulting from the adoption of mobile-based learning and explores additional factors that may influence teachers’ acceptance and usage of these technologies.

6. Conclusions

This study aimed to investigate the factors influencing the adoption of mobile learning technology among teachers in Saudi Arabia and Pakistan. The UTAUT model, known for its high success rate of up to 70% in explaining behavioural intention to use IT, was adopted as the theoretical framework. The findings of this study underscore the significance of various factors in technology adoption, including performance expectancy, effort expectancy, social influence, and facilitating conditions. Additionally, mobile self-efficacy, students’ self-efficacy, creative thinking skills, 21st-century skills-based training, and behavioural intention to use were identified as essential contributors to technology adoption. The results indicate that performance expectancy positively affects behavioural intention to use and mobile self-efficacy, while effort expectancy and facilitating conditions also positively influence behavioural intention to use. Moreover, mobile self-efficacy, students’ self-efficacy, creative thinking skills, and 21st-century skills-based training were found to significantly enhance technology readiness. These findings emphasise the role of mobile-based learning in fostering 21st-century skills among teachers and highlight the importance of providing adequate training and support to facilitate technology adoption. Education policymakers, educators, and practitioners should consider these factors and insights when implementing mobile learning technology in educational institutions. By improving teachers’ self-efficacy, and creativity, and providing the necessary infrastructure and support, the challenges associated with technology adoption can be effectively addressed. Overall, this study contributes valuable insights into the field of technology adoption and provides practical implications for enhancing teachers’ adoption of mobile learning technology.

Limitations and Future Work

This study did not specifically focus on the distinction between 21st-century skills and training for those skills. Rather, it explored the factors influencing teachers’ intention to use mobile-based learning and its impact on 21st-century skills-based training. Future research should consider examining the relationship between training characteristics and the development of 21st-century skills among teachers.
This study employed cross-sectional survey data, which limited the ability to establish cause–effect relationships. Variables were measured at a specific point in time, preventing an understanding of their pre-training values. To gain deeper insights, future research should incorporate longitudinal designs to capture changes over time and explore the impact of variables measured before and after training.
Future Work: Skill gains from mobile-based learning: It is recommended that future research investigates the actual skill gains resulting from the adoption of mobile-based learning. By assessing the impact on specific 21st-century skills, such as problem-solving or digital literacy, a clearer understanding of the benefits and effectiveness of these technologies can be obtained.
Additional factors influencing acceptance and usage: To further enhance the understanding of teachers’ acceptance and usage of mobile-based learning, future research should explore additional factors beyond those examined in this study. For example, the influence of individual characteristics (e.g., age, gender, experience, qualifications) and contextual factors (e.g., cultural differences, institutional support) could be investigated to gain a more comprehensive understanding of the adoption process.
Overall, this study contributes to the existing literature by shedding light on the factors influencing teachers’ intention to adopt mobile-based learning and their implications for 21st-century skills. However, future research should address the mentioned limitations and pursue the suggested avenues to advance the understanding of mobile-based learning for 21st-century skills-based training adoption.

Author Contributions

All authors shared equal responsibility for the invention of the idea, the implementation and analysis of the experimental results, and the drafting of the text. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the King Saud University, Riyadh, Saudi Arabia, through Researchers Supporting Project RSP2023R417.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

All subjects who took part in this study gave their informed consent.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A. Instrument Measurements (Questionnaire)

S.NoItems
Performance Expectancy
1PE1: Training through mobile learning improves my learning results.
2PE2: Training through mobile learning enhances my learning motivation.
3PE3: Training through mobile learning increases my performance in my learning activities.
4PE4: I would find training through mobile learning useful in my professional development.
Effort Expectancy
5EE1: I would find training through mobile learning is easy for me to use.
6EE2: I would find it easy for me to become skillful at attaining training through mobile learning.
7EE3: I would become proficient at using training through mobile learning applications.
8EE4: My learning activities with mobile learning are clear and understandable.
Facilitating Conditions
9FC1: I have the resources necessary to attend training through mobile learning.
10FC2: I have the knowledge necessary to use training through mobile learning.
11FC3: I think that using training through l learning fits well with the way I like to learn.
12FC4: If I have problems using mobile learning, I could solve them very quickly.
Social Influences
13SI1: People who are important to me think that I should use mobile learning for 21st-century skills-based trainings.
14SI2: People who affect my learning behavior think that I should use mobile learning.
15SI3: My peers and teachers think that I should use mobile learning.
16SI4: I think that using mobile learning is fashionable and enjoyable.
Mobile Self-efficacy
17MSE1: I have qualification to use and operate mobile learning application.
18MSE2: I have qualification to use and operate mobile learning application via internet.
19MSE3: I have skills in using mobile learning application.
20MSE4: I am confident of using mobile learning application.
Creative Thinking Skills
21CreT1: I am able to discover new ways of doing things.
22Cret2: use idea-generating techniques such as brainstorming to develop several original design ideas.
23Cret3: I contribute ideas that could be helpful in this class.
24Cret4: I develop innovative ideas.
Students’ Self-efficacy
25SSE1: I feel confident in the utilization of mobile learning system even when no one is there for assistance.
26SSE2: I have sufficient skills to use the mobile learning system.
27SSE3: I feel confident when using the mobile learning system even if I have only the online instructions.
28SSE4: I feel confident when using the mobile learning system features.
29SSE5: I feel confident when using the online learning content in the mobile learning.
21st Century Skills-based Training
30TRG1: My level of understanding was substantially improved after going through the training program.
31TRG2: The training through mobile learning gave me confidence in developing 21st-century skills.
32TRG3: The training was of adequate length and detail.
33TRG4: The trainers were knowledgeable and aided me in my understanding of 21st-century skills.
Behavioural Intention to Use
34BI1: I intend to attend training through mobile learning in my future training activities.
35BI2: I would use mobile learning to improve my 21st-century learning skills.
36BI3: I plan to use mobile learning in the next 2 months for my professional development.

References

  1. Voogt, J.; Roblin, N.P. 21st century skills. Discuss. Zoetermeer Neth. Kennisnet 2010, 23, 2000. [Google Scholar]
  2. P21 Framework for 21st Century Learning Definitions; Battelle for Kids: Columbus, OH, USA, 2019.
  3. Voogt, J.; Roblin, N.P. A comparative analysis of international frameworks for 21st century competences: Implications for national curriculum policies. J. Curric. Stud. 2012, 44, 299–321. [Google Scholar] [CrossRef]
  4. Dahri, N.A.; Vighio, M.S.; Bather, J.D.; Arain, A.A. Factors Influencing the Acceptance of Mobile Collaborative Learning for the Continuous Professional Development of Teachers. Sustainability 2021, 13, 13222. [Google Scholar] [CrossRef]
  5. Dahri, N.A.; Vighio, M.S.; Alismaiel, O.A.; Al-Rahmi, W.M. Assessing the Impact of Mobile-Based Training on Teachers’ Achievement and Usage Attitude. Int. J. Interact. Mob. Technol. 2022, 66, 107–129. [Google Scholar] [CrossRef]
  6. Zubairi, A.; Halim, W.; Kaye, T.; Wilson, S. Country-Level Research Review; EdTech in Pakistan: Karachi, Pakistan, 2021. [Google Scholar]
  7. Alismaiel, O.A.; Cifuentes-Faura, J.; Al-Rahmi, W.M. Online Learning, Mobile Learning, and Social Media Technologies: An Empirical Study on Constructivism Theory during the COVID-19 Pandemic. Sustainability 2022, 14, 11134. [Google Scholar] [CrossRef]
  8. Singh, A.K.; Rind, I.A.; Sabur, Z. Continuous Professional Development of School Teachers. In Handbook of Education Systems in South Asia; Springer: Berlin/Heidelberg, Germany, 2021; p. 1355. [Google Scholar]
  9. Singh, A.K.; Rind, I.A.; Sabur, Z. Continuous Professional Development of School Teachers: Experiences of Bangladesh, India, and Pakistan. In Handbook of Education Systems in South Asia; Springer: Berlin/Heidelberg, Germany, 2020; pp. 1–27. [Google Scholar]
  10. Rawal, S.; Aslam, M.; Jamil, B. Teacher characteristics, actions and perceptions: What matters for student achievement in Pakistan? 2013. CSAE Working Paper: University of Oxford, England. Available online: https://ora.ox.ac.uk/objects/uuid:eb83bdf8-0424-4c25-aa7f-adcd800d2d30/download_file?file_format=&hyrax_fileset_id=s2z10wq69v&safe_filename=csae-wps-2013-19.pdf&type_of_work=Working+paper (accessed on 15 January 2023).
  11. Dahri, N.A.; Al-Rahmi, W.M.; Almogren, A.S.; Yahaya, N.; Vighio, M.S.; Al-Maatuok, Q. Mobile-Based Training and Certification Framework for Teachers’ Professional Development. Sustainability 2023, 15, 5839. [Google Scholar] [CrossRef]
  12. British Council. Continuing professional development (CPD) options for primary school teachers (PSTs) at school and local level in Punjab. 2018. Available online: https://www.britishcouncil.pk/sites/default/files/cpd_options_for_psts_at_school_and_local_level_in_punjab_-_british_council_2018.pdf (accessed on 15 March 2023).
  13. Sindh, G. Continuous Professional Development (CPD) Model. Report. 2017. Available online: http://www.sindheducation.gov.pk/Contents/Menu/CPD Model.pdf (accessed on 15 March 2023).
  14. UNESCO. Mobile Learning for Teachers in Asia Working Paper Series on Mobile Learning—Teacher Focus; UNESCO: Paris, France, 2012. [Google Scholar]
  15. So, H.-J. Turning on mobile learning in Asia: Illustrative initiatives and policy implications. Policy Focus UNESCO Work. Pap. Ser. Mob. Learn. 2012, 1, 1–32. [Google Scholar]
  16. PPKHA Team. Tracer Study Report 2020; UNESA: Jawa Timur, Indonesia, 2020; Volume 27, p. 16. [Google Scholar]
  17. Government of Pakistan. Pakistan’s Implementation the 2030 Agenda for Sustainable Development-Voluntary National Review; Ministry of Planning, Development&Special Initiatives: Islamabad, Pakistan, 2019. [Google Scholar]
  18. Alghamdi, N. TIMSS 2019 Report-(First Insights into Mathematics and Science Achievements of Saudi Arabia Students in Grades 4 and 8 in an International Context; Education & Training Evaluation Commission: Riyadh, Saudi Arabia, 2021; Available online: https://www.iea.nl/sites/default/files/2021-03/TIMSS%202019-%20Saudi%20Arabia%20national%20report.pdf (accessed on 15 March 2023).
  19. Singh, H.P.; Singh, A.; Alam, F.; Agrawal, V. Impact of sustainable development goals on economic growth in Saudi Arabia: Role of education and training. Sustainability 2022, 14, 14119. [Google Scholar] [CrossRef]
  20. Aldegether, R. Saudi Arabia’s Vision 2030: Approaches to multicultural education and training. Int. J. Innov. Creat. Chang. 2020, 12, 92–102. [Google Scholar]
  21. Alansari, I.H. Inservice Education and Training of EFL Teachers in Saudi Arabia: A Study of Current Provision and Future Needs. 1997. Available online: https://eprints.soton.ac.uk/458782/ (accessed on 15 March 2023).
  22. Maboya, M.J.; Jita, L.C.; Chimbi, G.T. Reaping the Rewards of Professional Development: Evidence from Mathematics Teachers’ Pedagogical Practices. Int. J. Instr. 2022, 15, 873–890. [Google Scholar] [CrossRef]
  23. Iqbal, S.; Hanif, R.; Ali, F.; Tahir, M.; Minhas, R.; Yasmeen, R.; Khokhar, A.; Laique, T. Teachers’ Perceptions of Netiquette Practices by undergraduate Dental Students During Online Classes in COVID-19 Pandemic. Development 2021, 7, 2–8. [Google Scholar] [CrossRef]
  24. Almaiah, M.A.; Alamri, M.M.; Al-Rahmi, W. Applying the UTAUT model to explain the students’ acceptance of mobile learning system in higher education. IEEE Access 2019, 7, 174673–174686. [Google Scholar] [CrossRef]
  25. ARAIN, A.A.; Hussain, Z.; Vighio, M.S.; Rizvi, W.H. Factors influencing acceptance of Mobile learning by higher education students in Pakistan. Sindh Univ. Res. J.-SURJ Sci. Ser. 2018, 50, 141–146. [Google Scholar] [CrossRef]
  26. Gurban, M.A.; Almogren, A.S. Students’ actual use of E-learning in higher education during the COVID-19 pandemic. SAGE Open 2022, 12, 21582440221091250. [Google Scholar] [CrossRef]
  27. Almogren, A.S.; Aljammaz, N.A. The integrated social cognitive theory with the TAM model: The impact of M-learning in King Saud University art education. Front. Psychol. 2022, 13, 1050532. [Google Scholar] [CrossRef]
  28. Alserhan, S.; Alqahtani, T.M.; Yahaya, N.; Al-Rahmi, W.M.; Abuhassna, H. Personal Learning Environments: Modeling Students’ Self-Regulation Enhancement through a Learning Management System Platform. IEEE Access 2023, 11, 5464–5482. [Google Scholar] [CrossRef]
  29. Almogren, A.S. Art education lecturers’ intention to continue using the blackboard during and after the COVID-19 pandemic: An empirical investigation into the UTAUT and TAM model. Front. Psychol. 2022, 13. [Google Scholar] [CrossRef] [PubMed]
  30. Alqahtani, M.A.; Alamri, M.M.; Sayaf, A.M.; Al-Rahmi, W.M. Exploring student satisfaction and acceptance of e-learning technologies in Saudi higher education. Front. Psychol. 2022, 13, 939336. [Google Scholar] [CrossRef]
  31. Al-Rahmi, A.M.; Al-Rahmi, W.M.; Alturki, U.; Aldraiweesh, A.; Almutairy, S.; Al-Adwan, A.S. Exploring the factors affecting mobile learning for sustainability in higher education. Sustainability 2021, 13, 7893. [Google Scholar] [CrossRef]
  32. Asghar, M.Z.; Barberà, E.; Younas, I. Mobile Learning Technology Readiness and Acceptance among Pre-Service Teachers in Pakistan during the COVID-19 Pandemic. Knowl. Manag. E-Learn. 2021, 13, 83–101. [Google Scholar]
  33. Bakhsh, M.; Mahmood, A.; Sangi, N.A.; Iqbal, M.J. M-learning acceptance among faculty and students in Pakistan: A structural equation modeling. In Structural Equation Modeling Approaches to E-Service Adoption; IGI Global: Hershey, PA, USA, 2019; pp. 187–221. [Google Scholar]
  34. Uppal, M.A.; Ali, S.; Zahid, Z.; Basir, M. Factors determining student’s perception towards mobile learning: An empirical study of Pakistan’s higher education. Pak. J. Distance Online Learn. 2020, 5, 101–124. [Google Scholar]
  35. Bakhsh, M.; Mahmood, A.; Sangi, N.A. Examination of factors influencing students and faculty behavior towards m-learning acceptance: An empirical study. Int. J. Inf. Learn. Technol. 2017, 34, 166–188. [Google Scholar] [CrossRef]
  36. Huang, Y.-C. Integrated concepts of the UTAUT and TPB in virtual reality behavioral intention. J. Retail. Consum. Serv. 2023, 70, 103127. [Google Scholar] [CrossRef]
  37. Dahri, N.A.; Vighio, M.S.; Al-Rahmi, W.M.; Alismaiel, O.A. Usability Evaluation of Mobile App for the Sustainable Professional Development of Teachers. Int. J. Interact. Mob. Technol. 2022, 16, 4–30. [Google Scholar] [CrossRef]
  38. Al-Rahmi, W.M.; Othman, M.S. Evaluating student’s satisfaction of using social media through collaborative learning in higher education. Int. J. Adv. Eng. Technol. 2013, 6, 1541. [Google Scholar]
  39. Kim, S.-J.; Shin, D.-H. The effects of ambient scent on hedonic experience on online shopping. In Proceedings of the 11th International Conference on Ubiquitous Information Management and Communication, Beppu, Japan, 5–7 January 2017; pp. 1–5. [Google Scholar]
  40. Venkatesh, V.; Brown, S.A.; Maruping, L.M.; Bala, H. Predicting different conceptualizations of system use: The competing roles of behavioral intention, facilitating conditions, and behavioral expectation. MIS Q. 2008, 32, 483–502. [Google Scholar] [CrossRef]
  41. Taherdoost, H. A review of technology acceptance and adoption models and theories. Procedia Manuf. 2018, 22, 960–967. [Google Scholar] [CrossRef]
  42. Al-Rahmi, W.M.; Al-Adwan, A.S.; Al-Maatouk, Q.; Othman, M.S.; Alsaud, A.R.; Almogren, A.S.; Al-Rahmi, A.M. Integrating Communication and Task–Technology Fit Theories: The Adoption of Digital Media in Learning. Sustainability 2023, 15, 8144. [Google Scholar] [CrossRef]
  43. Alalwan, N.; Al-Rahmi, W.M.; Alfarraj, O.; Alzahrani, A.; Yahaya, N.; Al-Rahmi, A.M. Integrated three theories to develop a model of factors affecting students’ academic performance in higher education. IEEE Access 2019, 7, 98725–98742. [Google Scholar] [CrossRef]
  44. Almulla, M.A.; Al-Rahmi, W.M. Integrated Social Cognitive Theory with Learning Input Factors: The Effects of Problem-Solving Skills and Critical Thinking Skills on Learning Performance Sustainability. Sustainability 2023, 15, 3978. [Google Scholar] [CrossRef]
  45. Arain, A.A.; Hussain, Z.; Rizvi, W.H.; Vighio, M.S. Extending UTAUT2 toward acceptance of mobile learning in the context of higher education. Univers. Access Inf. Soc. 2019, 18, 659–673. [Google Scholar] [CrossRef]
  46. Al-Maatouk, Q.; Othman, M.S.; Aldraiweesh, A.; Alturki, U.; Al-Rahmi, W.M.; Aljeraiwi, A.A. Task-technology fit and technology acceptance model application to structure and evaluate the adoption of social media in academia. IEEE Access 2020, 8, 78427–78440. [Google Scholar] [CrossRef]
  47. Mohamed, A.A. Factors Affecting Secondary School Teachers’ Intention to Use Education 4.0 in UAE: A UTAUT Analysis. Malays. J. Soc. Sci. Humanit. 2023, 8, e002254. [Google Scholar] [CrossRef]
  48. Hossain, M.N.; Talukder, M.S.; Khayer, A.; Bao, Y. Investigating the factors driving adult learners’ continuous intention to use M-learning application: A fuzzy-set analysis. J. Res. Innov. Teach. Learn. 2021, 14, 245–270. [Google Scholar] [CrossRef]
  49. Venkatesh, V.; Thong, J.Y.L.; Xu, X. Consumer acceptance and use of information technology: Extending the unified theory of acceptance and use of technology. MIS Q. 2012, 157–178. [Google Scholar] [CrossRef]
  50. Ajzen, I. The theory of planned behavior. Organ. Behav. Hum. Decis. Process. 1991, 50, 179–211. [Google Scholar] [CrossRef]
  51. Venkatesh, V. Determinants of perceived ease of use: Integrating control, intrinsic motivation, and emotion into the technology acceptance model. Inf. Syst. Res. 2000, 11, 342–365. [Google Scholar] [CrossRef]
  52. Wang, X.; Zhang, Y.; Hui, Z.; Bai, W.; Terry, P.D.; Ma, M.; Li, Y.; Cheng, L.; Gu, W.; Wang, M. The mediating effect of regulatory emotional self-efficacy on the association between self-esteem and school bullying in middle school students: A cross-sectional study. Int. J. Environ. Res. Public Health 2018, 15, 991. [Google Scholar] [CrossRef]
  53. Kocak, O.; Coban, M.; Aydin, A.; Cakmak, N. The mediating role of critical thinking and cooperativity in the 21st century skills of higher education students. Think. Ski. Creat. 2021, 42, 100967. [Google Scholar] [CrossRef]
  54. Tohani, E.; Aulia, I. Effects of 21st Century Learning on the Development of Critical Thinking, Creativity, Communication, and Collaboration Skills. J. Nonform. Educ. 2022, 8. [Google Scholar] [CrossRef]
  55. Ahmed, S.A.; Alzahrani, S.G. Impact of creative problem solving program on the development of creative thinking skills among university female students. Arts Humanit. 2020, 28, 231–249. [Google Scholar]
  56. Alzahrani, A.-A.; Al-Dhaimat, Y.; Shahin, A. The Effectiveness of Future Problem-Solving Program (FPSP) in Developing Creative Thinking Skills Among Gifted Students: Experimental Study. J. Educ. Pract. 2020, 11, 138–147. [Google Scholar]
  57. Chao, C.-M. Factors determining the behavioral intention to use mobile learning: An application and extension of the UTAUT model. Front. Psychol. 2019, 10, 1652. [Google Scholar] [CrossRef]
  58. Dahri, N.A.; Vighio, M.S.; Dahri, M.H. An Acceptance of Web Based Training System for Continuous Professional Development. A Case Study of Provincial Institute of Teacher Education Sindh, Nawabshah. In Proceedings of the 2018 3rd International Conference on Emerging Trends in Engineering, Sciences and Technology (ICEEST), Karachi, Pakistan, 21–22 December 2018; pp. 1–8. [Google Scholar] [CrossRef]
  59. Marinkovic, V.; Kalinic, Z. Antecedents of customer satisfaction in mobile commerce: Exploring the moderating effect of customization. Online Inf. Rev. 2017, 41, 138–154. [Google Scholar] [CrossRef]
  60. Akram, U.; Fülöp, M.T.; Tiron-Tudor, A.; Topor, D.I.; Căpușneanu, S. Impact of digitalization on customers’ well-being in the pandemic period: Challenges and opportunities for the retail industry. Int. J. Environ. Res. Public Health 2021, 18, 7533. [Google Scholar] [CrossRef] [PubMed]
  61. Venkatesh, V.; Morris, M.G.; Davis, G.B.; Davis, F.D. User acceptance of information technology: Toward a unified view. MIS Q. 2003, 27, 425–478. [Google Scholar] [CrossRef]
  62. Davis, F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 1989, 13, 319–340. [Google Scholar] [CrossRef]
  63. Hair, J.F.; Sarstedt, M.; Pieper, T.M.; Ringle, C.M. The use of partial least squares structural equation modeling in strategic management research: A review of past practices and recommendations for future applications. Long Range Plann. 2012, 45, 320–340. [Google Scholar] [CrossRef]
  64. Deriquito, M.; Domingo, Z. Mobile Learning for Teachers in Asia: Exploring the Potential of Mobile Technologies to Support Teachers and Improve Practice. In Teacher Focus: UNESCO Working Paper Series on Mobile Learning; UNESCO: Paris, France, 2012; pp. 1–41. [Google Scholar]
  65. Hair, J.F.; Sarstedt, M.; Ringle, C.M.; Mena, J.A. An assessment of the use of partial least squares structural equation modeling in marketing research. J. Acad. Mark. Sci. 2012, 40, 414–433. [Google Scholar] [CrossRef]
  66. Kelley, T.R.; Knowles, J.G.; Han, J.; Sung, E. Creating a 21st century skills survey instrument for high school students. Am. J. Educ. Res. 2019, 7, 583–590. [Google Scholar] [CrossRef]
  67. Haviz, M.; Maris, I.M.; Adripen; Lufri; David; Fudholi, A. Assessing pre-service teachers’ perception on 21st century skills in Indonesia. J. Turk. Sci. Educ. 2020, 17, 351–363. [Google Scholar]
  68. Chu, S.K.W.; Reynolds, R.B.; Tavares, N.J.; Notari, M.; Lee, C.W.Y. Assessment instruments for twenty-first century skills. In 21st Century Ski. Dev. Through Inq. Learn. From Theory to Pract; Springer: Gateway East Singapore, Singapore, 2017; pp. 163–192. [Google Scholar] [CrossRef]
  69. Fornell, C.; Larcker, D.F. Evaluating structural equation models with unobservable variables and measurement error. J. Mark. Res. 1981, 18, 39–50. [Google Scholar] [CrossRef]
  70. Churchill Jr, G.A. A paradigm for developing better measures of marketing constructs. J. Mark. Res. 1979, 16, 64–73. [Google Scholar] [CrossRef]
  71. Pallant, J. SPSS Survival Manual: A Step by Step Guide to Data Analysis Using IBM SPSS; McGraw-Hill Education (UK): London, UK, 2020; ISBN 0335249507. [Google Scholar]
  72. Gefen, D.; Straub, D.; Boudreau, M.-C. Structural equation modeling and regression: Guidelines for research practice. Commun. Assoc. Inf. Syst. 2000, 4, 7. [Google Scholar] [CrossRef]
  73. Anderson, J.C.; Gerbing, D.W. Structural equation modeling in practice: A review and recommended two-step approach. Psychol. Bull. 1988, 103, 411. [Google Scholar] [CrossRef]
  74. Balkaya, S.; Akkucuk, U. Adoption and Use of Learning Management Systems in Education: The Role of Playfulness and Self-Management. Sustainability 2021, 13, 1127. [Google Scholar] [CrossRef]
  75. Hair, J.F.; Black, W.C.; Babin, B.; Anderson, R.E. Multivariate Data Analysis: A Global Perspective; Pearson Prentice Hall: Cranbury, NJ, USA, 2010. [Google Scholar]
  76. Bharati, V.J.; Srikanth, R. Modified UTAUT2 model for m-learning among students in India. Int. J. Learn. Chang. 2018, 10, 5–20. [Google Scholar] [CrossRef]
  77. Alalwan, A.A.; Dwivedi, Y.K.; Rana, N.P. Factors influencing adoption of mobile banking by Jordanian bank customers: Extending UTAUT2 with trust. Int. J. Inf. Manag. 2017, 37, 99–110. [Google Scholar] [CrossRef]
Figure 1. Proposed research model.
Figure 1. Proposed research model.
Sustainability 15 08514 g001
Figure 2. Proposed research hypothesis.
Figure 2. Proposed research hypothesis.
Sustainability 15 08514 g002
Table 1. Constructs, Cronbach’s alpha values, and references.
Table 1. Constructs, Cronbach’s alpha values, and references.
ConstructNumber of ItemsCronbach’s AlphaReferences
Performance Expectancy (PE)40.85[42,45,49,50,51,52]
Effort Expectancy (EE)40.83[42,45,49,50,51,52]
Facilitating Conditions (FC)40.81[42,45,49,50,51,52]
Social Influences (SI)40.79
Mobile Self-efficacy (MSE)40.87[24,57]
Students’ Self-efficacy (SSE)50.89[66,67]
Creative Thinking Skills (CreT)40.84
21st-Century Skills-based Training (TRG)40.82[66,68]
Behavioural Intention to Use (BI)30.78[4,45,58]
Table 2. Demographic information of participants.
Table 2. Demographic information of participants.
ItemsDescriptionSample%
GenderMale40465.3
Female21534.7
Age20–3018029.1
31–4038962.9
41–50508.1
51–6000.0
Education (Academic)Bachelor’s degree21735.1
Master’s/M.Phil.38762.6
Ph.D.050.8
Other101.6
ProfessionalB.Ed.19531.5
M.Ed.36058.3
ADE599.5
Other50.8
Teaching experience1–532051.8
6–1021334.5
11–208613.9
No. of CPD training received1–558093.9
6–10396.3
11–2000.0
Daily time spent on social media1–237160.0
3–415224.6
>49615.5
Favourite time to use social mediaMorning14724.0
Noon/Evening24740.0
Night22536.4
Table 4. Discriminated validity measures.
Table 4. Discriminated validity measures.
PEEEFCSIMSESSETRGCreTBI
PE0.849
EE0.2030.792
FC0.250.3370.763
SI0.2090.2670.340.812
MSE0.1670.3430.3710.4240.828
SSE0.2350.1930.3570.3470.3650.832
TRG0.1480.3050.310.3280.4030.3670.744
CreT0.0790.2260.1530.3250.2510.1570.2590.789
BI0.180.4430.4060.1720.4040.3420.4430.2810.817
Table 5. Summary of model fit indices.
Table 5. Summary of model fit indices.
MeasuresFit IndicesObtained ValueRecommended Criteria
Absolute fit measuresχ21323-
df554-
χ2/df2.3891 < χ2/df < 3
GFI0.889≥0.90
RMSEA0.047<0.05
Incremental fit measuresNFI0.900≥0.90
CFI0.939≥0.90
Parsimony fit measuresAGFI0.867≥0.90
Table 6. Hypothesis testing (path relationships) of structural model.
Table 6. Hypothesis testing (path relationships) of structural model.
HypothesisRelationshipEstimates
(β, Value)
S.E.C.R. or (T Value)P
(p < 0.001)
Result
H1PEBI0.0560.0541.0410.000Accepted
H2PEMSE0.0730.0551.3220.000Accepted
H3EEBI0.2790.0475.950.000Accepted
H4EEMSE0.2470.0485.160.000Accepted
H4FCBI0.2710.0564.8710.000Accepted
H6FCMSE0.3170.0526.0870.000Accepted
H7SIBI−0.1280.04−3.2030.001Accepted
H8SITRG0.1060.0323.3070.000Accepted
H9SSEBI0.1060.0472.2360.025Accepted
H10SSETRG0.2090.0375.7050.000Accepted
H11CreTTRG0.1250.0343.6650.000Accepted
H12TRGBI0.4030.0695.8720.000Accepted
H13MSEBI0.2110.0434.8980.000Accepted
Note: SE: standard error; C.R: critical ratio or T-value; and P: p-Value.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Dahri, N.A.; Al-Rahmi, W.M.; Almogren, A.S.; Yahaya, N.; Vighio, M.S.; Al-maatuok, Q.; Al-Rahmi, A.M.; Al-Adwan, A.S. Acceptance of Mobile Learning Technology by Teachers: Influencing Mobile Self-Efficacy and 21st-Century Skills-Based Training. Sustainability 2023, 15, 8514. https://doi.org/10.3390/su15118514

AMA Style

Dahri NA, Al-Rahmi WM, Almogren AS, Yahaya N, Vighio MS, Al-maatuok Q, Al-Rahmi AM, Al-Adwan AS. Acceptance of Mobile Learning Technology by Teachers: Influencing Mobile Self-Efficacy and 21st-Century Skills-Based Training. Sustainability. 2023; 15(11):8514. https://doi.org/10.3390/su15118514

Chicago/Turabian Style

Dahri, Nisar Ahmed, Waleed Mugahed Al-Rahmi, Abeer S. Almogren, Noraffandy Yahaya, Muhammad Saleem Vighio, Qusay Al-maatuok, Ali Mugahed Al-Rahmi, and Ahmad Samed Al-Adwan. 2023. "Acceptance of Mobile Learning Technology by Teachers: Influencing Mobile Self-Efficacy and 21st-Century Skills-Based Training" Sustainability 15, no. 11: 8514. https://doi.org/10.3390/su15118514

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop