Next Article in Journal
Scrutinizing Business Development Research: Dynamic Retrospective Analysis and Conceptual Evolution
Previous Article in Journal
The Impact of Green Human Resource Management Practices on Employees, Clients, and Organizational Performance: A Literature Review
Previous Article in Special Issue
The Impact of the COVID-19 Pandemic on the Use of the Menor Preço Brasil Application
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Exploring the Relationships between the Enablers and Results Criteria of the EFQM Model 2013 in the Context of the Greek Public Administrative Services

by
Dimitra Mitsiou
1 and
Kostas Zafiropoulos
2,*
1
Department of International and European Studies, School of Social Sciences, University of Macedonia, 546 36 Thessaloniki, Greece
2
Department of Educational and Social Policy, School of Social Sciences, University of Macedonia, 546 36 Thessaloniki, Greece
*
Author to whom correspondence should be addressed.
Adm. Sci. 2024, 14(4), 79; https://doi.org/10.3390/admsci14040079
Submission received: 22 March 2024 / Revised: 18 April 2024 / Accepted: 19 April 2024 / Published: 22 April 2024
(This article belongs to the Special Issue Challenges and Future Trends in Digital Government)

Abstract

:
This study presents a first attempt to apply and validate the European Foundation for Quality Management (EFQM) Model 2013 as a framework in the context of public administrative services in Greece, and to explore the relationships between the model’s enablers and results criteria. The methodological approach adopted was quantitative research with a structured questionnaire, while partial least squares structural equation modeling (PLS-SEM) was applied to validate the model and test the cause–effect relationships between the enablers and results on a national sample of 155 managers. The results confirmed the reliability and validity of the EFQM Model 2013 in the context of this study and revealed significant relationships between the model’s enablers and results. In addition, the empirical findings of this study may improve our understanding of the underlying relationships between the EFQM model criteria, but should not be generalized, as this study only concerned Greek public administrative services. Finally, this study may provide valuable insights to managers and governing bodies responsible for policy-making about the significance and magnitude of the relationships between the enablers and results criteria so that they can develop strategies to improve the operational and strategic performance of the Greek public administrative services.

1. Introduction

The European Foundation for Quality Management (EFQM) model is a world-renowned model that was created in 1991 (Fonseca et al. 2021) and has undergone several revisions to remain in line with the developments and advances that have occurred over the years (Santos-Vijande and Alvarez-Gonzalez 2007). The latest update of the model is the EFQM Model 2020, which since its introduction and until the first half of 2021, was in parallel use with the previous version, the EFQM Model 2013, and the interested parties had the choice of using one of the aforementioned models for their assessment according to the context. As a result of the above, there is not enough information currently available about the outcomes of applying the novel version of the model; therefore, it would be a more productive approach to use the EFQM Model 2020 as a research model when adequate information is at hand (Bocoya-Maline et al. 2024). In contrast, the previous version, i.e., the EFQM Model 2013, is a well-established model that has been used by managers to evaluate the performance of their organization, but also by academics in research. The EFQM Model 2013 has nine criteria grouped into two different sets: the enablers and results. The enablers comprise five criteria—leadership; strategy; people; partnerships and resources; and processes, products, and services—while the results comprise four criteria—people results, customer results, business results, and society results (Figure 1).
The study of Suárez et al. (2017) reviewed the application of the EFQM model in quantitative research from 1991 to 2015 and found that the EFQM model is a valid, reliable, and cross-cutting framework in quantitative research. Furthermore, Suárez et al. (2017) emphasized the need for future research to further analyze the model in different contexts. Even though the EFQM Model 2013 has been widely used in quantitative research, a review of the literature revealed a limited number of studies that examined the relationships between the enablers and/or results criteria of the EFQM Model 2013 in Europe and beyond. In addition, most of the aforementioned studies focused on private organizations and applied different methodological techniques to investigate the relationships between the criteria of the EFQM Model 2013, such as the structural equation modeling approach and correlation analysis. Specifically, the study by Belvedere et al. (2018) investigated the relationships between the EFQM model criteria in the context of 118 private companies operating in different sectors in Europe, Asia, the Middle East, South America, Australia, and the USA by applying the SEM approach. The study revealed positive and significant relationships between the model’s criteria, as leadership had significant and strong positive effects on people, strategy, and partnerships and resources; people, strategy, and partnerships and resources had significant and moderate positive effects on processes, products, and services; processes and products and services had significant and strong positive effects on people results, customer results, and society results; people results and society results had significant and moderate effects on business results; and customer results had significant and modest effects on business results (Belvedere et al. 2018).
Moreover, Para-González et al. (2021) used the SEM methodology to examine the relationships between some of the EFQM 2013 enablers in the environment of 200 industrial companies in Spain, and the study showed that leadership had significant and strong positive effects on people and strategy, while strategy had a significant and modest positive effect on people. Moreover, the study of Andjelkovic-Pesic and Dahlgaard (2013), which focused on 150 companies from the Republic of Serbia, used correlation analysis, and the results showed that there were strong positive relationships between the criteria of the EFQM Model 2013. Also, Zhang et al. (2021) focused their research on 683 construction companies in China and applied the SEM methodology to examine the relationships between the model’s enablers criteria. The results of the study showed that leadership had a significant and strong positive effect on people and partnerships and resources, and a significant but moderate positive effect on strategy; strategy had a significant and modest positive effect on partnerships and resources; and people and partnerships and resources had significant and moderate positive effects on processes and products and services, respectively.
As far as the studies focusing on public services are concerned, their number is extremely limited, and they applied different methodological approaches to investigate the relationships between the criteria of the EFQM Model 2013. Specifically, the study of Đorđević et al. (2021) applied path analysis using regression analysis to investigate the relationships between the model’s criteria in the context of 17 Serbian and 21 Russian universities. The results of the study revealed the following: (1) very strong positive relationships between leadership and strategy; people; partnerships and resources; and processes, products, and services; (2) very strong positive relationships between strategy and people; partnerships and resources; and processes, products, and services; (3) a strong positive relationship between people and people results; (4) a very strong positive relationship between partnerships and resources and processes, products, and services; (5) very strong relationships between partnership and resources and people results and society results; (6) a strong positive relationship between partnership and resources and customer results; (7) strong positive relationships between processes, products, and services and people results and customer results; (8) a very strong positive relationship between processes, products, and services and society results; (9) a strong positive relationship between people results and business results; (10) a very strong positive relationship between customer results and business results; and (11) a very strong positive relationship between society results and business results (Đorđević et al. 2021). Finally, Kaplani (2023) applied the SEM methodology in the context of Greek public primary education (231 kindergarten and primary schools) to investigate the relationships between the enablers and results criteria of the EFQM 2013 model. The results of this study indicated that leadership had a significant and modest positive effect on people, a significant and strong positive effect on strategy, and a significant and modest positive effect on partnerships and resources; strategy had a significant and strong positive effect on people; strategy had a significant and moderate positive effect on partnerships and resources; strategy had a significant and modest positive effect on processes, products, and services; people had a moderate positive effect on processes, products, and services; partnerships and resources had a significant and modest positive effect on processes, products, and services; processes, products, and services had a significant and modest positive effect on people results and customer results (parents and students results); people results had a significant and strong positive effect on customer results (parents and students results) and business results; customer results (parents and students results) had a significant and modest positive effect on business results; and business results had a significant and strong positive effect on society results.
Τhe evaluation system of the Greek public sector services assesses individual performance, collects feedback solely from the services’ staff, and monitors the attainment of goals set at both individual and organizational levels. Hence, in comparison with the structure and conceptual framework of the EFQM Model 2013, the evaluation system of the Greek public sector services focuses only on the criteria “people” and “business results”. Therefore, there is a need for the Greek public services to adopt a new approach to their evaluation system that will provide them with a holistic view of their operational and strategic performance. The EFQM Model 2013 can serve this purpose, as it can provide insights into several criteria, along with their causal relationships, that are present in every organization. This approach will facilitate decision-making at the organizational level and provide valuable information to policy-makers, which may lead to the formulation of new policies or recommendations for a holistic improvement of the Greek public sector services’ operation and performance.
Considering the above, the scholars’ recommendation to more deeply explore the EFQM model with a focus on public sector organizations, as well as the fact that the EFQM Model 2013 is a well-established framework extensively referenced in the existing academic literature, the authors chose the EFQM Model 2013 for this research. This choice was based on its solid theoretical foundation, which provides a more substantial basis for analysis and the expectation that its use ensures methodological continuity. This allows for the direct comparison of the findings with those of the existing literature. By focusing on the EFQM Model 2013, this paper contributes to the academic and practical understanding of its applicability, reliability, and validity in the context of the Greek public administrative services. Furthermore, this focus will enrich the literature with specific insights into the EFQM Model 2013 effectiveness and the details of its implementation in the public sector. Specifically, this study examined the relationships between the constructs leadership (L); strategy (S); people (P); partnerships and resources (PRE); processes, products, and services (PRO); people results (PR); customer results (CR); business results (BR); and society results (SR). Therefore, the hypotheses of this study are as follows:
H1. 
Leadership has a positive effect on strategy.
H2. 
Leadership has a positive effect on people.
H3. 
Leadership has a positive effect on partnerships and resources.
H4. 
Strategy has a positive effect on people.
H5. 
Strategy has a positive effect on partnerships and resources.
H6. 
Strategy has a positive effect on processes, products, and services.
H7. 
People have a positive effect on processes, products, and services.
H8. 
Partnerships and resources have a positive effect on processes, products, and services.
H9. 
Processes, products, and services have a positive effect on people results.
H10. 
Processes, products, and services have a positive effect on customer results.
H11. 
Processes, products, and services have a positive effect on business results.
H12. 
People results have a positive effect on customer results.
H13. 
People results have a positive effect on business results.
H14. 
Customer results have a positive effect on business results.
H15. 
Business results have a positive effect on society results.
The proposed model and the hypotheses are presented in detail in Figure 2 below.
The following sections present the study methodology, along with the study results, discussion, and conclusions.

2. Materials and Methods

In this section, the research methodology is presented in detail. In order to achieve the purpose of this study, the authors applied qualitative methods in the first phase to adapt the research instrument to the context of this study. Subsequently, quantitative research methods were applied during the pilot study and the main study phases. Prior to conducting this study, the authors submitted the research protocol for approval to the University Research Ethics Committee and the Ministry of Education, Religious Affairs and Sport of Greece, and both approvals were granted (University Research Ethics Committee Decision No. 37/17-07-2023 and Ministry of Education, Religious Affairs and Sport of Greece Decision No. 86346/Ν4/31-07-2023).

2.1. Adaptation and Validation of the Research Questionnaire

This study’s research tool was based on a structured questionnaire created by Kaplani (2023), which was based on the assessment tool of the EFQM Model 2013. The questionnaire had ten different sections: nine sections for the nine criteria of the EFQM Model 2013, and a section about the participants’ demographic characteristics. For the 9 criteria, the 5-point Likert scale of the EFQM model 2013 assessment questionnaire was used (1 = No Evidence/Don’t Know, 2 = We have plans, 3 = On our way, 4 = Close to good, 5 = Fully done).
Since the research by Kaplani (2023) focused on school units, an adaptation of the questionnaire was necessary to align it with the context of the public sector administrative services. Specifically, in Kaplani’s questionnaire, the EFQM model criterion “processes, products, and services” was formulated as a formative latent factor comprising three dimensions: administrative, educational, and pedagogical. Additionally, the criterion “customer results” was tailored to the school context, focusing on “parents and students results”. Given the context and nature of public administrative services, for the present study, the criterion “processes, products, and services” was redefined as a reflective latent variable with only one dimension: administrative. Similarly, the criterion “customer results” focused on the customers of public administrative services. Moreover, the questionnaire’s wording was adjusted to suit the context of public administrative services. Subsequently, two focus groups involving 7 managers and 7 staff members of public administrative services were conducted to assess the content and face validity of the questionnaires, as well as the appropriateness of its items for this study’s context. This process led to minor adjustments in the wording of the questionnaire items that ensured clarity and relevance.

2.2. Pilot Study

The reliability of the questionnaire was tested in a pilot study. Fifty (50) managers from public administrative services in Greece, which were selected by using the convenience sampling method, participated in the pilot study. The analysis of the data showed that for the 9 scales of the questionnaire measuring the 9 criteria of the EFQM Model 2013, all the Cronbach’s alpha coefficients were above the 0.70 threshold; therefore, the pilot study provided evidence of the reliability of the research tool.

2.3. Main Study

The population of this study consisted of the managers of the Greek public administrative services. Specifically, the participants of the main study were the managers of the regional administrative services of the Ministry of Education, Religious Affairs and Sport of Greece. In order to reach the participants, an email was sent to the email address of each service and contained the link to the online questionnaire and a citation of the approval of the Ministry to conduct this study. The data were collected from the 10th of October until the 15th of December 2023. Subsequently, after the data collection phase, the reliability and validity of the research tool were assessed, and the demographic characteristics of the participants were analyzed by using descriptive statistics. In addition, partial least squares structural equation modeling (PLS-SEM) was used to test the reliability and validity of the research model and the hypotheses of this study. This methodological approach was chosen because of its high efficiency in model estimation (Hair et al. 2021), its growing popularity in the field of quality management (Magno et al. 2022), and it is not affected by the complexity of the research model or by the number of observations used to estimate the model (Hair et al. 2019). All the latent variables were reflective. Each of the nine first-order latent factors corresponded to a criterion of the EFQM Model 2013 (L, S, P, PRE, PRO, PR, CR, BR, SR), while the structural model was designed according to the research hypotheses about the relationships between the latent variables of the model. SmartPLS 4 software was used to evaluate both the measurement and structural models. Therefore, the loadings of the indicators, Cronbach’s α, rho_a, rho_c, composite reliability, average variance extracted (AVE), Fornell–Larcker criterion, analysis of cross-loadings, and heterotrait–monotrait ratio (HTMT) of the correlations were estimated. Finally, the path coefficients and the R2 coefficients were estimated, along with their significance levels, by performing a bootstrap of 10,000 replications.

3. Results

This section presents the results of the descriptive statistical analysis of the participants’ demographics, the reliability and validity results of the questionnaire, and the measurement and structural model evaluation results.

3.1. The Study Sample Demographics

The study sample comprised 155 managers from the public regional administrative services of the Ministry of Education, Religious Affairs and Sports of Greece. The majority of the managers were male (59.4%), and two-thirds were 51–60 years old (67.7%). Also, the vast majority of the managers (74.1%) had completed postgraduate studies, while the majority of the study participants (54.8%) were less experienced since they had 0–5 years of management experience (Table 1).

3.2. Reliability and Convergent and Discriminant Validity of the Research Questionnaire

The reliability tests of the nine scales of the questionnaire showed that the Cronbach’s α coefficient for each scale of the EFQM Model 2013 was found to be above the threshold of 0.70. Therefore, the reliability of the research tool was verified. Also, the unidimensionality analyses showed that the items of each scale produced only one factor. The aforementioned results are not presented in detail in the results of this study.

3.3. Evaluation Results of the Measurement Model

The reliability and validity of the measurement model were tested by applying the partial least squares structural equation modeling (PLS-SEM) method and following the recommendations of Hair et al. (2021) for evaluating the measurement model. According to the results, the vast majority of the loadings of the indicators were above the threshold of 0.70 and only seven had a value that was below 0.70, specifically, their values ranged from 0.575 to 0.693. These seven indicators were not removed from the model because their values were between 0.40 and 0.70, and their removal from the model would not lead to better internal consistency reliability or convergent validity values (Hair et al. 2017; Hair et al. 2021). Regarding the internal consistency reliability, the results show that all values of Cronbach’s α, rho_a, and rho_c and the composite reliability were above the threshold of 0.70 (Table 2). Therefore, the reliability and internal consistency were checked. In addition, the average variance extracted (AVE) values were above the threshold 0.50 (Table 2). Therefore, the convergent validity was also checked (Hair et al. 2017; Hair et al. 2021).
Furthermore, the results of the discriminant validity test for the Fornell–Larcker criterion showed that the square root of the average variance extracted (AVE, written in bold) of each factor was greater than its correlations with the other factors (Table 3). Therefore, the discriminant validity was also tested using this criterion.
In addition, the discriminant validity was again checked by a cross-loadings analysis, which showed that the indicators of each factor had higher loadings on their factor compared with the loadings they had on the other factors of the model (Table 4). Therefore, the discriminant validity was also checked by the criterion of cross-loadings.
The discriminant validity was also tested using the heterotrait–monotrait ratio of correlations (HTMT). The results (Table 5) showed that all HTMT values were less than the proposed threshold of 0.90 (Henseler et al. 2015; Hair et al. 2021); therefore, the discriminant validity was checked.

3.4. The Results of Structural Model Evaluation and Hypothesis Testing

The structural model was evaluated according to the guidelines of Hair and Alamer (2022) and Hair et al. (2021). Specifically, the R2 coefficient of determination was calculated for each of the endogenous variables (Table 6). The R2 coefficient can range from 0 to 1, and low R2 values indicate weak explanatory power (Hair et al. 2021). The results of the structural model evaluation showed that the model had strong explanatory power for three of its endogenous factors (CR, BR, and SR); moderate explanatory power for four of the eight endogenous variables (S, P, PRE, and PRO); and only for one endogenous variable (PR), the R2 value was 0.196. Therefore, the model presented a weak explanatory power, but at the same time, this value was considered satisfactory based on the recommendation of Hair et al. (2021).
The next step was to test the research hypotheses about the relationships between the criteria of the EFQM Model 2013. Following the guidelines of Hair and Alamer (2022), a one-tailed bootstrapping with 10,000 replications was performed to calculate the values of the path coefficients, along with their significance levels. The results indicated that the vast majority of the research hypotheses were supported by the results. Specifically, for twelve of the fifteen research hypotheses, the analysis showed that the t-values of their path coefficients were greater than 1.96 and their p-values were found to be less than 0.001, 0.01, and 0.05 (Table 7). Subsequently, the evaluation of the effect size of the path coefficients was carried out according to the guidelines of Hair and Alamer (2022), who suggested that if the value of a path coefficient (β) is between 0.0 and 0.010, this is an indication of a weak effect size; if it is between 0.11 to 0.30, then the effect size is characterized as modest; if its value is between 0.30 and 0.50, this indicates that the effect size is moderate; and if the values of the path coefficient is greater than 0.50, then this is an indication of a strong effect size. Based on the above, the results of this study showed that leadership (L) had a significant strong positive effect on strategy (S) and a significant moderate positive effect on people (P). Also, strategy had a significant and strong positive effect on partnerships and resources (PRE) and a significant and modest positive effect on people. In addition, on the one hand, people had a significant strong and positive effect on processes, products, and services (PRO), but on the other hand, partnerships and resources had a significant moderate and positive effect on processes, products, and services. The results also indicated that processes, products, and services had a significant and moderate positive effect on people results (PR), a significant and modest positive effect on customer results (CR), and a significant and weak positive effect on business results (BR). In addition, people results had a significant strong and positive effect on customer results and business results. Finally, the results indicated that business results had a significant and strong positive effect on society results (SR).
A visual representation highlighting the aforementioned key findings of this study is presented below (Figure 3).

4. Discussion

The EFQM Model 2013 was applied in quantitative research in Europe, but most of the studies were on private organizations. In addition, the number of studies that examined the relationships between the criteria of the EFQM Model 2013 and focused on public sector organizations is extremely limited. Moreover, studies that examined the relationships between the criteria of the EFQM Model 2013 in the context of the Greek public sector services are scarce. The literature review revealed only one study that applied the structural equation modeling approach to investigate the cause–effect relationships between the criteria of the EFQM Model 2013 and focused on the area of Greek public primary education. Therefore, this study aimed to follow the recommendation of Suárez et al. (2017) to conduct more research to further analyze the EFQM Model 2013 with a focus on the public sector. Hence, the purpose of this study was to test the reliability and validity of the EFQM Model 2013 in the context of the Greek public sector administrative services and to investigate the relationships among the enablers and results criteria of the EFQM Model 2013.
The results indicate that the proposed research model was reliable and valid for the context of this study. In addition, this study’s results provide evidence for the confirmation of the vast majority of the hypotheses regarding the cause–effect relationships between the enablers and results criteria of the EFQM Model 2013. Specifically, 12 of the 15 hypotheses were confirmed at high levels of significance (H1, H2, H4, H5, H7, H8, H9, H10, H11, H12, H13, H15). Moreover, the results showed that leadership had positive effects on strategy (0.760) and people (0.468), which are supported by previous literature (Belvedere et al. 2018; Đorđević et al. 2021; Kaplani 2023; Para-González et al. 2021; Zhang et al. 2021). These findings underscore the critical role that leadership plays in formulating policies and motivating people; therefore, public sector services need to pay great attention to the leadership cultivated in their organizations and provide guidance on how it can be effective.
In addition, the results of this study show that strategy had a positive effect on partnerships and resources (0.615), which is consistent with previous findings (Kaplani 2023; Zhang et al. 2021), and it had a positive effect on people (0.248), which is also supported by the literature (Kaplani 2023; Para-González et al. 2021; Zhang et al. 2021). The above show that public sector services must focus on creating a clear strategic plan that must be shared within the organization and at each organizational level so that people can better understand the organization’s strategy and align their actions with it. In addition, public services must integrate into their strategy the aspects of their stakeholders (their employees, partners, suppliers, etc.) and the management and allocation of their resources so that they can effectively serve the achievement of the organization’s goals.
Furthermore, the results indicate that there was a positive effect of people (0.522) and partnerships and resources (0.353) on processes, products, and services, which is consistent with the results of previous studies (Belvedere et al. 2018; Kaplani 2023; Para-González et al. 2021; Zhang et al. 2021). Therefore, public sector services must ensure that their employees are trained and keep up with the advances in their field, as they play a crucial role in the delivery of services to the internal and external customers of the public entity for which they work. In addition, public services must make an effort to build alliances with their partners and establish a collaborative and close relationship with them since their cooperation affects the quality of the services provided by the public sector entities.
The results also show that processes, products, and services had a positive impact on people results (0.442), customer results (0.149), and business results (0.100), which is supported by previous findings in the literature (Belvedere et al. 2018; Kaplani 2023). Therefore, public sector services need to carefully design the processes through which they deliver their services so that they are efficient, effective, and aligned with the needs of their customers. In addition, the results of this study indicate that people results had positive effects on customer results (0.775) and business results (0.717), which is in line with the previous literature (Belvedere et al. 2018; Kaplani 2023). The above underscores the fact that public sector services need to adopt a new approach to monitor the satisfaction, performance, and competencies of their employees; their understanding of their organization’s strategic plan; and the quality of communication within their organization, as all of these affect the organization’s efficiency, effectiveness, and productivity, as well as the customer results. Moreover, the results have revealed that business results (for the case of public sector services could also be called organizational results) had a positive effect on society results (0.843), which is supported by the findings of Kaplani (2023), and this was the strongest positive effect among the criteria of the EFQM Model 2013 revealed by the results of this study. In light of the above, public sector services must integrate the aspect of sustainability in their operations and decision-making so that their actions are aligned with the principles and goals of sustainable development and with the promotion and realization of actions that have a positive impact on their local community and beyond.
In addition, the study findings regarding the application of the EFQM Model 2013 to public administrative services in Greece could have significant implications for policy-making and practical application. Specifically, implementing the EFQM model 2013 will encourage public administrative services in Greece to align their activities with strategic objectives and priorities. Also, policy-making can be guided by a strategic focus, leading to more coherent and effective public service delivery. Furthermore, the study findings can provide insights into the performance of public administrative services in Greece, enabling policy-makers to assess the effectiveness of policies and interventions and make data-driven decisions to improve service delivery. Also, the results of this study could stimulate public administrative services in Greece to utilize the EFQM Model 2013 to establish a culture of learning and innovation, wherein organizations continually strive to enhance their processes, services, and outcomes. Concurrently, it can enable public services in Greece to utilize benchmarking data to compare their performance with similar organizations locally, nationally, or internationally. This comparative analysis will facilitate the identification of areas of strength and weakness, as well as opportunities for improvement, leading to the adoption of best practices and innovative approaches to public service delivery.
Moreover, the study findings can facilitate policy-makers in Greece to make more informed, evidence-based decisions. The EFQM model provides a structured framework for evaluating the effectiveness of policies and interventions, thereby allowing policy-makers to assess their impact on organizational performance, stakeholder satisfaction, and societal outcomes. This evidence-based approach to policy-making will guarantee efficient resource allocation and the attainment of desired policy objectives. Overall, this study aspired to provide stimulus for a wider application of the EFQM Model 2013 to public administrative services in Greece, ultimately leading to more strategic, accountable, and effective policy-making, as well as improved service delivery and outcomes for citizens.
Since this study focused only the regional administrative services of the Ministry of Education, Religious Affairs and Sport of Greece, its findings cannot be generalized to the entire population of public services in Greece and may introduce some bias into the results. Also, this focus may limit the generalizability of the findings to other countries or contexts, as the unique cultural, political, and institutional factors that shape public administration in Greece may not be applicable to other countries with different contexts and governance structures. Considering the above and the dynamic nature of public administrative services, future research in similar or different contexts that incorporates a longitudinal or comparative perspective into the study design would be beneficial. Such an approach would enable researchers to track changes and trends in the performance of Greek public sector services over time. Additionally, it would allow for the analysis of differences in responses from similar organizations in other countries, facilitating the identification of best practices or areas for improvement. Furthermore, future research following a mixed-methods approach, which combines quantitative data from structured questionnaires with qualitative data from interviews or focus groups, could provide a more comprehensive understanding since qualitative data can offer insights into the contextual factors that influence organizational performance and aid in interpreting quantitative findings in a nuanced manner.
Subsequently, future research exploring the applicability of the EFQM Model 2013 beyond public administrative services to other types of Greek public sector services, such as public healthcare services, could provide insights into its effectiveness and adaptability in different contexts. In summary, by adopting these approaches, future research can contribute to a deeper understanding of the challenges and opportunities faced by Greek public sector services. It can also identify transferable lessons and best practices that can inform organizational improvement efforts across diverse settings, while also informing strategies for enhancing their performance and effectiveness.

5. Conclusions

The EFQM model has been used by private and public organizations as a compass to facilitate their continuous improvement. To the best of our knowledge, this is the first study that attempted to apply and validate the EFQM Model 2013 in the context of the Greek Public Administration and to explore the causal relationships between its enablers and results criteria. The results of this study confirm that the EFQM Model 2013 is a valid and reliable framework also for the context of the Greek Public Administrative Services. Moreover, the results confirm the vast majority of the research hypotheses that were already verified by previous studies conducted in different settings. Given the prevailing focus of the evaluation system in Greek public services on individual performance assessment, skill enhancement, employee feedback collection, and organizational and individual goal monitoring, there is a clear imperative for a revamped evaluation approach. This new approach should provide a holistic view of the services’ operational and strategic performance. The EFQM model can serve this purpose by providing valuable insights into the causal relationships between its factors, which are present in every organization, and facilitate decision-making within the services. Since this study focused only on the public regional administrative services of the Ministry of Education, Religious Affairs and Sport of Greece, its results cannot be generalized. Therefore, further research is necessary to be conducted in other types of Greek public sector services and in different countries and similar contexts to clearly validate the results of the present study. Lastly, future studies that will apply a combination of qualitative and quantitative research methods could provide a more comprehensive understanding of the dynamics of public administrative services. Overall, by adopting these approaches, future studies can contribute to a deeper understanding on this research topic and provide valuable insights to policy- and decision-makers to enhance organizational performance and effectiveness across diverse settings.

Author Contributions

Conceptualization, D.M. and K.Z.; methodology, D.M. and K.Z.; validation, D.M. and K.Z; formal analysis, D.M. and K.Z.; investigation, D.M..; resources, D.M. and K.Z; data curation, D.M.; writing—original draft preparation, D.M.; writing—review and editing, K.Z.; visualization, D.M. and K.Z.; supervision, K.Z.; project administration, K.Z.; funding acquisition, D.M. and K.Z. All authors read and agreed to the published version of the manuscript.

Funding

This work is part of a project that has received funding from the University of Macedonia Research Fund under the Basic Research 2023 funding programme.

Institutional Review Board Statement

This study was conducted in accordance with the Declaration of Helsinki and approved by the Committee for Research Ethics of the University of Macedonia (protocol code 37 and date of approval 17 July 2023).

Informed Consent Statement

Informed consent was obtained from all subjects involved in this study.

Data Availability Statement

The data that support the findings of this study are not publicly available due to restrictions of the University of Macedonia Ethics Committee’s approval.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Andjelkovic-Pesic, Marija, and Jens J. Dahlgaard. 2013. Using the Balanced Scorecard and the European Foundation for Quality Management Excellence model as a combined roadmap for diagnosing and attaining excellence. Total Quality Management & Business Excellence 24: 652–63. [Google Scholar] [CrossRef]
  2. Belvedere, Valeria, Alberto Grando, and Hervé Legenvre. 2018. Testing the EFQM model as a framework to measure a company’s procurement performance. Total Quality Management & Business Excellence 29: 633–51. [Google Scholar] [CrossRef]
  3. Bocoya-Maline, Jose, Manuel Rey-Moreno, and Arturo Calvo-Mora. 2024. The EFQM excellence model, the knowledge management process and the corresponding results: An explanatory and predictive study. Review of Managerial Science 18: 1281–315. [Google Scholar] [CrossRef]
  4. Đorđević, Aleksandar, Yury Klochkov, Slavko Arsovski, Nikola Stefanović, Luiza Shamina, and Aleksandar Pavlović. 2021. The Impact of ICT Support and the EFQM Criteria on Sustainable Business Excellence in Higher Education Institutions. Sustainability 13: 2–25. [Google Scholar] [CrossRef]
  5. Fonseca, Luis, António Amaral, and José Oliveira. 2021. Quality 4.0: The EFQM 2020 Model and Industry 4.0 Relationships and Implications. Sustainability 13: 3107. [Google Scholar] [CrossRef]
  6. Hair, Joseph F., and Abdullah Alamer. 2022. Partial Least Squares Structural Equation Modeling (PLS-SEM) in second language and education research: Guidelines using an applied example. Research Methods in Applied Linguistics 1: 100027. [Google Scholar] [CrossRef]
  7. Hair, Joseph F., G. Tomas M. Hult, Christian M. Ringle, and Marko Sarstedt. 2017. A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM). Thousand Oaks: Sage Publications Inc. [Google Scholar]
  8. Hair, Joseph F., G. Tomas M. Hult, Christian M. Ringle, Marko Sarstedt, Nicholas P. Danks, and Soumya Ray. 2021. Partial Least Squares Structural Equation Modeling (PLS-SEM) Using R. Cham: Springer Nature Switzerland AG. [Google Scholar]
  9. Hair, Joseph F., Jeffrey J. Risher, Marko Sarstedt, and Christian M. Ringle. 2019. When to use and how to report the results of PLS-SEM. European Business Review 31: 2–24. [Google Scholar] [CrossRef]
  10. Henseler, Jörg, Christian M. Ringle, and Marko Sarstedt. 2015. A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science 43: 115–35. [Google Scholar] [CrossRef]
  11. Kaplani, Giannoula. 2023. Quality Assurance Models in Primary School Management. The Case of Greece in the Context of the European Union. Ph.D. thesis, University of Macedonia, Thessaloniki, Greece. [Google Scholar]
  12. Magno, Francesca, Fabio Cassia, and Christian M. Ringle. 2022. A brief review of partial least squares structural equation modeling (PLS-SEM) use in quality management studies. The TQM Journal 197: 165–67. [Google Scholar] [CrossRef]
  13. Para-González, Lorena, Daniel Jimenez-Jimenez, and Angel R. Martínez-Lorente. 2021. The link between people and performance under the EFQM excellence model umbrella. Total Quality Management & Business Excellence 32: 410–30. [Google Scholar] [CrossRef]
  14. Santos-Vijande, Maria Leticia, and Luis I. Alvarez-Gonzalez. 2007. TQM and firms performance: An excellence model research based survey. International Journal of Business Science and Applied Management 2: 21–41. Available online: https://www.econstor.eu/handle/10419/190585 (accessed on 10 November 2023).
  15. Suárez, Eva, Arturo Calvo-Mora, José L. Roldán, and Rafael Periáñez-Cristóbal. 2017. Quantitative research on the EFQM excellence model: A systematic literature review (1991–2015). European Research on Management and Business Economics 23: 147–56. [Google Scholar] [CrossRef]
  16. Zhang, Jingxiao, Hui Li, Vera Li, Bo Xia, and Martin Skitmore. 2021. Internal relationships of market-oriented EFQM enablers in the Chinese construction industry. Engineering, Construction and Architectural Management 28: 765–87. [Google Scholar] [CrossRef]
Figure 1. The EFQM Model 2013.
Figure 1. The EFQM Model 2013.
Admsci 14 00079 g001
Figure 2. The research model.
Figure 2. The research model.
Admsci 14 00079 g002
Figure 3. The research model R2 coefficients, and direct effects (n.s.: non-significant).
Figure 3. The research model R2 coefficients, and direct effects (n.s.: non-significant).
Admsci 14 00079 g003
Table 1. The demographics of the study sample.
Table 1. The demographics of the study sample.
Demographic Category Frequency Percentage (%)
Gender155100.0
Men9259.4
Women6340.6
Age155100.0
24–3000
31–4031.9
41–502717.4
51–6010567.7
Over 60 years old2012.9
Education level155100.0
Secondary education degree53.2
Bachelor’s3120.0
Second bachelor’s42.6
Master’s9460.6
PhD2113.5
Management experience (years)155100.0
0–58554.8
6–103321.3
11–20159.7
Over 20 years2214.2
Table 2. Reliability and convergent validity of the measurement model.
Table 2. Reliability and convergent validity of the measurement model.
ConstructCronbach’s αComposite
Reliability (rho_a)
Composite
Reliability (rho_c)
Average
Variance
Extracted (AVE)
L0.8530.8570.9020.697
S0.9230.9250.9390.687
P0.8190.8360.8710.533
PRE0.8790.8870.9070.583
PRO 0.8560.8620.8900.538
PR 0.8190.8360.8710.533
CR0.9340.9400.9470.720
BR 0.9470.9510.9560.729
SR 0.9270.9330.9430.733
Table 3. Discriminant validity of the measurement model based on the Fornell–Larcker criterion.
Table 3. Discriminant validity of the measurement model based on the Fornell–Larcker criterion.
ConstructLSPPREPROPRCRBRSR
L0.835
S0.7600.829
P0.6560.6030.730
PRE0.5610.6860.6120.764
PRO 0.4930.4040.6450.5670.734
PR 0.2030.0550.3630.1200.4420.846
CR0.2170.1100.3740.2150.4910.8410.848
BR 0.0810.0080.3580.0650.4090.8450.7460.854
SR 0.1330.0320.3390.0700.3630.8170.7850.8430.856
Table 4. Cross-loadings matrix (higher loadings across lines are written in bold).
Table 4. Cross-loadings matrix (higher loadings across lines are written in bold).
Item/ConstructLSPPREPROPRCRBRSR
L_10.8170.6850.4430.5260.306−0.0120.030−0.106−0.026
L_20.8590.6530.5130.4460.3410.0640.113−0.0210.039
L_30.8920.6290.6590.4730.5550.3070.2880.1720.216
L_40.7640.5680.5690.4270.4360.3170.2930.2260.215
S_10.6940.8370.4990.4900.3510.0620.0440.0170.062
S_20.6010.7700.4690.5050.3180.0220.0290.071−0.011
S_30.6490.8880.5490.6240.3660.0240.1410.0500.054
S_40.5250.7960.4520.5570.4110.0800.1750.0500.115
S_50.6650.8080.5180.5820.3150.0810.117−0.026−0.001
S_60.6720.8300.4790.5720.2830.0410.055−0.087−0.032
S_70.5950.8660.5260.6420.3030.0120.075−0.0240.000
P_10.4980.5260.6360.4960.3590.038−0.0140.0720.027
P_20.3330.1990.7080.2600.5050.4800.4980.4720.449
P_30.5390.5640.7930.4620.4420.2890.2960.3260.259
P_40.6240.5430.8500.4930.5460.3330.3380.3110.343
P_50.4060.4630.5750.5550.3630.0830.1240.0660.041
P_60.4250.3070.7810.4110.5930.3500.3840.3090.338
PRE_10.4410.6000.4390.8120.447−0.0240.066−0.023−0.047
PRE_20.4730.5900.4940.8750.4360.0050.112−0.0460.020
PRE_30.4200.3500.5170.6480.5530.3210.3570.2070.307
PRE_40.4090.5300.2770.6930.149−0.0820.050−0.121−0.110
PRE_50.4210.5430.4270.7590.3770.2120.3060.1620.154
PRE_60.3830.4850.5120.7480.4570.0960.1270.0730.024
PRE_70.4510.5580.5620.7890.5420.1080.1380.0760.019
PRO_10.4860.5310.5860.5200.6550.2300.2020.2430.147
PRO_20.4050.2320.5230.3500.8190.4510.4390.4320.351
PRO_30.3920.2590.4670.3150.7280.4560.4920.4610.438
PRO_40.4050.4580.4960.6250.6930.1540.2740.1580.146
PRO_50.2110.1240.4220.2980.7630.3420.3830.2990.278
PRO_60.2550.1110.4040.3040.7640.3850.4830.3030.329
PRO_70.3770.4060.4150.5570.7010.1910.1900.1330.109
PR_10.2010.1010.3610.2090.4190.8880.8050.7700.725
PR_20.3000.2050.4180.2850.4560.8480.8370.6640.698
PR_30.1690.0760.3560.1380.3020.7420.4900.6140.539
PR_40.1990.0340.3200.0550.3710.9010.7600.7550.735
PR_50.058−0.0840.280−0.0470.3910.8650.6930.7410.679
PR_60.088−0.0450.1800.0560.3300.7700.6150.7000.715
PR_70.1670.0180.223−0.0020.3280.8910.7160.7480.723
CR_10.2340.2020.3370.3120.4070.6940.8550.5700.628
CR_20.2040.1430.3220.2770.3840.7600.8960.6080.642
CR_30.1990.1210.3330.2570.4060.6870.8670.5880.637
CR_40.107−0.0310.2260.0690.3770.6670.8410.6440.688
CR_50.1150.0060.2600.0360.3750.7710.8710.6970.708
CR_60.3380.2140.4480.2600.5900.5620.6720.5400.553
CR_70.1320.0380.3250.1090.4150.8170.9140.7500.775
BR_10.014−0.0430.2550.0930.2530.6150.5420.7290.512
BR_20.1290.0910.3440.1610.3740.7170.5940.8630.666
BR_30.1870.1130.4230.1800.4010.7220.6340.8400.609
BR_40.056−0.0160.3250.0420.3690.7440.7040.8700.794
BR_50.049−0.0270.300−0.0080.4030.7190.7090.8710.790
BR_6−0.003−0.0780.282−0.0220.3960.7530.5860.8690.711
BR_70.050−0.0120.2790.0030.2810.7020.6520.8680.800
BR_80.0790.0310.2580.0300.3120.7890.6600.9110.815
SR_10.1790.1510.3450.1510.3140.6360.7110.6130.812
SR_20.1590.1220.3750.1910.2940.6800.7150.6450.830
SR_30.1840.0250.2650.0450.3360.6650.7070.6620.881
SR_40.038−0.0650.262−0.0150.3640.6810.5810.7670.803
SR_50.0930.0060.278−0.0060.2450.7230.6370.7870.899
SR_60.066−0.0320.2440.0330.3170.7900.7050.8140.906
Table 5. Heterotrait–monotrait ratio (HTMT).
Table 5. Heterotrait–monotrait ratio (HTMT).
Heterotrait–Monotrait Ratio (HTMT)
Leadership <→ business results0.197
Leadership <→ customer results0.282
Partnership and resources <→ business results0.167
Partnership and resources <→ customer results0.270
Partnership and resources <→ leadership0.650
People <→ business results0.415
People <→ customer results0.451
People <→ leadership0.776
People <→ partnership and resources0.719
People results <→ business results0.899
People results <→ customer results0.889
People results <→ leadership0.269
People results <→ partnership and resources0.228
People results <→ people0.426
Processes, products, and services <→ business results0.440
Processes, products, and services <→ customer results0.546
Processes, products, and services <→ leadership0.575
Processes, products, and services <→ partnership and resources0.667
Processes, products, and services <→ people0.772
Processes, products, and services <→ people results0.479
Society results <→ business results0.883
Society results <→ customer results0.847
Society results <→ leadership0.196
Society results <→ partnership and resources0.179
Society results <→ people0.396
Society results <→ people results0.872
Society results <→ processes, products, and services0.395
Strategy <→ business results0.095
Strategy <→ customer results0.153
Strategy <→ leadership0.856
Strategy <→ partnership and resources0.760
Strategy <→ people0.687
Strategy <→ people results0.116
Strategy <→ processes, products, and services0.467
Strategy <→ society results0.111
Customer results <→ business results0.789
Table 6. R2 coefficients of determination of the model’s endogenous variables.
Table 6. R2 coefficients of determination of the model’s endogenous variables.
Endogenous
Variables
R2 Coefficientst-Values
(Bootstrapping 10,000 Replications)
p-Values
(Bootstrapping 10,000 Replications)
S 0.57810.3820.000
P0.4566.7720.000
PRE0.4755.9990.000
PRO0.4758.0810.000
PR0.1963.4720.000
CR0.72515.1590.000
BR0.73416.6470.000
SR0.71013.9790.000
Table 7. Results of the structural model assessment.
Table 7. Results of the structural model assessment.
Research HypothesesPathsPath Coefficients (β)t-Values
(Bootstrapping 10,000 Replications)
p-Values
(Bootstrapping 10,000 Replications)
H1L → S0.76020.6290.000
H2L → P0.4684.0880.000
H3L → PRE0.0940.9010.184
H4S → P0.2482.1650.015
H5S → PRE0.6155.4750.000
H6S → PRO−0.1531.4790.070
H7P → PRO0.5225.1450.000
H8PRE → PRO0.3533.7550.000
H9PRO → PR0.4426.8410.000
H10PRO → CR0.1493.4730.000
H11PRO → BR0.1001.6590.049
H12PR → CR0.77519.3750.000
H13PR → BR0.7176.1760.000
H14CR → BR0.1160.8160.207
H15BR → SR0.84327.9710.000
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Mitsiou, D.; Zafiropoulos, K. Exploring the Relationships between the Enablers and Results Criteria of the EFQM Model 2013 in the Context of the Greek Public Administrative Services. Adm. Sci. 2024, 14, 79. https://doi.org/10.3390/admsci14040079

AMA Style

Mitsiou D, Zafiropoulos K. Exploring the Relationships between the Enablers and Results Criteria of the EFQM Model 2013 in the Context of the Greek Public Administrative Services. Administrative Sciences. 2024; 14(4):79. https://doi.org/10.3390/admsci14040079

Chicago/Turabian Style

Mitsiou, Dimitra, and Kostas Zafiropoulos. 2024. "Exploring the Relationships between the Enablers and Results Criteria of the EFQM Model 2013 in the Context of the Greek Public Administrative Services" Administrative Sciences 14, no. 4: 79. https://doi.org/10.3390/admsci14040079

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop