Next Article in Journal
A New Synchronous Handling Technology of Double Stack Container Trains in Sea-Rail Intermodal Terminals
Next Article in Special Issue
Internet of Things based Decision Support System for Green Logistics
Previous Article in Journal
Impact of Digital Finance on Energy Efficiency in the Context of Green Sustainable Development
Previous Article in Special Issue
Effects of Sustainable Development of the Logistics Industry by Cloud Operational System
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

From Public E-Procurement 3.0 to E-Procurement 4.0; A Critical Literature Review

by
Aristotelis Mavidis
* and
Dimitris Folinas
Department of Supply Chain Management, International Hellenic University, 60100 Katerini, Greece
*
Author to whom correspondence should be addressed.
Sustainability 2022, 14(18), 11252; https://doi.org/10.3390/su141811252
Submission received: 22 July 2022 / Revised: 3 September 2022 / Accepted: 5 September 2022 / Published: 8 September 2022
(This article belongs to the Special Issue Sustainable Management and Application of E-Logistics)

Abstract

:
Public procurement is an important part of public finances; therefore, its management is challenging for the quality of the citizen’s relationship with the public authorities. Existing electronic public procurement optimization tools are systematically attempting to standardize procedures by improving access to information and transparency in management. Nevertheless, the next day requires the definition of the transition to modern tools and technologies of the fourth industrial revolution. This study attempts to identify common and additional critical success factors from implementing e-procurement in the 3.0 and 4.0 eras. Identifying the key challenges will be the basis for the roadmap plan suitable for maximizing the achievement of new public management in Industry 4.0.

1. Introduction

Public procurement is one of the four key economic activities governments participate in [1,2]. In OECD member countries, public procurement accounts for one-third of all government spending and 13% of GDP [1,3]. One of the government functions most susceptible to corruption is this one. Even in EU nations with relatively strong procurement system integrity, estimates of losses from acquired spending range from 10 to 20 percent [4]. Due to poor infrastructure quality or degree, corruption can result in greater deficits and slower growth [5]. Some concepts and procedures used to prevent corruption and protect the public interest in the procurement process include integrity standards, openness, stakeholder involvement, and e-procurement [1,6,7,8]. The government may obtain the highest quality and price ratio in public procurement by boosting competition among bidders. Beyond the problem of the draining impact of corruption, there are also benefits to using e-procurement systems, including the ability to manage public resources efficiently [9]. Quality management as a public administration reform approach sought to develop strategies to ensure the modernization of public administration to maximize decision-making and the quality of public services [10]. A tool for achieving quality in public management objectives is e-procurement [11]. Numerous experts agree that enhancing quality necessitates a process-based perspective. E-procurement is essential for implementing a QMS because it supports the sharing of quality information and makes it possible for suppliers and purchasers to engage in quality procedures [11]. According to studies, e-procurement promoted the admission of better standard contractors and improved quality in India and Indonesia [12]. Implementing electronic (e-) procurement as a critical reform contributed to solutions through its application in the private and public sectors. In the public sector, in particular, the influence of e-procurement is a decisive factor in achieving efficiency and effectiveness in three fields [13,14,15,16]: (1) transparency and accountability in governance, (2) efficient use of public resources, and (3) conditions of balanced development of all regions and fair competition between companies. Reforming public procurement through electronic transition strengthens the citizens’ faith in public administration and democracy as it achieves its political goals rationally, effectively, and transparently [16,17,18]. Democratic accountability is the main component of public e-procurement systems that are constrained by laws, rules, regulations, and numerous institutional oversight mechanisms. Increasing competition between public vendors may greatly simplify procurement, decrease costs, and produce better results. With the advent of electronic government platforms, electronic public procurement (e-PP) began its journey toward digital transformation [16]. Procurement 2.0 (e-PP 2.0) transitioned from traditional price-based and siloed procurement to capturing data and transactions utilizing e-PP and digital process management in the early phases of digitalization [19]. Through procurement 3.0, e-PP 3.0 systems began working and interacting with information outside their data environment. Business choices were directed by cognitive capabilities and content management rather than transactions alone [15,16,20]. Industry 4.0 features machine-to-machine communication and integration of the physical, digital, and biological worlds using 4.0 technologies [21]. For instance, in Purchasing 3.0, an electronic catalogue, a digital tool that requires a human customer to register his desire is an example of buying. In Industry 4.0 (ID 4.0), sensors in a cyber-physical system detect demand by seeing that material is running low. Autonomy is the second of the constituting elements of I.D. 4.0 [22]. The decisions use pre-programmed algorithms (e.g., AI & ML). Finally, machine-to-machine communication is a legitimate need but necessary since it requires a secure connection to work. Instead of focusing on the human-machine interface as in I.D. 3.0, the innovation now is that networked robots may interact without human intervention [23].
This study attempts to lead by examining common and distinct challenges and problems in the transition from era 3.0 to era 4.0 of e-PP. To achieve this, it collects and categorizes problems and challenges of the 3.0 era, groups them with the method T.O.E., and attempts to classify them with the MIT90s model to have an understandable cognitive structure for those who make decisions. Previous studies underline that a digital transition plan from one era to another requires a deep understanding and accurate T.O.E. classification [24] of the challenges and barriers that interpret adoption readiness and effectiveness [25]. The next step is transforming these challenges and barriers to critical success factors (CSFs) for practical managerial implications. Numerous significant studies and reports have been conducted on the critical success factors for implementing e-procurement [2,13,15,16,20,25]. Likewise, there are studies on the potential of the fourth industrial revolution technologies in procurement in the private and public sectors [21,26,27,28,29,30,31,32].
The present electronic public procurement (e-P.P. 3.0) literature offers limited assistance for a compact transition strategy for companies and public organizations to electronic public procurement in ID 4.0. e-PP 4.0 studies have mostly focused on how emerging technologies may provide value to them [33,34,35]. To address this gap in the literature, our study gathered the new challenges and obstacles that public bodies and relevant shareholders face in applying emerging technologies in public procurement, and explored how these challenges and barriers could be classified to transform them into useful administrative actions, understandable to digital transition public or private decision-makers.
In Section 3.1, the study presents the definition and classification of the challenges and barriers of e-PP 3.0. The definition and classification of challenges and barriers of e-PP 4.0 were collected in current case studies of the 4.0 era to Section 3.2 and Appendix A. Section 4.1 presents the comparative analysis of e-PP. 3.0 and e-P.P. 4.0 challenges and barriers, resulting in two concluding tables analyzing the common problems and challenges of implementing e-procurement in the public sector and additional challenges and problems of the fourth industrial revolution. In Section 4.2, we classified the additional challenges and problems into understandable critical success factors based on the MIT90s framework of Scott Morton (1990) [36]. This could be the base of a future study to facilitate their conversion into management actions, maximizing the effectiveness of an e-public digital transition through a commonly accepted roadmap [37]. In the discussion, we proceed to theoretical implications to Section 5.1 by synthesizing managerial and research analysis tools to create a valuable input to a technology transition roadmap. Managerial implications in Section 5.2 included from the comparative evaluation reveal common elements and additional ones that concern technologies of the fourth industrial revolution exclusively, due to their special nature. In Section 5.3 we mention the main limitations of the study as they derive from the collection of the data, the ontological limits of the research tools, and the dynamics of the subject of the fourth industrial revolution, as it is ongoing. An overall digital transition strategy for public procurement in ID 4.0 is the point of a potential future study in Section 5.4. Also, the additional specific problems for public procurement in ID 4.0 could lead to new research questions and suggestions for the most efficient transition of public and private organizations. In the conclusion, the contribution of this study is highlighted as it will utilize our previous knowledge from the application of e-PP 3.0 during the digital transition and focuses the effort to identify, understand, and reveal the specific problems created by the technologies of the fourth industrial revolution in their future implementation in public procurement by implying a former framework (MIT90s) as a process of preparing a modern technology transition roadmap.

2. Research Methodology

We followed Stuart et al.’s research process model: first, we defined our research questions. The research design was therefore created to compare the theoretical view about e-P.P. 3.0 challenges and relevant cases in e-PP 4.0. Following that, we acquired, compared, and discussed the common and new challenges [38].

2.1. The Research Questions

The research questions were defined at the initial step of the research process.
The main research questions of this study are:
RQ1. Which are the common and new challenges and barriers between e-PP 3.0 and e-PP 4.0?
RQ2. How can we define and classify these new challenges and barriers to critical success factors to connect them to specific actions in a new digital transition roadmap?

2.2. Research Path

The databases chosen as the first step in the process for this literature review were Science Direct, IEEE Explore, Scopus, Google Scholar, and Web of Science.
The method of data collecting is shown in Table 1.
After gathering the appropriate theoretical data about e-PP 3.0 and case studies on e-PP 4.0, the study categorized barriers and challenges according to the technology evaluation methodology described as the TOE framework [13]. The TOE framework is a framework that proposes a basic set of factors that explain and predict the probability of innovation/technology adoption [13].
We used a qualitative method and performed a descriptive multiple case study about emerging technologies in e-PP 4.0 to give first insights and help create well-grounded, generalizable challenges with TOE analysis due to a lack of relevant literature [39]. According to Yin, case studies are most effective when the study topic is “why” observable phenomena occur and when the focus is on recent events [40]. We chose to identify and describe critical variables such as challenges and barriers in e-PP 4.0 where either a theory does not yet exist or cause and effect are in doubt in the case research methodology because it is both appropriate and essential. According to Handfield and Melynk, the proper research structure for finding key variables are focused, in-depth, multi-site, best-in-class case studies [41].
The primary sources of evidence in focused case studies are participant interviews, project reports, end user feedback documents, and meeting notes. Secondary sources are studies of international organizations concerning technology applications of the e-PP 4.0. The authors used a four-step approach: preparation, exploration, specification, and integration (PESI) for empirical material understanding [40]. Reliability and generalizability are the two main criteria for assessing the previous sourcing material but are risky in qualitative methods as described in the research limitation [42]. The research logic consideration is abduction, while it is sufficiently adaptable to allow for a less theory-driven research method than deduction. Abduction through case study analysis asserts that theoretical frameworks emerge with empirical observation. The researcher evaluates the empirical data and gives detailed descriptions based on the participants’ perspectives from the abovementioned sources [43]. The case study selection and the interpretation of challenges and barriers in e-PP 4.0 were focused on flexibility. Data-gathering methods were focused on public procurement cases, but different sources of case interpretation were gathered to make the data more flexible. To establish validity, we explored several sources of evidence for each essential aspect of challenges and barriers in e-PP.4.0, employing the crucial triangulation approach [44,45].
The authors have identified three distinct shortcomings in the data analysis section of case research paper submissions as reviewers for a range of journals: the failure to identify important patterns, the difficulty in simplifying from descriptive material, and the inability to think laterally. A good strategy for separating order from chaos is to structure the data in several patterns and present them in tables. Much of the data from case-based research is qualitative, making it challenging to present in a format suitable for a journal article. Yin describes writing a case study to avoid extensive tales. As a result, they decided to apply tables that categorize data by technology type and classify them in a TOE structure comparable to e-PP 3.0 data collection [40]. The Eisenhardt framework will be used to set the organize and control rules of the research, known as a case study protocol (CSP) [46], as it is adapted in IS research [46]. The Eisenhardt framework may be divided into three phases: model construction (Phase 1) by selecting the proper to research questions cases, model testing (Phase 2) by analyzing the data within the cases or cross-case, and model refining (Phase 3) by comparison with similar or conflicting literature. The data collection of the cases is presented in Appendix A.
There are also other commonly used theoretical models in I.S. adoption technology research, including the classical Technology Acceptance Model (TAM) [47], TAM II [48], the Theory of Planned Behavior (TPB) [49], and the Diffusion of Innovations (DOI) [50]. Nevertheless, the TOE framework appears relevant because it is a commonly used theoretical technique for examining contextual elements that impact IT innovation adoption with an empirical base [51]. The technological dimension of the TOE framework examines challenges, problems, and the degree of readiness about the necessary technology infrastructure in hardware and software and IT human resources capabilities [24]. The organizational dimension describes the administrative and contextual requirements for implementing new digital technology. Top management support, financial resources, and organizational structure were all identified by Kosmol et al. [25]. Change management and communicating the organization’s transitional goals and arrangements to address any resistance to change on the part of the staff, users, or other stakeholders is another element of the organizational challenges we had to address [52]. The environmental dimension refers to government regulation that public authorities and businesses should follow to preserve privacy, transparency, and accountability [36]. The sector’s structure, the national presence or absence of technical service providers, national policies, and public financing are all factors to consider also [53].
To classify the challenges and barriers to critical success factors (CSFs) [36] and then to an actionable technology roadmap (T.R.M) [37,54], we used the socio-technical MIT90s framework of Scott Morton [30]. The CSFs will be the subject of further future Delphi method analysis to determine actions and a strategic plan for adopting a digital transformation (TRM) by the shareholders of public procurement in the ID 4.0 era. A technological roadmap will assist policymakers in determining which technologies to advance and how to implement them. Figure 1 below summarizes the research path and the intended results of each step.

3. Comparing Public e-Procurement 3.0 and e-Procurement 4.0

3.1. The e-Public Procurement 3.0 Challenges by the TOE Framework Based on Literature Review

E-public procurement impact reduces administrative costs and reorganizes procurement procedures faster and more transparently by providing information about individual tender opportunities [55]. E-procurement improved monitoring because there is a digital recorded process under audit standards [56]. Similarly, the cross-border competition was expanded by removing barriers presented by paper-based procurement processes. The procurement administration is centralized, so applying economies of scale and reducing back-office costs is feasible [57].
Critical success factors, obstacles, and challenges arising from the implementation of e-procurement 3.0 contribute to their reliable benchmarking with those resulting from the implementation of e-procurement 4.0 cases. The idea is based on benchmarking between two products with common but different characteristics [58]. The TOE classification makes it easy for us to have a common benchmarking framework, understandable and easily translatable to management decisions [53]. Table 2 below presents the TOE categorized barriers and challenges presented during the implementation of 3.0 technologies in electronic public procurement through the literature review.

3.2. The e-Public Procurement 4.0 Challenges by TOE Framework Based on Case Studies

The fourth industrial revolution is a wave that brings changes in the technology sector and all business structures and interfaces between the State, business, and citizens/customers. Industry 4.0 is the critical framework of the investigation, which offers solutions and creates research requirements in breadth and depth of all parameters that support or hinder the full realization of the benefits for business and civil society [72]. The 2019 Accenture report analyzes the DNA of the technological changes that are imminent in the context of the fourth industrial revolution through the acronym DARQ. It briefly refers to DTL technology [73], artificial intelligence (AI), augmented reality (AR), and quantum computing [74].
Public procurement 4.0 adopts technological tools which can offer several benefits, such as faster and more effective access to more cross-border opportunities, especially for the SMEs [70]. Persons, platforms, processes, and partnerships are the main categories of challenge transformation for e-procurement in ID 4.0 [75].
The study of the directorate-general for internal market, industry, entrepreneurship, and SMEs about emerging technologies in public procurement around the world is an important base for our research [28]. The following table summarizes the results of the impact of each technology per case study and the challenges, barriers, and critical issues connected to each case and generally in literature. Cloud computing and “XaaS” are included in SMAC technologies additional to social, mobile, and analytics technologies [74]. Big data analytics is an emerging disruptive technology as it is a bridge between 3.0 and 4.0 generations and combines the operations with the main disruptive technologies of business intelligence, machine learning, and artificial intelligence [74,75,76,77]. A number of the practical use-cases and technologies are mutually beneficial and operate in addition [74,75,78]. “AI Watch” is another research source about the european landscape on the use of artificial intelligence by the public sector and analyze national strategies about reforming public procurement to obtain AI for public use.
A crucial component of this digital transition in the ID 4.0 equation connects the digital, physical, and human spheres through networks, processes, and data that are then transformed into knowledge and action. Emerging technologies have recently switched their emphasis from the purely technical component of connecting devices and obtaining data to the interconnectedness of devices, data, business objectives, people, and processes [30,31,72]. Table 3 presents the TOE framework e-public procurement 4.0 challenges/problems sourced from case studies (Appendix A).
Figure 2 below gathers, groups, and presents, more simply and understandably, in summary, the results of Table 3.

4. Comparative Analysis of Findings

4.1. Common and Additional Problems/Challenges e-Public Procurement 3.0–4.0

Regarding our first research question, the common problems and challenges between e-public procurement 3.0 and 4.0 are presented in Table 4.
The additional problems and challenges between e-public procurement 3.0 and 4.0 are presented in Table 5.

4.2. Classify Challenges and Barriers to MIT90s Critical Success Factors

Regarding our second research question, the study’s results reveal that technologies such as artificial intelligence, big data, and the Internet of Things allow companies and public organizations to automate and optimize their procurement process only if they identify and solve critical challenges and problems.
The MIT90s framework is intended as an application tool for a particular organization or a business performance model that examines the environmental factors from the perspective of five (5) components, which are crucial organizational characteristics that emerge as highly valuable information and need to be aligned and formed together to achieve greater effectiveness [36]. The MIT90s model explains the coordination of several essential factors in aligning strategy and Information and Communication Technology (ICT) [174]. The MIT90s model has been examined as a fundamental framework that stimulates and enables companies to understand the dynamics of all transformations that are necessary for technology to ensure the success of business performance [175].
By developing a conceptual framework using the MIT90s framework, this study seeks to find the new challenges and barriers from the emerging technologies implementation in e-PP and classify them with a long-term purpose to a road mapping technology procedure. In order to better understand how CSFs interact with to implement emerging technologies in public procurement, the CSF concept and the MIT90s framework have been combined [176,177]. Table 6 presents the classification of problems and challenges in CSF by MIT90s framework.

5. Discussion

5.1. Theoretical Implications

The theoretical contribution of the work is to synthesize a research path with the harmonization of certified research tools and methods, which results in a common and additional challenges-and-problems summary of two different techno-economic paradigms. Comparative analysis with the collection of secondary data [179] from the literature in era 3.0 and the collection of qualitative data from case study analysis in era 4.0, is a challenge. A challenge affected two parameters: the difference in the maturity of the technologies of the two periods and the different nature of the collected data, as in the case of the secondary literature review data we have in the majority quantitative data while in the case of case study analysis, qualitative data. Nevertheless, the categorization of the challenges and problems with the TOE [180] and MIT90s framework could contribute to reliable benchmarking [181]. Thus, we can compare “apples to apples” and come to conclusions that will help future researchers or managers. In the case of common challenges, managers can adopt good past practices, and in the case of new challenges, the shareholders should compose new practices. Additionally, the study’s contribution to the theoretical part of the new challenges management, MIT90s method, could be utilized as a base for reform. The simplicity and fundamental nature of the MIT90s [53] framework can transform the heterogeneous information of challenges and problems into something more practical for managers. The familiarization of managers with the MIT90s method in IT and digital transition projects, and creating a series of proposed critical success factors by matching the challenges, creates the theoretical background for additional research that will be validated through a technology assessment. In addition, categorizing challenges and problems into groups helps identify the critical system requirements and their targets. In the case of the fourth industrial revolution, we have to assess whether the management processes or public procurement strategy will be at the center of the MIT90s framework [182] combined with the potential and weaknesses of emerging technologies. For this reason, in a future study, we have to research the interaction of the grouped critical success factors and focus on transforming public procurement strategy into technology-oriented drivers. In conclusion, serving the need to create a technology transition roadmap [37,54,183,184], we can rearrange the relationships of the elements of the MIT90s framework by setting in the center of the framework the public procurement strategic priorities and emerging technologies capabilities. In conclusion, it was studied and theoretically presented how management and data analysis tools can be combined to feed as an input a technology transition roadmap of electronic public procurement in the ID 4.0.

5.2. Managerial Implications

As a result, our study about emerging technologies in public procurement offers a viable answer to assist practitioners in implementing such technologies effectively and generating momentum by upscaling skills and applying methods accurately.
They are achieving the benefits of adopting ID 4.0 technologies require new skills, roles, and processes. A plan to increase the number of civil servants with emerging technologies 4.0-related skills is needed. Public managers should be informed of emerging technologies and what to expect from them, and their training should be adapted to these capabilities. Professionals should adopt the perspective that under certain circumstances, a public procurement system 4.0 can fail, be prejudiced, make incorrect decisions, or propose incorrect solutions.
Process automation frequently necessitates changes in organizational structures and cultures as tasks formerly conducted by people become automated, while previously unknown jobs and responsibilities become noticeable. There were always ethical issues to address through automation, and protective measures should be used to avoid the loss of control by humans. Regarding a reliable and human-centered use of technology, public administration is anticipated to be at the forefront.
The development and implementation of initiatives aimed at enhancing the public sector’s data quality, accessibility, and availability could be improved by access to data from the private sector through a secured method. The system, as well as the quality of the data, must be methodical and incorporated into legal frameworks. Regulatory sandboxes and pilot projects could allow the testing of innovative technologies in a real-life environment. The regulatory sandbox [185] aims to learn more about specific innovations’ opportunities and threats and develop an appropriate regulatory environment to respond to them. For instance, regulating the relationship between the public and private sectors is important to ensure successful collaboration and prevent unfavorable outcomes like vendor lock-in. The flagship pilots are useful for overcoming digital transformation challenges, but it is important to avoid pilot purgatory. Clear goals and integrated decisions by the shareholders are important to prove the value of the implemented technology in the long term. Using common metrics should review each emerging technology’s efficiency and document the key steps and success factors in developing a scaling roadmap checklist.
Public procurement departments, in particular, are being compelled to address governmental laws and connect their ID 4.0 programs with procurement legislation. As a result, we recommend starting with previous gain knowledge by e-PP3 to acquire firsthand experience and then evolve our transition to the specific elements that will meet the challenges of the technologies of ID 4.0.
Few infrastructure improvements will be made to encourage the adoption of emerging technologies in PP to improve the efficiency with which large amounts of data may be processed through the current data exchange portals. Furthermore, governments could encourage using PPP agreement. Supercomputer facilities could create novel emerging technology solutions for their public and private sectors. Also, reforming the procurement process to more agile methodologies could make adoption in technological and organizational aspects more likely to succeed. Technological interoperability is essential, particularly once the project has moved past the pilot stage.

5.3. Limitations

By gathering and interpreting qualitative data from focused case studies in e-PP 4.0 there is a reliability and generalizability risk. Qualitative case study research aims to analyze occurrences rather than generalize the findings. Credibility, reliability, transferability, and flexibility can all help to enhance qualitative empirical material interpretations [42]. The case study technique is frequently used to identify a relation or effect rather than to describe an average effect; hereafter, cases are frequently exemplary rather than typical [38]. Case-based research is sometimes misunderstood as a collection of “tales and war stories.” This critique can only be avoided by carefully designing and carrying out the research project using protocols. The cases are frequently described in a shot taken at a certain time. The case might be in pilot status or incomplete at this certain time. In addition, the data acquired from public sources was limited, so some obstacles or challenges might not be researched or covered [43]. The accessibility and interpretability of the information have a significant impact on the collection of use cases. Online, the information on particular use cases was frequently poor and, in some cases, unclear. Additionally, not all the information was readily available in English, leading to translation problems.

5.4. Implications for Future Studies

The classified critical success factors provide a method to establish guidelines for monitoring and controlling an organizational [186] and focus management attention on the critical area of business [187]. According to Leidecker and Bruno [188], using experts’ opinions is a technique used to identify CSFs. Delphi’s method could organize the expert opinion analysis more effectively because answers are tested repeatedly until a consensus is formed. The precise information produced is valuable for a well-focused decision-making policy [189]. TRM is an actionable time-specified strategic plan for realization among the various stakeholders/experts, developing a shared vision, defining rules for emerging technologies implementation, setting goals, evaluating the identified challenges and obstacles, and building strategy priorities. The proper tool for analysis and fulfilling of TRM in future research could be the Delphi method [37]. As we can record from previous studies, TRM [190] using as a designing basis, multi-criteria decision-making methodologies, the Delphi method, and HDM (hierarchical decision modeling) [54]. Consequently, future research based on classified challenges and barriers to CSF could suggest a TRM for a digital transition from e-public procurement 3.0 to 4.0 by building a consensus between experts about why, how, and when emerging technologies could impact and reform effectively the public procurement process.

6. Conclusions

By observing ongoing case studies, emerging technologies (Table 3) (Appendix A) provide a chance to handle the digital transition challenges for public procurement in ID 4.0. In the present study, by comparatively evaluating the challenges and problems between technologies 3.0 and 4.0 in the common context of a TOE. analysis, we found common and additional elements that can be our cognitive starting point during the digital transition from one technology to another.
Therefore, public and private sector managers could take advantage of the common and additional problems and challenges of the previous period and apply the following during the transition to the fourth industrial revolution.
In the technological field:
To ensure the resources for the necessary technological infrastructures.
Carefully plan the interface of legacy applications with emerging technologies by combining input sources and information outputs.
Design applications in a user-friendly manner that will ensure a user’s knowledge of how algorithms work when making decisions.
In the organizational field:
Public managers inspire with their vision and motivate staff to implement the transition by documenting the use of their choices and upgrading their skills.
Public authorities reorganize the framework of the management structure and update the job descriptions without barriers between departments and without exclusions for departments of employees or stakeholders.
PA and suppliers create an open model for innovation adoption by refining a culture of cooperation and knowledge exchange in the overall ecosystem.
In the environmental field:
Propose the institutional adaptation of administrative law to the modern technological challenges that require protecting personal data, cyber security, and preventing the risk of corruption and discrimination.
Ensure through certification protocols that the final responsibility for the control and operation of the electronic procurement tools will be with the end users and the citizens.
Calls for transparency as a path to a critical evaluation, democratic process, and accountability are inspired by images of the black-boxed algorithm or procurement without auditing.
Public administration in modern democracies serves the principles of democratic governance through the principles of accountability, transparency, political participation and equal opportunities.
The challenges found in the environment of emerging technologies define that the knowledge about the content of the algorithms and how they work must be clearly presented to citizens [191]. Although AI procurement systems can make decisions (for example, awarding procurements), they cannot be recipients of political responsibility towards the citizens. The citizens will request the responsibilities of the administrative staff of the public sector who choose the algorithms or train the robotic systems. Consequently, the public administration should, for reasons of strengthening the democratic feeling of the citizens, leave a window of participation and explanations for them. They should reveal the decision-making patterns at all stages of the procurement cycle by humans and machines and allow them to suggest changes.
The limitations of the present study are mainly found in the data collected from the case studies of emerging technologies in the field of electronic public procurement, as several of them are not mature or are in a trial stage or have not been sufficiently evaluated by the users.
Some future studies could be generated from the present one. A future study could concern the creation of a digital transition map through the consensus of experts (Delphi method). Another series of studies could isolate the emerging technology phase of the supply cycle or aim to investigate the challenges and problems concerning public procurement and propose solutions on a case-by-case basis.
It is important to speak generally of adoption rather than the implementation of emerging technologies in public procurement as the entire shareholder’s ecosystem should embrace the new solution, incorporate it into their processes, and as a result, become more fruitful. Generally, and especially for public processes like public procurement, it has become vital to create supervision and enforcement mechanisms that have a public-facing component, can demonstrate democratic responsibility, and are therefore also more representative of society as powerful technologies are deployed to the public in ways that are transparent to individuals. This legitimacy certification will empower the adoption culture through awareness training and continuously rationally reform the relationship between technologies, organizational structures, and people.

Author Contributions

Conceptualization, A.M. and D.F.; methodology, A.M.; validation, A.M. and D.F.; formal analysis, D.F.; investigation, A.M.; resources, A.M.; data curation, A.M.; writing—original draft preparation, A.M. and D.F.; writing—review and editing, A.M. and D.F.; visualization, D.F.; supervision, D.F.; project administration, D.F.; funding acquisition, D.F. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

No dataset.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. e-public procurement cases studies in I.D. 4.0.
Table A1. e-public procurement cases studies in I.D. 4.0.
Types of TechnologyCase Study Name
(Country)
Main ImpactProject StatusCollaboration with 3.0 PlatformsConcept
Blockchain1. Digipolis (Belgium) [192]TransparencyIn DevelopmentYesData backbone of trusted information
2. HHS Accelerate project [154,193] (USA)Decision-makingIn useYesData management from legacy systems
3. F.D.A.’s D.S.C.S.A.
Pilot Project Program (U.S.A.) [194]
TraceabilityPilotYesAlerts from trusted network members
4. Smart Contract. Programa de Alimentación Escolar (PAE) (Spain) [84,195]Decision-makingIn useYesAutomated tender vendor evaluation
5. Blockchain-based Proposal Evaluation System (South Korea) [28]TransparencyIn useYesStoring evaluation scores
Big data analytics
Business Intelligence
1. MEDIAAN (Belgium) [196]Decision-makingIn useYesPrice and cost analysis
2. Public Procurement Price Panel (Brazil) [77] Decision-makingIn useYesPrice and cost analysis
3. Open Contracting Data Standard Transformation and Analytics (Belarus) [28,197]Decision-making
Transparency
In useYesAnalyze and visualize procurement
data-patterns
4. DIGIWHIST project [198]Reduce corruption
Transparency
In useYesAnalyze and visualize procurement data
5. Red flags project (Hungary) [199,200]Reduce corruption
Transparency
In useYesPrevention and detection of corrupt procurements
6. Price Panel (Brazil) [201]TransparencyIn useYesMarket analysis
7. Skrinja-Business Intelligence Project (Slovenia) [158]Decision-
making
Transparency
In developmentYesAnalyze and visualize procurement data
Artificial Intelligence
Machine Learning
Chatbots
1. ProZorro
(Ukraine) [202,203,204]
Efficiency
Transparency
PilotYesAnalyze-monitor procurement data
2. Categorization Artificial Intelligence Technology (CAITY) (Australia) [28,76]Decision-
making
Transparency
In UseYesAnalyze-monitor procurement data
3. (i) Chat Bot UNA (Latvia) [205]EfficiencyIn UseYesProcurement Information Provider
3. (ii) Chat Bot Y.P.O.
(U.K.) [206]
EfficiencyIn UseYesProcurement Information Provider
4. Public Procurement Service (P.P.S.)
(Republic of Korea) [28]
EfficiencyIn UseYesPredictive analysis
Internet of Things (IoT)1. Department of Defense (U.S.A.) IoT [207]EfficiencyIn UseYesAnalyze-monitor procurement data
2. Smart Cities_ IoT Tampere platform (Finland)EfficiencyPilotNoAnalyze-monitor procurement data
Robotics
RPA (Robotics Process Automation)
Robots and Drones
1. Palkeet (Finland) [208]
1. Ghanaian Health Service using drones for vaccines delivery [209]
Efficiency
Transparency
Efficiency-Security
(i) in use
(ii) most in use in private sector
(i) Yes
(ii) No
(i) automate transactional processes and rules-based tasks
(ii) material handling, inspection, security
Augment Reality and Virtual RealityDigibygg project [210]
Helsinki city council, Urban planning project [211]
Statsbygg, Imerso pilot project [212]
Efficiency
Transparency
Accountability
Decision-making
In use-pilotYesPublic construction planning visualization, Evaluating final project, Asset management and maintenance
3D PrintingDepartment of Defense (U.S.A.) [213]
Beth Israel Deaconess Medical Center [214]
Material Stock Logistic Command of the Dutch Army [215]
EfficiencyIn useYesManufacturing
-prototypes
-bottleneck periods
-Additive

References

  1. OECD. Reforming Public Procurement: Progress in Implementing the 2015 OECD Recommendation; OECD Public Governance Reviews; OECD: Paris, France, 2019; ISBN 978-92-64-89160-9. [Google Scholar]
  2. Thai, K.V. Public Procurement Re-Examined. J. Public Procure 2001, 1, 9–50. [Google Scholar] [CrossRef]
  3. Bosio, E.; Djankov, S.; Glaeser, E.; Shleifer, A. Public Procurement in Law and Practice; National Bureau of Economic Research: Cambridge, MA, USA, 2020; p. w27188. [Google Scholar]
  4. Hafner, M.; Taylor, J.; Disley, E.; Thebes, S.; Barberi, M.; Stepanek, M.; Levi, M. The Cost of Non-Europe in the Area of Organised Crime and Corruption: Annex II—Corruption; RAND Corporation: Santa Monica, CA, USA, 2016. [Google Scholar]
  5. Schwartz, G.; Fouad, M.; Hansen, T.; Verdier, G. (Eds.) Well Spent; International Monetary Fund: Washington, DC, USA, 2020; ISBN 978-1-5135-1181-8. [Google Scholar]
  6. Colonnelli, E.; Prem, M. Corruption and Firms. Rev. Econ. Stud. 2020, 89, 695–732. [Google Scholar] [CrossRef]
  7. Fazekas, M.; Kocsis, G. Uncovering High-Level Corruption: Cross-National Objective Corruption Risk Indicators Using Public Procurement Data. Br. J. Political Sci. 2020, 50, 155–164. [Google Scholar] [CrossRef]
  8. Zimmermann, S. Using Data and Transparency to Fight Corruption in Public Procurement. p. 17. Available online: http://www.oas.org/juridico/PDFs/mesicic5_intecolec_29_wb_zimmermann.pdf (accessed on 23 October 2021).
  9. Afolabi, A.; Ibem, E.; Aduwo, E.; Tunji-Olayeni, P. Digitizing the Grey Areas in the Nigerian Public Procurement System Using E-Procurement Technologies. Int. J. Constr. Manag. 2020, 2022, 1774836. [Google Scholar] [CrossRef]
  10. Matei, L.; Lazăr, C.-G. Quality Management and the Reform of Public Administration in Several States in South-Eastern Europe. Comp. Analysis. Theor. Appl. Econ. 2011, XVIII, 65–98. [Google Scholar]
  11. Vaidyanathan, G.; Devaraj, S. The Role of Quality in E-Procurement Performance: An Empirical Analysis. J. Oper. Manag. 2008, 26, 407–425. [Google Scholar] [CrossRef]
  12. Lewis-Faupel, S.; Neggers, Y.; Olken, B.A.; Pande, R. Can Electronic Procurement Improve Infrastructure Provision? Evidence from Public Works in India and Indonesia. Am. Econ. J. Econ. Policy 2016, 8, 258–283. [Google Scholar] [CrossRef]
  13. Pekolj, N.; Hodošček, K.; Valjavec, L.; Ferk, P. Digital Transformation of Public Procurement as an Opportunity for the Economy. LeXonomica 2019, 11, 15–42. [Google Scholar]
  14. Gasco, M.; Cucciniello, M.; Nasi, G.; Yuan, Q. Determinants and Barriers of E-Procurement: A European Comparison of Public Sector Experiences. In Proceedings of the 51st Hawaii International Conference on System Sciences, Hilton Waikoloa Village, HI, USA, 3–6 January 2018. [Google Scholar]
  15. Mohungoo, I.; Brown, I.; Kabanda, S. A Systematic Review of Implementation Challenges in Public E-Procurement. In Proceedings of the Responsible Design, Implementation and Use of Information and Communication Technology, Skukuza, South Africa, 6–8 April 2020; Volume 12067, pp. 46–58. [Google Scholar]
  16. Croom, S.; Brandon-Jones, A. Key Issues in E-Procurement: Procurement Implementation and Operation in the Public Sector. J. Public Procure 2005, 5, 367–387. [Google Scholar] [CrossRef]
  17. Croom, S.; Brandon-Jones, A. Impact of E-Procurement: Experiences from Implementation in the UK Public Sector. J. Purch. Supply Manag. 2007, 13, 294–303. [Google Scholar] [CrossRef]
  18. Panayiotou, N.A.; Gayialis, S.P.; Tatsiopoulos, I.P. An E-Procurement System for Governmental Purchasing. Int. J. Prod. Econ. 2004, 90, 79–102. [Google Scholar] [CrossRef]
  19. Croom, S.R. The Impact of Web-Based Procurement on the Management of Operating Resources Supply. J. Supply Chain Manag. 2000, 36, 4–13. [Google Scholar] [CrossRef]
  20. Vaidya, K.; Sajeev, A.; Callender, G. Critical Factors That Influence E-Procurement Implementation Success in the Public Sector. J. Public Procure. 2006, 6, 70–99. [Google Scholar] [CrossRef]
  21. Lee, J.; Bagheri, B.; Kao, H.-A. A Cyber-Physical Systems Architecture for Industry 4.0-Based Manufacturing Systems. Manuf. Lett. 2015, 3, 18–23. [Google Scholar] [CrossRef]
  22. Hwang, J.S. Intelligent Manufacturing. 2016, p. 4. Available online: https://www.jenniehwang.com/pdfs/industry4.pdf (accessed on 23 November 2021).
  23. Sung, T.K. Industry 4.0: A Korea Perspective. Technol. Forecast. Soc. Chang. 2018, 132, 40–45. [Google Scholar] [CrossRef]
  24. Tornatzky, L.G. The Processes of Technological Innovation; Lexington Books: Lexington, MA, USA, 1990; ISBN 978-0-669-20348-6. [Google Scholar]
  25. Kosmol, T.; Reimann, F.; Kaufmann, L. You’ll Never Walk Alone: Why We Need a Supply Chain Practice View on Digital Procurement. J. Purch. Supply Manag. 2019, 25, 100553. [Google Scholar] [CrossRef]
  26. Jonathan, G.M. Digital Transformation in the Public Sector: Identifying Critical Success Factors. In Information Systems; Themistocleous, M., Papadaki, M., Eds.; Lecture Notes in Business Information Processing; Springer International Publishing: Cham, Switzerland, 2020; Volume 381, pp. 223–235. ISBN 978-3-030-44321-4. [Google Scholar]
  27. OECD State of the Art in the Use of Emerging Technologies in the Public Sector; OECD Working Papers on Public Governance; OECD: Paris, France, 2019; Volume 31.
  28. Deloitte. European Commission Study on Up-Take of Emerging Technologies in Public Procurement. Available online: https://ec.europa.eu/docsroom/documents/40102 (accessed on 23 September 2021).
  29. Sun, T.; Sales, L.J. Predicting Public Procurement Irregularity: An Application of Neural Networks. J. Emerg. Technol. Account. 2018, 15, 141–154. [Google Scholar] [CrossRef]
  30. Sony, M.; Naik, S. Critical Factors for the Successful Implementation of Industry 4.0: A Review and Future Research Direction. Prod. Plan. Control. 2020, 31, 799–815. [Google Scholar] [CrossRef]
  31. Garay-Rondero, C.L.; Martinez-Flores, J.L.; Smith, N.R.; Caballero Morales, S.O.; Aldrette-Malacara, A. Digital Supply Chain Model in Industry 4.0. J. Manuf. Technol. Manag. 2020, 31, 887–933. [Google Scholar] [CrossRef]
  32. Büyüközkan, G.; Göçer, F. Digital Supply Chain: Literature Review and a Proposed Framework for Future Research. Comput. Ind. 2018, 97, 157–177. [Google Scholar] [CrossRef]
  33. Masudin, I.; Aprilia, G.D.; Nugraha, A.; Restuputri, D.P. Impact of E-Procurement Adoption on Company Performance: Evidence from Indonesian Manufacturing Industry. Logistics 2021, 5, 16. [Google Scholar] [CrossRef]
  34. Glas, D.A.H.; Kleemann, P.D.D. The Impact of Industry 4.0 on Procurement and Supply Management: A Conceptual and Qualitative Analysis. Available online: https://www.semanticscholar.org/paper/The-Impact-of-Industry-4-.-0-on-Procurement-and-%3A-A-Glas-Kleemann/cbeb003590eb09927fdb768bbeee8ef64cba49b0 (accessed on 23 November 2021).
  35. Vaidya, K.; Campbell, J. Multidisciplinary Approach to Defining Public E-Procurement and Evaluating Its Impact on Procurement Efficiency. Inf. Syst. Front. 2016, 18, 333–348. [Google Scholar] [CrossRef]
  36. Rockart, J.F.; Morton, M.S.S. Implications of Changes in Information Technology for Corporate Strategy. Interfaces 1984, 14, 84–95. [Google Scholar] [CrossRef]
  37. Kanama, D. Development of Technology Foresight: Integration of Technology Roadmapping and the Delphi Method. In Technology Roadmapping for Strategy and Innovation; Moehrle, M.G., Isenmann, R., Phaal, R., Eds.; Springer: Berlin/Heidelberg, Germany, 2013; pp. 151–171. ISBN 978-3-642-33922-6. [Google Scholar]
  38. Stuart, I.; McCutcheon, D.; Handfield, R.; McLachlin, R.; Samson, D. Effective Case Research in Operations Management: A Process Perspective. J. Oper. Manag. 2002, 20, 419–433. [Google Scholar] [CrossRef]
  39. Eisenhardt, K.M.; Graebner, M.E. Theory Building from Cases: Opportunities and Challenges. AMJ 2007, 50, 25–32. [Google Scholar] [CrossRef]
  40. Yin, R.K. Case Study Research Design and Methods Third Edition. Appl. Soc. Res. Methods Ser. 2003, 5, 109–122. [Google Scholar]
  41. Handfield, R.B.; Melnyk, S.A. The Scientific Theory-Building Process: A Primer Using the Case of TQM. J. Oper. Manag. 1998, 16, 321–339. [Google Scholar] [CrossRef]
  42. Merriam, S.B.; Tisdell, E.J. Qualitative Research: A Guide to Design and Implementation; John Wiley & Sons: Hoboken, NJ, USA, 2015; ISBN 978-1-119-00361-8. [Google Scholar]
  43. Rashid, D.Y.; Rashid, A.; Warraich, M.; Sabir, S.; Waseem, A. Case Study Method: A Step-by-Step Guide for Business Researchers. Int. J. Qual. Methods 2019, 18, 160940691986242. [Google Scholar] [CrossRef]
  44. Denzin, N.K.; Lincoln, Y.S. Introduction: The Discipline and Practice of Qualitative Research. In The Sage Handbook of Qualitative Research; Sage Publications Ltd.: Thousand Oaks, CA, USA, 2008. [Google Scholar]
  45. Jick, T.D. Mixing Qualitative and Quantitative Methods: Triangulation in Action. Adm. Sci. Q. 1979, 24, 602–611. [Google Scholar] [CrossRef]
  46. Maimbo, H.; Pervan, G. Designing a Case Study Protocol for Application in IS Research. In Proceedings of the PACIS, Bangkok, Thailand, 7–10 July 2005. [Google Scholar]
  47. Davis, F.D. A Technology Acceptance Model for Empirically Testing New End-User Information Systems: Theory and Results. Ph.D. Thesis, Massachusetts Institute of Technology, Cambridge, MA, USA, 1985. [Google Scholar]
  48. Venkatesh, V.; Davis, F.D. A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies. Manag. Sci. 2000, 46, 186–204. [Google Scholar] [CrossRef]
  49. Ajzen, I. The Theory of Planned Behavior. Organ. Behav. Hum. Decis. Processes 1991, 50, 179–211. [Google Scholar] [CrossRef]
  50. Rogers, E.M. Diffusion of Innovations, 4th ed.; Routledge: London, UK, 2010; ISBN 978-1-4516-0247-0. [Google Scholar]
  51. Zhu, K.; Kraemer, K.L.; Xu, S. The Process of Innovation Assimilation by Firms in Different Countries: A Technology Diffusion Perspective on E-Business. Manag. Sci. 2006, 52, 1557–1576. [Google Scholar] [CrossRef]
  52. Bellantuono, N.; Nuzzi, A.; Pontrandolfo, P.; Scozzi, B. Digital Transformation Models for the I4.0 Transition: Lessons from the Change Management Literature. Sustainability 2021, 13, 12941. [Google Scholar] [CrossRef]
  53. Baker, J. The Technology–Organization–Environment Framework. In Information Systems Theory: Explaining and Predicting Our Digital Society, Volume 1; Dwivedi, Y.K., Wade, M.R., Schneberger, S.L., Eds.; Integrated Series in Information Systems; Springer: New York, NY, USA, 2012; pp. 231–245. ISBN 978-1-4419-6108-2. [Google Scholar]
  54. De Alcantara, D.P.; Martens, M.L. Technology Roadmapping (TRM): A Systematic Review of the Literature Focusing on Models. Technol. Forecast. Soc. Chang. 2019, 138, 127–138. [Google Scholar] [CrossRef]
  55. Roman, A.; Mccue, C. E-Procurement: Myth or Reality. J. Public Procure. 2012, 12, 212. [Google Scholar] [CrossRef]
  56. Williams, S.P.; Hardy, C. Public EProcurement as Socio-Technical Change. Strat. Chang. 2005, 14, 273–281. [Google Scholar] [CrossRef]
  57. Christensen, C.M.; Overdorf, M. Meeting the Challenge of Disruptive Change. Harv. Bus. Rev. 2000, 78, 66–77. [Google Scholar]
  58. Nograšek, J. Change Management as a Critical Success Factor in E-Government Implementation. Bus. Syst. Res. J. 2012, 2, 13–24. [Google Scholar] [CrossRef]
  59. Moe, C.E.; Päivärinta, T. Challenges in Information Systems Procurement in the Public Sector. Electron. J. E-Gov. 2013, 11, 307–322. [Google Scholar]
  60. Williams-Elegbe, S. Beyond UNCITRAL: The Challenges of Procurement Reform Implementation in Africa. Stellenbosch Law Rev. 2014, 25, 209–224. [Google Scholar]
  61. Costa, A.A.; Arantes, A.; Valadares Tavares, L. Evidence of the Impacts of Public E-Procurement: The Portuguese Experience. J. Purch. Supply Manag. 2013, 19, 238–246. [Google Scholar] [CrossRef]
  62. Barahona, J.C.; Elizondo, A.M. The Disruptive Innovation Theory Applied to National Implementations of E-procurement. Electron. J. E-Gov. 2012, 10, 107–119. [Google Scholar]
  63. Rose, W.; Grant, G. Critical Issues Pertaining to the Planning and Implementation of E-Government Initiatives. Gov. Inf. Q. 2010, 27, 26–33. [Google Scholar] [CrossRef]
  64. Srivastava, A. Resistance to Change: Six Reasons Why Businesses Don’t Use e-Signatures. Electron. Commer. Res. 2011, 11, 357–382. [Google Scholar] [CrossRef]
  65. Conklin, A.; White, G.B. E-Government and Cyber Security: The Role of Cyber Security Exercises. In Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS’06), Kauai, HI, USA, 4–7 January 2006; Volume 4, p. 79b. [Google Scholar]
  66. Panda, D.; Sahu, G.P. E-Procurement Implementation: Critical Analysis of Success Factors’ Impact on Project Outcome; Social Science Research Network: Rochester, NY, USA, 2012. [Google Scholar]
  67. Al Athmay, A.A.A.R.A. Demographic Factors as Determinants of E-Governance Adoption: A Field Study in the United Arab Emirates (UAE). Transform. Gov. People Process Policy 2015, 9, 159–180. [Google Scholar] [CrossRef]
  68. Directorate-General for Internal Market, I.; de Bas, P.; Hausemer, P.; Kruger, T.; Rabuel, L.; de Vet, J.M.; Vincze, M. Analysis of the SMEs’ Participation in Public Procurement and the Measures to Support It: Final Report; Publications Office of the European Union: Luxembourg, 2019; ISBN 978-92-76-09142-4. [Google Scholar]
  69. European Commission. Directorate General for Internal Market, Industry, Entrepreneurship and SMEs.; t33. In SME Needs Analysis in Public Procurement: Final Report; Publications Office: Luxembourg, 2021. [Google Scholar]
  70. Tammi, T.; Reijonen, H.; Saastamoinen, J. E-Procurement and SME Involvement in Public Procurement of Innovations: An Exploratory Study. IJPM 2018, 11, 420. [Google Scholar] [CrossRef]
  71. Krogstie, J. Introduction of a Public Sector E-Procurement Solution: Lessons Learned from Disappointing Adoption. In Advances in Information Systems Research, Education and Practice; Avison, D., Kasper, G.M., Pernici, B., Ramos, I., Roode, D., Eds.; IFIP—The International Federation for Information Processing; Springer: Boston, MA, USA, 2008; Volume 274, pp. 203–214. ISBN 978-0-387-09681-0. [Google Scholar]
  72. Weking, J.; Stöcker, M.; Kowalkiewicz, M.; Böhm, M.; Krcmar, H. Leveraging Industry 4.0—A Business Model Pattern Framework. Int. J. Prod. Econ. 2020, 225, 107588. [Google Scholar] [CrossRef]
  73. Ray, S. The Difference Between Blockchains & Distributed Ledger Technology. Available online: https://towardsdatascience.com/the-difference-between-blockchains-distributed-ledger-technology-42715a0fa92 (accessed on 22 September 2021).
  74. Accenture, A. Accenture Technology Vision. 2019. Available online: https://www.accenture.com/_acnmedia/pdf-94/accenture-techvision-2019-tech-trends-report.pdf (accessed on 22 September 2021).
  75. Nicoletti, B. Procurement 4.0 and the Fourth Industrial Revolution: The Opportunities and Challenges of a Digital World; Springer Nature: Berlin/Heidelberg, Germany, 2020; ISBN 978-3-030-35979-9. [Google Scholar]
  76. World Bank Disruptive Technologies Can Provide Developing Countries with a Pathway to Revamp Their Public Procurement Processes. Available online: https://blogs.worldbank.org/governance/disruptive-technologies-can-provide-developing-countries-pathway-revamp-their-public (accessed on 26 September 2021).
  77. Deloitte. GROW.R.2.DIR Public Procurement Price Panel—Emerging Technologies in Public Procurement—Case Study. Available online: https://ec.europa.eu/docsroom/documents/39911?locale=el (accessed on 28 September 2021).
  78. Ferk, P. Can the Implementation of Full E-Procurement into Real Life Address the Real Challenges of EU Public Procurement? Eur. Procure. Public Priv. Partnersh. Law Rev. 2016, 11, 327–339. [Google Scholar] [CrossRef]
  79. Knirsch, F.; Unterweger, A.; Engel, D. Implementing a Blockchain from Scratch: Why, How, and What We Learned. EURASIP J. Inf. Secur. 2019, 2019, 2. [Google Scholar] [CrossRef]
  80. All 10 Million Buildings in the Netherlands Available as 3D Models. Available online: https://www.tudelft.nl/en/2021/bk/all-10-million-buildings-in-the-netherlands-available-as-3d-models (accessed on 13 October 2021).
  81. Bui, K. 3D Printing Presents a Faster Path to Innovation. Available online: https://www.tctmagazine.com/api/content/94c24500-f602-11eb-acf0-1244d5f7c7c6/ (accessed on 17 October 2021).
  82. Ishchenko, N. Global Material Supply Chain: Procurement Database for 3D Printing Construction Projects. Available online: http://www.theseus.fi/handle/10024/467476 (accessed on 16 October 2021).
  83. Katkar, R.; Geha, H. Emerging Imaging Technologies in Dento-Maxillofacial Region, an Issue of Dental Clinics of North America; Elsevier: Amsterdam, The Netherlands, 2018; ISBN 978-0-323-61077-3. [Google Scholar]
  84. Sanchez, S.N. The Implementation of Decentralised Ledger Technologies for Public Procurement: Blockchain Based Smart Public Contracts. Eur. Procure. Pub. Priv. Partnersh. L. Rev. 2019, 14, 180. [Google Scholar]
  85. Gohil, D.; Thakker, S.V. Blockchain-Integrated Technologies for Solving Supply Chain Challenges. Mod. Supply Chain Res. Appl. 2021, 3, 78–97. [Google Scholar] [CrossRef]
  86. Centre for the Fourth Industrial Revolution. Bridging the Governance Gap: Interoperability for Blockchain and Legacy Systems; World Economic Forum: Cologny, Switzerland, 2020. [Google Scholar]
  87. Briggs, R.; Dul, J.; Mariani, J.; Kishnani, P.K. Digital Reality in Government. Available online: https://www2.deloitte.com/us/en/insights/industry/public-sector/augmented-virtual-reality-government-services.html (accessed on 13 October 2021).
  88. Adam, I.; Fazekas, M. Big Data Analytics as a Tool for Auditors to Identify and Prevent Fraud and Corruption in Public Procurement. Eur. Court. Audit. J. 2019, 2, 172–179. [Google Scholar]
  89. kingmesal Vendor Lock-In and the Big Data Ecosystem—What Does It Really Mean? SmartData Collective 2016. Available online: https://www.smartdatacollective.com/vendor-lock-and-big-data-ecosystem-what-does-it-really-mean/ (accessed on 24 November 2021).
  90. Moretto, A.; Ronchi, S.; Patrucco, A.S. Increasing the Effectiveness of Procurement Decisions: The Value of Big Data in the Procurement Process. Int. J. RF Technol. 2017, 8, 79–103. [Google Scholar] [CrossRef]
  91. Al-Jaroodi, J.; Mohamed, N. Characteristics and Requirements of Big Data Analytics Applications. In Proceedings of the 2016 IEEE 2nd International Conference on Collaboration and Internet Computing (CIC), Pittsburgh, PA, USA, 1–3 November 2016; pp. 426–432. [Google Scholar]
  92. Hartley, K.; Seymour, L.F.; Seymour, L. Towards a Framework for the Adoption of Business Intelligence in Public Sector Organisations: The Case of South Africa. In Proceedings of the South African Institute of Computer Scientists and Information Technologists Conference on Knowledge, Innovation and Leadership in a Diverse, Multidisciplinary Environment, Cape Town, South Africa, 3–5 October 2011. [Google Scholar]
  93. Sivarajah, U.; Kamal, M.M.; Irani, Z.; Weerakkody, V. Critical Analysis of Big Data Challenges and Analytical Methods. J. Bus. Res. 2017, 70, 263–286. [Google Scholar] [CrossRef]
  94. Publications Office of the European. COM/2020/65 Final, WHITE PAPER on Artificial Intelligence—A European Approach to Excellence and Trust. Available online: http://op.europa.eu/en/publication-detail/-/publication/ac957f13-53c6-11ea-aece-01aa75ed71a1 (accessed on 14 October 2021).
  95. Rane, S.B.; Narvel, Y.A.M.; Bhandarkar, B.M. Developing Strategies to Improve Agility in the Project Procurement Management (PPM) Process: Perspective of Business Intelligence (BI). Bus. Process Manag. J. 2019, 26, 257–286. [Google Scholar] [CrossRef]
  96. Surya, L. Artificial Intelligence in Public Sector; Social Science Research Network: Rochester, NY, USA, 2019. [Google Scholar]
  97. McBride, K.; van Noordt, C.; Misuraca, G.; Hammerschmid, G. Towards a Systematic Understanding on the Challenges of Procuring Artificial Intelligence in the Public Sector. 2021. Available online: https://osf.io/preprints/socarxiv/un649/ (accessed on 24 September 2021).
  98. Goldenfein, J. Algorithmic Transparency and Decision-Making Accountability: Thoughts for Buying Machine Learning Algorithms; Social Science Research Network: Rochester, NY, USA, 2019. [Google Scholar]
  99. Veale, M.; Brass, I. Administration by Algorithm? Public Management Meets Public Sector Machine Learning; Social Science Research Network: Rochester, NY, USA, 2019. [Google Scholar]
  100. García Rodríguez, M.J.; Rodríguez Montequín, V.; Ortega Fernández, F.; Villanueva Balsera, J.M. Public Procurement Announcements in Spain: Regulations, Data Analysis, and Award Price Estimator Using Machine Learning. Complexity 2019, 2019, e2360610. [Google Scholar] [CrossRef]
  101. Zeadally, S.; Adi, E.; Baig, Z.; Khan, I.A. Harnessing Artificial Intelligence Capabilities to Improve Cybersecurity. IEEE Access 2020, 8, 23817–23837. [Google Scholar] [CrossRef]
  102. Betigiri, V. Artificial Intelligence (AI) Driven Infrastructure. Medium 2018. Available online: https://medium.com/@vijay.betigiri/ai-defined-enterprise-it-a662b4fd9ca8 (accessed on 25 November 2021).
  103. García Rodríguez, M.J.; Rodríguez Montequín, V.; Ortega Fernández, F.; Villanueva Balsera, J.M. Bidders Recommender for Public Procurement Auctions Using Machine Learning: Data Analysis, Algorithm, and Case Study with Tenders from Spain. Complexity 2020, 2020, e8858258. [Google Scholar] [CrossRef]
  104. De Blasio, G.; D’Ignazio, A.; Letta, M. Predicting Corruption Crimes with Machine Learning. A Study for the Italian Municipalities. Available online: http://www.diss.uniroma1.it/sites/default/files/allegati/DiSSE_deBlasioetal_wp16_2020.pdf (accessed on 25 November 2021).
  105. Popa, M. Uncovering the Structure of Public Procurement Transactions. Bus. Politics 2019, 21, 351–384. [Google Scholar] [CrossRef] [Green Version]
  106. Ash, E.; Galletta, S.; Giommoni, T. A Machine Learning Approach to Analyzing Corruption in Local Public Finances. Cent. Law Econ. Work. Pap. Ser. 2020, 6, 35. [Google Scholar] [CrossRef]
  107. Seibel, R. Collusion by Exclusion in Public Procurement. Available online: https://samuelskoda.github.io/assets/pdf/collusion.pdf (accessed on 25 September 2021).
  108. CAHAI Artificial Intelligence in Public Sector. Available online: https://rm.coe.int/cahai-pdg-2021-03-subwg2-ai-in-public-sector-final-draft-12032021-2751/1680a1c066 (accessed on 23 October 2021).
  109. Wirtz, B.W.; Weyerer, J.C.; Schichtel, F.T. An Integrative Public IoT Framework for Smart Government. Gov. Inf. Q. 2019, 36, 333–345. [Google Scholar] [CrossRef]
  110. Brass, I.; Tanczer, L.; Carr, M.; Elsden, M.; Blackstock, J. Standardising a Moving Target: The Development and Evolution of IoT Security Standards. In Proceedings of the Living the Internet of Things: Cybersecurity of the IoT—2018, London, UK, 28–29 March 2018. [Google Scholar]
  111. Bandyopadhyay, D.; Sen, J. Internet of Things: Applications and Challenges in Technology and Standardization. Wirel. Pers. Commun. 2011, 58, 49–69. [Google Scholar] [CrossRef]
  112. Fosch Villaronga, E.; Golia, A.J. Robots, Standards and the Law: Rivalries between Private Standards and Public Policymaking for Robot Governance. Comput. Law Secur. Rev. 2019, 35, 129–144. [Google Scholar] [CrossRef]
  113. Zhou, Y. Research on Development and Problems of 3D Printing Technology under Intelligent Background. In Proceedings of the 2019 12th International Conference on Intelligent Computation Technology and Automation (ICICTA), Xiangtan, China, 26–27 October 2019; pp. 682–685. [Google Scholar]
  114. Shuaib, M.; Haleem, A.; Kumar, S.; Javaid, M. Impact of 3D Printing on the Environment: A Literature-Based Study. Sustain. Oper. Comput. 2021, 2, 57–63. [Google Scholar] [CrossRef]
  115. White Paper: Data, Digital Threads, and Industry 4.0. Available online: https://www.protolabs.com/resources/guides-and-trend-reports/data-digital-threads-and-industry-4-0/ (accessed on 16 October 2021).
  116. Berman, B. 3-D Printing: The New Industrial Revolution. Bus. Horiz. 2012, 55, 155–162. [Google Scholar] [CrossRef]
  117. Bonnard, R.; Hascoët, J.-Y.; Mognol, P. Data Model for Additive Manufacturing Digital Thread: State of the Art and Perspectives. Int. J. Comput. Integr. Manuf. 2019, 32, 1170–1191. [Google Scholar] [CrossRef]
  118. Noorani, R. 3D Printing: Technology, Applications, and Selection; CRC Press: Boca Raton, FL, USA, 2017; ISBN 978-1-4987-8376-7. [Google Scholar]
  119. Nordberg, A.; Schovsbo, J. EU Design Law and 3D Printing: Finding the Right Balance in a New e-Ecosystem; Social Science Research Network: Rochester, NY, USA, 2016. [Google Scholar]
  120. Maric, J.; Rodhain, F.; Barlette, Y. 3D Printing Trends and Discussing Societal, Environmental and Ethical Implications. Manag. Des. Technol. Organ. 2016, 6, 126–138. [Google Scholar]
  121. Moving into the Future with 3D Printing|ORNL. Available online: https://www.ornl.gov/blog/moving-future-3d-printing (accessed on 16 October 2021).
  122. EBSCOhost|133077531|Digital Business Value Creation with Robotic Process Automation (Rpa) in Northern and Central Europe. Available online: https://web.a.ebscohost.com/abstract?direct=true&profile=ehost&scope=site&authtype=crawler&jrnl=18544223&AN=133077531&h=3eWz5kdprDl%2f9%2fWXjD%2fl8N4OMY9Kgq%2ftnDYnWTbt18vE%2fDIbtpUvQHVX7PNgn8HXz%2fnul7%2b%2fg51dZfWfxM692A%3d%3d&crl=c&resultNs=AdminWebAuth&resultLocal=ErrCrlNotAuth&crlhashurl=login.aspx%3fdirect%3dtrue%26profile%3dehost%26scope%3dsite%26authtype%3dcrawler%26jrnl%3d18544223%26AN%3d133077531 (accessed on 7 October 2021).
  123. Top 7 RPA Uses & Challenges in the Government & Public Sector. Available online: https://research.aimultiple.com/rpa-government/ (accessed on 7 October 2021).
  124. Flechsig, C.; Anslinger, F.; Lasch, R. Robotic Process Automation in Purchasing and Supply Management: A Multiple Case Study on Potentials, Barriers, and Implementation. J. Purch. Supply Manag. 2021, 28, 100718. [Google Scholar] [CrossRef]
  125. Iatsyshyn, A.V.; Kovach, V.O.; Romanenko, Y.O.; Deinega, I.I.; Iatsyshyn, A.V.; Popov, O.O.; Kutsan, Y.G.; Artemchuk, V.O.; Burov, O.Y.; Lytvynova, S.H. Application of Augmented Reality Technologies for Preparation of Specialists of New Technological Era. In Proceedings of the 2nd International Workshop on Augmented Reality in Education, Kryvyi Rih, Ukraine, 22 March 2019; p. 20. [Google Scholar]
  126. Kim, J.-S.; Lee, S.-W. Study on How to Improve Visibility of Transparent Display for Augmented Reality under Various Environment Conditions. Opt. Express OE 2020, 28, 2060–2069. [Google Scholar] [CrossRef] [PubMed]
  127. Hardwick, F.S.; Akram, R.N.; Markantonakis, K. Fair and Transparent Blockchain Based Tendering Framework—A Step Towards Open Governance. arXiv 2018, arXiv:1805.05844. [Google Scholar]
  128. Bertrand Maltaverne 4 Reasons for Procurement to Back Blockchain. Available online: https://www.thedigitaltransformationpeople.com/channels/enabling-technologies/4-reasons-for-procurement-to-back-blockchain/ (accessed on 23 September 2021).
  129. Upadhyay, N. Demystifying Blockchain: A Critical Analysis of Challenges, Applications and Opportunities. Int. J. Inf. Manag. 2020, 54, 102120. [Google Scholar] [CrossRef]
  130. Walsh, C.; O’Reilly, P.; Gleasure, R.; McAvoy, J.; O’Leary, K. Understanding Manager Resistance to Blockchain Systems. Eur. Manag. J. 2021, 39, 353–365. [Google Scholar] [CrossRef]
  131. Wang, S.J.; Moriarty, P. Barriers to the Implementation of Big Data. In Big Data for Urban Sustainability; Springer International Publishing: Cham, Switzerland, 2018; pp. 65–80. ISBN 978-3-319-73608-2. [Google Scholar]
  132. Torres Berru, Y.; López Batista, V.F.; Torres-Carrión, P.; Jimenez, M.G. Artificial Intelligence Techniques to Detect and Prevent Corruption in Procurement: A Systematic Literature Review. In Proceedings of the Applied Technologies, Quito, Ecuador, 3–5 December 2019; Botto-Tobar, M., Zambrano Vizuete, M., Torres-Carrión, P., Montes León, S., Pizarro Vásquez, G., Durakovic, B., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 254–268. [Google Scholar]
  133. Deloitte Guidelines for AI Procurement in Government. Available online: https://www2.deloitte.com/global/en/pages/about-deloitte/articles/guidelines-for-ai-procurement-in-government.html (accessed on 24 September 2021).
  134. Munné, R. Big Data in the Public Sector. In New Horizons for a Data-Driven Economy: A Roadmap for Usage and Exploitation of Big Data in Europe; Cavanillas, J.M., Curry, E., Wahlster, W., Eds.; Springer International Publishing: Cham, Switzerland, 2016; pp. 195–208. ISBN 978-3-319-21569-3. [Google Scholar]
  135. Mikalef, P.; Boura, M.; Lekakos, G.; Krogstie, J. Big Data Analytics and Firm Performance: Findings from a Mixed-Method Approach. J. Bus. Res. 2019, 98, 261–276. [Google Scholar] [CrossRef]
  136. Choi, Y.; Lee, H.; Irani, Z. Big Data-Driven Fuzzy Cognitive Map for Prioritising IT Service Procurement in the Public Sector. Ann. Oper. Res. 2018, 270, 75–104. [Google Scholar] [CrossRef]
  137. Howson, C.; Richardson, J.; Sallam, R.; Kronz, A. Magic Quadrant for Analytics and Business Intelligence Platforms. 2019. Available online: https://cedar.princeton.edu/sites/g/files/toruqf1076/files/media/gartner_bi_comparison_2018.pdf (accessed on 5 October 2021).
  138. Magaireah, I.A.; HidayahSulaiman, H.; Ali, N. Identifying the Most Critical Factors to Business Intelligence Implementation Success in the Public Sector Organizations. TJSSR 2019, 450–462. [Google Scholar] [CrossRef]
  139. Cavanillas, J.M.; Curry, E.; Wahlster, W. (Eds.) New Horizons for a Data-Driven Economy; Springer International Publishing: Cham, Switzerland, 2016; ISBN 978-3-319-21568-6. [Google Scholar]
  140. Babica, V.; Sceulovs, D.; Rustenova, E. Digitalization of Public Procurement: Barriers for Innovation. In Proceedings of the 23rd World Multi-Conference on Systemics, Cybernetics and Informatics: WMSCI 2019, Orlando, FL, USA, 6–9 July 2019; p. 6. [Google Scholar]
  141. Sobczak, A.; Ziora, L. The Use of Robotic Process Automation (RPA) as an Element of Smart City Implementation: A Case Study of Electricity Billing Document Management at Bydgoszcz City Hall. Energies 2021, 14, 5191. [Google Scholar] [CrossRef]
  142. Gallego, J.; Rivero, G.; Martínez, J. Preventing Rather than Punishing: An Early Warning Model of Malfeasance in Public Procurement. Int. J. Forecast. 2021, 37, 360–377. [Google Scholar] [CrossRef] [PubMed]
  143. Mulligan, D.K.; Bamberger, K.A. Procurement as Policy: Administrative Process for Machine Learning. Berkeley Tech. L.J. 2019, 34, 773. [Google Scholar] [CrossRef]
  144. Crews, C. What Machine Learning Can Learn from Foresight: A Human-Centered Approach: For Machine Learning–Based Forecast Efforts to Succeed, They Must Embrace Lessons from Corporate Foresight to Address Human and Organizational Challenges. Res. Technol. Manag. 2019, 62, 30–33. [Google Scholar] [CrossRef]
  145. Public Procurement Conditions for Trustworthy AI and Algorithmic Systems. NGI. 2021. Available online: https://research.ngi.eu/public-procurement-conditions-for-trustworthy-ai-and-algorithmic-systems/ (accessed on 23 October 2021).
  146. Pang, Z.; Zheng, L.; Tian, J.; Kao-Walter, S.; Dubrova, E.; Chen, Q. Design of a Terminal Solution for Integration of In-Home Health Care Devices and Services towards the Internet-of-Things. Enterp. Inf. Syst. 2015, 9, 86–116. [Google Scholar] [CrossRef]
  147. Gomes, J.F.; Moqaddemerad, S. Futures Business Models for an IoT Enabled Healthcare Sector: A Causal Layered Analysis Perspective. J. Bus. Models 2016, 4, 60–80. [Google Scholar]
  148. He, L.; Xue, M.; Gu, B. Internet-of-Things Enabled Supply Chain Planning and Coordination with Big Data Services: Certain Theoretic Implications. J. Manag. Sci. Eng. 2020, 5, 1–22. [Google Scholar] [CrossRef]
  149. Brous, P.; Janssen, M.; Herder, P. Internet of Things Adoption for Reconfiguring Decision-Making Processes in Asset Management. Bus. Process Manag. J. 2019, 25, 495–511. [Google Scholar] [CrossRef]
  150. Uskenbayeva, R.; Kalpeyeva, Z.; Satybaldiyeva, R.; Moldagulova, A.; Kassymova, A. Applying of RPA in Administrative Processes of Public Administration. In Proceedings of the 2019 IEEE 21st Conference on Business Informatics (CBI), Moscow, Russia, 15–17 July 2019; Volume 2, pp. 9–12. [Google Scholar]
  151. Iwata, H.; Sugano, S. Human Robot Interference Adapting Control Coordinating Human Following and Task Execution. In Proceedings of the 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566), Sendai, Japan, 28 September–2 October 2004; Volume 3, pp. 2879–2885. [Google Scholar]
  152. Iansiti, M.; Lakhani, K.R. Harvard Business Review. 1 January 2017. Available online: https://hbr.org/2017/01/the-truth-about-blockchain (accessed on 23 September 2021).
  153. Lianos, I.; Hacker, P.; Eich, S.; Dimitropoulos, G. (Eds.) Regulating Blockchain: Techno-Social and Legal Challenges, 1st ed.; Oxford University Press: Oxford, UK, 2019; ISBN 978-0-19-884218-7. [Google Scholar]
  154. Jory Heckman HHS Blockchain-AI Project Gets Go-Ahead to Use Live Agency Acquisition Data. Available online: https://federalnewsnetwork.com/technology-main/2018/12/hhs-blockchain-ai-project-gets-go-ahead-to-use-live-agency-acquisition-data/ (accessed on 23 September 2021).
  155. Upadhyay, A.; Mukhuty, S.; Kumar, V.; Kazancoglu, Y. Blockchain Technology and the Circular Economy: Implications for Sustainability and Social Responsibility. J. Clean. Prod. 2021, 293, 126130. [Google Scholar] [CrossRef]
  156. Soria-Comas, J.; Domingo-Ferrer, J. Big Data Privacy: Challenges to Privacy Principles and Models. Data Sci. Eng. 2016, 1, 21–28. [Google Scholar] [CrossRef]
  157. Krishna Kagita, M. Security and Privacy Issues for Business Intelligence in LOT. In Proceedings of the 2019 IEEE 12th International Conference on Global Security, Safety and Sustainability (ICGS3), London, UK, 16–18 January 2019; pp. 206–212. [Google Scholar]
  158. OECD Skrinja (Chest): Using Emerging Technologies for Better Digital Public Services and Data Driven Decision Making in Slovenia. Observatory of Public Sector Innovation. Available online: https://oecd-opsi.org/innovations/skrinja-chest-using-emerging-technologies-for-better-digital-public-services-and-data-driven-decision-making-in-slovenia/ (accessed on 5 October 2021).
  159. Singh, V.; Srivastava, I.; Johri, V. Big Data and the Opportunities and Challenges for Government Agencies. Int. J. Comput. Sci. Inf. Technol. 2014, 5, 4. [Google Scholar]
  160. European Commission Building Trust in Human-Centric Artificial Intelligence. Available online: https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=CELEX%3A52019DC0168 (accessed on 20 October 2021).
  161. AboBakr, A.; Azer, M.A. IoT Ethics Challenges and Legal Issues. In Proceedings of the 2017 12th International Conference on Computer Engineering and Systems (ICCES), Cairo, Egypt, 19–20 December 2017; pp. 233–237. [Google Scholar]
  162. Arne Holst IoT Connected Devices by Vertical 2030. Available online: https://www.statista.com/statistics/1194682/iot-connected-devices-vertically/ (accessed on 3 October 2021).
  163. Legenvre, H.; Henke, M.; Ruile, H. Making Sense of the Impact of the Internet of Things on Purchasing and Supply Management:A Tension Perspective. J. Purch. Supply Manag. 2020, 26, 100596. [Google Scholar] [CrossRef]
  164. Man, L.C.K.; Na, C.M.; Kit, N.C. IoT-Based Asset Management System for Healthcare-Related Industries. Int. J. Eng. Bus. Manag. 2015, 7, 19. [Google Scholar] [CrossRef]
  165. Bibal, A.; Lognoul, M.; de Streel, A.; Frénay, B. Legal Requirements on Explainability in Machine Learning. Artif. Intell. Law 2021, 29, 149–169. [Google Scholar] [CrossRef]
  166. European Commission. Available online: https://ec.europa.eu/info/sites/default/files/commission-white-paper-artificial-intelligence-feb2020_en.pdf (accessed on 29 September 2021).
  167. Black, J.; Murray, A.D. Regulating AI and Machine Learning: Setting the Regulatory Agenda. Eur. J. Law Technol. 2019, 10. Available online: https://www.ejlt.org/index.php/ejlt/article/view/722 (accessed on 25 November 2021).
  168. Al-Qaseemi, S.A.; Almulhim, H.A.; Almulhim, M.F.; Chaudhry, S.R. IoT Architecture Challenges and Issues: Lack of Standardization. In Proceedings of the 2016 Future Technologies Conference (FTC), San Francisco, CA, USA, 6–7 December 2016; pp. 731–738. [Google Scholar]
  169. Micheli, M.; Scholten, H.; Ponti, M.; Craglia, M. Internet of Things: Implications for Governance. In Proceedings of the Internet of Things: Implications for Governance, Ljubljana, Slovenia, 13–14 May 2019. [Google Scholar]
  170. Gad-Elrab, A.A.A. Modern Business Intelligence: Big Data Analytics and Artificial Intelligence for Creating the Data-Driven Value; IntechOpen: London, UK, 2021; ISBN 978-1-78984-685-0. [Google Scholar]
  171. Megan, K. George; Kelly Ball Legal Risks of Virtual and Augmented Reality on the Construction Site—Real Estate and Construction—United States. Available online: https://www.mondaq.com/unitedstates/construction-planning/820886/legal-risks-of-virtual-and-augmented-reality-on-the-construction-site (accessed on 13 October 2021).
  172. Rehr, D.D.K.; Munteanu, D. The Promise of Robotic Process Automation for the Public Sector. 2021. Available online: https://cbce.gmu.edu/wp-content/uploads/2021/06/The-Promise-of-RPA-For-The-Public-Sector.pdf (accessed on 7 October 2021).
  173. Pernet, M. 3D Printing in Intellectual Property Law: A French Overview. 2019. Available online: https://hal.archives-ouvertes.fr/hal-02390179 (accessed on 16 October 2021).
  174. Chan, Y.E.; Reich, B.H. IT Alignment: What Have We Learned? J. Inf. Technol. 2007, 22, 297–315. [Google Scholar] [CrossRef]
  175. Amarilli, F. A Framework for Business IT Alignment in Turbulent Environments. AJTE 2014, 1, 103–118. [Google Scholar] [CrossRef]
  176. Denolf, J.M.; Trienekens, J.H.; Wognum, P.M.; Schütz, V.; van der Vorst, J.G.; Omta, S.W. “Actionable” Critical Success Factors for Supply Chain Information System Implementations. Int. J. Food Syst. Dyn. 2018, 9, 79–100. [Google Scholar] [CrossRef]
  177. Denolf, J.M.; Trienekens, J.H.; Wognum, P.M.; van der Vorst, J.G.; Omta, S.W.F. Towards a Framework of Critical Success Factors for Implementing Supply Chain Information Systems. Comput. Ind. 2015, 68, 16–26. [Google Scholar] [CrossRef]
  178. Ren, M. Why Technology Adoption Succeeds or Fails: An Exploration from the Perspective of Intra-Organizational Legitimacy. J. Chin. Sociol. 2019, 6, 21. [Google Scholar] [CrossRef]
  179. Wickham, R.J. Secondary Analysis Research. JADPRO 2019, 10, 395. [Google Scholar] [CrossRef]
  180. Awa, H.O.; Ukoha, O.; Emecheta, B.C. Using T-O-E Theoretical Framework to Study the Adoption of ERP Solution. Cogent Bus. Manag. 2016, 3, 1196571. [Google Scholar] [CrossRef]
  181. Mistry, V. Benchmarking E-learning: Trialling the “MIT90s” Framework. Benchmarking Int. J. 2008, 15, 326–340. [Google Scholar] [CrossRef]
  182. Coltman, T.; Tallon, P.; Sharma, R.; Queiroz, M. Strategic IT Alignment: Twenty-Five Years on. J. Inf. Technol. 2015, 30, 91–100. [Google Scholar] [CrossRef]
  183. Ustundag, A.; Cevikcan, E. Industry 4.0: Managing the Digital Transformation; Springer Series in Advanced Manufacturing; Springer International Publishing: Cham, Switzerland, 2018; ISBN 978-3-319-57869-9. [Google Scholar]
  184. Issa, A.; Hatiboglu, B.; Bildstein, A.; Bauernhansl, T. Industrie 4.0 Roadmap: Framework for Digital Transformation Based on the Concepts of Capability Maturity and Alignment. Procedia CIRP 2018, 72, 973–978. [Google Scholar] [CrossRef]
  185. Goo, J.J.; Heo, J.-Y. The Impact of the Regulatory Sandbox on the Fintech Industry, with a Discussion on the Relation between Regulatory Sandboxes and Open Innovation. J. Open Innov. Technol. Mark. Complex. 2020, 6, 43. [Google Scholar] [CrossRef]
  186. Dickinson, R.A.; Ferguson, C.R.; Sircar, S. Critical Success Factors and Small Business. Am. J. Small Bus. 1984, 8, 49–57. [Google Scholar] [CrossRef]
  187. Rockart, J.F. Harvard Business Review. 1 March 1979. Available online: https://hbr.org/1979/03/chief-executives-define-their-own-data-needs (accessed on 23 November 2021).
  188. Leidecker, J.K.; Bruno, A.V. Identifying and Using Critical Success Factors. Long Range Plan. 1984, 17, 23–32. [Google Scholar] [CrossRef]
  189. Harold, A. Linstone and Murray Turoff the Delphi Method: Techniques and Applications. 1975. Available online: https://web.archive.org/web/20080520015240/http://is.njit.edu/pubs/delphibook/ (accessed on 4 March 2021).
  190. Groenveld, P. Roadmapping Integrates Business and Technology. Res. Technol. Manag. 2007, 50, 49–58. [Google Scholar] [CrossRef]
  191. Levy, K.; Chasalow, K.; Riley, S. Algorithms and Decision-Making in the Public Sector. Annu. Rev. Law Soc. Sci. 2021, 17, 309–334. [Google Scholar] [CrossRef]
  192. De Coninck, B.; Viaene, S.; Leysen, J. Public Procurement of Innovation through Increased Startup Participation: The Case of Digipolis. In Proceedings of the Hawaii International Conference on System Science 2018, Waikoloa Village, HI, USA, 3–6 January 2018; ISBN 978-0-9981331-1-9. [Google Scholar]
  193. Tracing HHS Blockchain Adoption. Avascent 2021. Available online: https://www.avascent.com/news-insights/healthcare-pulse/tracing-hhs-blockchain-adoption/ (accessed on 23 September 2021).
  194. DSCSA Pilot Project Program. FDA. 2019. Available online: https://www.fda.gov/drugs/drug-supply-chain-security-act-dscsa/dscsa-pilot-project-program (accessed on 11 January 2022).
  195. Triana Casallas, J.A.; Cueva-Lovelle, J.M.; Rodríguez Molano, J.I. Smart Contracts with Blockchain in the Public Sector. IJIMAI 2020, 6, 63. [Google Scholar] [CrossRef]
  196. Deloitte MEDIAAN—Emerging Technologies in Public Procurement—Case Study; European Commission: Brussels, Belgium, 2020.
  197. DPAteam Belarus-OCDS-Transformation-and-Analytics 2021. Available online: https://github.com/DPAteam/Belarus-OCDS-Transformation-and-Analytics (accessed on 12 January 2022).
  198. Fazekas, M.; Toth, B.; Skuhrovec, J.; Hrubý, J.; Mendes, M. DIGIWHIST: The Digital Whistleblower 2018. Available online: https://digiwhist.eu/ (accessed on 27 September 2021).
  199. Early Warning Red Flags. Available online: https://ec.europa.eu/antifraud-knowledge-centre/library-good-practices-and-case-studies/good-practices/early-warning-red-flags_en (accessed on 27 September 2021).
  200. Red Flags. Available online: https://www.redflags.eu/ (accessed on 12 January 2022).
  201. OECD Fighting Bid Rigging in Brazil: A Review of Federal Public Procurement—OECD. Available online: https://www.oecd.org/competition/fighting-bid-rigging-in-brazil-a-review-of-federal-public-procurement.htm (accessed on 23 January 2022).
  202. ProZorro. Available online: http://prozorro.gov.ua/en (accessed on 5 October 2021).
  203. Nizhnikau, R. Love the Tender: ProZorro and Anti-Corruption Reforms after the Euromaidan Revolution. Probl. Post-Communism 2020, 69, 1–14. [Google Scholar] [CrossRef]
  204. Bugay, Y. ProZorro: How a Volunteer Project Led to Nation-Wide Procurement Reform in Ukraine. In 2020/21 KSP Policy Consultation Report; Open Contracting Partnership: Washington, DC, USA, 2016. [Google Scholar]
  205. UNA—The First Virtual Assistant of Public Administration in Latvia—Observatory of Public Sector Innovation Observatory of Public Sector Innovation. Available online: https://oecd-opsi.org/innovations/una-the-first-virtual-assistant-of-public-administration-in-latvia/ (accessed on 25 November 2021).
  206. YPO Helping You Navigate Procurement. Available online: https://www.ypo.co.uk/frameworks-home (accessed on 24 September 2021).
  207. Fraga-Lamas, P.; Fernández-Caramés, T.; Suárez-Albela, M.; Castedo, L.; González-López, M. A Review on Internet of Things for Defense and Public Safety. Sensors 2016, 16, 1644. [Google Scholar] [CrossRef] [Green Version]
  208. The Finnish Government Shared Services Centre for Finance and HR (Palkeet). Available online: https://www.palkeet.fi/en/ (accessed on 26 July 2022).
  209. Grace Dean Drones in Ghana Deliver COVID Vaccines to Rural Communities. Available online: https://www.businessinsider.com/covid-vaccine-ghana-drones-covax-who-coronavirus-zipline-rural-communities-2021-3 (accessed on 18 October 2021).
  210. Homleid, Å. Sambruksstasjon og Døgnhvileplass, Gol. Available online: https://www.bygg.no/article/1381510!/ (accessed on 13 October 2021).
  211. Augmented Reality, Urban Data and the|VTT News. Available online: https://www.vttresearch.com/en/news-and-ideas/augmented-reality-urban-data-and-related-opportunities (accessed on 13 October 2021).
  212. Anett Andreassen Digitalisering—Statsbygg. Available online: https://www.statsbygg.no/samfunnsansvar/digitalisering (accessed on 13 October 2021).
  213. DOD Believes Blockchain Can Boost 3-D Printing at the Front. Available online: https://gcn.com/cybersecurity/2017/05/dod-believes-blockchain-can-boost-3-d-printing-at-the-front/304800/ (accessed on 26 July 2022).
  214. BIDMC Physician-Scientists Spearhead Effort to Address Nationwide COVID-19 Testing Swab Shortage. Available online: https://www.bidmc.org/about-bidmc/news/2020/03/3d-printed-swabs (accessed on 26 July 2022).
  215. Quintanilla, G. Dutch Army Starts Cooperation with DiManEx. 2018. Available online: https://www.dimanex.com/2018/05/14/dutch-army-starts-cooperation-with-dimanex-to-solve-spare-part-supply-challenges-with-an-end-to-end-service-for-3d-manufacturing/ (accessed on 26 April 2022).
Figure 1. Research path.
Figure 1. Research path.
Sustainability 14 11252 g001
Figure 2. Simplifying the illustration of Table’s 3 results.
Figure 2. Simplifying the illustration of Table’s 3 results.
Sustainability 14 11252 g002
Table 1. Data collection method.
Table 1. Data collection method.
DatabasesScience Direct, IEEE Explore, Scopus, Google Scholar, and Web of Science
KeywordsIndustry 4.0, e-public procurement, Public Procurement, blockchain, of Business Intelligence, Machine Learning, and Artificial Intelligence, 3D Printing, Robots, Challenges, Barriers, TOE, Critical Success Factors
Document typeArticles, Books, Cases
Date2002>
LanguageEnglish
Initial search352
Provisional collection180 -abstract briefly reviewed
Selection criteriaNovelty, times cited, publication date, journal impact, relevance, pilot or full use
Selected articles122
Table 2. TOE framework e-public procurement 3.0 challenges/barriers.
Table 2. TOE framework e-public procurement 3.0 challenges/barriers.
TechnologicalOrganizationalEnvironmental
The system does not meet public authorities needs [58,59]Changing management issues such as organizational culture, a collaboration of different departments from the front office to the back office, and public institutions are inherently less flexible [33,60]A competitive environment induces mimicking behavior between the public authorities and businesses [14]
The system is complicated and unable to attract suppliers [58,59]Leadership and stakeholders lack engagement [20] due to sufficient funding and resources and the need for strong and committed leadership at the political level [33,61]Economic health vs. budget constraints [14]
Disruptive innovation-a new set of resources, processes, and values [62]Lack of project great pilots as an excellent paradigm [15]Strong corruption [63]
Electronic signatures: costly, complex, lack of interoperability, legal barriers, and limited support from service providers [64] Lack of well-trained and skilled personnel [15]The compulsory and political character of the regulatory framework [18]
IT security and authentication (confidentiality, integrity, and availability) [59,65]Users’ resistance to change because e-procurement will make their work more difficult and monotonous, and current roles will change [35,56,58]Political engagement
to guarantee enough funding [18]
Cyber security [20,66]Various stakeholders’ different needs, goals, and interests, as well as the realization of benefits of information systems in public procurement stakeholders [56,58,59]Social norms about innovations [56]
Interoperability [18,33]Business process reengineering
The inefficient and non-value-adding processes need to be cleaned up, while the mandatory procedures need to be optimized for e-use [35,58,59]
The size of the population and the high level of education [67]
Existing knowledge in IT [14]Organizational adjustments to secure critical private and confidential information [59]The involvement of small and medium enterprises in public procurement [68]
Business model (in-house or third party) and lack of coordination and standardization of processes [35]SMEs are responsible for innovation and flexible services [68]
Bureaucratic culture and practices [26]Availability of information to SME.s [69,70]
Lack of skills and capabilities by the stakeholders and especially the employees [71]The reduction of administrative burden and the increase of digitization [70]
Table 3. TOE framework e-public procurement 4.0 challenges/problems.
Table 3. TOE framework e-public procurement 4.0 challenges/problems.
TechnologicalOrganizationalEnvironmental
1. Simple technical implementation [28,79]
2. Integration with other digital technologies [80,81,82,83]
3. Cooperation with legacy systems [84,85,86,87]
4. Danger of lock-in [88,89]
5. Require existing digital procurement platforms to extract and transform data [90,91]
ease of use,
visual appeal analytic dashboards,
workflow integration
6. Good data. Quality, accuracy, and trustworthiness [92]
7. Process challenges about
data capturing, transformation and sharing integration [93]
8. Measuring corruption requires a proxy— a ‘corruption risk index’ (CRI) and proper patterns [7]
9. Quantum computing increases processing capacity
[94]
10. Proper infrastructure:
hardware, software, and license types must be adequately defined [95]. In-house production and support of AI systems [96]
11. Large, open, anonymized and standardized datasets are needed across the government [28,97,98].
12. Advanced algorithm construction for better results [99]
13. Ability to use real-time structure and unstructured training data [76,100]
14. Add new A&Qs to the Chabot regularly [28]
15. Analyze the capabilities of data infrastructure
Cyber security [101]
Define differences between
software-defined infrastructure (SDI) vs. AI-defined infrastructure [102]
16. Integrated data preprocessing [103]
17. Well-trained data scientists
18. Enriching the training data from the vendor market [104]
19.Technical transparency [105,106,107,108]
23. IT infrastructure must address security issues [109,110]
24.Managing heterogeneity: scalability, modularity, extensibility, and interoperability among heterogeneous things and their environments [109,111]
25.Endpoints/connected objects component (sensors–interfaces) [109]
26. Issues with the authenticity of the underlying data [100]
27. Robots need more clear information than humans [112]
28. Create algorithms that are adaptable enough to generate a simple and accurate 3D model for every type of building or construction [80]
29. Management of the continuous data volume increase [113,114,115]
30. Detailed technical information on components to be printed [116]
31. Delaminate parts-fused deposition modeling (FDM) [81,82,83,117]
32. Beware of inaccuracies in the product design process
33. Ensure post-processing requirements [118,119,120]
34.The raw material selection is not extensive [113,115,118]
35. Limit the size of the pieces that can be printed [28,83,121]
36.Deep analysis of the target process. Correctly identified use-cases for automation [122,123,124]
37. Give access to fresh data that can be studied and compared to current data to produce unique knowledge [125,126]
38. Need to build support for the project with internal stakeholders and users [84,127,128,129]
39. Overcome resistance to the use of emerging technologies [28,130]
40. Authorize access to data, and role distribution [131]
41. Organizations to own their data [90]
42. New roles need new training forms [94,96,132,133,134]
43. IT and non-IT users work properly together [135,136]. Non-technical public workers lack appropriate data and AI understanding [96]
44. Confirm the organizational structure’s quality,
talents,
experiences,
programs,
processes [137,138]
45. Project management focuses on data, not coding [94,138,139,140]
46. Lack of organization-wide adoption [138]. Creating and promoting a pro-innovative corporate culture among business/PA employees [141]
47. Compatible procurement policies and data expertise inside the public authority [133]
48. Check where the AI is the better solution [97]
49. Self-selection bias in data entry from the organizations [142]
50. Administrative processes building,
contestability,
human engagement,
integration of values [143]
51. Update models regularly to reflect changing situations and behaviors of contractors and civil servants [100,144]
52. Procedural transparency provides information about the purpose of the algorithmic system [106,143,145]
53. Adapt public procurement to IoT model [109]
54. Networking vendors. Interoperability and compatibility between them [146,147,148]
55. New abilities required and new organizational forms and procedures [149]
56. Check suitability:
high-volume processes,
high standardization,
rule-based tasks [150]
57. Manage physical interference and contact (PIFACT), humans with robots [151]
58. Create new positions and revise job descriptions [57]
59. Define and certify processes:
protocols, standards, and procedures [83]
60. Define staff qualification and certification [118]
61. Overcoming legal regulations regarding barriers and conflicts [84,152,153,154,155]
62. Privacy issues about data stored [134,156,157,158]
63. Lack of support from the government [134,159]
64. Legal ethics issues about personal data [160] use, sovereignty safety, equity, accountability, and lack of fairness [97,161,162,163,164]
65. Explainability: clear documentation about the working algorithm according to bias or ethical issues [94,143,165]
66. Combine human intelligence with the best of machine intelligence (i.e., human in/on the loop, human in command) [166]
67. Integrating machine learning system design with administrative law [143,167]
68. Lack of standards concerning, e.g., IoT technologies [110,168]
69. Expand the role of the public sector in governing data. Accessibility-flexibility accountability [134,169,170]
70. Manage thoughts and sentiments in opposition to automation, e.g., human workforce [123]
71. Liability for design errors, safety problems [112,141,171,172]
72. Intellectual property issues,
copyright protection,
patent protection,
design rights [173]
Table 4. Common problems/challenges in e-public procurement 3.0–4.0 (source: Table 2 and Table 3).
Table 4. Common problems/challenges in e-public procurement 3.0–4.0 (source: Table 2 and Table 3).
Common Problems/Challenges e-Public Procurement 3.0–4.0
TechnologicalOrganizationalEnvironmental
Complicated platforms-tools.
Usability and accessibility.
Change management strategy:
overcome resistance
overcome bureaucratic culture
Involvement, engagement, motivation for stakeholders, and the realization of benefits
Expand the public sector’s data governing in data security, personal data protection intellectual property issues
Inaccurate IT design on users’ needsTop management support
Vision
Resources
Training
Project management
Political decisions about providing
Resources
Infrastructures
Administrative law adaption
Interoperability-cooperation with legacy and 3.0 systems/platforms/toolsCollaboration between departments.
IT and non-IT staff
Security issues
IT (i.e., authentication)
Cyber
Anonymize personal data
Adapting to new roles and job descriptions
Requirement of new technical skills
The quality of structured data requires
Existing database
Compatible formats
Disruptive innovation characteristics
Table 5. Additional problems/challenges in e-public procurement 3.0–4.0 (source: Table 2 and Table 3).
Table 5. Additional problems/challenges in e-public procurement 3.0–4.0 (source: Table 2 and Table 3).
Additional Problems/Challenges in e Public Procurement 3.0–4.0
TechnologicalOrganizationalEnvironmental
Avoid “lock-in danger” from 4.0 proprietary technologiesNeed for a protocol to examine which technology is appropriate for each
organization
Procurement phase
Type of procurement
The legal framework in ethical issues:
Clear documentation about the working algorithm
Combine human intelligence with the best of machine intelligence
(i.e., human in/on the loop, human in command)
Manage unexpected-unwanted reactions
(e.g., by the bots)
Robots need more clear information than humans.
Business models are updated regularly to reflect the new learning inputs from the process (e.g., Machine Learning about fraud detection)Introduction of standardization in devices
(e.g., IoT) related to technologies 4.0
Find/create proper algorithms to discover patterns (e.g., fraud cases) (CRI).Higher level of automation workflows becoming more transparent, decentralized, and less hierarchicalData government policy issues
Limited access to critical databases (tax, insurance, business registries).Reallocation of the workforce:
Machine-to-machine communication (e.g., IoT, Bots).
Work without human intervention.
Self-monitoring systems
Interoperability, integration- between 4.0 technologies.Business process-reengineering
Discard unnecessary process
Optimize
Automate
Utilization of existing (i.e., EU’s) 3.0 tools as data sourcesCompulsory to digitize the process from end-to-end
Intra-organizational integration
Inter-organizational integration
Managing and analyzing unstructured data requires
skills (e.g., data science)
computing infrastructure and high- processing capacity,
data storage capacity
Availability of training data, e.g., vendor market, technical information and raw materials (e.g., 3D printing)
Manage difference between
Software-defined infrastructure, SDI based on developer-defined rules and
AI-defined infrastructure (AIDI) learning of its environment
Big datasets that cannot be gathered, stored, handled, or analyzed using standard software methods
Table 6. Classify problems and challenges in C.S.F by MIT90s framework.
Table 6. Classify problems and challenges in C.S.F by MIT90s framework.
Scott Morton’s ElementCSFChallenge Number Table 3
Project strategy1.Performance legitimacy [178]
Define clearly national transformation goals
2. Allocate sufficient funds to implement the transformation plan for
infrastructures
training and
supportive resources
4,6,11,27,34,35,36,46,48,56,57,63,67,68,69,70,72
Structure1. Task legitimacy [178]
2. Reengineer processes
3. Reform organizational structure
38,40,43,44,51,52,55,58,59,66
Information systems1. Evaluate the interoperability, integration, security, data quality, and efficiency of legacy IT Systems (e.g., PP platforms) with 4.0 technologies
2. Data Governing
1,2,3,4,5,6,9,10,12,13,14,19,23,25,26,28,30,37,41,45,47,49,62,64,65,66,69,72
PeopleValue Legitimacy [178]
Manage change resistance, relations, and deliver training
Protect fundamental democratic rights and ethical values
17,38,39,42,55,57,60,64,65,66,70,71,72
Management processes1. Manage legal reforms
2. Manage digital transformation tactics
3. Project management resources-requirement planning
6,7,8,13,15,16,17,23,24,29,31,32,33,37,43,46,47,50,51,52,53,54,61,64,65,66,67,70
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Mavidis, A.; Folinas, D. From Public E-Procurement 3.0 to E-Procurement 4.0; A Critical Literature Review. Sustainability 2022, 14, 11252. https://doi.org/10.3390/su141811252

AMA Style

Mavidis A, Folinas D. From Public E-Procurement 3.0 to E-Procurement 4.0; A Critical Literature Review. Sustainability. 2022; 14(18):11252. https://doi.org/10.3390/su141811252

Chicago/Turabian Style

Mavidis, Aristotelis, and Dimitris Folinas. 2022. "From Public E-Procurement 3.0 to E-Procurement 4.0; A Critical Literature Review" Sustainability 14, no. 18: 11252. https://doi.org/10.3390/su141811252

APA Style

Mavidis, A., & Folinas, D. (2022). From Public E-Procurement 3.0 to E-Procurement 4.0; A Critical Literature Review. Sustainability, 14(18), 11252. https://doi.org/10.3390/su141811252

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop