From Public E-Procurement 3.0 to E-Procurement 4.0; A Critical Literature Review
Abstract
:1. Introduction
2. Research Methodology
2.1. The Research Questions
2.2. Research Path
3. Comparing Public e-Procurement 3.0 and e-Procurement 4.0
3.1. The e-Public Procurement 3.0 Challenges by the TOE Framework Based on Literature Review
3.2. The e-Public Procurement 4.0 Challenges by TOE Framework Based on Case Studies
4. Comparative Analysis of Findings
4.1. Common and Additional Problems/Challenges e-Public Procurement 3.0–4.0
4.2. Classify Challenges and Barriers to MIT90s Critical Success Factors
5. Discussion
5.1. Theoretical Implications
5.2. Managerial Implications
5.3. Limitations
5.4. Implications for Future Studies
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Appendix A
Types of Technology | Case Study Name (Country) | Main Impact | Project Status | Collaboration with 3.0 Platforms | Concept |
---|---|---|---|---|---|
Blockchain | 1. Digipolis (Belgium) [192] | Transparency | In Development | Yes | Data backbone of trusted information |
2. HHS Accelerate project [154,193] (USA) | Decision-making | In use | Yes | Data management from legacy systems | |
3. F.D.A.’s D.S.C.S.A. Pilot Project Program (U.S.A.) [194] | Traceability | Pilot | Yes | Alerts from trusted network members | |
4. Smart Contract. Programa de Alimentación Escolar (PAE) (Spain) [84,195] | Decision-making | In use | Yes | Automated tender vendor evaluation | |
5. Blockchain-based Proposal Evaluation System (South Korea) [28] | Transparency | In use | Yes | Storing evaluation scores | |
Big data analytics Business Intelligence | 1. MEDIAAN (Belgium) [196] | Decision-making | In use | Yes | Price and cost analysis |
2. Public Procurement Price Panel (Brazil) [77] | Decision-making | In use | Yes | Price and cost analysis | |
3. Open Contracting Data Standard Transformation and Analytics (Belarus) [28,197] | Decision-making Transparency | In use | Yes | Analyze and visualize procurement data-patterns | |
4. DIGIWHIST project [198] | Reduce corruption Transparency | In use | Yes | Analyze and visualize procurement data | |
5. Red flags project (Hungary) [199,200] | Reduce corruption Transparency | In use | Yes | Prevention and detection of corrupt procurements | |
6. Price Panel (Brazil) [201] | Transparency | In use | Yes | Market analysis | |
7. Skrinja-Business Intelligence Project (Slovenia) [158] | Decision- making Transparency | In development | Yes | Analyze and visualize procurement data | |
Artificial Intelligence Machine Learning Chatbots | 1. ProZorro (Ukraine) [202,203,204] | Efficiency Transparency | Pilot | Yes | Analyze-monitor procurement data |
2. Categorization Artificial Intelligence Technology (CAITY) (Australia) [28,76] | Decision- making Transparency | In Use | Yes | Analyze-monitor procurement data | |
3. (i) Chat Bot UNA (Latvia) [205] | Efficiency | In Use | Yes | Procurement Information Provider | |
3. (ii) Chat Bot Y.P.O. (U.K.) [206] | Efficiency | In Use | Yes | Procurement Information Provider | |
4. Public Procurement Service (P.P.S.) (Republic of Korea) [28] | Efficiency | In Use | Yes | Predictive analysis | |
Internet of Things (IoT) | 1. Department of Defense (U.S.A.) IoT [207] | Efficiency | In Use | Yes | Analyze-monitor procurement data |
2. Smart Cities_ IoT Tampere platform (Finland) | Efficiency | Pilot | No | Analyze-monitor procurement data | |
Robotics RPA (Robotics Process Automation) Robots and Drones | 1. Palkeet (Finland) [208] 1. Ghanaian Health Service using drones for vaccines delivery [209] | Efficiency Transparency Efficiency-Security | (i) in use (ii) most in use in private sector | (i) Yes (ii) No | (i) automate transactional processes and rules-based tasks (ii) material handling, inspection, security |
Augment Reality and Virtual Reality | Digibygg project [210] Helsinki city council, Urban planning project [211] Statsbygg, Imerso pilot project [212] | Efficiency Transparency Accountability Decision-making | In use-pilot | Yes | Public construction planning visualization, Evaluating final project, Asset management and maintenance |
3D Printing | Department of Defense (U.S.A.) [213] Beth Israel Deaconess Medical Center [214] Material Stock Logistic Command of the Dutch Army [215] | Efficiency | In use | Yes | Manufacturing -prototypes -bottleneck periods -Additive |
References
- OECD. Reforming Public Procurement: Progress in Implementing the 2015 OECD Recommendation; OECD Public Governance Reviews; OECD: Paris, France, 2019; ISBN 978-92-64-89160-9. [Google Scholar]
- Thai, K.V. Public Procurement Re-Examined. J. Public Procure 2001, 1, 9–50. [Google Scholar] [CrossRef]
- Bosio, E.; Djankov, S.; Glaeser, E.; Shleifer, A. Public Procurement in Law and Practice; National Bureau of Economic Research: Cambridge, MA, USA, 2020; p. w27188. [Google Scholar]
- Hafner, M.; Taylor, J.; Disley, E.; Thebes, S.; Barberi, M.; Stepanek, M.; Levi, M. The Cost of Non-Europe in the Area of Organised Crime and Corruption: Annex II—Corruption; RAND Corporation: Santa Monica, CA, USA, 2016. [Google Scholar]
- Schwartz, G.; Fouad, M.; Hansen, T.; Verdier, G. (Eds.) Well Spent; International Monetary Fund: Washington, DC, USA, 2020; ISBN 978-1-5135-1181-8. [Google Scholar]
- Colonnelli, E.; Prem, M. Corruption and Firms. Rev. Econ. Stud. 2020, 89, 695–732. [Google Scholar] [CrossRef]
- Fazekas, M.; Kocsis, G. Uncovering High-Level Corruption: Cross-National Objective Corruption Risk Indicators Using Public Procurement Data. Br. J. Political Sci. 2020, 50, 155–164. [Google Scholar] [CrossRef]
- Zimmermann, S. Using Data and Transparency to Fight Corruption in Public Procurement. p. 17. Available online: http://www.oas.org/juridico/PDFs/mesicic5_intecolec_29_wb_zimmermann.pdf (accessed on 23 October 2021).
- Afolabi, A.; Ibem, E.; Aduwo, E.; Tunji-Olayeni, P. Digitizing the Grey Areas in the Nigerian Public Procurement System Using E-Procurement Technologies. Int. J. Constr. Manag. 2020, 2022, 1774836. [Google Scholar] [CrossRef]
- Matei, L.; Lazăr, C.-G. Quality Management and the Reform of Public Administration in Several States in South-Eastern Europe. Comp. Analysis. Theor. Appl. Econ. 2011, XVIII, 65–98. [Google Scholar]
- Vaidyanathan, G.; Devaraj, S. The Role of Quality in E-Procurement Performance: An Empirical Analysis. J. Oper. Manag. 2008, 26, 407–425. [Google Scholar] [CrossRef]
- Lewis-Faupel, S.; Neggers, Y.; Olken, B.A.; Pande, R. Can Electronic Procurement Improve Infrastructure Provision? Evidence from Public Works in India and Indonesia. Am. Econ. J. Econ. Policy 2016, 8, 258–283. [Google Scholar] [CrossRef]
- Pekolj, N.; Hodošček, K.; Valjavec, L.; Ferk, P. Digital Transformation of Public Procurement as an Opportunity for the Economy. LeXonomica 2019, 11, 15–42. [Google Scholar]
- Gasco, M.; Cucciniello, M.; Nasi, G.; Yuan, Q. Determinants and Barriers of E-Procurement: A European Comparison of Public Sector Experiences. In Proceedings of the 51st Hawaii International Conference on System Sciences, Hilton Waikoloa Village, HI, USA, 3–6 January 2018. [Google Scholar]
- Mohungoo, I.; Brown, I.; Kabanda, S. A Systematic Review of Implementation Challenges in Public E-Procurement. In Proceedings of the Responsible Design, Implementation and Use of Information and Communication Technology, Skukuza, South Africa, 6–8 April 2020; Volume 12067, pp. 46–58. [Google Scholar]
- Croom, S.; Brandon-Jones, A. Key Issues in E-Procurement: Procurement Implementation and Operation in the Public Sector. J. Public Procure 2005, 5, 367–387. [Google Scholar] [CrossRef]
- Croom, S.; Brandon-Jones, A. Impact of E-Procurement: Experiences from Implementation in the UK Public Sector. J. Purch. Supply Manag. 2007, 13, 294–303. [Google Scholar] [CrossRef]
- Panayiotou, N.A.; Gayialis, S.P.; Tatsiopoulos, I.P. An E-Procurement System for Governmental Purchasing. Int. J. Prod. Econ. 2004, 90, 79–102. [Google Scholar] [CrossRef]
- Croom, S.R. The Impact of Web-Based Procurement on the Management of Operating Resources Supply. J. Supply Chain Manag. 2000, 36, 4–13. [Google Scholar] [CrossRef]
- Vaidya, K.; Sajeev, A.; Callender, G. Critical Factors That Influence E-Procurement Implementation Success in the Public Sector. J. Public Procure. 2006, 6, 70–99. [Google Scholar] [CrossRef]
- Lee, J.; Bagheri, B.; Kao, H.-A. A Cyber-Physical Systems Architecture for Industry 4.0-Based Manufacturing Systems. Manuf. Lett. 2015, 3, 18–23. [Google Scholar] [CrossRef]
- Hwang, J.S. Intelligent Manufacturing. 2016, p. 4. Available online: https://www.jenniehwang.com/pdfs/industry4.pdf (accessed on 23 November 2021).
- Sung, T.K. Industry 4.0: A Korea Perspective. Technol. Forecast. Soc. Chang. 2018, 132, 40–45. [Google Scholar] [CrossRef]
- Tornatzky, L.G. The Processes of Technological Innovation; Lexington Books: Lexington, MA, USA, 1990; ISBN 978-0-669-20348-6. [Google Scholar]
- Kosmol, T.; Reimann, F.; Kaufmann, L. You’ll Never Walk Alone: Why We Need a Supply Chain Practice View on Digital Procurement. J. Purch. Supply Manag. 2019, 25, 100553. [Google Scholar] [CrossRef]
- Jonathan, G.M. Digital Transformation in the Public Sector: Identifying Critical Success Factors. In Information Systems; Themistocleous, M., Papadaki, M., Eds.; Lecture Notes in Business Information Processing; Springer International Publishing: Cham, Switzerland, 2020; Volume 381, pp. 223–235. ISBN 978-3-030-44321-4. [Google Scholar]
- OECD State of the Art in the Use of Emerging Technologies in the Public Sector; OECD Working Papers on Public Governance; OECD: Paris, France, 2019; Volume 31.
- Deloitte. European Commission Study on Up-Take of Emerging Technologies in Public Procurement. Available online: https://ec.europa.eu/docsroom/documents/40102 (accessed on 23 September 2021).
- Sun, T.; Sales, L.J. Predicting Public Procurement Irregularity: An Application of Neural Networks. J. Emerg. Technol. Account. 2018, 15, 141–154. [Google Scholar] [CrossRef]
- Sony, M.; Naik, S. Critical Factors for the Successful Implementation of Industry 4.0: A Review and Future Research Direction. Prod. Plan. Control. 2020, 31, 799–815. [Google Scholar] [CrossRef]
- Garay-Rondero, C.L.; Martinez-Flores, J.L.; Smith, N.R.; Caballero Morales, S.O.; Aldrette-Malacara, A. Digital Supply Chain Model in Industry 4.0. J. Manuf. Technol. Manag. 2020, 31, 887–933. [Google Scholar] [CrossRef]
- Büyüközkan, G.; Göçer, F. Digital Supply Chain: Literature Review and a Proposed Framework for Future Research. Comput. Ind. 2018, 97, 157–177. [Google Scholar] [CrossRef]
- Masudin, I.; Aprilia, G.D.; Nugraha, A.; Restuputri, D.P. Impact of E-Procurement Adoption on Company Performance: Evidence from Indonesian Manufacturing Industry. Logistics 2021, 5, 16. [Google Scholar] [CrossRef]
- Glas, D.A.H.; Kleemann, P.D.D. The Impact of Industry 4.0 on Procurement and Supply Management: A Conceptual and Qualitative Analysis. Available online: https://www.semanticscholar.org/paper/The-Impact-of-Industry-4-.-0-on-Procurement-and-%3A-A-Glas-Kleemann/cbeb003590eb09927fdb768bbeee8ef64cba49b0 (accessed on 23 November 2021).
- Vaidya, K.; Campbell, J. Multidisciplinary Approach to Defining Public E-Procurement and Evaluating Its Impact on Procurement Efficiency. Inf. Syst. Front. 2016, 18, 333–348. [Google Scholar] [CrossRef]
- Rockart, J.F.; Morton, M.S.S. Implications of Changes in Information Technology for Corporate Strategy. Interfaces 1984, 14, 84–95. [Google Scholar] [CrossRef]
- Kanama, D. Development of Technology Foresight: Integration of Technology Roadmapping and the Delphi Method. In Technology Roadmapping for Strategy and Innovation; Moehrle, M.G., Isenmann, R., Phaal, R., Eds.; Springer: Berlin/Heidelberg, Germany, 2013; pp. 151–171. ISBN 978-3-642-33922-6. [Google Scholar]
- Stuart, I.; McCutcheon, D.; Handfield, R.; McLachlin, R.; Samson, D. Effective Case Research in Operations Management: A Process Perspective. J. Oper. Manag. 2002, 20, 419–433. [Google Scholar] [CrossRef]
- Eisenhardt, K.M.; Graebner, M.E. Theory Building from Cases: Opportunities and Challenges. AMJ 2007, 50, 25–32. [Google Scholar] [CrossRef]
- Yin, R.K. Case Study Research Design and Methods Third Edition. Appl. Soc. Res. Methods Ser. 2003, 5, 109–122. [Google Scholar]
- Handfield, R.B.; Melnyk, S.A. The Scientific Theory-Building Process: A Primer Using the Case of TQM. J. Oper. Manag. 1998, 16, 321–339. [Google Scholar] [CrossRef]
- Merriam, S.B.; Tisdell, E.J. Qualitative Research: A Guide to Design and Implementation; John Wiley & Sons: Hoboken, NJ, USA, 2015; ISBN 978-1-119-00361-8. [Google Scholar]
- Rashid, D.Y.; Rashid, A.; Warraich, M.; Sabir, S.; Waseem, A. Case Study Method: A Step-by-Step Guide for Business Researchers. Int. J. Qual. Methods 2019, 18, 160940691986242. [Google Scholar] [CrossRef]
- Denzin, N.K.; Lincoln, Y.S. Introduction: The Discipline and Practice of Qualitative Research. In The Sage Handbook of Qualitative Research; Sage Publications Ltd.: Thousand Oaks, CA, USA, 2008. [Google Scholar]
- Jick, T.D. Mixing Qualitative and Quantitative Methods: Triangulation in Action. Adm. Sci. Q. 1979, 24, 602–611. [Google Scholar] [CrossRef]
- Maimbo, H.; Pervan, G. Designing a Case Study Protocol for Application in IS Research. In Proceedings of the PACIS, Bangkok, Thailand, 7–10 July 2005. [Google Scholar]
- Davis, F.D. A Technology Acceptance Model for Empirically Testing New End-User Information Systems: Theory and Results. Ph.D. Thesis, Massachusetts Institute of Technology, Cambridge, MA, USA, 1985. [Google Scholar]
- Venkatesh, V.; Davis, F.D. A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies. Manag. Sci. 2000, 46, 186–204. [Google Scholar] [CrossRef]
- Ajzen, I. The Theory of Planned Behavior. Organ. Behav. Hum. Decis. Processes 1991, 50, 179–211. [Google Scholar] [CrossRef]
- Rogers, E.M. Diffusion of Innovations, 4th ed.; Routledge: London, UK, 2010; ISBN 978-1-4516-0247-0. [Google Scholar]
- Zhu, K.; Kraemer, K.L.; Xu, S. The Process of Innovation Assimilation by Firms in Different Countries: A Technology Diffusion Perspective on E-Business. Manag. Sci. 2006, 52, 1557–1576. [Google Scholar] [CrossRef]
- Bellantuono, N.; Nuzzi, A.; Pontrandolfo, P.; Scozzi, B. Digital Transformation Models for the I4.0 Transition: Lessons from the Change Management Literature. Sustainability 2021, 13, 12941. [Google Scholar] [CrossRef]
- Baker, J. The Technology–Organization–Environment Framework. In Information Systems Theory: Explaining and Predicting Our Digital Society, Volume 1; Dwivedi, Y.K., Wade, M.R., Schneberger, S.L., Eds.; Integrated Series in Information Systems; Springer: New York, NY, USA, 2012; pp. 231–245. ISBN 978-1-4419-6108-2. [Google Scholar]
- De Alcantara, D.P.; Martens, M.L. Technology Roadmapping (TRM): A Systematic Review of the Literature Focusing on Models. Technol. Forecast. Soc. Chang. 2019, 138, 127–138. [Google Scholar] [CrossRef]
- Roman, A.; Mccue, C. E-Procurement: Myth or Reality. J. Public Procure. 2012, 12, 212. [Google Scholar] [CrossRef]
- Williams, S.P.; Hardy, C. Public EProcurement as Socio-Technical Change. Strat. Chang. 2005, 14, 273–281. [Google Scholar] [CrossRef]
- Christensen, C.M.; Overdorf, M. Meeting the Challenge of Disruptive Change. Harv. Bus. Rev. 2000, 78, 66–77. [Google Scholar]
- Nograšek, J. Change Management as a Critical Success Factor in E-Government Implementation. Bus. Syst. Res. J. 2012, 2, 13–24. [Google Scholar] [CrossRef]
- Moe, C.E.; Päivärinta, T. Challenges in Information Systems Procurement in the Public Sector. Electron. J. E-Gov. 2013, 11, 307–322. [Google Scholar]
- Williams-Elegbe, S. Beyond UNCITRAL: The Challenges of Procurement Reform Implementation in Africa. Stellenbosch Law Rev. 2014, 25, 209–224. [Google Scholar]
- Costa, A.A.; Arantes, A.; Valadares Tavares, L. Evidence of the Impacts of Public E-Procurement: The Portuguese Experience. J. Purch. Supply Manag. 2013, 19, 238–246. [Google Scholar] [CrossRef]
- Barahona, J.C.; Elizondo, A.M. The Disruptive Innovation Theory Applied to National Implementations of E-procurement. Electron. J. E-Gov. 2012, 10, 107–119. [Google Scholar]
- Rose, W.; Grant, G. Critical Issues Pertaining to the Planning and Implementation of E-Government Initiatives. Gov. Inf. Q. 2010, 27, 26–33. [Google Scholar] [CrossRef]
- Srivastava, A. Resistance to Change: Six Reasons Why Businesses Don’t Use e-Signatures. Electron. Commer. Res. 2011, 11, 357–382. [Google Scholar] [CrossRef]
- Conklin, A.; White, G.B. E-Government and Cyber Security: The Role of Cyber Security Exercises. In Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS’06), Kauai, HI, USA, 4–7 January 2006; Volume 4, p. 79b. [Google Scholar]
- Panda, D.; Sahu, G.P. E-Procurement Implementation: Critical Analysis of Success Factors’ Impact on Project Outcome; Social Science Research Network: Rochester, NY, USA, 2012. [Google Scholar]
- Al Athmay, A.A.A.R.A. Demographic Factors as Determinants of E-Governance Adoption: A Field Study in the United Arab Emirates (UAE). Transform. Gov. People Process Policy 2015, 9, 159–180. [Google Scholar] [CrossRef]
- Directorate-General for Internal Market, I.; de Bas, P.; Hausemer, P.; Kruger, T.; Rabuel, L.; de Vet, J.M.; Vincze, M. Analysis of the SMEs’ Participation in Public Procurement and the Measures to Support It: Final Report; Publications Office of the European Union: Luxembourg, 2019; ISBN 978-92-76-09142-4. [Google Scholar]
- European Commission. Directorate General for Internal Market, Industry, Entrepreneurship and SMEs.; t33. In SME Needs Analysis in Public Procurement: Final Report; Publications Office: Luxembourg, 2021. [Google Scholar]
- Tammi, T.; Reijonen, H.; Saastamoinen, J. E-Procurement and SME Involvement in Public Procurement of Innovations: An Exploratory Study. IJPM 2018, 11, 420. [Google Scholar] [CrossRef]
- Krogstie, J. Introduction of a Public Sector E-Procurement Solution: Lessons Learned from Disappointing Adoption. In Advances in Information Systems Research, Education and Practice; Avison, D., Kasper, G.M., Pernici, B., Ramos, I., Roode, D., Eds.; IFIP—The International Federation for Information Processing; Springer: Boston, MA, USA, 2008; Volume 274, pp. 203–214. ISBN 978-0-387-09681-0. [Google Scholar]
- Weking, J.; Stöcker, M.; Kowalkiewicz, M.; Böhm, M.; Krcmar, H. Leveraging Industry 4.0—A Business Model Pattern Framework. Int. J. Prod. Econ. 2020, 225, 107588. [Google Scholar] [CrossRef]
- Ray, S. The Difference Between Blockchains & Distributed Ledger Technology. Available online: https://towardsdatascience.com/the-difference-between-blockchains-distributed-ledger-technology-42715a0fa92 (accessed on 22 September 2021).
- Accenture, A. Accenture Technology Vision. 2019. Available online: https://www.accenture.com/_acnmedia/pdf-94/accenture-techvision-2019-tech-trends-report.pdf (accessed on 22 September 2021).
- Nicoletti, B. Procurement 4.0 and the Fourth Industrial Revolution: The Opportunities and Challenges of a Digital World; Springer Nature: Berlin/Heidelberg, Germany, 2020; ISBN 978-3-030-35979-9. [Google Scholar]
- World Bank Disruptive Technologies Can Provide Developing Countries with a Pathway to Revamp Their Public Procurement Processes. Available online: https://blogs.worldbank.org/governance/disruptive-technologies-can-provide-developing-countries-pathway-revamp-their-public (accessed on 26 September 2021).
- Deloitte. GROW.R.2.DIR Public Procurement Price Panel—Emerging Technologies in Public Procurement—Case Study. Available online: https://ec.europa.eu/docsroom/documents/39911?locale=el (accessed on 28 September 2021).
- Ferk, P. Can the Implementation of Full E-Procurement into Real Life Address the Real Challenges of EU Public Procurement? Eur. Procure. Public Priv. Partnersh. Law Rev. 2016, 11, 327–339. [Google Scholar] [CrossRef]
- Knirsch, F.; Unterweger, A.; Engel, D. Implementing a Blockchain from Scratch: Why, How, and What We Learned. EURASIP J. Inf. Secur. 2019, 2019, 2. [Google Scholar] [CrossRef]
- All 10 Million Buildings in the Netherlands Available as 3D Models. Available online: https://www.tudelft.nl/en/2021/bk/all-10-million-buildings-in-the-netherlands-available-as-3d-models (accessed on 13 October 2021).
- Bui, K. 3D Printing Presents a Faster Path to Innovation. Available online: https://www.tctmagazine.com/api/content/94c24500-f602-11eb-acf0-1244d5f7c7c6/ (accessed on 17 October 2021).
- Ishchenko, N. Global Material Supply Chain: Procurement Database for 3D Printing Construction Projects. Available online: http://www.theseus.fi/handle/10024/467476 (accessed on 16 October 2021).
- Katkar, R.; Geha, H. Emerging Imaging Technologies in Dento-Maxillofacial Region, an Issue of Dental Clinics of North America; Elsevier: Amsterdam, The Netherlands, 2018; ISBN 978-0-323-61077-3. [Google Scholar]
- Sanchez, S.N. The Implementation of Decentralised Ledger Technologies for Public Procurement: Blockchain Based Smart Public Contracts. Eur. Procure. Pub. Priv. Partnersh. L. Rev. 2019, 14, 180. [Google Scholar]
- Gohil, D.; Thakker, S.V. Blockchain-Integrated Technologies for Solving Supply Chain Challenges. Mod. Supply Chain Res. Appl. 2021, 3, 78–97. [Google Scholar] [CrossRef]
- Centre for the Fourth Industrial Revolution. Bridging the Governance Gap: Interoperability for Blockchain and Legacy Systems; World Economic Forum: Cologny, Switzerland, 2020. [Google Scholar]
- Briggs, R.; Dul, J.; Mariani, J.; Kishnani, P.K. Digital Reality in Government. Available online: https://www2.deloitte.com/us/en/insights/industry/public-sector/augmented-virtual-reality-government-services.html (accessed on 13 October 2021).
- Adam, I.; Fazekas, M. Big Data Analytics as a Tool for Auditors to Identify and Prevent Fraud and Corruption in Public Procurement. Eur. Court. Audit. J. 2019, 2, 172–179. [Google Scholar]
- kingmesal Vendor Lock-In and the Big Data Ecosystem—What Does It Really Mean? SmartData Collective 2016. Available online: https://www.smartdatacollective.com/vendor-lock-and-big-data-ecosystem-what-does-it-really-mean/ (accessed on 24 November 2021).
- Moretto, A.; Ronchi, S.; Patrucco, A.S. Increasing the Effectiveness of Procurement Decisions: The Value of Big Data in the Procurement Process. Int. J. RF Technol. 2017, 8, 79–103. [Google Scholar] [CrossRef]
- Al-Jaroodi, J.; Mohamed, N. Characteristics and Requirements of Big Data Analytics Applications. In Proceedings of the 2016 IEEE 2nd International Conference on Collaboration and Internet Computing (CIC), Pittsburgh, PA, USA, 1–3 November 2016; pp. 426–432. [Google Scholar]
- Hartley, K.; Seymour, L.F.; Seymour, L. Towards a Framework for the Adoption of Business Intelligence in Public Sector Organisations: The Case of South Africa. In Proceedings of the South African Institute of Computer Scientists and Information Technologists Conference on Knowledge, Innovation and Leadership in a Diverse, Multidisciplinary Environment, Cape Town, South Africa, 3–5 October 2011. [Google Scholar]
- Sivarajah, U.; Kamal, M.M.; Irani, Z.; Weerakkody, V. Critical Analysis of Big Data Challenges and Analytical Methods. J. Bus. Res. 2017, 70, 263–286. [Google Scholar] [CrossRef]
- Publications Office of the European. COM/2020/65 Final, WHITE PAPER on Artificial Intelligence—A European Approach to Excellence and Trust. Available online: http://op.europa.eu/en/publication-detail/-/publication/ac957f13-53c6-11ea-aece-01aa75ed71a1 (accessed on 14 October 2021).
- Rane, S.B.; Narvel, Y.A.M.; Bhandarkar, B.M. Developing Strategies to Improve Agility in the Project Procurement Management (PPM) Process: Perspective of Business Intelligence (BI). Bus. Process Manag. J. 2019, 26, 257–286. [Google Scholar] [CrossRef]
- Surya, L. Artificial Intelligence in Public Sector; Social Science Research Network: Rochester, NY, USA, 2019. [Google Scholar]
- McBride, K.; van Noordt, C.; Misuraca, G.; Hammerschmid, G. Towards a Systematic Understanding on the Challenges of Procuring Artificial Intelligence in the Public Sector. 2021. Available online: https://osf.io/preprints/socarxiv/un649/ (accessed on 24 September 2021).
- Goldenfein, J. Algorithmic Transparency and Decision-Making Accountability: Thoughts for Buying Machine Learning Algorithms; Social Science Research Network: Rochester, NY, USA, 2019. [Google Scholar]
- Veale, M.; Brass, I. Administration by Algorithm? Public Management Meets Public Sector Machine Learning; Social Science Research Network: Rochester, NY, USA, 2019. [Google Scholar]
- García Rodríguez, M.J.; Rodríguez Montequín, V.; Ortega Fernández, F.; Villanueva Balsera, J.M. Public Procurement Announcements in Spain: Regulations, Data Analysis, and Award Price Estimator Using Machine Learning. Complexity 2019, 2019, e2360610. [Google Scholar] [CrossRef]
- Zeadally, S.; Adi, E.; Baig, Z.; Khan, I.A. Harnessing Artificial Intelligence Capabilities to Improve Cybersecurity. IEEE Access 2020, 8, 23817–23837. [Google Scholar] [CrossRef]
- Betigiri, V. Artificial Intelligence (AI) Driven Infrastructure. Medium 2018. Available online: https://medium.com/@vijay.betigiri/ai-defined-enterprise-it-a662b4fd9ca8 (accessed on 25 November 2021).
- García Rodríguez, M.J.; Rodríguez Montequín, V.; Ortega Fernández, F.; Villanueva Balsera, J.M. Bidders Recommender for Public Procurement Auctions Using Machine Learning: Data Analysis, Algorithm, and Case Study with Tenders from Spain. Complexity 2020, 2020, e8858258. [Google Scholar] [CrossRef]
- De Blasio, G.; D’Ignazio, A.; Letta, M. Predicting Corruption Crimes with Machine Learning. A Study for the Italian Municipalities. Available online: http://www.diss.uniroma1.it/sites/default/files/allegati/DiSSE_deBlasioetal_wp16_2020.pdf (accessed on 25 November 2021).
- Popa, M. Uncovering the Structure of Public Procurement Transactions. Bus. Politics 2019, 21, 351–384. [Google Scholar] [CrossRef] [Green Version]
- Ash, E.; Galletta, S.; Giommoni, T. A Machine Learning Approach to Analyzing Corruption in Local Public Finances. Cent. Law Econ. Work. Pap. Ser. 2020, 6, 35. [Google Scholar] [CrossRef]
- Seibel, R. Collusion by Exclusion in Public Procurement. Available online: https://samuelskoda.github.io/assets/pdf/collusion.pdf (accessed on 25 September 2021).
- CAHAI Artificial Intelligence in Public Sector. Available online: https://rm.coe.int/cahai-pdg-2021-03-subwg2-ai-in-public-sector-final-draft-12032021-2751/1680a1c066 (accessed on 23 October 2021).
- Wirtz, B.W.; Weyerer, J.C.; Schichtel, F.T. An Integrative Public IoT Framework for Smart Government. Gov. Inf. Q. 2019, 36, 333–345. [Google Scholar] [CrossRef]
- Brass, I.; Tanczer, L.; Carr, M.; Elsden, M.; Blackstock, J. Standardising a Moving Target: The Development and Evolution of IoT Security Standards. In Proceedings of the Living the Internet of Things: Cybersecurity of the IoT—2018, London, UK, 28–29 March 2018. [Google Scholar]
- Bandyopadhyay, D.; Sen, J. Internet of Things: Applications and Challenges in Technology and Standardization. Wirel. Pers. Commun. 2011, 58, 49–69. [Google Scholar] [CrossRef]
- Fosch Villaronga, E.; Golia, A.J. Robots, Standards and the Law: Rivalries between Private Standards and Public Policymaking for Robot Governance. Comput. Law Secur. Rev. 2019, 35, 129–144. [Google Scholar] [CrossRef]
- Zhou, Y. Research on Development and Problems of 3D Printing Technology under Intelligent Background. In Proceedings of the 2019 12th International Conference on Intelligent Computation Technology and Automation (ICICTA), Xiangtan, China, 26–27 October 2019; pp. 682–685. [Google Scholar]
- Shuaib, M.; Haleem, A.; Kumar, S.; Javaid, M. Impact of 3D Printing on the Environment: A Literature-Based Study. Sustain. Oper. Comput. 2021, 2, 57–63. [Google Scholar] [CrossRef]
- White Paper: Data, Digital Threads, and Industry 4.0. Available online: https://www.protolabs.com/resources/guides-and-trend-reports/data-digital-threads-and-industry-4-0/ (accessed on 16 October 2021).
- Berman, B. 3-D Printing: The New Industrial Revolution. Bus. Horiz. 2012, 55, 155–162. [Google Scholar] [CrossRef]
- Bonnard, R.; Hascoët, J.-Y.; Mognol, P. Data Model for Additive Manufacturing Digital Thread: State of the Art and Perspectives. Int. J. Comput. Integr. Manuf. 2019, 32, 1170–1191. [Google Scholar] [CrossRef]
- Noorani, R. 3D Printing: Technology, Applications, and Selection; CRC Press: Boca Raton, FL, USA, 2017; ISBN 978-1-4987-8376-7. [Google Scholar]
- Nordberg, A.; Schovsbo, J. EU Design Law and 3D Printing: Finding the Right Balance in a New e-Ecosystem; Social Science Research Network: Rochester, NY, USA, 2016. [Google Scholar]
- Maric, J.; Rodhain, F.; Barlette, Y. 3D Printing Trends and Discussing Societal, Environmental and Ethical Implications. Manag. Des. Technol. Organ. 2016, 6, 126–138. [Google Scholar]
- Moving into the Future with 3D Printing|ORNL. Available online: https://www.ornl.gov/blog/moving-future-3d-printing (accessed on 16 October 2021).
- EBSCOhost|133077531|Digital Business Value Creation with Robotic Process Automation (Rpa) in Northern and Central Europe. Available online: https://web.a.ebscohost.com/abstract?direct=true&profile=ehost&scope=site&authtype=crawler&jrnl=18544223&AN=133077531&h=3eWz5kdprDl%2f9%2fWXjD%2fl8N4OMY9Kgq%2ftnDYnWTbt18vE%2fDIbtpUvQHVX7PNgn8HXz%2fnul7%2b%2fg51dZfWfxM692A%3d%3d&crl=c&resultNs=AdminWebAuth&resultLocal=ErrCrlNotAuth&crlhashurl=login.aspx%3fdirect%3dtrue%26profile%3dehost%26scope%3dsite%26authtype%3dcrawler%26jrnl%3d18544223%26AN%3d133077531 (accessed on 7 October 2021).
- Top 7 RPA Uses & Challenges in the Government & Public Sector. Available online: https://research.aimultiple.com/rpa-government/ (accessed on 7 October 2021).
- Flechsig, C.; Anslinger, F.; Lasch, R. Robotic Process Automation in Purchasing and Supply Management: A Multiple Case Study on Potentials, Barriers, and Implementation. J. Purch. Supply Manag. 2021, 28, 100718. [Google Scholar] [CrossRef]
- Iatsyshyn, A.V.; Kovach, V.O.; Romanenko, Y.O.; Deinega, I.I.; Iatsyshyn, A.V.; Popov, O.O.; Kutsan, Y.G.; Artemchuk, V.O.; Burov, O.Y.; Lytvynova, S.H. Application of Augmented Reality Technologies for Preparation of Specialists of New Technological Era. In Proceedings of the 2nd International Workshop on Augmented Reality in Education, Kryvyi Rih, Ukraine, 22 March 2019; p. 20. [Google Scholar]
- Kim, J.-S.; Lee, S.-W. Study on How to Improve Visibility of Transparent Display for Augmented Reality under Various Environment Conditions. Opt. Express OE 2020, 28, 2060–2069. [Google Scholar] [CrossRef] [PubMed]
- Hardwick, F.S.; Akram, R.N.; Markantonakis, K. Fair and Transparent Blockchain Based Tendering Framework—A Step Towards Open Governance. arXiv 2018, arXiv:1805.05844. [Google Scholar]
- Bertrand Maltaverne 4 Reasons for Procurement to Back Blockchain. Available online: https://www.thedigitaltransformationpeople.com/channels/enabling-technologies/4-reasons-for-procurement-to-back-blockchain/ (accessed on 23 September 2021).
- Upadhyay, N. Demystifying Blockchain: A Critical Analysis of Challenges, Applications and Opportunities. Int. J. Inf. Manag. 2020, 54, 102120. [Google Scholar] [CrossRef]
- Walsh, C.; O’Reilly, P.; Gleasure, R.; McAvoy, J.; O’Leary, K. Understanding Manager Resistance to Blockchain Systems. Eur. Manag. J. 2021, 39, 353–365. [Google Scholar] [CrossRef]
- Wang, S.J.; Moriarty, P. Barriers to the Implementation of Big Data. In Big Data for Urban Sustainability; Springer International Publishing: Cham, Switzerland, 2018; pp. 65–80. ISBN 978-3-319-73608-2. [Google Scholar]
- Torres Berru, Y.; López Batista, V.F.; Torres-Carrión, P.; Jimenez, M.G. Artificial Intelligence Techniques to Detect and Prevent Corruption in Procurement: A Systematic Literature Review. In Proceedings of the Applied Technologies, Quito, Ecuador, 3–5 December 2019; Botto-Tobar, M., Zambrano Vizuete, M., Torres-Carrión, P., Montes León, S., Pizarro Vásquez, G., Durakovic, B., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 254–268. [Google Scholar]
- Deloitte Guidelines for AI Procurement in Government. Available online: https://www2.deloitte.com/global/en/pages/about-deloitte/articles/guidelines-for-ai-procurement-in-government.html (accessed on 24 September 2021).
- Munné, R. Big Data in the Public Sector. In New Horizons for a Data-Driven Economy: A Roadmap for Usage and Exploitation of Big Data in Europe; Cavanillas, J.M., Curry, E., Wahlster, W., Eds.; Springer International Publishing: Cham, Switzerland, 2016; pp. 195–208. ISBN 978-3-319-21569-3. [Google Scholar]
- Mikalef, P.; Boura, M.; Lekakos, G.; Krogstie, J. Big Data Analytics and Firm Performance: Findings from a Mixed-Method Approach. J. Bus. Res. 2019, 98, 261–276. [Google Scholar] [CrossRef]
- Choi, Y.; Lee, H.; Irani, Z. Big Data-Driven Fuzzy Cognitive Map for Prioritising IT Service Procurement in the Public Sector. Ann. Oper. Res. 2018, 270, 75–104. [Google Scholar] [CrossRef]
- Howson, C.; Richardson, J.; Sallam, R.; Kronz, A. Magic Quadrant for Analytics and Business Intelligence Platforms. 2019. Available online: https://cedar.princeton.edu/sites/g/files/toruqf1076/files/media/gartner_bi_comparison_2018.pdf (accessed on 5 October 2021).
- Magaireah, I.A.; HidayahSulaiman, H.; Ali, N. Identifying the Most Critical Factors to Business Intelligence Implementation Success in the Public Sector Organizations. TJSSR 2019, 450–462. [Google Scholar] [CrossRef]
- Cavanillas, J.M.; Curry, E.; Wahlster, W. (Eds.) New Horizons for a Data-Driven Economy; Springer International Publishing: Cham, Switzerland, 2016; ISBN 978-3-319-21568-6. [Google Scholar]
- Babica, V.; Sceulovs, D.; Rustenova, E. Digitalization of Public Procurement: Barriers for Innovation. In Proceedings of the 23rd World Multi-Conference on Systemics, Cybernetics and Informatics: WMSCI 2019, Orlando, FL, USA, 6–9 July 2019; p. 6. [Google Scholar]
- Sobczak, A.; Ziora, L. The Use of Robotic Process Automation (RPA) as an Element of Smart City Implementation: A Case Study of Electricity Billing Document Management at Bydgoszcz City Hall. Energies 2021, 14, 5191. [Google Scholar] [CrossRef]
- Gallego, J.; Rivero, G.; Martínez, J. Preventing Rather than Punishing: An Early Warning Model of Malfeasance in Public Procurement. Int. J. Forecast. 2021, 37, 360–377. [Google Scholar] [CrossRef] [PubMed]
- Mulligan, D.K.; Bamberger, K.A. Procurement as Policy: Administrative Process for Machine Learning. Berkeley Tech. L.J. 2019, 34, 773. [Google Scholar] [CrossRef]
- Crews, C. What Machine Learning Can Learn from Foresight: A Human-Centered Approach: For Machine Learning–Based Forecast Efforts to Succeed, They Must Embrace Lessons from Corporate Foresight to Address Human and Organizational Challenges. Res. Technol. Manag. 2019, 62, 30–33. [Google Scholar] [CrossRef]
- Public Procurement Conditions for Trustworthy AI and Algorithmic Systems. NGI. 2021. Available online: https://research.ngi.eu/public-procurement-conditions-for-trustworthy-ai-and-algorithmic-systems/ (accessed on 23 October 2021).
- Pang, Z.; Zheng, L.; Tian, J.; Kao-Walter, S.; Dubrova, E.; Chen, Q. Design of a Terminal Solution for Integration of In-Home Health Care Devices and Services towards the Internet-of-Things. Enterp. Inf. Syst. 2015, 9, 86–116. [Google Scholar] [CrossRef]
- Gomes, J.F.; Moqaddemerad, S. Futures Business Models for an IoT Enabled Healthcare Sector: A Causal Layered Analysis Perspective. J. Bus. Models 2016, 4, 60–80. [Google Scholar]
- He, L.; Xue, M.; Gu, B. Internet-of-Things Enabled Supply Chain Planning and Coordination with Big Data Services: Certain Theoretic Implications. J. Manag. Sci. Eng. 2020, 5, 1–22. [Google Scholar] [CrossRef]
- Brous, P.; Janssen, M.; Herder, P. Internet of Things Adoption for Reconfiguring Decision-Making Processes in Asset Management. Bus. Process Manag. J. 2019, 25, 495–511. [Google Scholar] [CrossRef]
- Uskenbayeva, R.; Kalpeyeva, Z.; Satybaldiyeva, R.; Moldagulova, A.; Kassymova, A. Applying of RPA in Administrative Processes of Public Administration. In Proceedings of the 2019 IEEE 21st Conference on Business Informatics (CBI), Moscow, Russia, 15–17 July 2019; Volume 2, pp. 9–12. [Google Scholar]
- Iwata, H.; Sugano, S. Human Robot Interference Adapting Control Coordinating Human Following and Task Execution. In Proceedings of the 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566), Sendai, Japan, 28 September–2 October 2004; Volume 3, pp. 2879–2885. [Google Scholar]
- Iansiti, M.; Lakhani, K.R. Harvard Business Review. 1 January 2017. Available online: https://hbr.org/2017/01/the-truth-about-blockchain (accessed on 23 September 2021).
- Lianos, I.; Hacker, P.; Eich, S.; Dimitropoulos, G. (Eds.) Regulating Blockchain: Techno-Social and Legal Challenges, 1st ed.; Oxford University Press: Oxford, UK, 2019; ISBN 978-0-19-884218-7. [Google Scholar]
- Jory Heckman HHS Blockchain-AI Project Gets Go-Ahead to Use Live Agency Acquisition Data. Available online: https://federalnewsnetwork.com/technology-main/2018/12/hhs-blockchain-ai-project-gets-go-ahead-to-use-live-agency-acquisition-data/ (accessed on 23 September 2021).
- Upadhyay, A.; Mukhuty, S.; Kumar, V.; Kazancoglu, Y. Blockchain Technology and the Circular Economy: Implications for Sustainability and Social Responsibility. J. Clean. Prod. 2021, 293, 126130. [Google Scholar] [CrossRef]
- Soria-Comas, J.; Domingo-Ferrer, J. Big Data Privacy: Challenges to Privacy Principles and Models. Data Sci. Eng. 2016, 1, 21–28. [Google Scholar] [CrossRef]
- Krishna Kagita, M. Security and Privacy Issues for Business Intelligence in LOT. In Proceedings of the 2019 IEEE 12th International Conference on Global Security, Safety and Sustainability (ICGS3), London, UK, 16–18 January 2019; pp. 206–212. [Google Scholar]
- OECD Skrinja (Chest): Using Emerging Technologies for Better Digital Public Services and Data Driven Decision Making in Slovenia. Observatory of Public Sector Innovation. Available online: https://oecd-opsi.org/innovations/skrinja-chest-using-emerging-technologies-for-better-digital-public-services-and-data-driven-decision-making-in-slovenia/ (accessed on 5 October 2021).
- Singh, V.; Srivastava, I.; Johri, V. Big Data and the Opportunities and Challenges for Government Agencies. Int. J. Comput. Sci. Inf. Technol. 2014, 5, 4. [Google Scholar]
- European Commission Building Trust in Human-Centric Artificial Intelligence. Available online: https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=CELEX%3A52019DC0168 (accessed on 20 October 2021).
- AboBakr, A.; Azer, M.A. IoT Ethics Challenges and Legal Issues. In Proceedings of the 2017 12th International Conference on Computer Engineering and Systems (ICCES), Cairo, Egypt, 19–20 December 2017; pp. 233–237. [Google Scholar]
- Arne Holst IoT Connected Devices by Vertical 2030. Available online: https://www.statista.com/statistics/1194682/iot-connected-devices-vertically/ (accessed on 3 October 2021).
- Legenvre, H.; Henke, M.; Ruile, H. Making Sense of the Impact of the Internet of Things on Purchasing and Supply Management:A Tension Perspective. J. Purch. Supply Manag. 2020, 26, 100596. [Google Scholar] [CrossRef]
- Man, L.C.K.; Na, C.M.; Kit, N.C. IoT-Based Asset Management System for Healthcare-Related Industries. Int. J. Eng. Bus. Manag. 2015, 7, 19. [Google Scholar] [CrossRef]
- Bibal, A.; Lognoul, M.; de Streel, A.; Frénay, B. Legal Requirements on Explainability in Machine Learning. Artif. Intell. Law 2021, 29, 149–169. [Google Scholar] [CrossRef]
- European Commission. Available online: https://ec.europa.eu/info/sites/default/files/commission-white-paper-artificial-intelligence-feb2020_en.pdf (accessed on 29 September 2021).
- Black, J.; Murray, A.D. Regulating AI and Machine Learning: Setting the Regulatory Agenda. Eur. J. Law Technol. 2019, 10. Available online: https://www.ejlt.org/index.php/ejlt/article/view/722 (accessed on 25 November 2021).
- Al-Qaseemi, S.A.; Almulhim, H.A.; Almulhim, M.F.; Chaudhry, S.R. IoT Architecture Challenges and Issues: Lack of Standardization. In Proceedings of the 2016 Future Technologies Conference (FTC), San Francisco, CA, USA, 6–7 December 2016; pp. 731–738. [Google Scholar]
- Micheli, M.; Scholten, H.; Ponti, M.; Craglia, M. Internet of Things: Implications for Governance. In Proceedings of the Internet of Things: Implications for Governance, Ljubljana, Slovenia, 13–14 May 2019. [Google Scholar]
- Gad-Elrab, A.A.A. Modern Business Intelligence: Big Data Analytics and Artificial Intelligence for Creating the Data-Driven Value; IntechOpen: London, UK, 2021; ISBN 978-1-78984-685-0. [Google Scholar]
- Megan, K. George; Kelly Ball Legal Risks of Virtual and Augmented Reality on the Construction Site—Real Estate and Construction—United States. Available online: https://www.mondaq.com/unitedstates/construction-planning/820886/legal-risks-of-virtual-and-augmented-reality-on-the-construction-site (accessed on 13 October 2021).
- Rehr, D.D.K.; Munteanu, D. The Promise of Robotic Process Automation for the Public Sector. 2021. Available online: https://cbce.gmu.edu/wp-content/uploads/2021/06/The-Promise-of-RPA-For-The-Public-Sector.pdf (accessed on 7 October 2021).
- Pernet, M. 3D Printing in Intellectual Property Law: A French Overview. 2019. Available online: https://hal.archives-ouvertes.fr/hal-02390179 (accessed on 16 October 2021).
- Chan, Y.E.; Reich, B.H. IT Alignment: What Have We Learned? J. Inf. Technol. 2007, 22, 297–315. [Google Scholar] [CrossRef]
- Amarilli, F. A Framework for Business IT Alignment in Turbulent Environments. AJTE 2014, 1, 103–118. [Google Scholar] [CrossRef]
- Denolf, J.M.; Trienekens, J.H.; Wognum, P.M.; Schütz, V.; van der Vorst, J.G.; Omta, S.W. “Actionable” Critical Success Factors for Supply Chain Information System Implementations. Int. J. Food Syst. Dyn. 2018, 9, 79–100. [Google Scholar] [CrossRef]
- Denolf, J.M.; Trienekens, J.H.; Wognum, P.M.; van der Vorst, J.G.; Omta, S.W.F. Towards a Framework of Critical Success Factors for Implementing Supply Chain Information Systems. Comput. Ind. 2015, 68, 16–26. [Google Scholar] [CrossRef]
- Ren, M. Why Technology Adoption Succeeds or Fails: An Exploration from the Perspective of Intra-Organizational Legitimacy. J. Chin. Sociol. 2019, 6, 21. [Google Scholar] [CrossRef]
- Wickham, R.J. Secondary Analysis Research. JADPRO 2019, 10, 395. [Google Scholar] [CrossRef]
- Awa, H.O.; Ukoha, O.; Emecheta, B.C. Using T-O-E Theoretical Framework to Study the Adoption of ERP Solution. Cogent Bus. Manag. 2016, 3, 1196571. [Google Scholar] [CrossRef]
- Mistry, V. Benchmarking E-learning: Trialling the “MIT90s” Framework. Benchmarking Int. J. 2008, 15, 326–340. [Google Scholar] [CrossRef]
- Coltman, T.; Tallon, P.; Sharma, R.; Queiroz, M. Strategic IT Alignment: Twenty-Five Years on. J. Inf. Technol. 2015, 30, 91–100. [Google Scholar] [CrossRef]
- Ustundag, A.; Cevikcan, E. Industry 4.0: Managing the Digital Transformation; Springer Series in Advanced Manufacturing; Springer International Publishing: Cham, Switzerland, 2018; ISBN 978-3-319-57869-9. [Google Scholar]
- Issa, A.; Hatiboglu, B.; Bildstein, A.; Bauernhansl, T. Industrie 4.0 Roadmap: Framework for Digital Transformation Based on the Concepts of Capability Maturity and Alignment. Procedia CIRP 2018, 72, 973–978. [Google Scholar] [CrossRef]
- Goo, J.J.; Heo, J.-Y. The Impact of the Regulatory Sandbox on the Fintech Industry, with a Discussion on the Relation between Regulatory Sandboxes and Open Innovation. J. Open Innov. Technol. Mark. Complex. 2020, 6, 43. [Google Scholar] [CrossRef]
- Dickinson, R.A.; Ferguson, C.R.; Sircar, S. Critical Success Factors and Small Business. Am. J. Small Bus. 1984, 8, 49–57. [Google Scholar] [CrossRef]
- Rockart, J.F. Harvard Business Review. 1 March 1979. Available online: https://hbr.org/1979/03/chief-executives-define-their-own-data-needs (accessed on 23 November 2021).
- Leidecker, J.K.; Bruno, A.V. Identifying and Using Critical Success Factors. Long Range Plan. 1984, 17, 23–32. [Google Scholar] [CrossRef]
- Harold, A. Linstone and Murray Turoff the Delphi Method: Techniques and Applications. 1975. Available online: https://web.archive.org/web/20080520015240/http://is.njit.edu/pubs/delphibook/ (accessed on 4 March 2021).
- Groenveld, P. Roadmapping Integrates Business and Technology. Res. Technol. Manag. 2007, 50, 49–58. [Google Scholar] [CrossRef]
- Levy, K.; Chasalow, K.; Riley, S. Algorithms and Decision-Making in the Public Sector. Annu. Rev. Law Soc. Sci. 2021, 17, 309–334. [Google Scholar] [CrossRef]
- De Coninck, B.; Viaene, S.; Leysen, J. Public Procurement of Innovation through Increased Startup Participation: The Case of Digipolis. In Proceedings of the Hawaii International Conference on System Science 2018, Waikoloa Village, HI, USA, 3–6 January 2018; ISBN 978-0-9981331-1-9. [Google Scholar]
- Tracing HHS Blockchain Adoption. Avascent 2021. Available online: https://www.avascent.com/news-insights/healthcare-pulse/tracing-hhs-blockchain-adoption/ (accessed on 23 September 2021).
- DSCSA Pilot Project Program. FDA. 2019. Available online: https://www.fda.gov/drugs/drug-supply-chain-security-act-dscsa/dscsa-pilot-project-program (accessed on 11 January 2022).
- Triana Casallas, J.A.; Cueva-Lovelle, J.M.; Rodríguez Molano, J.I. Smart Contracts with Blockchain in the Public Sector. IJIMAI 2020, 6, 63. [Google Scholar] [CrossRef]
- Deloitte MEDIAAN—Emerging Technologies in Public Procurement—Case Study; European Commission: Brussels, Belgium, 2020.
- DPAteam Belarus-OCDS-Transformation-and-Analytics 2021. Available online: https://github.com/DPAteam/Belarus-OCDS-Transformation-and-Analytics (accessed on 12 January 2022).
- Fazekas, M.; Toth, B.; Skuhrovec, J.; Hrubý, J.; Mendes, M. DIGIWHIST: The Digital Whistleblower 2018. Available online: https://digiwhist.eu/ (accessed on 27 September 2021).
- Early Warning Red Flags. Available online: https://ec.europa.eu/antifraud-knowledge-centre/library-good-practices-and-case-studies/good-practices/early-warning-red-flags_en (accessed on 27 September 2021).
- Red Flags. Available online: https://www.redflags.eu/ (accessed on 12 January 2022).
- OECD Fighting Bid Rigging in Brazil: A Review of Federal Public Procurement—OECD. Available online: https://www.oecd.org/competition/fighting-bid-rigging-in-brazil-a-review-of-federal-public-procurement.htm (accessed on 23 January 2022).
- ProZorro. Available online: http://prozorro.gov.ua/en (accessed on 5 October 2021).
- Nizhnikau, R. Love the Tender: ProZorro and Anti-Corruption Reforms after the Euromaidan Revolution. Probl. Post-Communism 2020, 69, 1–14. [Google Scholar] [CrossRef]
- Bugay, Y. ProZorro: How a Volunteer Project Led to Nation-Wide Procurement Reform in Ukraine. In 2020/21 KSP Policy Consultation Report; Open Contracting Partnership: Washington, DC, USA, 2016. [Google Scholar]
- UNA—The First Virtual Assistant of Public Administration in Latvia—Observatory of Public Sector Innovation Observatory of Public Sector Innovation. Available online: https://oecd-opsi.org/innovations/una-the-first-virtual-assistant-of-public-administration-in-latvia/ (accessed on 25 November 2021).
- YPO Helping You Navigate Procurement. Available online: https://www.ypo.co.uk/frameworks-home (accessed on 24 September 2021).
- Fraga-Lamas, P.; Fernández-Caramés, T.; Suárez-Albela, M.; Castedo, L.; González-López, M. A Review on Internet of Things for Defense and Public Safety. Sensors 2016, 16, 1644. [Google Scholar] [CrossRef] [Green Version]
- The Finnish Government Shared Services Centre for Finance and HR (Palkeet). Available online: https://www.palkeet.fi/en/ (accessed on 26 July 2022).
- Grace Dean Drones in Ghana Deliver COVID Vaccines to Rural Communities. Available online: https://www.businessinsider.com/covid-vaccine-ghana-drones-covax-who-coronavirus-zipline-rural-communities-2021-3 (accessed on 18 October 2021).
- Homleid, Å. Sambruksstasjon og Døgnhvileplass, Gol. Available online: https://www.bygg.no/article/1381510!/ (accessed on 13 October 2021).
- Augmented Reality, Urban Data and the|VTT News. Available online: https://www.vttresearch.com/en/news-and-ideas/augmented-reality-urban-data-and-related-opportunities (accessed on 13 October 2021).
- Anett Andreassen Digitalisering—Statsbygg. Available online: https://www.statsbygg.no/samfunnsansvar/digitalisering (accessed on 13 October 2021).
- DOD Believes Blockchain Can Boost 3-D Printing at the Front. Available online: https://gcn.com/cybersecurity/2017/05/dod-believes-blockchain-can-boost-3-d-printing-at-the-front/304800/ (accessed on 26 July 2022).
- BIDMC Physician-Scientists Spearhead Effort to Address Nationwide COVID-19 Testing Swab Shortage. Available online: https://www.bidmc.org/about-bidmc/news/2020/03/3d-printed-swabs (accessed on 26 July 2022).
- Quintanilla, G. Dutch Army Starts Cooperation with DiManEx. 2018. Available online: https://www.dimanex.com/2018/05/14/dutch-army-starts-cooperation-with-dimanex-to-solve-spare-part-supply-challenges-with-an-end-to-end-service-for-3d-manufacturing/ (accessed on 26 April 2022).
Databases | Science Direct, IEEE Explore, Scopus, Google Scholar, and Web of Science |
Keywords | Industry 4.0, e-public procurement, Public Procurement, blockchain, of Business Intelligence, Machine Learning, and Artificial Intelligence, 3D Printing, Robots, Challenges, Barriers, TOE, Critical Success Factors |
Document type | Articles, Books, Cases |
Date | 2002> |
Language | English |
Initial search | 352 |
Provisional collection | 180 -abstract briefly reviewed |
Selection criteria | Novelty, times cited, publication date, journal impact, relevance, pilot or full use |
Selected articles | 122 |
Technological | Organizational | Environmental |
---|---|---|
The system does not meet public authorities needs [58,59] | Changing management issues such as organizational culture, a collaboration of different departments from the front office to the back office, and public institutions are inherently less flexible [33,60] | A competitive environment induces mimicking behavior between the public authorities and businesses [14] |
The system is complicated and unable to attract suppliers [58,59] | Leadership and stakeholders lack engagement [20] due to sufficient funding and resources and the need for strong and committed leadership at the political level [33,61] | Economic health vs. budget constraints [14] |
Disruptive innovation-a new set of resources, processes, and values [62] | Lack of project great pilots as an excellent paradigm [15] | Strong corruption [63] |
Electronic signatures: costly, complex, lack of interoperability, legal barriers, and limited support from service providers [64] | Lack of well-trained and skilled personnel [15] | The compulsory and political character of the regulatory framework [18] |
IT security and authentication (confidentiality, integrity, and availability) [59,65] | Users’ resistance to change because e-procurement will make their work more difficult and monotonous, and current roles will change [35,56,58] | Political engagement to guarantee enough funding [18] |
Cyber security [20,66] | Various stakeholders’ different needs, goals, and interests, as well as the realization of benefits of information systems in public procurement stakeholders [56,58,59] | Social norms about innovations [56] |
Interoperability [18,33] | Business process reengineering The inefficient and non-value-adding processes need to be cleaned up, while the mandatory procedures need to be optimized for e-use [35,58,59] | The size of the population and the high level of education [67] |
Existing knowledge in IT [14] | Organizational adjustments to secure critical private and confidential information [59] | The involvement of small and medium enterprises in public procurement [68] |
Business model (in-house or third party) and lack of coordination and standardization of processes [35] | SMEs are responsible for innovation and flexible services [68] | |
Bureaucratic culture and practices [26] | Availability of information to SME.s [69,70] | |
Lack of skills and capabilities by the stakeholders and especially the employees [71] | The reduction of administrative burden and the increase of digitization [70] |
Technological | Organizational | Environmental |
---|---|---|
1. Simple technical implementation [28,79] 2. Integration with other digital technologies [80,81,82,83] 3. Cooperation with legacy systems [84,85,86,87] 4. Danger of lock-in [88,89] 5. Require existing digital procurement platforms to extract and transform data [90,91] ease of use, visual appeal analytic dashboards, workflow integration 6. Good data. Quality, accuracy, and trustworthiness [92] 7. Process challenges about data capturing, transformation and sharing integration [93] 8. Measuring corruption requires a proxy— a ‘corruption risk index’ (CRI) and proper patterns [7] 9. Quantum computing increases processing capacity [94] 10. Proper infrastructure: hardware, software, and license types must be adequately defined [95]. In-house production and support of AI systems [96] 11. Large, open, anonymized and standardized datasets are needed across the government [28,97,98]. 12. Advanced algorithm construction for better results [99] 13. Ability to use real-time structure and unstructured training data [76,100] 14. Add new A&Qs to the Chabot regularly [28] 15. Analyze the capabilities of data infrastructure Cyber security [101] Define differences between software-defined infrastructure (SDI) vs. AI-defined infrastructure [102] 16. Integrated data preprocessing [103] 17. Well-trained data scientists 18. Enriching the training data from the vendor market [104] 19.Technical transparency [105,106,107,108] 23. IT infrastructure must address security issues [109,110] 24.Managing heterogeneity: scalability, modularity, extensibility, and interoperability among heterogeneous things and their environments [109,111] 25.Endpoints/connected objects component (sensors–interfaces) [109] 26. Issues with the authenticity of the underlying data [100] 27. Robots need more clear information than humans [112] 28. Create algorithms that are adaptable enough to generate a simple and accurate 3D model for every type of building or construction [80] 29. Management of the continuous data volume increase [113,114,115] 30. Detailed technical information on components to be printed [116] 31. Delaminate parts-fused deposition modeling (FDM) [81,82,83,117] 32. Beware of inaccuracies in the product design process 33. Ensure post-processing requirements [118,119,120] 34.The raw material selection is not extensive [113,115,118] 35. Limit the size of the pieces that can be printed [28,83,121] 36.Deep analysis of the target process. Correctly identified use-cases for automation [122,123,124] 37. Give access to fresh data that can be studied and compared to current data to produce unique knowledge [125,126] | 38. Need to build support for the project with internal stakeholders and users [84,127,128,129] 39. Overcome resistance to the use of emerging technologies [28,130] 40. Authorize access to data, and role distribution [131] 41. Organizations to own their data [90] 42. New roles need new training forms [94,96,132,133,134] 43. IT and non-IT users work properly together [135,136]. Non-technical public workers lack appropriate data and AI understanding [96] 44. Confirm the organizational structure’s quality, talents, experiences, programs, processes [137,138] 45. Project management focuses on data, not coding [94,138,139,140] 46. Lack of organization-wide adoption [138]. Creating and promoting a pro-innovative corporate culture among business/PA employees [141] 47. Compatible procurement policies and data expertise inside the public authority [133] 48. Check where the AI is the better solution [97] 49. Self-selection bias in data entry from the organizations [142] 50. Administrative processes building, contestability, human engagement, integration of values [143] 51. Update models regularly to reflect changing situations and behaviors of contractors and civil servants [100,144] 52. Procedural transparency provides information about the purpose of the algorithmic system [106,143,145] 53. Adapt public procurement to IoT model [109] 54. Networking vendors. Interoperability and compatibility between them [146,147,148] 55. New abilities required and new organizational forms and procedures [149] 56. Check suitability: high-volume processes, high standardization, rule-based tasks [150] 57. Manage physical interference and contact (PIFACT), humans with robots [151] 58. Create new positions and revise job descriptions [57] 59. Define and certify processes: protocols, standards, and procedures [83] 60. Define staff qualification and certification [118] | 61. Overcoming legal regulations regarding barriers and conflicts [84,152,153,154,155] 62. Privacy issues about data stored [134,156,157,158] 63. Lack of support from the government [134,159] 64. Legal ethics issues about personal data [160] use, sovereignty safety, equity, accountability, and lack of fairness [97,161,162,163,164] 65. Explainability: clear documentation about the working algorithm according to bias or ethical issues [94,143,165] 66. Combine human intelligence with the best of machine intelligence (i.e., human in/on the loop, human in command) [166] 67. Integrating machine learning system design with administrative law [143,167] |
68. Lack of standards concerning, e.g., IoT technologies [110,168] 69. Expand the role of the public sector in governing data. Accessibility-flexibility accountability [134,169,170] 70. Manage thoughts and sentiments in opposition to automation, e.g., human workforce [123] 71. Liability for design errors, safety problems [112,141,171,172] 72. Intellectual property issues, copyright protection, patent protection, design rights [173] |
Common Problems/Challenges e-Public Procurement 3.0–4.0 | ||
---|---|---|
Technological | Organizational | Environmental |
Complicated platforms-tools. Usability and accessibility. | Change management strategy: overcome resistance overcome bureaucratic culture Involvement, engagement, motivation for stakeholders, and the realization of benefits | Expand the public sector’s data governing in data security, personal data protection intellectual property issues |
Inaccurate IT design on users’ needs | Top management support Vision Resources Training Project management | Political decisions about providing Resources Infrastructures Administrative law adaption |
Interoperability-cooperation with legacy and 3.0 systems/platforms/tools | Collaboration between departments. IT and non-IT staff | |
Security issues IT (i.e., authentication) Cyber Anonymize personal data | Adapting to new roles and job descriptions | |
Requirement of new technical skills | ||
The quality of structured data requires Existing database Compatible formats | ||
Disruptive innovation characteristics |
Additional Problems/Challenges in e Public Procurement 3.0–4.0 | ||
---|---|---|
Technological | Organizational | Environmental |
Avoid “lock-in danger” from 4.0 proprietary technologies | Need for a protocol to examine which technology is appropriate for each organization Procurement phase Type of procurement | The legal framework in ethical issues: Clear documentation about the working algorithm Combine human intelligence with the best of machine intelligence (i.e., human in/on the loop, human in command) |
Manage unexpected-unwanted reactions (e.g., by the bots) Robots need more clear information than humans. | Business models are updated regularly to reflect the new learning inputs from the process (e.g., Machine Learning about fraud detection) | Introduction of standardization in devices (e.g., IoT) related to technologies 4.0 |
Find/create proper algorithms to discover patterns (e.g., fraud cases) (CRI). | Higher level of automation workflows becoming more transparent, decentralized, and less hierarchical | Data government policy issues |
Limited access to critical databases (tax, insurance, business registries). | Reallocation of the workforce: Machine-to-machine communication (e.g., IoT, Bots). Work without human intervention. Self-monitoring systems | |
Interoperability, integration- between 4.0 technologies. | Business process-reengineering Discard unnecessary process Optimize Automate | |
Utilization of existing (i.e., EU’s) 3.0 tools as data sources | Compulsory to digitize the process from end-to-end Intra-organizational integration Inter-organizational integration | |
Managing and analyzing unstructured data requires skills (e.g., data science) computing infrastructure and high- processing capacity, data storage capacity | ||
Availability of training data, e.g., vendor market, technical information and raw materials (e.g., 3D printing) | ||
Manage difference between Software-defined infrastructure, SDI based on developer-defined rules and AI-defined infrastructure (AIDI) learning of its environment | ||
Big datasets that cannot be gathered, stored, handled, or analyzed using standard software methods |
Scott Morton’s Element | CSF | Challenge Number Table 3 |
---|---|---|
Project strategy | 1.Performance legitimacy [178] Define clearly national transformation goals 2. Allocate sufficient funds to implement the transformation plan for infrastructures training and supportive resources | 4,6,11,27,34,35,36,46,48,56,57,63,67,68,69,70,72 |
Structure | 1. Task legitimacy [178] 2. Reengineer processes 3. Reform organizational structure | 38,40,43,44,51,52,55,58,59,66 |
Information systems | 1. Evaluate the interoperability, integration, security, data quality, and efficiency of legacy IT Systems (e.g., PP platforms) with 4.0 technologies 2. Data Governing | 1,2,3,4,5,6,9,10,12,13,14,19,23,25,26,28,30,37,41,45,47,49,62,64,65,66,69,72 |
People | Value Legitimacy [178] Manage change resistance, relations, and deliver training Protect fundamental democratic rights and ethical values | 17,38,39,42,55,57,60,64,65,66,70,71,72 |
Management processes | 1. Manage legal reforms 2. Manage digital transformation tactics 3. Project management resources-requirement planning | 6,7,8,13,15,16,17,23,24,29,31,32,33,37,43,46,47,50,51,52,53,54,61,64,65,66,67,70 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Mavidis, A.; Folinas, D. From Public E-Procurement 3.0 to E-Procurement 4.0; A Critical Literature Review. Sustainability 2022, 14, 11252. https://doi.org/10.3390/su141811252
Mavidis A, Folinas D. From Public E-Procurement 3.0 to E-Procurement 4.0; A Critical Literature Review. Sustainability. 2022; 14(18):11252. https://doi.org/10.3390/su141811252
Chicago/Turabian StyleMavidis, Aristotelis, and Dimitris Folinas. 2022. "From Public E-Procurement 3.0 to E-Procurement 4.0; A Critical Literature Review" Sustainability 14, no. 18: 11252. https://doi.org/10.3390/su141811252
APA StyleMavidis, A., & Folinas, D. (2022). From Public E-Procurement 3.0 to E-Procurement 4.0; A Critical Literature Review. Sustainability, 14(18), 11252. https://doi.org/10.3390/su141811252