Next Article in Journal
Availability and Adequacy of Facilities in 15 Minute Community Life Circle Located in Old and New Communities
Previous Article in Journal
Profiling Citizens in the Smart City: A Quantitative Study in Wallonia
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development of a Maturity Model for Assessing Smart Cities: A Focus Area Maturity Model

1
College of Science, University of Bahrain, Sakhir 32038, Bahrain
2
College of Information Technology, University of Bahrain, Sakhir 32038, Bahrain
3
Department of Computing and Information Systems, University of Melbourne, Melbourne 3052, Australia
*
Author to whom correspondence should be addressed.
Smart Cities 2023, 6(4), 2150-2175; https://doi.org/10.3390/smartcities6040099
Submission received: 17 June 2023 / Revised: 4 August 2023 / Accepted: 8 August 2023 / Published: 18 August 2023

Abstract

:
The concept of smart cities has gained significant attention due to the potential of smart cities to optimize city services and enhance citizens’ quality of life. Cities are investing in digital transformation to become smarter, sustainable, and resilient. Therefore, there is a need to build a comprehensive and holistic model to assess smart city initiatives. This paper aims to develop a model that can capture the maturity of smart city adoption across various functional domains. These domains are divided into focus areas that capture different dimensions of a smart city and grouped into seven groups: ICT, economy, environment, social, resources, services, and governance. Each focus area has a set of maturity levels that describe the capabilities and outcomes of the city at different stages of development. To develop the model, the focus areas were extracted from the literature based on 16 models that have been reviewed. Assessing these models helped in identifying gaps and building the foundation of the model. Using the information extracted from the literature, a focus area model was designed and developed. The model development included seven main phases, which were: scope, design, populate, test, deploy, and maintain. The current paper validates the proposed model using the Delphi method, which involves the participation of a panel of sixty field experts. The experts evaluated the model’s correctness and completeness based on their experience and provided feedback. This feedback was used to revise and finalize the model. The smart city maturity model provides a framework for benchmarking, planning, and improving smart city initiatives. Cities can use the model to measure their performance and evaluate their weaknesses and strengths. The model is also the most comprehensive in terms of the scope of the focus areas included, and the results show that the model has a high level of accuracy and consistency and can effectively assess smart city adoption.

1. Introduction

Cities worldwide face population growth, rapid urbanization, improper resource management, and inadequate infrastructure. These challenges pose environmental threats, drain resources, weaken infrastructure and the economy, and trigger social problems such as high crime rates and inequality. To manage and mitigate these problems, cities are racing to digital transformations and to become smarter. According to the World Cities Report 2020 [1], the global demand for smart cities grew from USD 622 billion in 2017 to USD 1 trillion in 2019 and is forecasted to reach USD 3.48 trillion by 2026. The United Nations’ 2030 Agenda for Sustainable Development emphasizes the need for smart and sustainable cities globally, particularly the sustainable development goal (SDG) 11: “make cities and human settlements inclusive, safe, resilient and sustainable” [2] (p. 26). Successful smart city implementation will contribute to achieving the SDGs [3,4].
Smart city implementation not only helps governments provide more efficient services but also promotes innovation, encourages private–government partnerships, enhances decision-making processes, improves project financing, and promotes sustainability [5,6]. However, many technical, social, economic, and strategic challenges must be overcome to realize the benefits of the smart city concept. Contemporary cites are characterized by complexity, diversity, and intelligence [7], which can be barriers to smart transformation. Therefore, it is crucial to ensure the availability of reliable governance systems that can plan, manage, and measure smart transformation.
Academic studies and practitioners have provided a variety of conceptualizations of smart cities. The definition in [8] (p. 11) focuses on the main characteristics of a smart city: “a city well performing in a forward-looking way in the six characteristics (economy, people, governance, mobility, environment, living), built on the smart combination of endowments and activities of self-decisive, independent and aware citizens”. Other definitions emphasize the role of technology. For example, the International Data Corporation defines smart cities as cities that use ubiquitous networks, wireless sensors, and intelligent management systems to solve current and future challenges and create new services [9].
Standards bodies such as the British Standards Institution (BSI) adopt a holistic view of smart cities and the utilization of best practices when defining a smart city as “a city where there is effective integration of physical, digital and human systems in the built environment to deliver a sustainable, prosperous and inclusive future for its citizens” [10] (p. 18). The International Telecommunication Union Telecommunication Focus Group on Smart Sustainable Cities (ITU-T FGSSC) analyzed 120 definitions to develop a comprehensive definition of a smart city: “an innovative city that uses information and communication technologies (ICTs) and other means to improve quality of life, efficiency of urban operations and services, and competitiveness, while ensuring that it meets the needs of present and future generations with respect to economic, social, environmental as well as cultural aspects” [11] (p. 13).
On the basis of the definitions in the literature, this paper defines a smart city as a city that innovatively utilizes ICT enablers to enhance the quality of life for citizens in a sustainable and balanced environment while considering the economic and social aspects of society. This definition highlights the vital role of ICT in a smart city while emphasizing that the smart city concept is about more than just technology. To achieve the desired outcome of smart city adoption, namely improving citizens’ quality of life, smart city projects should also consider sustainability and a balanced lifestyle.
The literature acknowledges the need for proper governance tools to facilitate smart city adoption and connect forces in different domains [12]. However, previous attempts to build models and frameworks have not considered all city domains [13], failed to engage stakeholders in model building or implementation, missed differences between different domains [14], or ignored the level of granularity [15]. Several smart city metrics and performance indicators have been proposed, but most cannot provide comprehensive evaluations of complex systems such as smart cities. One reason that cities lack standards to measure their progress [16,17,18] is the absence of a globally accepted definition of the smart city concept [19].
The objective of this study is to is to develop a model that can capture the maturity of smart city adoption based on different focus areas. Cities can use the model to measure their performance and evaluate their weaknesses and strengths.
This paper builds on the past efforts of various practitioners and scholars to develop a tool that addresses these gaps. Specifically, a maturity model for assessing smart city implementation is developed and empirically examined. Maturity models can help entities to achieve continuous improvements. Cities can use maturity models to assess their situation and determine the capabilities required to build a smart city [9]. Smart city maturity models are important for the proper evaluation of smart city implementation to prioritize funding and improve city performance. This model will provide significant input to all smart city stakeholders and empower cities to successfully undergo smart transformation to face urban challenges.
The smart city maturity model was developed through an extensive literature review and analysis. This article is structured as follows: Section 2 gives background information about the smart city concept and smart city assessment. Section 3 describes the methods used to develop the model. Section 4 presents and discusses the results. Finally, the paper is concluded in Section 5.

2. Related Work

Studies such as those reported in [12,14] have highlighted the importance of tools for assessing and evaluating smart city implementation. Frameworks and practices for smart city assessment belong to five main categories: best practices, ranking frameworks, index-based frameworks, initiative-based evaluation, and maturity models. Some background information about the five categories is outlined in Section 2.1, Section 2.2, Section 2.3, Section 2.4 and Section 2.5.

2.1. Best Practices

International, regional, and local standards bodies issue best practices to ensure the quality of services and enable cities to perform benchmarking. These bodies include the International Organization for Standardization (ISO), the International Electrotechnical Commission (IEC), the International Telecommunication Union (ITU), the European Committee for Standardization (CEN), the British Standards Institution (BSI), and the National Institute of Standards and Technology (NIST). These organizations have published standards that define a smart city and specify relevant indicators for assessment, such as ISO 37120:2018 (Sustainable cities and communities—Indicators for city services and quality of life), ISO 37153:2017 (Smart community infrastructures—Maturity model for assessment and improvement), ISO/IEC 30146:2019 (Information technology—Smart city ICT indicators), PAS 181:2014 (Smart city framework—Guide to establishing strategies for smart cities and communities), and ITU-T L.1603 (Key performance indicators for smart sustainable cities to assess the achievement of sustainable development goals). However, applying best practices in real-life projects can be challenging.

2.2. Ranking Frameworks

Ranking frameworks compare cities by using specific criteria, which allows cities to act based on their relative positions. The European smart cities ranking (ESCR) [8,20] is a very well known ranking framework. Giffinger and colleagues studied 58 medium-sized cities to define a ranking mechanism for European cities based on six main characteristics: society, environment, economy, governance, mobility, and living. They also identified 31 factors and 74 indicators that can be used to measure cities’ performance. A limitation of ranking systems is that they focus on the final results and do not capture enough detail about cities’ strengths and weaknesses. Moreover, these frameworks do not consider cities as complex and unique systems that require comprehensive yet specific measurements based on local context.

2.3. Index-Based Frameworks

Index-based frameworks use key performance indicators. The CITYKeys project, which is funded by the European Commission, has developed a indices-based performance measurement framework for monitoring smart city implementation [21]. A limitation of these frameworks is that they are subject to data availability.

2.4. Initiative-Based Evaluation

Initiative-based evaluation is similar to the framework developed by [22] to examine smart city initiatives based on a set of identified critical success factors. This framework includes management and organization, technology, governance, policy context, people and communities, economy, built infrastructure, and the natural environment and provides a comprehensive conceptualization of the smart city. However, initiative-based evaluation frameworks may encourage isolation and barriers between different sectors of smart city projects.

2.5. Maturity Models

A maturity model is an assessment tool for establishing the current situation and identifying necessary improvements to progress in maturity. Maturity models have been used as assessment tools in many sectors to ensure continuous improvement such as process management, project management, knowledge management, sustainability management, risk management, supply chains, education, government, construction, and healthcare [23]. Maturity models can be applied to measure the success of smart city adoption [24].
Maturity models comprise several components [25]:
  • The domain is the model’s first layer and provides a high-level view of the scope;
  • The domain components, sometimes referred to as focus areas or factors, are the significant aspects of the domain, such as critical success factors;
  • The domain subcomponents, also called capabilities or processes, provide further details. Achieving the capabilities will determine the level of maturity;
  • The levels can be present in any number, depending on the model scope and application. Maturity can range from the minimum value, i.e., the quality of the elements underlying the processes is in the lowest required state, to the maximum value, i.e., no further improvements are needed [26];
  • The assessment tool defines how the capabilities will be measured against the maturity scale using qualitative (descriptions) or quantitative (numerical scales) approaches. Assessment can either be self-assessment or performed by a third party.
Maturity models can be classified into two types based on stages, fixed levels, and focus areas. The fixed levels have a specific number of levels of maturity for all defined focus areas. A well-known fixed-level model is the CMM. It is popular and simple to implement but is not recommended for complex environments [23]. The focus area maturity model divides the functional domain into a number of focus areas that need to be developed to achieve maturity in the functional domain. Related focus areas can be grouped to facilitate the assessment. Each focus area includes (1) different capabilities that represent the steps of development of the focus area and (2) different numbers of maturity levels. The final maturity is a combination of the maturity levels of the focus areas.
The focus area maturity model has been used to develop models in disciplines such as enterprise architecture [27], information security [28], software governance [29], master data management, disaster risk management, and social media [30]. However, the focus area maturity model has not been used to develop a smart city maturity model. This research adopts the focus area approach for three key reasons:
  • The focus area maturity model facilitates the measurement of different dimensions within a smart city, each of which has different maturity levels. This is not possible in fixed-level models;
  • A smart city is a complex system that depends on multiple interconnected processes that must be measured. The focus area maturity model illustrates the interdependencies between processes and enables the measurement of incremental improvements;
  • The focus area maturity model can include any number of levels. Including a greater number of incremental levels allows more detailed guidance for capability improvements.

3. Research Approach

3.1. The Model Development Method

This section presents the development of the smart city maturity model based on the focus area maturity model method. It outlines the method used to guide the development of the maturity model, discusses each step of the model development and then provides information about the assessment tool created to perform the assessment. Finally, the Delphi method is presented, which is used to validate the model components.
Table 1 provides an overview of the two methods used in this study to create the smart city maturity model: the generic development framework [25] and the development framework for focus area maturity models [31]. The different phases of each method are listed in sequence under the second column (Phase), along with a description of each phase in the last column (Description).
These two methods have been combined previously to develop focus area maturity models such as the software ecosystem governance maturity model [29] and the focus area maturity model for API management [32]. Figure 1 illustrates the steps followed to develop the smart city maturity model.

3.1.1. Scope

The first phase of the maturity model development was to establish scope, as shown in Figure 1. Defining the aim of the model, the gaps it will fill, the problems it will address, and the potential opportunities is fundamental. The scope must be clearly formulated, and domain(s) must be identified.
To define the scope clearly and collect information about existing maturity models for smart city assessment, a literature review was conducted following the guidelines proposed by [33]. The first step in this methodology is definition, which includes defining the inclusion and exclusion criteria, specifying the search sources, and determining the search string. The inclusion criteria were publications in English that were related to the research questions and included basic information about the model components and levels. Publications that did not meet these criteria were excluded. Several platforms were searched: Scopus, ScienceDirect, SpringerLink, Taylor & Francis Online, ACM, and ResearchGate. The search string was (“smart” AND (“city” OR “cities”) AND (“maturity” OR “assessment”) AND (“model” OR “method” OR “framework”)). The query string was adjusted according to the syntax of each search engine.
The next step in [33]’s review methodology is search, which includes executing the search, extracting the results, and performing a selection step to refine the results. As shown in Table 2, the initial search on 29 May 2020 yielded 1759 publications.
After removing duplicates and publications that addressed smart cities from a limited angle (i.e., a specific domain such as smart transport or smart tourism), 114 studies were considered for a second round of quality checks to ensure relevance and reliability by reading the abstract and parts of the study. Finally, 16 papers were retained for inclusion in the literature review (Appendix A). The various conceptualizations of smart city assessment models in the literature included diverse domains. Some domains were used in multiple models, whereas others were mentioned in only a single publication. The domains were extracted from the models, studied, and classified into seven logical categories: ICT, economy, environment, social, resources, services, and governance. These categories provided a clearer idea of the areas that have received attention in the literature on maturity models.
Governments are initiating multidimensional smart city projects to satisfy citizens’ needs and improve city competitiveness. However, cities have struggled to chart improvement paths and effectively measure success. Therefore, this study aims to introduce a smart city maturity model that covers all dimensions and assists governments in their smart city journeys. None of the studied maturity models included comprehensive measures encompassing all of the domains. Moreover, all of the models were based on fixed-stage models that did not consider differences between domains. Each domain may have unique specifications and components that must be considered separately. By contrast, a focus area model considers differences and can provide a reasonable improvement path that can be applied globally. The gaps identified in the literature review will be addressed by introducing a comprehensive focus area maturity model that can be used to measure the success of smart city implementation globally while considering the local differences between cities. Accordingly, the model’s scope is domain specific in assessing smart city maturity. In addition, the model can be applied to any city and is not region specific.
Another critical decision in the scope phase is the model’s target audience and stakeholders. The smart city maturity model developed in this research is intended for both researchers and practitioners. It will support government representatives, decision makers, all city actors, and, indirectly, citizens.

3.1.2. Design

The second phase of model development is design. In this phase, the model’s foundation is constructed by answering the following questions:
  • Why is the model required?
The primary goal of the model is to assist cities in measuring the maturity of smart city implementation.
  • How will it be applied to different entities?
Cities can utilize the model to assess their level of maturity and then focus on the practices that need to be implemented to achieve the intended improvement.
  • Who should be involved?
City officials and decision makers will be the main users of the model. However, since the model measures the city’s activities, everyone in the city can be considered as a potential stakeholder.
  • What can be achieved?
Cities can use the model to identify a path for improving capabilities and practices to progress and mature.

3.1.3. Populate

Once the model design is ready, the next phase is to populate. According to [25], the model’s components should be defined along with what will be measured and how. The steps from the focus area development framework were followed to identify the components. First, the focus area groups and the focus areas were defined. Each group was divided into several focus areas, defined as groups of related activities, events, deliverables, or products that support the domain [34]. Grouping the focus areas into labeled categories can increase model accessibility [31]. The seven categories that were identified in the literature review were considered the focus area groups. These groups were divided into eighteen focus areas: ICT infrastructure, digital transformation, data, labor market, entrepreneurship, pollution, environmental management, education, social equity, citizen active lifestyle, water resources management, sustainable and efficient energy, urban planning and management, healthcare system, transport system, safety and security, political structure, and strategic planning. All focus areas were clearly defined to eliminate confusion in scope and precisely identify each area’s capabilities.
To describe the ability to achieve the focus areas, the relevant capabilities and practices within the capabilities were defined [35,36]. According to [37] (p. 8), capabilities are “the ability to achieve a predefined goal”. Capabilities can be considered the building blocks of the focus area maturity model [38]. Each focus area was studied to determine the main capabilities that should be satisfied to achieve success in that particular focus area. In general, capabilities should satisfy the following criteria: have a theoretical foundation; be measurable, clear, and precise; and have available related data. For the smart city maturity model, the capabilities and practices were extracted from the academic literature, international standards, and best practices.

3.1.4. Test and Deployment

In the test phase, experts were interviewed and consulted to verify the content of the model using the Delphi method, which will be discussed in Section 3.3. The Delphi method has been used previously to verify frameworks [39] and, more specifically, to validate maturity models [40,41].

3.2. Building the Assessment Tool

After validating the model and finalizing the components, the assessment tool was built and used to evaluate the city’s level of maturity [42]. Each level within a focus area had three checkpoints: questions that can be answered by “yes” or “no” to assess the current situation [28,38]. The maturity of the focus area level was achieved only if all three questions were answered “yes”. Appendix D lists all the checkpoints that are under ICT focus area as an example and below in Table 3 are the questions for measuring level one of the ICT infrastructure/connectivity focus area.
The checkpoints were derived from the definitions of the focus areas, capabilities, and practices. The questions were also based on standards and frameworks from the literature that were related to the focus areas and capabilities. The questions were formulated considering five desirable properties [43]: unambiguous, comprehensive, direct, operational, and understandable. In addition to the mentioned properties, within each focus area there are three categories of questions according to what they measure: input, output, or outcome [44]. First, the input questions measure the resources allocated to the focus area, such as budget and human resources. However, the input questions will measure the efforts dedicated to that focus area but do not measure whether the resources are spent efficiently or the objectives achieved. Second, the output questions measure the actions produced to accomplish the focus area’s goals but do not measure the effectiveness of the actions. A typical output was the presence of a plan or strategy. Finally, the outcome questions measure the effectiveness of the actions in reaching the focus area objectives, such as questions about citizens’ satisfaction. Within each focus area, the questions covered strategy, governance, people, communication, and reporting.

3.3. The Delphi Method

The goal of the test phase is to validate the components of the maturity model. The focus areas, capabilities, and practices were extracted from the literature. Testing and validation of the data were essential to ensure the model’s completeness and correctness. Specifically, the objectives of the test phase were as follows:
  • Agree on the definitions of focus areas and capabilities, which is essential to establish a solid foundation for the model;
  • Identify any missing capabilities to ensure model completeness;
  • Identify any potential overlap between the proposed focus areas/capabilities to avoid confusion between the different components;
  • Identify any potential dependencies between focus areas/capabilities to build the model matrix based on any dependencies;
  • Agree on all focus areas and capabilities to ensure model validity;
  • Identify the importance of each focus area/capability to the smart city.
The Delphi method is an iterative process of gathering experts’ opinions and assumes that the opinion of a group of experts is more accurate than the opinion of a single individual [45]. The process ends when it reaches the predefined level of consensus or completes the predefined number of rounds [46]. The Delphi method has been successfully used to evaluate the identification and development of concepts within theoretical frameworks such as the maturity model [39,40,41,47]. Figure 2 shows the steps of the Delphi method.

3.3.1. Clustering of Questions

To avoid confusing the panelists, the questions were formulated clearly and concisely and fitted the study’s purpose. As shown in Table 4, the focus areas were grouped into twelve clusters, and an online tool was used to create and publish each cluster’s interview questions online through a secure link shared with the panelists during the interview for better accessibility.

3.3.2. Panel Selection

Panel selection is essential to data credibility; an improperly selected panel may provide misleading information. In addition, choosing unmotivated panelists can result in a low response rate. The panelists were chosen based on their knowledge and extensive experience, which ranged from 8 to 41 years. In addition, to ensure a range of perspectives, panelists with diverse backgrounds and professional experiences were selected. The experts worked in government agencies, the private sector, universities, UN agencies, and NGOs and held jobs such as managers, professionals, CEOs, researchers, and lecturers. The snowball approach was used [49], asking panelists to recommend other potential participants.

3.3.3. Interview Process

The data were collected in two rounds [39]. Five panelists were assigned to each cluster (Table 4) to answer interview questions related to their area of expertise. Each interview began by explaining the study and the questions. The panelist was asked to either answer the questions during the interview or return responses (based on the panelist’s preference) within a week using the link provided. If the panelist chose to send answers later, a supplemental document describing the model components was sent to the panelist along with the link.
Out of the 86 panelists who were approached to participate in the interviews, 60 participated and actively contributed to the interviews by giving their opinions and feedback in two rounds. The data were extracted from the online tool into Microsoft Excel and then downloaded into SPSS for analysis.
In the first round, the panelists were presented with four questions about their agreement with the definitions of the focus areas and capabilities. They were asked to suggest modifications when applicable, add any missing capabilities to the model, and identify any overlap or dependencies between the focus areas/capabilities.
After finalizing the focus areas and capabilities, a second round was conducted in which the panelists were asked to agree on all capabilities and practices and rate the importance of different focus area groups, focus areas, and capabilities.

3.3.4. Reliability and Validity

The following aspects of the Delphi method ensured the reliability and validity of the Delphi method:
  • The selected experts were knowledgeable, experienced, and representative of the related domain. In addition, they were willing and able to participate in the Delphi process. The number and diversity of experts were sufficient to ensure a balanced and comprehensive perspective on the topic;
  • The design of the questionnaire avoided leading, ambiguous, or biased questions. The experts had space to comment and give open-ended responses and comments. The questionnaire was pilot tested and refined before being administered to the panel;
  • The data were analyzed using appropriate statistical methods with criteria to measure the level of agreement among the experts. The results were presented in a transparent and systematic matter that highlighted the main findings and areas of disagreement.

4. The Final Smart City Maturity Model

After the expert review and validation, the final proposed model included eighteen focus areas belonging to seven groups: ICT, economy, environment, social, resources, services, and governance. Each focus area was classified into two to four capabilities, depending on the nature of the focus area. These focus areas and capabilities were compiled to form the smart city maturity model. Cities can use this model to obtain a clear picture of the sectors they should focus on to improve smart city adoption. Figure 3 provides an overview of the model’s architecture.
The smart city maturity matrix is available in Appendix B, which describes the five levels of maturity of each model component. The matrix also lists all practices. However, more details are included in the full model about each capability. To illustrate the concept, a list of the practices and related capabilities that are under the ICT focus area group are provided in Appendix C. Below, in Figure 4, is the capability connectivity in the focus area ICT infrastructure in:
  • Focus Area Name;
  • Capability Name;
  • Practice Code: A unique identifier that comprises three parts: the first part is the focus area number, the second part is the capability number, and the last part is the number of the practice within the capability;
  • Practice Name;
  • Practice Description;

5. Discussion

The findings of this study indicate that the smart city maturity model involves various components. Accurately defining the model components provides a structured framework for the maturity model and ensures its ability to provide an effective assessment of smart city maturity. The components were initially extracted from the literature on smart city assessment frameworks and validated by experts using the Delphi method, as explained in Section 3 and Section 4. The final key components, or focus areas, of the smart city maturity model are ICT infrastructure, digital transformation, data, labor market, entrepreneurship, pollution control, environmental management, social equity, citizen active lifestyle, water resources management, sustainable and efficient energy, urban planning and management, healthcare system, transport system, safety and security, political structure, and strategic planning. Measuring these focus areas using the developed maturity model will ensure the effectiveness of the assessment.
The model was built and evaluated using techniques and guidelines from the literature. The use of the Delphi method during model development strengthened the model’s foundation and grounded the model in theory and practice.
The developed model is based on the concept of dividing the functional domains into a number of focus areas, which provides a structural approach that can guide the city in adopting a phased development approach, focusing on incremental improvements and prioritizing investments based on assessment. Breaking down the process based on the maturity level of each capability will improve resource allocation and allow the city to focus on priorities. Over time, cities will be able to measure their progress and demonstrate their achievements.
Furthermore, the model facilitates knowledge transfer by enabling benchmarking and sharing best practices based on the assessment results. Additionally, the model can support capacity building by identifying gaps and areas for improvements.
The findings of this study have several implications for future research since there is no globally accepted definition of a smart city. The developed smart city maturity model contributes to a better understanding of what constitutes a smart city and how it can be measured. It shows how to build an effective maturity model that can effectively contribute to achieving successful digital transformation. The developed model opens new research opportunities and can be used as a basis to investigate the impact of smart city initiatives on different areas related to city development, such as sustainability, economic development, and culture. In addition, the developed model is the most comprehensive with respect to the inclusion of focus areas and has been empirically validated. The model bridges gaps in the literature and contributes to the smart city field.
Similarly, the smart city maturity model has implications for practice; governments around the world can use the proposed model to influence smart city implementation. The decision makers and planners in government can benefit from the model to set priorities and adopt and evaluate digital transformation strategies. The model not only identifies challenges but also highlights strengths and best practices. Consequently, it can be replicated in other areas or shared with other cities. Additionally, the success of smart city adoption relies on the engagement of stakeholders and the collaboration between them, and the model can be used to explore the roles of different stakeholders, such as officials, decision makers, and citizens. Establishing priorities will clarify the roles of stakeholders. Finally, the proposed model can be used to accelerate the progress of cities in sustainable development and achieving the SDGs. The practices in the model align with all of the SDGs.
Overall, the smart city maturity model offers a structured and holistic approach to the development of smart cities. Utilizing the model’s recommendations can navigate the complexities of smart city development and provide a roadmap to successful smart initiatives.

6. Conclusions

This research aimed to develop a maturity model to support cities in assessing smart city adoption. The study started with a review of models in the literature to extract the main focus areas. These areas were then used to develop the model using the focus area maturity model development method. This method allowed interconnected domains within a smart city to be measured. In addition, the focus areas technique facilitated the fragmentation of domains into capabilities, thereby improving the accessibility of the model and enabling cities to concentrate on areas of improvement. To validate the model’s correctness and completeness, the Delphi method was used to solicit feedback from sixty expert panelists from multiple sectors. The model was then amended based on quantitative analysis of the feedback.
This study faced three main challenges. The first was the stakeholder engagement, since developing this model required input from a wide range of stakeholders. Ensuring the involvement of all stakeholders was challenging. The second was the data availability challenge; building a such model demands access to data about the city from different angles. Some data were difficult to obtain either due to unavailability or sensitivity. The third was the heterogeneity of cities; differences in the sizes, populations, social lives, economies, and priorities of cities made it challenging to develop one model that could be applied to all cities. These challenges notwithstanding, the developed model is a significant contribution to the assessment of smart city maturity.
This research is the first attempt to develop a comprehensive maturity model for assessing smart city implementation using focus areas. The topic of smart cities is vast and constantly changing, thus any model of smart city maturity must be able to evolve. Potential avenues for future research include the deployment of the model in multiple cities; then, the data can be analyzed and used to improve the model. Additionally, during the interviews, the majority of the experts expressed interest in using the output of the maturity model assessment to improve their internal processes. Continued collaboration with government and private entities would allow the model’s findings to be put into action.

Author Contributions

Writing—original draft preparation, T.A.; writing—review and editing, T.A.; supervision, M.A. and S.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A. List of Models Included in Literature Review

No.Maturity ModelModel SummarySource
1Brazilian Smart City Maturity Model (Br-SCMM)Based on the information retrieved from Brazilian cities. The model has five levels that are not incremental. However, only the first two levels have been tested and validated.[50]
2Alternative Framework for Smart City Assessment Based on the European smart city ranking [8]. The model is a ranking tool used to evaluate Seoul, Singapore, and Iskandar Malaysia to identify cities with high performance. [51]
3Reconciled Smart City Assessment Framework (RSCAF)The model assesses the city’s smartness by finding the gap between the actual and planned smart initiatives, using the city’s primary functions as a baseline. Only the conceptual design is ready. The model levels are not defined yet. [52]
4Smart City Systematic and Foresight approach It is a five-step methodological model to provide a conceptual image of smart city initiatives.[53]
5Smart City Assessment Methodology (SCAML)Composed of a reference model (SCRM) and an assessment method (SCAM). Used design science research as a method for research and Brazilian cities’ profiles as the initial scope of work. [54]
6Data Quality Driven Smart City Maturity Model (DQSC-MM)The model evaluates the smart city maturity based on the data quality. It was developed using two surveys to collect data about model dimensions. The model is based on five leverage domains, eleven key domain areas, and five maturity levels. An application was developed to measure smart city maturity based on the model.[55]
7Smart City ICT Adoption Maturity Model (SCIAMM)It is inspired by existing maturity models for smart cities, government enterprise architecture, and management models. Aimed at developing countries and has been tested on Colombian cities. It has 5 domains, 15 domain areas, 48 critical variables, and 5 maturity levels. [56]
8Smart City Projects Assessment Matrix (SC[PAM])A framework to assess and evaluate smart city projects that are related and connected. The dimensions are based on European Smart City Ranking [8]. It was assessed using five case studies.[57]
9Bahrain National Smart City FrameworkIt is a national model developed to assess the kingdom of Bahrain’s progress. Based on six dimensions and proposing five levels of maturity.[58]
10Framework for Village Smartness MaturityDeveloped for the villages based on the six dimensions identified by a group of experts. The data were collected by questionnaire. The model has four levels (high, good, medium, and low). It was tested using a single case study.[59]
11Maturity-Based Assessment ScaleIt is developed based on three main dimensions: connectivity, sustainability, and resilience. It is a descriptive model describing each of its five levels but not how to achieve them. [60]
12Smart City for Development Model (SC4D)Emphasizes how smart city initiatives can impact the city’s development. Based on six domains aiming to balance ICT with a city’s needs.[61]
13Australian Smart City RankingBuilt to compare and rank the smartness of Australian cities. Based on 6 dimensions, 90 indicators, and 26 factors.[19]
14CityDNAIt aims to provide information about the city’s smartness maturity, like human DNA provides information about the body’s health and status. The model is based on ISO 37153:2017, and the indicators are based on ISO 37120:2014. [62]
15Multiagency Modeling of Transformation It is a three-dimensional model that illustrates the city’s transformation. It is based on the ISO 37120:2018 and ISO/IEC 30146:2019 standards. It was tested in the city of Warsaw. [63]
16Value Alignment Smart City Model (VASC)A conceptual model for smart city initiatives. It assesses smart city initiatives based on a systematic literature review. The model comprises three main components: the dimensions, stakeholders, and value alignment phases. The idea of the model is mainly about stakeholders’ realization of the smart city benefits.[64]

Appendix B. Smart City Maturity Matrix

ComponentMaturity Level
01234
1ICT Infrastructure
1.1Connectivity Broadband consistencyBasic IoT projectsAdvanced IoT technologyUbiquitous connectivity
1.2Architecture Decentralized architectureBasic Cloud architectureOptimized Cloud architecture
1.3Interoperability Offline data exchangeBasic data exchange platformsAdvanced data exchange
2Digital Transformation
2.1Strategy Ad hoc transformation processesCity-wide strategyOptimized strategy
2.2E-services Multi-channel e-servicesEnable e-participationOptimized and integrated e-services
2.3Innovation Recognize innovation occasionallyLimited innovation recognitionStrategic innovation recognition
2.4Cybersecurity Ad hoc cybersecurity practicesStrategic cybersecurity practicesOptimized cybersecurity practices
3Data
3.1Data Management Data collectionLimited data managementStrategic data management
3.2Data Analytics Basic data reportingPredictive data analysisStrategic data management
4Labor Market
4.1Unemployment eradication Limited attention to unemployment Strategic solutions for unemploymentOptimized unemployment strategy
4.2Access to Finance Limited access to financeStrategic financing pocketsOptimized financing strategy
4.3Productivity Efficiency Decentralized productivity measurementCentralized productivity measurementImproving productivity
5Entrepreneurship
5.1Public-private partnership Basic practices for PPPWell-established PPP practicesOptimized PPP practices
5.2Research and Development Basic research and developmentWell-established research and development
6Pollution Control
6.1Air Quality Management Basic efforts to enhance air qualityWell-defined policies for air quality controlEnforced policies for air quality controlImplement air pollution prevention measures
6.2Water Quality Management Basic efforts to enhance water qualityWell-defined policies for water quality controlEnforced policies for water quality controlImplement water pollution prevention measures
6.3Soil Quality Management Basic efforts to enhance soil qualityWell-defined policies for soil quality controlEnforced policies for soil quality controlImplement soil pollution prevention measures
6.4Noise Pollution Control Basic efforts to measure noiseWell-defined policies to monitor noise pollutionEnforced policies for noise pollution controlImplement noise pollution prevention measures
7Environmental Management
7.1Biodiversity Conservation Basic efforts against biodiversityWell-defined biodiversity metricsBenchmarked biodiversity regulationsProactive practices for biodiversity
7.2Waste Management Basic waste management effortsWell-defined waste management metricsAdvanced waste management regulationsProactive waste management practices
7.3Environmental Awareness Basic efforts for improving awarenessWell-defined environmental awareness metricsCity-wide optimized efforts for awareness
7.4Climate Change Basic efforts against climate changeWell-defined climate change metricsBenchmarked climate change regulations and policiesProactive practices for climate change
8Education
8.1Education Quality Basic efforts for education qualityClearly defined quality standardsOptimized quality standards
8.2Skills and Competencies Basic skills assessmentRobust skills reformsOptimized skills reforms
9Social Equity
9.1Social inclusion and Equity Basic social inclusion acknowledgmentRobust system for social inclusionOptimized social inclusion culture
9.2Social Protection Basic social protection programsRobust system for social protectionOptimized social protection programs
10Citizen active lifestyle
10.1Community Programs Basic community programsRobust system for community programsComprehensive community programs
10.2Citizen’s engagement Basic citizens’ engagement plansRobust system for citizen’s participationCitizens proactive engagement
11Water Resources Management
11.1Water Resources Planning Ad hoc water resources planningStrategic water resources planningOptimized water resources planning
11.2Water Management Limited water managementAdvanced water managementOptimized water management
12Sustainable and efficient energy
12.1Energy Efficiency Limited energy efficiency monitoringAdvanced energy efficiency monitoringOptimized energy efficiency monitoring
12.2Renewable Energy Limited renewable energy implementationStrategic renewable energy implementationOptimized renewable energy implementation
13Urban Planning and Management
13.1Housing Services Limited housing services qualityAdvanced housing services qualityOptimized housing services quality
13.2Road Services Limited road services qualityAdvanced road services qualityOptimized road services quality
13.3Urban Design Limited urban planning standardsAdvanced urban planning and designOptimized city urban design
14Healthcare System
14.1Healthcare services Uncoordinated healthcare services Integrated healthcare services Preventive healthcare services
15Transport System
15.1Sustainable Transportation Limited initiatives for sustainable transportationAdvanced for sustainable transportationOptimized sustainable transportation initiatives
15.2Traffic Management Limited traffic management initiativesIntegrated traffic management systemOptimized traffic management system
16Safety and Security
16.1Law enforcement Limited efforts to fight the crimeStrategic law enforcement systemOptimized law enforcement system
16.2Public surveillance system Limited security measuresAdvanced public security systemOptimized public security system
16.3Disaster Management Limited disaster recovery plansStrategic disaster recovery plansOptimized disaster recovery plans
17Political Structure
17.1Legal and Regulations Stability Limited stability in the political systemStable political systemOptimized political system based on democracy
17.2Coherence between government agencies Siloed operating modelConsistent integration between agenciesOptimized integration between agencies
18Strategic Planning
18.1Smart city vision and team Project-focused strategyStrategic smart city visionOptimized smart city strategy
18.2Public transparency Limited access to decision-making processesTransparent system for decision makingDecision-making processes based on citizens’ feedback

Appendix C. Practices of ICT Focus Area Group

ICT infrastructureConnectivityPractice Code: 1.1.1Practice Name: Broadband consistency
Description: The broadband network is consistent across the city
Practice Code: 1.1.2Practice Name: Basic IoT projects
Description: Some projects utilize IoT applications and devices
Practice Code: 1.1.3Practice Name: Advanced IoT technology
Description: A city-wide plan for utilization of the IoT applications and devices
Practice Code: 1.1.4Practice Name: Ubiquitous connectivity
Description: Ubiquitous connectivity that connects IoT devices, people, and services
ICT infrastructureArchitecturePractice Code: 1.2.1Practice Name: Decentralized architecture
Description: Decentralized systems architecture that can support silos projects only.
Practice Code: 1.2.2Practice Name: Basic Cloud architecture
Description: Consolidated, scalable Cloud-based architecture
Practice Code: 1.2.3Practice Name: Optimized Cloud architecture
Description: Optimized Cloud-based architecture that supports agile development
ICT infrastructureInteroperabilityPractice Code: 1.3.1Practice Name: Offline data exchange
Description: Projects are implemented in silos that do not communicate, and no mechanism for online data exchange between different entities.
Practice Code: 1.3.2Practice Name: Basic data exchange platforms
Description: Some pilots are implemented with open data platforms to exchange data
Practice Code: 1.3.3Practice Name: Advanced data exchange
Description: Systems communicate seamlessly through cross-organizational collaboration
Digital TransformationStrategyPractice Code: 2.1.1Practice Name: Ad hoc transformation processes
Description: Ad hoc processes in place for digital transformation.
Practice Code: 2.1.2Practice Name: City-wide strategy
Description: Well-defined, city-wide strategy for identifying the latest technology and clear processes for adoption.
Practice Code: 2.1.3Practice Name: Optimized strategy
Description: Periodic review of the digital transformation strategy to ensure linking the investments to outcomes.
Digital TransformationE-servicesPractice Code: 2.2.1Practice Name: Multichannel e-services
Description: Enable the stakeholders to perform online transactions any time and through multiple channels.
Practice Code: 2.2.2Practice Name: Enable e-participation
Description: Social participation of stakeholders in e-services that shape the decision-making process.
Practice Code: 2.2.3Practice Name: Optimized and integrated e-services
Description: Optimized and integrated online services that are based on best practices.
Digital TransformationInnovationPractice Code: 2.3.1Practice Name: Recognize innovation occasionally
Description: Ad hoc recognition for innovative ideas
Practice Code: 2.3.2Practice Name: Limited innovation recognition
Description: Innovative ideas are considered by individual organizations’ practices.
Practice Code: 2.3.3Practice Name: Strategic innovation recognition
Description: City-wide recognition for innovative ideas with a defined budget for the ideas’ implementation.
Digital TransformationCybersecurityPractice Code: 2.4.1Practice Name: Ad hoc cybersecurity practices
Description: Initial and ad hoc practices in place for cybersecurity
Practice Code: 2.4.2Practice Name: Strategic cybersecurity practices
Description: Well-defined strategy that is implemented by a dedicated entity with adequate resources (human and financial) assigned.
Practice Code: 2.4.3Practice Name: Optimized cybersecurity practices
Description: Optimized cybersecurity practices by evaluating and benchmarking the performed practices.
DataData ManagementPractice Code: 3.1.1Practice Name: Data collection
Description: Lack of data centralization, no integration between organizations for data sharing, access to data is limited and data can have accuracy issues
Practice Code: 3.1.2Practice Name: Limited data management
Description: The city acknowledges data significance and data is treated as a critical asset.
Practice Code: 3.1.3Practice Name: Strategic data management
Description: Data is used on a city-wide scale to give citizens information and achieve a proactive decision-making process.
DataData AnalyticsPractice Code: 3.2.1Practice Name: Basic data reporting
Description: Only descriptive data analytics exists that can explain the data
Practice Code: 3.2.2Practice Name: Predictive data analytics
Description: Predictive data analytics exists to forecast the future.
Practice Code: 3.2.3Practice Name: Strategic data analytics
Description: Advanced prescriptive city-wide data analytics that is used to guide the decision makers in achieving best-case scenarios.

Appendix D. Assessment Tool for ICT Focus Area Group

CapabilityNo.Checkpoint
Focus Area: ICT Infrastructure
Connectivity
Broadband consistency1Does the broadband network cover all parts of the city?
2Is the broadband network accessible to all relevant stakeholders?
3Is the connectivity affordable and reliable?
Basic IoT projects4Do you have projects that use IoT devices for providing real-time data?
5Is the provided data utilized by the relevant stakeholders?
6Do you have a clear plan or strategy for IoT applications and devices utilization on a city-wide level?
Advanced IoT technology7Do you have the needed governance system (i.e., standards, action plans, regulatory measures, and administrative capacity) to enforce the IoT strategy?
8Do you analyze the city’s connectivity and IoT projects’ performances to improve policies, standards, and outcomes?
9Do you benchmark your standards, programs, and achievements internationally and encourage best practices adoption?
Ubiquitous connectivity10Are all related services, devices, and people connected seamlessly
11Is the effectiveness of the connectivity evaluated and reported to the stakeholders?
12Do you benchmark your standards, programs, and achievements internationally and encourage best practices adoption when it comes to ubiquitous connectivity?
Architecture
Decentralized architecture13Are the systems architecture needs clearly identified and serve the projects’ requirements?
14Do you have a consistent understanding across all sectors of the significance of centralized architecture?
15Do you have access to the infrastructure resources required to deploy your projects?
Basic Cloud architecture16Do you have a city-wide strategy for Cloud-based architecture?
17Do you have the needed governance system (i.e., standards, action plans, regulatory measures, and administrative capacity) to enforce the Cloud-based strategy?
18Does your process of workload allocation support agile development?
Optimized Cloud architecture19Do you regularly evaluate your Cloud workloads to optimize performance and cost?
20Did you evaluate the outcome and impact of the Cloud’s implementation?
21Do you benchmark your standards, programs, and achievements internationally and encourage best practices adoption?
Interoperability
Offline data exchange22Is data exchange between systems possible through data extraction and data import operations?
23Do all smart city projects have steering authority to ensure they follow city guidelines and standards
24Do your systems support open protocols to ensure their independence from the complexity of other systems/devices?
Basic data exchange platforms25Do you follow any predefined standards, local or international, to ensure the security, performance, scalability, and resilience of systems?
26Does the steering authority ensure that the project output will not interfere with other implemented projects?
27Have you implemented an open data platform by coordinating data exchange between different organizations?
Advanced data exchange28Do your systems allow real-time data collection?
29Are all related functions grouped in shared systems that have cross-organizational ownership?
30Does the data flow between systems in both directions eliminate redundancy?
Focus Area: Digital Transformation
Strategy
Ad hoc transformation processes31Is there awareness regarding the need for a digital transformation strategy?
32Do you have a clear digital transformation strategy for the city?
33Do you have a cross-sectorial body that provides support and ensures effective implementation of the strategy?
Citywide Strategy34Do you proactively bring in the latest technology trends based on the predefined strategy?
35Is the strategy communicated and reported properly to all relevant stakeholders based on a clear mechanism for stakeholder involvement and citizen engagement?
36Do you refer to the strategy before any change or modification?
Optimized Strategy37Do you periodically evaluate, report, and reflect on the strategy?
38Do you amend the strategy based on feedback gathered from relevant stakeholders and citizens?
39Do you benchmark your strategy to international standards and other cities’ strategies?
E-services
Multi-channel e-services49Do all government agencies have an active web presence that provides all the needed information?
41Are the majority of the services that are offered by the government and private sector available online?
42Are the offered services accessible through multiple channels?
Enable e-participation43Do you have citywide guidelines/standards to define and regulate organizations’ web presence?
44Do you measure the quality of services regularly and communicate reports to stakeholders and citizens?
45Do you utilize social media channels to ensure public involvement in the decision-making process?
Optimized and integrated e-services46Do you perform process reengineering of the processes behind the services offered?
47Do you evaluate the offered e-services regularly and perform revisions based on the citizens’ feedback?
48Do you benchmark your standards, e-services, and achievements internationally and encourage best practices adoption?
Innovation
Recognize innovation occasionally49Does the city promote an innovation culture?
50Does the city provide access to innovative resources that can be utilized in smart city applications?
51Do the city’s organizations support agility?
Limited innovation recognition52Does the city provide enough incentives to encourage innovation?
53Does the city provide programs that cultivate innovation?
54Do the research centers the and academic community play a strong role in shaping the city strategy?
Strategic innovation recognition55Do you have a designated entity and defined budget to facilitate innovation and measure the efficiency of implementation?
56Do you analyze the effect and expected value of innovation on digital transformation?
57Does the city benchmark its innovation ecosystem with global standards?
Cybersecurity
Ad hoc cybersecurity practices58Do you have education and training programs directed at cybersecurity professionals?
59Does the city conduct cybersecurity awareness campaigns directed at different categories (i.e., government, private organizations, citizens) to raise awareness?
60Do you have laws and legalizations that regulate data protection, online identity and data theft, and online antisocial behavior?
Strategic cybersecurity practices61Does the city have a dedicated entity responsible for managing cyber risks city wide?
62Does the government offer incentives to adhere to cybersecurity adoption?
63Does the cybersecurity strategy cover business continuity plans?
Optimized cybersecurity practices64Does the city respond promptly and act systematically against cybercrime incidents?
65Do you revise your cybersecurity strategy to ensure it is up to date and matches international standards?
66Are you part of any bilateral or multilateral international agreements for cybersecurity cooperation?
Focus Area: Data
Data Management
Data collection67Does the city acknowledge data ownership and provide clear guidance to data sources?
68Are data-sharing platforms available to stakeholders to empower them?
69Is there awareness regarding data management processes?
Limited data management70Do you have a citywide data management strategy that ensures proper data collection, processing, utilization, and distribution?
71Are the data management policies, standards, and guidelines communicated properly to the stakeholders?
72Are data governance roles and responsibilities clearly defined and communicated?
Strategic data management73Do you regularly evaluate the effectiveness of data management strategy and modify based on the metrics results?
74Do you apply data management best practices and international standards?
75Do you continually improve your data management strategy, standards, and practices?
Data Analytics
Basic data reporting76Do you have a consistent understanding across all sectors of the significance of analytics and how to utilize them in decision making?
77Are all the data sources digitized, cleaned, documented, and accessible to the concerned stakeholders for analytics?
78Do you have a city-wide strategy for analytics services?
Predictive data analytics79Are the analytics services embedded in all the processes of all sectors?
80Do you have a workforce with the needed skills to utilize data analytics possibilities?
81Do you use structured and unstructured data and big data?
Strategic data analytics82Is the analytics strategy and operations subject to regular evaluation and benchmark reviews?
83Do you utilize the latest tools in machine learning, artificial intelligence, and data visualization to achieve data analytics objectives?
84Has the city reached the level of prescriptive analytics, where it can automatically suggest the best actions and optimization options?

References

  1. United Nations Human Settlements Programme. World Cities Report 2020. The Value of Sustainable Urbanization. 2020. Available online: https://unhabitat.org/world-cities-report-2020-the-value-of-sustainable-urbanization (accessed on 15 November 2020).
  2. United Nations. Transforming Our World: The 2030 Agenda for Sustainable Development. Available online: https://sustainabledevelopment.un.org/content/documents/21252030%20Agenda%20for%20Sustainable%20Development%20web.pdf (accessed on 15 November 2020).
  3. Ismagilova, E.; Hughes, L.; Dwivedi, Y.K.; Raman, K.R. Smart cities: Advances in research—An information systems perspective. Int. J. Inf. Manag. 2019, 47, 88–100. [Google Scholar] [CrossRef]
  4. Klopp, J.M.; Petretta, D.L. The urban sustainable development goal: Indicators, complexity and the politics of measuring cities. Cities 2017, 63, 92–97. [Google Scholar] [CrossRef]
  5. Belanche, D.; Casaló, L.V.; Orús, C. City attachment and use of urban services: Benefits for smart cities. Cities 2016, 50, 75–81. [Google Scholar] [CrossRef]
  6. Marchetti, D.; Oliveira, R.; Figueira, A.R. Are global north smart city models capable to assess Latin American cities? A model and indicators for a new context. Cities 2019, 92, 197–207. [Google Scholar] [CrossRef]
  7. Fernández-Güell, J.-M.; Guzmán-Araña, S.; Collado-Lara, M.; Fernández-Añez, V. How to incorporate urban complexity, diversity and intelligence into smart cities initiatives. In Smart Cities. Smart-CT 2016; Alba, E., Chicano, F., Luque, G., Eds.; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2016; Volume 9704. [Google Scholar] [CrossRef]
  8. Giffinger, R.; Fertner, C.; Kramer, H.; Kalasek, R.; Pichler-Milanović, N.; Meijers, E. Smart Cities-Ranking of European Medium-Sized Cities [Final Report]; Centre of Regional Science, Vienna University of Technology: Vienna, Austria, 2007; Available online: https://www.smart-cities.eu/download/smart_cities_final_report.pdf (accessed on 1 December 2020).
  9. Clarke, R.Y. Smart Cities and the Internet of Everything: The Foundation for Delivering Next-Generation Citizen Services [White Paper]. IDC Government Insights. 2013. Available online: https://www.cisco.com/c/dam/en_us/solutions/industries/docs/scc/ioe_citizen_svcs_white_paper_idc_2013.pdf (accessed on 1 December 2020).
  10. British Standards Institution. PAS 180 Smart Cities. Vocabulary; BSI: London, UK, 2014. [Google Scholar]
  11. International Telecommunication Union. Smart Sustainable Cities: An Analysis of Definitions [ITU-T Focus Group on Smart Sustainable Cities Technical Report FG-SSC]. 2014. Available online: https://www.itu.int/en/ITU-T/focusgroups/ssc/Documents/website/web-fg-ssc-0029-r14-overview_role_of_ICT.docx (accessed on 15 November 2020).
  12. Ruhlandt, R. The governance of smart cities: A systematic literature review. Cities 2018, 81, 1–23. [Google Scholar] [CrossRef]
  13. Castelnovo, W.; Misuraca, G.; Savoldelli, A. Smart cities governance: The need for a holistic approach to assessing urban participatory policy making. Soc. Sci. Comput. Rev. 2016, 34, 724–739. [Google Scholar] [CrossRef]
  14. Sharifi, A. A critical review of selected smart city assessment tools and indicator sets. Clean Prod. 2019, 233, 1269–1283. [Google Scholar] [CrossRef]
  15. Patrão, C.; Moura, P.; de Almeida, A.T. Review of smart city assessment tools. Smart Cities 2020, 3, 1117–1132. [Google Scholar] [CrossRef]
  16. BSI (British Standards Institution). The Role of Standards in Smart Cities [Technical Paper]. 2014. Available online: https://www.bsigroup.com/LocalFiles/en-GB/smart-cities/resources/The-Role-of-Standards-in-Smart-Cities-Issue-2-August-2014.pdf (accessed on 15 November 2020).
  17. Caird, S.P.; Hallett, S.H. Towards evaluation design for smart city development. J. Urban Des. 2019, 24, 188–209. [Google Scholar] [CrossRef]
  18. de Santana, E.d.S.; de Oliveira Nunes, É.; Santos, L.B. The use of ISO 37122 as standard for assessing the maturity level of a smart city. Int. J. Adv. Eng. Res. Sci. 2018, 5, 309–315. [Google Scholar] [CrossRef]
  19. Tariq, M.A.U.R.; Faumatu, A.; Hussein, M.; Shahid, M.L.U.R.; Muttil, N. Smart city-ranking of major Australian cities to achieve a smarter future. Sustainability 2020, 12, 2797. [Google Scholar] [CrossRef]
  20. Giffinger, R.; Haindlmaier, G. Smart cities ranking: An effective instrument for the positioning of the cities? ACE Archit. City Environ. 2010, 4, 7–26. [Google Scholar] [CrossRef]
  21. Bosch, P.; Jongeneel, S.; Rovers, V.; Neumann, H.-M.; Airaksinen, M.; Huovila, A. CITYkeys Indicators for Smart City Projects and Smart Cities; European Commission and H2020 Programme; 2017. [Google Scholar] [CrossRef]
  22. Hafedh, C.; Nam, T.; Walker, S. Understanding smart cities: An integrative framework. In Proceedings of the 2012 45th Hawaii International Conference on System Sciences, Maui, HI, USA, 4–7 January 2012. [Google Scholar] [CrossRef]
  23. dos Santos-Neto, J.B.S.; Costa, A.P.C.S. Enterprise maturity models: A systematic literature review. Enterp. Inf. Syst. 2019, 13, 719–769. [Google Scholar] [CrossRef]
  24. Liu, J.; Chen, N.; Chen, Z.; Xu, L.; Du, W.; Zhang, Y.; Wang, C. Towards sustainable smart cities: Maturity assessment and development pattern recognition in China. J. Clean. Prod. 2022, 370, 133248. [Google Scholar] [CrossRef]
  25. de Bruin, T.; Freeze, R.; Kulkarni, U.; Rosemann, M. Understanding the main phases of developing a maturity assessment model. In Proceedings of the ACIS 2005 Proceedings, Jeju Island, Republic of Korea, 14–16 July 2005; Volume 109. Available online: https://aisel.aisnet.org/acis2005/109 (accessed on 14 February 2021).
  26. Gochermann, J.; Nee, I. The idea maturity model—A dynamic approach to evaluate idea maturity. Int. J. Innov. Technol. Manag. 2018, 16, 1950030. [Google Scholar] [CrossRef]
  27. van Steenbergen, M.; van den Berg, M.; Brinkkemper, S. A balanced approach to developing the enterprise architecture practice. In Proceedings of the Enterprise Information Systems: 9th International Conference (ICEIS 2007), Funchal, Madeira, 12–16 June 2007; Revised Selected Papers 9. Springer: Berlin/Heidelberg, Germany, 2008; pp. 240–253. [Google Scholar] [CrossRef]
  28. Spruit, M.; Roeling, M. ISFAM: The Information Security Focus Area Maturity Model. ECIS 2014 Proceedings. Available online: https://aisel.aisnet.org/ecis2014/proceedings/track14/6/ (accessed on 15 March 2021).
  29. Jansen, S. A focus area maturity model for software ecosystem governance. Inf. Softw. Technol. 2020, 118, 106219. [Google Scholar] [CrossRef]
  30. Sanchez-Puchol, F.; Pastor-Collado, J.A. Focus area maturity models: A comparative review. In Proceedings of the Information Systems: 14th European, Mediterranean, and Middle Eastern Conference (EMCIS 2017), Coimbra, Portugal, 7–8 September 2017; Proceedings 14. Springer: Berlin/Heidelberg, Germany, 2017; pp. 531–544. [Google Scholar] [CrossRef]
  31. van Steenbergen, M.; Bos, R.; Brinkkemper, S.; van de Weerd, I.; Bekkers, W. The design of focus area maturity models. In Global Perspectives on Design Science Research. DESRIST 2010; Winter, R., Zhao, J.L., Aier, S., Eds.; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2010; Volume 6105. [Google Scholar] [CrossRef]
  32. Overeem, M.; Mathijssen, M.; Jansen, S. API-m-FAMM: A focus area maturity model for API management. Inf. Softw. Technol. 2022, 147, 106890. [Google Scholar] [CrossRef]
  33. Wolfswinkel, J.F.; Furtmueller, E.; Wilderom, C.P.M. Using grounded theory as a method for rigorously reviewing literature. Eur. J. Inf. Syst. 2013, 22, 45–55. [Google Scholar] [CrossRef]
  34. Duncan, J.; Xu, W.; Narus, S.P.; Nangle, B.; Thornton, S.; Facelli, J. A focus area maturity model for a statewide master person index. Online J. Public Health Inform. 2013, 5, 210. [Google Scholar] [CrossRef]
  35. Kırmızı, M.; Kocaoglu, B. Digital transformation maturity model development framework based on design science: Case studies in manufacturing industry. J. Manuf. Technol. Manag. 2022, 33, 1319–1346. [Google Scholar] [CrossRef]
  36. Williams, C.A.; Krumay, B.; Schallmo, D.; Scornavacca, E. An interaction-based digital maturity model for SMEs. In Proceedings of the ACIS 2022 Proceedings, Melbourne, Australia, 4–7 December 2022; Volume 254. [Google Scholar]
  37. van Steenbergen, M.; Bos, R.; Brinkkemper, S.; van de Weerd, I.; Bekkers, W. Improving IS functions step by step: The use of focus area maturity models. Scand. J. Inf. Syst. 2013, 25, 2. [Google Scholar]
  38. Yigit Ozkan, B.; van Lingen, S.; Spruit, M. The cybersecurity focus area maturity (CYSFAM) model. J. Cybersecur. Priv. 2021, 1, 119–139. [Google Scholar] [CrossRef]
  39. Gallotta, B.; Garza-Reyes, J.A.; Anosike, A. Using the Delphi method to verify a framework to implement sustainability initiatives. In Proceedings of the International Conference on Industrial Engineering and Operations Management, Bandung, Indonesia, 6–8 March 2018; IEOM Society: Southfield, MI, USA, 2018; p. 92922. [Google Scholar]
  40. de Bruin, T.; Rosemann, M. Using the Delphi technique to identify BPM capability areas. In Proceedings of the ACIS 2007 Proceedings, Melbourne, Australia, 11–13 July 2007; Volume 42. Available online: https://aisel.aisnet.org/acis2007/42 (accessed on 1 May 2021).
  41. Głuszek, E. Use of the e-Delphi method to validate the corporate reputation management maturity model (CR3M). Sustainability 2021, 13, 12019. [Google Scholar] [CrossRef]
  42. Al-Sai, Z.A.; Husin, M.H.; Syed-Mohamad, S.M.; Abdullah, R.; Zitar, R.A.; Abualigah, L.; Gandomi, A.H. Data Maturity Assessment Models: A Systematic Literature Review. Big Data Cogn. Comput. 2023, 7, 2. [Google Scholar] [CrossRef]
  43. Keeney, R.L.; Gregory, R.S. Selecting attributes to measure the achievement of objectives. Oper. Res. 2005, 53, 1–11. [Google Scholar] [CrossRef]
  44. Schumann, A. Using Outcome Indicators to Improve Policies: Methods, Design Strategies and Implementation [Organisation for Economic Co-Operation and Development Regional Development Working Papers]; Organisation for Economic Cooperation and Development: Paris, France, 2016. [CrossRef]
  45. Taze, D.; Hartley, C.; Morgan, A.W.; Chakrabarty, A.; Mackie, S.L.; Griffin, K.J. Developing consensus in Histopathology: The role of the Delphi method. Histopathology 2022, 81, 159–167. [Google Scholar] [CrossRef]
  46. Boel, A.; Navarro-Compán, V.; Landewé, R.; van der Heijde, D. Two different invitation approaches for consecutive rounds of a Delphi survey led to comparable final outcome. J. Clin. Epidemiol. 2021, 129, 31–39. [Google Scholar] [CrossRef]
  47. Culley, J.M. Use of a computer-mediated Delphi process to validate a mass casualty conceptual model. Comput. Inform. Nurs. CIN 2011, 29, 272. [Google Scholar] [CrossRef]
  48. Schmalz, U.; Spinler, S.; Ringbeck, J. Lessons learned from a two-round Delphi-based scenario study. MethodsX 2021, 8, 101179. [Google Scholar] [CrossRef]
  49. Parker, C.; Scott, S.; Geddes, A. Snowball sampling. In SAGE Research Methods Foundations; Atkinson, P., Delamont, S., Cernat, A., Sakshaug, J.W., Williams, R.A., Eds.; SAGE Publications: Thousand Oaks, CA, USA, 2019. [Google Scholar] [CrossRef]
  50. Afonso, R.A.; dos Santos Brito, K.; do Nascimento, C.H.; Garcia, V.C.; Álvaro, A. Brazilian smart cities: Using a maturity model to measure and compare inequality in cities. In Proceedings of the 16th Annual International Conference on Digital Government Research, Phoenix, AZ, USA, 27–30 May 2015. [Google Scholar] [CrossRef]
  51. Adnan, Y.M.; Hamzah, H.; Dali, M.M.; Daud, M.N.; Alias, A. An initiatives-based framework for assessing smart city. Plan. Malays. 2016, 5. [Google Scholar] [CrossRef]
  52. Hamzah, H.; Adnan, Y.M.; Daud, M.N.; Alias, A.; Dali, M.M. A smart city assessment framework. In Proceedings of the 8th International Real Estate Researchers Symposium (IRERS), Kuala Lumpur, Malaysia, 26–28 April 2016; pp. 1–5. [Google Scholar]
  53. Fernández-Güell, J.-M.; Collado-Lara, M.; Guzmán-Araña, S.; Fernández-Añez, V. Incorporating a systemic and foresight approach into smart city initiatives: The case of Spanish cities. J. Urban Technol. 2016, 23, 43–67. [Google Scholar] [CrossRef]
  54. Porto, J.B.; Macadar, M.A. Assessment methodology in smart cities based on public value. In Proceedings of the 18th Annual International Conference on Digital Government Research (dg.o ‘17), Staten Island, NY, USA, 7–9 June 2017; Association for Computing Machinery: New York, NY, USA, 2017; pp. 460–470. [Google Scholar] [CrossRef]
  55. Korachi, Z.; Bounabat, B. Data driven maturity model for assessing smart cities. In Proceedings of the 2nd International Conference on Smart Digital Environment (ICSDE ’18), Rabat, Morocco, 18–20 October 2018; Association for Computing Machinery: New York, NY, USA, 2018; pp. 140–147. [Google Scholar] [CrossRef]
  56. Maestre, G.; Astudillo, H.; Concha, G.; Nieto, W. Empirical evidence of Colombian national e-government programs’ impact on local smart city-adoption. In Proceedings of the 11th international conference on theory and practice of electronic governance (ICEGOV ’18), Galway, Ireland, 4–6 April 2018; Association for Computing Machinery: New York, NY, USA, 2018; pp. 517–525. [Google Scholar] [CrossRef]
  57. Fernandez-Anez, V.; Velazquez, G.; Perez-Prada, F.; Monzón, A. Smart city projects assessment matrix: Connecting challenges and actions in the Mediterranean region. J. Urban Technol. 2020, 27, 79–103. [Google Scholar] [CrossRef]
  58. Al-Ammal, H.; Aljawder, M. Development of a national smart city initiatives framework for the Kingdom of Bahrain: A blueprint for successful smart cities. In Smart Cities in the Gulf; Samad, W.A., Azar, E., Eds.; Palgrave Macmillan: Hampshire, UK, 2019; pp. 41–57. [Google Scholar] [CrossRef]
  59. Martinez-Gil, J.; Pichler, M.; Beranič, T.; Brezočnik, L.; Turkanović, M.; Lentini, G.; Polettini, F.; Lué, A.; Vitale, A.C.; Doukhan, G.; et al. Framework for assessing the smartness maturity level of villages. In New Trends in Databases and Information Systems. ADBIS 2019; Welzer, T., Podgorelec, V., Wrembel, R., Ivanović, M., Gamper, J., Morzy, M., Tzouramanis, T., Darmont, J., Latifić, A.K., Eds.; Communications in Computer and Information Science; Springer: Berlin/Heidelberg, Germany, 2019; Volume 1064. [Google Scholar] [CrossRef]
  60. AlaEldin, S.; Rankin, J.; Robak, A. Maturity-based scale for smart cities: A conceptual framework. In Proceedings of the Canadian Society for Civil Engineering, the Annual Conference, Montreal, QC, Canada, 12–15 June 2019. [Google Scholar]
  61. Joia, L.A.; Kuhl, A. Smart city for development: A conceptual model for developing countries. In Information and Communication Technologies for Development. Strengthening Southern-Driven Cooperation as a Catalyst for ICT4D; Nielsen, P., Kimaro, H.C., Eds.; Springer International Publishing: Zurich, Switwerland, 2019. [Google Scholar]
  62. Moustaka, V.; Maitis, A.; Vakali, A.; Anthopoulos, L.G. CityDNA dynamics: A model for smart city maturity and performance benchmarking. In Proceedings of the Companion Proceedings of the Web Conference 2020 (WWW ’20), Taipei, Taiwan, 20–24 April 2020; Association for Computing Machinery: New York, NY, USA, 2020; pp. 829–833. [Google Scholar] [CrossRef]
  63. Gotlib, D.; Kulisiewicz, T.; Muraszkiewicz, M.; Olszewski, R. Multiagency modeling of transformation strategies towards sustainable smart cities. Appl. Sci. 2020, 10, 853. [Google Scholar] [CrossRef]
  64. van der Hoogen, A.; Scholtz, B.; Calitz, A.P. Using theories to design a value alignment model for smart city initiatives. In Responsible Design, Implementation and Use of Information and Communication Technology. I3E 2020; Hattingh, M., Matthee, M., Smuts, H., Pappas, I., Dwivedi, Y., Mäntymäki, M., Eds.; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2020; Volume 12066. [Google Scholar] [CrossRef]
Figure 1. The development methodology of the smart city maturity model.
Figure 1. The development methodology of the smart city maturity model.
Smartcities 06 00099 g001
Figure 2. Steps of the Delphi method (adapted from [48] with modifications).
Figure 2. Steps of the Delphi method (adapted from [48] with modifications).
Smartcities 06 00099 g002
Figure 3. Final Components of the Smart City Maturity Model.
Figure 3. Final Components of the Smart City Maturity Model.
Smartcities 06 00099 g003
Figure 4. Descriptions of Connectivity Practices.
Figure 4. Descriptions of Connectivity Practices.
Smartcities 06 00099 g004
Table 1. Maturity model development methodologies.
Table 1. Maturity model development methodologies.
MethodologyPhaseDescription
Generic development frameworkScopeDecide on the model focus (general or domain specific) and development stakeholders (academia, practitioners, government)
DesignThe architecture basis: Why the model is required? How it will be applied to different organizations? Who should be involved? What can be achieved?
PopulateSpecify what needs to be measured and how it can be measured?
TestTest the model validity, reliability, and generalizability
DeployMaking the model available to its intended users
Development framework for focus area maturity modelsIdentify the scope and functional domainDecide on what to include and exclude
Determine focus areasBased on the literature review, then exploratory methods
Determine capabilitiesCapabilities define the incremental path for maturity levels’ progress
Determine dependenciesSpecify the order of the capabilities within and between focus areas
Position capabilities in matrixBased on the specified dependencies
Develop assessment instrumentSpecify assessment questions for the capabilities based on the description
Define improvement actionsGeneral suggestions
Implement maturity modelThe first implementation is for model evaluation
Improve matrix iterativelyEnough assessment data to be collected for the model evaluation
Communicate resultsTo practitioners and academia
Table 2. Count of publications.
Table 2. Count of publications.
DatabaseNo. of Papers in the Initial ResultsNo. of Papers after 1st Round of ExclusionNo. of Papers after 2nd Round of Exclusion
Scopus43375
Springerlink779323
Taylor & Francis890181
ScienceDirect1750
ACM665
ResearchGate24162
Total175911416
Table 3. Checkpoints to determine level 1 of ICT infrastructure/connectivity.
Table 3. Checkpoints to determine level 1 of ICT infrastructure/connectivity.
ICT
Focus Area: ICT Infrastructure/Connectivity
Broadband consistency1Does the broadband network cover all parts of the city?
2Is the broadband network accessible to all relevant stakeholders?
3Is the connectivity affordable and reliable?
Table 4. Focus area clusters for interviews.
Table 4. Focus area clusters for interviews.
Cluster No.Focus Area GroupFocus Area
1ICTICT infrastructure, Digital Transformation, Data
2EconomyLabor Market, Entrepreneurship
3EnvironmentPollution, Environmental Management
4SocialEducation
5SocialSocial Equity, Citizen Active Lifestyle
6ResourcesWater Resources Management, Energy Sustainability
7ServicesUrban Planning and Management
8ServicesHealthcare System
9ServicesTransport System
10ServicesSafety and Security
11GovernancePolitical Structure
12GovernanceStrategic Planning
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Aljowder, T.; Ali, M.; Kurnia, S. Development of a Maturity Model for Assessing Smart Cities: A Focus Area Maturity Model. Smart Cities 2023, 6, 2150-2175. https://doi.org/10.3390/smartcities6040099

AMA Style

Aljowder T, Ali M, Kurnia S. Development of a Maturity Model for Assessing Smart Cities: A Focus Area Maturity Model. Smart Cities. 2023; 6(4):2150-2175. https://doi.org/10.3390/smartcities6040099

Chicago/Turabian Style

Aljowder, Thajba, Mazen Ali, and Sherah Kurnia. 2023. "Development of a Maturity Model for Assessing Smart Cities: A Focus Area Maturity Model" Smart Cities 6, no. 4: 2150-2175. https://doi.org/10.3390/smartcities6040099

APA Style

Aljowder, T., Ali, M., & Kurnia, S. (2023). Development of a Maturity Model for Assessing Smart Cities: A Focus Area Maturity Model. Smart Cities, 6(4), 2150-2175. https://doi.org/10.3390/smartcities6040099

Article Metrics

Back to TopTop