Next Article in Journal
Modeling the Market-Driven Composition of the Passenger Vehicle Market during the Transition to Electric Vehicles
Next Article in Special Issue
Tracking Interoperability and Data Quality: A Methodology with BPMN 2.0 Extensions and Performance Evaluation
Previous Article in Journal
Shell-Based Finite Element Modeling of Herøysund Bridge in Norway
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

DIAG Approach: Introducing the Cognitive Process Mining by an Ontology-Driven Approach to Diagnose and Explain Concept Drifts

1
Production Engineering Laboratory (LGP), National Engineering School of Tarbes (ENIT), Tarbes University of Technology (UTTOP), 65000 Tarbes, France
2
Industrial Engineering Center (CGI) of IMT Mines Albi, 81000 Albi, France
*
Author to whom correspondence should be addressed.
Modelling 2024, 5(1), 85-98; https://doi.org/10.3390/modelling5010006
Submission received: 27 November 2023 / Revised: 14 December 2023 / Accepted: 22 December 2023 / Published: 27 December 2023

Abstract

:
The remarkable growth of process mining applications in care pathway monitoring is undeniable. One of the sub-emerging case studies is the use of patients’ location data in process mining analyses. While the streamlining of published works is focused on introducing process discovery algorithms, there is a necessity to address challenges beyond that. Literature analysis indicates that explainability, reasoning, and characterizing the root causes of process drifts in healthcare processes constitute an important but overlooked challenge. In addition, incorporating domain-specific knowledge into process discovery could be a significant contribution to process mining literature. Therefore, we mitigate the issue by introducing cognitive process mining through the DIAG approach, which consists of a meta-model and an algorithm. This approach enables reasoning and diagnosing in process mining through an ontology-driven framework. With DIAG, we modeled the healthcare semantics in a process mining application and diagnosed the causes of drifts in patients’ pathways. We performed an experiment in a hospital living lab to examine the effectiveness of our approach.

1. Introduction

Process-oriented data science projects are offering significant results in the healthcare sector through applications of process mining [1,2]. Process mining [3] is a research paradigm that offers analytical services to extract and transform data into illustrative information. Three main proposed services are process discovery, conformance checking, and enhancement. Process discovery extracts models from event logs, whereas conformance checking evaluates the observed behavior against a reference model. Enhancement looks for opportunities to improve either the structure or performance of the processes. These services help healthcare providers to identify and prevent adverse situations such as medication errors, and deviations leading to inefficient care pathways. One of the known applications of process mining is related to extracting patients’ pathways from location event logs [2]. The combination of process mining and patient localization provides a powerful tool to gain insight to identify bottlenecks, safety hazards, and optimization opportunities within the processes in which patients are involved. However, such analyses are limited to just visualization of processes or some basic statistical analysis [4].
Recently, researchers reviewed the main challenges confronting process mining applications in healthcare [1]. Following their guidelines, Table 1 presents these characteristics and challenges. Looking at C2 and C3 in Table 1, it is important for process mining applications to provide extended information about healthcare processes, such as causes of drifts and deviations in processes. Research has shown that diagnosing inefficiencies and reasoning in healthcare processes are often ignored [5,6,7].
Accordingly, the research question here is:
  • “How to embed the domain knowledge into process mining applications in such a way that we can diagnose the causes of deviations and drifts from the reference patients’ pathways?” (RQ 3, c.f. Figure 1).
We aim to answer this question by introducing the DIAG approach, which uses a meta-model and an algorithm. Accordingly, we integrate the domain knowledge by an ontology-driven framework, which could play a crucial role in reasoning and diagnosing process deviations. By identifying concepts, relationships, and rules within the patients’ pathway analysis, the DIAG meta-model offers a formal and structured framework for capturing and harmonizing domain knowledge. The association of the DIAG meta-model and the presented algorithm helps to augment conventional process mining approaches with a cognitive ability to explain and diagnose causes of concept drifts. Figure 1 provides an overview of the paper’s focus, highlighting what has been discussed and what will be addressed. Globally, this research project aims at improving patients’ pathways by looking into their location data. To do so, many research questions appeared. For instance, RQ 1 describes how to interpret a raw location event log. RQ 2 introduces an important requirement for diagnosing causes of inefficiencies, which is about discovering a reference process model of patients’ pathways. After addressing these RQs in previous works [9], we faced the explainability in analyzing and diagnosing potential assignable causes (PACs) of concept drifts, which is presented as RQ 3 and the focus of this paper.
The structure of the content unfolds in the following manner. Section 2 offers an overview of related and similar works with a focus on conformance checking and concept drift analyses in process mining. Section 3 will demonstrate the proposal and preliminary concepts. Section 4 evaluates the proposed method within the context of a case study. Finally, Section 5 draws a conclusion and outlines possible areas of future research.

2. Background

Conformance checking and concept drift analyses are two process mining research avenues that are important to the development of this paper’s contributions.

2.1. Conformance Checking

Conformance checking methods enable users to draw conclusions about the relation and misalignment between an event log and its corresponding process model. Generally, conformance checking methods provide measurements to evaluate how well a process model could represent the behavior recorded in an event log [3]. These measurements or quality metrics are fitness, simplicity, precision, and generalization [10]. As much as these metrics can provide insights about deviations between two behaviors (modeled, and recorded), they lack the necessary semantics to highlight the reasons for observing such deviations.
Conformance checking is not limited only to analyzing the control flow perspective. Other methods that focus on other perspectives are data-aware alignments, resource-aware alignments, and integrated approaches. They evaluate the performance metrics of a process (such as cycle time) by looking at defined objectives. Some works also focus on statistical and machine learning approaches to detect the proper objectives of the process and compare the current process performance with those goals [11,12,13].
It is important to recall the attention to this issue that conformance checking methods help us to detect deviating behaviors; however, they are not capable of detecting the cause(s) of deviations in processes without considering the relevant domain knowledge. Simply put, they lack the cognitive ability for reasoning.
Many existing conformance-checking applications are capable of detecting deviations in process mining [10,14,15,16,17,18]; however, these analyses do not cover the important issue of explainability and integration of domain knowledge into process mining analyses. This issue has also been highlighted in [19,20]. Authors in [19] mentioned that clinical decision support systems are required to integrate human interpretation in conformance checking analyses. In addition, they have emphasized the need for computer-interpretable guidelines. Based on our reviews of these existing works, we imply that it is important to go beyond detection and discovery, a statement that has been seen previously in [1,5].
This is the motivation behind using an ontology-driven approach and introducing the meta-model in the proposal section of this paper (c.f. Figure 2).

2.2. Concept Drifts

Concept drift in process mining is associated with a challenge im analyzing processes and detecting changes in their state while they are being monitored [21]. Originally, concept drifts had their roots in data mining, and it refers to a situation where the relationship between the input data and the target values changes [22].
Researchers in [23] mentioned that while working on concept drifts in process mining, there are three challenges that should be addressed. The first is (i) change point detection, which is about detecting a specific trend or seasonality in changes happening to the process. (ii) Change localization and characterization address the detection of the nature of a change. This is the closest term to the diagnosing of deviations in a business process, and the research carried out in this area is similar to our proposal. After identifying and localizing the changes, the (iii) change process discovery challenge addresses several methods that help us to predict the future modifications in the process.
Concept drift analyses have five different aspects:
  • Change perspective: time, control flow, resource, data;
  • Change analysis: online, offline;
  • Change duration: momentary, permanent;
  • Change type: sudden, gradual, recurring, incremental;
  • Change dynamic: multi-order (i.e., process changes happen at different time periods).
Despite identifying these aspects, one of the missing links in the literature on concept drift analyses is how to create a response system to address the detected deviations in the process in a manner that the system can be agile and flexible in fixing the drift.

2.3. Related Works

The work in [24] introduces a method for change point detection in processes by making use of the activity correlation strength feature extracted using an event log. The proposed technique helps to localize a deviation by applying statistical hypothesis testing methods.
Authors in [5] highlight the importance of root cause analysis in an ever-changing business environment by proposing a framework that eventually could help companies in handling concept drifts and uncertainty in their operational processes. The mentioned framework adds an explainability layer to concept drift detection.
Previous works in [9] signify the importance of model-based system engineering approaches for eliciting knowledge prior to applying process mining analysis, whereas most existing research has focused on detecting and locating significant changes in a process. Such works go further and add a causality check/explainability that determines the origin of concept drifts.
Moreover, the results of [22] show a literature review of 45 papers based on two aspects: concept drift detection, which addresses the perspective aspect, and the analysis aspect to see whether online monitoring is used to monitor the evolution of the process environment. Accordingly, detection of the nature of concept drifts is something that has not received adequate attention in the literature. It should be highlighted that one of the main reasons is identified as the challenge in integrating specific domain knowledge in process mining applications. This is one of the motivations of the DIAG.
In addition, looking at the application of process mining and real-time location systems, most of the current works have evolved around information extraction and how we can discover process models from location event logs [25] rather than integrating the domain knowledge. However, as mentioned here, we must venture beyond process discovery, as has been indicated in Table 1 by [1].
The first prerequisite in diagnosing patients’ pathways is to detect the drifts from a reference model. This is labeled as RQ2 in Figure 1. To achieve this, we leveraged the stable heuristic miner algorithm [8]. There are other algorithms to discover the reference process model [26,27]; however, to our humble knowledge, they have not been tested using location event logs. The stable heuristic miner algorithm identifies and localizes drifts by assessing the statistical stability in an event log. It automatically establishes two thresholds: the LCL (lower control limit) and UCL (upper control limit). Behaviors between LCL and UCL are determined to be stable, while those with a score lower than LCL require diagnoses. Activities or edges with a frequency higher than the UCL may pose a risk to the normal process execution and could lead to potential problems. The results of the stable heuristic miner algorithm are used as inputs for running the DIAG algorithm (i.e., Algorithm 1), which will extend the capability of the previous algorithm.

3. Proposal

The proposed ontology-driven process mining approach consists of two main contributions:
  • The DIAG meta-model is an ontology-based knowledge representation to engage domain-based semantics in the process mining analyses.
  • The DIAG algorithm is a semantic-based algorithm that leverages the DIAG meta-model to generate meaningful insights and add the cognitive capability to process discovery.
Together, these contributions provide the cognitive ability for process mining analytics. Such an approach could outline a potential progression from discovery to conformance checking and, eventually, the enhancement of business processes.

3.1. DIAG Meta-Model

The DIAG meta-model is shown in Figure 2. This conceptual model shows an explicit use of a domain-specific ontology to define the process domain and promote interoperability. However, we go beyond just a conceptual model. DIAG meta-model is implemented in the R.IO-DIAG tool (https://r-iosuite.atlassian.net/wiki/spaces/RIOSUITE/overview?mode=global 26 November 2023).
This meta-model is made up of eight packages, each of which contains a number of classes for tracking patients’ activities utilizing location information. To start the experimentation, for now, we have developed packages such as Healthcare resources, Organization, Objectives, Location Event Logs, Processes, Functions, Healthcare Functions, and Context.
Inside the Context package, the Potential Assignable Causes (PACs) class has four inherited sub-classes, defined here as environmental causes, equipment-related causes, human-related causes, and rules and procedures. This class and its inherited sub-classes serve as resources for explainability and reasoning rules to diagnose process drifts.
These deviations are a subset of the fact class, which shows unexpected events in patients’ pathways. The context package primarily includes the domain knowledge that healthcare experts can provide prior to the analyzing phase and using process mining methods. While we have outlined four categories to identify potential assignable causes, it is worth mentioning that this classification is not limited to only four classes. As experiments become more complex, it may be necessary to identify other categories or identify non-linear relationships.
Additionally, we have modeled the objectives package, which includes important classes to evaluate the quality of business processes and patients’ pathways according to the detected drifts. In this package, we have the objective class, which could be realized by the process class. Objectives define the CTQ (Critical To Quality) characteristics that will define KPIs (key performance indicators) to evaluate the quality of a process based on identified quality characteristics. This evaluation will be based on certain specification/target values that are defined by the performance objectives of an organization.
The organization class is defined within the organization package, including other important information that should be modeled prior to launching process mining analyses. In this package, we identify the used resources and components that could (help to) run business processes, according to the capacity and competence of the organization.
Furthermore, to better assess the quality of processes, we defined the function package. Within this, we identified a class as function that is the parent to the healthcare functions. This entity contains a value class, which has three sub-classes that identify the value of executing a certain function (i.e., value-added, non-value-added, business value-added). This helps to understand, if a deviation or an activity exists, how and to what extent it would impact a process.
Moreover, we have described the model for integrating location data within the location event-logs package and presented how such information could be defined as resources of an organization for executing business processes.
These modeled domain specifications help to augment the capability of process mining analyses to be more cognitive and capable of diagnosing drifts and issues and assessing the quality of a business process.
As mentioned earlier, to assess the effectiveness of this meta-model, we applied it to depict the underlying architecture of a cognitive process mining tool titled R.IO-DIAG [9]. This open-source tool is developed by incorporating the meta-model as its core semantic engine to capture the important relationships in an experimental setting.
This meta-model is realized by constructing a knowledge graph, which makes it easier to update and extend the knowledge base. The significance of this meta-model lies in its ability to provide the necessary semantics for conducting process-oriented analyses and diagnoses of business processes. Without such a semantic foundation, it would not be feasible to diagnose unanticipated events in patients’ pathways automatically. Figure 3 and Figure 4 provide screenshots of how domain knowledge is modeled in the tool, and an online demonstration video (https://youtu.be/fdPbXVqFhV0 26 November 2023) is available for a more detailed understanding of how the meta-model provides interoperability and incorporation of the domain knowledge in process mining analyses and its implementation within the tool’s architecture.
Figure 3 and Figure 4 serve as illustrative examples to show how the conceptual DIAG meta-model is actually used in practice to provide cognition to process mining analyses. For instance, these figures show how location tags are dedicated as a resource to each patient to run a process, and how functions are modeled. This information is used to enrich conventional process discovery event logs. In the following, we illustrate the DIAG algorithm’s operation in light of this improvement.

3.2. DIAG Algorithm

As outlined in Section 2.3, prior to diagnosing a cause, it is necessary to detect any drifts or deviations in the patients’ pathways. To achieve this, the DIAG algorithm is based on the stable heuristic miner algorithm [8], and it extends the previous capability of the algorithm to take into account the domain knowledge while discovering process models. Once this step is completed, the DIAG algorithm matches the discovered drifts with PACs modeled by the domain experts in R.IO-DIAG. The steps of this method are presented in Algorithm 1. A running example in the following subsection illustrates our approach and each step of the algorithm.
Algorithm 1 DIAG algorithm
1:
input D o m a i n K n o w l e d g e ;
2:
input E v e n t L o g ;
3:
Identify a c t i v i t i e s ;
4:
DomainKnowledge.df= data.frame(
DomainKnowledge[“activity"], DomainKnowledge[“deviation"], DomainKnowledge[“PAC"]);
5:
Execute stable heuristic miner       
6:
Detect L C L & U C L ;       
7:
unstable_activities=[   ];       
8:
deviating_activities=[   ];       
9:
stable_activities=[   ];
10:
for i in activities do
11:
   if i < L C L  then
12:
      deviating_activities= append(i, deviating_activities);
13:
   else if i > U C L then
14:
      unstable_activities= append(i, unstable_activities);
15:
   else
16:
      stable_activities = append(i, stable_activities);
17:
   end if
18:
   deviating_behaviors = merge(deviating_activities, unstable_activities)
19:
end for
{Comment: Verifying deviations with the domain knowledge}
20:
d i a g n o s i s = as.matrix(merge( D o m a i n K n o w l e d g e , d e v i a t i n g _ b e h a v i o r s ), by.x=c(“activity", “deviation"), by.y=c(“from_activity", “to_activity"), all.y = TRUE);
21:
stable_nodes = data.frame(stable_activities, attribute_color = “white");
22:
deviating_nodes = data.frame(deviating_activities, attribute_color = “green");
23:
unstable_nodes = data.frame(unstable_activities, attribute_color = “red");
24:
all_nodes = combine(stable_nodes, deviating_nodes, unstable_nodes);
25:
 
26:
devise.graph(all_nodes, diagnosis.edges);

An Illustrative Example

Potential assignable causes (PACs) for organizational actions can be found, and their repercussions can be recorded thanks to the DIAG meta-model. A knowledge graph incorporates this information, with vertices representing the activities and their PACs. An illustration of this domain knowledge can be seen in Table 2. This method enables a better comprehension of the connections between the various process entities and how PACs may affect healthcare operations.
Now, let us assume that, during a data-gathering procedure, an event log like the one below is collected as L: Modelling 05 00006 i001
As shown in the first two lines of Algorithm 1, both the domain knowledge and the event log will be received as inputs. This is a different approach compared to the conventional process discovery methods. The activities will be extracted from the event log, and a data frame of the domain knowledge will be detected and merged into the raw event log for further analysis.
Thanks to the execution of the stable heuristic miner, the two thresholds of U C L (Upper Control Limit) and L C L (Lower Control Limit) are identified. Then, as shown in lines 10 to 19, lists of unstable_activities, deviating_activities, and stable_activities are detected.
To diagnose the causes of drifts, a matrix is generated and placed adjacent to the data, and the algorithm matches the domain knowledge and the data frame of deviating behaviors. This matrix will be used in the extraction of edges/connections among activities and it will help to detect the causes of deviations. Finally, we aim to identify each type of extracted behavior by a different color. This helps domain experts to distinguish between stable behaviors, drifts, and corresponding causes of deviations. Consequently, the DIAG Algorithm 1 produces the model depicted in Figure 5. The activities and edges that are shown in black are expressing stable behaviors, which are activities that are typically present in multiple iterations of the process and are considered major activities in the execution of patients’ pathways. The red color indicates activities and edges that exhibit higher variations compared to the normal, stable state of the entire dataset. The dashed edges are drifting connections among activities. The activities in green are drifting activities.
Once the ensemble of behaviors has been discovered, we can enhance the model by incorporating information from the knowledge graph associated with each activity, healthcare function, and the observed drift. For instance, the deviation between activity ‘b’ and activity ‘k’ corresponds to an environmental cause. The deviation between activities ‘c’ and ‘j’ is related to a human error. The edge between activities ‘c’ and ‘h’ is related to a change in rules and procedures. When some edges demonstrate 0 values, it means that the modeled PAC did not match these deviations. Simply put, the domain knowledge was not adequate. A case study in a hospital living lab is devised to assess pragmatically the effectiveness and applicability of our method and proposal, which will be introduced in the next section.

4. Case Study

4.1. Presentation of the Case Study

For this experiment, we modeled the patients’ activities via seven departments and about 300 patients at Toulouse Hospital. Despite the hospital having high patient traffic, our experiment was limited by dangerous procedures. We gathered data regarding the hospital’s layout and departments while concentrating on the urology department’s analysis.
We modeled important information related to the environment, such as activity types, potential assignable causes, and performance objectives for patients’ pathways using the DIAG meta-model. An example of these actions can be seen in Figure 3 and Figure 4.
Later on, we clarified each step of our approach with the objective of diagnosing deviations in patients’ pathways. These steps were Configuration of the environment and systems, Location data gathering, Location data interpretation, Business process modeling, Business process analyzing, Business process diagnosing, and Business process simulating.

4.2. Results and Analyses

In the first step, we obtained and modeled the domain knowledge and other relevant information about the hospital premises to start the location data gathering. This is similar to the running example and what is presented in Table 2 and Figure 3 and Figure 4. The third, fourth, and fifth steps have been previously discussed in our works [4,9]. To illustrate the diagnosing step, we incorporated the modeled knowledge as an input for the DIAG Algorithm 1. For a better illustration of the knowledge graph output, we used Table 3 to display the outcome of our model for each healthcare function in the urology department. Here, users considered the relationships among activities and mentioned “what will be the deviation if a certain PAC is present?”
After receiving the event log and the knowledge set, DIAG (c.f. Algorithm 1) discovered the descriptive reference process model and associated each drift with the modeled causes of deviations for unexpected behaviors. The result of applying this method is shown in Figure 6.
Similar to what has been presented by the running example, there are three types of discovered behaviors from the event log:
  • Stable activities and edges: These behaviors are shown in black. They are presenting the most common and normal behaviors.
  • Activities and edges with high variations (unstable behaviors): These behaviors are shown in red. They correspond to observations with a higher level of variations than the upper control limit of the stability state.
  • Drifts: These behaviors are represented by activities modeled in green and dashed edges. They illustrate unanticipated occurrences recorded in the event log.
Furthermore, the causes of deviations among activities are displayed alongside the drifting edges. In cases where the information in the knowledge set does not align with the extracted deviations, or it does not exist, a 0 value is assigned to those deviations. Consequently, it can be inferred that some cases in the “Exam Room IDE” finished their processes because of a problem related to the “Equipment”. Similarly, due to human-related errors, certain patients had to return to waiting room 5. These errors could be attributed to miscommunication between staff, improper training of personnel, or inadequate staffing levels. Further investigation may be required to highlight the specific cause of these errors and take appropriate measures to prevent similar incidents from happening in the future. This task could be considered as the prognosis initiatives and tackled through simulation in future research.
To our humble knowledge, such a mixture of process discovery while detecting and explaining concept drift and deviations has not been addressed previously in the literature of process mining. The approach we took in developing DIAG helps domain experts not to be left out with process discovery results that are not augmented enough with specific explanations. In essence, providing a framework that offers explainability and reasoning to analyze healthcare processes should be a necessity, since we are dealing with a sensible sector such as healthcare.

5. Conclusions

We observed that researchers examined the expansion of process mining applications in healthcare and proposed crucial scientific avenues for the future, such as explainability and reasoning in analysis and going beyond process discovery. Although patient and care pathway discovery is receiving lots of attention, reasoning and incorporating domain knowledge are neglected. More research is required to employ semantics in such analyses, and this is axiomatic for digital and cognitive twin applications in healthcare.
This paper addresses the need to incorporate healthcare domain knowledge into process mining applications and presents a method to achieve this. This led to the presentation of two contributions.
First, the DIAG meta-model provides a framework for a process mining application that can use patients’ location data and other semantics such as experts’ knowledge. Second is the DIAG algorithm. This algorithm is based on the previously established stable heuristic miner algorithm; however, it adds cognitive ability to the previous algorithm, and it uses the modeled domain knowledge to perform diagnosis on top of the detected deviations in patients’ pathways. This algorithm can aid healthcare providers in identifying the root causes of drifts in patients’ pathways, which can inform interventions to enhance patients’ experience inside hospitals and streamline healthcare processes.
Our approach offers several benefits to healthcare providers. Firstly, it allows for the automatic discovery of a reference patients’ pathway, which can identify normal activities and drifts in the flow of patients through the healthcare system. Secondly, it enables the automatic reasoning and diagnosis of drifts and unexpected behaviors. This helps to identify the root causes of inefficiencies and errors. We demonstrated the applicability of this method through an experiment conducted at a university hospital. To the best of our knowledge, attaining such results has never been addressed by previous process mining activities. In addition, previous process discovery algorithms were not able to diagnose deviating behaviors in an event log automatically.

Limitations and Future Works

There are certain aspects of this approach that could raise concerns for users. For instance, ontology-driven methods often have limited flexibility. This means they are designed with a specific domain in mind and may not be easily adaptable to other sectors. Therefore, it is necessary to address this issue. The development of such methods could be a time-consuming and resource-intensive process. Also, we are heavily dependent on experts’ understanding of the domain. We believe that there is an open research avenue for developing standard and reference ontologies for the healthcare sector and aligning this with process-oriented analyses.
Moreover, in this work, the non-linear relationships of potential assignable causes are not thoroughly addressed. This is a limitation that should be addressed if this primary method for domain knowledge integration in healthcare is seen as applicable in supplementary experimentation.
Despite that, we pave the way to embed healthcare domain-specific knowledge into process mining analysis, which helps to go beyond process discovery and provide explainability while performing process mining analyses.
Given these limitations, we strongly believe there is a lot of potential for fusing model-based system engineering approaches and ontologies into process mining analyses. We are planning to improve our methods to extract process models with a procedural modeling language that could be used in the simulation of patients’ pathways. For this reason, there is a need to improve the gathered semantics, which could help us to detect the decision points.

Author Contributions

Conceptualization: S.N.A., F.B. and F.F. Methodology: S.N.A. Software: S.N.A. Validation: S.N.A., A.S. and F.B. Resources: F.F., E.L. and M.-H.K. Writing original draft: S.N.A. Writing—review: F.B., M.-H.K., A.S. and E.L. Project Administration: F.F., E.L. and F.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Used data is available at [28].

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
DIAGData, Information, Awareness, Governance
UCLUpper Control Limit
CLCentral Line
LCLLower Control Limit
PACPotential Assignable Cause

References

  1. Munoz-Gama, J.; Martin, N.; Fernandez-Llatas, C.; Johnson, O.A.; Sepúlveda, M.; Helm, E.; Galvez-Yanjari, V.; Rojas, E.; Martinez-Millana, A.; Aloini, D.; et al. Process mining for healthcare: Characteristics and challenges. J. Biomed. Inform. 2022, 127, 103994. [Google Scholar] [CrossRef] [PubMed]
  2. De Roock, E.; Martin, N. Process mining in healthcare—An updated perspective on the state of the art. J. Biomed. Inform. 2022, 127, 103995. [Google Scholar] [CrossRef] [PubMed]
  3. van der Aalst, W. Data Science in Action. In Process Mining: Data Science in Action; Springer: Berlin/Heidelberg, Germany, 2016; pp. 3–23. [Google Scholar] [CrossRef]
  4. Namaki Araghi, S.; Fontaili, F.; Lamine, E.; Salatge, N.; Lesbegueries, J.; Pouyade, S.R.; Tancerel, L.; Benaben, F. A Conceptual Framework to Support Discovering of Patients’ Pathways as Operational Process Charts. In Proceedings of the 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications (AICCSA), Aqaba, Jordan, 28 October–1 November 2018; pp. 1–6. [Google Scholar] [CrossRef]
  5. Adams, J.N.; van Zelst, S.J.; Quack, L.; Hausmann, K.; van der Aalst, W.M.P.; Rose, T. A Framework for Explainable Concept Drift Detection in Process Mining. arXiv 2021, arXiv:2105.13155. [Google Scholar]
  6. Namaki Araghi, S.; Fontanili, F.; Lamine, E.; Salatge, N.; Benaben, F. Interpretation of Patients’ Location Data to Support the Application of Process Mining Notations. In HEALTHINF 2020-13th International Conference on Health Informatics; SCITEPRESS-Science and Technology Publications: Setúbal, Portugal, 2020; Volume 5, pp. 472–481. [Google Scholar] [CrossRef]
  7. Yang, W.; Su, Q. Process mining for clinical pathway: Literature review and future directions. In Proceedings of the 2014 11th International Conference on Service Systems and Service Management (ICSSSM), Beijing, China, 25–27 June 2014; pp. 1–5. [Google Scholar]
  8. Namaki Araghi, S.; Fontanili, F.; Lamine, E.; Okongwu, U.; Benaben, F. Stable Heuristic Miner: Applying statistical stability to discover the common patient pathways from location event logs. Intell. Syst. Appl. 2022, 14, 200071. [Google Scholar] [CrossRef]
  9. Namaki Araghi, S. A Methodology for Business Process Discovery and Diagnosis Based on Indoor Location Data: Application to Patient Pathways Improvement. Ph.D. Thesis, Ecole des Mines d’Albi-Carmaux, Albi, France, 2019. Albi-FRANCE. [Google Scholar]
  10. Carmona, J.; van Dongen, B.; Weidlich, M. Conformance Checking: Foundations, Milestones and Challenges. In Process Mining Handbook; Lecture Notes in Business Information Processing; van der Aalst, W.M.P., Carmona, J., Eds.; Springer International Publishing: Cham, Switzerland, 2022; pp. 155–190. [Google Scholar] [CrossRef]
  11. Rodriguez-Fernandez, V.; Trzcionkowska, A.; Gonzalez-Pardo, A.; Brzychczy, E.; Nalepa, G.J.; Camacho, D. Conformance Checking for Time-Series-Aware Processes. IEEE Trans. Ind. Inform. 2021, 17, 871–881. [Google Scholar] [CrossRef]
  12. Van der Aalst, W.; Adriansyah, A.; van Dongen, B. Replaying history on process models for conformance checking and performance analysis. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 2012, 2, 182–192. [Google Scholar] [CrossRef]
  13. Carmona, J.; van Dongen, B.; Solti, A.; Weidlich, M. Conformance Checking; Springer: Cham, Switzerland, 2018. [Google Scholar] [CrossRef]
  14. Burattin, A.; Maggi, F.M.; Sperduti, A. Conformance checking based on multi-perspective declarative process models. Expert Syst. Appl. 2016, 65, 194–211. [Google Scholar] [CrossRef]
  15. Gatta, R.; Vallati, M.; Fernandez-Llatas, C.; Martinez-Millana, A.; Orini, S.; Sacchi, L.; Lenkowicz, J.; Marcos, M.; Munoz-Gama, J.; Cuendet, M.; et al. Clinical Guidelines: A Crossroad of Many Research Areas. Challenges and Opportunities in Process Mining for Healthcare. In Business Process Management Workshops; Lecture Notes in Business Information Processing; Di Francescomarino, C., Dijkman, R., Zdun, U., Eds.; Springer: Cham, Switzerland, 2019; pp. 545–556. [Google Scholar] [CrossRef]
  16. Dunzer, S.; Stierle, M.; Matzner, M.; Baier, S. Conformance checking: A state-of-the-art literature review. In Proceedings of the 11th International Conference on Subject-Oriented Business Process Management: S-BPM ONE 2019, Seville, Spain, 26–28 June 2019; pp. 1–10. [Google Scholar] [CrossRef]
  17. Asare, E.; Wang, L.; Fang, X. Conformance Checking: Workflow of Hospitals and Workflow of Open-Source EMRs. IEEE Access 2020, 8, 139546–139566. [Google Scholar] [CrossRef]
  18. Benevento, E.; Pegoraro, M.; Antoniazzi, M.; Beyel, H.H.; Peeva, V.; Balfanz, P.; van der Aalst, W.M.P.; Martin, L.; Marx, G. Process Modeling and Conformance Checking in Healthcare: A COVID-19 Case Study. In Process Mining Workshops; Lecture Notes in Business Information Processing; Montali, M., Senderovich, A., Weidlich, M., Eds.; Springer: Cham, Switzerland, 2023; pp. 315–327. [Google Scholar] [CrossRef]
  19. Oliart, E.; Rojas, E.; Capurro, D. Are we ready for conformance checking in healthcare? Measuring adherence to clinical guidelines: A scoping systematic literature review. J. Biomed. Inform. 2022, 130, 104076. [Google Scholar] [CrossRef]
  20. Soliman-Junior, J.; Tzortzopoulos, P.; Baldauf, J.P.; Pedo, B.; Kagioglou, M.; Formoso, C.T.; Humphreys, J. Automated compliance checking in healthcare building design. Autom. Constr. 2021, 129, 103822. [Google Scholar] [CrossRef]
  21. Elkhawaga, G.; Abuelkheir, M.; Barakat, S.I.; Riad, A.M.; Reichert, M. CONDA-PM—A Systematic Review and Framework for Concept Drift Analysis in Process Mining. Algorithms 2020, 13, 161. [Google Scholar] [CrossRef]
  22. Sato, D.M.V.; De Freitas, S.C.; Barddal, J.P.; Scalabrin, E.E. A Survey on Concept Drift in Process Mining. ACM Comput. Surv. 2021, 54, 189:1–189:38. [Google Scholar] [CrossRef]
  23. Bose, R.P.J.C.; van der Aalst, W.M.P.; Žliobaitė, I.; Pechenizkiy, M. Dealing With Concept Drifts in Process Mining. IEEE Trans. Neural Netw. Learn. Syst. 2014, 25, 154–171. [Google Scholar] [CrossRef] [PubMed]
  24. ManojKumarM, V.; Thomas, L.; Basava, A. Capturing the Sudden Concept Drift in Process Mining. In ATAED@Petri Nets/ACSD; 2015; Available online: https://api.semanticscholar.org/CorpusID:18068152 (accessed on 26 November 2023).
  25. Martinez-Millana, A.; Lizondo, A.; Gatta, R.; Vera, S.; Salcedo, V.T.; Fernandez-Llatas, C. Process Mining Dashboard in Operating Rooms: Analysis of Staff Expectations with Analytic Hierarchy Process. Int. J. Environ. Res. Public Health 2019, 16, 199. [Google Scholar] [CrossRef]
  26. Augusto, A.; Conforti, R.; Dumas, M.; La Rosa, M. Split Miner: Discovering Accurate and Simple Business Process Models from Event Logs. In Proceedings of the 2017 IEEE International Conference on Data Mining (ICDM), New Orleans, LA, USA, 18–21 November 2017; pp. 1–10. [Google Scholar] [CrossRef]
  27. Pulsanong, W.; Porouhan, P.; Tumswadi, S.; Premchaiswadi, W. Using inductive miner to find the most optimized path of workflow process. In Proceedings of the 2017 15th International Conference on ICT and Knowledge Engineering (ICT&KE), Bangkok, Thailand, 22–24 November 2017; pp. 1–5. [Google Scholar] [CrossRef]
  28. Namaki Araghi, S. LivingLabHospital_Interpreted Location Event Logs. Available online: https://data.mendeley.com/datasets/v5kc7chhpv/1 (accessed on 26 November 2023).
Figure 1. General presentation of this article and its focus [6,8].
Figure 1. General presentation of this article and its focus [6,8].
Modelling 05 00006 g001
Figure 2. DIAG meta-model. The architecture behind the application of process discovery and diagnosis of patients’ pathways by using their location data.
Figure 2. DIAG meta-model. The architecture behind the application of process discovery and diagnosis of patients’ pathways by using their location data.
Modelling 05 00006 g002
Figure 3. A screenshot of the R.IO-DIAG tool developed to realize the modeling of different concepts defined in the DIAG meta-model such as healthcare resources, organizations, location event-logs, etc., for monitoring patients’ pathways.
Figure 3. A screenshot of the R.IO-DIAG tool developed to realize the modeling of different concepts defined in the DIAG meta-model such as healthcare resources, organizations, location event-logs, etc., for monitoring patients’ pathways.
Modelling 05 00006 g003
Figure 4. A screenshot of R.IO-DIAG tool developed to realize the modeling of healthcare functions. This domain-specific knowledge is integrated into process mining analyses.
Figure 4. A screenshot of R.IO-DIAG tool developed to realize the modeling of healthcare functions. This domain-specific knowledge is integrated into process mining analyses.
Modelling 05 00006 g004
Figure 5. The discovered model with the corresponding diagnoses of drifts.
Figure 5. The discovered model with the corresponding diagnoses of drifts.
Modelling 05 00006 g005
Figure 6. The result of our approach in diagnosing the process deviations of the urology department.
Figure 6. The result of our approach in diagnosing the process deviations of the urology department.
Modelling 05 00006 g006
Table 1. Distinguishing characteristics (D) and challenges (C) of process mining research in healthcare [1].
Table 1. Distinguishing characteristics (D) and challenges (C) of process mining research in healthcare [1].
Distinguished CharacteristicsChallenges
D1: Exhibit Substantial VariabilityC1: Design Dedicated / Tailored Methodologies and Frameworks
D2: Value the Infrequent BehaviourC2: Discover Beyond Discovery
D3: Use Guidelines and ProtocolsC3: Mind the Concept Drift
D4: Break the glassC4: Deal with Reality
D5: Consider Data at Multiple Abstraction LevelsC5: Do it Yourself
D6: Involve a Multidisciplinary TeamC6: Pay Attention to Data Quality
D7: Focus on the PatientC7: Take Care of Privacy and Security
D8: Think about White-box ApproachesC8: Look at the Process through the Patient’s Eyes
D9: Generate Sensitive and Low-Quality DataC9: Complement HISs with the Process Perspective
D10: Handle Rapid Evolutions and New ParadigmsC10: Evolve in Symbiosis with the Development in the Healthcare Domain
Table 2. This table shows an illustration of how the domain knowledge will be extracted from the knowledge graph. This will be embedded as an input into the process discovery procedure.
Table 2. This table shows an illustration of how the domain knowledge will be extracted from the knowledge graph. This will be embedded as an input into the process discovery procedure.
ActivityDeviationPAC
cjHuman-related
bkEnvironmental
chRules and procedure
jiHuman-related
ceRules and procedure
ghEquipment
.........
Table 3. The knowledge set provided by the domain expert to be used by DIAG method.
Table 3. The knowledge set provided by the domain expert to be used by DIAG method.
ActivityDeviationPAC
Enter_consultationBox ConsultationRules and procedure
Reception_Waiting_roomRegistration_PrioritiesRules and procedure
RegistrationReception_Waiting_roomRules and procedure
Waiting_room 5RegistrationRules and procedure
Waiting_room 5Exam Room UROLOGYRules and procedure
Box_ConsultationWaiting_room 5Human-related
Box_ConsultationRegistrationEnvironmental
Checkout_Office_UROLOGYRegistrationRules and procedure
Paramedical programmingExitEquipment
FlowmeteringWaiting_room 5Human-related
Post_consultationBox_ConsultationRules and procedure
Post_consultationWaiting_room 5Human-related
Post_consultationExitEquipment
ExitCheckout_Office_UROLOGYRules and procedure
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Namaki Araghi, S.; Fontanili, F.; Sarkar, A.; Lamine, E.; Karray, M.-H.; Benaben, F. DIAG Approach: Introducing the Cognitive Process Mining by an Ontology-Driven Approach to Diagnose and Explain Concept Drifts. Modelling 2024, 5, 85-98. https://doi.org/10.3390/modelling5010006

AMA Style

Namaki Araghi S, Fontanili F, Sarkar A, Lamine E, Karray M-H, Benaben F. DIAG Approach: Introducing the Cognitive Process Mining by an Ontology-Driven Approach to Diagnose and Explain Concept Drifts. Modelling. 2024; 5(1):85-98. https://doi.org/10.3390/modelling5010006

Chicago/Turabian Style

Namaki Araghi, Sina, Franck Fontanili, Arkopaul Sarkar, Elyes Lamine, Mohamed-Hedi Karray, and Frederick Benaben. 2024. "DIAG Approach: Introducing the Cognitive Process Mining by an Ontology-Driven Approach to Diagnose and Explain Concept Drifts" Modelling 5, no. 1: 85-98. https://doi.org/10.3390/modelling5010006

APA Style

Namaki Araghi, S., Fontanili, F., Sarkar, A., Lamine, E., Karray, M. -H., & Benaben, F. (2024). DIAG Approach: Introducing the Cognitive Process Mining by an Ontology-Driven Approach to Diagnose and Explain Concept Drifts. Modelling, 5(1), 85-98. https://doi.org/10.3390/modelling5010006

Article Metrics

Back to TopTop