Next Article in Journal
Transcritical R744 Supermarket Refrigeration System Integrated with a Heat-Driven Ejector Chiller
Previous Article in Journal
Computer Modelling of Heliostat Fields by Ray-Tracing Techniques: Simulating Shading and Blocking Effects
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Failure Modes Analysis Related to User Experience in Interactive System Design Through a Fuzzy Failure Mode and Effect Analysis-Based Hybrid Approach

School of Mechanical and Electrical Engineering, Jiangsu Normal University, Xuzhou 221116, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2025, 15(6), 2954; https://doi.org/10.3390/app15062954
Submission received: 5 February 2025 / Revised: 4 March 2025 / Accepted: 6 March 2025 / Published: 9 March 2025

Abstract

:
User experience (UX) is crucial for interactive system design. To improve UX, one method is to identify failure modes related to UX and then take action on the high-priority failure modes to decrease their negative impacts. For the UX of interactive system design, the failure modes under consideration are human errors or difficulties, and thus the risk factors concerning failure modes are subjective and even subconscious. Existing methods are not sufficient to deal with these issues. In this paper, a fuzzy failure mode and effect analysis (FMEA)-based hybrid approach is proposed to improve the UX of interactive system design. First, hierarchical task analysis (HTA) and systematic human error reduction and prediction approach (SHERPA) are combined to identify potential failure modes concerning UX. Subsequently, fuzzy linguistic variables are employed to assess the risk parameters of the failure modes, and the similarity aggregation method (SAM) is adopted to aggregate the fuzzy opinions. Then, on the basis of the aggregation results, fuzzy logic is adopted to compute the fuzzy risk priority numbers that can prioritize the failure modes. Finally, the failure modes with high priorities are considered for corrective actions. An in-vehicle information system was employed as a case study to illustrate the proposed approach. The findings indicate that, compared with other methods, our approach can provide more accurate results for prioritizing failure modes related to UX, and can successfully deal with the subjective and even subconscious nature of the risk factors associated with failure modes. This approach can be universally utilized to enhance the UX of interactive system design.

1. Introduction

Interactive systems are closely related to people’s lives. Designing interactive systems involves many different types of products, such as software systems, interactive products, and environments. The goal of designing interactive systems is to make them enjoyable to use, enable them to perform useful tasks, and improve the quality of life for those who use them. In other words, interactive systems should provide a good user experience (UX). UX involves developing high-quality interactive systems that fit with people and their ways of living [1].
Designers need to place users at the center of the design process and eliminate the failure modes that harm users the most. Generally, a failure mode in UX is an action that causes a user to stray from the path to successful completion. To enhance UX, a systematic approach to prioritizing the failure modes related to UX is needed. Several studies have been conducted on prioritizing failure modes related to UX. Nielsen [2] used severity to rank the failure modes, and the failure modes were rated as high, medium, or low. The failure modes were prioritized based on severity level. Besides severity, there are other factors affecting the risk of failure models. Rubin and Chisnell [3] used criticality, which was the combination of severity and probability, to rank the failure modes related to UX, and categorized the failure modes into seven levels. Travis and Hodgson [4] employed a decision tree that was constructed by using three questions (What is the impact of the failure mode? How many users are affected by the failure mode? Will users be bothered by the failure mode repeatedly?) to rank the failure modes and categorize them as low, medium, serious, and critical. These studies all focused on prioritizing failure modes related to UX; however, they did not systematically consider the risk factors that affect the priorities of failure modes.
Failure mode and effect analysis, commonly referred to as FMEA, is a meticulously systematic approach that is utilized for the identification and prevention of potential product or process failure modes before they even have a chance to occur [5]. FMEA is a proactive risk management tool that concentrates on preventing defects, enhancing safety, and boosting customer satisfaction [6]. Using FMEA, the risk priority number (RPN) that involves the severity, occurrence, and detection of failure modes can be determined, and the failure modes can be prioritized through the RPN. However, if two failure modes have the same RPN, it is not possible to distinguish between the prioritizations of the two failure modes [7]. For the UX of interactive system design, the failure modes under consideration are human errors or difficulties rather than mechanical or electronic component failure modes, and thus the risk factors including occurrence, severity, and detection are subjective and even subconscious, making them difficult to use exact numbers for estimation [8]. To deal with these situations, FMEA needs to be combined with other methods. Several studies have combined fuzzy logic with FMEA for the assessment of risk factors [9,10]. Compared with traditional FMEA, fuzzy logic-based FMEA has the following advantages: it allows the analyst to employ linguistic terms to evaluate the risk factors and can yield more accurate results [11]. Fuzzy logic-based FMEA has been studied in various fields, such as the aerospace industry, construction industry, and process industry [12,13]. Nevertheless, to the best of our knowledge, very few studies have been devoted to employing fuzzy logic-based FMEA to improve the UX of interactive system design.
When carrying out FMEA for the best results, a team is needed [14]. To aggregate the team members’ opinions concerning risk factors of failure modes, many studies used average value [15]. However, when there exist extreme values, the extreme values can be averaged, and the preference values of experts could be diminished. In other words, the consensus extent cannot be embodied, which could impact the validity of the evaluation result [16]. The similarity aggregation method (SAM) provides a systematic method to objectively consolidate individual opinions during group decision-making and can convert linguistic terms used for evaluation risk factors into fuzzy numbers [17]. Furthermore, through the aggregation steps, we can establish the judgment matrix and effectively derive consensus information for group decision problems [18].
Failure mode identification is crucial for improving the UX of interactive system design; however, FMEA does not provide a method to accomplish this. Hierarchical task analysis (HTA) is a commonly used task analysis method that can decompose tasks into clearly identifiable steps. This process helps to effectively identify potential failure modes [19,20]. In addition, the systematic human error reduction and prediction approach (SHERPA) employs a well-designed behavioral classification interconnected with an external failure mode taxonomy to discern potential failure modes related to human behavior [21]. SHERPA uses an error list methodology and claims to achieve the highest accuracy in error prediction [22]. Several studies have combined HTA with SHERPA for failure mode identification [23].
The main purpose of this paper is to improve UX in interactive system design. The primary contribution of this paper is the integration of various methods from different fields into a unified framework and its application to interactive system design, a field where it has not been previously utilized. In this framework, HTA and SHERPA are combined to detect the failure modes related to UX; moreover, fuzzy linguistic variables and SAM are integrated to analyze the failure modes. In addition, fuzzy logic is used to calculate the fuzzy risk priority number (FRPN), which is used to prioritize the failure modes. The proposed approach can accurately prioritize the failure modes related to UX, as well as effectively manage the subjective and even subconscious nature of risk factors associated with failure modes. In this paper, we hypothesize that the failure modes related to UX have different priorities, and our approach can identify and rank all the failure modes as well as provide corrective actions for the failure modes with high priorities. The remainder of this paper is arranged as follows. Section 2 gives a theoretical background review of UX in interactive system design, FMEA, and fuzzy set theory. Section 3 presents our proposed methodology. Section 4 demonstrates the procedures with a case study, and its results are discussed in Section 5. Finally, Section 6 summarizes the main conclusions.

2. Theoretical Background

2.1. UX in Interactive System Design

UX is defined as a person’s perceptions and responses that result from the use or anticipated use of a product, system, or service [24]. It is all about a user’s overall experience with a product, system, or service, encompassing emotional reactions, attitudes, ability to succeed efficiently, and other aspects. There exist two types of qualities related to UX [25]. One is pragmatic qualities, which are usability goals that relate to the tasks users must complete in order to reach their goals, such as suitability for the task, efficiency, and error tolerance. The other is hedonic qualities, which are experience goals related to the subjective impression concerning the overall interaction with the product, such as aesthetic impression, emotional appeal, and novelty [26].
UX is a crucial driving force for interactive system design [27]. Several researchers have proposed qualitative principles or rules that can be used to enhance the UX of an interactive system [28,29]. Measuring UX is focused on ensuring that the interactive system is appropriate, and thus it is at the heart of interactive system design. Various metrics related to measuring UX are subjective and even subconscious. Therefore, many studies have used fuzzy set theory for UX evaluation [30,31,32]. Generally, a failure mode in UX is an action that causes a user to stray from the path to successful completion. Common types of failure modes concerning UX include behaviors that prevent task completion, taking an incorrect sequence of actions, misinterpreting some pieces of content, and not seeing something that should be noticed [33]. Some of the changes made to solve certain failure modes may introduce new failure modes. Therefore, identifying and removing the biggest failure modes is important for improving the UX of an interactive system.

2.2. FMEA

The objective of FMEA is to identify all potential failure modes of a process or product. A failure mode occurs when the product does not perform as it should or when it malfunctions in some way. Even the simplest products have many opportunities for failure modes. In traditional FMEA, the risk of a failure mode and its effects are measured through three factors that are severity, occurrence, and detection [34]. Severity refers to the effect of the failure mode when it takes place; occurrence refers to the probability of the failure mode occurring; detection refers to the probability of the failure mode detecting. The RPN of a failure mode can be obtained by using Equation (1).
R P N = O × S × D ,
where O signifies the occurrence, S denotes the severity, and D represents the detection. Through the values of RPN, the failure modes can be prioritized.
When applying traditional FMEA in real-world cases, there exist some important weaknesses. One significant weakness is that it is difficult to evaluate risk factors of failure modes in terms of exact numbers from 1 to 10. Furthermore, traditional FMEA does not consider the relationship of the risk factors. Moreover, traditional FMEA lacks a mechanism for systematically identifying all failure modes. In addition, different combinations of risk factor scores can produce the same RPN value, disregarding the whole different risk levels of the failure modes. Therefore, many studies have been devoted to mitigating these shortcomings of traditional FMEA [35,36,37]. In this study, we integrated fuzzy set theory, HTA, and SHERPA with traditional FMEA to overcome these shortcomings.

2.3. Fuzzy Set Theory

Fuzzy set theory is a powerful technique for dealing with concepts and rules that concern uncertainty, imprecision, and nonlinearity [38]. A significant feature of fuzzy set theory is its ability to represent vague data [39]. UX involves multiple aspects, some of which are characterized by vague and linguistic variables [40]. There are various types of fuzzy numbers used to represent vague data, including triangular, trapezoidal, G-Bell, and sigmoid functions. In this study, triangular fuzzy numbers were adopted to quantify fuzzy linguistic variables concerning the risk of UX because they are intuitive, straightforward to calculate, and easy to comprehend [41]. A triangular fuzzy number can be defined using a triplet (a1, a2, a3), and its membership function can be formulated as follows [42]:
μ x = 0 ,                                               x < a 1 x a 1 a 2 a 1 ,     a 1 x a 2 x a 3 a 2 a 3 ,     a 2 x a 3 0 ,                                               x > a 3 .
To obtain the crisp output for fuzzy calculation, defuzzification is required. Defuzzification can be performed by using various methods, such as center of gravity, mean of maxima, and center of area. Center of gravity is the most popular and precise method due to its clear geometric significance [43]. Therefore, the center of gravity was adopted for defuzzification in this study, and the formula for computing the defuzzification value is as follows:
D F = x μ x d x μ x d x ,
where DF is the defuzzification value and μ(x) is the membership function.

2.4. The Use of Fuzzy Logic in UX

Fuzzy logic is a mathematical technique for inexact reasoning that enables the modeling of human reasoning processes using linguistic terms [44], and is suitable for analyzing subjective and vague information, which is an important feature of user experience. Many studies concerning UX have been conducted using fuzzy logic. Sulikowski et al. [45] used fuzzy logic for purchase intent modeling based on user tracking for e-commerce recommenders. Li and Zhu [46] combined fuzzy logic with the Taguchi method for multi-objective optimization of user experience in mobile application design.
In this study, a fuzzy logic system was adopted to assess the FRPN of a failure mode. The membership function used for each input and output factor in the fuzzy logic system is the G-Bell shape because it enables the creation of continuously differentiable hypersurfaces for a fuzzy model, thereby making the theoretical analysis of a fuzzy logic system more accessible [47]. The G-Bell shape function can be defined as follows:
μ x = 1 1 + x c a 2 b ,
where c determines the center of the curve, and a and b dictate the shape of the curve and are usually positive.

3. Proposed Methodology

The flowchart of the proposed methodology is depicted in Figure 1. The methodology consists of four stages, which are detecting failure modes by employing HTA and SHERPA, analyzing failure modes by using fuzzy linguistic variables and SAM, calculating FRPNs by using fuzzy logic, and modifying the failure modes with high priorities. To carry out the methodology, a multidisciplinary team is required.

3.1. Detecting Failure Modes by Using HTA and SHERPA

HTA and SHERPA are combined to systematically detect all failure modes related to UX in interactive system design. HTA is used to decompose the task into clearly identifiable steps that the user performs when interacting with an interactive system, so as to identify any steps that may have potential failure modes. Subsequently, SHERPA is adopted to identify credible failure modes associated with these steps. In SHERPA, failure modes are classified into five categories which include action, retrieval, checking, information communication, and selection, as shown in Table 1 [48]. Based on this classification, the failure mode of each task can be identified.

3.2. Analysing Failure Modes by Using Fuzzy Linguistic Variables and SAM

Analyzing failure modes includes two processes, which are evaluating risk parameters of failure modes and aggregating fuzzy opinions for risk parameter assessments.

3.2.1. Evaluating Risk Parameters of Failure Modes

FMEA is used to analyze failure modes. The risk parameters for FMEA include occurrence, severity, and detection. To evaluate these risk parameters, fuzzy linguistic variables are employed. The fuzzy linguistic variables regarding occurrence, severity, and detection are given in Table 2, Table 3, and Table 4, respectively [49].

3.2.2. Aggregating Fuzzy Opinions for Risk Parameters Assessments

The team members may have different opinions about the risk parameters assessments, and the ratings for risk parameters derived by subjective judgment are not very reliable [50]. Therefore, the ratings from different team members need to be aggregated. SAM is adopted to aggregate the fuzzy ratings. SAM was developed by Hsu and Chen [51], and the steps for SAM are as follows.
Step 1. Compute the agreement degree.
S R i , R j = x min μ R i x , μ R j x d x x max μ R i x , μ R j x d x ,
where R i and R j are the fuzzy evaluation values of member i and member j, respectively, and S R i , R j is the agreement degree between the two members.
Step 2. Establish the agreement matrix AM.
A M = S i j n × n ,     i = 1 , 2 , , n ,     j = 1 , 2 , , n ,
where S i j = S R i , R j .
Step 3. Compute the average agreement degree A A D i of member i with other members.
A A D i = 1 n 1 j = 1 i j n S i j ,     i = 1 , 2 , , n .
Step 4. Compute the relative agreement degree R A D i of member i.
R A D i = A A D i i = 1 n A A D i ,     i = 1 , 2 , , n .
Step 5. Compute the consensus degree coefficient C D C i of member i.
C D C i = β × w i + 1 β × R A D i ,     i = 1 , 2 , , n ,
where wi is the degree of importance for the ith member, and β ( 0 β 1 ) is a relaxation factor. Due to the heterogeneous characteristics of the team members in this study, β was assigned a value of 0.5.
Step 6. Compute the aggregation value R.
R = i = 1 n C D C i R i ,     i = 1 , 2 , , n .

3.3. Calculating FRPNs with Fuzzy Logic

Fuzzy logic is employed to transform the risk parameters into an FRPN. Fuzzy logic allows for the modeling of human reasoning using linguistic terms. It is a perfect tool for mapping the relationship between system inputs and the output we want [52]. This approach has proven useful across a range of areas including automatic control, decision analysis, and expert systems [53]. The structure of a fuzzy logic system mainly consists of four components including a fuzzifier, a knowledge base, an inference engine, and a defuzzifier. The interconnections among these components and the process are illustrated in stage 3 of the proposed methodology flowchart (see Figure 1). Initially, the fuzzifier employs membership functions to transform crisp inputs into fuzzy sets. Following that, the fuzzy inference engine conducts fuzzy reasoning to generate fuzzy values by using the knowledge base. As a final step, the obtained fuzzy values are converted into a crisp output by using the defuzzifier.
A knowledge base, which contains a set of if–then rules, is built to map the relationship between the inputs and the output. A representative linguistic fuzzy rule is as follows [54]:
Rule i: If x1 is Ai1, x2 is Ai2, …, and xr is Air, then yi is Ci,
where i = 1, 2, …, M (M is the total number of fuzzy rules), xj (j = 1, 2, …, r) is the input variable, yi is the output variable, and Aij and Ci are fuzzy sets modeled by the membership functions μ A i j x j and μ C i y i , respectively. The Mamdani fuzzy inference engine is employed for its advantages of intuitive formation, widespread acceptance, and compatibility with human input [55]. Thus, for a collection of M fuzzy rules, the obtained output can be expressed as follows [56]:
μ c i y i = max min μ A i 1 x 1 ,   μ A i 2 x 2 , ,   μ A i r x r .
To derive the crisp output for the fuzzy inference result, the center of gravity is adopted for defuzzification.

3.4. Modifying the Failure Modes with High Priorities

Based on the above analysis, many failure modes can be detected. Modifying one failure mode could exacerbate other failure modes or lead to the emergence of new failure modes. Therefore, we need to modify the failure modes with high priorities. Failure modes with a larger FRPN take on a higher level of priority; the top 50% of failure modes are considered for modification [13]. Modifications are made according to the priorities of the failure modes.

4. Case Study

In-vehicle information systems (IVISs) are typical interactive systems, which support a wide variety of secondary vehicle functions, including navigation, media, and climate control. These functions are incorporated into a single system, usually operated through a touchscreen interface [57]. With the advancement of intelligent vehicles, more functions are being integrated into IVISs, potentially affecting their UX. The design of IVISs, which are connected to driving safety, has garnered significant research attention [15,58,59]. For this reason, an IVIS was selected to illustrate our approach. In this case study, we utilized a focus group for data collection. The group included seven team members: three UX experts, two designers, and two IVIS users, each bringing their unique insights and perspectives. The traits of the team members are listed in Table 5.

4.1. Detecting Failure Modes for IVIS

The primary user interface of the original IVIS is depicted in Figure 2. From this IVIS, many tasks can be executed. In this study, we focused on the commonly used tasks that concerned navigation, climate, media, telephone, and radio. The results of the HTA for these tasks are described in a tabular list, as shown in Table 6. The experimenters observed the processes of the users completing the tasks. After that, SHERPA was employed to identify the failure modes related to UX. A total of 25 failure modes were identified, as listed in Table 7.

4.2. Analysing Failure Modes for IVIS

4.2.1. Evaluating Risk Parameters of Failure Modes for IVIS

To evaluate the risk parameters of the identified failure modes, triangular fuzzy linguistic variables were adopted. The evaluation results of the seven team members (TM1–TM7) regarding occurrence, severity, and detection are given in Table 8, Table 9, and Table 10, respectively.

4.2.2. Aggregating Fuzzy Opinions for Risk Parameters Assessments for IVIS

To aggregate the fuzzy opinions of team members for risk parameters assessments, SAM was used. The weighting scores according to the traits of team members are given in Table 11 [60]. The weights assigned to each team member based on their traits (see Table 5) are presented in Table 12.
For the risk parameter of occurrence, according to Equations (5) and (6), as regards failure mode No. 1, the agreement matrix can be obtained as follows:
A M = 1.000 0.200 0.143 0.200 0.143 1.000 1.000 0.200 1.000 0 1.000 0 0.200 0.200 0.143 0 1.000 0 1.000 0.143 0.143 0.200 1.000 0 1.000 0 0.200 0.200 0.143 0 1.000 0 1.000 0.143 0.143 1.000 0.200 0.143 0.200 0.143 1.000 1.000 1.000 0.200 0.143 0.200 0.143 1.000 1.000
By using Equation (7), the average agreement degree (AAD) can be calculated, and then the relative agreement degree (RAD) can be derived according to Equation (8). On the basis of RAD and the weights of the team members, the consensus degree coefficient (CDC) can be calculated according to Equation (9). The computed AAD, RAD, and CDC for occurrence are given in Table 13. By using Equation (10), the aggregation result was obtained as follows: R = 5.072 ,     7.572 ,     9.382 . Consequently, by using Equation (4), the defuzzification value for the aggregated fuzzy opinions can be obtained, whose result was 7.342.
The aggregated fuzzy opinions and the corresponding defuzzification values for all the failure modes concerning risk parameters of occurrence can be derived, as shown in the last two columns of Table 8. In the same way, the aggregated fuzzy opinions and the corresponding defuzzification values for the risk parameters of severity and detection can also be derived, as shown in the last two columns of Table 9 and Table 10.

4.3. Calculating FRPNs for IVIS

4.3.1. Constructing the Fuzzy Logic System

To calculate the FRPNs, a fuzzy logic system was built. The input variables were the defuzzification values for the risk parameters, and the output variable was FRPNs. According to the suggestion of Chang and Dillon [61], the G-Bell shape function was used to construct the fuzzy logic system, and the membership functions of the input and output variables are illustrated in Figure 3.
Through a focus group, the team members established the relationship between the input variables (occurrence, severity, and detection) and the output variable (FRPN). This relationship is illustrated in Figure 4. A total of 125 fuzzy rules (5 × 5 × 5 = 125) were determined; one of the fuzzy rules is as follows: if the occurrence is very low, the severity is medium, and the detection is very high, then the FRPN is medium. Based on these fuzzy rules, the fuzzy logic system was constructed. The schematic of the constructed fuzzy logic system is illustrated in Figure 5. The 3D surface viewers of the constructed fuzzy logic system are presented in Figure 6, which shows the influences of input variables on the FRPN. It can be observed that these 3D surface viewers conform to the characteristic of monotonicity, and thus the constructed fuzzy logic system can yield valid and comparable results.

4.3.2. Calculating the FRPN

Through the constructed fuzzy logic system, the FRPN was obtained. Figure 7 illustrates the rule viewer of the constructed system, which can receive the defuzzification values of the risk parameters for the three inputs and generate the FRPN for the output. For example, for failure mode No. 1, it can be expressed as follows: if the defuzzification value of occurrence was 7.342, the defuzzification value of severity was 7.488, and the defuzzification value of detection was 3.498, then the FRPN was 6.395. The FRPNs of all the failure models produced by using the constructed fuzzy logic system are presented in column 2 of Table 14, and the prioritizations as per FRPNs are presented in the last column of Table 14.

4.4. Modifying the Failure Modes with High Priorities for IVIS

Corrective actions were developed for the top 50% of failure modes that were ranked from 1 to 12 (as listed in Table 14), with failure mode No. 3 (Users are not aware of how to operate) given the highest priority. This was followed by failure modes No. 22 (Users are unable to figure out how to use it) and No. 20 (Users have difficulty understanding the meaning of words). The last error requiring corrective action was failure mode No. 7 (Users are not aware of how to operate). The original IVIS had numerous functions that were not effectively designed, resulting in a poor UX. To improve its UX, several corrective actions were carried out. These actions were proposed based on the design principles for dealing with error, the laws of UX, and the principle of user interface design [28,62,63]. The detailed actions included simplifying operations to reduce users’ burden and facilitate task completion (for failure modes No. 3 and No. 19), enhancing the system model to better align with users’ mental model (for failure modes No. 8 and No. 22), and providing perceivable signifiers for users to understand possible actions and their execution (for failure modes No. 1, No. 23, and No. 24). Other actions involved using the words familiar to users (for failure modes No. 20), setting clear clues in the appropriate context for each task (for failure modes No. 18), adjusting the interface layout to facilitate the execution of frequently used tasks (for failure mode No. 16), and improving the information architecture for ease of use (for failure mode No. 11). The primary user interface for the revised IVIS is shown in Figure 8.

5. Discussion

Traditional FMEA used exact numbers to evaluate the risk factors and employed the RPN, which was computed through Equation (1), to prioritize failure modes. By contrast, the proposed approach used fuzzy linguistic terms to evaluate the risk factors, and the results were then aggregated through SAM. On the basis of the aggregated values, a fuzzy logic system was built to derive the FRPN that was used to prioritize failure modes. A comprehensive experiment was carried out where the values for occurrence, severity, and detection, along with the corresponding RPNs, were systematically obtained by the team members, following the guidelines stipulated in traditional FMEA. To compare the results, we placed the FRPNs from our approach alongside the RPNs from traditional FMEA, as shown in Table 15. The results show that our approach is more effective in generating unique values. It differentiated between failure modes that were indistinguishable using traditional FMEA. For instance, failure modes No. 1 and No. 16 had identical RPNs (224) with traditional FMEA. However, with our new approach, they had different FRPNs (6.395 and 6.384). In addition, if we only used severity to prioritize failure modes, many failure modes would be indistinguishable. For instance, failure modes No. 10, No. 11, No. 14, No. 15, No. 19, and No. 21 all had an identical severity level of 6. Obviously, the FRPNs from our approach provided a clear ranking of the failure modes, each with different priorities. This clear ranking can offer valuable insights that improve the UX of interactive system design.
The comparison between the proposed approach and two other typical approaches is presented in Table 16. In the approach that combined FMEA with fuzzy TOPSIS [64], the weights of the risk factors—occurrence, severity, and detection—were taken into account when calculating the FRPN. This results in a greater variety of unique FRPN values, thereby facilitating the prioritization of failure modes. However, in this combined approach, the FRPN was derived through fuzzy algebra operations, and the relationship between the risk factors and the FRPN was not fully addressed; therefore, there may be some bias in the results of this combined approach. For example, in the case of failure mode No. 3, the prioritizations obtained from the other two approaches are both ranked 1, while the prioritization from the approach that combined FMEA with fuzzy TOPSIS is ranked 2. In the approach that combined FMEA with fuzzy logic [13], the input values for the fuzzy logic system were derived from the defuzzification values, which were calculated based on the average of the fuzzy evaluation results. Consequently, identical FRPNs may occur, making it challenging to determine the prioritization of failure modes. For example, the prioritizations for failure modes No. 4, No. 5, No. 7, and No. 12 are identical. Clearly, the proposed approach, which integrates FMEA with SAM and fuzzy logic, overcomes the limitations of the two other typical approaches. Based on these findings, we believe our new approach offers several advantages, including more accurate results, ease of understanding, and flexibility in practical applications.
In order to compare the UX of the original IVIS with the newly revised version, an A/B test was conducted, and the system usability scale (SUS) was employed. SUS was developed by Brooke [65] and has been extensively used in measuring the UX of interactive systems. It comprises 10 statements to which users are asked to express their level of agreement. The statements are equally divided between positive and negative wording. In this scale, a score of 0 represents the worst possible outcome, while 100 represents the best. We enlisted 30 participants for this UX test, ensuring a balance in gender and an age range between 30 and 60. Each participant had at least 5 years of IVIS experience, ensuring a solid understanding and familiarity with such systems. The participants were asked to execute the assigned tasks and then assess both versions of the IVIS using SUS. The revised IVIS received a SUS score of 90.12. This was a significantly higher score compared to that of the original IVIS, which only garnered a score of 60.15. The statistical significance of this difference was confirmed (p < 0.05). These results suggest that the recommended measures that were incorporated into the revised IVIS design were indeed effective, and the revised design has proven to be more usable. Therefore, these findings serve to validate the proposed approach, demonstrating its effectiveness in enhancing the UX of the IVIS.
This study primarily focused on identifying and ranking failure modes. Despite the fact that the causes of these failure modes were delineated with clarity, we did not delve into a comprehensive investigation of the underlying mechanisms of these causes. To facilitate a deeper understanding of these mechanisms, one potential approach could involve the application of fault tree analysis, which is often utilized in the exploration of potential causes for failure modes [66,67]. Future research could concentrate on integrating fault tree analysis with the approach proposed in this paper to research the root causes of failure models concerning UX [68]. Note that in this case study, failure mode identification was carried out in a stationary vehicle, not a moving one. This had a minimal impact on the accuracy of error identification results [69]. Future studies could expand this research to include vehicles in motion on highways.
Our approach is slightly complex and comprises several computational steps, but it is properly carried out. More importantly, it is composed of four simplification stages, namely, detecting failure modes, analyzing failure modes, calculating FRPNs by using fuzzy logic, and modifying the failure modes with high priorities. The fuzzy calculation process can be facilitated through programming. In this study, the programming was implemented using the fuzzy logic toolbox for MATLAB. It involved aggregating fuzzy opinions for risk parameter assessments and calculating FRPNs with fuzzy logic. The proposed approach will have broad applications due to these four simplification stages. While this study employed an IVIS as an example, the approach outlined in this research is universal and can be applied broadly to other interactive systems, including mobile apps, software interfaces, and even specific hardware controls, with the aim of improving UX. Possible future works include identifying automated repair methods for the failure modes identified and ranked through the proposed method, identifying how the FRPN values from the proposed method can help with such repair, and adding the fuzziness of human reasoning while interacting with the system.

6. Conclusions

In this paper, we propose a fuzzy FMEA-based hybrid approach that integrates FMEA with SAM and fuzzy logic to improve the UX of interactive system design. Through the proposed approach, the priorities of failure modes concerning UX can be distinguished clearly; furthermore, it allows the subjective and even subconscious aspects of the risk factors of failure modes to be effectively managed. The proposed approach mainly focuses on the UX problem concerning designing for errors. This approach can be regarded as a universal approach for improving the UX of interactive system design and can be applied to a broader field of UX, including interactive product design, app design, and web design. It should be mentioned that in an interactive system, users, technologies, activities, contexts, and design can all lead to failure modes, and this study primarily focused on design. Future research should aim to integrate all components to analyze the risk of failure modes concerning the UX of interactive systems.

Author Contributions

Y.L. conceived of and designed the study, performed the experiments, and analyzed the data. L.Z. revised and polished the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the Philosophy and Social Sciences Foundation of the Jiangsu Higher Education Institutions of China (Grant No. 2023SJYB1078).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are contained within the article.

Acknowledgments

The authors would like to express their sincere thanks to the editor and the anonymous reviewers for their valuable comments and suggestions.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

UXUser experience
FMEAFailure mode and effect analysis
HTAHierarchical task analysis
SHERPASystematic human error reduction and prediction approach
RPNRisk priority number
FRPNFuzzy risk priority number
SAMSimilarity aggregation method
IVISIn-vehicle information system
AADAverage agreement degree
RADRelative agreement degree
CDCConsensus degree coefficient

References

  1. Benyon, D. Designing User Experience: A Guide to HCI, UX and Interaction Design, 4th ed.; Pearson: Harlow, UK, 2019. [Google Scholar]
  2. Nielsen, J. Usability Engineering; Morgan Kaufmann: San Diego, CA, USA, 1993. [Google Scholar]
  3. Rubin, J.; Chisnell, D. Handbook of Usability Testing: How to Plan, Design and Conduct Effective Tests, 2nd ed.; John Wiley & Sons: New York, NY, USA, 2008. [Google Scholar]
  4. Travis, D.; Hodgson, P. Think Like a UX Researcher: How to Observe Users, Infuence Design, and Shape Business Strategy; CRC Press: Boca Raton, FL, USA, 2019. [Google Scholar]
  5. Liu, P.; Wu, Y.; Li, Y.; Wu, X. An improved FMEA method based on the expert trust network for maritime transportation risk management. Expert Syst. Appl. 2024, 238, 121705. [Google Scholar] [CrossRef]
  6. Anes, V.; Morgado, T.; Abreu, A.; Calado, J.; Reis, L. Updating the FMEA Approach with Mitigation Assessment Capabilities—A Case Study of Aircraft Maintenance Repairs. Appl. Sci. 2022, 12, 11407. [Google Scholar] [CrossRef]
  7. Liu, H.-C.; Zhang, L.-J.; Ping, Y.-J.; Wang, L. Failure mode and effects analysis for proactive healthcare risk evaluation: A systematic literature review. J. Eval. Clin. Pract. 2020, 26, 1320–1337. [Google Scholar] [CrossRef] [PubMed]
  8. Cai, M.; Xiao, J.; Luo, Q.; Gao, Y.; Jian, X.; Wang, Y. Evidential FMEA method for human reliability assessment. Qual. Eng. 2024, 36, 21–35. [Google Scholar] [CrossRef]
  9. Testik, O.M.; Unlu, E.T. Fuzzy FMEA in risk assessment for test and calibration laboratories. Qual. Reliab. Eng. Int. 2023, 39, 575–589. [Google Scholar] [CrossRef]
  10. Kumru, M.; Kumru, P.Y. Fuzzy FMEA application to improve purchasing process in a public hospital. Appl. Soft Comput. 2013, 13, 721–733. [Google Scholar] [CrossRef]
  11. Muthukumar, A.; Krishnamurthy, K. Bus body manufacturing system via FEMA and fuzzy logic controller. Soft Comput. 2021, 25, 3889–3901. [Google Scholar] [CrossRef]
  12. Bohrey, O.P.; Chatpalliwar, A.S. Human error management in aviation maintenance using hybrid FMEA with a novel fuzzy approach. Def. Sci. J. 2024, 74, 11–21. [Google Scholar] [CrossRef]
  13. Chanamool, N.; Naenna, T. Fuzzy FMEA application to improve decision-making process in an emergency department. Appl. Soft Comput. 2016, 43, 441–453. [Google Scholar] [CrossRef]
  14. Stamatis, D.H. Failure Mode and Effect Analysis: FMEA from Theory to Execution, 2nd ed.; ASQ Quality Press: Milwaukee, WI, USA, 2003. [Google Scholar]
  15. Li, Y.; Zhu, L. Risk analysis of human error in interaction design by using a hybrid approach based on FMEA, SHERPA, and fuzzy TOPSIS. Qual. Reliab. Eng. Int. 2020, 36, 1657–1677. [Google Scholar] [CrossRef]
  16. Yin, H.; Liu, C.; Wu, W.; Song, K.; Liu, D.; Dan, Y. Safety assessment of natural gas storage tank using similarity aggregation method based fuzzy fault tree analysis (SAM-FFTA) approach. J. Loss Prev. Process Ind. 2020, 66, 104159. [Google Scholar] [CrossRef]
  17. Tuncel, A.L.; Besikci, E.B.; Akyuz, E.; Arslan, O. Safety analysis of fire and explosion (F&E) accidents risk in bulk carrier ships under fuzzy fault tree approach. Saf. Sci. 2023, 158, 105972. [Google Scholar] [CrossRef]
  18. Kumar, M.; Singh, K. Fuzzy fault tree analysis of chlorine gas release hazard in Chlor-Alkali industry using alpha-cut interval-based similarity aggregation method. Appl. Soft Comput. 2022, 125, 109199. [Google Scholar] [CrossRef]
  19. Stanton, N.A. Hierarchical task analysis: Developments, applications, and extensions. Appl. Ergon. 2006, 37, 55–79. [Google Scholar] [CrossRef]
  20. Salvendy, G. Handbook of Human Factors and Ergonomics, 4th ed.; John Wiley & Sons, Inc.: Hoboken, NJ, USA, 2012. [Google Scholar]
  21. Embrey, D.E. SHERPA: A systematic human error reduction and prediction approach. In Proceedings of the International Topical Meeting on Advances in Human Factors in Nuclear Power Systems, Knoxville, Tennessee, 21–24 April 1986; pp. 184–193. [Google Scholar]
  22. Stanton, N.A.; Salmon, P.M.; Rafferty, L.A.; Walker, G.H.; Baber, C.; Jenkins, D.P. Human Factors Methods: A Practical Guide for Engineering and Design, 2nd ed.; CRC Press: Boca Raton, FL, USA, 2013. [Google Scholar]
  23. Mandal, S.; Singh, K.; Behera, R.K.; Sahu, S.K.; Raj, N.; Maiti, J. Human error identification and risk prioritization in overhead crane operations using HTA, SHERPA and fuzzy VIKOR method. Expert Syst. Appl. 2015, 42, 7195–7206. [Google Scholar] [CrossRef]
  24. Schrepp, M. User Experience Questionnaires: How to Use Questionnaires to Measure the User Experience of Your Products? Independently Published: Chicago, IL, USA, 2021. [Google Scholar]
  25. Rogers, Y.; Sharp, H.; Preece, J. Interaction Design: Beyond Human-Computer Interaction, 6th ed.; John Wiley & Sons, Inc.: Hoboken, NJ, USA, 2023. [Google Scholar]
  26. Hassenzahl, M.; Diefenbach, S.; Göritz, A. Needs, affect, and interactive products—Facets of user experience. Interact. Comput. 2010, 22, 353–362. [Google Scholar] [CrossRef]
  27. Hartson, H.R. Human–computer interaction: Interdisciplinary roots and trends. J. Syst. Softw. 1998, 43, 103–118. [Google Scholar] [CrossRef]
  28. Norman, D.A. The Design of Everyday Things. Revised and Expanded Edition; Basic Books: New York, NY, USA, 2013. [Google Scholar]
  29. Shneiderman, B.; Plaisant, C.; Cohen, M.; Jacobs, S.; Elmqvist, N.; Diakopoulos, N. Designing the User Interface: Strategies for Effective Human-Computer Interaction, 6h ed.; Pearson: Boston, MA, USA, 2016. [Google Scholar]
  30. Atalay, K.D.; Eraslan, E. Multi-criteria usability evaluation of electronic devices in a fuzzy environment. Hum. Factors Ergon. Manuf. Serv. Ind. 2014, 24, 336–347. [Google Scholar] [CrossRef]
  31. Camargo, M.; Wendling, L.; Bonjour, E. A fuzzy integral based methodology to elicit semantic spaces in usability tests. Int. J. Ind. Ergon. 2014, 44, 11–17. [Google Scholar] [CrossRef]
  32. Chou, J.-R. A psychometric user experience model based on fuzzy measure approaches. Adv. Eng. Inform. 2018, 38, 794–810. [Google Scholar] [CrossRef]
  33. Albert, B.; Tullis, T. Measuring the User Experience: Collecting, Analyzing, and Presenting UX Metrics, 3rd ed.; Morgan Kaufmann: Cambridge, MA, USA, 2022. [Google Scholar]
  34. Razouk, H.; Kern, R. Improving the Consistency of the Failure Mode Effect Analysis (FMEA) Documents in Semiconductor Manufacturing. Appl. Sci. 2022, 12, 1840. [Google Scholar] [CrossRef]
  35. Zhu, M.; Zhou, W.; Duan, C. Integrating FMEA and fuzzy super-efficiency SBM for risk assessment of crowdfunding project investment. Soft Comput. 2024, 28, 2563–2575. [Google Scholar] [CrossRef]
  36. Akhtar, M.J.; Naseem, A.; Ahsan, F. A novel hybrid approach to explore the interaction among faults in production process with extended FMEA model using DEMATEL and cloud model theory. Eng. Fail. Anal. 2024, 157, 107876. [Google Scholar] [CrossRef]
  37. Ju, Y.; Zhao, Q.; Luis, M.; Liang, Y.; Dong, J.; Dong, P.; Giannakis, M. A novel framework for FMEA using evidential BWM and SMAA-MARCOS method. Expert Syst. Appl. 2024, 243, 122796. [Google Scholar] [CrossRef]
  38. Zadeh, L.A. Fuzzy sets. Inf. Control 1965, 8, 338–353. [Google Scholar] [CrossRef]
  39. Ceylan, B.O. Shipboard compressor system risk analysis by using rule-based fuzzy FMEA for preventing major marine accidents. Ocean Eng. 2023, 272, 113888. [Google Scholar] [CrossRef]
  40. Can, G.F.; Demirok, S. Universal usability evaluation by using an integrated fuzzy multi criteria decision making approach. Int. J. Intell. Comput. Cybern. 2019, 12, 194–223. [Google Scholar] [CrossRef]
  41. Rao, C.; Gao, M.; Wen, J.; Goh, M. Multi-attribute group decision making method with dual comprehensive clouds under information environment of dual uncertain Z-numbers. Inf. Sci. 2022, 602, 106–127. [Google Scholar] [CrossRef]
  42. Li, Y.; Zhu, L. Optimization of user experience in mobile application design by using a fuzzy analytic-network-process-based Taguchi method. Appl. Soft Comput. 2019, 79, 268–282. [Google Scholar] [CrossRef]
  43. Zimmermann, H.-J. Fuzzy Set Theory—And Its Applications, 4th ed.; Kluwer Academic Publishers: Boston, MA, USA, 2001. [Google Scholar]
  44. Nourbakhsh Borujerd, S.V.; Soleimani, A.; Esfandyari, M.J.; Masih-Tehrani, M.; Esfahanian, M.; Nehzati, H.; Dolatkhah, M. Fuzzy logic approach for failure analysis of Li-ion battery pack in electric vehicles. Eng. Fail. Anal. 2023, 149, 107233. [Google Scholar] [CrossRef]
  45. Sulikowski, P.; Zdziebko, T.; Hussain, O.; Wilbik, A. Fuzzy Approach to Purchase Intent Modeling Based on User Tracking For E-commerce Recommenders. In Proceedings of the 2021 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), Luxembourg, 11–14 July 2021; pp. 1–8. [Google Scholar]
  46. Li, Y.; Zhu, L. Multi-objective optimisation of user experience in mobile application design via a grey-fuzzy-based Taguchi approach. Concurr. Eng.-Res. Appl. 2020, 28, 175–188. [Google Scholar] [CrossRef]
  47. Jong, C.H.; Tay, K.M.; Lim, C.P. Application of the fuzzy failure mode and effect analysis methodology to edible bird nest processing. Comput. Electron. Agric. 2013, 96, 90–108. [Google Scholar] [CrossRef]
  48. Banks, V.; Allison, C.K.; Parnell, K.; Plant, K.; Stanton, N.A. Predicting and mitigating failures on the flight deck: An aircraft engine bird strike scenario. Ergonomics 2022, 65, 1672–1695. [Google Scholar] [CrossRef] [PubMed]
  49. Tzeng, G.-H.; Huang, J.-J. Multiple Attribute Decision Making: Methods and Applications; CRC Press: Boca Raton, FL, USA, 2011. [Google Scholar]
  50. Guo, C.; Wu, W. Risk assessment of disconnect operations of MNPP using similarity aggregation method based fuzzy dynamic Bayesian networks model. Ocean Eng. 2023, 285, 115390. [Google Scholar] [CrossRef]
  51. Hsu, H.-M.; Chen, C.-T. Aggregation of fuzzy opinions under group decision making. Fuzzy Sets Syst. 1996, 79, 279–285. [Google Scholar]
  52. Psarros, G.A. Fuzzy logic system interference in ship accidents. Hum. Factors Ergon. Manuf. Serv. Ind. 2018, 28, 372–382. [Google Scholar] [CrossRef]
  53. Hassan, F.u.; Nguyen, T.; Le, T.; Le, C. Automated prioritization of construction project requirements using machine learning and fuzzy failure mode and effects analysis (FMEA). Autom. Constr. 2023, 154, 105013. [Google Scholar] [CrossRef]
  54. Chaudhary, A.K.; Pandey, A.K.; Dubey, A.K. Computer aided Taguchi-fuzzy multi-optimization of laser cutting process. J. Intell. Fuzzy Syst. 2014, 26, 801–810. [Google Scholar] [CrossRef]
  55. Ross, T.J. Fuzzy Logic with Engineering Applications, 4th ed.; John Wiley & Sons, Ltd.: Chichester, UK, 2017. [Google Scholar]
  56. Tzeng, Y.-f.; Chen, F.-c. Multi-objective optimisation of high-speed electrical discharge machining process using a Taguchi fuzzy-based approach. Mater. Des. 2007, 28, 1159–1168. [Google Scholar] [CrossRef]
  57. Lee, S.C.; Kim, Y.W.; Ji, Y.G. Effects of visual complexity of in-vehicle information display: Age-related differences in visual search task in the driving context. Appl. Ergon. 2019, 81, 102888. [Google Scholar] [CrossRef]
  58. Feng, F.; Liu, Y.; Chen, Y. A computer-aided usability testing tool for in-vehicle infotainment systems. Comput. Ind. Eng. 2017, 109, 313–324. [Google Scholar] [CrossRef]
  59. Biondi, F.; Alvarez, I.; Jeong, K.-A. Human–vehicle cooperation in automated driving: A multidisciplinary review and appraisal. Int. J. Hum.–Comput. Interact. 2019, 35, 932–946. [Google Scholar] [CrossRef]
  60. Ramzali, N.; Lavasani, M.R.M.; Ghodousi, J. Safety barriers analysis of offshore drilling system by employing Fuzzy Event Tree Analysis. Saf. Sci. 2015, 78, 49–59. [Google Scholar] [CrossRef]
  61. Chang, E.; Dillon, T.S. A usability-evaluation metric based on a soft-computing approach. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 2006, 36, 356–372. [Google Scholar] [CrossRef]
  62. Ruiz, J.; Serral, E.; Snoeck, M. Unifying Functional User Interface Design Principles. Int. J. Hum.–Comput. Interact. 2021, 37, 47–67. [Google Scholar] [CrossRef]
  63. Yablonski, J. Laws of UX: Using Psychology to Design Better Products & Services; O’Reilly Media, Inc.: Sebastopol, CA, USA, 2020. [Google Scholar]
  64. Selim, H.; Yunusoglu, M.G.; Balaman, S.Y. A Dynamic Maintenance Planning Framework Based on Fuzzy TOPSIS and FMEA: Application in an International Food Company. Qual. Reliab. Eng. Int. 2016, 32, 795–804. [Google Scholar] [CrossRef]
  65. Brooke, J. SUS—A quick and dirty usability scale. Usability Eval. Ind. 1996, 189, 4–7. [Google Scholar]
  66. Gallardo, B.; Sutherland, W.J.; Martin, P.; Aldridge, D.C. Applying fault tree analysis to biological invasions identifies optimal targets for effective biosecurity. J. Appl. Ecol. 2022, 59, 2553–2566. [Google Scholar] [CrossRef]
  67. Mutlu, N.G.; Altuntas, S. Risk analysis for occupational safety and health in the textile industry: Integration of FMEA, FTA, and BIFPET methods. Int. J. Ind. Ergon. 2019, 72, 222–240. [Google Scholar] [CrossRef]
  68. Arifin, H.H.; Kawamura, K.; Robert Ong, H.K.; Pepper, B.; Chimplee, N.; Pavalkis, S. Model-based FMEA & FTA with case-based reasoning. INCOSE Int. Symp. 2023, 33, 305–319. [Google Scholar] [CrossRef]
  69. Harvey, C.; Stanton, N.A.; Pickering, C.A.; McDonald, M.; Zheng, P. A usability evaluation toolkit for in-vehicle information systems (IVISs). Appl. Ergon. 2011, 42, 563–574. [Google Scholar] [CrossRef]
Figure 1. Flowchart of the proposed methodology.
Figure 1. Flowchart of the proposed methodology.
Applsci 15 02954 g001
Figure 2. Primary user interface of the original IVIS.
Figure 2. Primary user interface of the original IVIS.
Applsci 15 02954 g002
Figure 3. Membership functions for (a) input variables and (b) output variables.
Figure 3. Membership functions for (a) input variables and (b) output variables.
Applsci 15 02954 g003
Figure 4. Relationship between occurrence, severity, detection, and FRPN.
Figure 4. Relationship between occurrence, severity, detection, and FRPN.
Applsci 15 02954 g004
Figure 5. Schematic of the constructed fuzzy logic system.
Figure 5. Schematic of the constructed fuzzy logic system.
Applsci 15 02954 g005
Figure 6. Three-dimensional surface viewers. (a) Severity, occurrence, and FRPN; (b) Detection, occurrence, and FRPN.
Figure 6. Three-dimensional surface viewers. (a) Severity, occurrence, and FRPN; (b) Detection, occurrence, and FRPN.
Applsci 15 02954 g006
Figure 7. Rule viewer of the constructed fuzzy logic system.
Figure 7. Rule viewer of the constructed fuzzy logic system.
Applsci 15 02954 g007
Figure 8. Primary user interface of the revised IVIS.
Figure 8. Primary user interface of the revised IVIS.
Applsci 15 02954 g008
Table 1. Failure mode taxonomy in SHERPA.
Table 1. Failure mode taxonomy in SHERPA.
Failure Mode CategoryFailure Mode CodeFailure Mode Description
ActionA1Operation too long/short
A2Operation mistimed
A3Operation in wrong direction
A4Operation too much/little
A5Misalign
A6Right operation on wrong object
A7Wrong operation on right object
A8Operation omitted
A9Operation incomplete
A10Wrong operation on wrong object
CheckingC1Check omitted
C2Check incomplete
C3Right check on wrong object
C4Wrong check on right object
C5Check mistimed
C6Wrong check on wrong object
Information communicationI1Information not communicated
I2Wrong information communicated
I3Information communication incomplete
Information retrievalR1Information not obtained
R2Wrong information obtained
R3Information retrieval incomplete
SelectionS1Selection omitted
S2Wrong selection made
Table 2. Fuzzy linguistic variables regarding occurrence.
Table 2. Fuzzy linguistic variables regarding occurrence.
Linguistic VariableTriangular Fuzzy NumberDescription
Very low (VL)(0, 0, 2.5)Failure modes are unlikely to occur.
Low (L)(0, 2.5, 5.0)Relatively few failure modes are likely to occur.
Medium (M)(2.5, 5.0, 7.5)Failure modes occur occasionally.
High (H)(5.0, 7.5, 10.0)Failure modes can be repeated.
Very high (VH)(7.5, 10.0, 10.0)Failure modes are almost inevitable.
Table 3. Fuzzy linguistic variables regarding severity.
Table 3. Fuzzy linguistic variables regarding severity.
Linguistic VariableTriangular Fuzzy NumberDescription
Very low (VL)(0, 0, 2.5)The effect of failure mode on usability can be ignored.
Low (L)(0, 2.5, 5.0)The effect slightly impacts usability.
Medium (M)(2.5, 5.0, 7.5)The effect slightly but noticeably impacts usability.
High (H)(5.0, 7.5, 10.0)The effect significantly impacts on usability.
Very high (VH)(7.5, 10.0, 10.0)The effect seriously impacts usability.
Table 4. Fuzzy linguistic variables regarding detection.
Table 4. Fuzzy linguistic variables regarding detection.
Linguistic VariableTriangular Fuzzy NumberDescription
Very low (VL)(0, 0, 2.5)Almost certain to be detected.
Low (L)(0, 2.5, 5.0)Easy to detect.
Medium (M)(2.5, 5.0, 7.5)Detected occasionally.
High (H)(5.0, 7.5, 10.0)Difficult to detect.
Very high (VH)(7.5, 10.0, 10.0)Almost impossible to detect.
Table 5. Traits of the team members in the study.
Table 5. Traits of the team members in the study.
Team MemberProfessional Position (T1)Job Experience (T2)Education (T3)Age (T4)
TM1Senior expert20PhD43
TM2Intermediate expert17Master39
TM3Senior expert35Bachelor59
TM4Designer30Master52
TM5Designer4Master25
TM6Advanced user27College diploma50
TM7Ordinary user5High school27
Table 6. HTA for the original IVIS regarding media, navigation, telephone, radio, and climate.
Table 6. HTA for the original IVIS regarding media, navigation, telephone, radio, and climate.
CodeTaskRule
0Performing relevant tasksPlan 0: do any of 1, 2, 3, 4, or 5 in any order
1MediaPlan 1: do 1.1, 1.2, 1.3, 1.4, and 1.5 in order
1.1  Play mediaPlan 1.1: do 1.1.1, 1.1.2, and 1.1.3 in order
1.1.1    Click on MENU
1.1.2    Click on Media
1.1.3    Click on Play
1.2  Adjust volumePlan 1.2: do 1.2.1, 1.2.2 in order
1.2.1    Click on blank area
1.2.2    Slide volume bar
1.3  Switch musicPlan 1.3: do 1.3.1, then do 1.3.2, 1.3.3, 1.3.4, and 1.3.5 in any order
1.3.1    Click on SelectionPlan 1.3.1: do 1.3.1.1 and 1.3.1.2 in order
1.3.1.1      Enter playlist
1.3.1.2      Click on the songs
1.3.2    Click on Previous
1.3.3    Click on Next
1.3.4    Click on Repeat
1.3.5    Click on Shuffle
1.4  Adjust processPlan 1.4: do 1.4.1 and 1.4.2 in any order
1.4.1    Slide to right
1.4.2    Slide to left
1.5  Close mediaPlan 1.5: do 1.5.1 and 1.5.2 in order
1.5.1    Click on Stop
1.5.2    Click on MENU
2NavigationPlan 2: do 2.1, 2.2, 2.3, and 2.4 in order
2.1  Open navigationPlan 2.1: do 2.1.1 and 2.1.2 in order
2.1.1    Click on MENU
2.1.2    Click on Navigation
2.2  Choose placePlan 2.2: do 2.2.1 and 2.2.2 in order
2.2.1    Set route
2.2.2    Set destinationPlan 2.2.2: do 2.2.2.1, 2.2.2.2, and 2.2.2.3 in any order
2.2.2.1      Save current position
2.2.2.2      Historical records
2.2.2.3      Home address
2.3  Start navigatingPlan 2.3: do 2.2, then do 2.3.1, 2.3.2, and 2.3.3 in order
2.3.1    Click on Selection
2.3.2    Select route
2.3.3    Click on Start
2.4  Close navigation
3TelephonePlan 3: do 3.1, 3.2, 3.3, and 3.4 in order
3.1  Open phone optionsPlan 3.1: do 3.1.1 and 3.1.2 in order
3.1.1    Click on MENU
3.1.2    Click on Call
3.2  Select contactsPlan 3.2: do 3.2.1, 3.2.2, or 3.2.3
3.2.1    Dial number
3.2.2    Contacts
3.2.3    Recent
3.3  Make callsPlan 3.3: do 3.3.1 and 3.3.2 in order
3.3.1    Click on dial button
3.3.2    Click on hang-up button
3.4  Return Home
4RadioPlan 4: do 4.1, 4.2, 4.3, and 4.4 in order
4.1  Turn on the radioPlan 4.1: do 4.1.1 and 4.1.2 in order
4.1.1    Click on MEUN
4.1.2    Click on radio options
4.2  Switch radioPlan 4.2: do 4.2.1, 4.2.2, and 4.2.3 in any order
4.2.1    Click on bandsPlan 4.2.1: do 4.2.1.1 and 4.2.1.2 in any order
4.2.1.1      Select AM
4.2.1.2      Select FM
4.2.2    Click on the radio list
4.2.3    Click on manual
4.3  Add stationPlan 4.3: do 4.2.2, then do 4.3.1 and 4.3.2 in order
4.3.1    Long press station
4.3.2    Click on blank to add box
4.4  Return home
5ClimatePlan 5: do 5.1, 5.2, and 5.3 in order
5.1  Turn on the air conditionerPlan 5.1: do 5.1.1, 5.1.2, 5.1.3, and 5.1.4 in order
5.1.1    Click on MENU
5.1.2    Click on vehicle button
5.1.3    Click on blank
5.1.4    Click on air conditioner button
5.2  Set air conditionerPlan 5.2: do 5.2.1, 5.2.2, and 5.2.3 in any order
5.2.1    Regulate air volumePlan 5.2.1: do 5.2.1.1 and 5.2.1.2 in any order
5.2.1.1      Increase air volume
5.2.1.2      Decrease air volume
5.2.2    Regulate temperaturePlan 5.2.2: do 5.2.2.1 and 5.2.2.2 in any order
5.2.2.1      Turn down the temperature
5.2.2.2      Turn up the temperature
5.2.3    Regulate blowing mode
5.3  Return home
Table 7. Failure modes identified using SHERPA.
Table 7. Failure modes identified using SHERPA.
Failure Mode No.Code in HTAFailure Mode CategoryFailure Mode DescriptionFailure Mode EffectFailure Mode Cause
11.1.1A9Users confuse the meaning of icons.Impact on the following operations.The meaning of icon is unclear.
21.1.2A9Users are unable to determine the correct method of operation.Unable to advance to the next step.The information architecture is complicated.
31.2.1I3Users are not aware of how to operate.It is difficult to complete the task.The operation is complex.
41.2.2A2Additional time is required to complete the operation.Impact on usability.The operation is complex.
51.3.2I1Users lack confidence in their operations.Impact on usability.Shortage of operational clues.
61.5.1A8Users omit certain steps in the operational process.Unable to complete the task.Insufficient relevant clues.
72.2.1.1A9Users are not aware of how to operate.It is difficult to complete the task.Be an unreasonable design.
82.3.1A4Users are not aware of how to operate.It is difficult to complete the task.The operation process is unreasonable.
92.2.2.4A9Users are unable to locate their saved records.Impact on usability.Be an unreasonable design.
102.4I3Users are unsure if the navigation has been initiated.Impact on usability.Insufficient relevant clues.
113.1.2I2Users are unable to determine the correct method of operation.Results in incorrect operation.The information architecture is complicated.
123.2.2R1Users are unable to locate the contact information.Unable to complete the task.Shortage of operational clues.
133.2.3C3Users select the wrong objects.Unable to complete the task.The meaning of icon is unclear.
143.4A8Users navigate back to the main interface without disconnecting the phone.Impact on the following operations.Shortage of operational clues.
153.2.1A9Users do not know how to navigate back.Impact on the following operations.Insufficient relevant clues.
163.2.1A2Users are not aware of how to operate.Results in incorrect operation.The layout of interface is unsuitable.
174.2.1A9Users have difficulty understanding the meaning of words.Unable to advance to the next step.Overlooking users’ characteristics.
184.2.2I3Users are unclear about their subsequent actions.Results in incorrect operation.Shortage of operational clues.
194.3.1A9Users are unclear about their subsequent actions.Results in incorrect operation.The operation is complex.
204.3.2A9Users have difficulty understanding the meaning of words.Results in incorrect operation.The meaning of words is unclear.
215.1.3I1Users are uncertain about their next step.Unable to advance to the next step.There are too many operational steps.
225.1.4A4Users are unable to figure out how to use it.Results in incorrect operation.The operation process is unreasonable.
235.2.1A9Users confuse the meaning of icons.Unable to advance to the next step.The meaning of icon is unclear.
245.2.3S2Users confuse the meaning of icons.Results in incorrect operation.The meaning of icon is unclear.
255.2.2.1A9Users are unclear about how to adjust the temperature.Unable to advance to the next step.Shortage of operational clues.
Table 8. Fuzzy evaluations and aggregation of opinions for occurrence.
Table 8. Fuzzy evaluations and aggregation of opinions for occurrence.
Failure Mode No.Fuzzy Evaluations of Team MembersAggregation of
Fuzzy Opinions
Defuzzification Value
TM1TM2TM3TM4TM5TM6TM7
1HVHMVHMHH(5.072, 7.572, 9.382)7.342
2MMHMMHH(3.428, 5.928, 8.428)5.928
3VHVHHVHVHVHVH(7.215, 9.715, 10.000)8.977
4MMLMMMM(2.227, 4.727, 7.227)4.727
5MMMMHMM(2.660, 5.160, 7.660)5.160
6MMLMMMM(2.227, 4.727, 7.227)4.727
7MHMMHMM(2.981, 5.481, 7.981)5.481
8VHVHHVHVHVHH(6.999, 9.499, 10.000)8.832
9MMMHMHM(3.066, 5.566, 8.066)5.566
10MMHMMMM(2.773, 5.273, 7.773)5.273
11HHHHHMH(4.798, 7.298, 9.798)7.298
12HMMHHHH(4.406, 6.906, 9.406)6.906
13MMLMLMM(1.962, 4.462, 6.962)4.462
14MHMMMMM(2.716, 5.216, 7.716)5.216
15MMHMHMM(3.038, 5.538, 8.038)5.538
16HHMHHHH(4.727, 7.227, 9.727)7.227
17MMMMMMM(2.500, 5.000, 7.500)5.000
18HHHVHHHH(5.271, 7.771, 10.000)7.681
19HHHHHHH(5.000, 7.500, 10.000)7.500
20HHHVHHHH(5.271, 7.771, 10.000)7.681
21MMMMMMM(2.500, 5.000, 7.500)5.000
22VHVHVHHHVHH(6.618, 9.118, 10.000)8.579
23HHHHHMM(4.589, 7.089, 9.589)7.089
24HHHHHMM(4.589, 7.089, 9.589)7.089
25MMLMLMM(1.962, 4.462, 6.962)4.462
Table 9. Fuzzy evaluations and aggregation of opinions for severity.
Table 9. Fuzzy evaluations and aggregation of opinions for severity.
Failure Mode No.Fuzzy Evaluations of Team MembersAggregation of
Fuzzy Opinions
Defuzzification Value
TM1TM2TM3TM4TM5TM6TM7
1HHVHHHMH(5.085, 7.585, 9.793)7.488
2HHHHHHM(4.896, 7.396, 9.896)7.396
3VHVHVHVHVHHVH(7.285, 9.785, 10.000)9.023
4HMHHMHH(4.519, 7.019, 9.519)7.019
5HMMHHHH(4.406, 6.906, 9.406)6.906
6LLLLLLM(0.104, 2.604, 5.104)2.604
7HHHMHHH(4.741, 7.241, 9.741)7.241
8HHHHVHHVH(5.389, 7.889, 10.000)7.759
9MMMHMMH(2.967, 5.467, 7.967)5.467
10MMMMHHM(2.967, 5.467, 7.967)5.467
11HHMMHHH(4.364, 6.864, 9.364)6.864
12HHHHMMH(4.533, 7.033, 9.533)7.033
13MMMMMLM(2.298, 4.798, 7.298)4.798
14MMMMHMM(2.660, 5.160, 7.660)5.160
15HHHMHHH(4.741, 7.241, 9.741)7.241
16HHHHHHVH(5.117, 7.617, 10.000)7.578
17MMMMMMH(2.604, 5.104, 7.604)5.104
18HVHHHHVHH(5.543, 8.043, 10.000)7.862
19HHHHVHVHH(5.487, 7.987, 10.000)7.825
20VHHHVHVHVHH(6.548, 9.048, 10.000)8.532
21HMMMHHH(3.904, 6.404, 8.904)6.404
22VHVHVHVHVHHVH(7.285, 9.785, 10.000)9.023
23HHHMHHH(4.741, 7.241, 9.741)7.241
24HHHVHHHH(5.271, 7.771, 10.000)7.681
25HVHHHHMH(5.029, 7.529, 9.793)7.451
Table 10. Fuzzy evaluations and aggregation of opinions for detection.
Table 10. Fuzzy evaluations and aggregation of opinions for detection.
Failure Mode No.Fuzzy Evaluations of Team MembersAggregation of
Fuzzy Opinions
Defuzzification Value
TM1TM2TM3TM4TM5TM6TM7
1MLMLLLM(0.998, 3.498, 5.998)3.498
2LLLLMLL(0.160, 2.660, 5.160)2.660
3MMMMMML(2.396, 4.896, 7.396)4.896
4MMMMMMM(2.500, 5.000, 7.500)5.000
5MMLMMMM(2.227, 4.727, 7.227)4.727
6LLLLLLL(0.000, 2.500, 5.000)2.500
7MMMMLLM(2.033, 4.533, 7.033)4.533
8LLLLLLL(0.000, 2.500, 5.000)2.500
9MLMMMMM(2.284, 4.784, 7.284)4.784
10MLLMMMM(1.906, 4.406, 6.906)4.406
11MMMLLLL(1.110, 3.610, 6.110)3.610
12MMLLLLL(0.594, 3.094, 5.594)3.094
13LLMLLLL(0.273, 2.773, 5.273)2.773
14MMMMLML(2.131, 4.631, 7.131)4.631
15MMLMMLL(1.572, 4.072, 6.572)4.072
16MLMMMLL(1.629, 4.129, 6.629)4.129
17MMMMLML(2.131, 4.631, 7.131)4.631
18LLMLLLL(0.273, 2.773, 5.273)2.773
19LLLLLLL(0.000, 2.500, 5.000)2.500
20LLLLLLL(0.000, 2.500, 5.000)2.500
21MMMMLLL(1.685, 4.185, 6.685)4.185
22HHHVHHHH(5.271, 7.771, 10.000)7.681
23MLLMMLM(1.460, 3.960, 6.460)3.960
24HHMHHMM(4.072, 6.572, 9.072)6.572
25MMMMMLM(2.298, 4.798, 7.298)4.798
Table 11. Weighting scores according to the traits of team members.
Table 11. Weighting scores according to the traits of team members.
TraitsClassifyScore
Professional position (T1)Senior expert5
Intermediate expert4
Designer3
Advanced user2
Ordinary user1
Job experience (T2)≥30 years5
20–294
10–193
6–92
≤51
Education (T3)PhD5
Master4
Bachelor3
College diploma2
High school1
Age (T4)≥504
40–493
30–392
≤291
Table 12. Weights of team members based on their traits.
Table 12. Weights of team members based on their traits.
Team MemberWeighting TraitsTotal ScoreWeight
T1T2T3T4
TM15453170.191
TM24342130.146
TM35534170.191
TM43544160.180
TM5314190.101
TM62424120.135
TM7121150.056
Table 13. The computed AAD, RAD, and CDC for occurrence.
Table 13. The computed AAD, RAD, and CDC for occurrence.
Team Member Average Agreement Degree
(AAD)
Relative Agreement Degree
(RAD)
Consensus Degree Coefficient
(CDC)
TM10.4480.1900.191
TM20.2670.1130.130
TM30.2380.1010.146
TM40.2670.1130.147
TM50.2380.1010.101
TM60.4480.1900.163
TM70.4480.1900.123
Table 14. Prioritization of failure modes.
Table 14. Prioritization of failure modes.
Failure Mode No.FRPNPrioritization
16.3958
25.34719
38.0781
46.28614
56.26715
63.60225
76.33012
86.4326
95.15320
105.11321
116.37410
126.28913
134.86924
145.04622
156.09317
166.3849
175.01323
186.4674
196.4117
206.8233
215.88918
228.0282
236.33211
246.4505
256.23316
Table 15. Comparison of the results derived from two approaches.
Table 15. Comparison of the results derived from two approaches.
Failure Mode No.RPN Derived from the Traditional FMEA MethodFRPN Derived from the Proposed Approach
OccurrenceSeverityDetectionRPN
18742246.395
167842246.384
89832166.432
208932166.823
117652106.374
127562106.289
236752106.332
76841926.330
188831926.467
198641926.411
156641446.093
214661445.889
96541205.153
105641205.113
144651205.046
176451205.013
Table 16. Comparison of prioritization across different approaches.
Table 16. Comparison of prioritization across different approaches.
Failure Mode No.Prioritization Based on the Proposed ApproachPrioritization Based on the Combination of FMEA with Fuzzy TOPSISPrioritization Based on the Combination of FMEA with Fuzzy Logic
1899
2191619
3121
4141811
5151511
6252525
7121211
8645
9201920
10212120
11101110
12131311
13242424
14222222
15171416
16978
17232322
18464
19787
20353
21182016
22212
23111015
24536
25161718
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Li, Y.; Zhu, L. Failure Modes Analysis Related to User Experience in Interactive System Design Through a Fuzzy Failure Mode and Effect Analysis-Based Hybrid Approach. Appl. Sci. 2025, 15, 2954. https://doi.org/10.3390/app15062954

AMA Style

Li Y, Zhu L. Failure Modes Analysis Related to User Experience in Interactive System Design Through a Fuzzy Failure Mode and Effect Analysis-Based Hybrid Approach. Applied Sciences. 2025; 15(6):2954. https://doi.org/10.3390/app15062954

Chicago/Turabian Style

Li, Yongfeng, and Liping Zhu. 2025. "Failure Modes Analysis Related to User Experience in Interactive System Design Through a Fuzzy Failure Mode and Effect Analysis-Based Hybrid Approach" Applied Sciences 15, no. 6: 2954. https://doi.org/10.3390/app15062954

APA Style

Li, Y., & Zhu, L. (2025). Failure Modes Analysis Related to User Experience in Interactive System Design Through a Fuzzy Failure Mode and Effect Analysis-Based Hybrid Approach. Applied Sciences, 15(6), 2954. https://doi.org/10.3390/app15062954

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop