Next Article in Journal
Application of a Multi-Strategy Improved Sparrow Search Algorithm in Bridge Crane PID Control Systems
Next Article in Special Issue
Applying Design Thinking to Develop AI-Based Multi-Actor Decision-Support Systems: A Case Study on Human Capital Investments
Previous Article in Journal
Fuzzy Comprehensive Evaluation of Collapse Risk in Mountain Tunnels Based on Game Theory
Previous Article in Special Issue
Enhancing Spatial Cognition in Online Virtual Museum Environments: Integrating Game-Based Navigation Strategies for Improved User Experience
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Importance Ranking of Usability Indicators for Second-Hand Trading Applications Based on Exploratory Factor Analysis—Analytic Hierarchy Process toward Sustainable Development

by
Xiaoxue Liu
,
Boyoung Lee
and
Kyungjin Park
*
Department of Industrial Design, Hanyang University, ERICA Campus, Ansan 15588, Republic of Korea
*
Author to whom correspondence should be addressed.
Appl. Sci. 2024, 14(12), 5164; https://doi.org/10.3390/app14125164
Submission received: 18 May 2024 / Revised: 11 June 2024 / Accepted: 12 June 2024 / Published: 13 June 2024
(This article belongs to the Special Issue Advanced Technologies for User-Centered Design and User Experience)

Abstract

:
In contemporary society, excessive energy consumption and rapid product development cycles are seen as significant barriers to sustainable development. Second-hand trading apps have emerged as a solution to this issue that allow the extension of the lifecycle of products to reduce resource consumption and waste generation. This study aims to support the design and development of second-hand trading apps by establishing and prioritizing usability indicators. To this end, we assembled a team of 20 experts and initially identified usability indicators using the Delphi method. Then, data from surveys of 412 users were analyzed using Exploratory Factor Analysis (EFA) to reduce dimensions, and the Analytic Hierarchy Process (AHP) was used to finally rank the relative importance and priority of these indicators. The results show that of the Level 1 indicators, safety and privacy, learning and operation, and information architecture are relatively highly prioritized. For the Level 2 indicators, property protection, page information architecture, privacy protection, ease of use, and efficiency ranked highly in terms of composite weight priority. The findings of this study will aid in the usability evaluation and enhancement of future second-hand trading apps. By optimizing app usability, increasing user engagement, and thereby boosting the rate of second-hand product purchases, this research contributes positively to the sustainable development of the environment by reducing waste generation.

1. Introduction

In contemporary society, the pursuit of sustainable consumption and the imperative of environmental protection stand as pivotal concerns. The excessive consumption of energy coupled with the rapid, iterative development of products poses formidable challenges to the goal of achieving sustainable development [1,2]. In particular, consumer culture is driven by the quest for immediate gratification, which engenders resource wastage and environmental deterioration in addition to enduring adverse consequences [3,4]. For example, rapidly changing fashions and the fleeting pursuit of particular design styles have led to the trend of disposable product use. This trend not only results in the continuous growth of solid waste but also has numerous negative impacts on the environment and climate change [5]. According to an analysis by Business Insider, fashion production accounts for 10% of global carbon emissions, and 85% of textiles are thrown away each year [6]. Over the past 15 years, the number of times a piece of clothing is worn has decreased by more than one-third, to an average of seven times, leading to the generation of 92 million tons of textile waste globally each year [7]. In this social context, second-hand trading apps are playing a crucial role in providing consumers with new consumption experiences while simultaneously fostering a culture of sustainable consumption [8]. From the perspective of sustainability, second-hand goods trading not only breathes new life into products by allowing unneeded or idle items to be passed on to those who can use them, effectively extending product lifecycles; it also significantly reduces resource consumption and waste output [9]. According to a report by Schibsted, the buying and selling of second-hand items through their platform resulted in approximately 290,992 tons of steel saved in 2021, equivalent to the amount used in 11.5 million bicycles, and a further 8.2 billion plastic bags were saved simply through use of the second-hand trading app [10]. With the ubiquity of smartphones, the methods of second-hand trading have become more diversified, and second-hand trading apps have emerged as important platforms for users to conveniently buy and sell used items [11]. However, according to one report, more than 56% of users uninstall apps within the first seven days of installation [12]. Therefore, optimizing the app’s usability becomes especially crucial to attract and retain more users for second-hand trading apps [13]. However, assessing and improving the sustainable usability of second-hand trading apps remains a challenge, and the development of usability evaluation metrics wherein both user convenience and environmental impact are considered is an important research topic [14,15].
In order to achieve the above objectives, this study addresses the following research questions:
RQ1: Which indicators are closely related to the usability evaluation of a sustainable second-hand trading app?
RQ2: What is the importance ranking of indicators at different levels in the usability evaluation of a sustainable second-hand trading app?
RQ3: What is the overall importance ranking of the indicators in the usability evaluation of a sustainable second-hand trading app?
In summary, the purpose of this study is to rank the importance of usability indicators for second-hand trading apps using the Delphi method, Exploratory Factor Analysis (EFA), and Analytic Hierarchy Process (AHP) to identify the key indicators that enhance usability. The findings will not only aid in developing applications that better meet user needs, improve user experience and satisfaction, and reduce the uninstall rate but also have profound implications for encouraging users to adopt eco-friendly living habits, mitigating environmental pollution, and reducing resource wastage.

2. Literature Review

2.1. Application Usability

The concept of usability was first introduced by Nielsen in the 1970s. The definition of usability varies among researchers and fields of study [16]. Application usability refers to the ease with which users can interact with and navigate an application to complete tasks effectively and efficiently [17]. Therefore, highly usable applications are intuitive and user-friendly, minimizing user frustration while maximizing productivity.
The research by Baharuddin, R., Singh, D., and others proposes a set of usability dimensions for designing and evaluating mobile applications [18]. Hoehle, H. and Venkatesh, V. conducted a study to propose and validate a conceptual framework and survey instrument for mobile application usability to better understand the impact of mobile application usability and to provide guidance for designing effective mobile applications [14]. Sibarani, A. J. evaluated the satisfaction and usage levels of e-learning applications and their functionalities using the five usability metrics established by Nielsen [19]. Mazaheri Habibi, M. R., Moghbeli, F., and others conducted a study on the usability of applications used by pregnant women, employing Nielsen’s five usability principles [20].
These studies have made significant contributions to the evaluation of mobile application usability. However, most research has focused on broad categories of mobile applications or has conducted usability tests based on existing general mobile application metrics without considering the specific characteristics of particular mobile applications. Notably, almost all usability tests have used Nielsen’s usability principles, with little consideration of the unique attributes of specific mobile applications. Therefore, this study builds upon the metrics proposed by Nielsen and others, incorporating the specific features of particular software for a more detailed and focused investigation.

2.2. Second-Hand Trading Applications

Second-hand goods trading platforms provide a marketplace for exchange and communication between the owners of idle items and buyers. This not only extends the lifespan of products but also reduces the need for manufacturing new products [21]. Given their impact on sustainability and economic benefits for consumers, there is currently extensive research on second-hand trading apps. W. Qi and P. Yang’s study focuses on the second-hand trading apps Xianyu and Hongbulin, analyzing the differences in interaction modes and their impact on user experience to enhance the overall user experience of second-hand trading apps [22]. Jiu, Y. and Hong, Q. developed an electronic trading platform for second-hand goods based on the Android platform. Utilizing the MVP architecture pattern during platform construction, they achieved a highly maintainable, API-oriented second-hand trading platform software [23]. Jin W. explored the relationship model between changes in user needs and dimensions of user flow experience in the design of internet shopping platforms, subsequently designing an internet shopping platform based on user flow experience [24]. Barbara Borusiak et al. employed the extended Theory of Planned Behavior (TPB) to study consumers’ willingness to purchase second-hand products and visit online and offline second-hand shops. Guiot, D. and Roux, D. proposed a second-hand shoppers’ motivation scale to evaluate the motivations of second-hand shoppers [25].
In summary, research on second-hand trading platforms primarily focuses on user experience, platform design and implementation, and consumer purchase intentions. Although these studies provide effective solutions for optimizing the use of second-hand trading apps, research on the importance of usability metrics specific to the characteristics of second-hand trading apps remains insufficient. Therefore, this paper aims to develop usability metrics from a sustainability perspective, considering the unique characteristics of second-hand trading apps.

2.3. Sustainable Consumption and Second-Hand Purchases

Sustainable consumption refers to using products and services in ways that minimize environmental impact [26]. Paavola’s research indicates that people can reduce environmental harm by altering their consumption patterns [27]. According to Wikipedia, sustainable consumption relies on the efficient use of resources, reduction of waste and pollution, utilization within the regenerative capacity of renewable resources, and the reuse and upcycling of products throughout their lifecycle to maximize their utility; it also emphasizes intergenerational and intragenerational equity [28]. The concept of sustainable consumption has also influenced consumer needs and values [29], protesting against wasteful consumption and fast fashion, which has led to the emergence of an alternative model of circular fashion systems [30]. As environmental awareness and the importance of sustainability continue to increase, a new trend of second-hand purchasing is emerging [11]. The number of second-hand retailers is continuously increasing [31], growing at a rate 11 times faster than the overall retail sector [11]. By 2029, the second-hand market is expected to account for over 17% of traditional retail [11]. The rise of e-commerce has also led to a surge in online second-hand platforms [32]. To provide a good online environment, studies by Ganguly et al. and Haryanti and Subriadi indicate that a unified and aesthetically pleasing user interface [11], combined with a comfortable and satisfactory user experience design, plays a crucial role in creating an effective and emotionally appealing online platform [28]. Therefore, this paper will also study aspects of user experience and effectiveness to propose usability evaluation metrics for second-hand trading platforms, providing an evaluation framework for improving the usability of second-hand trading applications.

3. Methodology

3.1. Research Framework

In this study, the Delphi technique, Exploratory Factor Analysis (EFA), and Analytic Hierarchy Process (AHP) are used to identify usability evaluation items for second-hand trading apps and analyze their importance. This research primarily revolves around deriving evaluation items and their weights, for which the methodology of this study is divided into three 3 parts. Part I: Through extensive literature searching, a series of preliminary usability metrics were collected, and the metrics were then confirmed through the distribution of Delphi questionnaires to domain experts. Part II: EFA was used to reduce these metrics into five dimensions. Part III: Weights were calculated using AHP, and the most critical usability metrics for second-hand trading apps were identified by assessing and ranking their priorities. An intuitive overview of the research steps is provided to the reader, with the methodological flowchart illustrated in Figure 1.

3.2. Research Methods and Survey Techniques

3.2.1. Delphi Method

The Delphi method, developed by the RAND Corporation (Santa Monica, CA, USA) in 1953, is a forecasting technique based on expert opinions [33]. This method utilizes iterative rounds of anonymous surveys to deepen the understanding of uncertain issues through achieving a consensus among experts. The Delphi method particularly emphasizes a feedback mechanism, allowing experts to adjust their views after considering the opinions of their peers, thereby enhancing the accuracy of judgments and facilitating the formation of consensus. It is widely applied in exploratory, normative, and predictive analyses [34]. Typically, this process involves the careful selection of anonymous experts to form a chosen group who undergo two to three rounds of structured surveys. After each round, the questionnaire is adjusted based on expert feedback and distributed for the next round, with this process repeated until a consensus is reached among the experts [35,36,37].

Scientific Validity of the Questionnaire

Considering the scientific validity and quality control of the questionnaire, the content of this study’s questionnaire references the one developed by Ye and Jiang [38]. The questionnaire includes (1) basic information about the experts, as shown in Table 1; (2) descriptions of the indicators: each indicator’s corresponding meaning and the supplementary explanations revised by the experts; (3) a 5-point Likert scale is used for rating the indicators. To ensure the rigorous use of the evaluation tool, other Delphi questionnaire rating tools were also investigated. According to the study by Remus, A., Smith, V., et al., using different rating scales in Delphi surveys does appear to affect the results; however, the 5-point scale was found to be most consistent with the final outcomes [39]. Furthermore, a literature review on the Delphi method revealed that previous researchers have commonly employed the 5-point Likert scale [40,41,42]. Therefore, this study also adopts the 5-point Likert scale for the questionnaire; (4) the survey also assesses the experts’ familiarity with the guidelines and judgment criteria.

Scientific Validity of the Experts

To ensure the authority, representativeness, and reliability of the research results, this study follows the criteria outlined by Skulmoski, G. J. et al. [43], which suggest that experts should meet four requirements: (1) acquire knowledge and experience through investigation, (2) participate voluntarily, (3) have sufficient time to participate, and (4) possess effective communication skills [43]. Therefore, this study adopted the following criteria for including experts: 15 experts with over 8 years of experience in design-related work or research, 2 experts with more than 5 years of experience in environmental science, and 3 software engineers with over 5 years of work experience, for a total of 20 experts. All the experts participated voluntarily, and they had sufficient time to engage in the study.

Questionnaire Distribution

In this study, a questionnaire was developed based on the collected usability metrics, and a Delphi survey was conducted from 5 March 2024 to 12 March 2024. The questionnaire was distributed via email. In the first round of the Delphi survey, statistical feedback information was collected from the questionnaires, and we removed some indicators based on the experts’ suggestions. The first round of revisions was incorporated into the second round of the consultation questionnaire, where experts then rated the revised indicators. Experts were required to rate each item using a 5-point Likert scale, with 1 being “very unimportant”, 3 being “neutral”, and 5 being “very important”. Throughout the survey process, experts were also encouraged to propose new measurement indicators to ensure a comprehensive evaluation.
Table 1. Demographic information of the expert Delphi panel.
Table 1. Demographic information of the expert Delphi panel.
N = 20ItemNumber of
Participants
Percentage (%)
Age Range (years)30–34735
35–39945
40–44315
Over 45 15
GenderM840
F1660
OccupationDesigner1050
Design Professor525
Environmental Science Professor 210
Software Engineer315
Education LevelBachelor’s Degree735
Master’s Degree 840
Ph.D. 525
Work Experience (years)5–9525
10–141470
More than 1515

3.2.2. Exploratory Factor Analysis

Exploratory Factor Analysis (EFA) was initially proposed by Charles Spearman in 1904 as a multivariate statistical technique aimed at reducing data into a smaller set of summary variables and exploring the underlying theoretical structure of phenomena [44,45].

Questionnaire Design

Based on the usability indicators obtained through the Delphi survey method, an online questionnaire was created on the Questionnaire Star platform (Wenjuanxing: http://www.wjx.cn 16 March 2024) to collect the data required for Exploratory Factor Analysis (EFA). The Questionnaire Star platform has been widely used in academic research, as demonstrated by studies conducted by Zhang Yan, Chen Yongping, Wu Wei, Zhang Yan, Ma Ling, Liu Hong, and others, all of whom utilized the Questionnaire Star platform for their online surveys [40,41,42]. The online questionnaire provides a convenient option for reaching a large audience. Reverse questions were included in the survey to reduce response bias and enhance the reliability and validity of the questionnaire [46].
Responses to the reverse questionnaire that were incorrect were considered invalid. The questionnaire was conducted from 14 March 2024 to 17 March 2024. Based on a review of the literature on survey sample sizes [47,48,49], a total of 412 users aged 18 and above who had actually used second-hand trading software were surveyed. The participant information is detailed in Table 2. A total of 412 questionnaires were distributed, of which 400 were valid and 12 were invalid. Among the invalid questionnaires, 8 had identical answers throughout, and 4 had incorrect responses to the reverse questions.

Research Process

Before performing an Exploratory Factor Analysis (EFA) of the data collected from online questionnaires, it is crucial to evaluate the validity and reliability of the data, determining their fitness for EFA. When the Kaiser–Meyer–Olkin (KMO) value is higher than 0.7, and the significance level in the Bartlett’s Test of Sphericity is less than 0.05, it indicates strong data validity. Additionally, a Cronbach’s alpha coefficient in the range of 0.7 to 0.95 indicates strong scale reliability [10].
After confirming the reliability and validity of the questionnaire, the data were processed using Exploratory Factor Analysis (EFA). Common factors with eigenvalues (λ) greater than 1 were retained [50]. These common factors and their included usability indicators were then grouped and named accordingly.

3.2.3. Analytic Hierarchy Process

The Analytic Hierarchy Process (AHP), developed by Thomas L. Saaty in the 1970s, is a method for accurately quantifying the weights of decision criteria [51,52]. With this method, the decision-making process becomes more scientific and objective, aiding in tackling complex decision issues to ensure the most suitable options are selected.

Questionnaire Design

The AHP questionnaire involves pairwise comparisons of indicators at each level to generate ratio scales for judgment. The AHP employs Saaty’s 1–9 scale allocation method [53] to score the indicators in the matrix. Each judgment is made by comparing the indicators in the left column with those in the top row to determine which of the two components is relatively more important. According to the literature [54], we ultimately decided to invite 20 industry experts with over 10 years of experience to participate in this questionnaire, including 3 product managers, 7 interaction designers, and 10 product designers. The demographic information of the 20 experts participating in the questionnaire is shown in Table 3.

Research Process

In this study, we first established a hierarchical framework model for the indicators. Considering that YAAHP 10.1 software (https://www.metadecsn.com/yaahp/ 21 May 2024) has been used in many studies [55,56,57] and has proven its applicability in the AHP method, we input the hierarchical framework model of the indicators into YAAHP 10.1 software for verification. After successful verification, we created a pairwise comparison matrix questionnaire. Finally, the numerical comparisons in the pairwise matrices were calculated to obtain the weight values at different levels.

4. Research Execution and Analysis

4.1. Extraction of Usability Indicators

In Usability Engineering, Nielsen defines usability as the measurement of whether a system or product meets consumer requirements, categorizing it into five aspects: Learnability, Efficiency, Memorability, Errors, and Satisfaction [58]. The ISO 9241 standard [59] defines usability as the extent to which specified users can achieve specified goals with Effectiveness, Efficiency, and Satisfaction in a particular context of use [60]. Brian Shackel’s definition emphasizes the necessity of system evaluation throughout the development lifecycle, highlighting four criteria of a usability system: effectiveness, learnability, flexibility, and user attitude [61]. Dumas and Redish (1994) described usability in terms of enhancing the speed and ease for users interacting with a product to achieve their objectives. Usability can be encapsulated as emphasizing user centricity, effectiveness, efficiency, and ease of use alongside the aspects of effectiveness, efficiency, and simplicity in use [62].
The above is based on the literature and compilation of usability indicators. However, considering the specific research subjects, further literature research on the usability of applications is needed. So, we considered the variability in usability across different researchers or fields not only by referencing the indicators of usability evaluation provided by scholars but also through utilizing widely recognized platforms such as Scopus, Web of Science, and Google Scholar [63,64]. Keywords including “app usability research”, “interface design”, and “online second-hand trading app” were used to search the literature. The aim was to comprehensively select usability indicators for second-hand trading apps from multiple perspectives. Liu, X. (2023) classifies the usability of app software interfaces into several categories: timely feedback on software operations, terminology understandable by users, clarity of the interface, consistency with public cognition, realization of value through application use, error feedback that notifies users of operational mistakes, assistance that offers solutions, privacy protection safeguarding user privacy, and protection of property [65]. In their study on the factors influencing satisfaction with app interface design, Han, X., Tao, X., and Zhou, Z. (2021) detailed that interface clarity, simplicity, and the layout of graphics and text significantly impact the usability of app interfaces [66]. Richardson, B., Campbell-Yeo, M., and Smit, M. (2021) described the usability of mobile applications through seven indicators in their article: “usable”, “usefulness”, “desirable”, “findability”, “accessibility”, “credibility”, and “valuable” [67]. Padmavathy, C., Swapna, M., and Paul, J. (2019) demonstrated in their study that when using second-hand trading software, the software convenience, the pleasure derived from purchasing products, the social aspect of communicating with sellers, and the security of the payment system are aspects that capture consumer attention [68]. Qi, W. and Yang, P. (2021) argue that in mobile apps for trading second-hand luxury goods, a user-centric approach should be emphasized, focusing on “interactive design” between the platform and users, “page information architecture” design, and “navigation” design [22].
Based on the indicators from the literature review, a total of 29 usability indicators were compiled after removing duplicates and similar indicators, as shown in Table 4.

4.2. Delphi Consultation

4.2.1. Expert Authority Level

The expert authority level (Cr) is primarily influenced by two factors: the basis of the expert’s judgment when evaluating the questionnaire (Ca), and the expert’s familiarity with the questionnaire (Cs). The formula for calculating the expert authority level is as follows:
Cr = (Ca + Cs)/2
The value of Cr ranges from 0 to 1. A Cr value greater than 0.7 indicates that the reliability of the value is acceptable; the higher the Cr value, the greater the expert’s authority level [38].
In this study, the calculation of the expert authority level is mainly derived from the self-assessment data provided by the experts in the questionnaire. The evaluation criteria for the experts’ self-assessment in the questionnaire are as follows:
Familiarity is divided into five levels: very familiar, fairly familiar, generally familiar, somewhat unfamiliar, and very unfamiliar. The corresponding values are 1.0, 0.8, 0.6, 0.4, and 0.2, respectively [38].
The basis of judgment is categorized into four options: theoretical analysis, practical experience, reference to relevant domestic and international materials, and intuition. These are valued sequentially at 0.8, 0.6, 0.4, and 0.2, respectively [38], as shown in Table 5.
Based on the experts’ self-assessment results regarding their familiarity with the questionnaire and their judgment basis, the average values for the judgment basis and familiarity were calculated for each round of the questionnaire. Finally, using Formula (1), the authority level of 20 experts over the two rounds of the questionnaire was calculated. The specific results are shown in Table 6 below.
The authority levels for the two rounds of the questionnaire were 0.71 and 0.755, respectively. Since both authority values are greater than 0.7, this indicates that the experts’ authority level is relatively high, thereby confirming the reliability of the results from this expert consultation.

4.2.2. Delphi Expert Questionnaire Results

As part of the Delphi questionnaire method, SPSS 27.0 was utilized to analyze the questionnaire data in assessing the authority and scientific nature of the indicators. Indicators were considered to have high consensus among experts and were retained when the progressive significance (P) value was less than 0.05, the mean value (M) was greater than 3.5, and the coefficient of variation (CV) was lower than 0.3 [69]. After completing the second round of questionnaires, the opinions of the experts were unanimous; therefore, a third round of questionnaire testing was deemed unnecessary. The 100% response rate for both rounds of the survey indicates that all experts attach great importance to this questionnaire. The Delphi questionnaire data are shown in Table 7.
Based on the survey data from Table 2, the p values for both rounds of the Delphi questionnaire were less than 0.05. Based on the scores from the questionnaire in the first round, five indicators were removed: Attitude, User-Centricity, Clarity, Terminology, and Credibility. In the second round, Graphic Layout was removed. As a result of the two rounds of expert consultation questionnaires, 23 indicators were finally identified, as shown in Table 8 below.

4.3. EFA Indicator Classification

To obtain data more conveniently and accurately, we utilized SPSS 27.0 to compute the questionnaire metrics of KMO, Bartlett’s test of sphericity, and Cronbach’s alpha coefficient. The outcomes, as delineated in Table 9, are a KMO measure of 0.923, a Bartlett’s test significance below 0.05, and a Cronbach’s alpha of 0.923. These findings collectively affirm the high reliability and validity of the questionnaire data, which thereby qualify for subsequent EFA investigation.
As part of this factor analysis, Exploratory Factor Analysis (EFA) was employed to distill the factor structure from the data. During the factor extraction process, only factors with eigenvalues λ greater than 1 were retained, eliminating any factors constituted by a single item. When the loading difference between two items on the same factor was less than 0.05, one of the items was removed, and the analysis was then re-conducted. Additionally, any item with a communality less than 0.4 or a maximum loading less than 0.35 was also excluded. After several rounds of screening and rotation, five common factors with eigenvalues λ greater than 1 were ultimately identified, retaining 23 metrics related to the usability of second-hand trading software.
Utilizing the described analytical techniques, we ascertained the contribution of each factor to the total variance, as meticulously outlined in Table 10. Further insights are provided by the scree plot in Figure 2, which elaborates on each factor’s contribution toward the total variance. Moreover, the correlations between various usability metrics of second-hand trading software (such as user satisfaction, efficiency in operation, and ease of recall) and the identified factors (e.g., B1, B2, etc.) are detailed in Table 11.
Based on the results from the rotated component matrix in Table 11 and the characteristics of indicators for each dimension, we extracted and named the following common factors.
The first group (B1) of factors includes indicators such as Satisfaction, Flexibility, Value Realization, Pleasure, Accessibility, and Social Interaction. These are indicators of fulfilling user needs and enhancing loyalty as primarily achieved through emotional design, thus; the group is named “Emotional Design”.
The second group (B2) of factors encompasses indicators such as Learnability, Efficiency, Memorability, Error Prevention, Usability, and Convenience, reflecting the fundamental operations while learning and using the product. Hence, it is named “Learning and Operation”.
The third group (B3) of factors consists of indicators such as Timely Feedback, Consistency, Interface Simplicity, Help, and Error Feedback, showcasing the user experience during interaction with the product, including interface design, operational feedback, and help systems. Therefore, it is termed “Interaction Experience”.
The fourth group (B4) of factors focuses on indicators such as Searchability, Page Information Architecture, and Navigation, emphasizing how the product structure is organized to facilitate easy access and information retrieval for users, and is hence named “Information Architecture”.
The fifth group (B5) of factors includes Privacy Protection, Property Protection, and System Security, centering on the safety of user’s personal information, property, and system security, and is thus named “Security and Privacy”.

4.4. AHP Weight Calculation

4.4.1. Construction of the Judgment Matrix

The main components and corresponding indicators obtained through EFA dimensionality reduction are incorporated into the AHP decision framework, which is divided into three levels: the target objective layer, the Level 1 indicator layer, and the Level 2 indicator layer, as shown in Table 12.
This hierarchical model was entered into the YAAHP 10.1 software for validation and weight computation in alignment with the AHP framework. Upon the validation of the hierarchical structure, an evidence evaluation questionnaire was formulated. Utilizing the scoring criteria set forth in Table 13, the responses from 20 experts were transformed into a judgment matrix, enabling systematic pairwise comparisons among indicators across various tiers. The constructed judgment matrix is as follows:
A = ( a i j ) n × n = a 11 a 12 a 21 a 22 a 1 n a 2 n         a n 1 a n 2 a n n
a i j represents the result of comparing the importance of indicators i and j within the same group, where a i j   > 0, a i j   = 1/ a j i , a j j   = 1, for i , j = 1,2,3…… n , with n being the number of subsets contained in B .

4.4.2. Calculation of Weights for Individual Levels

By normalizing the judgment matrix based on calculating its eigenvector, we can incrementally ascertain the relative weights of the matrix. The aggregated weight values at each hierarchical level are gauged relative to the overall goal and are derived sequentially from the higher to the lower levels. In the context of a multi-tiered decision-making model, the weight assigned to an individual level serves as the basis for evaluating the relative significance of the elements within that tier [70].
The steps for calculating the individual levels sorting method are as follows:
(1)
Calculate the product of each row’s indicators in the judgment matrix M i .
M i = j = 1 m a i j ( j = 1,2 , , m )
(2)
Calculate the nth root of M i .
W i = M i n   ( i = 1,2 , , n )
(3)
Normalize W i to obtain the eigenvector ω i .
ω i = W i j = 1 m W j ( j = 1,2 , , m )
(4)
The formula for the maximum value of the judgment matrix is as follows:
λ m a x = i = 1 n [ A ω ] i n ω i
We determine the maximum eigenvalue λ m a x of the judgment matrix A by considering n as the matrix’s dimension, where A denotes the judgment matrix itself and ω i signifies the weight attributed to the i th indicator.
(5)
Consistency test:
The ratio of the Consistency Index (CI) of the judgment matrix to the Random Index (RI) is known as the Random Consistency Ratio (CR). When CR is less than 0.1, the judgment matrix is considered consistent. If CR is greater than 0.1, the judgment matrix needs to be reconstructed [71].
The formula for calculating CR is as follows:
C I = λ m a x n n 1
C R = C I R I
The R I value in the formula is determined according to Table 14.
First, we organize the data collected from 20 experts who rated according to the Saaty rating scale and then summarize it into Table 15, Table 16, Table 17, Table 18, Table 19 and Table 20. The evaluation method can be exemplified using the first-level indicators B1 and B2 in Table 15. The ratio of the B1 indicator on the vertical axis to the B1 indicator on the horizontal axis is 1, because they are the same indicator. The ratio of the B1 indicator on the vertical axis to the B2 indicator on the horizontal axis is 1/8, indicating that when comparing B1 and B2, the B2 indicator is significantly more important. Similarly, the ratio of the B2 indicator on the vertical axis to the B1 indicator on the horizontal axis is 8, also indicating that the B2 indicator is significantly more important. Then, based on the numerical values of the expert ratings, we apply Formulas (2) to (7) to determine the weights at each level, and these weight values are marked in Table 15, Table 16, Table 17, Table 18, Table 19 and Table 20.

4.4.3. Calculation of Weights for Individual Levels

In the hierarchical analysis process, merely assessing the relative value of weights within a single tier falls short, given that each criterion operates within a more expansive framework. Consequently, the computation of overall weights becomes imperative. Aligning with the methodology adopted by the majority of researchers, we proceed by multiplying the weights of secondary indicators by the weights of their respective primary indicators [72,73,74].
The overall weight O W i for each individual indicator can be calculated using the following formula:
O W i = W p r i m a r y   × W s e c o n d a r y
where W p r i m a r y   denotes the weight of the individual indicator within the parent indicator layer, and W s e c o n d a r y represents the weight of the indicator within its respective parent indicator.
Based on this formula, the total weights of all Level 2 indicators were calculated and combined with all single-layer weight values and overall weight values, as shown in Table 21.

5. Results and Discussion

5.1. Importance Analysis and Results of Level 1 Indicators

As illustrated in Figure 3, Security and Privacy (0.4094) emerges as the most critical indicator within the level, followed by Learning and Operation (0.2674), Information Architecture (0.2052), Interaction Experience (0.0823), and finally, Emotional Design (0.0357). This reflects the highest level of concern users have for the protection of personal information and financial data security when using second-hand transaction apps. Furthermore, the ability to simply and conveniently use the software, easily find the information users seek, and the interface attractiveness are all important criteria for evaluating second-hand transaction apps. Although Emotional Design holds a lower weight, it plays a subtle yet significant role in enhancing user loyalty and establishing brand image. Therefore, in the design and development of second-hand transaction apps, comparatively more focus should be placed on protecting user information and assets as well as facilitating a convenient and comfortable software usage experience than on enhancing user loyalty and building a brand image.

5.2. Analysis and Results of the Importance of Level 2 Indicators

The analysis of the secondary indicators for each primary indicator was conducted in descending order of their weights, from the highest to the lowest. The specific details of the analysis are as follows:
(1)
Security and Privacy (B5) Indicator Layer.
As depicted in Figure 4, in the distribution of weights for the secondary indicators under Security and Privacy, Property Protection (0.5485) carries the highest weight, followed by Privacy Protection (0.2409), with System Security (0.2106) ranking last. This ranking reflects that protection of their financial assets and personal information is prioritized by app users engaged in online transactions over the ability to defend against viruses. Therefore, when optimizing the security and privacy of an app, priority should be given to strengthening asset and privacy protection.
(2)
Learning and Operation (B2) Indicator Layer.
As depicted in Figure 5, in the weight distribution of secondary indicators for Learning and Operation, Simplicity in Use (0.3464) emerges as the highest weighted indicator, followed closely by Efficiency (0.3271), then Learnability (0.1163), Memorability (0.1077), and Convenience (0.0586), with Error Prevention (0.0439) at the bottom. This order reveals a strong user preference for apps that boast intuitive interfaces, simplicity in mastery, the capability to efficiently accomplish tasks, and the ease of quickly learning and remembering operational procedures. Therefore, in the process of optimizing the learning and operation aspects of an app, placing a premium on Usability and Efficiency should be considered a priority.
(3)
Information Architecture (B4) Indicator Layer.
As shown in Figure 6, in the weight distribution of secondary indicators for Information Architecture, Page Information Architecture (0.5813) holds the highest weight, followed by Navigation (0.3092), and then Findability (0.1096). This indicates that users place particular importance on the app’s page layout and content organization as well as on how navigation clearly guides users to different functional areas. Therefore, when optimizing an app’s information architecture, it is recommended that Page Information Architecture and Navigation be prioritized.
(4)
Interaction Experience (B3) Indicator Layer.
As illustrated in Figure 7, in the distribution of weights for secondary indicators of Interaction Experience, Consistency (0.4661) has the highest weight, followed by Immediate Feedback (0.2314), Error Feedback (0.1913), Interface Simplicity (0.0669), and finally, Help (0.0443). This underscores the importance users place on consistency in interface text and images with common sense as well as the need for prompt responses after actions. Therefore, when designing and optimizing an app’s interaction experience, it is advisable to prioritize consistency and immediate feedback.
(5)
Emotional Design (B1) Indicator Layer.
As depicted in Figure 8, within the distribution of weights for secondary indicators of Emotional Design, Social (0.3336) is the highest weighted, followed by Accessibility (0.1977), Flexibility (0.1607), Satisfaction (0.1366), Value Realization (0.0872), and Pleasure (0.0842). This highlights that while users seek a personalized experience in app usage, they also value the app’s capability to facilitate communication and establish connections as well as its accessibility features. Therefore, in the design and optimization of an app’s emotional design, it is advisable to prioritize Social Interaction and Flexibility.

5.3. Relative Importance of Composite Weights

As illustrated in Figure 9, after conducting an analysis on the relative importance of composite weights by multiplying the weights of 23 secondary indicators with their respective higher-level indicator weights, several key findings emerged. The most critical components identified are as follows: under the Security and Privacy category, Asset Property Protection (0.2245), focusing on the safeguarding of user financial security; within the Information Architecture category, Page Information Architecture (0.1193), ensuring users’ clear comprehension of page layouts and content; and, again in Security and Privacy, Privacy Protection (0.0986) aimed at preventing the leakage of users’ personal data. Indicators with relatively lower importance predominantly fall within the Emotional Design category, including Pleasure (0.0030), where the aim is to elicit users’ emotional values through textual and visual content; Value Realization (0.0031), which is achieved through the software fulfilling anticipated goals; and in the Interaction Experience category, Help (0.004) offers detailed instructions for product use and answers to common questions. These findings offer valuable insights for future assessments of the usability of second-hand trading platform apps.

6. Conclusions

This study aimed to propose usability evaluation indicators and their weights for second-hand trading applications, enhance user stickiness, and reduce app uninstall rates. Through a literature review, 29 usability indicators were summarized. Using the Delphi method with 20 experts, these 29 indicators were refined by removing duplicates and merging similar ones, resulting in 23 usability indicators: Satisfaction (C1), Flexibility (C2), Accessibility (C3), Social (C4), Pleasure (C5), Value Realization (C6), Efficiency (C7), Memorability (C8), Convenience (C9), Simplicity in Use (C10), Learnability (C11), Error Prevention (C12), Immediate Feedback (C13), Interface Simplicity (C14), Help (C15), Consistency (C16), Error Feedback (C17), Findability (C18), Page Information Architecture (C19), Navigation (C20), System Security (C21), Property Protection (C22), and Privacy Protection (C23) (addressing RQ1).
Next, these 23 indicators were grouped and named through Exploratory Factor Analysis (EFA). The indicators were classified into five groups: Emotional Design (B1), Learning and Operation (B2), Interaction Experience (B3), Information Architecture (B4), and Security and Privacy (B5). Finally, the Analytic Hierarchy Process (AHP) was used for hierarchical structuring. The primary indicator Emotional Design (B1) includes the following secondary indicators: Satisfaction (C1), Flexibility (C2), Accessibility (C3), Social (C4), Pleasure (C5), and Value Realization (C6). The primary indicator Learning and Operation (B2) includes Efficiency (C7), Memorability (C8), Convenience (C9), Simplicity in Use (C10), Learnability (C11), and Error Prevention (C12). The primary indicator Interaction Experience (B3) includes Immediate Feedback (C13), Interface Simplicity (C14), Help (C15), Consistency (C16), and Error Feedback (C17). The primary indicator Information Architecture (B4) includes Findability (C18), Page Information Architecture (C19), and Navigation (C20). The primary indicator Security and Privacy (B5) includes System Security (C21), Property Protection (C22), and Privacy Protection (C23) (addressing RQ2).
Lastly, based on the expert ratings, the weights for different levels of indicators were obtained, including their overall weights. Among the primary indicators, the highest weight was for Security and Privacy (B5, 0.4094). Within the Emotional Design (B1) indicator, the highest-weighted secondary indicator was Social (C4, 0.3336). Within the Learning and Operation (B2) indicator, the highest-weighted secondary indicator was Simplicity in Use (C10, 0.3464). Within the Interaction Experience (B3) indicator, the highest-weighted secondary indicator was Consistency (C16, 0.4661). Within the Information Architecture (B4) indicator, the highest-weighted secondary indicator was Page Information Architecture (C19, 0.5813). Within the Security and Privacy (B5) indicator, the highest-weighted secondary indicator was Property Protection (C22, 0.5485), (addressing RQ3). The findings of this study can serve as a comprehensive guide for enhancing the usability of second-hand trading apps through design, which is crucial for assessing and improving app usability. By enhancing the usability of these apps, we can increase user engagement, encourage the purchase of second-hand products, and reduce waste generation, thereby positively impacting environmental conservation.
However, a limitation of this study is the small number of experts involved in the surveys, which did not allow for a sufficiently diverse range of opinions. Additionally, the selection of usability assessment indicators for mobile second-hand trading apps was solely based on a literature review. In consideration of these factors, future research plans should aim to expand the pool of experts participating in the surveys and the range of selected indicators toward more systematically gathering and integrating a broader spectrum of opinions and indicators.

Author Contributions

Conceptualization, X.L.; methodology, X.L.; software, X.L.; validation, X.L.; formal analysis, X.L.; investigation, X.L.; resources, X.L.; data curation, X.L.; writing—original draft preparation, X.L.; writing—review and editing, X.L. and B.L; visualization, X.L.; supervision, K.P.; project administration, K.P.; funding acquisition, X.L. and B.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the first author on request.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Chua, K.B.; Quoquab, F.; Mohammad, J.; Basiruddin, R. The Mediating Role of New Ecological Paradigm between Value Orientations and Pro-Environmental Personal Norm in the Agricultural Context. Asia Pac. J. Mark. Logist. 2016, 28, 323–349. [Google Scholar] [CrossRef]
  2. Yoon, S.W.; Yoon, C.-H. On the impossibility of sustainable growth in a manufacturing based economy. Econ. Res. Ekon. Istraživanja 2018, 31, 1526–1538. [Google Scholar] [CrossRef]
  3. Fischer, D.; Böhme, T.; Geiger, S.M. Measuring young consumers’ sustainable consumption behavior: Development and validation of the YCSCB scale. Young Consum. 2017, 18, 312–326. [Google Scholar] [CrossRef]
  4. Khoshnevis Yazdi, S.; Dariani, A.G. CO2 emissions, urbanisation and economic growth: Evidence from Asian countries. Econ. Res. Ekon. Istraživanja 2019, 32, 510–530. [Google Scholar] [CrossRef]
  5. Liang, J.; Xu, Y. Second-hand clothing consumption: A generational cohort analysis of the Chinese market. Int. J. Consum. Stud. 2018, 42, 120–130. [Google Scholar] [CrossRef]
  6. Fast Fashion and Its Environmental Impact. Available online: https://earth.org/fast-fashions-detrimental-effect-on-the-environment/ (accessed on 15 January 2024).
  7. 5 Takeaways From the New EU Circular Fashion Strategy. Available online: https://earth.org/5-takeaways-from-the-new-eu-circular-fashion-strategy/ (accessed on 15 March 2024).
  8. Clausen, J.; Blättel-Mink, B.; Erdmann, L.; Henseling, C. Contribution of Online Trading of Used Goods to Resource Efficiency: An Empirical Study of eBay Users. Sustainability 2010, 2, 1810–1830. [Google Scholar] [CrossRef]
  9. Lane, R.; Horne, R.; Bicknell, J. Routes of Reuse of Second-hand Goods in Melbourne Households. Aust. Geogr. 2009, 40, 151–168. [Google Scholar] [CrossRef]
  10. The Second-Hand Trend: The Future of Online Marketplaces. Available online: https://besedo.com/knowledge-hub/blog/second-hand-online-marketplace/ (accessed on 15 March 2024).
  11. Bae, Y.; Choi, J.; Gantumur, M.; Kim, N. Technology-Based Strategies for Online Secondhand Platforms Promoting Sustainable Retailing. Sustainability 2022, 14, 3259. [Google Scholar] [CrossRef]
  12. Available online: https://www.thehindubusinessline.com/info-tech/56-of-app-users-uninstall-it-them-apps-within-the-first-7-days-of-installation/article31098697.ece (accessed on 5 June 2024).
  13. Li, M.; Kim, M.H. Development of Evaluation Indicators for the Usability Evaluation of Smart Home App Design. J. Korea Contents Assoc. 2019, 19, 249–258. [Google Scholar]
  14. Hoehle, H.; Venkatesh, V. Mobile application usability: Conceptualization and instrument development. Manag. Inf. Syst. Q. 2015, 39, 435–472. [Google Scholar] [CrossRef]
  15. Păsărelu, C.R.; Andersson, G.; Dobrean, A. Attention-defcit/hyperactivity disorder mobile apps: A systematic review. Int. J. Med. Inform. 2020, 138, 104133. [Google Scholar] [CrossRef] [PubMed]
  16. Folmer, E.; Bosch, J. Architecting for Usability: A Survey. J. Syst. Softw. 2004, 70, 61–78. [Google Scholar]
  17. Available online: https://ux4sight.com/blog/what-is-usability-and-why-does-it-matter-in-app-development (accessed on 5 June 2024).
  18. Baharuddin, R.; Singh, D.; Razali, R. Usability dimensions for mobile applications-a review. Res. J. Appl. Sci. Eng. Technol. 2013, 5, 2225–2231. [Google Scholar] [CrossRef]
  19. Sibarani, A.J. Usability and user satisfaction rate evaluation on e-learning application from student’s perspective using Nielsen usability method. J. Infotel 2021, 13, 120–127. [Google Scholar] [CrossRef]
  20. Mazaheri Habibi, M.R.; Moghbeli, F.; Langarizadeh, M.; Fatemi Aghda, S.A. Mobile health apps for pregnant women usability and quality rating scales: A systematic review. BMC Pregnancy Childbirth 2024, 24, 34. [Google Scholar] [CrossRef] [PubMed]
  21. Available online: https://tru.earth/blogs/tru-living/the-environmental-benefits-of-thrift-shopping-and-buying-second-hand (accessed on 5 June 2024).
  22. Qi, W.; Yang, P. Research on the Interaction Design of Mobile APP for Second-hand Luxury Goods Transaction. In Proceedings of the 2021 4th International Conference on Artificial Intelligence and Big Data (ICAIBD), Chengdu, China, 28–31 May 2021; pp. 617–621. [Google Scholar] [CrossRef]
  23. Jiu, Y.; Hong, Q. Design and Implementation of a Second-Hand Items Trading Platform Based on Android. In Proceedings of the 2016 5th International Conference on Computer Science and Network Technology (ICCSNT) (2016 5th International Conference on Computer Science and Network Technology (ICCSNT), Changchun, China, 10–11 December 2016; pp. 21–34. [Google Scholar]
  24. Jin, W. Research on User Experience Design of Internet Shopping Platform Based on Flow Theory; Zhejiang University: Hangzhou, China, 2016. [Google Scholar]
  25. Guiot, D.; Roux, D. A second-hand shoppers’ motivation scale: Antecedents, consequences, and implications for retailers. J. Retail. 2010, 86, 355–371. [Google Scholar] [CrossRef]
  26. Consumer Council (Hong Kong). Sustainable Consumption for a Better Future—A Study on Consumer Behaviour and Business Reporting. Available online: https://www.consumer.org.hk/en/advocacy/study-report/2016-sustainable-consumption (accessed on 11 June 2024).
  27. Paavola, J. Towards Sustainable Consumption: Economics and Ethical Concerns for the Environment in Consumer Choices. Rev. Soc. Econ. 2001, 59, 227–248. [Google Scholar] [CrossRef]
  28. Available online: https://en.wikipedia.org/wiki/Sustainable_consumption (accessed on 5 June 2024).
  29. Ruiz-Real, J.L.; Uribe-Toril, J.; Gázquez-Abad, J.C.; de Pablo Valenciano, J. Sustainability and retail: Analysis of global research. Sustainability 2018, 11, 14. [Google Scholar] [CrossRef]
  30. Kim, N.L.; Woo, H.; Ramkumar, B. The role of product history in consumer response to online second-hand clothing retail service based on circular fashion. J. Retail. Consum. Serv. 2021, 60, 102457. [Google Scholar] [CrossRef]
  31. Kim, S.P. A study on the user structure analysis of secondhand market apps—Focusing on Joongonara, Bungaejangter, danggeunmarket. J. Korea Acad. Ind. Coop. Soc. 2021, 22, 449–458. [Google Scholar]
  32. Parker, B.; Weber, R. Second-Hand Spaces: Restructuring Retail Geographies in an Era of E-Commerce. Urban Geogr. 2013, 34, 1096–1118. [Google Scholar] [CrossRef]
  33. Dalkey, N.C.; Brown, B.B.; Cochran, S. The Delphi Method: An Experimental Study of Group Opinion; Rand Corporation: Santa Monica, CA, USA, 1969. [Google Scholar]
  34. McMillan, S.S.; King, M.; Tully, M.P. How to use the nominal group and Delphi techniques. Int. J. Clin. Pharm. 2016, 38, 655–662. [Google Scholar] [CrossRef] [PubMed]
  35. Niederberger, M.; Spranger, J. Delphi Technique in Health Sciences: A Map. Front. Public Health 2020, 8, 457. [Google Scholar] [CrossRef]
  36. Jünger, S.; Payne, S.A.; Brine, J.; Radbruch, L.; Brearley, S.G. Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological systematic review. Palliat. Med. 2017, 31, 684–706. [Google Scholar] [CrossRef]
  37. Hasson, F.; Keeney, S.; McKenna, H. Research guidelines for the Delphi survey technique. J. Adv. Nurs. 2020, 2008, 32–1015. [Google Scholar]
  38. Ye, B.-R.; Jiang, X.-Y. Study of an evaluation index system of nursing undergraduate employability developed using the Delphi method. Int. J. Nurs. Sci. 2014, 1, 180–184. [Google Scholar] [CrossRef]
  39. Remus, A.; Smith, V.; Wuytack, F. Methodology in core outcome set (COS) development: The impact of patient interviews and using a 5-point versus a 9-point Delphi rating scale on core outcome selection in a COS development study. BMC Med. Res. Methodol. 2021, 21, 10. [Google Scholar] [CrossRef]
  40. Zhang, Y.; Chen, Y.P.; Wang, J.; Deng, Y.; Peng, D.; Zhao, L. Anxiety status and influencing factors of rural residents in hunan during the coronavirus disease 2019 epidemic: A web-based cross-sectional survey. Front. Psychiatry 2020, 11, 564745. [Google Scholar] [CrossRef] [PubMed]
  41. Wu, W.; Zhang, Y.; Wang, P.; Zhang, L.; Wang, G.; Lei, G.; Xiao, Q.; Cao, X.; Bian, Y.; Xie, S.; et al. Psychological stress of medical staffs during outbreak of COVID-19 and adjustment strategy. J. Med. Virol. 2020, 92, 1962–1970. [Google Scholar] [CrossRef]
  42. Ma, L.; Liu, H.; Tao, Z.; Jiang, N.; Wang, S.; Jiang, X. Knowledge, Beliefs/Attitudes, and practices of rural residents in the prevention and control of COVID-19: An online questionnaire survey. Am. J. Trop. Med. Hyg. 2020, 103, 2357–2367. [Google Scholar] [CrossRef]
  43. Skulmoski, G.J.; Hartman, F.T.; Krahn, J. The Delphi method for graduate research. J. Inf. Technol. Educ. Res. 2007, 6, 1–21. [Google Scholar] [CrossRef] [PubMed]
  44. Fabrigar, L.R.; Wegener, D.T. Exploratory Factor Analysis; Oxford University Press: Oxford, UK, 2012; pp. 1–17. [Google Scholar]
  45. Howard, M.C. A systematic literature review of exploratory factor analyses in management. J. Bus. Res. 2023, 164, 113969. [Google Scholar] [CrossRef]
  46. Available online: https://verstaresearch.com/blog/tips-on-reverse-wording-survey-questions/ (accessed on 5 June 2024).
  47. Valencia-Toledo, A. Unearthing Influential Factors Shaping the Mining Industry’s Development in Peruvian Regions (Apurimac-Cusco): An Exploratory Factor Analysis Perspective. Min. Met. Explor. 2024, 41, 805–818. [Google Scholar] [CrossRef]
  48. Pichardo, J.M.; Fields, D.; Hong, J.E.; Court. Exploratory Factor Analysis of the Social Communication Disorder Screener. J. Autism Dev. Disord. 2023, 1–11. [Google Scholar] [CrossRef]
  49. Kajatt, J.U. Psychometric properties for measuring remote work factors: An exploratory analysis in student collaborators. Estud. Gerenciales 2022, 41, 436–448. [Google Scholar]
  50. Howard, M.C.; Henderson, J. A review of exploratory factor analysis in tourism and hospitality research: Identifying current practices and avenues for improvement. J. Bus. Res. 2023, 154, 113328. [Google Scholar] [CrossRef]
  51. Saaty, T.L. What is the Analytic Hierarchy Process? In Mathematical Models for Decision Support; Springer: Berlin/Heidelberg, Germany, 1988; pp. 109–121. [Google Scholar]
  52. Fabianek, P.; Will, C.; Wolff, S.; Madlener, R. Green and regional? A multi-criteria assessment framework for the provision of green electricity for electric vehicles in Germany. Transp. Res. Part D 2020, 87, 102504. [Google Scholar] [CrossRef]
  53. Zhang, Z.; Liu, X.; Yang, S. A Note on the 1-9 Scale and Index Scale In AHP. In Proceedings of the Cutting-Edge Research Topics on Multiple Criteria Decision Making, Chengdu/Jiuzhaigou, China, 21–26 June 2009; pp. 630–634. [Google Scholar] [CrossRef]
  54. Chen, Z.; Zhang, X.; Lee, J. Combining PCA-AHP Combination Weighting to Prioritize Design Elements of Intelligent Wearable Masks. Sustainability 2023, 15, 1888. [Google Scholar] [CrossRef]
  55. Yan, L. Construction of the professional quality evaluation system of environmental impact assessment engineers based on yaahp software. In Proceedings of the 2nd International Conference on Energy, Environmental and Information System (ICENIS 2017), Semarang, Indonesia, 15–16 August 2017; Volume 259, p. 05002. [Google Scholar]
  56. Zhu, L. Research and application of AHP-fuzzy comprehensive evaluation model. Evol. Intell. 2022, 15, 2403–2409. [Google Scholar] [CrossRef]
  57. Shao, T.; Yang, P.; Jiang, H.; Shao, Q. An analysis of public service satisfaction of tourists at scenic spots: The case of Xiamen city. Sustainability 2023, 15, 2752. [Google Scholar] [CrossRef]
  58. Nielsen, J. Usability Engineering; Kaufmann, M., Ed.; AP Professional, Inc.: Boston, MA, USA, 1993; p. 121. [Google Scholar]
  59. ISO 9241; Ergonomics of Human-System Interaction. ISO: Geneva, Switzerland, 2010.
  60. Petrie, H.; Bevan, N. The Evaluation of Accessibility, Usability, and User Experience, The Universal Access Handbook; CRC Press: Boca Raton, FL, USA, 2009; pp. 20–21. [Google Scholar]
  61. Chen, Y.; Germain, C.A.; Rorissa, A. Defining Usability: How Library Practice Differs from Published Research. Portal Libr. Acad. 2011, 11, 599–628. [Google Scholar] [CrossRef]
  62. Rubin, J.; Chisnell, D. Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests; Wiley: Indianapolis, IN, USA, 2008. [Google Scholar]
  63. Cai, S.; Gou, Z. A comprehensive analysis of green building rating systems for data centers. Energy Build. 2023, 284, 112874. [Google Scholar] [CrossRef]
  64. Ascione, F.; De Masi, R.F.; Mastellone, M.; Vanoli, G.P. Building rating systems: A novel review about capabilities, current limits and open issues. Sustain. Cities Soc. 2022, 76, 103498. [Google Scholar] [CrossRef]
  65. Liu, X.X.; Park, K.J. Analysis of Usability Evaluation Items of Mobile Health App Design. Korean Soc. Sci. Art 2023, 41, 263–277. [Google Scholar] [CrossRef]
  66. Han, X.; Xi, T.; Zhou, Z. Research on the Influencing Factors of Users’ Satisfaction with the Usability of News App Interface Under the Epidemic. In Proceedings of the Design, User Experience, and Usability: Design for Contemporary Technological Environments, Virtual, 24–29 July 2021; Springer: Cham, Switzerland, 2021; pp. 457–466. [Google Scholar] [CrossRef]
  67. Richardson, B.; Campbell-Yeo, M.; Smit, M. Mobile application user experience checklist: A tool to assess attention to core UX principles. Int. J. Hum. Comput. Interact. 2021, 37, 1283–1290. [Google Scholar] [CrossRef]
  68. Padmavathy, C.; Swapana, M.; Paul, J. Online second-hand shopping motivation—Conceptualization, scale development, and validation. J. Retail. Consum. Serv. 2019, 51, 19–32. [Google Scholar] [CrossRef]
  69. Preece, J.; Rogers, Y.; Sharp, H. Interaction Design: Beyond Human-Computer Interaction; John Wiley & Sons: New York, NY, USA, 2002. [Google Scholar]
  70. Dhurkari, R.K. Strategic Pricing Decision Using the Analytic Hierarchy Process. J. Revenue Pricing Manag. 2023, 22, 85–100. [Google Scholar] [CrossRef]
  71. Liu, M.; Zhu, X.; Chen, Y.; Kong, Q. Evaluation and design of dining room chair based on analytic hierarchy process (AHP) and fuzzy AHP. BioResources 2023, 18, 2574–2588. [Google Scholar] [CrossRef]
  72. Xu, D.; Lv, L.; Ren, X.; Ren, J.; Dong, L. Route selection for low-carbon ammonia production: A sustainability prioritization framework based-on the combined weights and projection ranking by similarity to referencing vector method. J. Clean. Prod. 2018, 193, 263–276. [Google Scholar] [CrossRef]
  73. Ma, Z.; Song, J.; Zhang, J. Energy consumption prediction of air-conditioning systems in buildings by selecting similar days based on combined weights. Energy Build. 2017, 151, 157–166. [Google Scholar] [CrossRef]
  74. Zhou, X.; Ma, Y.; Wang, H.; Li, Y.; Yu, J.; Yang, J. Optimal scheduling of integrated energy system for low carbon considering combined weights. Energy Rep. 2022, 8, 527–535. [Google Scholar] [CrossRef]
Figure 1. Methodology flowchart.
Figure 1. Methodology flowchart.
Applsci 14 05164 g001
Figure 2. Scree plot.
Figure 2. Scree plot.
Applsci 14 05164 g002
Figure 3. Bar chart of weights for Level 1 indicator layer.
Figure 3. Bar chart of weights for Level 1 indicator layer.
Applsci 14 05164 g003
Figure 4. Bar chart of weights for B5 indicator layer.
Figure 4. Bar chart of weights for B5 indicator layer.
Applsci 14 05164 g004
Figure 5. Bar chart of weights for B2 indicator layer.
Figure 5. Bar chart of weights for B2 indicator layer.
Applsci 14 05164 g005
Figure 6. Bar chart of weights for B4 indicator layer.
Figure 6. Bar chart of weights for B4 indicator layer.
Applsci 14 05164 g006
Figure 7. Bar chart of weights for B3 indicator layer.
Figure 7. Bar chart of weights for B3 indicator layer.
Applsci 14 05164 g007
Figure 8. Bar chart of weights for B1 indicator layer.
Figure 8. Bar chart of weights for B1 indicator layer.
Applsci 14 05164 g008
Figure 9. Composite weights.
Figure 9. Composite weights.
Applsci 14 05164 g009
Table 2. Demographic information of second-hand trading application users.
Table 2. Demographic information of second-hand trading application users.
N = 400ItemNumber of
Participants
Percentage (%)
GenderM17042.5
F23057.5
Age18–2820350.75
29–3912531.25
Over 40 7218
Years of Using Second-Hand Trading ApplicationsLess than 1 year10225.5
1–3 years11528.75
More than 3 years18345.75
Table 3. AHP demographic information of the expert panel.
Table 3. AHP demographic information of the expert panel.
N = 20ItemNumber of
Participants
Percentage (%)
Age Range (years)30–3415
35–39840
40–441050
Over 45 15
GenderM730
F1365
OccupationProduct Managers315
Interaction Designers730
Product Designers1050
Education LevelBachelor’s Degree315
Master’s Degree 525
Ph.D. 1260
Work Experience (years)10–14840
15–201055
Over 20 years210
Table 4. Summary of usability metrics for second-hand trading applications.
Table 4. Summary of usability metrics for second-hand trading applications.
IndicatorContentIndicatorContent
LearnabilityThe ability of users to quickly learn how to use the appUser-CentricityDesign and development processes centered around user needs and experiences
Property ProtectionProtecting the safety of users’ propertyConvenienceEase and speed of use during the product or service experience
EfficiencyThe time required to complete tasksSimplicity in Use Simple and easy-to-operate design
Graphic LayoutThe organization and layout of visual elements and textPleasureSatisfaction felt during product use
MemorabilityThe ability of users to remember how to operate the app after periods of non-useImmediate FeedbackThe system’s ability to provide instant responses after user actions
Interface SimplicityA clear interface design without distracting elementsSocialEncourages interaction between users and between users and sellers
Error PreventionDesign features that reduce the likelihood of user errorsConsistencyThe degree to which interface elements and operational logic are unified
FindabilityThe ease with which users can find the information they needSystem SecurityProtects the system from threats such as viruses
SatisfactionThe overall satisfaction level of users with the product or serviceClarityThe degree to which information is expressed clearly and is easy to understand
AccessibilityEnsuring that everyone, including individuals with disabilities, can use the product without barriersPage Information ArchitectureThe organization and hierarchical structure of page information
FlexibilityThe capacity for user customization and personalizationTerminologyUses vocabulary that users can understand
CredibilityUsers’ perception of the product’s or service’s reliability and trustworthinessNavigationHelps users quickly find the information they need during product use
AttitudeThe impression or stance users hold toward the product, service, or brandHelpProvides guidance and solutions for user operations and problems
Value RealizationThe value obtained from using the productError FeedbackOffers guidance and feedback to users when errors are made
FindabilityThe ease with which users can find the information they need
Table 5. Quantitative table of expert familiarity and judgment basis.
Table 5. Quantitative table of expert familiarity and judgment basis.
Familiarity Level (Cs)ValueJudgment Basis (Ca)Value
Very familiar1.0Theoretical analysis0.8
Fairly familiar0.8Practical experience0.6
Generally familiar0.6Reference to relevant domestic and international materials0.4
Somewhat unfamiliar0.4
Very unfamiliar0.2Intuition0.2
Table 6. Results of authority levels from expert consultation questionnaires.
Table 6. Results of authority levels from expert consultation questionnaires.
Delphi RoundsCsCaCr
10.65 0.65 0.65
20.68 0.68 0.68
Table 7. Delphi survey results.
Table 7. Delphi survey results.
N = 20First Round Delphi DataSecond Round Delphi Data
IndicatorMSDCVMSDCV
Learnability4.500.610.134.450.610.14
Efficiency4.700.470.104.600.500.11
Memorability4.400.750.174.300.800.19
Error Prevention4.400.600.143.800.770.20
Satisfaction4.150.670.163.900.720.18
Flexibility4.750.440.094.600.500.11
Attitude1.650.670.41
User-Centricity2.701.460.54
Simplicity in Use4.750.440.094.550.510.11
Immediate Feedback4.750.440.094.650.490.11
Consistency4.600.500.113.900.640.16
Clarity1.600.750.47
Terminology1.600.820.51
Help3.800.700.183.300.660.20
Privacy Protection4.600.500.114.550.510.11
Property Protection4.850.370.084.950.220.05
Graphic Layout3.850.810.211.850.930.50
Interface Simplicity4.450.510.114.300.570.13
Findability4.650.490.114.100.640.16
Accessibility4.350.590.134.200.700.17
Credibility1.901.070.56
Value Realization3.950.760.193.950.760.19
Convenience4.750.440.094.400.680.15
Pleasure4.100.910.223.800.890.24
Social3.900.850.224.000.730.18
System Security4.850.370.084.850.370.08
Page Information Architecture4.800.520.114.650.490.11
Navigation4.400.500.113.900.790.20
Error Feedback4.200.950.233.950.890.22
Table 8. Indicators after Delphi questionnaire.
Table 8. Indicators after Delphi questionnaire.
Second-Hand Trading App Usability Indicators
LearnabilityEfficiencyMemorabilityError PreventionSatisfactionFlexibility
Simplicity in UseImmediate FeedbackConsistencyHelpPrivacy ProtectionProperty Protection
Interface SimplicityFindabilityAccessibilityValue RealizationConveniencePleasure
SocialSystem SecurityPage Information ArchitectureNavigationError Feedback
Table 9. Results of KMO and Bartlett’s test.
Table 9. Results of KMO and Bartlett’s test.
TestTest Value
KMO 0.923
Bartlett’s Approximate Chi-Square5029.248
Degrees of Freedom (df) 253
Significance0.00
Cronbach’s Alpha 0.923
Table 10. Total variance explained.
Table 10. Total variance explained.
Total Variance Explained
ElementInitial EigenvaluesSum of Squared Loadings for ExtractionRotated Sum of Squared Loadings
TotalPercentage of Variance ExplainedCumulative Percentage of Variance ExplainedTotalPercentage of Variance ExplainedCumulative Percentage of Variance ExplainedTotalPercentage of Variance ExplainedCumulative Percentage of Variance Explained
18.61637.46337.4638.61637.46337.4634.03417.53817.538
22.2699.86647.3292.2699.86647.3293.79916.51934.056
31.9058.28355.6121.9058.28355.6123.36614.63648.693
41.6987.38162.9931.6987.38162.9932.2329.70458.397
51.0174.42267.4151.0174.42267.4152.0749.01767.415
60.6232.70770.122
70.5692.47472.595
80.5572.42275.018
90.5422.35677.373
100.5182.25379.627
110.4872.11781.744
120.4772.07683.820
130.4491.95085.770
140.4421.92387.692
150.4251.84689.539
160.3921.70391.241
170.3761.63592.876
180.3591.56394.439
190.3231.40595.844
200.2801.21697.060
210.2631.14298.202
220.2130.92799.129
230.2000.871100.000
Table 11. Rotated component matrix.
Table 11. Rotated component matrix.
Element
B1B2B3B4B5
Satisfaction C10.873
Flexibility C20.765
Accessibility C30.745
Social C40.736
Pleasure C50.729
Value Realization C60.694
Efficiency C7 0.865
Memorability C8 0.748
Convenience C9 0.741
Simplicity in Use C10 0.732
Learnability C11 0.716
Error Prevention C12 0.662
Immediate Feedback C13 0.862
Interface Simplicity C14 0.773
Help C15 0.745
Consistency C16 0.712
Error Feedback C17 0.703
Findability C18 0.871
Page Information Architecture C19 0.775
Navigation C20 0.732
System Security C21 0.735
Property Protection C22 0.745
Privacy Protection C23 0.769
Extraction Method: Principal Component Analysis.
Rotation Method: Kaiser Normalization Varimax Method a.
a. Rotation converged in 6 iterations.
Table 12. AHP decision framework.
Table 12. AHP decision framework.
TargetLevel 1Level 2
Second-hand trading app usability indicators
A
B1C1
C2
C3
C4
C5
C6
B2C7
C8
C9
C10
C11
C12
B3C13
C14
C15
C16
C17
B4C18
C19
C20
B5C21
C22
C23
Table 13. Relative importance scale.
Table 13. Relative importance scale.
Saaty’s 1–9 Scale Assignment Method
ScaleMeaning
1 Indicators   i   and   j are of equal importance.
3 Indicator   i   is   slightly   more   important   than   indicator   j .
5 Indicator   i   is   moderately   more   important   than   indicator   j .
7 Indicator   i   is   strongly   more   important   than   indicator   j .
9 Indicator   i   is   absolutely   more   important   than   indicator   j .
2, 4, 6, 8The importance of the indicators falls between the above scales.
Reciprocal If   the   comparison   between   factors   i   and   j   results   in   the   judgment   matrix   entry   C i j ,   then   the   comparison   of   factor   j   to   i   is   given   as   C i j   = 1 / C j i .
Table 14. Random index (RI) value.
Table 14. Random index (RI) value.
N345678910
RI Value0.520.891.121.261.361.411.461.49
Table 15. Level 1 indicator weight.
Table 15. Level 1 indicator weight.
Level 1B1B2B3B4B5ωiλmaxCR
B111/81/51/71/60.03575.44330.0990
B281521/30.2674
B351/511/41/60.0823
B571/2411/20.2052
B6636210.4094
Table 16. Level 2 B1 indicator weight.
Table 16. Level 2 B1 indicator weight.
Level 2/B1C1C2C3C4C5C6ωiλmaxCR
C111/21/21/3230.13666.40560.0644
C2211/21/4230.1607
C32211/2220.1977
C43421320.3336
C51/21/21/21/3110.0842
C61/31/31/21/2110.0872
Table 17. Level 2 B2 indicator weight.
Table 17. Level 2 B2 indicator weight.
Level 2/B2C7C6C9C10C11C12ωiλmaxCR
C71371550.32716.53490.0849
C81/3121/4220.1077
C91/71/211/41/520.0586
C101441670.3464
C111/51/251/6140.1163
C121/51/221/71/410.0439
Table 18. Level 2 B3 indicator weight.
Table 18. Level 2 B3 indicator weight.
Level 2/B3C13C14C15C16C17ωiλmaxCR
C131481/310.23145.17470.0390
C141/4121/71/30.0669
C151/81/211/61/50.0443
C16376130.4661
C171351/310.1913
Table 19. Level 2 B4 indicator weight.
Table 19. Level 2 B4 indicator weight.
Level 2/B4C18C19C20ωiλmaxCR
C1811/51/30.1096 3.00370.0036
C195120.5813
C2031/210.3092
Table 20. Level 2 B5 indicator weight.
Table 20. Level 2 B5 indicator weight.
Level 2/B5C21C22C23ωiλmaxCR
C2111/210.2106 3.01830.0176
C223120.5485
C2311/310.2409
Table 21. Second-hand trading app usability indicator weight.
Table 21. Second-hand trading app usability indicator weight.
Level 1WeightsRank Level 2WeightsRank Overall WeightsRank
B10.03575C10.136640.004920
C20.160730.005718
C30.197720.007117
C40.333610.011915
C50.084260.003023
C60.087250.003122
B20.26742C70.327120.08755
C80.107740.028810
C90.058650.015714
C100.346410.09264
C110.116330.03119
C120.043960.011716
B30.08234C130.231420.019112
C140.066940.005519
C150.044350.003621
C160.466110.03848
C170.191330.015713
B40.20523C180.109630.022511
C190.581310.11932
C200.309220.06347
B50.40941C210.210630.08626
C220.548510.22451
C230.240920.09863
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Liu, X.; Lee, B.; Park, K. Importance Ranking of Usability Indicators for Second-Hand Trading Applications Based on Exploratory Factor Analysis—Analytic Hierarchy Process toward Sustainable Development. Appl. Sci. 2024, 14, 5164. https://doi.org/10.3390/app14125164

AMA Style

Liu X, Lee B, Park K. Importance Ranking of Usability Indicators for Second-Hand Trading Applications Based on Exploratory Factor Analysis—Analytic Hierarchy Process toward Sustainable Development. Applied Sciences. 2024; 14(12):5164. https://doi.org/10.3390/app14125164

Chicago/Turabian Style

Liu, Xiaoxue, Boyoung Lee, and Kyungjin Park. 2024. "Importance Ranking of Usability Indicators for Second-Hand Trading Applications Based on Exploratory Factor Analysis—Analytic Hierarchy Process toward Sustainable Development" Applied Sciences 14, no. 12: 5164. https://doi.org/10.3390/app14125164

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop