1. Introduction
The increasing complexity of control systems, economic and social systems, as well as design problems increases the complexity of related decision problems [
1]. They concern, among other things, the decision-making of control of complex systems [
2,
3], design issues [
4,
5,
6], political systems [
7], organization management [
8,
9,
10,
11,
12,
13], financial management [
14,
15], and marketing [
16]. Many decision-making problems are characterized by high dimensionality [
17], sources of uncertainty, and risk factors [
18]. It is important to reconcile conflicting goals, make decisions based on many criteria, and seek compromise [
19]. Policy makers are faced with the complexity of decision-making situations and require methods and systems to support decision making [
20]. In response to these needs, many solutions have been developed dedicated to selected areas, as well as general purpose methods [
21]. In this context, multicriteria decision analysis (MCDA) methods are widely used. In addition to the formal foundations, these methods are characterized by the ability to deal with many conflicting goals, as well as various stakeholders as part of the decision-making process [
22]. The dynamic development of MCDA methods has been observed in recent years [
23,
24,
25] as evidenced by scientific publications appearing in magazines on this subject. However, they differ significantly in many dimensions, such as complexity, way of representing preferences and assessment criteria, type of data aggregation, the possibility of taking into account uncertain data, and the availability of implementation in decision support systems or criteria compensation [
26,
27,
28].
The huge number of possible MCDA methods allow finding a solution to a properly formulated decision situation. Therefore, an important research issue that has not yet been fully resolved is determining the method for selecting the number of criteria to assess situations and selecting the most satisfactory decision. That is why the formulated research problem is so important for the methods of managing industrial, technological, and social systems. This is an especially important issue in the security and control systems of complex objects in dynamic states in conditions of uncertainty and risk. It follows from a very large number of factors influencing the decisions taken and determining the control, nonscalar criterion functions, and difficulties in determining the direct relationship between the components of the criterion function and these factors. In addition, in these types of systems, especially in conflict situations, there are usually strong restrictions on the time allowed to solve the problem. An additional impediment to their implementation for the decision-maker is the stress resulting from high responsibility for the decisions made and usually a strong limitation in terms of the time they require. The above-mentioned conditions imply the legitimacy of making efforts to model the problems in the form of optimization tasks. Hence, it is desirable to provide computer support for activities performed in individual stages of the decision-making process. In the literature on the subject, there are practically no publications on methods of selecting partial criteria, including the selection of numbers and aspects of assessment. Few publications [
29,
30,
31] relate primarily to the selection of assessment criteria in the selection process of suppliers in the supply chain. Most often, this problem is solved by experts who arbitrarily define individual partial criteria. This approach may lead to an unnecessary increase in the size of the decision assessment vector or failure to consider relevant criteria. A necessary condition for optimizing decisions is to have a measure of quality assessment [
32] formulated to cover all aspects of the problem. For this reason, the main aim of the conducted studies is to formulate a method for selecting the number of criteria to assess the quality of decisions taken.
This article contains five sections.
Section 1 introduced the problem, describes the state of the art, and gives the main aim of research.
Section 2 presents the problem formulation of the multicriteria optimization of decision tasks. In
Section 3, we present the proposed method of selecting subcriteria, as well as theorems and proof used. In
Section 4, we present a case study applying the proposed method for formulating vector criterion for an anticollision ship motion control system. All experiments and obtained results are discussed and summarized in
Section 5.
2. The Problem Formulation
An important property of decision-making optimization tasks is the fact that there is a nonempty set of
solutions. These can be, for example, the states that will be achieved after making a specific decision. When making a decision, the effects it will bring must be evaluated. It is often difficult to use only one criterion when choosing the right decision, especially in complex situations. For this reason, decisions are evaluated using multiple scalar criteria. This task can be formulated as follows:
where
is the real number set.
The function
assigns the evaluation to the solution
, as follows:
where
is the scalar criteria number set.
We are considering a set of possible solutions
. We assume that
solutions are evaluated using the following criteria:
One of the problems occurring at the stage of formulation of vector optimization tasks is the selection of
scalar criteria so that their meaning, number, and order correspond to the modeled decision situation. Therefore, the task of determining the vector criterion (1) can be formulated so that [
2,
3]:
where
is the set of acceptable vector criteria and
is the quality indicator.
When designing the system, the user and the designer determine acceptable scalar criteria by assessing the quality of the adopted decision task solutions. Therefore, user preferences regarding the desired properties of solutions should be taken into account when choosing the number of partial criteria and when choosing the appropriate dominance relationship. Thus, the user can specify their preferences at the stage of formulating a multicriteria optimization task. The correct selection of the number of partial criteria is crucial when modeling a specific decision situation. From the user’s point of view, adopting a negligible partial criterion may lead to proposing solutions with undesirable properties and omitting solutions with interesting features.
3. Method Description
3.1. Conditions for Selecting Subcriteria
The set of
scalar partial criteria
should meet three basic conditions: completeness, consistency, and nonredundancy [
5]. The condition of completeness excludes the situation when the user chooses one of two different solutions, where these solutions have equal grades. However, the condition of completeness does not apply to the situation when the user chooses one of the two nondominated solutions in the sense of the dominance relationship.
Let
, where
is a set of allowable states, and the vector criteria functions with
coordinates, which evaluate these states, are taken the form
and
, then the condition of completeness can be formulated as follows:
The consistency condition excludes the following situation: two different solutions
with identical images
are modified. The first solution is modified by “improving” at least one of its partial assessments. Thus,
, where
is the dominance relation of the polyoptimization task. On the other hand, the modification of the second solution consists of determining a solution with at least one “worse”, in the sense of the dominance relationship, partial indicator. Therefore,
. It is not advisable for the user to choose the
solution instead of the
solution. This indicates an incorrect formulation of the criterion function. Formally, the criterion of consistency of a criterion function can be written in the form:
The nonredundancy condition of partial criteria in the vector criterion is met when reducing one of the scalar criteria results in the remaining partial criteria not fulfilling the condition of completeness and consistency. Therefore, partial criteria cannot be reduced if they express user preferences. On the other hand, too many partial criteria cannot be taken into account because the nonredundancy condition will not be met.
As a result of preliminary modeling, it is usually possible to determine some basic vector criteria (1).
Multicriteria optimization problems often take into account restrictions that “cut off” the value of a criterion function:
where
is the value of limitation of the partial criterion
.
Each vector criterion can be modified by removing or adding a partial criterion.
Let the relationship below indicate the confidence level for the
criterion:
where
,
is the subjective level of user confidence to the adequacy of the selection of the scalar partial
criterion,
is relative accuracy of determining the
partial criterion, and
is confidence level of exceeding the limit value
.
The total confidence level can be determined using the trust function
:
where
.
The extended modification of the
vector criterion in relation to the base
criterion is understood as a vector criterion created by adding the
partial criterion. Therefore,
where
.
The concept of reduced modification of the vector criterion
in relation to the basic criterion
is understood as the vector criterion created by removing the partial criterion
. Therefore,
where
.
If the reduction or addition of a partial criterion does not change the subjective confidence levels
for
, then modification of the vector criterion is effective if the condition:
is satisfied.
3.2. Theorems on the Election of a Vector Criterion
Let
and
be the confidence level corresponding to the
criterion for
, where the confidence levels
are defined for the
criterion in the same way as
for criterion
. Because, from the point of view of the modeled situation, it is important to know the results of introducing or removing a partial criterion, the following statements can be formulated and proved [
2,
4,
5]:
Theorem 1. (On the introduction of a partial criterion) [2,4,5] If,
If,
If
this extended modification of the vector criterion is effective then and only then if: Proof of Theorem 1.
Based on the assumptions of the theorem
Let
,
Then .
Because then when , which ends the proof. □
Conclusion: If , then the partial criterion can be included in the process of formulating the polyoptimization task, whereas in extreme cases, when or , it makes no sense to consider an additional partial criterion.
Theorem 2. (On the removal of the partial criterion) [2,4,5] If
then reduced modification of the vector criterion is effective then and only then if: Proof of Theorem 2.
Based on the assumptions of the theorem
Let
,
Then .
Because then when , which ends the proof. □
Conclusion: If , the partial criterion can be removed in the process of formulating the polyoptimization task. Therefore, it is advisable to withdraw partial criteria with the lowest confidence levels, and introduce criteria with the highest confidence level after verifying the modified criteria using conditions of completeness, consistency, and nonredundancy.
In practice, the addition or subtraction of a partial criterion causes the decision-maker to verify the value of some subjective confidence levels, while adding it lowers it, while reducing it increases it.
Let denote the vector of subjective confidence levels as a result of adding the criterion. Therefore, the new, subjective confidence level is .
Theorem 3. (On the introduction of a partial criterion) [2,4,5] Ifexists, then the partial criterioncan be entered into the base criterion then and only then, if occurs:
Proof of Theorem 3. The extended baseline criterion
should increase the value of the functional
. Therefore,
where
,
.
After substituting the above dependencies and necessary simplifications, we will receive:
Hence,
, which ends the proof. □
The criterion should also fulfill the condition of completeness. This condition is fulfilled if, for each pair of such that and the fulfilled condition , the user does not choose or . If and the user selects before while maximizing , then shows the user’s preferences.
The introduction of the
criterion may result in failure to comply with the consistency condition. If
then the condition of consistency will be maintained.
Taking into account an additional partial criterion will introduce redundancy into the criterion , provided that it was not the criterion. This redundancy can be avoided only after eliminating one of the criteria . If no such criterion exists, then no additional criterion can be entered. If does not meet the nonredundancy condition, the introduction of redundancy does not matter.
If or under the conditions of completeness, consistency, and nonredundancy, then the criterion cannot be considered.
Let denote the vector of reduction of subjective confidence levels as a result of removing the criterion . Therefore, the new, subjective confidence level is .
Theorem 4. (On the removal of the partial criterion) [2,4,5] If exists, then the partial criterioncan be removed from criterionif and only if Proof of Theorem 4. The reduced base criterion
should increase the value of the functional
. Therefore,
where
,
.
After substituting the above dependencies and necessary simplifications, we will receive:
Hence, , which ends the proof. □
Based on the presented methodology, it is possible to formulate a scheme for formulating a vector criterion when we have a set of scalar criteria that affect the quality of solutions obtained, and thus the effects of decisions.
4. Example of Formulating a Vector Criterion
The issue of choosing the number of criteria used to evaluate decisions is a significant problem in many decision-making tasks. In the paper, as an example of using the presented method of selecting the number of criteria, we will consider the task of choosing a vector criterion in a complex object control system in a conflict situation. The presented principles of selection of the vector quality criterion will be used to formulate a decision task for the needs of designing the ship’s anticollision system. This task can be formulated as follows:
The number of criteria in the vector quality of control indicator used to select the optimal safe trajectory in a collision situation by the ship’s anticollision system should be chosen, assuming:
- -
the criterion should take into account the aspect of traffic safety and economics,
- -
gyro compass accuracy ± 3%,
- -
accuracy of log indications ± 4%,
- -
radar accuracy when measuring distances ± 4%,
- -
radar accuracy at speed measurement ± 5%,
- -
radar accuracy when measuring bearing ± 3%.
Analyzing the process of controlling a sailing object in a collision situation and taking into account the requirements for anticollision systems, we come to the conclusion that the assessment of control should be made in terms of traffic safety, and this aspect of control is the most important. In the set of safe controls, we can look for solutions that provide optimal control regarding the economic aspect.
For the above reasons, the selection of optimal control will be made on the basis of a vector quality indicator which will include both safety-related criteria and criteria related to traffic economics [
2,
3,
4,
5].
Among the criteria for evaluating control from the standpoint of security, one can distinguish the following criteria:
- -
The shortest approach distance
determined by the equation:
where
is the relative speed of the
j-th object relative to its own ship,
are the relative coordinates of relative speed,
are the appropriate coordinates of the location of the
j-th object in the rectangular coordinate system associated with its own ship;
- -
Time remaining until reaching the closest distance is determined by the equation:
- -
Collision risk indicator is determined by the equation:
where
is the distance from the ship to the
j-th object,
is the safe time to complete the maneuver,
are weight factors depending on the type of body of water, degree of visibility at sea, and dynamic length and width of the ship and draft;
- -
Collision risk angle is defined by the equation:
where
is the distance from the ship to the
j-th object,
- -
Aspect of the
j-th object is determined by the equation:
where
is the bearing on the
j-th object,
is the course of the
j-th object.
The criteria for assessing control from an economic point of view include the following criteria:
- -
Time lost for anticollision maneuver is determined by the equation:
where
are the set speed and course of the ship before a collision situation,
are the current speed and course of the ship, and
is the distance traveled;
- -
Fuel consumption per anticollision maneuver is determined by the equation:
where
are coefficients approximating the fuel consumption curve, depending on the type of propulsion system, ship’s hull, and hydromechanical conditions of the basin;
- -
Loss of road for anticollision maneuver
where
are the start and end time of the anticollision maneuver, respectively,
- -
Deviation from the set trajectory is determined by the equation:
- -
Deviation from the set course:
For specified scalar quality criteria (18)–(27), subjective confidence levels
were adopted, which are the arithmetic mean of confidence levels estimated by experts. However, the values of confidence levels
resulting from the accuracy of determining partial criteria are calculated from the relationship:
where
is the relative error value of the
n-th partial criterion.
Confidence levels
resulting from restrictions imposed on partial criteria in the form of:
are determined from the equation:
Confidence levels
for the adopted partial criteria are determined with the following limitations:
Subjective confidence levels determined by experts and other confidence levels determined based on the above relationships are presented in
Table 1.
Table 1 also presents the values of the total confidence levels of individual scalar criteria, which were determined from relationship (8).
As a result of the analysis of the proposed partial criteria, a vector base criterion was formulated that includes two scalar criteria related to traffic safety and two scalar criteria assessing the economic aspect of control. The criterion is presented in the form of:
The total confidence level determined from (9) for the baseline criterion is .
Using Theorem 1, we check the possibility of extending the base vector criterion to the other defined scalar criteria. This condition is not met for criteria , , , and because there are conditions such that , , , and ; therefore, these scalar criteria according to Theorem 1 cannot be entered into the vector criterion.
For scalar criteria and , there are conditions such that and . In this case, we check by entering these scalar criteria into the vector criterion whether the conditions resulting from Theorem 3 are met.
Both criteria are criteria from the economics assessment group control; therefore, the first two coordinates of the reduction vector assume a value of zero.
The criterion assessing road loss and the criterion assessing the deviation from a given trajectory affect both time lost and fuel consumption; therefore, the reduction vector will take the form:
For such a reduction vector, we check the fulfillment of the condition resulting from Theorem 3 for criteria
and
. Theorem 3 shows that there is the relation:
Therefore, only criterion
can be entered into the vector criterion, because only it meets the condition of Theorem 3. Therefore, the vector criterion function will take the form:
For a modified vector criterion, using (9) we determine the total confidence level, which is .
For the new vector criterion, we check the possibility of removing the scalar criterion that meets the condition resulting from Theorem 2. It follows that , , ; however, , occur for the criteria and . Therefore, according to Theorem 2, they can be removed from the vector criterion.
Both scalar criteria that we can remove are criteria from the group assessing the economics of control; therefore, the first two coordinates of the reduction vector take a value equal to zero, and the other three values are different from zero. The reduction vector takes the form
. For such a reduction vector, we check the fulfillment of the condition resulting from Theorem 4 for criteria
and
. It follows that:
According to Theorem 4, the criterion
is removed from the vector criterion. Then, the vector criterion will take the form
For this criterion, the value of the total confidence level is . After checking the condition resulting from Theorem 1, we cannot introduce additional scalar criterion into this vector criterion. Thus, the process of forming the vector criterion for the ship’s anticollision motion control system has been completed.
5. Conclusions
Decision making is an indispensable element of our private and professional lives. Such decisions may concern, for example, acceptance of a technical solution, choosing the best solution among the available options, or choosing the most appropriate control systems in conditions of uncertainty and risk. The above issues are related to making engineering decisions involving the search for optimal solutions; therefore, the task must be a so-called well-defined problem. Thus, the designer is faced with the task of formulating an optimization problem that includes formulating criteria for the assessment of decisions, actions, or effects of controlling any system. For this reason, the paper proposes a method for selecting the number of criteria to assess the quality of decisions taken, which can be used in modeling decision-making situations, especially in engineering issues related to controlling complex systems. In such cases, depending on the time horizon and external conditions, making the optimal decision may involve difficulties, and is often associated with the risk of making a mistake. Therefore, when designing the control device, the designer must formulate a vector criterion function that allows the analysis of many variants in a limited time.
Formulated in this work:
- -
The conditions of completeness, coherence, and nonredundancy that must be met by the vector criterion adopted for the assessment of the decision situation, ensuring the selection of the number of scalar criteria in the vector criterion relevant to the modeled decision situation;
- -
A theorem of introducing the scalar criterion into the vector criterion, and a theorem of reducing the number of criteria in the vector criterion for variables and constant user preferences, ensuring the selection of such a number of criteria that user preferences are taken into account in the modeled decision situation;
- -
Claims about increasing or reducing the dimension of the vector criterion allowed in order to create a method of forming the vector criterion for any decision task in which the scalar criteria with their confidence levels are specified.
The presented method was used to formulate a decision task for the needs of a marine anticollision system. A specific vector criterion based on the formulated method ensures the selection of safe control in a collision situation of the ship’s movement and is optimal in the economic aspect.
The application of the presented method to model the decision situation requires defining a set of scalar criteria assessing the quality of the decision made. If these are measurable values, then the relative accuracy can be determined, e.g., resulting from the measurement accuracy as well as the confidence level of exceeding the limit value . The confidence level is a subjective quantity determined by experts. It should be emphasized that this parameter is one of the three confidence levels used to assess the confidence of a given scalar criterion. In addition, the subjectivity of the adopted values can be minimized by increasing the number of experts participating in the assessment. The adopted method ensures finding a vector criterion function, the form of which excludes its further modification in accordance to the presented theorems. The solution obtained in the presented example is intuitively correct because in the final form, the vector criterion takes into account the most important indicators assessing traffic safety, i.e., the smallest approach distance and the time remaining to reach the smallest approach distance, as well as the two most important indicators related to traffic economics, i.e., lost time and loss roads for anticollision maneuver. The remaining indicators taken into account during the selection procedure of the optimal vector indicator are based on indicators that were adopted in its final form, and thus it seems intuitive to not take them into account.
It should be stated that the formulated method of selecting the number of scalar criteria in the vector criterion can be used to formulate optimal control issues, as well as in solving other decision-making tasks formulated as multicriteria optimization tasks. However, the applicability of this approach is limited to decision-making issues for which we can define scalar criteria and specify their confidence levels. Despite this, the presented approach does not limit the number of scalar criteria that can be used to assess the analyzed decision situation, nor their complexity.