Abstract
In this paper, we consider a single server queueing system in which the arrivals occur according to a Markovian arrival process (MAP). The served customers may be recruited (or opted from those customers’ point of view) to act as secondary servers to provide services to the waiting customers. Such customers who are recruited to be servers are referred to as secondary servers. The service times of the main as well as that of the secondary servers are assumed to be exponentially distributed possibly with different parameters. Assuming that at most there can only be one secondary server at any given time and that the secondary server will leave after serving its assigned group of customers, the model is studied as a QBD-type queue. However, one can also study this model as a GI/M/1-type queue. The model is analyzed in steady state, and a few illustrative numerical examples are presented.
MSC:
60K25; 60K30; 68M20; 90B22
1. Introduction
Queueing theory has been playing a significant role in many areas of science, engineering, and business, among others. One can see the impact of queueing theory in day-to-day activities. Starting from conventional applications in areas such as the telephone industry, grocery stores, post offices, and banks, queueing theory has permeated deep into emerging areas, including crowdsourcing and blockchains. In these emerging areas, businesses as well as other service sectors always look for ways to increase their efficiency by recruiting (temporary) servers who can help the system when needed.
In this paper, we introduce a new queueing model where the system will try to recruit secondary servers from among the customers who received services and are willing to serve. The motivation for studying such a queueing system arose out of one of the author’s personal experiences visiting a bank. In countries like India, government pensioners are required to send a living proof document once a year to the government via banks. During one such visit with an aging parent, the author had to wait for a long period of time before a bank agent helped his parent obtain a simple one-page document to be filled out and signed by the parent; then, the completed document was stamped by the agent. The meeting with the agent took fewer than a couple of minutes, but the aging parent could have saved time and could have been spared the agony of waiting if only they had a secondary server available to help the agent with such services. Similar examples can be seen in areas where customers who are required to use computers for filling out necessary forms are not comfortable with computers; they may benefit from having such a secondary server facility. In order to recruit such secondary servers, the customers need to know the requirements to go through such a process. In education applications, students or teaching assistants (who keep rotating based on the quarter/system) or any other form of helpers can, after getting serviced by the teacher, be recruited temporarily to help the system. In sports, the training manager can, after training athletes, be recruited to help the team. In computer applications, especially dealing with multi-core CPUs, a few can be programmed (similar to recruitment) to help the system. Secondly, there should be a willingness on the part of the customers to help other customers.
Thus, the novelty of this paper is to introduce the concept of recruitment of secondary servers from the (served) customers so as to help the system. Further, these secondary servers will offer services in groups of varying sizes and are available only on a temporary basis (will leave the system after serving exactly one group). In this way, the customers will not be held back so as to attend to their business after helping the system. The numerical results indicate the proposed model performs better than the corresponding classical queueing model. This will help the decision maker of the system recruit secondary servers as and when needed in order to improve the performance of the system.
Queueing models where the main servers are supported by backup servers (or additional servers) are interesting from a practical point of view. For example, one can find the usefulness of such backup server queueing models in energy saving applications in cloud computing systems and server farms (see, e.g., the survey paper [1] and the paper [2]). Queueing models with reserve servers studied in the literature are divided into two groups. One group, seemingly a larger one, assumes a switching-on and a switching-off mechanism for the backup servers based on the current queue length using threshold-type and hysteresis-type strategies. It is worth mentioning a few works from this group, namely, papers [3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22].
In the other group of papers, the focus is on using backup servers to help the main server whenever there is too long a service duration for the customer in service. In [23], a multi-server queueing model with phase-type services is considered. If the service time of a customer exceeds a certain (random) bound, the server will start receiving help from a backup server from a finite pool of backup servers. Also, a few practical examples dealing with managerial decision are presented. In [24], a multi-server infinite buffer queueing system with additional servers (assistants) provides help to the main servers whenever the server encounters problems that are commonly noticed in real-world situations.
In this paper, we consider a model in which the arrivals occur according to the Markovian arrival process (). Recall that , a class of versatile point processes, was introduced by Neuts in the 1970s. For details on and its usefulness in stochastic modeling, we refer the reader to [25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40]. Among the papers considering systems with and backup servers, we point out a few relevant ones here.
In [41], a multi-server queueing model of the type —in which a permanent server is supported by a group backup servers that are added or removed based on a set of thresholds dynamically—is considered, and some interesting results useful in practical applications are reported. In [42], under the scenario of a finite capacity queueing system with phase-type services, the main server is supported by a backup server based on a hysteretic-type threshold. That is, a backup server is requested (the request time is assumed to be exponential) when the buffer size hits the upper threshold, and this server is released whenever the buffer size drops to or below the lower threshold at the service completion of the backup server. Through numerical examples, they study the impact of the standard deviation as well as the correlation of the inter-arrival times and the standard deviation of the service time distributions on the server backup decisions. A queueing model is studied in [43] using a simulation approach wherein, using a set of thresholds, the backup servers are added through requests taking a random amount of time and released. A queueing model with phase-type services wherein the server is subject to breakdowns and repairs is considered in [44] by taking into consideration a backup server only during periods of downtime.
In [45], the authors study a model in which two types of customers arrive according to a marked Markovian arrival process () such that the type that receives anon-preemptive priority has a finite buffer, and the other type has an infinite buffer to wait, and in which the services are of the phase type depending on the type. Multiple servers are always active, while some are switched on and off depending a hysteretic policy. The main contribution of the paper is the development of a computational procedure for the stationary distribution of the system states and optimal cost criterion for any fixed threshold. The authors show through numerical results the effectiveness of the hysteresis control and the importance of the role played by the correlation in the arrival process as well as the variance of the service times.
In this paper, using as an arrival process, we consider a scenario of providing help to the main server in a single-server queueing system. This scenario was considered earlier in the context of crowdsourcing [46]. Crowdsourcing is getting popular after a number of industries such as food, consumer products, hotels, electronics, and other large retailers bought into this idea of serving customers; see, e.g., [47,48,49,50]. In [46], a multi-server queue was considered in which there are two types of customers. One type of customers, after obtaining a service, may opt to help the system by acting as a secondary server and hence decrease the number waiting in the system by one. In this paper, we consider the system that is also suitable for modeling the crowdsourcing system. In contrast to [46], here we assume that there is only one main server and that the use of only one secondary server is allowed at any give time. However, we consider the two following features that are inherent to some real world systems and have not been studied in the past: (i) a secondary server will be assigned a batch (not exceeding a pre-determined finite threshold); this server will offer services one at a time; and once all the assigned customers are served, the secondary server also leaves the system; and (ii) with a certain probability, a customer served by a secondary server becomes dissatisfied and hence returns to the main system to get a new service.
The paper is organized as follows. In Section 2, the description of the mathematical model is presented. The steady state analysis using the -type process of the model is given in Section 3, and the -type approach is presented in Section 4. Illustrative numerical examples are given in Section 5, and a few concluding remarks are summarized in Section 6.
2. Mathematical Model
We consider a single-server queueing system in which the arrivals occur according to a Markovian arrival process () with parameter matrices of order The , introduced first by Neuts [36] as part of a larger class of point processes referred to as versatile Markovian point process with heavy notation, was reintroduced in paper [34] with simpler notation. The simplicity of the notation has attracted many researchers, and hence this representation is now the standard in the literature when using or batch (). The generalizes some of the well-known point processes like Poisson, interrupted Poisson, and phase-type renewals, among others. Further, is ideally suited in situations where correlation maybe present in the inter-arrival times. Suppose that the arrivals occur from different sources to a common area for processing. Even if all the individual sources generate arrivals according to renewal processes, the pooled one may not necessarily be a renewal process (unless all individual sources are Poisson processes). Another attractive part of using is that the analysis requires matrix formalism and the associated intuitive reasonings that go with the analysis. A quick description of the follows; for more details, we refer the reader to the above references. The irreducible generator of the is given by ; let denote its invariant vector so that
where here and in the following, e denotes a column vector of ones with appropriate dimension and 0 denotes a row vector of zeros with appropriate dimension.
While the matrix governs the transitions corresponding to the underlying generator producing no arrivals, the matrix governs those corresponding to arrivals occurring to the system.
The average rate of the arrivals (), the variance of the inter-arrival times (), and the correlation () between two successive inter-arrival times are given by (see, e.g., ref. [29])
The system has a single server that offers services on a basis. This server will be referred to as the main server. The service times are exponential with the parameter .
With probability , a served customer may be recruited (or opted from the served customer point of view) to serve other customers waiting in the system (assuming the queue size is positive) provided there is no other such server already serving. Such a server is referred to as a secondary server. That is, a recruitment occurs only when there is at least one customer waiting in the queue and when there is no other secondary server present in the system. Thus, the system may have at most two servers at any given time. Note that with probability , the served customer, who can become the secondary server, does not agree to do this and leaves the system.
When a secondary server is recruited, the server will be assigned a group of, say, i customers, where number in the queue, , where L is a pre-determined finite positive integer. That is, . The secondary server will offer services to the group of customers one at a time, and the service times are exponentially distributed with parameter . A customer receiving a service from a secondary server may be dissatisfied with the service received and requests to be served again with probability , and with probability will leave the system. The dissatisfied customers are fed back to the system. Once the secondary server finishes serving all the customers assigned, the system will release this server.
Note that by taking (in this case plays no role and can be ignored), we get the classic single-server queueing model. This case is used only as an accuracy check in the numerical computations and is not of interest otherwise. The case when is of no interest since here every customer served by a secondary server is fed back to the system and hiring secondary servers only makes the system slow down in offering services.
A pictorial description of the queueing system under study is displayed in Figure 1.
Figure 1.
Structure of the system under study.
3. Approach to the Steady State Analysis
We will analyze the queueing model under study in steady state. The analysis can be carried out either via the process or via -type. In this section, we will take the approach, and in the next section, we briefly highlight the other approach. As it is known, the process is a special case of continuous-time Markov chain (). processes in the context of stochastic modeling have been extensively studied in the literature (see, e.g., refs. [26,29,30,31,32,33,37]).
3.1. Description of the Process Governing the System and Its Generator
Suppose that we denote, at time , that
- •
- is the number of customers in the system,
- •
- is the number of customers in service at the secondary server, ; (note that when , the system does not have a secondary server);
- •
- is the state of the underlying process of the describing the arrivals of the customers,
Then, the stochastic process, describing the behavior of the model under study is a regular irreducible . Enumerating the states of the , in lexicographic order and denoting the level i, for , to be the set of states , the (infinitesimal) generator, Q, of this is given in the following theorem.
Theorem 1.
The infinitesimal generator Q of the has a block tri-diagonal structure:
where the non-zero blocks are defined as follows:
In Equation (4), the notation used is as follows:
- •
- O and I are, respectively, zero and identity matrices of appropriate dimensions as indicated in the suffix;
- •
- ⊗ indicates the Kronecker product of matrices (see, e.g., [51,52,53,54]);
- •
- is a matrix of dimension with and all other entries are zero;
- •
- is a square matrix of dimension with and all other entries are zero;
- •
- is a square matrix of dimension with and all other entries are zero;
- •
- is a square matrix of dimension with , and all other entries are zero;
- •
- is a matrix of dimension with and all other entries are zero;
- •
- is the matrix of dimension with and all other entries are zero;
- •
- is the matrix of dimension with and all other entries are zero;
- •
- is the matrix of dimension with and all other entries are zero.
Proof.
Follows immediately by considering various possibilities with respect to the transitions in the underlying . □
3.2. Ergodicity Condition of the Process
The following result establishes the stability condition of the queueing model under study.
Theorem 2.
The is ergodic if and only if the following inequality holds good:
Proof.
It is well known from Neuts’ matrix-geometric approach (see, e.g., ref. [37]) that the criterion for the ergodicity of the with the generator of form given in (3) is the satisfaction of the inequality
where the vector y is the unique solution of the system
It can easily be verified that
where
Using the mixed product rule for the Kronecker product of matrices (see, e.g., refs. [51,52]), and using Equation (1), it is easy to verify that
where is as given in Equation (1) and x is the solution to the system
By direct substitution, it is easy to verify that the components of the vector which is the unique solution to the system given in (10), are given by
Remark 1.
The stability condition given in Equation (5) can intuitively be explained as follows. Generally, the ergodicity condition requires that the arrival rate of customers per unit of time should be less than the rate of services the customers receive per unit of time when the system is overloaded (in the sense that the number of customers presenting in the system is very large). Here, the arrival rate of the customers is λ per unit of time. The service rate of the customers when the system is overloaded is the sum of (the rate of service per unit of time by the main server) and the rate of service (per unit of time) provided by the secondary server. The latter service rate is 0 when the secondary server is not present at the system, which occurs with probability When the secondary server is present in the system, which occurs with probability , the customers receive service and leave the system at a rate per unit of time. Thus, the total average service rate is and hence the inequality seen in Equation (5).
Remark 2.
The probability, , that when the system is overloaded the second server is not present in the system at an arbitrary time can easily be computed from the following consideration. Consider the periods of the secondary server not present in the system (clearly the average duration of this period is ) alternating with the periods of the secondary server present in the system. When the system recruits a secondary server (when the system is overloaded, the secondary server is assigned to take L for services), the average duration of the secondary server continuously present in the system is given by Hence, we have
which is the expression obtained in Equation (11).
3.3. Computation of the Stationary Distribution of the Process
Under the assumption that the ergodicity condition given in relation (5) holds good, the following steady state probabilities of the states of the exist:
Let us form the row vectors of the steady state probabilities as follows: the row vector is given by and
It is well known that the stationary probability vectors satisfy the system of linear algebraic equations (equilibrium equations):
where Q is the generator of the Markov chain and is given in Equation (3).
The solution of the problem of computing the steady state distribution of level independent is well known; see [37]. For the levels where transitions of do not depend on the level, vectors of stationary probability are found in the matrix-geometric form. The vectors of stationary probabilities of the boundary levels, at which transitions of depend on the level, are then directly found as the solution of the system of linear algebraic equations. However, if the number of boundary levels is large (what occurs in our model if L is large), this system has a large size. Here we present an algorithm that essentially exploits the block tri-diagonal but level-dependent structure of the generator for the levels smaller than
The algorithm used for solving the infinite system of equilibrium equations is presented as the following statement.
Theorem 3.
The vectors are calculated as
where the vector is computed as the unique solution to the system of equations
and the vectors are defined as
or by the recursive formula
where
Here, the stochastic matrices are calculated using the following backward recursion
where the matrix G is the minimal nonnegative solution to the matrix-quadratic equation
This algorithm is an effective modification of the algorithm for the computation of the stationary distribution of the asymptotically quasi-Toeplitz (see, e.g., ref. [31], pp. 145–146). In [31], the vectors are computed as where the matrices are obtained from the matrix recursion similar to Equation (16). Using the vector recursion as spelled out in Equation (16) instead of the corresponding matrix recursion allows a significant reduction in the required computer memory and the execution time.
The existence of the inverses of the matrices (all of which are irreducible sub-generators) appearing in the above algorithm follows immediately, for example, from the O. Tausska theorem [55]. Further, these matrices are semi-stable (and hence the inverses of the negative of these matrices are nonnegative), resulting in producing stable recursive procedures in the numerical implementation of the algorithm.
Corollary. For the following formula is valid:
where
3.4. Computation of the Performance Measures of the System
In order to study the queueing model under study qualitatively as well as to compare it with the corresponding classic queue so as to look at the impact of the recruitment process, we need to develop some key performance measures. A few of these along with their formulas are listed below.
- The probability that the system is idle at an arbitrary time is computed as
- The probability that the system is idle at an arrival epoch is computed as
- The probability that the main server is idle at an arbitrary time is computed as
- The probability that the main server is idle at an arrival epoch is computed as
- The probability that the secondary server is not presenting in the system at an arbitrary time is computed as
- The probability that the main server is busy while the secondary is idle at an arbitrary time is computed as
- The probability that the secondary server is present in the system while the main server is idle at an arbitrary time is computed as
- The mean number of customers in the system at an arbitrary time is computed as
- The mean number of customers in the buffer and with the main server at an arbitrary time is computed as
- The mean number of customers with the secondary server at an arbitrary time is computed as
- The rate of customers departing from the system via the main server is computed as
- The rate of customers departing from the system via the secondary server is computed as
- The fraction of customers served by the main server, , is computed as
- The fraction of customers served by the secondary server, , is computed as
- The rate of dissatisfied customers (returning to the main server from the secondary server) is computed as
It is important in any numerical implementation that one uses as many accuracy checks as possible. Below, we list a few that are intuitively clear and whose proofs are easily verifiable.
- For the steady state vector given in Equation (12), it should be clear that
- The following relationship between various rates should hold good
4. Approach
In this section, we briefly present how one can analyze the queueing system under study using -type queues in continuous time. Keeping track of the number of customers waiting in the queue along with the status of the main server (busy or idle) and the status of the secondary server (not present or present with a specified number of customers assigned), we can study the model as a -type as follows.
Define first the state space of the , which is given by
In the sequel, we take to be a column vector with 1 in the position and 0 elsewhere. Note that where clarification is needed we will denote the dimension within parentheses. For example, will denote a column vector of ones with dimension . The appearing as superscript in a vector or a matrix will stand for the transpose notation. Thus, will denote a row vector of ones.
Define the level , . Note that level indicates that the main server is busy (provided ); customers are waiting in the (main) queue; the secondary server (provided ) is also busy; and the arrival process is in various phases. The level corresponds to the system being idle with the process in one of m phases.
The generator of the governing the system under study is given by
where
means the diagonal matrix with the diagonal entries listed in the brackets.
Using the results of the -type queues in continuous time (see, e.g., refs. [29,30]), for our model, it is easy to verify the following.
- Suppose that is the invariant vector of . Then, the vector is explicitly obtained as
- The stability condition, , reduces to the inequality given in Equation (5).
- Suppose R denotes the rate matrix. Then R satisfies the nonlinear matrix equation given byUsing the probabilistic interpretation of the rate matrix (or using the structure of the coefficient matrices), it is easy to verify that R is lower triangular. This fact, along with the structure of the coefficient matrices, can be exploited in computing R.
- Denoting to be the steady state probability vector of the generator as given in Equation (Section 4), we get the classic matrix-geometric solution here. That is, we havewhere is obtained by solving the following system of linear equations:One can develop the system performance measures for this approach similar to the one done for the approach. The details are omitted. It should be pointed out that we used this approach to validate the numerical results obtained using the approach as another accuracy check.
5. Numerical Examples
In this section, we provide a few illustrative examples using five different arrival processes. Of these five, three are renewal processes and two are correlated ones. Specifically, we take the five as:
ERL: This is an Erlang of order 5 with parameter 2.5 in each of the 5 states. Note that here we have , and .
EXP: This is exponential with a rate of 0.5. Note that here we have , and .
HEX: This is a hyperexponential distribution with mixing probability given by with the corresponding rates of the exponential distribution to be . Here we have , and .
The two correlated, negative and positive, processes are as follows:
NCR: This is a negatively correlated , with representation matrices given by
Note that here we have , and .
PCR: This is a positively correlated , with representation matrices given by
Note that here we have and .
It is clear by looking at the above five that they are all qualitatively different. It is worth pointing out that the arrival process labeled PCR is ideal for situations where the arrivals of the customers are highly irregular with periods alternating between system congestion and system starvation. Such arrivals are common in practice, especially in telecommunications and service industries. Note, further, that the arrival process labeled HEX is known to exhibit a similar irregular behavior in the sense that arrivals with shorter inter-arrival times are separated by long ones. However, the difference between these two processes is the (positive) correlation that is present in the PCR process. The impact of the (positive) correlation as well as the high variability in the inter-arrival times such as the above two processes has been well documented in the literature (see, e.g., refs. [29,30]).
We discuss three illustrative and representative numerical examples to bring out the qualitative nature of the model under study.
Illustrative Example 1:
Here, we discuss the impact of the parameter L on some selected system performance measures for all five s. We first fix and and vary L from 1 to 30.
Figure 2 clearly illustrates the effect of the irregularity in the arrival process, namely, PCR. The average number of customers in the system in the case of PCR is many times larger as compared to the other . It is worth pointing out that for the first four , the measure is a non-decreasing function of L, whereas for PCR, a non-increasing trend is seen. This explains the role of the correlation, especially positive, and should not be ignored. Further, a large value of L indicates that when a secondary server is recruited, more customers will be assigned and, due to the nature of the slowness of the secondary server (as compared to the main server), there is a high probability, especially for the cases of the first four , for the system to have more customers in the system on the average. Similar to what is known in the classic queue—namely, the mean number in the system increases with increasing variability in the inter-arrival times among the renewal arrivals—we see that behavior here among the first three , which correspond to renewal arrivals.
Figure 2.
Impact of L on the average number of customers in the system for different s.
However, with respect to the PCR arrivals, we see an interesting but opposite trend, namely, a decreasing one. This can intuitively be explained as follows. First, note that has a maximal value of 15.3983 when which can be explained by using the fact that, when , the secondary servers leave after serving one customer; with a probability of only 0.5 for recruitment, the queue tends to build up fast. As L is increased, secondary servers are more involved in clearing the queue, especially when the arrivals occur in spurts, and so decreases. It reaches a minimal value of 11.9757 when and then starts to increase due to not getting a chance to be served by the main server. For .
Figure 3 shows the behavior of the average number of customers with the secondary server As is to be expected, we see that increases when L increases. As in the previous figure, the value of is, generally speaking, large in the case of PCR. Only for small values of L is this value smaller for the - This can be explained by the high irregularity of the arrivals seen in the PCR process, which causes the system to starve, during which only the main server is busy offering services for the most part. Among - the known effect that higher variance implies a large number of customers in the system is confirmed.
Figure 3.
Dependence of the average number of customers with the secondary server on the parameter L for different s.
Figure 4 illustrates the behavior of the probability, , that the system is idle at an arbitrary moment. This figure matches Figure 2 in two respects. The first one is that it also shows a large difference in the measure when being compared to various . When one is interested in finding an optimal L, it is clear that it matters which measure is chosen as the objective function as well as the type of used when all other parameters are fixed. For example, if we look the case of the PCR arrival process, the optimal value of L is 16 if we are tying to minimize However, if measure is the focus of the optimization problem, then yields the largest value for this measure.
Figure 4.
Dependence of the probability that the system is idle at an arbitrary moment on the parameter L for different s.
Figure 5 and Figure 6 illustrate the behavior of the probabilities and , which respectively correspond to when the main server is idle with the secondary server being busy, and when the main server is busy with the secondary server being idle, at an arbitrary moment. While the first probability is increasing when L increases, the second probability is decreasing. From these figures, one can see the essential differences in these probabilities under various scenarios.
Figure 5.
Dependence of the probability that the main server is idle while the secondary server is busy on the parameter L for different s.
Figure 6.
Dependence of the probability that the main server is busy while the secondary server is idle on the parameter L for different s.
Illustrative Example 2:
The purpose of this example is to investigate the impact of the parameters q (recall this is the probability that a served customer refuses to act as a secondary server) and (this is the probability that a customer served by a secondary server is dissatisfied and sent back to the system). We fix the value of L as 10 (midpoint between the two optimal values mentioned in the first example). We also fix the service rates as and and investigate the dependence of several performance measures on the probabilities q and We vary the values of these probabilities from 0 to 1 with step 0.05. Note that the value corresponds to the classic system with the service rate
In this example, we focus on the arrival process labeled PCR, the choice of which is based on the behavior for this process on the measures as highlighted in the first illustrative example. From Figure 7, which displays the dependence of the average number of customers in the system on the parameters q and , we infer a number of interesting observations.
Figure 7.
Dependence of the average number of customers in the system on the parameters q and .
The value of is minimal with a value of 7.9328 when the served customer is always available to be recruited (when the system needs) and when the customer receiving service from a secondary server is always satisfied. That is the minimum attained when and . This measure increases when either q or increases, and the rate of increase becomes higher when one or both q and approach the value 1. When , the system transforms to the corresponding classic and to a system without the use of the secondary server, and for all values of (as is clear). When which corresponds to the case that a served customer is always recruited (when needed), even when the probability of dissatisfaction is high (), the value of is equal to 12.91247. Therefore, the use of a secondary server essentially decreases the mean number of customers in the system by more than 40%. Also, we looked at the cut-off point, say , for a dissatisfaction rate such that the classic queueing model will be better than the model proposed here. For the parameters of this example, the cut-off point is , in that the dissatisfaction rate has to be more than 98.5% for the classic model to perform better.
To test further the amount of reduction in the mean number, we increased by 50% to . Keeping all other parameters (except for the normalization of the parameters of the arrival process to arrive at this specific ) the same, we obtained a reduction percentage of more than 52.8%. Thus, an increased load to the system will highly benefit from having a secondary server to help the system even with a high customer dissatisfaction rate of 50% with this secondary server.
Figure 8 shows the dependence of the average number of customers with the secondary server on the parameters q and This probability significantly decreases when q approaches 1 and when the customers are rarely recruited to serve as secondary servers. has the maximal value when q is equal to zero, i.e., all customers are recruited (when needed) to become secondary servers, and when is close to 1. Obviously, in the latter case, almost all customers served by a secondary server have to be sent back to the system due dissatisfaction. This explains the creation of additional work to the system and should be discouraged by resorting to the classic queue as opposed to recruiting (bad) secondary servers. It is worth pointing out that such a (bad) system may reflect badly on the system itself for providing services that cannot be replicated by other (served) customers.
Figure 8.
Dependence of the average number of customers with the secondary server on the parameters q and .
In Figure 9, the behavior of the probability that the system is idle at an arbitrary moment as a function of q and is displayed. This probability has the minimal value of 0.4445 when and which is intuitively clear, as having to serve customers again after going through a secondary server puts a load on the system.
Figure 9.
Dependence of the probability that the system is idle at an arbitrary moment on the parameters q and .
The probability that increases when q increases and/or decreases: the maximal value 0.5652 of this probability is achieved when and In the corresponding classic system, this measure is .
Figure 10 shows the behavior of the probability , as a function of q and , that the system is idle at an arrival epoch. As can be expected, the behavior of the probability that the system is idle at an arrival epoch is similar to the behavior of the probability that the system is idle at an arbitrary moment. However, the former probability is less than the latter one. This is easily explained by the above-stated observation that in the case of PCR, wherein there are periods alternating between rare and frequent arrivals to the system, there is high likelihood that an arriving customer may be in the period of frequent arrivals leading to a high probability of seeing the system idle. It is worth pointing it out that for the corresponding classic system, this measure has a value of 0.358.
Figure 10.
Dependence of the probability that the system is idle at an arbitrary arrival moment on the parameters q and .
Figure 11 and Figure 12 show dependencies, respectively, of the probability that the main server is idle while the secondary server is busy, and the probability that the main server is busy while the secondary server is idle on q and The probability is significantly small and obviously tends to zero when probability q tends to 1. On the other hand, the probability appears to be much larger than The probability tends to increase when q is increased to 1.
Figure 11.
Dependence of the probability that the main server is idle while the secondary server is busy on the parameters q and .
Figure 12.
Dependence of the probability that the main server is busy while the secondary server is idle on the parameters q and .
Illustrative Example 3:
In this final example, we investigate the impact of the varying the service rates and when all other parameters are fixed. Towards this end, we fix , , and . The rates and are varied from 0.25 to 2.0 in increments of 0.05. It is worth mentioning that, to fulfill the ergodicity condition (see Equation (5)), we additionally restrict the value of whenever is small. In particular, when the minimal value of the rate is chosen (with the pre-described above step as 0.05) to be no less than 0.65. When the rate is chosen to be no less than 0.45. When the rate is chosen to be no less than 0.3. Only for can the value of be varied from 0.25 as originally pointed out.
With the above restrictions on the choice of and , we display in Figure 13 and Figure 14 the dependence of the measure on and In Figure 13, most of the surface showing the dependence looks flat. This is due to the fact that, for many combinations of the parameter values with small rate , the ergodicity condition is violated and the measure becomes very large. Therefore, in Figure 14, the dependence of on and is displayed only for non-small values of Clearly, one can see a decreasing trend as quickly decreases when increases for fixed and vice-versa.
Figure 13.
Dependence of the average number of customers in the system on the parameters and .
Figure 14.
Dependence of the average number of customers in the system on the parameters and .
Figure 15 shows the behavior of the average number of customers with the secondary server The value of is maximized with a value of about 5 when and are small. This is intuitively clear since for small values of and , the ergodicity condition is close to being violated, causing a high recruitment rate for secondary servers who in all likelihood before leaving the system will serve a group of size . Thus, the average number of customers in service at an arbitrary moment is about 5. With an increase in and the value of decreases as one would expect. For small values of , the decrease is significant as is increased; for larger values of we notice an insignificant rate of decrease in with an increase in .
Figure 15.
Dependence of the average number of customers with the secondary server on the parameters and .
Figure 16 and Figure 17 illustrate the behavior of and As in the previous example, is less than that of
Figure 16.
Dependence of the probability that the system is idle at an arbitrary moment on the parameters and .
Figure 17.
Dependence of the probability that the system is idle at an arbitrary arrival moment on the parameters q and .
Figure 18 and Figure 19 illustrate the behavior of and These performance characteristics can be quite interesting if the economic arguments are taken into account. For example, if the work of the secondary server is not gratis, then the analysis of the secondary server to stay idle or busy while the main server is busy or idle should shed more light and will be a topic of interest for a future study.
Figure 18.
Dependence of the probability that the main server is idle while the secondary server is busy on the parameters q and .
Figure 19.
Dependence of the probability that the main server is busy while the secondary server is idle on the parameters and .
6. Conclusions
In this paper, we analyzed a queueing system in which there is an opportunity to recruit a (served) customer as a secondary server to help the main server by assigning a group of a finite number of waiting customers. The arrival process is modeled using a versatile Markovian point process, The possibility of customer dissatisfaction with the service provided by the secondary server causing those customers to be fed back into the system is taken into account. The steady state analysis of the multi-dimensional Markov chain describing behavior of the system is implemented, and illustrative numerical results potentially useful for making managerial decisions are presented.
The model studied in this paper can be generalized in a number of ways. For example, (i) the service provided by the secondary server can be done in groups; (ii) relax the assumption of having only one secondary server to more than one and see the impact of just increasing it to, say, 2; (iii) use phase-type services possibly with different representations for the main and secondary server; (iv) incorporate impatience of the customers in both the main and secondary buffers; (v) implement a recruitment process depending on the observed queue length based on a threshold-type control policy; (vi) allow group arrivals; and finally (vii) incorporate the possibility of recruiting many secondary servers with two types of customers such that only one type will qualify to act as secondary servers.
Author Contributions
Conceptualization S.R.C. and S.A.D.; methodology S.R.C., A.N.D. and S.A.D.; software S.R.C., S.A.D. and O.S.D.; validation S.R.C., S.A.D. and O.S.D.; formal analysis S.R.C. and S.A.D.; investigation S.R.C., A.N.D., S.A.D. and O.S.D.; writing—original draft preparation S.R.C. and A.N.D.; writing—review and editing S.R.C., A.N.D. and O.S.D.; supervision S.R.C. and A.N.D.; project administration A.N.D. All authors read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Data Availability Statement
Not applicable.
Acknowledgments
The authors thank the anonymous reviewers for their suggestions/comments that improved the presentation of the paper.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Chaurasia, N.; Kumar, M.; Chaudhry, R.; Verma, O.P. Comprehensive survey on energy-aware server consolidation techniques in cloud computing. J. Supercomput. 2021, 77, 11682–11737. [Google Scholar] [CrossRef]
- Maccio, V.J.; Down, D.G. Structural properties and exact analysis of energy-aware multiserver queueing systems with setup times. Perform. Eval. 2018, 121, 48–66. [Google Scholar] [CrossRef]
- Mitrani, I. Trading power consumption against performance by reserving blocks of servers. In Computer Performance Engineering; Springer: Berlin/Heidelberg, Germany, 2013; pp. 1–15. [Google Scholar]
- Mitrani, I. Managing performance and power consumption in a server farm. Ann. Oper. Reasearch 2013, 202, 121–134. [Google Scholar] [CrossRef]
- Mitrani, I. Service center trade-offs between customers impatience and power consumation. Perform. Eval. 2011, 68, 1222–1231. [Google Scholar] [CrossRef]
- Lui, J.C.S.; Golubchik, L. Stochastic complement analysis of multi-server threshold queues with hysteresis. Perform. Eval. 1999, 35, 19–48. [Google Scholar] [CrossRef]
- Gortsev, A.M.; Nazarov, A.A.; Terpugov, A.F. Control and Adaptation in Queueing Systems; Tomsk University Press: Tomsk, Russia, 1978. (In Russian) [Google Scholar]
- Rykov, V.; Efrosinin, D. Optimal Control of Queueing Systems with Heterogeneous Servers. Queueing Syst. 2004, 46, 389–407. [Google Scholar] [CrossRef]
- Ibe, O.C.; Keilson, J. Multi-server threshold queues with hysteresis. Perform. Eval. 1995, 21, 185–213. [Google Scholar] [CrossRef]
- Li, H.; Yang, T. Queues with a variable number of servers. Eur. J. Oper. Res. 2000, 124, 615–628. [Google Scholar] [CrossRef]
- Chou, C.F.; Golubchik, L.; Lui, J.C.S. Multiclass Multiserver Threshold-Based Systems: A Study of Noninstantaneous Server Activation. IEEE Trans. Parallel Distrib. Syst. 2007, 18, 96–110. [Google Scholar] [CrossRef]
- Kitaev, M.Y.; Rykov, V.V. Controlled Queueing Systems; CRC Press: New York, NY, USA, 1995. [Google Scholar]
- Rykov, V.V. Monotone Control of Queueing Systems with Heterogeneous Servers. Queueing Syst. 2001, 37, 391–403. [Google Scholar]
- Efrosinin, D.; Breuer, L. Threshold policies for controlled retrial queues with heterogeneous servers. Ann. Oper. Res. 2006, 141, 139–162. [Google Scholar] [CrossRef]
- Nobel, R.D.; Tijms, H.C. Optimal control of a queueing system with heterogeneous servers and setup costs. IEEE Trans. Autom. Control 2000, 45, 780–784. [Google Scholar] [CrossRef]
- Nobel, R. A retrial queueing system with a variable number of active servers: Dynamic manpower planning in a call center. In International Conference on Queueing Theory and Network Applications; Springer: Cham, Switzerland, 2018; pp. 33–47. [Google Scholar]
- Lin, W.; Kumar, P. Optimal control of a queueing system with two heterogeneous servers. IEEE Trans. Autom. Control 1984, 29, 696–703. [Google Scholar] [CrossRef]
- Walrand, J. A note on “Optimal control of a queuing system with two heterogeneous servers”. Syst. Control Lett. 1984, 4, 131–134. [Google Scholar] [CrossRef]
- Schwartz, C.; Pries, R.; Tran-Gia, P. A queuing analysis of an energy-saving mechanism in data centers. In Proceedings of the International Conference on Information Network, Bali, Indonesia, 1–3 February 2012; pp. 70–75. [Google Scholar]
- Ivaneshkin, A.I. Optimizing a multiserver queuing system with a variable number of servers. Cybern. Syst. Anal. 2007, 43, 542–548. [Google Scholar] [CrossRef]
- Efrosinin, D.; Sztrik, J. An algorithmic approach to analysing the reliability of a controllable unreliable queue with two heterogeneous servers. Eur. J. Oper. Res. 2018, 271, 934–952. [Google Scholar] [CrossRef]
- Efrosinin, D.; Stepanova, N. Estimation of the optimal threshold policy in a queue with heterogeneous servers using a heuristic solution and artificial neural networks. Mathematics 2021, 9, 1267. [Google Scholar] [CrossRef]
- Klimenok, V.; Dudin, A.; Samouylov, K. Analysis of the BMAP/PH/N queueing system with backup servers. Appl. Math. Model. 2018, 57, 64–84. [Google Scholar] [CrossRef]
- Dudin, A.; Dudina, O.; Dudin, S.; Gaidamaka, Y. Self-service system with rating dependent arrivals. Mathematics 2022, 10, 297. [Google Scholar] [CrossRef]
- Artalejo, J.R.; Gomez-Correl, A.; He, Q.M. Markovian arrivals in stochastic modelling: A survey and some new results. SORT-Stat. Oper. Res. Trans. 2010, 34, 101–144. [Google Scholar]
- Bladt, M.; Nielsen, B.F. Matrix-Exponential Distributions in Applied Probability; Springer: Boston, MA, USA, 2017. [Google Scholar]
- Chakravarthy, S.R. The Batch Markovian Arrival Process: A Review and Future Work. Adv. Probab. Theory Stoch. Process. 2001, 1, 21–49. [Google Scholar]
- Chakravarthy, S.R. Markovian Arrival Processes. In Wiley Encyclopedia of Operations Research and Management Science; Wiley: Hoboken, NJ, USA, 2010. [Google Scholar]
- Chakravarthy, S.R. Introduction to Matrix-Analytic Methods in Queues 1: Analytical and Simulation Approach—Basics; ISTE Ltd.: London, UK; John Wiley and Sons: New York, NY, USA, 2022. [Google Scholar]
- Chakravarthy, S.R. Introduction to Matrix-Analytic Methods in Queues 2: Analytical and Simulation Approach—Queues and Simulation; ISTE Ltd.: London, UK; John Wiley and Sons: New York, NY, USA, 2022. [Google Scholar]
- Dudin, A.N.; Klimenok, V.I.; Vishnevsky, V.M. The Theory of Queuing Systems with Correlated Flows; Springer Nature: Berlin/Heidelberg, Germany, 2020. [Google Scholar]
- He, Q.-M. Fundamentals of Matrix-Analytic Methods; Springer: New York, NY, USA, 2014. [Google Scholar]
- Latouche, G.; Ramaswami, V. Introduction to Matrix Analytic Methods in Stochastic Modeling; SIAM: Philadelphia, PA, USA, 1999. [Google Scholar]
- Lucantoni, D.; Meier-Hellstern, K.S.; Neuts, M.F. A single-server queue with server vacations and a class of nonrenewal arrival processes. Adv. Appl. Probab. 1990, 22, 676–705. [Google Scholar] [CrossRef]
- Lucantoni, D. New results on the single server queue with a batch Markovian arrival process. Stoch. Model. 1991, 7, 1–46. [Google Scholar] [CrossRef]
- Neuts, M.F. A versatile Markovian point process. J. Appl. Probab. 1979, 16, 764–779. [Google Scholar] [CrossRef]
- Neuts, M.F. Matrix-Geometric Solutions in Stochastic Models; The Johns Hopkins University Press: Baltimore, MD, USA, 1981. [Google Scholar]
- Neuts, M.F. Structured Stochastic Matrices of M/G/1 Type and Their Applications; Marcel Dekker: New York, NY, USA, 1989. [Google Scholar]
- Neuts, M.F. Models based on the Markovian arrival processes. IEICE Trans. Commun. 1992, E75-B, 1255–1265. [Google Scholar]
- Naumov, V.; Gaidamaka, Y.; Yarkina, N.; Samouylov, K. Matrix and Analytical Methods for Performance Analysis of Telecommunication Systems; Springer Nature: Berlin/Heidelberg, Germany, 2021. [Google Scholar]
- Chakravarthy, S.R. A Multi-server Queueing Model with Markovian Arrivals and Multiple Thresholds. Asia-Pac. J. Oper. Res. 2007, 24, 223–243. [Google Scholar] [CrossRef]
- Chakravarthy, S.R.; Agnihothri, S.R. A Server Backup Model with Markovian Arrivals and Phase Type Services (with). Eur. J. Oper. Res. 2008, 184, 584–609. [Google Scholar] [CrossRef]
- Chakravarthy, S.R. A stochastic model for a dynamic service facility with threshold and lead time. In Proceedings of the Second International Conference on Stochastic Modelling and Simulation, Tamil Nadu, India, 17–19 December 2012; pp. 3–22. [Google Scholar]
- Chakravarthy, S.R.; Kulshrestha, R. A queueing model with server breakdowns, repairs, vacations, and backup server. Oper. Res. Perspect. 2020, 7, 100131. [Google Scholar] [CrossRef]
- Kim, C.S.; Dudin, A.; Dudin, S.; Dudina, O. Hysteresis control by the number of active servers in queueing system with priority service. Perform. Eval. 2016, 101, 20–33. [Google Scholar] [CrossRef]
- Chakravarthy, S.R.; Dudin, A.N. A Queueing Model for Crowdsourcing. J. Oper. Res. Soc. 2017, 68, 221–236. [Google Scholar] [CrossRef]
- Arslan, A.M.; Agatz, N.; Kroon, L.; Zuidwijk, R. Crowdsourced delivery—A dynamic pickup and delivery problem with ad hoc drivers. Transp. Sci. 2019, 53, 222–235. [Google Scholar] [CrossRef]
- Savelsbergh, M.W.; Ulmer, M.W. Challenges and opportunities in crowdsourced delivery planning and operations. 4OR 2022, 20, 1–21. [Google Scholar] [CrossRef]
- Sun, L.; Yang, Q.; Chen, X.; Chen, Z. RC-chain: Reputation-based crowdsourcing blockchain for vehicular networks. J. Netw. Comput. Appl. 2021, 176, 102956. [Google Scholar] [CrossRef]
- Fatehi, S.; Wagner, M.R. Crowdsourcing last-mile deliveries. Manuf. Serv. Oper. Manag. 2022, 24, 791–809. [Google Scholar] [CrossRef]
- Graham, A. Kronecker Products and Matrix Calculus with Applications; Ellis Horwood: Cichester, UK, 1981. [Google Scholar]
- Steeb, W.-H.; Hardy, Y. Matrix Calculus and Kronecker Product; World Scientific Publishing: Singapore, 2011. [Google Scholar]
- Horn, R.A.; Johnson, C.R. Topics in Matrix Analysis; Cambridge University Press: Cambridge, UK, 1991. [Google Scholar]
- Zhang, H.; Ding, F. On the Kronecker products and their applications. J. Appl. Math. 2013, 2013, 296185. [Google Scholar] [CrossRef]
- Gantmacher, F.R. Theory of Matrices, 1st ed.; Science USSR: Moscow, Russia, 1967. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).


















