Exact Time-Dependent Queue-Length Solution to a Discrete-Time Geo/D/1 Queue

Abstract

Time-dependent solutions to queuing models are beneficial for evaluating the performance of real-world systems such as communication, transportation, and service systems. However, restricted results have been reported due to mathematical complexity. In this study, we present a time-dependent queue-length formula for a discrete-time $Geo/D/1$ queue starting with a positive number of initial customers. We derive the time-dependent formula in closed form.

1. Introduction

Queuing models have been widely used for performance evaluation of practical systems such as communication, transportation, and service systems. For the most part, the previous studies have addressed stationary solutions of queuing models for the optimal control of long-term system performance. However, time-dependent solutions to queuing systems are more meaningful for practical systems; a good example was presented in Griffiths et al. [1], where the authors applied the transient solution of an $M/E_k/1$ queue to model and analyze a 24-hour traffic profile on the Severn Bridge in England.

The pioneering results on the transient results were presented by Luchak [2] and Saaty [3]. Using a modified Bessel function, they presented the transient queue-length distribution of an $M/M/1$ queue starting with a positive number of initial customers. Later, computationally efficient solutions were presented in many other studies [4,5,6,7,8]. For $M/E_k/1$ queues, several results have been presented. Griffiths et al. [1,9] and Leonenko [10] derived transient solutions for $M/E_k/1$ queues starting with a positive number of initial customers, and Baek et al. [11] extended their results to be applied to analysis in a single busy period. Furthermore, Kapodistria et al. [12] presented the time-dependent solutions to a linear birth/immigration-death process with binomial catastrophes. They presented general results that include a background random environment.

The first study on queues with deterministic service times was conducted by Garcia et al. [13]. Using the matrix-analytic method, they derived the transient queue-length distribution of an $M/D/1/N$ queue in a computationally efficient form. Later, the queue-length formula was extended to an $M/D/c$ queue by Franx [14]. Recently, extensive results on the transient solution of the $M/D/1$ queue were presented by Baek et al. [15]. They derived not only the queue-length probability but also the waiting time distribution in closed form.

The aforementioned studies focused only on the queues in a continuous-time domain. Time-dependent solutions to queues in a discrete-time domain are even scarcer. Parthasarathy and Sudhesh [16] were the first to derive the transient queue-length solution to a discrete-time $Geo/Geo/1$ queue. Employing a generating function and continued fractions, they obtained a computationally efficient solution. Kim [17] studied the same model and presented the solution in a formal form. However, we failed to find any result related to the time-dependent solution to the discrete-time queue with a constant service time. From this perspective, we present a time-dependent queue-length solution to a $Geo/D/1$ queue. To the best of our knowledge, our proposed results have not been noted in existing literature.

2. Main Results

In this section, we present the main results. Consider a discrete-time $Geo/D/1$ queuing system with an infinite buffer in which the timeline is divided into intervals of equal length called time slots. Customers arrive into the system according to the Bernoulli process at a rate of p, and the service times are assumed to be a constant of D. We assume that arrivals and service completion can occur only at the slot boundaries. More specifically, we consider the late-arrival model [18]. Therefore, we assume that customer arrivals can occur only in $(n-,n)$ and services can be completed only in $(n,n+)$.

Let $N_0$ be the number of new initial customers at time slot 0. We define $N\left(n\right)$ as the number of customers at the end of the time slot n and with the following probability:

$$Q_k^{\left(j\right)}\left(n\right)=Pr[N\left(n\right)=k|N_0=j],(k\ge 0,j\ge 0),(n>0).$$

Because $Q_0^{\left(j\right)}\left(n\right)$ plays a major role in deriving $Q_k^{\left(j\right)}\left(n\right)$, we first derive the probability $Q_0^{\left(j\right)}\left(n\right)$ in the following theorem.

Theorem 1.

We have

$$\begin{array}{cc}\hfill Q_0^{\left(j\right)}\left(n\right)& ={\displaystyle \sum _{r=0}^{\lfloor \frac{n}{D}\rfloor -j}}\left(\genfrac{}{}{0pt}{}{n}{r}\right)p^r{(1-p)}^{n-r}\left(1-\frac{r}{n}D\right).\hfill \end{array}$$

(1)

Proof. 

Let us define $A\left(n\right)$ as the number of arrivals during the time interval $(0,n]$ and ${\tau }_{i\left(r\right)}\left(n\right)$ as the i-th arrival epoch under the condition that $A\left(n\right)=r$. We note that the service time is a constant D and the system starts with j initial customers. Therefore, conditioning on $A\left(n\right)$, we have

$$\begin{array}{cc}\hfill Q_0^{\left(j\right)}\left(n\right)& ={\displaystyle \sum _{r=0}^{\infty }}Pr\left({\tau }_{1\left(r\right)}\left(n\right)<{\tau }_{2\left(r\right)}\left(n\right)<\cdots <{\tau }_{r\left(r\right)}\left(n\right),\right.\hfill \\ & \left.{\tau }_{1\left(r\right)}\left(n\right)\le n-rD,{\tau }_{2\left(r\right)}\left(n\right)\le n-(r-1)D,\dots ,{\tau }_{r\left(r\right)}\left(n\right)\le n-D|A\left(n\right)=r\right)\hfill \\ & \times Pr(A\left(n\right)=r)U\left(n\ge (j+r)D\right)\hfill \\ & ={\displaystyle \sum _{r=0}^{\lfloor \frac{n}{D}\rfloor -j}}Pr\left({\tau }_{1\left(r\right)}\left(n\right)\le n-rD,{\tau }_{2\left(r\right)}\left(n\right)\le n-(r-1)D,\dots ,{\tau }_{r\left(r\right)}\left(n\right)\le n-D|A\left(n\right)=r\right)Pr(A\left(n\right)=r),\hfill \end{array}$$

(2)

where $U\left(A\right)$ is an indicator function which takes 1, if A is true, or 0, and the second equality holds because it is obvious that ${\tau }_{1\left(r\right)}\left(n\right)<{\tau }_{2\left(r\right)}\left(n\right)<\cdots <{\tau }_{r\left(r\right)}\left(n\right)$.

Equation (2) means that the system can be empty at time slot n only when the i-th customer among r customers arrives before $\left[n-(r-(i-1\left)\right)D\right]$-th time slot $(1\le i\le r)$ under the condition that $A\left(n\right)=r$. Since the arrival process is Bernoulli process with rate p, we have $Pr(A\left(n\right)=r)=\left(\genfrac{}{}{0pt}{}{n}{r}\right)p^r{(1-p)}^{n-r}.$ Next, to complete Equation (2), we need to derive $Pr({\tau }_{1\left(r\right)}\left(n\right)\le n-rD,{\tau }_{2\left(r\right)}\left(n\right)\le n-(r-1)D,\dots ,{\tau }_{r\left(r\right)}\left(n\right)\le n-D|A\left(n\right)=r)$. For $1\le n_1<n_2<\cdots <n_r\le n$, it is not difficult to have

$$\begin{array}{cc}\hfill Pr& \left({\tau }_{1\left(r\right)}\left(n\right)=n_1,{\tau }_{2\left(r\right)}\left(n\right)=n_2,\cdots ,{\tau }_{r\left(r\right)}\left(n\right)=n_r|A\left(n\right)=r\right)\hfill \\ \hfill =& \frac{Pr({\tau }_{1\left(r\right)}\left(n\right)=n_1,{\tau }_{2\left(r\right)}\left(n\right)=n_2,\cdots ,{\tau }_{r\left(r\right)}\left(n\right)=n_r,A\left(n\right)=r)}{Pr\left(A\right(n)=r)}=\frac{p^r{(1-p)}^{n-r}}{\left(\genfrac{}{}{0pt}{}{n}{r}\right)p^r{(1-p)}^{n-r}}=\frac{1}{\left(\genfrac{}{}{0pt}{}{n}{r}\right)}.\hfill \end{array}$$

(3)

Therefore, we have

$$\begin{array}{cc}\hfill Pr& \left({\tau }_{1\left(r\right)}\left(n\right)\le n-rD,{\tau }_{2\left(r\right)}\left(n\right)\le n-(r-1)D,\dots ,{\tau }_{r\left(r\right)}\left(n\right)\le n-D|A\left(n\right)=r\right)\hfill \\ \hfill =& {\displaystyle \sum _{n_1=1}^{n-rD}}{\displaystyle \sum _{n_2=n_1+1}^{n-(r-1)D}}\cdots {\displaystyle \sum _{n_r=n_{r-1}+1}^{n-D}}Pr\left({\tau }_{1\left(r\right)}\left(n\right)=n_1,{\tau }_{2\left(r\right)}\left(n\right)=n_2,\cdots ,{\tau }_{r\left(r\right)}\left(n\right)=n_r|A\left(n\right)=r\right)\hfill \\ \hfill =& {\displaystyle \sum _{n_1=1}^{n-rD}}{\displaystyle \sum _{n_2=n_1+1}^{n-(r-1)D}}\cdots {\displaystyle \sum _{n_r=n_{r-1}+1}^{n-D}}\frac{1}{\left(\genfrac{}{}{0pt}{}{n}{r}\right)}.\hfill \end{array}$$

(4)

Using Equation (4) in Equation (2), we obtain

$$\begin{array}{c}\hfill Q_0^{\left(j\right)}\left(n\right)={\displaystyle \sum _{r=0}^{\lfloor \frac{n}{D}\rfloor -j}}\left[{\displaystyle \sum _{n_1=1}^{n-rD}}{\displaystyle \sum _{n_2=n_1+1}^{n-(r-1)D}}\cdots {\displaystyle \sum _{n_r=n_{r-1}+1}^{n-D}}\frac{1}{\left(\genfrac{}{}{0pt}{}{n}{r}\right)}\right]\left(\genfrac{}{}{0pt}{}{n}{r}\right)p^r{(1-p)}^{n-r}.\end{array}$$

(5)

Now, to obtain Equation (1), it is sufficient to prove that

$$\begin{array}{c}\hfill {\displaystyle \sum _{n_1=1}^{n-rD}}{\displaystyle \sum _{n_2=n_1+1}^{n-(r-1)D}}\cdots {\displaystyle \sum _{n_r=n_{r-1}+1}^{n-D}}\frac{1}{\left(\genfrac{}{}{0pt}{}{n}{r}\right)}=1-\frac{r}{n}D.\end{array}$$

(6)

We use mathematical induction for the proof of Equation (6). For $r=1$, we trivially have ${\sum }_{n_1=1}^{n-D}\frac{1}{\left(\genfrac{}{}{0pt}{}{n}{1}\right)}=1-\frac{1}{n}D$. We now assume that Equation (6) holds for $r=l$. Then, for $r=l+1$, we have

$$\begin{array}{c}{\displaystyle \sum _{n_1=1}^{n-(l+1)D}}{\displaystyle \sum _{n_2=n_1+1}^{n-lD}}\cdots {\displaystyle \sum _{n_{l+1}=n_l+1}^{n-D}}\frac{1}{\left(\genfrac{}{}{0pt}{}{n}{l+1}\right)}\hfill \\ ={\displaystyle \sum _{n_1=1}^{n-(l+1)D}}\left[{\displaystyle \sum _{i_1=1}^{n-n_1-lD}}\cdots {\displaystyle \sum _{i_l=i_{l-1}+1}^{n-n_{1}D}}\frac{1}{\left(\genfrac{}{}{0pt}{}{n-n_1}{l}\right)}\right]\frac{\left(\genfrac{}{}{0pt}{}{n-n_1}{l}\right)}{\left(\genfrac{}{}{0pt}{}{n}{l+1}\right)}={\displaystyle \sum _{n_1=1}^{n-(l+1)D}}\left[1-\frac{lD}{n-n_1}\right]\frac{\left(\genfrac{}{}{0pt}{}{n-n_1}{l}\right)}{\left(\genfrac{}{}{0pt}{}{n}{l+1}\right)},\hfill \end{array}$$

(7)

where we use $i_k=n_{k+1}-n_1$ for $k\ge 1$.

We now have

$$\begin{array}{c}{\displaystyle \sum _{n_1=1}^{n-(l+1)D}}\left[1-\frac{lD}{n-n_1}\right]\frac{\left(\genfrac{}{}{0pt}{}{n-n_1}{l}\right)}{\left(\genfrac{}{}{0pt}{}{n}{l+1}\right)}={\displaystyle \sum _{n_1=1}^{n-(l+1)D}}\frac{n-n_1-lD}{n-n_1}·\frac{(n-n_1)!·(n-l-1)!}{n!·(n-n_1-l)!}·(l+1)\hfill \\ =\frac{n-1-lD}{n-1}·\frac{(n-1)!·(n-l-1)!}{n!·(n-1-l)!}·(l+1)+\frac{n-2-lD}{n-2}·\frac{(n-2)!·(n-l-1)!}{n!·(n-2-l)!}·(l+1)\hfill \\ +\cdots +\frac{(l+1)D-lD}{(l+1)D}·\frac{\left(\right(l+1\left)D\right)!·(n-l-1)!}{n!·\left(\right(l+1)D-l)!}·(l+1)\hfill \\ ={\displaystyle \sum _{m=(l+1)D}^{n-1}}\frac{m-lD}{m}·\frac{m!·(n-l-1)!}{n!·(m-l)!}·(l+1)\hfill \\ =\left(1-\frac{(l+1)D}{n}\right)·\frac{(n-l-1)!}{(n-1)!}·\frac{l+1}{n-(l+1)D}{\displaystyle \sum _{m=(l+1)D}^{n-1}}\frac{(m-lD)·(m-1)!}{(m-l)!}.\hfill \end{array}$$

(8)

In Equation (8), we have

$$\begin{array}{c}{\displaystyle \sum _{m=(l+1)D}^{n-1}}\frac{(m-lD)·(m-1)!}{(m-l)!}\hfill \\ ={\displaystyle \sum _{m=0}^{n-1}}\left[\frac{m!}{(m-l)!}-lD\frac{(m-1)!}{(m-l)!}\right]-{\displaystyle \sum _{m=0}^{(l+1)D-1}}\left[\frac{m!}{(m-l)!}-lD\frac{(m-1)!}{(m-l)!}\right]\hfill \\ =l!\left[·{\displaystyle \sum _{m=0}^{n-1}}\left(\genfrac{}{}{0pt}{}{m}{l}\right)-D·{\displaystyle \sum _{m=0}^{n-1}}\left(\genfrac{}{}{0pt}{}{m-1}{l-1}\right)-{\displaystyle \sum _{m=0}^{(l+1)D-1}}\left(\genfrac{}{}{0pt}{}{m}{l}\right)+D·{\displaystyle \sum _{m=0}^{(l+1)D-1}}\left(\genfrac{}{}{0pt}{}{m-1}{l-1}\right)\right]\hfill \\ =l!\left[\left(\genfrac{}{}{0pt}{}{n}{l+1}\right)-D·\left(\genfrac{}{}{0pt}{}{n-1}{l}\right)-\left(\genfrac{}{}{0pt}{}{(l+1)D}{l+1}\right)+D·\left(\genfrac{}{}{0pt}{}{(l+1)D-1}{l}\right)\right]\hfill \\ =l!·\left(\genfrac{}{}{0pt}{}{n}{l+1}\right)-l!·D·\left(\genfrac{}{}{0pt}{}{n-1}{l}\right)\hfill \\ =\frac{(n-1)!}{(n-l-1)!}·\frac{n-(l+1)D}{l+1},\hfill \end{array}$$

(9)

where we use ${\sum }_{j=0}^n\left(\genfrac{}{}{0pt}{}{j}{m}\right)=\left(\genfrac{}{}{0pt}{}{n+1}{m+1}\right)$ for the third equality.

Using Equations (8) and (9) in Equation (7), we obtain

$${\displaystyle \sum _{n_1=1}^{n-(l+1)D}}{\displaystyle \sum _{n_2=n_1+1}^{n-lD}}\cdots {\displaystyle \sum _{n_{l+1}=n_l+1}^{n-D}}\frac{1}{\left(\genfrac{}{}{0pt}{}{n}{l+1}\right)}=1-\frac{l+1}{n}D.$$

Therefore, we prove that Equation (6) holds for $r=1,2,3,\cdots$ □.

Next, we derive $Q_k^{\left(j\right)}\left(n\right),(k\ge 1)$. We have the following theorem.

Theorem 2.

We have

$$\begin{array}{ccc}\hfill Q_k^{\left(j\right)}\left(n\right)& \hfill =& \left(\genfrac{}{}{0pt}{}{n}{k+\lfloor \frac{n}{D}\rfloor -j}\right)p^{k+\lfloor \frac{n}{D}\rfloor -j}{(1-p)}^{n-\left(k+\lfloor \frac{n}{D}\rfloor -j\right)}\hfill \\ & \hfill +& {\displaystyle \sum _{r=0}^{\lfloor \frac{n}{D}\rfloor -j-1}}{\displaystyle \sum _{m=0}^{\lfloor \frac{n}{D}\rfloor -j-1-r}}\left(\genfrac{}{}{0pt}{}{n-(r+1)D}{m}\right)p^m{(1-p)}^{n-(r+1)D-m}\hfill \\ & & \times \left(\frac{(k+r+1)-p-p\left[\right(r+1\left)D\right]}{(1-p)(k+r+1)}\right)\left(1-\frac{m}{\frac{n}{D}-r-1}\right)\left(\genfrac{}{}{0pt}{}{(r+1)D}{k+r}\right)p^{k+r}{(1-p)}^{(r+1)D-(k+r)}.\hfill \end{array}$$

(10)

Proof. 

Let us define $A^{last}$ and ${\tau }^{last}$ as the number of arrivals during the last busy period and the time slot at which the last busy period starts, respectively. We then have

$$\begin{array}{ccc}\hfill Q_k^{\left(j\right)}\left(n\right)& \hfill =& Pr[N\left(n\right)=k|N_0=j]\hfill \\ & \hfill =& Pr\left[N\left(n\right)=k,0\le {\tau }^{last}\le n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D|N_0=j\right]\hfill \\ & & +{\displaystyle \sum _{r=0}^{\lfloor \frac{n}{D}\rfloor -j-1}}Pr[N\left(n\right)=k,n-(r+1)D<{\tau }^{last}\le n-rD|N_0=j].\hfill \end{array}$$

(11)

To complete Equation (11), we first derive the first term in the second equality. We again note that the system starts with j customers, and the service time is a constant D. Therefore, if the last busy period starts before the $n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D$-th time slot, $\lfloor \frac{n}{D}\rfloor -j$ customers among newly arrived customers should be served during the last busy period. Then, to become $N\left(n\right)=k$ under this situation, $k+\lfloor \frac{n}{D}\rfloor -j$ customers should arrive in the system, and we have

$$\begin{array}{cc}\hfill Pr& \left[N\left(n\right)=k,0\le {\tau }^{last}\le n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D|N_0=j\right]\hfill \\ & =Pr\left[N\left(n\right)=k,0\le {\tau }^{last}\le n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j\right].\hfill \end{array}$$

(12)

Next, we have

$$\begin{array}{c}Pr\left[N\left(n\right)=k,0\le {\tau }^{last}\le n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j\right]\hfill \\ =Pr\left[N\left(n\right)=k,0\le {\tau }^{last}\le n,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j\right]\hfill \\ -Pr\left[N\left(n\right)=k,n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D<{\tau }^{last}\le n,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j\right]\hfill \\ =Pr\left[k\le N\left(n\right)\le k+\lfloor \frac{n}{D}\rfloor -j,0\le {\tau }^{last}\le n,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j\right]\hfill \\ -Pr\left[k+1\le N\left(n\right)\le k+\lfloor \frac{n}{D}\rfloor -j,0\le {\tau }^{last}\le n,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j\right]\hfill \\ -Pr\left[k\le N\left(n\right)\le k+\lfloor \frac{n}{D}\rfloor -j,n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D<{\tau }^{last}\le n,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j\right]\hfill \\ +Pr\left[k+1\le N\left(n\right)\le k+\lfloor \frac{n}{D}\rfloor -j,n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D<{\tau }^{last}\le n,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j\right]\hfill \\ =Pr\left[k\le N\left(n\right)\le k+\lfloor \frac{n}{D}\rfloor -j,0\le {\tau }^{last}\le n,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j\right]\hfill \\ -Pr\left[k\le N\left(n\right)\le k+\lfloor \frac{n}{D}\rfloor -j,n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D<{\tau }^{last}\le n,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j\right]\hfill \\ -Pr\left[k+1\le N\left(n\right)\le k+\lfloor \frac{n}{D}\rfloor -j,0\le {\tau }^{last}\le n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j\right].\hfill \end{array}$$

(13)

In Equation (13), we have

$$Pr\left[k+1\le N\left(n\right)\le k+\lfloor \frac{n}{D}\rfloor -j,0\le {\tau }^{last}\le n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j\right]=0$$

(14)

because $\lfloor \frac{n}{D}\rfloor -j$ customers among the newly arrived customers should be served during the last busy period, if the busy period starts in the time interval $\left[0,n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D\right]$.

Furthermore, we note that

$$\begin{array}{c}\hfill Pr[N\left(n\right)=k,n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D<{\tau }^{last}\le n,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j]=0.\end{array}$$

(15)

We then have

$$\begin{array}{c}Pr\left[N\left(n\right)=k,0\le {\tau }^{last}\le n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j\right]\hfill \\ =Pr\left[k\le N\left(n\right)\le k+\lfloor \frac{n}{D}\rfloor -j,0\le {\tau }^{last}\le n,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j\right]\hfill \\ -Pr\left[k+1\le N\left(n\right)\le k+\lfloor \frac{n}{D}\rfloor -j,n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D<{\tau }^{last}\le n,A^{last}=k+\lfloor \frac{n}{D}\rfloor -j|N_0=j\right]\hfill \\ =\left(\genfrac{}{}{0pt}{}{n}{k+\lfloor \frac{n}{D}\rfloor -j}\right)·p^{k+\lfloor \frac{n}{D}\rfloor -j}·{(1-p)}^{n-\left(k+\lfloor \frac{n}{D}\rfloor -j\right)}\hfill \\ -Q_0^{\left(j\right)}\left[n-\left(\lfloor \frac{n}{D}\rfloor -j\right)D\right]·\left(\genfrac{}{}{0pt}{}{(\lfloor \frac{n}{D}\rfloor -j)D}{k+\lfloor \frac{n}{D}\rfloor -j}\right)·p^{k+\lfloor \frac{n}{D}\rfloor -j}·{(1-p)}^{(\lfloor \frac{n}{D}\rfloor -j)D-(k+\lfloor \frac{n}{D}\rfloor -j)}.\hfill \end{array}$$

(16)

Next, we need to derive $Pr[N\left(n\right)=k,n-(r+1)D<{\tau }^{last}\le n-rD|N_0=j],(0\le r\le \lfloor \frac{n}{D}\rfloor -j-1)$ in Equation (11). When $r=0$, it is not difficult to have

$$\begin{array}{c}\hfill Pr[N\left(n\right)=k,n-D<{\tau }^{last}\le n|N_0=j]=Q_0^{\left(j\right)}\left(n-D\right)\left[\left(\genfrac{}{}{0pt}{}{D}{k}\right)·p^k·{(1-p)}^{D-k}\right]\end{array}$$

(17)

because no service can be completed during the time interval $(n-D,n]$.

In Equation (17), we assume that $\left(\genfrac{}{}{0pt}{}{D}{k}\right)=0$, if $k>D$. Next, we consider the case with $1\le r\le \lfloor \frac{n}{D}\rfloor -j-1$. Applying a similar approach used in Equations (12)–(16), we have

$$\begin{array}{c}Pr[N\left(n\right)=k,n-(r+1)D<{\tau }^{last}\le n-rD|N_0=j]\hfill \\ =Pr\left[N\left(n\right)=k,n-(r+1)D<{\tau }^{last}\le n-rD,A^{last}=k+r|N_0=j\right]\hfill \\ =Pr\left[k\le N\left(n\right)\le k+r,n-(r+1)D<{\tau }^{last}\le n,A^{last}=k+r|N_0=j\right]\hfill \\ -Pr\left[k+1\le N\left(n\right)\le k+r,n-rD<{\tau }^{last}\le n,A^{last}=k+r|N_0=j\right]\hfill \\ =Q_0^{\left(j\right)}(n-(r+1)D)·\left(\genfrac{}{}{0pt}{}{(r+1)D}{k+r}\right)·p^{k+r}·{(1-p)}^{(r+1)D-(k+r)}\hfill \\ -Q_0^{\left(j\right)}(n-rD)·\left(\genfrac{}{}{0pt}{}{rD}{k+r}\right)·p^{k+r}·{(1-p)}^{rD-(k+r)},\left(1\le r\le \lfloor \frac{n}{D}\rfloor -j-1\right).\hfill \end{array}$$

(18)

Using Equations (12) and (16)–(18) in Equation (11), we can obtain the simplified form as

$$\begin{array}{cc}\hfill Q_k^{\left(j\right)}\left(n\right)=& \left(\genfrac{}{}{0pt}{}{n}{k+\lfloor \frac{n}{D}\rfloor -j}\right)·p^{k+\lfloor \frac{n}{D}\rfloor -j}·{(1-p)}^{n-\left(k+\lfloor \frac{n}{D}\rfloor -j\right)}\hfill \\ & +{\displaystyle \sum _{r=0}^{\lfloor \frac{n}{D}\rfloor -j-1}}{Q}_0^{\left(j\right)}(n-(r+1)D)·\left(\genfrac{}{}{0pt}{}{(r+1)D}{k+r}\right)·p^{k+r}·{(1-p)}^{(r+1)D-(k+r)}\hfill \\ & -{\displaystyle \sum _{r=0}^{\lfloor \frac{n}{D}\rfloor -j-1}}{Q}_0^{\left(j\right)}(n-(r+1)D)·\left(\genfrac{}{}{0pt}{}{(r+1)D}{k+r+1}\right)·p^{k+r+1}·{(1-p)}^{(r+1)D-(k+r+1)}.\hfill \end{array}$$

(19)

From Equation (1), we have

$$\begin{array}{cc}\hfill Q_0^{\left(j\right)}\left[(n-(r+1)D)\right]& ={\displaystyle \sum _{m=0}^{\lfloor \frac{n}{D}\rfloor -(r+1)-j}}\left(\genfrac{}{}{0pt}{}{n-(r+1)D}{m}\right)p^m{(1-p)}^{n-(r+1)D-m}\left(1-\frac{mD}{n-(r+1)D}\right).\hfill \end{array}$$

(20)

Then, using the above equation in Equation (19), we have

$$\begin{array}{c}{Q}_k^{\left(j\right)}\left(n\right)\hfill \\ =\left(\genfrac{}{}{0pt}{}{n}{k+\lfloor \frac{n}{D}\rfloor -j}\right)p^{k+\lfloor \frac{n}{D}\rfloor -j}{(1-p)}^{n-\left(k+\lfloor \frac{n}{D}\rfloor -j\right)}\hfill \\ +{\displaystyle \sum _{r=0}^{\lfloor \frac{n}{D}\rfloor -j-1}}{\displaystyle \sum _{m=0}^{\lfloor \frac{n}{D}\rfloor -j-1-r}}\left(\genfrac{}{}{0pt}{}{n-(r+1)D}{m}\right)\left(\genfrac{}{}{0pt}{}{(r+1)D}{k+r}\right)\left(1-\frac{m}{\frac{n}{D}-r-1}\right)p^{m+k+r}{(1-p)}^{n-(m+k+r)}\hfill \\ -{\displaystyle \sum _{r=0}^{\lfloor \frac{n}{D}\rfloor -j-1}}{\displaystyle \sum _{m=0}^{\lfloor \frac{n}{D}\rfloor -j-1-r}}\left(\genfrac{}{}{0pt}{}{n-(r+1)D}{m}\right)\left(\genfrac{}{}{0pt}{}{(r+1)D}{k+r+1}\right)\left(1-\frac{m}{\frac{n}{D}-r-1}\right)p^{m+k+r+1}{(1-p)}^{n-(m+k+r+1)}.\hfill \end{array}$$

(21)

We then have the following simplified form:

$$\begin{array}{cc}\hfill Q_k^{\left(j\right)}\left(n\right)=& \left(\genfrac{}{}{0pt}{}{n}{k+\lfloor \frac{n}{D}\rfloor -j}\right)p^{k+\lfloor \frac{n}{D}\rfloor -j}{(1-p)}^{n-\left(k+\lfloor \frac{n}{D}\rfloor -j\right)}\hfill \\ & +{\displaystyle \sum _{r=0}^{\lfloor \frac{n}{D}\rfloor -j-1}}{\displaystyle \sum _{m=0}^{\lfloor \frac{n}{D}\rfloor -j-1-r}}\left(\genfrac{}{}{0pt}{}{n-(r+1)D}{m}\right)p^m{(1-p)}^{n-(r+1)D-m}\hfill \\ & \times \left(\genfrac{}{}{0pt}{}{(r+1)D}{k+r}\right)p^{k+r}{(1-p)}^{(r+1)D-(k+r)}\left(1-\frac{m}{\frac{n}{D}-r-1}\right)\hfill \\ & -{\displaystyle \sum _{r=0}^{\lfloor \frac{n}{D}\rfloor -j-1}}{\displaystyle \sum _{m=0}^{\lfloor \frac{n}{D}\rfloor -j-1-r}}\left(\genfrac{}{}{0pt}{}{n-(r+1)D}{m}\right)p^m{(1-p)}^{n-(r+1)D-m}\hfill \\ & \times \left(\genfrac{}{}{0pt}{}{(r+1)D}{k+r}\right)p^{k+r}{(1-p)}^{(r+1)D-(k+r)}\left(1-\frac{m}{\frac{n}{D}-r-1}\right)\frac{p\left[\right(r+1)D-(k+r\left)\right]}{(1-p)(k+r+1)}.\hfill \end{array}$$

(22)

Using algebra, we can now obtain Equation (10) to complete the proof. □

3. Numerical Examples

In this section, we show the numerical results. We use Equations (1) and (10) to compute the transient probabilities $Q_0^{\left(2\right)}\left(n\right)$, $Q_1^{\left(2\right)}\left(n\right)$, $Q_2^{\left(2\right)}\left(n\right)$ and $Q_3^{\left(2\right)}\left(n\right)$. Figure 1 shows the computation results of the probabilities.

Figure 1a shows the transient probabilities under the condition that $p=1/6$ and $D=3$ (i.e., $\rho =0.5$). Let $P_n$ be the stationary probability of the $Geo/D/1$ queue. If $\rho <1$, we can use the result in Gravey et al. [19] to compute the stationary probability and obtain $P_0=0.5$, $P_1=0.364$, $P_2=0.11059$, and $P_3=0.02107$. Then, in Figure 1a, we can confirm that each transient queue-length probability converges to the stationary value. Figure 1b shows the transient probabilities under the condition that $p=4/6$ and $D=3$ (i.e., $\rho =2$). When $\rho >1$, all the probabilities should be 0 as n increases; we can confirm this in Figure 1b.