Next Article in Journal
Towards an Inertial Sensor-Based Wearable Feedback System for Patients after Total Hip Arthroplasty: Validity and Applicability for Gait Classification with Gait Kinematics-Based Features
Previous Article in Journal
Detection of Tennis Activities with Wearable Sensors
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Distributed Rate-Control and Delay-Guaranteed Scheduling in MR-MC Wireless Mesh Networks

School of Electrical and Electronic Engineering, North China Electrical Power University, Beijing 102206, China
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(22), 5005; https://doi.org/10.3390/s19225005
Submission received: 15 October 2019 / Revised: 11 November 2019 / Accepted: 15 November 2019 / Published: 16 November 2019
(This article belongs to the Section Internet of Things)

Abstract

:
Wireless mesh networks (WMNs) can provide flexible wireless connections in smart city, Internet of Things (IoT), and device-to-device (D2D) communications. The performance of WMNs can be greatly enhanced by adopting the multi-radio multi-channel (MR-MC) technique, which enables a node to communicate with more nodes simultaneously. However, increasing the number of data flows will result in network congestion and longer end-to-end delays. In this paper, a distributed rate-control and delay-aware (DRDA) scheduling algorithm is proposed based on a multidimensional conflict graph. To satisfy the arrival rate and delay constraints of a flow, two virtual queues are constructed. All the actual and virtual queues are stabilized by the Lyapunov drift optimization method. The scheduling policy of each flow is optimized only based on the local information. The simulation results show that our proposed algorithm can maintain the stability of all the queues and strictly satisfy the arrival rate and delay constraint of each flow in the network as well.

1. Introduction

By increasing the dimensions of the radio interfaces and channels of a node, the multi-radio multi-channel (MR-MC) technique can significantly improve the capacity of wireless mesh networks (WMNs) [1,2,3,4,5]. MR-MC WMNs constitute an attractive complementary or even standalone solution for vehicle-to-vehicle (V2V), device-to-device (D2D), and unmanned aerial vehicle (UAV) communications to provide access to rural areas with little wired infrastructure or to enhance connectivity in highly dense metropolitan areas [6,7,8,9,10,11].
The problem of minimizing congestion and end-to-end delay in traffic scheduling, which is of fundamental importance for achieving superior performance while maintaining network connectivity, has attracted much attention recently [12,13]. Many scheduling algorithms have been proposed for single-radio single-channel (SR-SC) networks. A max-weight-based scheduling algorithm was proposed in [14], where the stability of the queue length was transformed into a convex optimization problem with the objective being to maximize the average throughput. The epidemic theory and truthful mechanism were adopted in scheduling algorithms to satisfy the delay constraint in [15,16], respectively. A scheduling algorithm based on the physical-ratio-K (PRK) interference model was proposed in [17], where the controllers identify the interference parameter in the PRK model as a minimum-variance regulation control problem and adapt its PRK model parameters to guarantee the link reliability desired. There are some works applying the back-pressure method to schedule flows for data transmission [18,19]. Scheduling based on the back-pressure algorithm is equivalent to solving the problem of a maximum weighted independent set (MWIS), which has been proven to be NP-hard. Several suboptimal scheduling algorithms have been proposed to approximate throughput optimality with low computation complexity [20,21,22,23]. A popular algorithm is greedy maximal scheduling (also known as the longest-queue-first policy), which is based on the greedy MWIS algorithm, in [20]. The Lyapunov-based approach is a novel method for optimizing a queue scheduling algorithm [24,25,26]. The throughput and reliability of a network with delay constraints were optimized through the Lyapunov method in [27,28], respectively. In [29], a Lyapunov-based buffer management strategy was designed to allocate the buffer recourses at each queue with video streaming.
Since centralized scheduling policies are not favored in large-scale sensor networks, especially those networks with some mobile and multi-hop nodes [30], distributed scheduling policies have been studied in the open literature. The authors of [31] studied the tradeoff between centralized and distributed approaches by way of the channel state information (CSI), and the point at which distributed scheduling outperforms centralized scheduling was characterized. Distributed graph routing and autonomous scheduling (DiGS) was proposed in [32], where the devices can compute their own transmission schedules autonomously based on the graph routes. Due to the scheduling conflicts among different types of traffic being eliminated by the graph routes, DiGS can provide short end-to-end latency. In [33], a local voting scheduling algorithm was proposed in which the load was defined as the ratio of the queue length to the number of allocated slots. All the loads were semi-equalized through slot reallocation based on local information exchange. The interference in a multi-hop network is more severe than that in a regular one due to the simultaneously transmitting links in the network. There are some scheduling algorithms which exploit a physical layer model to optimize the network throughput, for example, [34] presented a class of localized scheduling algorithms with a provable throughput guarantee subject to physical interference constraints, while [35,36] optimized distributed link scheduling under the signal to interference plus noise ratio (SINR) model.
In MR-MC networks, with significantly increased network dimension, link scheduling is often coupled with radio/channel assignment. There have been only a few studies on designing and analyzing the performance of distributed scheduling policies in MR-MC networks [2]. In [37], a distributed maximal scheduling policy was applied in MR-MC networks based on link–channel pairs (LCPs), where a physical link was split into several LCPs, with each LCP maintaining a queue to be considered in the maximal scheduling. A systematic approach that transforms an MR-MC network into an equivalent virtual SR-SC network through a tuple-based multidimensional conflict graph (MDCG) was proposed in [2]. Furthermore, cross-layer framework distributed scheduling and delay-aware routing based on an MDCG in multi-hop MR-MC networks was proposed in [38]. However, the distributed scheduling algorithm in [38] only considers the rate control of each node, which neglects the optimization of the scheduling decisions for multiple flows in each node.
Different from the aforementioned algorithms, we not only incorporate novel virtual queue structures to share the burden of actual packet queue backlogs through the virtual queues in an attempt to guarantee the delay performance and finite buffer sizes, but we also construct a scheduling controller to decide which flow needs to be scheduled at this moment, and the transmission rate of this flow is also calculated in a distributed way. The Lyapunov optimization method is adopted to maximize the data rate of the source node with an end-to-end delay constraint, actual queue backlogs, interference from neighbor links, and any other network limitations. The main contributions of this paper are summarized as follows:
  • A distributed rate-control and delay-guaranteed scheduling algorithm for MR-MC WMNs is proposed. The scheduling policy and scheduling rate of a link are optimized in a distributed way.
  • Two virtual queues are constructed to satisfy the data rate and delay constraint, respectively. The Lyapunov drift optimization method is adopted to maintain the queue stability and maximize the data rates of all the flows given the limitations in the MR-MC WMNs.
  • A weighted scheduling metric is designed which is only based on the local information. The transmission rates of the scheduled flows for each link can also be calculated in a distributed way.
The remainder of this paper is organized as follows. The system model based on an MDCG and the queue models are developed in Section 2. In Section 3, we introduce the Lyapunov drift optimization algorithm and analyze its performance. The distributed rate-control and delay-guaranteed scheduling algorithm is proposed in Section 4, and simulation results are given in Section 5. Section 6 concludes the article.

2. System Model

2.1. A Tuple-Based Link Model of MR-MC Networks

We consider an MR-MC multi-hop WMN as an undirected graph G p ( N , p ) where the sets of nodes and physical links are denoted by N and p , respectively. Each node n N is equipped with a set of radio interfaces r n , each of which can operate on a set of orthogonal channels e . Define tuple p n = ( n , r n , e r n ) as a vertex in the multidimensional conflict graph, which indicates that the radio interface r n r n of node n N operates on channel e r n e . Let the tuple-link l = ( p m , p n ) = ( ( n , r n , e l ) , ( m , r m , e l ) ) represent the transmission from interface r n of node n to interface r m of node m . Two radio interfaces can communicate with each other if, and only if, they work on the same channel, i.e., e l = e r n = e r m . Assuming that T and are the sets of tuples and tuple-links, respectively, then the whole network can be mapped as a tuple-based graph G ( T , ) . For convenience, the terms “tuple-link” and “link” are used interchangeably in this paper. Referring to the protocol interference model in [39], making the assumption that the interference range is equal to the communication range, collision occurs when two links share the same radios at the sending or receiving node or when the two links are within communication range of each other and with the same channel. For each link l , we define I l as the set of all interference links of l .
In this work, we study the multicommodity flow problem in which a set of flows F is injected into the network. The minimum arrival rate required for flow c F is denoted a c . We denote the source node that generates flow c by s ( c ) , s ( c ) N . Every node in the network is equipped with two or three radios, and more than three orthogonal channels are available in the network. The nodes choose channels and the next hop according to a certain channel assignment and routing algorithm, which is not the focus here and can be found in [40]. Taking the simple network shown in Figure 1 as an example, the source node s generates two commodity flows c 1 , c 2 F , each of which has a different destination node, d 1 and d 2 , respectively. The flows may go by way of multiple hops to reach the destination, so our goal is to design a proper scheduling policy for each node to deliver the packets to their corresponding destinations at the maximal throughput rate with an end-to-end delay limitation. The key notation in this paper is summarized in Table 1. E { · } and | · | are the expectation and absolute value, respectively. The operator [ x ] + is defined as [ x ] + = max { x , 0 } .

2.2. Queue Model

In this system, we consider the queue model which contains two types of queues, namely, actual queues and virtual queues. As shown in Figure 2, each link contains two actual queues; one is the input queue for incoming packets, and the other is the output queue for departing packets. We define Q l c ( t ) as the queue backlog of link l with flow c at time t. Q i n , l c ( t ) and Q o u t , l c ( t ) represent the backlogs of the input and output queues for link l with flow c at time t, respectively. The relationship of Q l c ( t ) , Q i n , l c ( t ) , and Q o u t , l c ( t ) can be expressed as
Q l c ( t ) = Q i n , l c ( t ) + Q o u t , l c ( t ) , c F , l c ,
where Q l c ( t ) can be calculated as
Q l c ( t + 1 ) = [ Q l c ( t ) D l c ( t ) ] + + D l 1 c ( t ) , c F , l c , l l s ( c ) ,
where the terms D l c ( t ) and D l 1 c ( t ) represent the scheduling policies of links l and ( l 1 ) of flow c , respectively, with l , ( l 1 ) c . The scheduling policy of each link is calculated by the scheduling controller in each node, which consists of two parts. One part is to determine which flow should be scheduled, and the other is to determine the scheduling rate of the flow scheduled. The scheduling policy D l c ( t ) is expressed as
D l c ( t ) = δ l c ( t ) μ l c ( t ) , c F , l c
where δ l c ( t ) represents the scheduling decision of link l with flow c , and δ l c ( t ) = 1 indicates that link l with flow c will be scheduled in the next time period, while δ l c ( t ) = 0 indicates that link l with flow c will not be scheduled. μ l c ( t ) denotes the scheduling rate of link l with flow c . The values of δ l c ( t ) and μ l c ( t ) are calculated by the scheduling controller in a distributed way, which will be discussed in Section 4.
The queue model of the source link is different from that of other links because its data input rate R c ( t ) is a virtual rate of flow c . Let s ( c ) denote the source node with flow c . l s ( c ) is the source (first) link of flow c . The queue backlog of source link l s ( c ) can be calculated by
Q l s ( c ) c ( t + 1 ) = [ Q l s ( c ) c ( t ) D l s ( c ) c ( t ) ] + + R c ( t ) , c F , l s ( c ) c
where D l s ( c ) c ( t ) is the scheduling policy of source link l s ( c ) .
Now we construct two virtual queues, namely, the virtual service queue X c ( t ) at the source node and the virtual delay queue Y c ( t ) for all the links of flow c . To satisfy the minimum arrival data rate requirement from the transport layer, the virtual queue X c ( t ) is constructed as
X c ( t + 1 ) = [ X c ( t ) R c ( t ) ] + + a c ( t ) , c F
where a c ( t ) is the minimum arrival rate of flow c . To satisfy the delay requirements of flow c , the virtual queue Y c ( t ) is constructed as
Y c ( t + 1 ) = [ Y c ( t ) ρ c R c ( t ) ] + + l c Q l c ( t ) , c F
where ρ c is the maximum delay constraint of flow c , ρ c R c ( t ) is the virtual backlogged packet queue length limitation, and l c Q l c ( t ) denotes the sum of all packets backlogged in the actual queues.

2.3. Network Constraints

First, the network remains stable when the backlog of all the queues is less than some finite value [39], which is set as the buffer size constraint q M . This constraint can be formulated as
lim sup T 1 T t = 0 T 1 E { Q l c ( t ) } < q M , c F , l c ,
lim sup T 1 T t = 0 T 1 E { X c ( t ) } < q M , c F ,
lim sup T 1 T t = 0 T 1 E { Y c ( t ) } < q M , c F .
Second, to maintain the stability of the actual queues, the packet delivery rate of link l should always be larger than that of link l 1 . We set a sufficiently small metric ε l c ; when flow c is scheduled at link l , its scheduling rate must satisfy the following constraint:
μ l c ( t ) μ l 1 c ( t ) ε l c , c F , l , ( l 1 ) c .
When l = l s ( c ) , Equation (10) can be transformed into
μ l s ( c ) c ( t ) R c ( t ) ε l s ( c ) c , c F , l s ( c ) c .
The value of R c ( t ) is constrained by the virtual queue X c ( t ) . To maintain the stability of X c ( t ) , the service rate R c ( t ) must be bigger than the arrival rate a c ( t ) . Thus, the limitation of the service rate is 0 a c ( t ) R c ( t ) μ 0 , where μ 0 is the maximum throughput rate for the source node.
Third, the scheduling policy of a link is constrained by its interference links, as we mentioned in the link model. All the links working on the same channel in the same area share the capacity of the physical channel [40], which can be expressed as
D l c ( t ) + l I l D l = Γ l , c F , l c
where Γ l is the capacity of the physical channel on which the links l and l operate. To ensure the scheduling rate of link l , the summed rates of all the interference links should be less than a constant threshold σ :
l I l D l σ , c F , l c .
Finally, according to Little’s Theorem, the average end-to-end delay of flow c can be expressed as
τ c = lim sup T 1 T t = 0 T 1 E { Q l c ( t ) } lim sup T 1 T t = 0 T 1 E { R c ( t ) } , c F , l c ,
and τ c should be no more than the delay threshold ρ c , i.e., τ c ρ c .

3. Problem Formulation and Lyapunov Drift Optimization

The objective of this paper is to maximize the capacity of the MR-MC WMNs and to ensure the stability of the network while satisfying the constraints of transmission rate, end-to-end delay, and interference issues. The whole problem is formulated as follows:
max lim T 1 T t = 0 T 1 c F R c ( t )
subject to
0 a c ( t ) R c ( t ) μ 0 μ l c ( t ) , c F , l c
μ l c ( t ) μ l 1 c ( t ) ε l c , c F , l c
l I l D l σ , c F , l c
τ c ρ c , c F
q M 0
where the objective function expressed in (15) is to maximize the average service rate of each flow at the source node. Constraint (15a) illustrates the relationship between the arrival rate from the transport layer, the service rate at the source node, the scheduling rate of the source node, and the scheduling rate of any link l belonging to the routing path of flow c ; (15b) is the scheduling rate constraint of two adjacent links to ensure the stability of each actual queue; (15c) limits the rate of the interference links to guarantee that the current link possesses enough physical channel capacity; and (15d) is the end-to-end delay constraint to satisfy the delay requirements of each flow.
As shown in the queue model in Section 2, all the constraints mentioned above can be transformed into a queue stability problem for all the actual and virtual queues. Let G ( t ) = { Q l c ( t ) , Q l s ( c ) c ( t ) , X c ( t ) , Y c ( t ) } denote the concatenated queue backlog of the network. As q M and μ 0 are the crucial metrics for the queue stability, we construct the Lyapunov function as
L ( G ( t ) ) = 1 2 { c F q M μ 0 q M Q l s ( c ) c ( t ) 2 + c F X c ( t ) 2 + c F l c Y c ( t ) 2 + c F l c Q l s ( c ) c ( t ) q M Q l c ( t ) 2 } .
Without loss of generality, we assume that all the queues are empty when t = 0 , such that L ( G ( 0 ) ) = 0 . The conditional Lyapunov drift Δ ( G ( t ) ) is defined as
Δ ( G ( t ) ) = E { L ( G ( t + 1 ) ) L ( G ( t ) ) | G ( t ) } .
By employing Equations (2), (4), (5), and (6), we obtain
Δ ( G ( t ) ) = 1 2 E { c F q M μ 0 q M ( Q l s ( c ) c ( t + 1 ) 2 Q l s ( c ) c ( t ) 2 ) + c F ( X c ( t + 1 ) 2 X c ( t ) 2 ) + c F l c ( Y c ( t + 1 ) 2 Y c ( t ) 2 ) + c F l c ( Q l s ( c ) c ( t + 1 ) q M Q l c ( t + 1 ) 2 ) c F l c ( Q l s ( c ) c ( t ) q M Q l c ( t ) 2 ) | G ( t ) } .
Subtracting (15) from (18), the drift-minus-reward term Δ G is obtained as follows:
Δ G = Δ ( G ( t ) ) V c F E { R c ( t ) | G ( t ) }
where V is a nonnegative tunable parameter. For any nonnegative values of x , y , and z , ( [ x y ] + + Z ) 2 x 2 + y 2 + z 2 2 x ( y z ) holds [10]. Thus, we obtain the drift-minus-reward Δ G as
Δ G = 1 2 E { c F q M μ 0 q M ( D l s ( c ) c ( t ) 2 + R c ( t ) 2 Q l s ( c ) c ( t ) D l s ( c ) c ( t ) + 2 Q l s ( c ) c ( t ) R c ( t ) ) + c F ( R c ( t ) 2 + a c 2 2 X c ( t ) R c ( t ) 2 X c ( t ) a c ) + c F l c ( ρ c 2 R c ( t ) 2 + l c Q l c ( t ) 2 2 Y c ( t ) ρ c R c ( t ) + 2 Y c ( t ) l c Q l c ( t ) ) + c F l ( Q l s ( c ) c ( t ) + R c ( t ) q M Q l c ( t + 1 ) 2 ) c F l c ( Q l s ( c ) c ( t ) q M Q l c ( t ) 2 ) | G ( t ) }
Δ G B + E { c F R c ( t ) ( ( q M μ 0 ) Q l s ( c ) c ( t ) q M Y c ( t ) ρ c ( t ) X c ( t ) V | G ( t ) ) } + c F X c ( t ) a c + | L c | q M c F Y c ( t ) + 1 2 c F ( 2 | L c | 1 + μ 0 2 ) q M Q l s ( c ) c ( t ) E { c F ( q M μ 0 ) q M Q l s ( c ) c ( t ) D l s ( c ) c ( t ) + c F l c Q l s ( c ) c ( t ) Q l c ( t ) q M ( D l c ( t ) D l 1 c ( t ) ) | G ( t ) }
where | c | is the number of hop counts of flow c , and | F | is the number of all flows. B is a positive constant constrained by the following equation:
B 1 2 | c | | F | q M μ 0 + | F | q M μ 0 q M μ 0 2 + 1 2 μ 0 2 c F ρ c 2 + 1 2 | F | | c | 2 q M 2 + 1 2 | F | μ 0 2 + 1 2 | F | a c 2 .
The last term of the right-hand side (RHS) in (20) can be rewritten by simple algebra as in [38].
E { c F ( q M μ 0 ) q M Q l s ( c ) c ( t ) D l s ( c ) c ( t ) + c F l c D l c ( t ) Q l s ( c ) c ( t ) q M ( D l 1 c ( t ) D l c ( t ) ) + c F D l s ( c ) c ( t ) Q l s ( c ) c ( t ) q M ( q M μ 0 Q l s ( c ) c ( t ) ) | G ( t ) }
The second term of the RHS in (21) is maximized by the service rate R c ( t ) . The last term of the RHS in (21) is optimized by the transmission rate μ l c ( t ) , while (23) is optimized by the scheduling policy D l c ( t ) . Thus, the original stochastic optimization problem in (15) can be transformed into a series of successive instantaneous static optimization problems.

4. The Distributed Rate-Control and Delay-Aware Scheduling Algorithm

Now we propose a distributed rate-control and delay-aware scheduling algorithm (DRDA) for the MR-MC multi-hop WMNs with multicommodity flows which can stabilize the network while satisfying the arrival data rate and delay constraints of each flow. The scheduling policy of a flow in the scheduling controller is calculated by the DRDA algorithm, which consists of two parts: scheduling decision and rate control.

4.1. Scheduling Decision

The scheduling decision δ l c ( t ) of link l with flow c can be calculated as
δ l c ( t ) { 1 , c = c * 0 , o t h e r w i s e
c * = arg   max c F ω l c ( t ) , c , c * F , l c
where ω l c ( t ) is the flow weighted metric which is calculated as follows.
ω l c ( t ) { Q l s ( c ) c ( t ) q M ( D l 1 c ( t ) D l c ( t ) ) , c F , l c , l l s ( c ) Q l s ( c ) c ( t ) q M ( q M μ 0 Q l s ( c ) c ( t ) ) , c F , l c , l = l s ( c )
Parameter ω l c ( t ) is calculated in the scheduling controller in turn by (26) based only on local information. The flow with the largest weight will be selected as the candidate flow c * for scheduling.

4.2. Rate Control

According to the second and last terms of the RHS in (21), the rate control can be divided into the service rate control at the source node of flow c and the scheduling rate control of each link of flow c. The optimization problem of service rate R c ( t ) is expressed as
min a c R c ( t ) μ 0 ( t ) R c ( t ) ( ( q M μ 0 ) Q l s ( c ) c ( t ) q M X c ( t ) Y c ( t ) ρ c V ) , c F , l , l s ( c ) c .
The corresponding solution is
R c ( t ) { μ 0 ( t ) , ( ( q M μ 0 ) Q l s ( c ) c ( t ) q M X c ( t ) Y c ( t ) ρ c V ) < 0 a c ( t ) , o t h e r w i s e
where V > 0 is a control parameter. It can be easily observed from (28) that when V is sufficiently large, the optimal value of R c ( t ) is μ 0 ( t ) ; when V is small, the optimal value of R c ( t ) is a c ( t ) .
The optimal scheduling rate μ l c ( t ) of each link can be obtained by solving a maximization problem with the link rate constraints which were illustrated in Section 2. The new problem is expressed as
max D l s ( c ) c ( t ) , D l c ( t ) ( c F ( q M μ 0 ) q M Q l s ( c ) c ( t ) D l s ( c ) c ( t ) + c F l c Q l s ( c ) c ( t ) Q l c ( t ) q M ( D l c ( t ) D l 1 c ( t ) ) )
subject to
μ l c ( t ) μ l 1 c ( t ) ε l c , c F , l , ( l 1 ) c
μ l s ( c ) c ( t ) R c ( t ) ε l s ( c ) c , c F , l s ( c ) c
ε min ε l c ( t ) , ε l s ( c ) c ( t ) ε max , c F , l , l s ( c ) c
D l c ( t ) + l I l D l = Γ l , c F , l c
l I l D l σ , c F , l c
where ε min should be sufficiently small and ε max is a global value which will be discussed later. We assume that for all the scheduling policies δ l c ( t ) = 1 ; then problem (29) can be transformed into
max D l s ( c ) c ( t ) , D l c ( t ) ( c F ( q M μ 0 ) q M Q l s ( c ) c ( t ) D l s ( c ) c ( t ) + c F l c Q l s ( c ) c ( t ) Q l c ( t ) q M ( D l c ( t ) D l 1 c ( t ) ) )
subject to
(29a)-(29c) hold
μ l c ( t ) + l I l μ l = Γ l , c F , l c
l I l μ l σ , c F , l c .
The constraints (30a) and (30b) can only be satisfied in a centralized way, which is inefficient for MR-MC multi-hop WMNs with multicommodity flows. Therefore, we transform the centralized conditions to distributed ones. Assuming that R c ( t ) is equal to its optimal solution μ 0 , then μ l c ( t ) can be rewritten as
μ l c ( t ) = μ l s ( c ) c ( t ) + l * : h l * [ 1 , h l ] ε l * = μ 0 + ε l s ( c ) c ( t ) + l * : h l * [ 1 , h l ] ε l * μ 0 + h l ε max .
For each interference link, we have
μ l c ( t ) μ 0 + h l ε max , c F , l I l , l c .
In the following, we introduce a distributed rate control Algorithm 1 to get the global value ε max and the optimal scheduling rate μ l c ( t ) . The specific steps are as follows:
Step 1: After the routing detection, every node can get the information of the channel strategy and interference from neighbor nodes in a distributed way. When the flow traverses link l , all the local information is sent to the source node and ε max c can be calculated locally according to (31) and (32).
Step 2: The minimum-consensus algorithm [37] is used to iteratively calculate the value of ε max in a distributed way through all the ε max c of the source nodes. In each iteration, every source node broadcasts its ε max c to its immediate neighbors, then compares the received ε max c from other nodes with its own ε max c value and updates ε max c to the smaller one. Other non-source nodes only need to forward the smallest received ε max c to their neighbors. The algorithm will finally achieve global convergence when ε max is equal to the smallest ε max c of all the source nodes.
Step 3: After getting ε max , the source nodes of each flow use (30b) to calculate the scheduling rate μ l c ( t ) of each link included in the flow’s routing path and then transmit them along each hop to the corresponding links.
Algorithm 1: Distributed Rate Control
1: Each node gets its channel strategy and interference nodes through routing detection.
2: for c = 1 | F |
3:  for n = 1 | N c |
4:    Send local information to its source node;
5:  end
6:   Calculate ε max c in the source node;
7: end
8: Update ε max c through minimum-consensus algorithm.
9: for c = 1 | F |
10:   Calculate μ l c ( t ) ;
11:   Send μ l c ( t ) to each node;
12: end
Theorem 1.
Given that ρ c | | q M r c , ξ * and q M 2 | | 1 + μ 0 2 2 ξ + μ 0 , the DRDA algorithm can achieve a time average throughput of
lim   inf t 1 t τ = 0 t 1 c F E { R c ( t ) } c F r c , δ * B V
B = | F | q M μ 0 q M μ 0 2 + 1 2 ( | c | | F | q M + μ 0 μ 0 2 c F ρ c 2 + | F | | c | 2 q M 2 + | F | μ 0 2 + | F | a c 2 ) .
In addition, DRDA ensures an upper bound of the virtual queue backlogs of
lim   inf t 1 t τ = 0 t 1 c F E { Q l s ( c ) c ( τ ) + X c ( τ ) + Y c ( τ ) } B + V K μ 0 θ .
Proof of Theorem 1.
Before the proof, we introduce some auxiliary variables. We define Λ as the capacity region consisting of all the available service rates R c ( t ) . Let r c represent the time-average value of R c ( t ) and let r c * Λ be the optimal solution of the following optimization problem:
max r c : ( r c + ξ ) Λ c F r c , c F
where r c should satisfy r c + ξ Λ , and ξ is a positive number that can be chosen to be arbitrarily small. Define r c , ξ * = r c * + ξ and r c , 2 ξ * = r c * + 2 ξ , which satisfies r c , ξ * , r c , 2 ξ * Λ . When ξ 0 , we have
lim ξ 0 c F r c , ξ * = c F r c * , c F .
By substituting r c , ξ * and r c , 2 ξ * into the second term and the last term of RHS of (21), respectively, the drift-minus-reward Δ G can be rewritten as
Δ G = Δ ( t ) V c F E { R c ( t ) | G ( t ) } B V c F r c , ξ * c F Q l s ( c ) c q M ( ξ ( q M μ 0 ) ( 2 | c | 1 + μ 0 2 ) 2 ) c F ( r c , ξ * a c ) X c ( t ) c F ( ρ c r c , ξ * | c | q M ) Y c ( t ) .
We define ξ 1 , ξ 2 , and ξ 3 satisfying 0 < ξ 1 ρ c r c , ξ * | | q M , 0 < ξ 2 ( ξ ( q M μ 0 ) | | + 1 2 μ 0 2 2 ) / q M , and 0 ξ 3 r c , ξ * a c . We can find ξ = min { ξ 1 , ξ 2 , ξ 3 } such that
Δ ( t ) V c F E { R c ( t ) | G ( t ) } B ξ c F ( Q l s ( c ) c ( t ) + X c ( t ) + Y c ( t ) ) V c F r c , ξ * .
By taking the expectation with respect to the distribution of G on both sides of (39) and taking the time average on τ = 0 , 1 , , t 1 , we can get
1 t E { L ( G ( t ) ) } V t τ = 0 t 1 c F E { R c ( τ ) } B V c F r c , ξ * ξ t τ = 0 t 1 c F E { Q l s ( c ) c ( τ ) + X c ( τ ) + Y c ( τ ) } .
Taking the lim inf of t in (40), we have
lim   inf t 1 t E { L ( G ( t ) ) } lim   inf t V t τ = 0 t 1 c F E { R c ( τ ) } B V c F r c , ξ * lim   inf t ξ t τ = 0 t 1 c F E { Q l s ( c ) c ( τ ) + X c ( τ ) + Y c ( τ ) } .
When the term in (41) is nonnegative, we can obtain (33) and (35). □

5. Simulation Results

In this section, the performance of the proposed algorithm is evaluated via simulations done in Network Simulator 2 (NS2). We consider an MR-MC WMN with 30 static nodes which are randomly and uniformly distributed in a square of 1000 m × 1000 m . The transmission and interference ranges of each node were both set to 250 m. We randomly chose five pairs of source and destination nodes to constitute five flows with a c = 1 Mbps ,   ρ c = 0.5 s . The maximum number of radios on each node was three, the carrier frequency was 2.4 GHz, and there were four available channels, each with a bandwidth of 5 MHz. In the simulations, ad hoc on-demand multi-path distance vector routing (AOMDV) and user datagram protocol (UDP) were adopted as the routing and transfer protocal, respectively. The parameter configuration in the NS2 simulations is shown in Table 2.
Figure 3 demonstrates the stability of the actual and virtual queues with V = 1000 ,   q M = 5   Mbit settings. We randomly selected a source node to record its virtual queues X c ( t ) and Y c ( t ) . It can be seen that the backlog of all the virtual queues converged to a stable value which was strictly lower than the maximum buffer size q M , as we discussed in Section 4. The behavior of the actual queue Q l c ( t ) was observed by randomly choosing a non-source node. It can be seen that although the backlog of the actual queue did not converge to a constant, it fluctuated slightly around a fixed value.
Figure 4 shows the average transmission rate and delay of all the data flows versus parameter V with q M = 5   Mbit . It was observed that with increasing V, the average transmission rate and end-to-end delay both firstly increased, and they remained stable when V ≥ 1000. The maximum delay was still less than the limit value ρ c = 0.5   s . Thus, we usually took V = 1000 in the simulations.
Figure 5 shows the network performance of DRDA versus the maximum buffer size q M with V = 1000. The average transmission rate of the flow was not sensitive to changes in the value of q M . However, the average end-to-end delay increased with q M in an obvious way. This is because the larger the q M , the more data will be admitted into the data queue for transmission, resulting in an increasing number of backlogged packets. However, the backlogged packets can only cause an increase in the transmission rate in a very short time. When the backlogs of all queues converge to a stable value, the transmission rate will decrease rapidly.
Finally, we compared the performance of DRDA with that of two relevant algorithms. One of the comparison algorithms is advanced random early detection (ARED) [41], which drops the backlogged packets according to a probability calculated based on the average queue length and bandwidth of links. The other comparison algorithm is controlling queue delay (CoDel) [42], which aims to keep queue delay low by dropping some of the backlogged packets. Figure 6 and Figure 7 depict the throughput and end-to-end delay, respectively, of the different algorithms with varying values of the data arrival rate a c . The control parameter and buffer size were set to V = 1000 and q M = 5 M b i t .
In Figure 6, we demonstrate the network throughput within a period of two seconds. Here, the total number of packets received by the destination nodes was used to represent the network throughput. It was observed that the performance of DRDA was better than that of the other two comparison algorithms. Meanwhile, the throughput of DRDA no longer increased when the arrival rate was such that a c μ 0 . The throughput of CoDel grows very slowly when the arrival rate is large; this is because too many backlogged packets are dropped to ensure low end-to-end delay.
In Figure 7, the end-to-end delay of DRDA is compared with that of ARED and CoDel. It was found that algorithms DRDA and CoDel can always satisfy the end-to-end flow delay requirement. However, with increasing arrival rate, the delay of ARED increases rapidly, even exceeding the delay constraint. This is because the aim of ARED is to ensure the fairness of all the packets, rather than meeting the delay requirement.

6. Conclusions

In this paper, a distributed rate-control and delay-guaranteed scheduling algorithm (DRDA) for MR-MC WMNs was proposed in which the scheduling policy and service rate are optimized through the Lyapunov drift optimization technique. The scheduling policy and scheduling rate of each flow can be decided based only on local information. The simulation results showed that our proposed algorithm can maintain the stability of all the actual and virtual queues while maximizing the network throughput and meeting the delay constraint of each flow as desired.

Author Contributions

Data curation, Y.Z.; Formal analysis, L.L.; Investigation, S.G.; Methodology, L.L.; Project administration, S.G.; Resources, X.Z.; Software, L.L.; Supervision, X.Z.; Visualization, Y.Z.; Writing—original draft, L.L.; Writing—review & editing, X.Z.

Funding

This research was funded by the Department of Science and Technology, State Grid Corporation of China, project entitled “Evolution of Power Wireless Private Network and Application Analysis of 4G and 5G Technologies”, grant number 5700-201955234A-0-0-00.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Alim Al Islam, A.B.M.; Islam, M.J.; Nurain, N.; Raghunathan, V. Channel assignment techniques for multi-radio wireless mesh networks: A survey. IEEE Commun. Surv. Tutor. 2016, 18, 988–1017. [Google Scholar] [CrossRef]
  2. Cheng, Y.; Li, H.; Shila, D.M.; Cao, X. A systematic study of maximal scheduling algorithms in multiradio multichannel wireless networks. IEEE/ACM Trans. on Netw. 2015, 23, 1342–1355. [Google Scholar] [CrossRef]
  3. Campbell, C.; Khan, S.; Singh, D.; Loo, K. Multi-channel multi-radio using 802.11 based media access for sink nodes in wireless sensor networks. Sensors 2011, 11, 4917–4942. [Google Scholar] [CrossRef] [PubMed]
  4. Lam, J.; Lee, S.; Tan, W. Performance evaluation of multi-channel wireless mesh networks with embedded systems. Sensors 2012, 12, 500–517. [Google Scholar] [CrossRef]
  5. Wang, H.; Ma, J.; Yang, D.; Gidlund, M. Efficient resource scheduling for multipath retransmission over industrial WSAN systems. Sensors 2019, 19, 3927. [Google Scholar] [CrossRef]
  6. Santana, J.; Marrero, D.; Macías, E.; Mena, V.; Suárez, Á. Interference effects redress over power-efficient wireless-friendly mesh networks for ubiquitous sensor communications across smart cities. Sensors 2017, 17, 1678. [Google Scholar] [CrossRef]
  7. Yu, B.; Zhang, X.; Palmieri, F.; Creignou, E.; You, I. A deep learning approach for maximum activity links in D2D communications. Sensors 2019, 19, 3941. [Google Scholar] [CrossRef]
  8. Park, S.; Kim, B.; Yoon, H.; Choi, S. RA-eV2V: Relaying systems for LTE-V2V communications. J. Commun. Netw. 2018, 20, 396–405. [Google Scholar] [CrossRef]
  9. Ahmad, S.A.; Hajisami, A.; Krishnan, H.; Ahmed-Zaid, F.; Moradi-Pari, E. V2V system congestion control validation and performance. IEEE Trans. Veh. Technol. 2019, 68, 2102–2110. [Google Scholar] [CrossRef]
  10. Dang, S.; Chen, G.; Coon, J.P. Multicarrier relay selection for full-duplex relay-assisted OFDM D2D systems. IEEE Trans. Veh. Technol. 2018, 67, 7204–7218. [Google Scholar] [CrossRef]
  11. Zhou, Z.; Feng, J.; Gu, B.; Ai, B.; Mumtaz, S.; Rodriguez, J.; Guizani, M. When mobile crowd sensing meets UAV: Energy-efficient task assignment and route planning. IEEE Trans. Commun. 2018, 66, 5526–5538. [Google Scholar] [CrossRef]
  12. Gore, A.D.; Karandikar, A. Link scheduling algorithms for wireless mesh networks. IEEE Commun. Surv. Tutor. 2011, 13, 258–273. [Google Scholar] [CrossRef]
  13. Gabale, V.; Raman, B.; Dutta, P.; Kalyanraman, S. A classification framework for scheduling algorithms in wireless mesh networks. IEEE Commun. Surv. Tutor. 2013, 15, 199–222. [Google Scholar] [CrossRef]
  14. Wang, X.; Cai, L. Limiting properties of overloaded multiuser wireless systems with throughput-optimal scheduling. IEEE Trans. Commun. 2014, 62, 3517–3527. [Google Scholar] [CrossRef]
  15. Yi, C.; Cai, J. A truthful mechanism for scheduling delay-constrained wireless transmissions in IoT-based healthcare network. IEEE Trans. Wirel. Commun. 2019, 18, 912–925. [Google Scholar] [CrossRef]
  16. Byun, H.; So, J. Node scheduling control inspired by epidemic theory for data dissemination in wireless sensor-actuator networks with delay constraints. IEEE Trans. Wirel. Commun. 2016, 15, 1794–1807. [Google Scholar] [CrossRef]
  17. Zhang, H.; Liu, X.; Li, C.; Chen, Y.; Che, X.; Wang, L.Y.; Lin, F.; Yin, G. Scheduling with predictable link reliability for wireless networked control. IEEE Trans. Wirel. Commun. 2017, 16, 6135–6150. [Google Scholar] [CrossRef]
  18. Bui, L.; Srikant, R.; Stolyar, A. Novel architectures and algorithms for delay reduction in back-pressure scheduling and routing. In Proceedings of the IEEE INFOCOM, Rio de Janeiro, Brazil, 19–25 April 2009; pp. 2936–2940. [Google Scholar]
  19. Ying, L.; Srikant, R.; Towsley, D.; Liu, S. Cluster-based back-pressure routing algorithm. IEEE/ACM Trans. Netw. 2011, 19, 1773–1786. [Google Scholar] [CrossRef]
  20. Chackochan, R.; Dhanasekaran, S.; Sunny, A. Asynchronous distributed greedy link scheduling in multihop wireless networks. IEEE Trans. Veh. Technol. 2018, 67, 10166–10170. [Google Scholar] [CrossRef]
  21. Bodas, S.; Shakkottai, S.; Ying, L.; Srikant, R. Low-complexity scheduling algorithms for multichannel downlink wireless networks. IEEE/ACM Trans. Netw. 2012, 20, 1608–1621. [Google Scholar] [CrossRef]
  22. Fathi, M.; Maihami, V. Operational state scheduling of relay nodes in two-tiered wireless sensor networks. IEEE Syst. J. 2015, 9, 686–693. [Google Scholar] [CrossRef]
  23. Alresaini, M.; Wright, K.; Krishnamachari, B.; Neely, M.J. Backpressure delay enhancement for encounter-based mobile networks while sustaining throughput optimality. IEEE/ACM Trans. Netw. 2016, 24, 1196–1208. [Google Scholar] [CrossRef]
  24. Neely, M.J. Stochastic network optimization with application to communication and queueing systems. Synth. Lect. Commun. Netw. 2010, 3, 1–211. [Google Scholar] [CrossRef]
  25. Neely, M.J. A lyapunov optimization approach to repeated stochastic games. In Proceedings of the 2013 51st Annual Allerton Conference on Communication, Control, and Computing, Monticello, IL, USA, 2–4 October 2013; pp. 1082–1089. [Google Scholar]
  26. Wei, X.; Neely, M.J. Power-aware wireless file downloading: A lyapunov indexing approach to a constrained restless bandit problem. IEEE/ACM Trans. Netw. 2016, 24, 2264–2277. [Google Scholar] [CrossRef]
  27. Neely, M.J. Delay-based network utility maximization. IEEE/ACM Trans. Netw. 2013, 21, 41–54. [Google Scholar] [CrossRef]
  28. Urgaonkar, R.; Neely, M.J. Delay-limited cooperative communication with reliability constraints in wireless networks. IEEE Trans. Inf. Theory. 2014, 60, 1869–1882. [Google Scholar] [CrossRef]
  29. Li, N.; Hu, Y.; Chen, Y.; Zeng, B. Lyapunov optimized resource management for multiuser mobile video streaming. IEEE Trans. Circuits Syst. Video Technol. 2019, 29, 1795–1805. [Google Scholar] [CrossRef]
  30. Kim, T.; An, K.; Yu, H. Performance analysis of centralized and distributed scheduling schemes for mobile multihop relay systems. IET Commun. 2017, 11, 69–75. [Google Scholar] [CrossRef]
  31. Johnston, M.; Modiano, E. Wireless scheduling with delayed CSI: When distributed outperforms centralized. IEEE Trans. Mob. Comput. 2018, 17, 2703–2715. [Google Scholar] [CrossRef]
  32. Shi, J.; Sha, M.; Yang, Z. Distributed graph routing and scheduling for industrial wireless sensor-actuator networks. IEEE/ACM Trans. Netw. 2019, 27, 1669–1682. [Google Scholar] [CrossRef]
  33. Vergados, D.J.; Amelina, N.; Jiang, Y.; Kralevska, K.; Granichin, O. Toward optimal distributed node scheduling in a multihop wireless network through local voting. IEEE Trans. Wirel. Commun. 2017, 17, 400–414. [Google Scholar] [CrossRef] [Green Version]
  34. Zhou, Y.; Li, X.; Liu, M.; Mao, X.; Tang, S.; Li, Z. Throughput optimizing localized link scheduling for multihop wireless networks under physical interference model. IEEE Trans. Parallel Distrib. Syst. 2014, 25, 2708–2720. [Google Scholar] [CrossRef] [Green Version]
  35. Qian, D.; Zheng, D.; Zhang, J.; Shroff, N.B.; Joo, C. Distributed CSMA algorithms for link scheduling in multihop MIMO networks under SINR model. IEEE/ACM Trans. Netw. 2013, 21, 746–759. [Google Scholar] [CrossRef] [Green Version]
  36. Choi, J.; Joo, C.; Zhang, J.; Shroff, N.B. Distributed link scheduling under SINR model in multihop wireless networks. IEEE/ACM Trans. Netw. 2014, 22, 1204–1217. [Google Scholar] [CrossRef]
  37. Lin, X.; Rasool, S.B. Distributed and probably efficient algorithms for joint channel-assignment, scheduling, and routing in multichannel ad hoc wireless networks. IEEE/ACM Trans. Netw. 2009, 17, 1874–1887. [Google Scholar]
  38. Cao, X.; Liu, L.; Shen, W.; Cheng, Y. Distributed scheduling and delay-aware routing in multihop MR-MC wireless networks. IEEE Trans. Veh. Technol. 2016, 65, 6330–6342. [Google Scholar] [CrossRef]
  39. Gupta, P.; Kumar, P.R. The capacity of wireless networks. IEEE Trans. Inf. Theory. 2000, 46, 388–404. [Google Scholar] [CrossRef] [Green Version]
  40. Wei, L.; Pados, D.A. Optimal orthogonal carriers and sum-INR/sum-capacity of the multiple-access vector channel. IEEE Trans. Commun. 2012, 60, 1188–1192. [Google Scholar] [CrossRef]
  41. Floyd, S.; Gummadi, R.; Shenker, S. Adaptive Red: An Algorithm for Increasing the Robustness of Red’s Active Queue Management. Available online: https://www.icir.org/floyd/papers/adaptiveRed.pdf (accessed on 15 November 2019).
  42. Nichols, K.; Jacobson, V. Controlling Queue Delay. Available online: http://people.eecs.berkeley.edu/~sylvia/papers/newAQM.pdf (accessed on 15 November 2019).
Figure 1. The multicommodity flow problem based on a tuple-based link model.
Figure 1. The multicommodity flow problem based on a tuple-based link model.
Sensors 19 05005 g001
Figure 2. Actual and virtual queue model.
Figure 2. Actual and virtual queue model.
Sensors 19 05005 g002
Figure 3. Queue stability.
Figure 3. Queue stability.
Sensors 19 05005 g003
Figure 4. Network performance of the distributed rate-control and delay-aware (DRDA) algorithm versus the value of V.
Figure 4. Network performance of the distributed rate-control and delay-aware (DRDA) algorithm versus the value of V.
Sensors 19 05005 g004
Figure 5. Network performance of DRDA versus the value of q M .
Figure 5. Network performance of DRDA versus the value of q M .
Sensors 19 05005 g005
Figure 6. Throughput of DRDA compared with that of ARED and CoDel.
Figure 6. Throughput of DRDA compared with that of ARED and CoDel.
Sensors 19 05005 g006
Figure 7. End-to-end delay of DRDA compared with that of ARED and CoDel.
Figure 7. End-to-end delay of DRDA compared with that of ARED and CoDel.
Sensors 19 05005 g007
Table 1. Summary of key notation.
Table 1. Summary of key notation.
NotationMeaning
N Set of nodes in the network
p Set of physical links
T Set of tuples
Set of tuple-links
c Set of tuple-links with flow c
N c Set of nodes with flow c
r n Set of radios in node n
e Set of channels
e r n The channel which radio r n operates on
I l Set of interference links of link l
F Set of all flows in the network
F s Set of flows which are generated in node s
a c The minimum arrival data rate of flow c
ρ c The delay constraint of flow c
Q l c ( t ) ,Queue length of link l with flow c
Q l s ( c ) c ( t ) Queue length of the source link with flow c
D l c ( t ) Scheduling policy of link l with flow c
δ l c ( t ) Scheduling weighted metric of link l with flow c
μ l c ( t ) Scheduling rate of link l with flow c
R c ( t ) Service rate of flow c at its source node
X c ( t ) , Y c ( t ) Backlog of virtual queues X and Y with flow c
μ 0 Maximum rate of each source node
q M Maximum buffer size of the queue
Table 2. Parameter configuration in Network Simulator 2 (NS2) simulations.
Table 2. Parameter configuration in Network Simulator 2 (NS2) simulations.
Channel TypeWireless Channel
Propagation ModelTwo Ray Ground
Antenna Height2 m
Working Frequency2.4 GHz
Single Channel Bandwidth5 MHz
Communication Distance250 m
Interference Distance250 m
Routing ProtocolAOMDV
Data TypeConstant Bate Rate (CBR)
Transfer ProtocolUDP
Maximum Number of Radios3
a c 1 Mbps
ρ c 0.5 s
V1000

Share and Cite

MDPI and ACS Style

Li, L.; Zhao, X.; Geng, S.; Zhang, Y. Distributed Rate-Control and Delay-Guaranteed Scheduling in MR-MC Wireless Mesh Networks. Sensors 2019, 19, 5005. https://doi.org/10.3390/s19225005

AMA Style

Li L, Zhao X, Geng S, Zhang Y. Distributed Rate-Control and Delay-Guaranteed Scheduling in MR-MC Wireless Mesh Networks. Sensors. 2019; 19(22):5005. https://doi.org/10.3390/s19225005

Chicago/Turabian Style

Li, Liang, Xiongwen Zhao, Suiyan Geng, and Yu Zhang. 2019. "Distributed Rate-Control and Delay-Guaranteed Scheduling in MR-MC Wireless Mesh Networks" Sensors 19, no. 22: 5005. https://doi.org/10.3390/s19225005

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop