1. Introduction
The fourth generation of mobile telephony Long-Term Evolution (LTE) seems to have reached its maturity in commercial deployments. However, the sharp increase in the forecasted capacity demand for mobile networks [
1] combined with the upgrade of devices and services with higher requirements make the expansion of spectral resources inevitable. Following this trend, cellular network operators see in the unlicensed bands the ideal solution to support the capacity gain necessary to compensate the new demands.
While a further extension of the operational spectrum is foreseen, the free bands currently available in Europe for this purpose are 2.4 and 5 GHz. Within this framework, 3GPP (Third Generation Partnership Project) created the Licensed Assisted Access (LAA) standard [
2] so that LTE could operate in the downlink in unlicensed bands. To adapt the LTE (and later standards) synchronous operation to a contention-based access channel, the use of Listen Before Talk (LBT) protocol has been established with the added purpose of maintaining equitable access with respect to the WiFi devices [
3]. This protocol, as shown in
Figure 1, has evolved being included as part of 3GPP developments to adapt mobile technologies to their operation in the unlicensed band.
From this proposal, later versions deepen the capabilities for 3GPP unlicensed spectrum support: LAA included a series of preconfigured values of the access parameters to the unlicensed channel called priority classes that would fulfill the function of providing a certain degree of Quality of Service (QoS) without going into details of its operation. Subsequently, in enhanced LAA (eLAA), the uplink channel is further added and the priorities are defined in the same way for this channel. Afterwards, FeLaa (Further enhanced LAA) becomes the first 5G standard that adapted LAA and eLAA adding new functionalities. In addition, non-3GPP technologies, such as the one proposed by the MulteFire Alliance [
4], have been derived from 3GPP to operate exclusively in the unlicensed band.
Finally, the recently completed Release 16 NR-U [
5] offers two different flavors for deployment: on the one hand the option of licensed assisted and on the other hand a completely standalone operation as proposed by MulteFire. For all these standards, the use of the LBT priorities initially proposed for LAA is common, however none of these specify which types of traffic or under which conditions their use is appropriate.
Even though 3GPP-based unlicensed standards and WiFi use the same techniques in their physical layer [
5], namely Orthogonal Frequency Division Multiplexing (OFDM) and Multiple Input Multiple Output spatial multiplexing (MIMO), they differ in other aspects such as the transmission power, bandwidth, Modulation and Coding Schemes (MCS) or error correction codes, to name a few. Regarding the packet loss recovery mechanisms, although they present similarities, the differences are substantial. While WiFi uses automatic retransmission (ARQ), 3GPP incorporates the Radio Link Control layer (RLC) with hybrid ARQ [
6]. Besides, in terms of scheduling, 3GPP acts as a synchronous system, via a centralized scheme. At the same time, WiFi operates half-duplex random access where the receiver must confirm all frame transmissions. Although both approaches can achieve similar performance in terms of data rate, the random access used by WiFi produces persistent collisions when there are several devices connected to the network [
7].
At present, although several articles evaluate the coexistence of both mechanisms [
8], there is still a need to investigate in this area with end-to-end performance assessment purposes especially in dense environments [
9], avoiding, as far as possible, the degradation of pre-existing technologies. Most of the collected works mentioned in [
8] choose a certain configuration of the access channel parameters to show the benefits of their proposal or to demonstrate the harmful or beneficial effect on WiFi. Many of these chosen parameters are not sufficiently justified or do not fully comply with the standard. In neither case do they cover the entire range of cases proposed by the 3GPP priorities.
It is important to highlight that, due to the operational differences mentioned above for both standards at the protocol level, a detailed study of all aspects that impact on the quality perceived by the users is necessary. Since an implementation of a coordination mechanism it is not foreseeable, possible ways to improve coexistence become a priority.
Therefore, it is not only a question of comparing the access methods being mutually respectful (LBT in 3GPP standards and CSMA/CA in WiFi) but also to determine how the channel sharing affects the operation of the upper layers (e.g., the MAC) and describe the interaction with themselves and each other as well as the impact on the application layer. In this regard, some works can be found in the literature specially focused on mathematical modeling.
In [
10,
11], the impact of priorities is assessed with a standardized throughput indicator and assuming ideal propagation conditions. However, the problem of heterogeneity of coexisting systems is identified, while the proposed scenario is far from dense. On the other hand, with respect to simulation works, several outstanding papers have appeared lately, among which it is worth mentioning the one by De Santana et al. [
12] where, despite the use of ns3 tool, a simplified scenario that does not reflect any of the problems posed by coexistence in the foreseeable dense indoor environments is proposed. It also focus on a single priority configuration with a fixed traffic load. Lastly, the exhaustive study made by the ns3-based LAA model creators in [
13] presents a setting where only FTP traffic is simulated, and the impact of each relevant random access parameter is studied. However, neither video traffic nor the priorities proposed by the 3GPP are included.
In this field, the contribution of the present work is on the end-to-end assessment of the LBT channel access priorities configurations in order to provide QoS and Quality of Experience (QoE). To this end, two types of services were simulated in an indoor dense environment, one of them being real-time (video streaming) and the other non-real-time (FTP) for different levels of traffic intensity. Thus, this is the first time that a multi-service end-to-end performance is assessed in the LBT-based 3GPP standards—WiFi coexistence literature leading to key conclusions on the performance of each priority and recommendations for future QoE-based use of LBT channel access configurations. From these results, a definition is derived and the framework about traffic prioritization for 3GPP standards in unlicensed band is implemented.
The structure of this work can be summarized as follows. In
Section 2, the access characteristics to the unlicensed channel in WiFi and 3GPP LBT are described.
Section 3 presents the evaluation framework designed for user end-to-end multi-service performance evaluation. Thereafter, a description of the relevant indicators being evaluated is presented in
Section 4, followed by
Section 5 presenting an exhaustive description of the scenario and parameters of the simulation leading to the performance assessment analysis. Finally,
Section 6 summarizes the conclusions of this work.
3. Evaluation Framework
To model both technologies as realistically as possible, the well-known simulator ns3 [
18] was chosen. For the evaluation, a simulated setup was developed based on ns3, implementing on top a framework for the simultaneous execution of Real Time Video Streaming (RTVS) and FTP services and the multi-layer monitoring of their performance. This tool has an important acceptance within the wireless research field [
19] given the fact that relevant entities in the industry have developed its WiFi and LTE modules.
The scope of ns3 simulations is to include multi-layer interactions of commercial standard deployments. The ns3 Evalvid module [
20] was used for the simulation of RTVS service. This module contains a set of tools to generate video traffic based on sender/receiver traces. In this way, it allows the encoding and comparison of the original video versus the received one, from which the differences due to its transit through the network are obtained.
In the proposed evaluation, a 4K AVC MPEG-4 encoded file (3840 × 2160 resolution, 120 fps with 28.3 MB size) containing 20 s of video is sent. To emulate real-time behavior, all frames with an end-to-end delay of more than 150 ms are discarded.
Additionally, for the modeling of the 3GPP downlink unlicensed channel, the LAA ns3-module was used [
21]. This includes the indoor scenarios and FTP Model I type of traffic as proposed by 3GPP [
22] to evaluate the performance of both systems. The architecture of the proposed simulation is shown in
Figure 3.
For link performance computation, the ns3 LAA module uses the [
23] model to extract the Mutual Information Effective SINR Metric (MIESM) as a Link-to-System Mapping (LSM) function, as done in [
24]. Finally, MIMO was modeled as a gain of SINR over SISO, as specified in [
25] where the statistical gain of several MIMO solutions with respect to SISO is argued.
The development of the framework adapted the evalvid module code to work through the LBT protocol in the version that supports it. In addition, the LAA module was modified to support the priorities as well as the performance indicators in the following section. This setup allows a novel multi-service end-to-end simulation of a coexistence environment between 3GPP LBT downlink technology and WiFi.
5. Performance Assessment
This section evaluates the impact of 3GPP LBT priorities on service performance in coexistence for indoor dense scenarios. The environment defined by 3GPP for this kind of analysis [
22] is used. Thus, among all the deployment scenarios for 5G (rural, dense, urban and urban macro outdoor), the one chosen is proposed in TR38.889 [
15] as a baseline on coexistence as indoor Hotspot scenario and specified as the most suitable to evaluate the coexistence with 802.11ac WiFi networks whose power and technical characteristics defined by ETSI do not allow exceeding 23 dBm.This criterion is followed by some of the key articles on coexistence of 3GPP-WiFi technologies in unlicensed band [
13,
16,
35,
36]. Both LBT and WiFi nodes share the same 20-MHz channel (number 36 within 5-GHz band).
5.1. Scenario
As shown in
Figure 4, an indoor layout of 120 m × 50 m where two Operators A and B with four base stations and a total of 20 static users per operator randomly placed all over the layout are coexisting.With this setting established, a hotspot use case where the users have very low or quasi-static mobility is considered. The base station/access points are aligned with 30 m separation between them and at 5 m distance between operators. The results are evaluated by averaging 50 different random user distribution scenarios with 500 s runs each.
Thus, in each run, a randomly selected user who makes use of the FTP/Real Time Video Streaming (RTVS) services is evaluated (“Random User traffic” in
Figure 4) while the rest of the user devices (“Background traffic” in
Figure 4) generate a download FTP Model I traffic with intensity that varies according to the lambda parameter (from 0.5 to 3 files/s). In this manner, the QoE performance (i.e., KQI) of the user is evaluated in the presence of a background traffic load from low to high.
The interference between WiFi access points and base stations is managed by contention mechanisms (CSMA/CA in WiFi and 3GPP LBT); no further Distributed Control Function is enabled. Unlike the synchronized and collision-free access in which 3GPP technologies operate, the necessary medium access layer given by the CSMA and LBT protocols has some drawbacks associated with it, such as the hidden node or the exposed node. When a terminal has started transmitting for the limited time (in the form of TxOP or MCOT), it is possible that interference may occur in nodes that are not able to detect such transmission (because it is below its energy detection threshold). Thus, in short transmissions, there is more chance of collisions by nodes that cannot detect it. Therefore, when an interference is produced during the transmission of a WiFi Access Point and, given the half-duplex nature of the protocol, the retransmission mechanism is activated trying to resend the interfered frame and causing greater congestion of the air environment and making further collisions of part of the hidden nodes of the co-existing technology more likely.
All the aforementioned performance indicators in
Section 4 are analyzed following a top-down approach in order to correctly analyze the interaction phenomena produced in coexistence. The background FTP Model I (UDP) traffic from the application layer is analyzed first, including the total number of files sent and which of these have arrived complete. The average performance figures among all background users are also shown. Then, the KQI obtained by the user taking into account these conditions are shown and compared with the KPI obtained by the network. Next, to explain the results, details of some lower layer parameters are shown to support the explanations. Finally, the fairness of both coexisting mechanisms is evaluated as described in the previous section.
5.2. Background Traffic (Load)
As shown in
Figure 5a, WiFi sends a fixed number of files depending on the intensity while 3GPP LBT varies depending on the priority used. More specifically, the use of Priorities 1 and 2 reduces the total number of files sent and losses occur (cut bar). If we look at the metrics of the FTP Background traffic (
Figure 5), i.e. File Transfer Mean Throughput and the File Transfer Mean Delay, it can be seen that in Priorities 1 and 2 there is a significant drop in quality. This means that not only are fewer files sent, but also the quality of service offered to the user is of a lower quality than in the case of Priorities 3 and 4 (in principle intended for Best Effort traffic [
5]).
5.3. User Traffic
Subsequently,
Figure 6 and
Figure 7 display the results obtained at the level of KQI indicators for the user of FTP and RTVS services. They are shown in boxplot form taking into account the results of all the iterations and all frames in video streaming (which is why more samples have been captured). The first aspect that can be observed is that the behavior of the priorities is very similar to the one followed by the Background traffic, that is Priorities 1 and 2 present a longer delay (
Figure 6b and
Figure 7a) and jitter values (
Figure 7b) and lower throughput (
Figure 6a) and PSNR (
Figure 7d) than Priorities 3 and 4.
To deepen in these results, in
Figure 8, a boxplot of the UPIs for both technologies is presented, measured in terms of the IP packages with prefixed MAC to channel delays so that only the delay introduced by the access to the channel varies. We see that in LBT as the priority is increased the performance improves and the dispersion decreases; this is not so for WiFi, where, although the average follows a linear progression, the dispersion is maintained. This fact means that priorities’ selection influence LBT performance more than WiFi traffic due mainly to two factors: (1) a lower use of the channel as fewer MCOTs are needed; and (2) a higher probability of collision when the contention window and the MCOT are reduced, especially between distant LBT stations as they are synchronized at subframe level [
13]. Such phenomenon is proved in
Figure 9 which shows how changes in LBT contention window (indicating a collision) imply a very similar lost packets pattern. Unlike what happens in WiFi where collisions are measured based on the number of retransmissions made, it can be seen that a similar behavior is practically maintained (accentuated for Priorities 1 and 2). Hence, in LBT, lost packets do not depend on the configuration but on the traffic load.
The fact 3GPP LBT has the channel for a more considerable amount of time means that, although waiting times are longer in the case of a collision, the transmissions have greater efficiency by having more resources. It is also appreciated in
Figure 8a that an LBT performance drop (UPT decrease and higher latency values) is produced with Priorities 1 and 2. This adverse effect (especially in Priority 1) is due to a shorter duration of MCOT and short backoff times C
w, which, in turn, cause an increased number of channel access attempts by WiFi retransmissions. Since WiFi ED-CCA threshold is higher than the one set by LBT (
Table 3), such repeated attempts result in a significant increase in the number of collisions produced by the WiFi retransmitted frames causing higher delays in LBT [
37]. Nevertheless, in Priority 1, the UPT is constant regardless of the traffic intensity due to a higher probability of accessing the medium but shorter transmission times compared to other priorities.
5.4. Fairness
On the subject of fairness, the results of the K-S test shown in
Table 4 confirm that in none of the priority settings does the parameter p reach the proposed alpha (0.05). This means that 3GPP LBT is not a fair method in any of these cases, although by means of the parameter Dmax it can be stated that Priority 4 is the closer to fairness than the rest of options.
Therefore, it can be concluded that the phenomenon that has the most impact, and therefore must be avoided, is the collisions between both technologies. In this manner, the more transmissions there are, the more likely they are to collide, thus it is advisable to make the number of such transmissions as efficient as possible, particularly in the dense scenario that is the subject of this research.
Although in principle the use of a shorter backoff time is more likely to use the channel, as the standard and the literature suggest [
16], it is also more likely in this context to interfere with other transmissions that are going unnoticed. Thus, these results raise the need to adopt specific mechanisms for especially dense environments that allow improving the coexistence between both technologies while maximizing 3GPP LBT performance.
6. Conclusions
This article presents an end-to-end multi-service performance evaluation by simulating an indoor dense coexistence environment. In such scenario, two non-cooperative deployments in the unlicensed sub-6-GHz bands coexist. The first is an operator using 3GPP Listen Before Talk access technology and the other is an operator with the WiFi 802.11ac. In this context, the performance and fairness of each priority established by 3GPP for LBT CAT4 proposed for LAA, eLAA and FeLAA and applicable for 5G NR-U were evaluated for a real-time service (FTP) and a non-realtime (Video Streaming) service.
According to the results obtained, and in contrast to the predicted from abstract models, Priorities 3 and 4 show very similar behavior, offering higher levels of user satisfaction measured in KQI for both real-time and non-real-time service compared to Priorities 1 and 2 and greater fairness towards WiFi. Therefore, it is proved that, in indoor dense coexistence scenarios, the 3GPP LBT parameter with the most significant impact is the Maximum Channel Occupation Time (MCOT). As a rule, configurations with longer MCOT provide higher user throughput and lower latencies. Nevertheless, it is essential to note that fairness is always compromised for all priorities, indicating that WiFi is still degraded.
Based on the evaluation made, it is necessary to find ways to optimize user’s performance and fairness in dense scenarios for future 5G NR-U developments in the unlicensed band. In addition, it can be inferred that the use of lower priority values (3 and 4) is recommended to get the best user experience, even if their waiting times are longer. A method to manage the synchronization between 3GPP Listen Before Talk base stations in order to avoid self-collisions when shorter duration signals are sent (1–2 ms) is therefore needed. In this way, an algorithm to dynamically assign priority classes and further elaboration on network metrics (e.g., cell throughput, resource blocks utilization, network power consumption, etc.) are envisioned as future work.