An Energy-Efficient Unselfish Spectrum Leasing Scheme for Cognitive Radio Networks

Abstract

Cooperative Communications in Cognitive Radio (CR) have been introduced as an essential and efficient technique to improve the transmission performance of primary users and offer transmission opportunities for secondary users. In a typical multiuser Cooperative Communication in CR, each primary user can choose one secondary user as a relay node. To encourage the cooperative behavior of the secondary users, primary users lease a fraction of their allocated spectrum to the relay secondary users to transmit their data packets. In this work, a novel unselfish spectrum leasing scheme in CR networks is proposed that offers an energy-efficient solution minimizing the environmental impact of our network. A network management architecture is introduced, and resource allocation is proposed as a constrained sum energy efficiency maximization problem. The optimization problem is formulated and solved using non-linear programming methods and based on a modified Kuhn-Munkres bipartite matching algorithm. System simulations demonstrate an increment in the energy efficiency of the primary users’ network compared with previously proposed algorithms.

1. Introduction

The exponential growth of wireless services in the last decades has called for additional spectrum to accommodate the ever-increasing traffic flow [1]. Besides, the current static spectrum policy, used by most countries in the world, has almost resulted in licensed spectrum exhaustion of some frequency bands [2]. On the contrary, recent spectrum utilization measurements have shown that the available spectrum opportunities are severely underutilized [3]. Cognitive radio (CR), with its ability to sense available frequency bands and adaptively adjust transmission frequency, has attracted considerable attention as one of the most promising solutions to spectrum underutilization [4,5,6,7]. Traditionally in CR networks (CRNs), there two categories of users, namely, primary users (PUs) and secondary users (SUs). PUs are licensed users, and they have the exclusive right to use their respective channels, while SUs are unlicensed, and they wish to use the underutilized channels [8]. To pay off the use of a licensed band, cooperative CRNs (CCRNs) have been proposed in which SUs act as relays to provide a better transmission performance to the PUs [9,10,11].

Extensive research has been conducted regarding spectrum leasing in CCRN. To address the challenges several approaches have been adopted. The game-theoretical approaches, such as Stackelberg game [12], are used to achieve the equilibrium state (e.g., Nash Equilibrium [13,14]) and involves PUs and SUs as players of the game. In Reference [15], a scenario, in which PUs compete for cooperation with available SUs under shared constraint set by SU’s requirements, is modeled as a generalized Nash Equilibrium. The authors of Reference [16], propose a noncooperative game to find the optimal power of SUs consumed in a scenario where SUs are used as relays in cooperation to aid PUs’ transmission. In Reference [17], a spectrum leasing technique to improve the spectral utility of the PUs has been proposed. Nash bargaining is used to determine the optimal division of temporal resources between relaying and reimbursement. In Reference [18], a novel approach is presented in which the spectrum leasing problem is formulated as a Stackelberg game, while the relay selection is solved by the Hungarian method. The authors of Reference [19], derive a cooperative game to find the optimal spectrum leasing time and allocated power of SUs.

Another popular approach is convex optimization. An adaptive spectrum leasing scheme is proposed in Reference [20] to improve the overall network throughput. The authors of Reference [21], present a spectrum leasing scheme for an overlay CRN in which PUs’ transmission is assisted by a cognitive multi-hop multi-branch network. The branch selection and spectrum allocation are jointly optimized such that the sum-rate of the SUs is maximized. A multi-objective optimization framework to incorporate average sum power minimization and the leased time minimization is proposed in Reference [22]. In Reference [23], a cooperative sharing model for cognitive wireless powered networks is proposed, to accomplish PU’s transmission early and vacate opportunity for SU’s transmission. An energy efficiency and spectral efficiency trade-off in an energy harvesting cooperative CRN is addressed in Reference [24]. The objective is to maximize energy and spectral efficiency via joint optimization of spectrum sensing time and self as well as cooperative transmission gains.

Different other approaches have been chosen to address the challenges of spectrum leasing in CCRN. In Reference [25], an opportunistic relaying based spectrum leasing is presented in which PUs lease their frequency band to the SUs and, at the same time, the primary network benefits in terms of outage probability. A cooperative relaying scheme is investigated in Reference [26], where one of the inactive SUs is used as a relay for the PUs. By adopting an aspiration level to model SUs behavior, the SUs’ strategy dynamics is formulated as a discrete-time Markov chain [27].

However, the majority of the research works regarding CRNs, are considered mostly PU-centered, with PUs that decide if and when to exploit SUs as relays based on certain conditions that can improve PUs’ transmission. This approach cannot guarantee full cooperation between PUs and SUs because will be dominated by the selfish behavior of PUs. In addition, networks are required nowadays to be more efficient not only in terms of spectrum use but also in terms of optimal power while guaranteeing a satisfying level of quality of service (QoS). In References [15,25,26], a scenario where a single pair of PUs or SUs is considered. Single user transmissions in CCRN compared to multiuser ones, can result incomplete because a full description of the efficiency of a cell cannot be given. It is proven that the rising number of users in a CCRN can significantly affect the overall performance of the network. Furthermore, spectrum leasing schemes in which PUs or SUs are assumed to have fixed transmission power like in Reference [18], cannot fully exploit the possibility of a more energy efficient network. Besides, energy-efficient systems are required not only from an engineering point of view but also to decrease the environmental impact through networks with a low carbon footprint [28].

Motivated by the aforementioned observations, we aim at jointly minimize the overall power consumption for energy-efficient communication in multiuser CRN. In addition, to provide improved cooperation between PUs and SUs and to secure an unselfish behavior of each user, we propose a resource management network architecture for a considered cell. This architecture, composed of various entities, will be responsible for making decisions regarding the usage of relay and for applying the optimal strategy to achieve the maximum energy efficiency of the cell. Our proposed CRN consists of multiple PUs and multiple SUs in which SUs are used as relays to enhance the PUs’ transmission performance and, in return, PUs lease a fraction of their bandwidth to the corresponding SUs. We formulate an energy efficiency based resource allocation, power allocation, and relay selection as an optimization problem. Our analysis shows that this problem can be divided into two subproblems: (1) power allocation, (2) transmission mode and relay selection. To solve the power allocation subproblem, we choose the maximization of the sum of energy efficiencies as the optimization target. This method was initially introduced in Reference [29] but due to its sum-of-ratio form can become difficult to solve. The method is further developed in our work by transforming power allocation into a subtractive form optimization problem with methods similar to those used to solve classical fractional programming problems [30,31,32]. Therefore, the optimal powers closed-form expressions can be derived through a two-layer optimization. Furthermore, the transmission mode and relay selection subproblem is solved based on a modified Kuhn-Munkres bipartite matching algorithm. System simulations performed in a referenced multiuser case validate the effectiveness of our approach proven by the proposed algorithm’s convergence and the increment in the efficiency of the PUs’ network performance when channel conditions get worse.

To summarize, the main contributions of the paper are:

• A novel unselfish resource allocation scheme for CRNs. Unlike most of works where PUs decide whether or not to cooperate with SUs, the decisions are made by a centralized approach with the goal of improving the overall energy efficiency of the cell.
• A resource management network architecture responsible for maximizing the energy efficiency of the cell.
• We propose a two-stage three-dimensional matching algorithm to maximize the energy efficiency of the cell, in which the joint optimization problem is decoupled into two subproblems and solved separately in two stages.

The rest of this paper is organized as follows. In Section 2, the architecture and the system model for CCRN are introduced. In Section 3, we formulate the energy efficiency based resource allocation, power allocation, and relay selection as an optimization problem. The non-convex energy efficiency for CCRN optimization problem is formulated and solved via an iterative algorithm in Section 4. Section 5 presents numerical performance results, and finally, conclusions are provided in Section 5.

2. Proposed Architecture and System Model for CCRN

In CCRN, one of the goals is to use the available spectrum resources in an efficient and coordinated way to guarantee a satisfying level of QoS for all users and achieve performance enhancement of the whole network. To this end, in this section, we propose a resource management network architecture consisting of a number of user resource management entities (URMEs), local resource management entities (LRMEs), and one cell resource management entity (CRME), as shown in Figure 1. The main functions of UMREs, LRMEs, and CRME are described as follows.

URME: It is a functional module embedded in each PU and SU, used to store channel state information, device characteristics and service requirements, and so forth. Through contacting associated LRMEs, URMEs send the collected information to the LRMEs and receive the resource allocation strategy accordingly also from CRMEs through LRMEs.

LRME: It is deployed in each primary base station (PBS) or secondary base station (SBS), being responsible for managing local resource status through interacting with the associated URMEs and the CRME. More specifically, receiving the network and service information from URMEs and then forwarding to the CRME, and receiving the resource management strategy from the CRME and forwarding to the URMEs.

CRME: By interacting with the LRME, the CMRE receives the network status, channel state information, and user service requirement information of all the users within the cell; then performs the proposed resource allocation and relay selection algorithm to obtain the optimal strategy for the cell and communicated to the associated LRMEs.

System Model

In this paper, we consider a CCRN consisting of multiple PUs, multiple SUs, one PBS, and one SBS. Assume PUs are allowed to transmit to the PBS simultaneously, by orthogonal frequency division multiple access (OFDMA). Further, assume that PUs may transmit to the PBS in direct transmission mode or one-hop relay transmission mode, while the relay SUs may also transmit their own data packets to the SBS. Figure 1 illustrates the scenario considered in this paper.

To encourage SUs to relay data packets for the PUs, we propose a spectrum leasing scheme where the PUs lease part of their allocated spectrum to relay SUs so that they can transmit their own data to the SBS exploiting the licensed spectrum [33,34,35]. In this paper, we assume that the decode-and-forward (DF) scheme is applied at each relay node [36].

Let M and K denote the number of PUs and the number of SUs, respectively, $B_m={\rho }_{m}B$ denote the allocated bandwidth of the mth PU, $m=1,\dots ,M$, where ${\rho }_m\in [0,1]$ denotes the spectrum fraction of the mth PU for transmitting the data packets of the PU in the relay transmission mode, and as a consequence $B_k=(1-{\rho }_m)B$, $\forall k$, is the remaining spectrum available for the relay SU to transmit its own data to the SBS. To support relay communication, the transmission time slot T is divided into two periods. For the first part, the PUs transmit their data packets to the corresponding relay SUs, then the SUs forward the received data packets to the PBS during the remaining time. Meanwhile, the SUs transmit their own data packets to the SBS for the whole time period. Figure 2 shows the time and spectrum division mode for relay transmission of the mth PU.

We assume, all channels undergo flat Rayleigh fading and log-normal shadowing and we consider that LRMEs know all channel state information. The distance between mth PU and kth SU relay is denoted as $d_{m,k}^{(\mathrm{p},\mathrm{s})}$. Then the channel power gain is represented as $h_{m,k}^{(\mathrm{p},\mathrm{s})}$ = $k_0{\left(d_{m,k}^{(\mathrm{p},\mathrm{s})}\right)}^{-\gamma }{g}_{m,k}^{(\mathrm{p},\mathrm{s})}{s}_{m,k}^{(\mathrm{p},\mathrm{s})}$, where $k_0$ denotes the average channel gain at a reference distance $d_0=1$m and this gain depends on carrier frequency, transmitter and receiver antenna gains and propagation characteristics, $\gamma >0$ is the path-loss exponent, $g_{m,k}^{(\mathrm{p},\mathrm{s})}$ is a Rayleigh distributed r.v., and $s_{m,k}^{(\mathrm{p},\mathrm{s})}$ is a log-normal r.v. with shadowing parameter ${\sigma }_{\mathrm{s}}$. The same channel model is considered for the other links $h_m^{(\mathrm{p},\mathrm{d})},h_{m,k}^{(\mathrm{p},\mathrm{r})},h_{m,k}^{\left(\mathrm{s}\right)}$, representing respectively the channel gains of the links between the mth PU and PBS in direct transmission mode, the kth SU and PBS in relay mode, and the kth SU when transmitting its own data to the SBS on the fraction of bandwidth leased by the mth PU.

In the case of multiple relay SUs being available, the optimal relay selection scheme should be designed. For each PU-SU pair, the transmit power of the PU, $P_{m,k}^{(\mathrm{p},\mathrm{s})}$ and the transmit power of the relay SU, consumed during relay $P_{m,k}^{(\mathrm{p},\mathrm{r})}$ and during its own data transmission $P_{m,k}^{\left(\mathrm{s}\right)}$, should be designed for performance optimization of the network.

3. Proposed Joint Resource Allocation and Relay Selection Scheme

In the following subsections, we formulate an optimization problem, and we present a new solution to the energy efficiency based resource allocation, power allocation, and relay selection.

3.1. Energy Efficiency of PUs

The energy efficiency of all the PUs can be expressed as

$${\eta }^{\left(\mathrm{p}\right)}=\sum _{m=1}^M{\eta }_m^{\left(\mathrm{p}\right)},$$

(1)

where ${\eta }_m^{\left(\mathrm{p}\right)}$ denotes the energy efficiency of the mth PU. As PUs may choose direct transmission or cooperative transmission through a relay SU for information transmission to the PBS, the energy efficiency of the mth PU can be calculated as

$${\eta }_m^{\left(\mathrm{p}\right)}={\beta }_m^{\left(\mathrm{d}\right)}{\eta }_m^{(\mathrm{p},\mathrm{d})}+\sum _{k=1}^K{\beta }_{m,k}^{\left(\mathrm{c}\right)}{\eta }_{m,k}^{(\mathrm{p},\mathrm{c})},$$

(2)

where ${\eta }_m^{(\mathrm{p},\mathrm{d})}$ is the energy efficiency of the mth PU when using direct mode, while ${\beta }_m^{\left(\mathrm{d}\right)}\in \{0,1\}$ denotes the transmission indicator of the mth PU for the direct mode. More specifically, if ${\beta }_m^{\left(\mathrm{d}\right)}=1$, the mth PU uses direct transmission mode, while for ${\beta }_m^{\left(\mathrm{d}\right)}=0$, the PU exploits SU relay assisted transmission. The term ${\eta }_{m,k}^{(\mathrm{p},\mathrm{c})}$ denotes the energy efficiency of the mth PU when using the kth SU as relay node for cooperative transmission mode, while ${\beta }_{m,k}^{\left(\mathrm{c}\right)}\in \{0,1\}$ is the corresponding transmission and relay selection variable, that is, ${\beta }_{m,k}^{\left(\mathrm{c}\right)}=1$ indicates that the mth PU uses the kth SU as relay node for cooperative transmission, and ${\beta }_{m,k}^{\left(\mathrm{c}\right)}=0$, otherwise. Note that ${\beta }_m^{\left(\mathrm{d}\right)}$ and ${\beta }_{m,k}^{\left(\mathrm{c}\right)}$ are mutually exclusive. In the following subsections, we derive the expression of ${\eta }_m^{(\mathrm{p},\mathrm{d})}$ and ${\eta }_{m,k}^{(\mathrm{p},\mathrm{c})}$, respectively.

3.1.1. Direct Mode

The energy efficiency of the mth PU in direct mode, that is, ${\eta }_m^{(\mathrm{p},\mathrm{d})}$ can be calculated as

$${\eta }_m^{(\mathrm{p},\mathrm{d})}=\frac{R_m^{(\mathrm{p},\mathrm{d})}}{P_m^{(\mathrm{p},\mathrm{d})}+P_c^{\left(\mathrm{p}\right)}},$$

(3)

where $P_m^{(\mathrm{p},\mathrm{d})}$ is the power consumed by the mth PU when transmitting in direct mode, $P_{\mathrm{c}}^{\left(\mathrm{p}\right)}$ denotes the circuit power consumption of the mth PU, which is assumed to be a constant for all the PUs in this paper, and $R_m^{(\mathrm{p},\mathrm{d})}$ denotes the data rate achieved by the mth PU in direct mode, which can be expressed as

$$R_m^{(\mathrm{p},\mathrm{d})}=B{log}_2\left(1+\frac{P_m^{(\mathrm{p},\mathrm{d})}{h}_m^{(\mathrm{p},\mathrm{d})}}{{\sigma }^2}\right),$$

(4)

where ${\sigma }^2$ is the noise power of the link between the mth PU and the PBS. Without loss of generality, the noise power of all the transmission links are assumed to be the same in this paper.

3.1.2. Relay Mode

The energy efficiency of the mth PU when using the kth SU as relay node for cooperative transmission, denoted by ${\eta }_{m,k}^{(\mathrm{p},\mathrm{c})}$, can be expressed as

$${\eta }_{m,k}^{(\mathrm{p},\mathrm{c})}=\frac{R_{m,k}^{(\mathrm{p},\mathrm{c})}}{P_{m,k}^{(\mathrm{p},\mathrm{c})}}.$$

(5)

The denominator $P_{m,k}^{(\mathrm{p},\mathrm{c})}$ is the power consumption of the mth PU when using the kth SU as a relay node and can be calculated as

$$P_{m,k}^{(\mathrm{p},\mathrm{c})}=P_{m,k}^{(\mathrm{p},\mathrm{s})}+P_{m,k}^{(\mathrm{p},\mathrm{r})}+P_{\mathrm{c}}^{\left(\mathrm{p}\right)}+P_{\mathrm{c}}^{\left(\mathrm{s}\right)},$$

(6)

where $P_{\mathrm{c}}^{\left(\mathrm{s}\right)}$ denotes the circuit power consumption of the SU which is assumed to be a constant for all the SUs. The numerator $R_{m,k}^{(\mathrm{p},\mathrm{c})}$ represents the data rate of the mth PU when using the kth SU as relay node for cooperative transmission. $R_{m,k}^{(\mathrm{p},\mathrm{c})}$ can be expressed as

$$R_{m,k}^{(\mathrm{p},\mathrm{c})}=min(R_{m,k}^{(\mathrm{p},\mathrm{s})},R_{m,k}^{(\mathrm{p},\mathrm{r})}),$$

(7)

where $R_{m,k}^{(\mathrm{p},\mathrm{s})}$ and $R_{m,k}^{(\mathrm{p},\mathrm{r})}$ are, respectively, the data rate of the link from the mth PU to the kth SU

$$R_{m,k}^{(\mathrm{p},\mathrm{s})}=t_1{\rho }_{m}B{log}_2\left(1+\frac{P_{m,k}^{(\mathrm{p},\mathrm{s})}{h}_{m,k}^{(\mathrm{p},\mathrm{s})}}{{\sigma }^2}\right)$$

(8)

and that from the kth SU to the PBS when the kth SU is chosen as the relay node of the mth PU

$$R_{m,k}^{(\mathrm{p},\mathrm{r})}=(1-t_1){\rho }_{m}B{log}_2\left(1+\frac{P_{m,k}^{(\mathrm{p},\mathrm{r})}{h}_{m,k}^{(\mathrm{p},\mathrm{r})}}{{\sigma }^2}\right).$$

(9)

3.2. Energy Efficiency of SUs

The energy efficiency of all the SUs in the CCRN, denoted by ${\eta }^{\left(\mathrm{s}\right)}$, can be calculated as

$${\eta }^{\left(\mathrm{s}\right)}=\sum _{m=1}^M\sum _{k=1}^K{\beta }_{m,k}^{\left(c\right)}{\eta }_{m,k}^{\left(\mathrm{s}\right)},$$

(10)

where ${\eta }_{m,k}^{\left(\mathrm{s}\right)}$ is the energy efficiency of the kth SU when transmitting its own data on the subchannel leased by the mth PU, which can be calculated as

$${\eta }_{m,k}^{\left(\mathrm{s}\right)}=\frac{R_{m,k}^{\left(\mathrm{s}\right)}}{P_{m,k}^{\left(\mathrm{s}\right)}+P_{\mathrm{c}}^{\left(\mathrm{s}\right)}},$$

(11)

where $R_{m,k}^{\left(\mathrm{s}\right)}$ denote the data rate of the kth SU when transmitting its own data on the subchannel leased by the mth PU

$$R_{m,k}^{\left(\mathrm{s}\right)}=(1-{\rho }_m)B{log}_2\left(1+\frac{P_{m,k}^{\left(\mathrm{s}\right)}{h}_{m,k}^{\left(\mathrm{s}\right)}}{{\sigma }^2}\right).$$

(12)

4. Energy Efficiency for CCRN Problem Formulation and Solution

The total energy efficiency of the PUs and the SUs can be formulated as:

$$\eta ={\eta }^{\left(\mathrm{p}\right)}+{\eta }^{\left(\mathrm{s}\right)}.$$

(13)

In the following, we propose a joint resource allocation, power allocation, and relay selection strategy to maximize the total energy efficiency (13).

4.1. Optimization Problem Formulation

The energy efficiency based power allocation, transmission mode and relay selection scheme can be obtained by solving the following optimization problem:

$$\begin{array}{cc}\hfill & \underset{[{\beta }_m^{\left(\mathrm{d}\right)},{\beta }_{m,k}^{\left(\mathrm{c}\right)},P_m^{(\mathrm{p},\mathrm{d})},P_{m,k}^{(\mathrm{p},\mathrm{s})},P_{m,k}^{(\mathrm{p},\mathrm{r})},P_{m,k}^{\left(\mathrm{s}\right)}]}{max}\eta \hfill \\ \hfill \mathrm{s}.\mathrm{t}.& \mathrm{C}1:{\beta }_m^{\left(\mathrm{d}\right)}+\sum _{k=1}^K{\beta }_{m,k}^{\left(\mathrm{c}\right)}\le 1,m=1,2,...,M\hfill \\ \hfill & \mathrm{C}2:\sum _{m=1}^M{\beta }_{m,k}^{\left(\mathrm{c}\right)}\le 1,\hfill \\ \hfill & \mathrm{C}3:P_m^{(\mathrm{p},\mathrm{d})}\le P_m^{(\mathrm{p},max)},\mathrm{if}{\beta }_m^{\left(\mathrm{d}\right)}=1,\hfill \\ \hfill & \mathrm{C}4:P_{m,k}^{(\mathrm{p},\mathrm{s})}\le P_m^{(\mathrm{p},max)},\mathrm{if}{\beta }_{m,k}^{\left(\mathrm{c}\right)}=1,\hfill \\ \hfill & \mathrm{C}5:P_{m,k}^{(\mathrm{p},\mathrm{r})}+P_{m,k}^{\left(\mathrm{s}\right)}\le P_k^{(\mathrm{s},max)},\mathrm{if}{\beta }_{m,k}^{\left(\mathrm{c}\right)}=1,\hfill \\ \hfill & \mathrm{C}6:R_m^{(\mathrm{p},\mathrm{d})}\ge R_m^{(\mathrm{p},min)},\mathrm{if}{\beta }_m^{\left(\mathrm{d}\right)}=1,\hfill \\ \hfill & \mathrm{C}7:R_{m,k}^{(\mathrm{p},\mathrm{s})}\ge R_m^{(\mathrm{p},min)},\mathrm{if}{\beta }_{m,k}^{\left(\mathrm{c}\right)}=1,\hfill \\ \hfill & \mathrm{C}8:R_{m,k}^{(\mathrm{p},\mathrm{r})}\ge R_m^{(\mathrm{p},min)},\mathrm{if}{\beta }_{m,k}^{\left(\mathrm{c}\right)}=1,\hfill \\ \hfill & \mathrm{C}9:R_{m,k}^{\left(\mathrm{s}\right)}\ge R_{m,k}^{(\mathrm{s},min)},\mathrm{if}{\beta }_{m,k}^{\left(\mathrm{c}\right)}=1.\hfill \end{array}$$

(14)

C1 represents the transmission mode indicator constraint since it is assumed that every PU can only choose direct transmission mode or relay transmission mode. Similarly, C2 specifies the relay mode indicator constraint as it is assumed that every PU can choose only one SU as its relay node and each SU can only forward packets for one PU. C3, C4 and C5 denote the maximum power constraint where $P_m^{(\mathrm{p},\max )}$ and $P_k^{(\mathrm{s},\max )}$ denote respectively the maximum transmit power of the mth PU and the kth SU. C6-C9 represent the minimum data rate constraints where $R_m^{(\mathrm{p},\min )}$ and $R_k^{(\mathrm{s},\min )}$ denote respectively the minimum required data rate of the mth PU and the kth SU.

The optimization problem in (14) can be classified as a nonlinear binary fractional program and therefore difficult to solve using traditional optimization methods [31]. From the optimization constraints C3–C9 given in (14), it can be shown that such an optimization problem can be transformed equivalently into two subproblems: (1) power allocation, (2) transmission mode and relay selection. The solution for each subproblem is presented in the following subsections.

4.2. Power Allocation Subproblem

Assuming that the mth PU selects direct transmission mode, that is, ${\beta }_m^{\left(\mathrm{d}\right)}=1$, the energy efficient optimal power allocation problem can be formulated as:

$$\begin{array}{cc}\hfill & \underset{\left[P_m^{(\mathrm{p},\mathrm{d})}\right]}{max}\frac{R_m^{(\mathrm{p},\mathrm{d})}}{P_m^{(\mathrm{p},\mathrm{d})}+P_c^{\left(\mathrm{p}\right)}}\hfill \\ \hfill \mathrm{s}.\mathrm{t}.& \mathrm{C}1:P_m^{(\mathrm{p},\mathrm{d})}\le P_m^{(\mathrm{p},max)},\hfill \\ \hfill & \mathrm{C}2:R_m^{(\mathrm{p},\mathrm{d})}\ge R_m^{(\mathrm{p},min)}.\hfill \end{array}$$

(15)

For the relay transmission mode, when the mth PU selects the kth SU as its relay node, that is, ${\beta }_{m,k}^{\left(\mathrm{c}\right)}=1$, the energy efficiency of the PU-SU pair can be expressed as

$${\eta }_{m,k}^{(\mathrm{p},\mathrm{c})}+{\eta }_{m,k}^{\left(\mathrm{s}\right)}.$$

(16)

Therefore, the optimal power allocation problem for the mth PU and the kth SU can be formulated as:

$$\begin{array}{cc}\hfill & \underset{[P_{m,k}^{(\mathrm{p},\mathrm{s})},P_{m,k}^{(\mathrm{p},\mathrm{r})},P_{m,k}^{\left(\mathrm{s}\right)}]}{max}\frac{R_{m,k}^{(\mathrm{p},\mathrm{c})}}{P_{m,k}^{(\mathrm{p},\mathrm{c})}}+\frac{R_{m,k}^{\left(\mathrm{s}\right)}}{P_{m,k}^{\left(\mathrm{s}\right)}+P_{\mathrm{c}}^{\left(\mathrm{s}\right)}}\hfill \\ \hfill \mathrm{s}.\mathrm{t}.& \mathrm{C}1:P_{m,k}^{(\mathrm{p},\mathrm{s})}\le P_m^{(\mathrm{p},max)},\hfill \\ \hfill & \mathrm{C}2:P_{m,k}^{(\mathrm{p},\mathrm{r})}+P_{m,k}^{\left(\mathrm{s}\right)}\le P_k^{(\mathrm{s},max)},\hfill \\ \hfill & \mathrm{C}3:R_{m,k}^{(\mathrm{p},\mathrm{s})}\ge R_m^{(\mathrm{p},min)},\hfill \\ \hfill & \mathrm{C}4:R_{m,k}^{(\mathrm{p},\mathrm{r})}\ge R_m^{(\mathrm{p},min)},\hfill \\ \hfill & \mathrm{C}5:R_{m,k}^{\left(\mathrm{s}\right)}\ge R_{m,k}^{(\mathrm{s},min)}.\hfill \end{array}$$

(17)

4.2.1. Equivalent Problem Transformation

In order to solve the optimization problem in (17), we exploit the fractional programming approach [37]. As we mentioned earlier, we are considering DF at the relay node. In case $R_{m,k}^{(\mathrm{p},\mathrm{s})}<R_{m,k}^{(\mathrm{p},\mathrm{r})}$, our optimization problem becomes:

$$\begin{array}{cc}\hfill & \underset{[P_{m,k}^{(\mathrm{p},\mathrm{s})},P_{m,k}^{(\mathrm{p},\mathrm{r})},P_{m,k}^{\left(\mathrm{s}\right)}]}{max}\frac{R_{m,k}^{(\mathrm{p},\mathrm{s})}}{P_{m,k}^{(\mathrm{p},\mathrm{c})}}+\frac{R_{m,k}^{\left(\mathrm{s}\right)}}{P_{m,k}^{\left(\mathrm{s}\right)}+P_{\mathrm{c}}^{\left(\mathrm{s}\right)}}\hfill \\ \hfill \mathrm{s}.\mathrm{t}.& \mathrm{C}1:P_{m,k}^{(\mathrm{p},\mathrm{s})}\le P_m^{(\mathrm{p},max)},\hfill \\ \hfill & \mathrm{C}2:P_{m,k}^{(\mathrm{p},\mathrm{r})}+P_{m,k}^{\left(\mathrm{s}\right)}\le P_k^{(\mathrm{s},max)},\hfill \\ \hfill & \mathrm{C}3:R_{m,k}^{(\mathrm{p},\mathrm{s})}<R_{m,k}^{(\mathrm{p},\mathrm{r})},\hfill \\ \hfill & \mathrm{C}4:R_{m,k}^{(\mathrm{p},\mathrm{s})}\ge R_m^{(\mathrm{p},min)},\hfill \\ \hfill & \mathrm{C}5:R_{m,k}^{(\mathrm{p},\mathrm{r})}\ge R_m^{(\mathrm{p},min)},\hfill \\ \hfill & \mathrm{C}6:R_{m,k}^{\left(\mathrm{s}\right)}\ge R_{m,k}^{(\mathrm{s},min)}.\hfill \end{array}$$

(18)

To proceed, we rewrite the problem in (18) into an equivalent form [38]:

$$\begin{array}{cc}\hfill & \underset{[P_{m,k}^{(\mathrm{p},\mathrm{s})},P_{m,k}^{(\mathrm{p},\mathrm{r})},P_{m,k}^{\left(\mathrm{s}\right)},{\alpha }_1,{\alpha }_2]}{max}{\alpha }_1+{\alpha }_2\hfill \\ \hfill \mathrm{s}.\mathrm{t}.& \mathrm{C}1-\mathrm{C}6\mathrm{in}\left(18\right),\hfill \\ \hfill & \mathrm{C}7:\frac{R_{m,k}^{(\mathrm{p},\mathrm{s})}}{P_{m,k}^{(\mathrm{p},\mathrm{c})}}\ge {\alpha }_1,\hfill \\ \hfill & \mathrm{C}8:\frac{R_{m,k}^{\left(\mathrm{s}\right)}}{P_{m,k}^{\left(\mathrm{s}\right)}+P_{\mathrm{c}}^{\left(\mathrm{s}\right)}}\ge {\alpha }_2,\hfill \end{array}$$

(19)

where C7 and C8 denote the energy efficiency constraints.

Theorem 1.

If the set ($P_{m,k}^{(\mathrm{p},\mathrm{s})*},P_{m,k}^{(\mathrm{p},\mathrm{r})*},P_{m,k}^{\left(\mathrm{s}\right)*},{\alpha }_1^{*},{\alpha }_2^{*}$) is the solution for (19), then there exist ν and κ such that ($P_{m,k}^{(\mathrm{p},\mathrm{s})*},P_{m,k}^{(\mathrm{p},\mathrm{r})*},P_{m,k}^{\left(\mathrm{s}\right)*}$) satisfies that Karush-Kuhn-Tucker (KKT) conditions for $\nu =\overline{\nu }$, $\kappa =\overline{\kappa }$, ${\alpha }_1={\alpha }_1^{*}$, ${\alpha }_2={\alpha }_2^{*}$ of the following problem [39]

$$\begin{array}{cc}\hfill & \underset{[P_{m,k}^{(\mathrm{p},\mathrm{s})},P_{m,k}^{(\mathrm{p},\mathrm{r})},P_{m,k}^{\left(\mathrm{s}\right)}]}{max}\varphi \hfill \\ \hfill \mathrm{s}.\mathrm{t}.& \mathrm{C}1-\mathrm{C}6\mathrm{in}\left(18\right),\hfill \end{array}$$

(20)

where $\varphi =\nu (R_{m,k}^{(\mathrm{p},\mathrm{s})}-{\alpha }_1{P}_{m,k}^{(\mathrm{p},\mathrm{c})})+\kappa (R_{m,k}^{\left(\mathrm{s}\right)}-{\alpha }_2(P_{m,k}^{\left(\mathrm{s}\right)}+P_c^{\left(\mathrm{s}\right)}))$. Also the set of solutions satisfies a system of equations for $\nu =\overline{\nu }$, $\kappa =\overline{\kappa }$, ${\alpha }_1={\alpha }_1^{*}$, and ${\alpha }_2={\alpha }_2^{*}$, with

$$\begin{array}{c}\hfill \left\{\begin{array}{cc}\overline{\nu }=\frac{1}{P_{m,k}^{(\mathrm{p},\mathrm{c})}}\hfill & \overline{\kappa }=\frac{1}{P_{m,k}^{\left(\mathrm{s}\right)}+P_c^{\left(\mathrm{s}\right)}}\hfill \\ {\alpha }_1^{*}=\frac{R_{m,k}^{(\mathrm{p},\mathrm{s})}}{P_{m,k}^{(\mathrm{p},\mathrm{c})}}\hfill & {\alpha }_2^{*}=\frac{R_{m,k}^{\left(\mathrm{s}\right)}}{P_{m,k}^{\left(\mathrm{s}\right)}+P_c^{\left(\mathrm{s}\right)}}.\hfill \end{array}\right.\end{array}$$

(21)

Proof for Theorem 1 is provided in Appendix A.

In Theorem 1 we proved that by satisfying the system of equations in (21) among the solutions of (20), the optimization problem in (18) can be solved. It shows as well that for an optimization problem with an objective function in fractional form, there exists an equivalent in subtractive form, that is, $\varphi$ in our case. As a result, we use the equivalent objective function for the rest of the paper.

4.2.2. Energy Efficiency Maximization

In this section we present an iterative algorithm in order to find solutions for the problem in (20). After transforming our problem (18) into (20), it can be easily proven that the tranformed problem is convex and can be solved using the Lagrange dual method [40,41]. Thus, by relaxing the constraints the Lagrange function can be represented as

$$\begin{array}{cc}\hfill & \mathcal{L}(P_{m,k}^{(\mathrm{p},\mathrm{r})},P_{m,k}^{(\mathrm{p},\mathrm{s})},P_{m,k}^{\left(\mathrm{s}\right)},\lambda ,\delta ,ϵ,\xi ,\theta ,\mu ,\nu ,\kappa )=\hfill \\ \hfill & +\nu (R_{m,k}^{(\mathrm{p},\mathrm{s})}-{\alpha }_1\left(P_{m,k}^{(\mathrm{p},\mathrm{c})}\right))+\kappa (R_{m,k}^{\left(\mathrm{s}\right)}-{\alpha }_2(P_{m,k}^{\left(\mathrm{s}\right)}+P_c^{\left(\mathrm{s}\right)}))\hfill \\ \hfill & +\lambda (P_m^{\left(\right(\mathrm{p},\max )}-P_{m,k}^{(\mathrm{p},\mathrm{s})})+\delta (P_k^{(\mathrm{s},\max )}-P_{m,k}^{(\mathrm{p},\mathrm{r})}-P_{m,k}^{\left(\mathrm{s}\right)})\hfill \\ & +ϵ(R_{m,k}^{(\mathrm{p},\mathrm{r})}-R_{m,k}^{(\mathrm{p},\mathrm{s})})+\xi (R_{m,k}^{(\mathrm{p},\mathrm{s})}-R_m^{(\mathrm{p},min)})\hfill \\ \hfill & +\delta (R_{m,k}^{(\mathrm{p},\mathrm{r})}-R_m^{(\mathrm{p},min)})+\mu (R_{m,k}^{\left(\mathrm{s}\right)}-R_k^{(\mathrm{s},min)}),\hfill \end{array}$$

(22)

where $\lambda ,\delta >0$ and $ϵ,\xi ,\theta ,\mu >0$ represent the Lagrange multipliers associated with power constraints and minimum data rate requirements, respectively. The corresponding Lagrange dual method can be expressed as follows:

$$\begin{array}{cc}\hfill & \underset{[\lambda ,\delta ,ϵ,\xi ,\theta ,\mu ]}{min}\underset{[P_{m,k}^{(\mathrm{p},\mathrm{r})},P_{m,k}^{(\mathrm{p},\mathrm{s})},P_{m,k}^{\left(\mathrm{s}\right)}]}{max}\mathcal{L}\hfill \\ \hfill \mathrm{s}.\mathrm{t}.& \lambda \ge 0,\delta \ge 0,ϵ\ge 0,\xi \ge 0,\theta \ge 0,\mu \ge 0.\hfill \end{array}$$

(23)

The above dual problem can be solved by optimizing the transmit power for a fixed set of Lagrange multipliers, and updating the Lagrange multipliers iteratively as well as our parameters $\nu ,\kappa ,{\alpha }_1,{\alpha }_2$. For a given set of Lagrange multipliers $\lambda ,\delta ,ϵ,\xi ,\theta ,\mu$, the locally optimal transmit powers can be obtained through calculating the derivative of $\mathcal{L}(P_{m,k}^{(\mathrm{p},\mathrm{r})},P_{m,k}^{(\mathrm{p},\mathrm{s})},P_{m,k}^{\left(\mathrm{s}\right)},\lambda ,\delta ,ϵ,\xi ,\theta ,\mu )$ over the transmit powers and setting it to zero thus obtaining

$$P_{m,k}^{(\mathrm{p},\mathrm{s})*}={\left[\frac{t_1{\rho }_{m}B(\nu +\xi -ϵ)}{(\lambda +\nu {\alpha }_1)ln2}-\frac{{\sigma }^2}{h_{m,k}^{(\mathrm{p},\mathrm{s})}}\right]}^{+}$$

(24)

$$P_{m,k}^{(\mathrm{p},\mathrm{r})*}={\left[\frac{(1-t_1){\rho }_{m}B(ϵ+\theta )}{(\delta +\nu {\alpha }_1)ln2}-\frac{{\sigma }^2}{h_{m,k}^{(\mathrm{p},\mathrm{r})}}\right]}^{+}$$

(25)

$$P_{m,k}^{\left(\mathrm{s}\right)*}={\left[\frac{(1-{\rho }_m)B(\mu +\kappa )}{(\delta +\kappa {\alpha }_2)ln2}-\frac{{\sigma }^2}{h_{m,k}^{\left(\mathrm{s}\right)}}\right]}^{+},$$

(26)

where ${\left[z\right]}^{+}=max(0,z)$.

In case $R_{m,k}^{(\mathrm{p},\mathrm{s})}\ge R_{m,k}^{(\mathrm{p},\mathrm{r})}$, a similar approach can be followed, leading to the optimization problem:

$$\begin{array}{cc}\hfill & \underset{[P_{m,k}^{(\mathrm{p},\mathrm{s})},P_{m,k}^{(\mathrm{p},\mathrm{r})},P_{m,k}^{\left(\mathrm{s}\right)}]}{max}\frac{R_{m,k}^{(\mathrm{p},\mathrm{s})}}{P_{m,k}^{(\mathrm{p},\mathrm{c})}}+\frac{R_{m,k}^{\left(\mathrm{s}\right)}}{P_{m,k}^{\left(\mathrm{s}\right)}+P_{\mathrm{c}}^{\left(\mathrm{s}\right)}}\hfill \\ \hfill \mathrm{s}.\mathrm{t}.& \mathrm{C}1:P_{m,k}^{(\mathrm{p},\mathrm{s})}\le P_m^{(\mathrm{p},max)},\hfill \\ \hfill & \mathrm{C}2:P_{m,k}^{(\mathrm{p},\mathrm{r})}+P_{m,k}^{\left(\mathrm{s}\right)}\le P_k^{(\mathrm{s},max)},\hfill \\ \hfill & \mathrm{C}3:R_{m,k}^{(\mathrm{p},\mathrm{s})}\ge R_{m,k}^{(\mathrm{p},\mathrm{r})},\hfill \\ \hfill & \mathrm{C}4:R_{m,k}^{(\mathrm{p},\mathrm{s})}\ge R_m^{(\mathrm{p},min)},\hfill \\ \hfill & \mathrm{C}5:R_{m,k}^{(\mathrm{p},\mathrm{r})}\ge R_m^{(\mathrm{p},min)},\hfill \\ \hfill & \mathrm{C}6:R_{m,k}^{\left(\mathrm{s}\right)}\ge R_{m,k}^{(\mathrm{s},min)}.\hfill \end{array}$$

(27)

By applying to (28) the same transformation explained in Theorem 1 and applying Lagrange dual method to the transformed problem, we are able to calculate the transmit powers:

$$P_{m,k}^{(\mathrm{p},\mathrm{s})*}={\left[\frac{t_1{\rho }_{m}B(\xi +ϵ)}{(\lambda +\nu {\alpha }_1)ln2}-\frac{{\sigma }^2}{h_{m,k}^{(\mathrm{p},\mathrm{s})}}\right]}^{+}$$

(28)

$$P_{m,k}^{(\mathrm{p},\mathrm{r})*}={\left[\frac{(1-t_1){\rho }_{m}B(\nu -ϵ+\theta )}{(\delta +\nu {\alpha }_1)ln2}-\frac{{\sigma }^2}{h_{m,k}^{(\mathrm{p},\mathrm{r})}}\right]}^{+}$$

(29)

$$P_{m,k}^{\left(\mathrm{s}\right)*}={\left[\frac{(1-{\rho }_m)B(\mu +\kappa )}{(\delta +\kappa {\alpha }_2)ln2}-\frac{{\sigma }^2}{h_{m,k}^{\left(\mathrm{s}\right)}}\right]}^{+}.$$

(30)

Based on these solutions, we propose a two-layer optimization algorithm. In the inner layer the Lagrange multipliers in (24)–(26) and (28)–(30) can be updated through using the subgradient method [42], that is,

$$\lambda (n+1)={[\lambda \left(n\right)-\psi (P_m^{(\mathrm{p},max)}-P_{m,k}^{(\mathrm{p},\mathrm{s})})]}^{+}$$

(31)

$$\delta (n+1)={[\delta \left(n\right)-\psi (P_k^{(\mathrm{s},max)}-P_{m,k}^{(\mathrm{p},\mathrm{r})}-P_{m,k}^{\left(\mathrm{s}\right)})]}^{+}$$

(32)

$$ϵ(n+1)={[ϵ\left(n\right)-\psi |R_{m,k}^{(\mathrm{p},\mathrm{r})}-R_{m,k}^{(\mathrm{p},\mathrm{s})}\left|\right]}^{+}$$

(33)

$$\xi (n+1)={[\xi \left(n\right)-\psi (R_{m,k}^{(\mathrm{p},\mathrm{s})}-R_m^{(\mathrm{p},min)})]}^{+}$$

(34)

$$\theta (n+1)={[\theta \left(n\right)-\psi (R_{m,k}^{(\mathrm{p},\mathrm{r})}-R_m^{(\mathrm{p},min)})]}^{+}$$

(35)

$$\mu (n+1)={[\mu \left(n\right)-\psi (R_{m,k}^{\left(\mathrm{s}\right)}-R_k^{(\mathrm{s},min)})]}^{+},$$

(36)

where $\psi$ denotes the learning rate.

In the outer layer the parameters $\nu ,\kappa ,{\alpha }_1,{\alpha }_2$ can be updated using Newton-Raphson method [43], that is,

$$\nu (n+1)=\nu \left(n\right)-\chi \left(\frac{\nu \left(n\right)P_{m,k}^{(\mathrm{p},\mathrm{c})}-1}{P_{m,k}^{(\mathrm{p},\mathrm{c})}}\right)$$

(37)

$$\kappa (n+1)=\kappa \left(n\right)-\chi \left(\frac{\kappa (P_{m,k}^{\left(\mathrm{s}\right)}+P_{\mathrm{c}}^{\left(\mathrm{s}\right)})-1}{P_{m,k}^{\left(\mathrm{s}\right)}+P_{\mathrm{c}}^{\left(\mathrm{s}\right)}}\right)$$

(38)

$${\alpha }_1(n+1)={\alpha }_1\left(n\right)-\chi \left(\frac{{\alpha }_1\left(n\right)P_{m,k}^{(\mathrm{p},\mathrm{c})}-\tau }{P_{m,k}^{(\mathrm{p},\mathrm{c})}}\right)$$

(39)

$${\alpha }_2(n+1)={\alpha }_2\left(n\right)-\chi \left(\frac{{\alpha }_2\left(n\right)(P_{m,k}^{\left(\mathrm{s}\right)}+P_c^{\left(\mathrm{s}\right)})-R_{m,k}^{\left(\mathrm{s}\right)}}{P_{m,k}^{\left(\mathrm{s}\right)}+P_c^{\left(\mathrm{s}\right)}}\right),$$

(40)

where $\chi$ denotes the learning rate and $\tau =min(R_{m,k}^{(\mathrm{p},\mathrm{s})},R_{m,k}^{(\mathrm{p},\mathrm{r})})$. Detailed steps of our algorithm are shown in Algorithm 1.

Algorithm 1. Power Allocation Optimization
1:	Set tollerance $\zeta$ and maximum number of iterations $n_{max}$
	Let $n=0$, choose $\psi \in (0,1)$, $\chi \in (0,1)$
	Choose arbitrarily $P_{m,k}^{(\mathrm{p},\mathrm{s})}\left(0\right)$, $P_{m,k}^{(\mathrm{p},\mathrm{r})}\left(0\right)$,$P_{m,k}^{\left(\mathrm{s}\right)}\left(0\right)$ such that satisfies
	power constraints
	Calculate $R_{m,k}^{(\mathrm{p},\mathrm{s})}\left(0\right)$, $R_{m,k}^{(\mathrm{p},\mathrm{r})}\left(0\right)$ and $R_{m,k}^{\left(\mathrm{s}\right)}\left(0\right)$
	if$R_{m,k}^{(\mathrm{p},\mathrm{s})}<R_{m,k}^{(\mathrm{p},\mathrm{r})}$
		then$\tau =R_{m,k}^{\left(\right(\mathrm{p},\mathrm{s})}$
	else$\tau =R_{m,k}^{(\mathrm{p},\mathrm{r})}$
	end
	Let
				$\left\{\begin{array}{c}\nu \left(n\right)=\frac{1}{P_{m,k}^{(\mathrm{p},\mathrm{c})}\left(n\right)}\hfill \\ \kappa \left(n\right)=\frac{1}{P_{m,k}^{\left(\mathrm{s}\right)}\left(n\right)+P_c^{\left(\mathrm{s}\right)}}\hfill \\ {\alpha }_1\left(n\right)=\frac{\tau }{P_{m,k}^{(\mathrm{p},\mathrm{c})}\left(n\right)}\hfill \\ {\alpha }_2\left(n\right)=\frac{R_{m,k}^{\left(\mathrm{s}\right)}\left(n\right)}{P_{m,k}^{\left(\mathrm{s}\right)}\left(n\right)+P_c^{\left(\mathrm{s}\right)}}\hfill \end{array}\right.$
	Initialize the Lagrange multipliers $\lambda ,\delta ,ϵ,\xi ,\theta ,\mu$
2:	if$\tau =R_{m,k}^{(\mathrm{p},\mathrm{s})}$
		update $P_{m,k}^{(\mathrm{p},\mathrm{s})}$ and $P_{m,k}^{(\mathrm{p},\mathrm{r})}$ with (24) and (25) and
		obtain $P_{m,k}^{(\mathrm{p},\mathrm{s})*}$ and $P_{m,k}^{(\mathrm{p},\mathrm{r})*}$
	else
		update $P_{m,k}^{(\mathrm{p},\mathrm{s})}$ and $P_{m,k}^{(\mathrm{p},\mathrm{r})}$ with (28) and (29) and
		obtain $P_{m,k}^{(\mathrm{p},\mathrm{s})*}$ and $P_{m,k}^{(\mathrm{p},\mathrm{r})*}$
	end
	Update $P_{m,k}^{\left(\mathrm{s}\right)}$ with (26) and obtain $P_{m,k}^{\left(\mathrm{s}\right)*}$
3:	Update the Lagrange multipliers using (31)–(36)
4:	Compute ${\varphi }^{*}$ with $P_{m,k}^{(p,s)*}$, $P_{m,k}^{(p,r)*}$ and $P_{m,k}^{\left(s\right)*}$
	if$|{\varphi }^{*}-{\varphi }^{\left(n\right)}|\le \zeta$
		$P_{m,k}^{(\mathrm{p},\mathrm{s})}(n+1)=P_{m,k}^{(\mathrm{p},\mathrm{s})*}$, $P_{m,k}^{(\mathrm{p},\mathrm{r})}(n+1)=P_{m,k}^{(\mathrm{p},\mathrm{r})*}$, $P_{m,k}^{\left(\mathrm{s}\right)}(n+1)=P_{m,k}^{\left(\mathrm{s}\right)*}$
		exit program (convergence reached)
	else
		$P_{m,k}^{(\mathrm{p},\mathrm{s})}\left(n\right)=P_{m,k}^{(\mathrm{p},\mathrm{s})*}$, $P_{m,k}^{(\mathrm{p},\mathrm{r})}\left(n\right)=P_{m,k}^{(\mathrm{p},\mathrm{r})*}$, $P_{m,k}^{\left(\mathrm{s}\right)}\left(n\right)=P_{m,k}^{\left(\mathrm{s}\right)*}$
		$\varphi \left(n\right)$ = ${\varphi }^{*}$
		update $\nu ,\kappa ,{\alpha }_1,{\alpha }_2$ using (37)–(40)
		Update $R_{m,k}^{(\mathrm{p},\mathrm{s})}(n+1),R_{m,k}^{(\mathrm{p},\mathrm{r})}(n+1),R_{m,k}^{\left(\mathrm{s}\right)}(n+1)$
		$n\leftarrow n+1$
	end
	go to step 2 unless n reached $n_{max}$

For the problem in (15), a similar approach can be followed. By transforming it using Theorem 1 and applying the Lagrange dual method, the optimal transmit power for the direct mode can be obtained.

4.3. Transmission Mode and Relay Selection Subproblem

Given the optimal transmit power of the PUs and the SUs, the total energy efficiency of the network can be calculated as:

$$\begin{array}{c}\hfill {\eta }^{*}=\sum _{m=1}^M\sum _{k=1}^K({\beta }_m^{\left(\mathrm{d}\right)}{\eta }_m^{*}+{\beta }_{m,k}^{\left(\mathrm{c}\right)}{\eta }_{m,k}^{*}).\end{array}$$

(41)

The transmission mode and relay selection subproblem can be formulated as:

$$\begin{array}{cc}\hfill & \underset{[{\beta }_m^{\left(\mathrm{d}\right)},{\beta }_{m,k}^{\left(\mathrm{c}\right)}]}{max}{\eta }^{*}\hfill \\ \hfill \mathrm{s}.\mathrm{t}.& \mathrm{C}1:{\beta }_m^{\left(\mathrm{d}\right)}+\sum _{k=1}^K{\beta }_{m,k}^{\left(\mathrm{c}\right)}\le 1,\hfill \\ \hfill & \mathrm{C}2:\sum _{m=1}^M{\beta }_{m,k}^{\left(\mathrm{c}\right)}\le 1,\hfill \end{array}$$

(42)

which is a linear binary optimization problem, that can be solved using graph-based optimization method [44]. To implement such optimization problem, we construct two tables:

Table 1. Tables of direct mode and cooperative mode.

(a) Direct Mode		(b) Cooperative Mode
	Direct Mode	Coop. with SU${}_{\mathbf{1}}$	Coop. with SU${}_{\mathbf{2}}$	⋯	Coop. with SU${}_{\mathbf{K}}$
PU${}_1$	${\eta }_1^{*}$	${\eta }_{1,1}^{*}$	${\eta }_{1,2}^{*}$	⋯	${\eta }_{1,K}^{*}$
PU${}_2$	${\eta }_2^{*}$	${\eta }_{2,1}^{*}$	${\eta }_{2,2}^{*}$	⋯	${\eta }_{2,K}^{*}$
⋯		⋯			⋯
PU${}_M$	${\eta }_M^{*}$	${\eta }_{M,1}^{*}$	${\eta }_{M,2}^{*}$	⋯	${\eta }_{M,K}^{*}$

a, whose columns contain the maximum energy efficiency when the mth PU chooses direct transmission mode; Table 1b, which contain the optimal energy efficiency when the mth PU chooses the kth SU as a relay node for cooperation mode.

It can be seen that the optimal transmission mode and relay selection solution of (42) is equivalent to finding the maximum sum of the energy efficiency elements which are chosen from various rows and columns, except for the direct mode. From (42), we can see that when the energy efficiency of the cell where only direct transmission is available is larger than all the energy efficiency of a cell where relay transmission is adopted, the PU should choose the direct mode. Hence, to solve the optimization problem formulated in (42), for the mth row, $1\le m\le M$, we first compare the element in direct mode with the other elements in the same row number in Table 1b; if the energy efficiency of the PU obtained in direct mode is the largest, then we set ${\beta }_m^{\left(\mathrm{d}\right)}=1,{\beta }_{m,k}^{\left(\mathrm{c}\right)}=0$, and delete the corresponding row in Table 1b. For the remaining, we can solve the optimal relay selection subproblem for cooperation transmission mode.

Given the constraints on both PUs and SUs, the optimal relay selection subproblem can be described as a bipartite graph, and the problem of finding the optimal relay can be regarded as an optimal matching algorithm in the bipartite graph that can be solved by a modified Kuhn-Munkres (K-M) algorithm [45,46]. A brief description of this algorithm and of its complexity is presented in Appendix B.

Based on the optimal relay selection results, we obtain the corresponding energy efficiency for cooperative mode, which is compared with that obtained from the direct mode for each PU. If the latter is larger, we set in direct mode the corresponding PU and rerun the K-M algorithm until the optimal energy efficiency obtained for cooperative mode is larger than that from the direct mode for all the PUs. In Algorithm 2, we present a brief description of the algorithm.

Algorithm 2. Transmission Mode and Relay Selection Optimization
1:	Solving optimal power allocation subproblem
	to obtain ${\eta }_m^{*}$ and ${\eta }_{m,k}^{*}$, construct Table 1
2:	for the mth PU
	if ${\eta }_m^{*}>{\eta }_{m,k}^{*}$, $\forall 1\le k\le K$
		then
		set ${\beta }_m^{(\mathrm{p},\mathrm{d})}=1$
		delete the mth row in Table 1b
		end
	end
	Table 1b is updated
3:	repeat
4:	Apply K-M algorithm on Table 1b to find
	optimal relay node obtaining ${\beta }_{m,k}^{\left(\mathrm{c}\right)}$
5:	if${\beta }_{m,k}^{\left(\mathrm{c}\right)}{\eta }_{m,k}^{*}<{\eta }_m^{*},1\le m\le M$
		set ${\beta }_m^{(\mathrm{p},\mathrm{d})}=1$
		set ${\beta }_{m,k}^{\left(\mathrm{c}\right)}=0$
		Update Table 1b removing the mth row
	end
6:	until${\beta }_{m,k}^{\left(\mathrm{c}\right)}{\eta }_{m,k}^{*}>{\eta }_m^{*}$,∀ PU${}_m$ in Table 1b.

5. Results

In this section, we evaluate the system performance and effectiveness of the proposed solution throughout Monte Carlo simulations. A single PUs’ cell of $250$m radius is considered (see Figure 1), and a summary of the scenario parameters are shown in

Table 2. System parameters.

Cell radius	$250$m
Small scale fading distribution	Rayleigh fading
Carrier frequency	$3.5$GHz
Bandwidth	$50$MHz
Noise power per link, ${\sigma }^2$	$-90$dBm
Shadowing, $s_{m,k}^{(\mathrm{p},\mathrm{s})}$	Log-normal with standard deviation of $8$dB
Average channel gain at 1 m, $k_0$	$-39$dB
Path-loss exponent, $\gamma$	3
Circuit power per UE (PU or SU), $P_{\mathrm{c}}$	$20$dBm
Maximum transmit power per UE, $P_{max}$	$24$dBm
Minimum data rate constraint, $R_m^{(\mathrm{p},min)}$	$100$Mbit/s
Fraction of bandwidth, ${\rho }_m$	$0.66$

. Results are obtained averaging over 5000 independent configuration snapshots, each one with different PUs’ and SUs’ positions within the cell (PUs and SUs are uniformly distributed within the area), and independent realizations of shadowing and fading. Regarding the time slot subdivision between PU and SU, we initially assume $t_1=T/2$, which is the choice maximizing energy efficiency, as shown in Section 5.6.

5.1. Convergence of the Iterative Algorithm

In Figure 3, we show the energy efficiency in deciBel, that is, $\eta \left(\mathrm{dB}\right)=10{log}_{10}\eta$, for different values of PUs’ and SUs’ circuit power, $P_{\mathrm{c}}$, as a function of the number of iterations, to illustrate the convergence of the proposed algorithm. It can be seen that the iterative algorithm generates a nondecreasing sequence and converges to a stable point within 15 iterations. In addition, we can observe the effect of $P_{\mathrm{c}}$ to energy efficiency. As expected, the energy efficiency decreases with the increase of $P_{\mathrm{c}}$.

5.2. Energy Efficiency Versus Maximum Transmit Power

In Figure 4, the average energy efficiency varying the maximum transmit power, $P_{max}$, is presented. The number of PUs and SUs is chosen randomly at every adaptation with a maximum number of 10 PUs and 10 SUs. From the figure, it can be observed that the energy efficiency increases with an increase of $P_{max}$ up to approximately $0.1$W, beyond which the energy efficiency saturates. Besides, we compare the performance of our solution with three different algorithms:

• A random choice algorithm in which PUs choose cooperative relays randomly.
• A non-cooperative approach in which a similar system model is considered but PUs choose relays to increase their own energy efficiency, instead of maximizing the total energy efficiency of the system.
• A system in which there are only PUs, and therefore only direct transmission is possible.

As can be observed, the proposed algorithm outperforms the other three solutions. In addition, compared to a system where only PUs are present, we can show that with our approach having the same available spectrum, higher energy efficiency can be achieved, and also more users are able to use the resources available.

5.3. Energy Efficiency Versus Number of Pus

Figure 5 illustrates the effect that an increasing number of PUs have on energy efficiency when the number of SUs is set to 10. When the number of PUs is smaller than the number of SUs, we can observe a higher energy efficiency achieved. However, increasing the number of PUs, the energy efficiency decreases because of the increased contention of PUs to choose the most convenient cooperative relay. When the number of PUs becomes larger than the number of SUs, the decline of the curve becomes sharper. This comes from the fact that not every PU can choose a cooperative relay and is bounded to perform a direct transmission. As we have shown before, the energy efficiency based only on direct transmission is lower than the one based on the cooperative relay.

5.4. Energy Efficiency Versus Path Loss Exponent

In Figure 6, the average energy efficiency varying the path-loss exponent, $\gamma$, is presented. With the increase of $\gamma$, the energy efficiency decreases; this is due to the increased attenuation, which reflects in a lower data rate. Also, it can be seen that our algorithm outperforms the energy efficiency obtained from the scheme proposed in Reference [18], in which only PUs’ power is optimized, the non-cooperative approach, as well as a system where only PUs are present. In harsh propagation environments with $\gamma >3.5$, the energy efficiency of the proposed algorithm outperforms the direct transmission scenario by approximately 110% and the proposed scheme in Reference [18] by 10%.

5.5. Energy Efficiency Versus Shadowing Standard Deviation

In Figure 7, we illustrate the average energy efficiency varying the shadowing standard deviation. As can be seen, also considering the previous figure, the proposed algorithm is more robust to shadowing and attenuation hence offers better performance in harsh propagation environments. The proposed scheme outperforms the direct transmission scenario by 72% and the proposed scheme in Reference [18] by nearly 20%.

5.6. Energy Efficiency Versus Time Slot Division

In Figure 8, the average energy efficiency varying the time slot division chosen in the two relay transmission links is illustrated. As we notice in the figure, when both links have the same duration, we can achieve the highest value of energy efficiency. In addition, it can be observed that the variation between the maximum, for $t_1/T=0.5$, and minimum value, for $t_1/T=0.9$, of energy efficiency is not very high. This fact confirms the robustness of the proposed algorithm to the choice of the time slot division in the relay transmission.

6. Conclusions

In this paper, a novel energy-efficient architecture for CRN is proposed where each PU can choose one SU as a relay node. To encourage the cooperative behavior of the SUs, PUs lease a fraction of their allocated spectrum to the relay SUs to transmit their data. We proposed a centralized resource management network architecture to achieve a performance enhancement of the network. The resource allocation problem is formulated as a constrained sum energy efficiency maximization problem. Our analysis shows that this problem can be divided into two subproblems: (1) power allocation, (2) transmission mode and relay selection. To tackle the sum-of-ratio form of the power allocation subproblem, we transform it into a subtractive form optimization problem, and then closed-form optimal powers are calculated through a two-layer optimization. A modified K-M algorithm bipartite matching algorithm is used to solve the transmission mode and relay selection subproblem. System simulations performed in a typical multiuser case show that the proposed algorithm converges to the solution within a small number of iterations. In addition, simulations show an increment in the energy efficiency of the PUs network performance compared to previously proposed algorithms when channel conditions get worse. In addition our proposed algorithm shows a robustness to the choice of the time division in the relay transmission. Furthermore, in the system simulations we illustrated the effect that an increasing number of PUs have on the energy efficiency of the cell. Future work will deal with the use of 3D image-based algorithms to acquire more realistic channel characteristics in more realistic scenarios. In addition, we will consider comparing our algorithm with some existing non-CCRNs-based schemes.