Next Article in Journal
Large Eddy Simulation of Rotationally Induced Ingress and Egress around an Axial Seal between Rotor and Stator Disks
Previous Article in Journal
Decentralized Control for the Cell Power Balancing of a Cascaded Full-Bridge Multilevel Converter
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Optimal Tuning of Fractional Order Sliding Mode Controller for PMSM Speed Using Neural Network with Reinforcement Learning

by
Younes Zahraoui
1,
Fardila M. Zaihidee
2,*,
Mostefa Kermadi
3,
Saad Mekhilef
3,4,5,
Ibrahim Alhamrouni
6,
Mehdi Seyedmahmoudian
3 and
Alex Stojcevski
3
1
FinEst Centre for Smart Cities, Tallinn University of Technology, Ehitajate tee 5, 19086 Tallinn, Estonia
2
Faculty of Technical and Vocational, Sultan Idris Education University, Tanjong Malim 35900, Malaysia
3
Power Electronics and Renewable Energy Research Laboratory (PEARL), Department of Electrical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia
4
School of Software and Electrical Engineering, Faculty of Science, Engineering and Technology, Swinburne University of Technology, Victoria, VIC 3122, Australia
5
Institute of Sustainable Energy, Universiti Tenaga Nasional (The National Energy University), Jalan Ikram Uniten, Kajang 43000, Selangor, Malaysia
6
Department of EEE, Universiti Kuala Lumpur, British Malaysian Institute, 8, Jalan Sungai Pusu, Gombak 53100, Selangor, Malaysia
*
Author to whom correspondence should be addressed.
Energies 2023, 16(11), 4353; https://doi.org/10.3390/en16114353
Submission received: 27 February 2023 / Revised: 29 April 2023 / Accepted: 17 May 2023 / Published: 26 May 2023
(This article belongs to the Section E: Electric Vehicles)

Abstract

:
An improved fractional-order sliding mode control (FOSMC) for PMSM is presented in this study to set the unavoidable parameters and to improve permanent magnet synchronous motors (PMSMs) drive performance, such as current and speed tracking accuracy. To determine the optimal parameters of the FOSMC for control speed in a PMSM drive, a neural network algorithm with reinforcement learning (RLNNA) is proposed. The FOSMC parameters are set by the ANN algorithm and then adapted through reinforcement learning to enhance the results. The proposed controller using RLNNA based on fractional-order sliding mode control (RLNNA-FOSMC) can drive the motor speed to achieve the referred value in a finite period of time, leading to faster convergence and improved tracking accuracy. For a fair comparison and evaluation, the proposed RLNNA-FOSMC is compared with conventional FOSMC by applying the integral of time multiplied absolute error as an objective function. The most commonly used objective functions in the literature were also compared, including the integral time multiplied square error, integral square error, and integral absolute error. To validate the performance of the RLNNA-FOSMC speed controller, different scenarios with different speeds steps were carried out. The computational results are promising and demonstrate the effectiveness of the proposed controller. Overall, the proposed RLNNA-FOSMC controller for the PMSM speed control system performed better than conventional FOSMC in numerical simulations.

1. Introduction

Permanent magnet synchronous motors (PMSMs) have been widely utilized in various industrial and daily life applications, including electric traction, automotive, robotics, and servomechanisms, due to their great efficiency, high torque to inertia ratio, high power factor, rapid reaction, and durable design. PMSM drives are preferred in many applications [1]. Mainly, several electromechanical parameters variations, speed, and position tracking control are the most challenging in PMSM [2]. In order to solve these challenges, various advanced control methods have been presented recently [3]. One of the popular methods that have been introduced in the literature is sliding mode control (SMC), which is successfully applied for the PMSM control [4]. SMC is a model of variable structure system (VSS), which allows reducing the uncertainty of multi-order systems to first-order state variables, specifically the derivatives of the sliding functions [5]. SMC is an effective controller model for ensuring optimal tracking once the system is subjected to external disturbances or different parameter changes [6]. Moreover, SMC is notable for its excellent accuracy and simplicity of application. However, the main challenges in the SMC are to minimize the chattering during the sliding mode [7], reduce the reaching phase to guarantee the control objective is reached on the sliding surface [8], and ensure convergence of the proposed system condition to the sliding surface [9].
Over the years, researchers have presented different SMC improvement approaches to cover these drawbacks and enhance the effectiveness of traditional SMC in order to improve speed tracking and eliminate the disturbance characteristics while reducing chattering impacts [10,11]. These proposed methods may include a modification of sliding surface design, higher-order SMC, reaching law methods, and composite SMC designs. For example, in [12], a discrete compound integral terminal combined with sliding mode control has been developed to enhance the speed system in PMSM. In the proposed control design, the authors presented the integral terminal sliding mode control to describe the convergence state of infinite time. Then, to address the problem of high switching gains caused by SMC to handle disturbances, an extended state observer-based compensator is presented. Moreover, a predictive control-based optimum control signal is generated to assist the control signal system in optimally pushing the state. The proposed speed scheme has been validated where the reaching quality is increased and reduced the tracking error band, low controller order, effective model flexibility, and disturbance reduction ability. In [13], the authors proposed a compound control technique adapted with an enhanced non-singular fast terminal with a sliding mode controller (NFTSMC) to improve the response time and enhance the anti-disturbance performance of PMSM. The purpose of the improved NFTSMC is to reduce the chattering on the output signal during maintaining the high-tracking performance of the speed controller. Moreover, the disturbance observer compensation techniques have been developed to predict the load disturbance and included in the output of the modified NFTSMC for a feedforward compensation component. Considering the time-varying characteristic and the high bandwidth of the unpredictability and disturbance in the PMSM drives, the authors in [1] proposed a novel design of the speed controller using the nonsingular terminal with sliding mode control integrated with the disturbances observer controller. The experiment results demonstrate that the proposed controller reaches the reference speed value in an infinite amount of time, with fast convergence and more precise tracking. Moreover, the authors in [14] developed a model-free super-twisting nonlinear sliding mode control technique integrated with an enhanced smoothing extended state observer. The authors introduced MFSTNLSMC to reduce the chattering occurrence and enhance system stability. In addition, a non-linear sliding mode surface is created for solving the shortcomings of the classic linear sliding mode and to predict the unknown variables of the PMSM. In [15], a disturbances observer has been suggested to predict the load disturbances and investigate the accuracy of speed controllers in electric vehicles (EV) using PMSM under external load torque disturbance. Furthermore, a second-order sliding mode differentiator was applied to estimate the derivative of the control signal rule and to solve the problem of complexity explosion. In [16], an anti-disturbance sliding mode controller was presented, which is preferred in terms of providing a speed and accuracy of the torque for deadbeat direct torque control in PMSM. To predict and correct the lumped anti-disturbances, the authors in [17] proposed a super-twisting sliding mode approach combined with a new disturbance observer, which results in a hybrid controller with a feed-forward compensation term and a state-feedback control. The purpose of this study is to enhance the performance of the PMSM. As a result, the composite SMC’s gain is decreased greatly, which improves the closed-loop PMSM speed controller performance. In [18], the feedback linearization method has been applied for the PMSM drive based on an advanced control technique integrated with terminal SMC. The speed-current single-loop structure and current stabilizing control are integrated into the controller, which provides a speed transient response. Then, a non-linear disturbances observer is considered to solve the mismatched disturbances, and the feed-forward compensation is considered to enhance robustness. In [19], authors designed a fractional-order sliding mode speed controller using fractional calculus. The sliding surface of the proposed technique includes fractional integration and differentiation. The stability state of the system and the proposed controller has been demonstrated by utilizing the Lyapunov stability theorem. In [20], the authors addressed the stabilization problem of PMSM using the wind energy conversion system as a power resource by adapting a novel controller called the fractional-fuzzy integral sliding mode control approach, which is different from the conventional integer order control design. The purpose of the proposed approach is to improve the convergence accuracy rate, which is significantly superior compared to the control schemes based on integer-order. Furthermore, this study analyzed the global stability of closed-loop systems using Lyapunov stability theory to explore the efficacy of fractional order controllers in both PMSM and surface-mounted PMSM-based wind energy conversion system. The authors of [21] proposed a hermite neural network-based second-order sliding-mode strategy for the PMSM drive system. The proposed control strategy is a nonlinear vector control strategy consisting of the speed control loop and the current control loop.
The PMSM drive process is vulnerable to unavoidable parameter changes, involving multivariable, strong coupling, and nonlinearity such as loads, changing the speed, etc. These parameters affect and make it difficult to derive the exact PMSM drive and parameters in the optimal function. Although the SMC is less sensitive to the uncertainty’s parameters and external and internal disturbances, determining the upper limits of the disturbances is complex and complicated. Generally, the SMC robustness is determined by a large switching gain, which results in the undesirable chattering phenomenon [22]. As described in the literature, integrating the SMC with other techniques that predict the disturbance is considered the preferable solution for overcoming the above drawbacks [23]. Disturbance observer techniques in SMC can assess the system’s lump disturbance, including parameter fluctuations and external disturbance, and create proportional compensation using the estimation method [13]. Nevertheless, these approaches combined with SMC have a gap in tuning the internal parameters of the controller. Controller parameters tuning is a difficult task that can impact the steady-state error, oscillation of the system, overshoot, response time, robustness of the controller, and sensitivity to disturbing effects [12,24].
From the fore-mentioned motivations, the purpose of this article is to propose a neural network algorithm with reinforcement learning (RLNNA) to obtain the optimal parameters of the traditional fractional-order sliding mode control (FOSMC) to eliminate the chattering phenomenon and enhance system robustness for the PMSM drive, instead of the traditional FOSMC, which considers a random tuning of the parameters for the speed controller [19]. The proposed technique will be effectively applied to the speed regulation problem of the PMSM system. To sum up, three contributions of this article are highlighted through comparisons with existing literature:
(1)
An RLNNA is proposed to obtain the optimal parameters, which is based on the FOSMC method for the speed controller of the PMSM.
(2)
An RLNNA-FOSMC is proposed in this paper. RLNNA can drive FOSMC to function with disturbances and reduce chattering without sacrificing robustness.
(3)
The effectiveness of the proposed control strategy is proved by the comparative simulations.
The reminder of this paper is organized as follows: Section 2 represents the PMSM mathematical model and describes the design of fractional-order sliding mode control. In Section 3, the proposed RLNNA algorithm to determine the optimal parameters is demonstrated. In Section 4, the simulation and numerical results are discussed. Conclusions is presented in Section 5.

2. Analysis and Design of PMSM and FOSMC

2.1. Fundamentals of PMSM for Speed Control Application

In this study, a space vector modulation (SVM) is applied to generate the pulse width modulation (PWM). The speed control system consists of two current loops with a speed loop as illustrated in Figure 1. The current loops are based on the proportional–integral (PI) controllers. Moreover, a FOSMC is applied for the speed loop.
The rotor of the PMSM has a permanent magnet frame, and the stator includes a three-phase of symmetric windings. By assuming that the magnetic circuit of the PMSM is ideal, the q axis follows the direction of rotation of the rotor and the d axis is in line with the excitation axis of the permanent magnet frame. The mathematical model of a PMSM can be represented as follows [4]:
u d = R i d ω ψ q + d ψ d d t u q = R i q ω ψ d + d ψ q d t
ψ d = L d   i d + ψ f ψ q = L q   i q
T e = 2 3 P ψ f i q + L d L q i d i q
J   ω ˙ = T e B ω T L
where i q and u q describe current and the voltage of the q axis, respectively; u d and i d describe the voltage and current of d axes, respectively; ψ d and ψ q represent the q and d -axis flux linkages; R is the armature winding resistance; ω represents the angular velocity. L d and L q represent d , q -axis stator inductance, where L d = L q ; P is the number of pole pairs; J describes the moment of inertia. B represents the viscous friction coefficient; T L represents the load torque; T e represents the electromagnetic torque.
The control problem in the speed loop is to find the optimal output single from the controller in the presence of model uncertainty. The speed controller aims to ensure the motor speed ω t is tracking the reference speed ω * t . The input signal has described the error e t between ω * and ω and is given by:
e t = ω * t ω t

2.2. Design of FOSMC

The fractional-order sliding surface is described as:
s t = K p e t + K i 0 D t α e t + K d 0 D t β e t
where α and β are positive numbers of the fractional-order parameters between 0 and 1. K i , K p , K i     R . The control law is given by:
s ˙ t = w s K s s i g n s
where w and K i     R + . s i g n s is the sign function which is described below:
s i g n s = 1 , s > 0 0 , s = 0 1 , s < 0
The equivalent control law can be derived. We can design the output signal as:
i q * t = b K p 1 K i 0 D t 1 α e t + K d 0 D t 1 + β e t + w a K p e t + K p t + w K i 0 D t α e t + w K d 0 D t β e t + K s s i g n s

2.3. Stability Analysis Using FOSMC

A SMC is considered more stable in sliding mode control theory when the following conditions are satisfied: the proposed sliding manifold’s reaching condition and the system stability. For both conditions, a stability analysis is required and must be addressed when the sliding mode occurs. To verify the convergence rate of the system condition to the manifold for the initial state, the proposed fractional sliding manifold’s reaching condition must be satisfied. To validate the stability of the system, the stability theorem based on Lyapunov is applied in this work. For the initial state, the Lyapunov function is defined in the equation below [19]:
V = 1 2 s 2
The derivation of V concerning time is given by:
V ˙ = K s s + K p δ t s w s 2
where:
K s > K p δ t     K s K p > δ t
After reaching the condition is ensured, the stability of the system during the sliding phase has to be analyzed. For this purpose, the following assumption is considered [4]:
D t r x t = A . x t
where x   R , A = ( a i j )   R , and 0< r < 1.
When sliding mode occurs, the sliding mode dynamics are represented in the matrix equation below:
D t α e 1 0 D t β e 2 0 = 0 1 K i K d K p K d e 1 e 2 = A e 1 e 2

3. Neural Network Algorithm with Reinforcement Learning (RLNNA)

RLNNA is an improved neural network algorithm (NNA) using reinforcement learning (RL) to face the challenge of slow convergence rate and local optimal stagnation for solving complex optimization problems [25]. Three strategies are used in RLNNA to solve the challenges that face the NNA: modification factor RL, transfer operator with historical population, and feedback operator. This section describes the NNA and the RLNNA for tuning the FOSMC in PMSM.

3.1. Neural Network Algorithm (NNA)

Artificial neural network (ANN) is a computation technique that is based on the structure and the functionality of a biological neural. ANN consists of several highly interconnected neurons that are motivated by biological nervous systems. Generally, the objective of ANN application is prediction, which can reduce the gap between the predicted and objective solutions by adjusting weight values regularly [26]. Moreover, the ANN has the potential to learn and obtain the optimal solution in enormous data sets. Obtaining the optimal solution from the given search space is the main objective of solving an optimization problem. To adapt ANN to be more suitable for optimization applications, the authors in [27] proposed an NNA. The NNA takes the current optimal solution as the best solution. Then, by adjusting the weight value of each neural cell, the optimal solutions for the problem are obtained. The mathematical models and steps of this algorithm are explained in the subsequent sub-sections.

3.1.1. Generating Initial Population

where N is the population size, D is the number of variables, and t is the current value of iteration. x i t is the i th individual of the population. v i t is the i th trial individual of the trial population, w i , j t is the weight value of the i th individual in of the number of variable j in iteration number t . The weight values in the matrix N , D must follow the constraint below:
x W . j t = i = 1 N w i , j t . x i t ,      i = 1 , 2 , 3 , N .   j = 1 , 2 , 3 , D .
v i t = x i t + x W , i t
i = 1 N w i , j t = 1   ,    0 < w i , j t < 1

3.1.2. Update Weight Matrix

Each trial population is generated using the weight matrix, which is updated using Equation (18),
w i t + 1 = w i , j t + 2 × λ 1 × w b e s t t w i t
where w i t + 1 is the weight value of the i th individual in iteration t + 1 .   λ 1 is a random uniformly number created at index i th ranging from 0 to 1. w b e s t t is the best weight vector.

3.1.3. Bias Operator

In NNA, the bias plays a substantial role in the dynamics of the optimization model. The bias current is constantly coupled to a surrounding state to generate the output of each neuron meet to the surrounding conditions. To enhance the performance and to expand the exploration of the optimization model, the NNA applies the bias operator and the transfer operator. The bias operator consists of a bias population and bias weight matrix [25]. To allocate the time of computation for exploration and exploitation, the modification factor β t + 1 is given by:
β t + 1 = 0.99 × β t
The bias population is given as follows:
v i , θ k t = l θ k + u θ k l θ k × λ 2 ,     k = 1 , 2 , 3 , N R .
where λ 2 is a random uniformly number created at index i th ranging from 0 to 1. u θ k and l θ k are the upper and lower limits, respectively. N R is a random integer between 1 and D . θ is a set of N R elements. N R = β t × D . The bias weight matrix is defined by Equation (21):
w i , ϑ t t + 1 = ξ ,     k = 1 , 2 , 3 , N w .
where N w is a random integer between 1 and D . ϑ is a set of N w elements. N w = β t × N . ξ is a random number between 0 and 1.

3.1.4. Transfer Operator

The transfer operator is applied to improve the solutions by moving the new individuals closer to the best solution to obtain a better solution for the next iterations. The transfer operator can be expressed as:
v i t = v i , j t + 2 × λ 3 × x b e s t t x i t ,     k = 1 , 2 , 3 , N .
where λ 3 is a random uniform number created at index i th ranging from 0 to 1.

3.2. Neural Network Algorithm with Reinforcement Learning (RLNNA)

RL is a computerized reward-directed trial and error method of solving multi-stage decision problems. RL has been applied to improve the performance of optimization techniques [28]. The RL system usually consists of four components: an environment, a learning agent, agent actions, and a reward. At time t , the agent is given a state and a reward. The agent will then take action based on the received reward and state. Finally, when the action is completed, the environment changes, resulting in a new reward and state at time t + 1 [29]. The major advantage of RL is the environment, which can interact directly during the RL process and requires only a little information about the environment as well as uses a simple mathematical equation. By using these advantages, adopting RL in NNA will enhance the performance and cover the drawbacks of the traditional NNA.
Figure 2 represents the schematic and the framework of the RLNAA. The steps of the RLNNA are summarized as follows:
Step 1: Generate the trial population.
Step 2: Update the weight of the matrix.
Step 3: Check the bias operator condition.
Step 4: Perform the selection operator.
Step 5: Optimize the selected individuals using the feedback operator.
Step 6: Generate the next generation based on the selection operator.
Compared with traditional NNA, the RLNNA technique can be described as follows:

3.2.1. Modification Factor with RL

If any individual can obtain a better solution in the search space, this individual has some knowledge for finding the global optimal solution and can be called an outstanding individual. Each individual moves around themselves in the search operator to avoid missing an optimal solution. RL on NNA is obtaining two fitness values for each individual and the expression of this value can be defined as:
β i t + 1 = β i t + β i t . τ . ( g h x + g ( s x ) ) ,      i = 1 , 2 , 3 , N .
h x = f i , 1 t + 1 f i , 1 t
s x = f i , 2 t + 1 m i n ( f i , 1 t + 1 , f i , 1 t )
g x = 1 , i f   x < 0 0 , i f   x 0
where β i t represents the modification factor of each individual i , τ describes the penalty factor. g x is a control function. f i , 1 t is a fitness function.

3.2.2. Transfer Operator with Historical Population

The transfer operator includes a current transfer term and a historical transfer term in RLNNA to avoid the risk of increasing the chance of traditional NNA falling into local minima. The transfer operator can be expressed as:
v i t = v i t + κ 1 × x b e s t t v i t + κ 1 × x b e s t t x o l d , i t
where κ 1 and κ 2 are two random uniform numbers created at index i th ranging from 0 to 1. x o l d , i t is the previous value of the i individual of the historical population at each iteration t . x o l d t can be updated using:
x o l d t = x c u r r e n t t ,     i f   λ 5 < 0.5 x o l d t ,     o t h e r w i s e
where λ 5 is a random uniform number created at index i th ranging from 0 to 1. After completing the bias operator or transfer operator, a selection operator can be described as in Equation (29).
v i t = v i t ,     i f   f ( v i t ) < f ( x i t ) x i t ,     o t h e r w i s e

3.2.3. Designed Feed-Back Operator

To overcome the drawbacks of the mature convergence in NNA, RL uses the feedback operator, which is the bias or transfer operator’s further optimization for the obtained population. The equation of the feedback operator can be expressed as:
v i t = v i t + κ 3 × v m t v i t + κ 4 × x o l d , i t v i t , i f   f ( v m t ) < f ( v i t ) v i t + κ 3 × v i t v m t + κ 4 × x o l d , i t v i t ,     o t h e r w i s e
where κ 3 and κ 4 are two random uniform numbers created at index i th ranging from 0 to 1. m is a random integer between 1 and N and is not equal to i . The selection operator is executed again after completing the feedback operator operation, using the equation below:
x i t + 1 = v i t + 1 ,     i f   f ( v i t ) < f ( v i t ) v i t ,                 o t h e r w i s e

3.3. Performance Evaluation

To evaluate the identification accuracy of the proposed approach, the integral of time multiplied absolute error (ITAE), the integral time multiplied square error (ITSE), integral square error (ISE), integral absolute error (IAE), are introduced as the performance indices. Four criteria are defined as follows:
I S E = 0 T e 2 t d t I A E = 0 T e t d t I T A E = 0 T t e t d t I T S E = 0 T t e 2 t d t
Figure 3 illustrate the process for tuning the parameter of FOSMC using RLNNA. In the ordinary form, solving the optimal parameters for the proposed FOSMC is a complex optimization problem, which is solved in offline mode. Therefore, the RLNNA approach, which is a population-based optimization technique, is used to optimize the parameters of the sliding surface of the FOSMC given in Equation (6). The parameters to be optimized by the RLNNA are: α , β , K i , K d , and K p . The objective functions based on Equation (32) to minimize the error have been modeled as the sum of multi-objective functions of PMSM. The proposed methodology is based on PMSM simulation. To optimize the parameters of the FOSMC, the following variables are required: stator resistance, d -axis stator inductance, q -axis stator inductance, the moment of inertia, viscous friction coefficient, flux linkage, and pole pair. As the first step in the proposed method, the elements between the range are declared to be:
0 < α < 1 0 < β < 1 k ¯ p   m i n k ¯ p k ¯ p   m a x k ¯ i   m i n k ¯ i k ¯ i   m a x k ¯ d   m i n k ¯ d k ¯ d   m a x
The value of the upper and lower bound is set according to the speed reference characteristics. In this study, initially, elements between the search ranges are generated and updated using the Equations (15)–(17). Then, apply the transfer operation for each element based on Equation (27). The FOSMC function based on Equation (9) is solved for each element. The operational constraint for the PMSM is considered while obtaining the optimal parameters of the FOSMC. The lowest objective function is selected. This operation is iterated for all of the elements. The whole process is repeated until the maximum number of iterations is reached. When the number of iterations reaches its maximum, the system obtains the optimal value of the FOSMC parameters.

4. Numerical Simulation

In this section, we provide simulation results to show the validation of the proposed speed control for PMSM. The effectiveness of the designed control scheme is programmed and implemented in Matlab and Simulink on a Lab computer with a 3.9 GHz Intel i5800 processor and 8 GB of memory. The PMSM model used in this simulation is a three-phase Y-connected 1.93 kW motor with parameters as listed in Table 1. In the simulation, the sampling time is 1 × 10 6   m s . The switching frequency (fs) is set at 25 kHz.
The designed RLNNA_FOSMC is compared with the traditional FOSMC in Ref. [19]. Then, three scenarios have been used to analyze the speed tracking performance of PMSM in variable speed and constant speed under the proposed controller. In addition, the best results in the comparative analysis are highlighted in bold using performance evaluation indexes as described above. The important results of this study are shown in the following subsections:

4.1. Case 1: One Step Speed Reference

In this scenario, we set the speed reference in one step of 0.015 s stop time, and different cases of speed references have been considered in this study which are 100, 200, 300, 400, and 500 (rpm). The unit speed step responses of the PMSM for RLNNA_FOSMC and FOSMC in the absence of external load disturbance are shown in Figure 4. As can be seen from the figures, the proposed RLNNA_FOSMC has the best transient response profile as it performs with faster stability with no overshoot in all cases that have been considered. These comparisons show clearly that the RLNNA_FOSMC gives good tracking performances.
The comparative transient response analysis of the error of RLNNA_FOSMC and FOSMC is given in Table 2. In the table, the values of the most preferred objective functions in the tuning processes, ISE, IAE, ITAE, and ITSE values, are also given for comparison purposes. As can be clearly seen from the table, the values of the four transient performance indices were lowest with the use of the RLNNA_FOSMC compared to the traditional controller.
In conclusion, for one step speed reference case, the RLNNA_FOSMC that has been proposed to control and obtain the optimal parameter for the PMSM speed controller has more stability, less error, faster, and less oscillating structure than the traditional controller set with different speed references.

4.2. Case 2: Speed Drop

In this case, the superiority and the effectiveness of the proposed controller RLNNA_FOSMC has been validated under the PMSM model by assuming the drop of the speed reference in different cases. We assumed the initial speed is 500 rpm. The PMSM controller tracks the speed reference of 500 rpm until 0.015 s and suddenly the speed reference drops into a new speed reference. In this scenario, the speed drops are assumed by 100, 200, 300, and 400 rpm.
Figure 5 illustrated the response of the proposed RLNNA_FOSMC and FOSMC for the PMSM driver. It can be noted that the proposed controller has the best tracking for the speed reference, and it performs with faster stability. On contrary, the response of the conventional FOSMC is much slower and a larger tracking error can be observed.
Table 3 represents the comparison of identification accuracy of RLNNA_FOSMC and FOSMC for this case. As can be clearly seen from the table, the values of different types of identification accuracy were lowest with the use of the RLNNA_FOSMC compared to the traditional controller.

4.3. Case 3: Different Steps Reference

To further confirm the superiority of the proposed approach for tuning the parameters of the speed controller in the PMSM drive, we assumed that the speed controller tracked different reference steps with 0.045 s stop time. In addition, the speed reference is considered to change every 0.015 s for investigation of the behavior of each controller in high-speed dynamic application. The different speed references are represented in Table 4.
The transient response performance of a system is maximized when the ISE, IAE, ITAE, and ITSE values are the lowest. The comparative values of the performance indices obtained from different approaches are presented in Table 4. As can be seen from this table, ISE, IAE, ITAE, and ITSE values of the RLNNA_FOSMC are the lowest compared to the traditional FOSMC. Moreover, these numerical results clearly demonstrate that the proposed controller is more efficient and flexible.
The speed step responses of the PMSM drive for the conventional FOSMC and RLNNA_FOSMC for the third case are shown in Figure 6. As can be seen from the figure, the proposed RLNNA_FOSMC controller has the best transient response profile as it performs faster stability with no overshoot.

5. Conclusions

Tuning the parameters of speed controllers is a very challenging process in PMSM drive. If the tuning performance is insufficient, not only does the control performance worsen, but also the control system becomes inflexible, unreliable, and inefficient. In this paper, the accurate speed tracking control of PMSM using RLNNA_FOSMC has been investigated for tuning the speed controller, and the problems related to the speed tracking, minimizing the error performance, and the identification accuracy have been solved by using ISE, IAE, ITAE, and ITSE as an objective function. Comparisons among the conventional FOSMC are carried out via simulation in different cases. The superiority of the proposed RLNNA_FOSMC has been proven and confirmed, where RLNNA_FOSMC performed better in terms of speed tracking. In future work, the data collected from the simulation such as the speed error, speed reference, and the stator current will be utilized to create a deep learning speed control model based on an artificial neural network to further enhance the speed controller in terms of speed tracking and anti-disturbance properties. Furthermore, the developed model will be carried out in both simulation validation and experimental verification.

Author Contributions

Y.Z.: Conceptualization, data curation, investigation, validation, methodology, visualization, writing—reviewing and editing, original draft preparation. F.M.Z.: writing—reviewing, editing, and supervision. I.A.: writing—reviewing. M.K.: writing—reviewing. S.M.: writing—reviewing. I.A.: writing—reviewing. M.S.: writing—reviewing. A.S.: writing—reviewing. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by Ministry of Higher Education, Malaysia (MOHE) through Fundamental Research Grant Scheme (FRGS/1/2021/TK0/UPSI/02/1).

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Xu, W.; Jiang, Y.; Mu, C. Novel Composite Sliding Mode Control for PMSM Drive System Based on Disturbance Observer. IEEE Trans. Appl. Supercond. 2016, 26, 0612905. [Google Scholar] [CrossRef]
  2. Kamel, T.; Abdelkader, D.; Said, B.; Padmanaban, S.; Iqbal, A. Extended Kalman filter based sliding mode control of parallel-connected two five-phase PMSM drive system. Electronics 2018, 7, 14. [Google Scholar] [CrossRef]
  3. Zahraoui, Y.; Zaihidee, F.M.; Kermadi, M.; Mekhilef, S.; Mubin, M.; Tang, J.R.; Zaihidee, E.M. Fractional Order Sliding Mode Controller Based on Supervised Machine Learning Techniques for Speed Control of PMSM. Mathematics 2023, 11, 1457. [Google Scholar] [CrossRef]
  4. Zhang, B.T.; Pi, Y.G.; Luo, Y. Fractional order sliding-mode control based on parameters auto-tuning for velocity control of permanent magnet synchronous motor. ISA Trans. 2012, 51, 649–656. [Google Scholar] [CrossRef] [PubMed]
  5. Wang, H.; Li, S.; Lan, Q.; Zhao, Z.; Zhou, X. Continuous terminal sliding mode control with extended state observer for PMSM speed regulation system. Trans. Inst. Meas. Control 2017, 39, 1195–1204. [Google Scholar] [CrossRef]
  6. Zaihidee, F.M.; Mekhilef, S.; Mubin, M. Robust speed control of pmsm using sliding mode control (smc)—A review. Energies 2019, 12, 1669. [Google Scholar] [CrossRef]
  7. Zhou, Z.; Zhang, B.; Mao, D. Robust sliding mode control of PMSM based on a rapid nonlinear tracking differentiator and disturbance observer. Sensors 2018, 18, 1031. [Google Scholar] [CrossRef]
  8. Saihi, L.; Boutera, A. Robust Sensorless Sliding Mode Control of PMSM with MRAS and Luenberger Extended Observer. In Proceedings of the 2016 8th International Conference on Modelling, Identification and Control ICMIC 2016, Algiers, Algeria, 15–17 November 2016; pp. 174–179. [Google Scholar] [CrossRef]
  9. Song, Q.; Li, Y.; Jia, C. A novel direct torque control method based on asymmetric boundary layer sliding mode control for PMSM. Energies 2018, 11, 657. [Google Scholar] [CrossRef]
  10. Liu, X.; Zhang, C.; Li, K.; Zhang, Q. Robust current control-based generalized predictive control with sliding mode disturbance compensation for PMSM drives. ISA Trans. 2017, 71, 542–552. [Google Scholar] [CrossRef]
  11. Jiang, Y.; Xu, W.; Mu, C.; Liu, Y. Improved deadbeat predictive current control combined sliding mode strategy for PMSM drive system. IEEE Trans. Veh. Technol. 2018, 67, 251–263. [Google Scholar] [CrossRef]
  12. Ma, Y.; Li, D.; Li, Y.; Yang, L. A Novel Discrete Compound Integral Terminal Sliding Mode Control with Disturbance Compensation for PMSM Speed System. IEEE/ASME Trans. Mechatron. 2022, 27, 549–560. [Google Scholar] [CrossRef]
  13. Xu, B.; Zhang, L.; Ji, W. Improved Non-Singular Fast Terminal Sliding Mode Control with Disturbance Observer for PMSM Drives. IEEE Trans. Transp. Electrif. 2021, 7, 2753–2762. [Google Scholar] [CrossRef]
  14. Gao, P.; Zhang, G.; Lv, X. Model-Free Control Using Improved Smoothing Extended State Observer and Super-Twisting Nonlinear Sliding Mode Control for PMSM Drives. Energies 2021, 14, 922. [Google Scholar] [CrossRef]
  15. Dai, Y.; Ni, S.; Xu, D.; Zhang, L.; Yan, X.-G. Disturbance-observer based prescribed-performance fuzzy sliding mode control for PMSM in electric vehicles. Eng. Appl. Artif. Intell. 2021, 104, 104361. [Google Scholar] [CrossRef]
  16. Wang, Y.; Zhu, Y.; Zhang, X.; Tian, B.; Wang, K.; Liang, J. Antidisturbance Sliding Mode-Based Deadbeat Direct Torque Control for PMSM Speed Regulation System. IEEE Trans. Transp. Electrif. 2021, 7, 2705–2714. [Google Scholar] [CrossRef]
  17. Hou, Q.; Ding, S.; Yu, X. Composite Super-Twisting Sliding Mode Control Design for PMSM Speed Regulation Problem Based on a Novel Disturbance Observer. IEEE Trans. Energy Convers. 2021, 36, 2591–2599. [Google Scholar] [CrossRef]
  18. Liu, X.; Yu, H.; Yu, J.; Zhao, L. Combined Speed and Current Terminal Sliding Mode Control with Nonlinear Disturbance Observer for PMSM Drive. IEEE Access 2018, 6, 29594–29601. [Google Scholar] [CrossRef]
  19. Zaihidee, F.M.; Mekhilef, S.; Mubin, M. Application of Fractional Order Sliding Mode Control for Speed Control of Permanent Magnet Synchronous Motor. IEEE Access 2019, 7, 101765–101774. [Google Scholar] [CrossRef]
  20. Mani, P.; Rajan, R.; Shanmugam, L.; Joo, Y.H. Adaptive fractional fuzzy integral sliding mode control for PMSM model. IEEE Trans. Fuzzy Syst. 2019, 27, 1674–1686. [Google Scholar] [CrossRef]
  21. Liu, Y.C.; Laghrouche, S.; N’Diaye, A.; Cirrincione, M. Hermite neural network-based second-order sliding-mode control of synchronous reluctance motor drive systems. J. Frankl. Inst. 2021, 358, 400–427. [Google Scholar] [CrossRef]
  22. Chen, W.H.; Yang, J.; Guo, L.; Li, S. Disturbance-Observer-Based Control and Related Methods—An Overview. IEEE Trans. Ind. Electron. 2016, 63, 1083–1095. [Google Scholar] [CrossRef]
  23. Yang, J.; Chen, W.H.; Li, S.; Guo, L.; Yan, Y. Disturbance/Uncertainty Estimation and Attenuation Techniques in PMSM Drives—A Survey. IEEE Trans. Ind. Electron. 2017, 64, 3273–3285. [Google Scholar] [CrossRef]
  24. Qi, Z.; Shi, Q.; Zhang, H. Tuning of digital PID controllers using particle swarm optimization algorithm for a CAN-Based DC motor subject to stochastic delays. IEEE Trans. Ind. Electron. 2020, 67, 5637–5646. [Google Scholar] [CrossRef]
  25. Zhang, Y. Learning for Parameters Extraction of Photovoltaic Models. IEEE Trans. Neural Netw. Learn. Syst. 2021, 1–11. [Google Scholar]
  26. Cook, D.F.; Ragsdale, C.T.; Major, R.L. Combining a neural network with a genetic algorithm for process parameter optimization. Eng. Appl. Artif. Intell. 2000, 13, 391–396. [Google Scholar] [CrossRef]
  27. Sadollah, A.; Sayyaadi, H.; Yadav, A. A dynamic metaheuristic optimization model inspired by biological nervous systems: Neural network algorithm. Appl. Soft Comput. J. 2018, 71, 747–782. [Google Scholar] [CrossRef]
  28. Arwa, E.O.; Folly, K.A. Reinforcement Learning Techniques for Optimal Power Control in Grid-Connected Microgrids: A Comprehensive Review. IEEE Access 2020, 8, 208992–209007. [Google Scholar] [CrossRef]
  29. Zhou, S.; Hu, Z.; Gu, W.; Jiang, M.; Chen, M.; Hong, Q.; Booth, C. Combined heat and power system intelligent economic dispatch: A deep reinforcement learning approach. Int. J. Electr. Power Energy Syst. 2020, 120, 106016. [Google Scholar] [CrossRef]
Figure 1. System configuration of field-oriented control of PMSM.
Figure 1. System configuration of field-oriented control of PMSM.
Energies 16 04353 g001
Figure 2. Schematic view for the performance of the RLNNA.
Figure 2. Schematic view for the performance of the RLNNA.
Energies 16 04353 g002
Figure 3. The process for tuning the FOSMC using RLNNA.
Figure 3. The process for tuning the FOSMC using RLNNA.
Energies 16 04353 g003
Figure 4. Transient responses of PMSM system under the conventional FOSMC and RLNNA_FOSMC for various speed references where (a) (100), (b) (200), (c) (300), (d) (400), (e) (500).
Figure 4. Transient responses of PMSM system under the conventional FOSMC and RLNNA_FOSMC for various speed references where (a) (100), (b) (200), (c) (300), (d) (400), (e) (500).
Energies 16 04353 g004
Figure 5. Speed response of PMSM system under the conventional FOSMC and RLNNA_FOSMC at 500 rpm at initial speed reference and different speed drops from 500 rpm to (a) (100), (b) (200), (c) (300), (d) (400).
Figure 5. Speed response of PMSM system under the conventional FOSMC and RLNNA_FOSMC at 500 rpm at initial speed reference and different speed drops from 500 rpm to (a) (100), (b) (200), (c) (300), (d) (400).
Energies 16 04353 g005
Figure 6. Speed responses of PMSM system under the conventional FOSMC and RLNNA_FOSMC for 3rd case from 500 rpm to (a) (100), (b) (200), (c) (300), (d) (400) then (a) (200), (b) (300), (c) (400), (d) (500).
Figure 6. Speed responses of PMSM system under the conventional FOSMC and RLNNA_FOSMC for 3rd case from 500 rpm to (a) (100), (b) (200), (c) (300), (d) (400) then (a) (200), (b) (300), (c) (400), (d) (500).
Energies 16 04353 g006
Table 1. Parameters of the PMSM.
Table 1. Parameters of the PMSM.
ParametersValue
Stator   resistance ,   R s 1.2   Ω
d - axis   stator   inductance ,   L d 6.35   m H
q - axis   stator   inductance ,   L q 6.75   m H
Moment   of   inertia ,   J 2.31 × 10 4   K g   m 2
Viscous friction coefficient, B m 0.0002   N m   s
Flux   linkage ,   λ f 0.15   W b
Pole   pair ,   n p 4
The proportional coefficient for the current loop K p 20
The integral coefficient for the current loop K i 100
Table 2. Comparison of the identification accuracy of RL_FOSMC and FOSMC for Case 1.
Table 2. Comparison of the identification accuracy of RL_FOSMC and FOSMC for Case 1.
Speed (rpm)ControllerISEIAEITAEITSE
100RLNNA_FOSMC2,274,941.1223,737.0087.92316.72
FOSMC [19]2,840,320.0631,315.3788.441027.89
200RLNNA_FOSMC13,041,197.8158,726.82223.922795.94
FOSMC [19]14,586,841.0994,586.46408.465163.30
300RLNNA_FOSMC36,613,213.68110,965.07253.169876.56
FOSMC [19]38,293,080.76181,028.59782.8112,271.44
400RLNNA_FOSMC76,973,812193,110.9312.1024,084.45
FOSMC [19]78,186,689.48287,608.401076.12925,081.94
500RLNNA_FOSMC138,620,950.28307,239.41421.4654749,550.83
FOSMC [19]139,862,958.9414,626.4311317.0550,222.20507
Table 3. Comparison of the identification accuracy of RL_FOSMC and FOSMC for 2nd case.
Table 3. Comparison of the identification accuracy of RL_FOSMC and FOSMC for 2nd case.
Steep ControllerISEIAEITAEITSE
Speed (rmp)Speed (rpm)
500100RLNNA_FOSMC 2.1619 × 10865,720.725745179.63287 1.2345 × 106
FOSMC [19] 2.1824 × 108126,220.626485208.3477 1.2516 × 106
200RLNNA_FOSMC 1.7606 × 108161,145.43843335.614 6.1685 × 105
FOSMC [19] 1.7897 × 108232,818.23854122.318 6.5087 × 105
300RLNNA_FOSMC 1.5213 × 108228,359.02952282.5614 2.5229 × 105
FOSMC [19] 1.5538 × 108319,952.93582973.7440 2.8991 × 105
400RLNNA_FOSMC 1.4102 × 108280,244.06161459.20079 8.5625 × 104
FOSMC [19] 1.4281 × 108383,903.52561518.19764 9.5631 × 104
Table 4. Comparison of the identification accuracy of RLNNA_FOSMC and FOSMC for 3rd case.
Table 4. Comparison of the identification accuracy of RLNNA_FOSMC and FOSMC for 3rd case.
SteepControllerISEIAEITAEITSE
Speed (rpm)Speed (rpm)Speed (rpm)
500100200RLNNA_FOSMC 2.1855 × 108 1.3401 × 105 4.880 × 103 1.2301 × 106
FOSMC [19] 2.2112 × 108 1.5886 × 105 5.1826 × 103 1.2519 × 106
200300RLNNA_FOSMC 1.7834 × 108 1.9835 × 105 3.302 × 103 6.1588 × 105
FOSMC [19] 1.8183 × 108 2.6476 × 105 4.1253 × 103 6.5117 × 105
300400RLNNA_FOSMC 1.5445 × 108 2.6580 × 105 2.2457 × 103 2.5295 × 105
FOSMC [19] 1.5831 × 108 3.5157 × 105 2.9767 × 103 2.9021 × 105
400500RLNNA_FOSMC 1.4334 × 108 3.0403 × 105 1.4621 × 103 8.6011 × 104
FOSMC [19] 1.4576 × 108 4.1491 × 105 1.4770 × 103 9.5938 × 104
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zahraoui, Y.; Zaihidee, F.M.; Kermadi, M.; Mekhilef, S.; Alhamrouni, I.; Seyedmahmoudian, M.; Stojcevski, A. Optimal Tuning of Fractional Order Sliding Mode Controller for PMSM Speed Using Neural Network with Reinforcement Learning. Energies 2023, 16, 4353. https://doi.org/10.3390/en16114353

AMA Style

Zahraoui Y, Zaihidee FM, Kermadi M, Mekhilef S, Alhamrouni I, Seyedmahmoudian M, Stojcevski A. Optimal Tuning of Fractional Order Sliding Mode Controller for PMSM Speed Using Neural Network with Reinforcement Learning. Energies. 2023; 16(11):4353. https://doi.org/10.3390/en16114353

Chicago/Turabian Style

Zahraoui, Younes, Fardila M. Zaihidee, Mostefa Kermadi, Saad Mekhilef, Ibrahim Alhamrouni, Mehdi Seyedmahmoudian, and Alex Stojcevski. 2023. "Optimal Tuning of Fractional Order Sliding Mode Controller for PMSM Speed Using Neural Network with Reinforcement Learning" Energies 16, no. 11: 4353. https://doi.org/10.3390/en16114353

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop