Abstract
In various modern linear control systems, a common practice is to make use of control in the feedback loops which act as an important tool for linear feedback systems. Stability and instability analysis of a linear feedback system give the measure of perturbed system to be singular and non-singular. The main objective of this article is to discuss numerical computation of the -values bounds by using low ranked ordinary differential equations based technique. Numerical computations illustrate the behavior of the method and the spectrum of operators are then numerically analyzed.
1. Introduction
In system theory, -value known as structured singular value (SSV) is a well-defined tool, first introduced by Doyle [1]. It is used to analyze the robustness of linear feedback systems when they are subject to uncertainties, particularly structured uncertainties. The -value tool has vast applications in control engineering, for instance, for the analysis of controller of an unstable system, the MIMO margins by using and for the space shuttle robustness analysis [2]. For more applications, we refer [3,4] and the references therein.
The numerical approximation of SSV appears as NP-hard problem [5,6]. The computation of the upper bounds of -values is a hard problem; in fact, the NP-hard is in nature when only real uncertainties appear [7].
The power method [3,8] is used to approximate the lower bounds of -values when only pure complex uncertainties are under consideration. This is a seemingly robust numerical method due to the fact that it depends solely on matrix-vector products. The power method is easy to apply only when mixed real perturbations and complex perturbations are taken into account [9,10,11]. This method resembles a mixture of power techniques used for the computation of eigenvalues and singular values of the constant matrices. This method also prove that -values act as an equilibrium point of the power technique. The power method fails to numerically compute the lower bounds of -values only when pure real uncertainties are under discussion. We refer to [12,13,14,15,16,17,18,19,20] and references therein for a comprehensive study of the numerical algorithms to compute numerically the bounds of -values from below.
An approximation of bounds of -values involve fundamental difficulties when one considers pure real uncertainties because the real -values might be discontinuous function of the given problem data [21,22]. Thus the available algorithms [13,14,15,19] to deal such problems have a computational cost which has exponential growth in nature. The idea of regularization to such a problem helps to reduce computational cost by making use of the mixed real/complex power iteration.
In this article, we use an iterative method [23] in order to numerically compute the -values bounds from below for a set of constant matrices generated randomly. The idea is based on a two level algorithm described in a great detail in [23]. The inner algorithm provides basis to develop a gradient system of ordinary differential equations (ODEs) and eventually solves this system by making use of extremizers of structured spectral-value sets. On the other hand, The outer algorithm helps to adjust the small positive parameter which acts as valid perturbation , when making use of fast Newton’s iteration.
This paper is organized as follows: In Section 2 we provide the basic definitions of pseudo-spectra and structured singular values. In Section 3 we give the reformulation of the definition of structured singular values. Section 4 of this article contains the computation of pseudo-spectra, where in Section 5 we explain how the computation of structured singular values can be addressed by making use of an inner-outer algorithm. In the outer algorithm, we determine a small perturbation level while in inner algorithm we determines a local extremizer of the structured spectral value set. Section 6 refers to numerical experiments to compare the lower bounds of SSV obtained with algorithm [23] to those obtained with MATLAB function mussv. Section 7 summarizes our conclusions.
2. Preliminaries
Definition 1.
The uncertainties in terms of mixed real and complex scalar blocks are denoted by and defined by
Definition 2.
The set of block diagonal matrices in terms of pure real scalar blocks is denoted by and defined by
Definition 3.
The set of uncertainties in terms of pure full complex blocks are denoted by , defined as
Definition 4.
The uncertainties in terms of blocks consist of r repeated real scalar blocks and F square full complex blocks are denoted by and defined as follows
Definition 5.
The block diagonal operators entirely consist of S repeated complex scalar blocks and F square full complex blocks are denoted by and defined as
Definition 6.
The spectrum of a square complex valued matrix is represented by and mathematically defined as
Definition 7.
The pseudo-spectrum of a n-dimensional complex valued operator is represented by and defined as:
Definition 8.
The μ-value of underlying block diagonal operator is mathematically denoted by and defined as follows
3. Reformulation of -Values
In this section we give the reformulation of μ-values based on structured spectral value sets [24]. The reformulation of μ-values allows us to construct an optimization problem in order to maximize the spectrum of the perturbed system.
Definition 9.
The ϵ-spectral valued set of an n-dimensional complex operator underlying a small positive real parameter is mathematically denoted by and defined as:
where the quantity represent the spectrum of an operator while represents the greatest singular value of an operator .
Definition 10.
For a given n-dimensional complex operator M and an underlying perturbation in the form of , the spectral value set is represented by and is defined as the following
Definitions 9 and 10 make it possible to formulate again μ-value as a maximization problem.
Definition 11.
For and a set of pure complex uncertainties , μ-value is defined as the following
with .
4. Pseudospectra of Square Matrices
In this section, the pseudospectra for matrices are under consideration. For this purpose we make use of the software package EigTool [25]. EigTool is routinely used to plot the unstructured pseudospectra of the matrices under consideration. Figure 1 and Figure 2 show the graphical representation of the pseudospectrum of 6-dimensional and 4-dimensional real valued matrices.
Figure 1.
MATLAB interface for computing pseudospectrum.
Figure 2.
MATLAB interface for computing pseudospectrum.
We consider a six dimensional real valued matrix M as
Next, we consider a four dimensional complex valued matrix M as
and compute pseudo-spectra with EigTool.
5. Proposed Methodology
In this section, the main objective is to discuss the optimization problem as mentioned in Definition 11, we make use of a numerical approach which is based on low-ranked ordinary differential equations. The numerical method is composed of a two-level algorithm, the inner algorithm and an outer algorithm. In this Section, we first discuss the inner-algorithm which shows how to give a theoretical construction to the system of ordinary differential equations. Secondly, we discuss how to deal with such systems mathematically. Next, we discuss the outer algorithm, which helps to modify the small positive real parameter . The outer algorithm is based on Newton’s iteration for approximating the roots of non-linear equations. The outer-algorithm computes an exact derivative of an extremizer say, for and . Complete details of the numerical method under consideration are given in [23,24]. Finally, we discuss the computation of an extremizer. For this purpose, we approximate the derivative of an eigenvalue matrix of a smooth matrix family say for some fixed parameter p.
5.1. Inner-Algorithm
5.1.1. The Basic Theory
Consider some smooth matrix family for a small parameter p. Let and be the eigenvalue and eigenvector matrices corresponding to . In matrix form
In Equation (12), computation of eigenvector matrix is not unique unless all of the eigenvectors remain fixed. For distinct eigenvalues all of the eigenvectors are computed up to a constant multiplier.
The theory of computing is extended if eigenvalue derivatives are repeated while the second order derivatives of eigenvalues remain distinct. This theory is further generalized to complex-valued and Hermitian matrix.
Here and hereafter the symbol denotes the derivative while we write , that is, we omit the dependency on p. By differentiating Equation (12) we get,
or
Our goal is to determine , the derivative of eigenvalues matrix. For this purpose, we multiply Equation (13) with throughout to have,
Since , this implies:
let , we find
thus Equation (14) gives:
or
Therefore,
Finally, this gives the required result for the computation of the derivative of spectrum of matrix valued function as follows
5.1.2. Approximation of Extremizers
A matrix valued function having the largest eigenvalue bounded above by 1 and the matrix valued function having a smallest eigenvalue which minimizes the modulus of structured spectral value set, is known as an extremizer. The following theorem computes an extremizer for a chosen smallest complex number belonging to the set .
Theorem 1 ([23]).
For a perturbation having the block diagonal structure
with acts as a local extremizer of structured spectral value set. For a simple smallest eigenvalue of matrix valued function having right and left eigenvetors x and y scaled as and let . The non-degeneracy conditions
hold. Then magnitude of each complex scalarappears to be exactly equal to 1 while each full block possesses a unit 2-norm.
Proof.
For proof we refer to [23]. □
5.1.3. Gradient System of ODEs
The gradient system of ODEs for an admissible perturbation to approximate a local extremizer of smallest eigenvalue , is obtained as,
where for and is a characteristic function. For a further discussion on the construction of gradient system of ODEs in above equations, we refer to [23].
5.2. Outer-Algorithm
In an outer-algorithm the main aim is to vary , the perturbation level, by means of a fast Newton’s iteration. In turn, will provide the approximation of lower bound of μ-value.
We make use of fast Newton’s iteration in order to solve a problem
In order to solve Equation (16), we need to compute
the derivative.
The following Theorem 2 helps us to compute , when is simple and , are assumed to remains smooth in the neighboring region of perturbation level .
Theorem 2 ([23]).
Consider matrix valued function . Let x and y as a function of perturbation level acts as right and left eigenvectors of matrix valued function . Consider the scaling of these vector accordingly to Theorem 1. Let and assume that non-degenracy conclusions as discussed in Theorem 1 yield then
Proof.
For proof we refer to [23]. □
Remark 1.
Choice of suitable initial value matrix and initial perturbation level: For a suitable choice of the initial value matrix and an initial perturbation level , we refer to [23].
6. Numerical Computation
In this section, we present numerical results for both lower and upper bounds of μ-values for randomly generated matrices in MATLAB (R2018a, MathWorks, Natick, MA, USA). The numerical computation of the lower bounds of structured singular values with the help of Nalgo, show the tighter results for the μ-values lower bounds computed by means of well-known MATLAB routine mussv. In each experiment the admissible uncertainties ∇ and E are computed with the help of mussv and Nalgo [23] respectively.
Example 1.
First we consider a six dimensional real valued matrix M
We choose block uncertainties The admissible uncertainty ∇ is given as below
with The main drawback with mussv is that it does not compute the unit 2-norm of each block of admissible perturbation Δ and by this way it loose the optimality condition. The optimality condition requires that: not only the admissible perturbation Δ should possess unit 2-norm but each of its block also possesses a unit 2-norm.
The approximated lower bound of μ-value is . Moreover, by using the algorithm [23], the admissible perturbation E is obtained as
with The algorithm [23] computes the unit 2-norm of admissible perturbation E. It does not violate the optimality condition and hence computes the unit 2-norm against each block of E. The lower bound approximation is which is a much better approximation than the one computed numerically.
If instead of full complex blocks, one chose the uncertainties to be repeated as complex blocks, then the mussv routine will not compute the desired admissible perturbations such that each repeated complex block possesses a unit 2-norm. On the hand, Nalgo computes each repeated complex block in such a way that not only the admissible perturbation possesses a unit 2-norm but each individual block also has a largest singular value to be exactly equal to 1.
In Table 1, we present the comparison for the lower and upper bounds of μ-value approximated numerically with the help of mussv and an efficient numerical algorithm [23] for matrix M in Example 1. The first column presents the size of an operator M, where the second, third and fourth columns represent the approximations towards both upper and lower bounds which are computed numerically and the lower bounds computed with the help of [23] respectively.
Table 1.
Computation of bounds of μ-values.
Example 2.
We consider a four dimensional complex valued matrix M
We choose the perturbation set The perturbation set contains only pure complex full blocks. The admissible perturbation ∇ is obtained as
with
The numerical result for the lower bound of μ-value is . Moreover by using the algorithm [23], the admissible perturbation E is obtained as
with The lower bound approximation is . If instead of full complex blocks, one choose the uncertainties to be repeated complex blocks then the mussv routine will not compute the desired admissible perturbations such that each repeated complex block possesses a unit 2-norm. On the other hand, Nalgo computes each repeated complex block in a such a way that not only the admissible perturbation possesses a unit 2-norm but each individual block also have a largest singular value to be exactly equal to 1.
Table 2 represents the comparison of the μ-values approximated numerically with the mussv routine and an iterative method [23] for matrix M taken in Example 2. In the very first column, we present the size of the matrix M. In the second column, the upper bounds of μ-values are presented while lower bounds are presented in the third and fourth columns, respectively.
Table 2.
Computation of bounds of μ-values.
In Figure 3, we show numerical approximation of bounds of μ-values for matrix valued function at various frequencies . In Cases 1–6, the matrix valued functions are obtained in MATLAB by using the “rand” command. The geometrical interpretation of μ-values bounds show the comparison of μ-values bounds computed numerically from below with the help of Nalgo and the one computed with the help of mussv. The frequency response is the quantitative measure of output of system.
Figure 3.
Numerical approximation of bounds of μ-values at different frequency response.
7. Conclusions
In this article, we presented numerical computation of lower and upper bounds of μ-values a well-known mathematical quantity in control. The μ-values discuss robustness and performance of linear feedback systems in control and their bounds examine stability analysis of such systems. The numerical computations show that the attained results for μ-values bounds from below are more appropriate than those obtained by MATLAB function mussv. The EigTool discussed the geometrical interpretation of the pseudo-spectrum of the family of matrices.
Author Contributions
M.R. and M.T. both contributed in conceptualization, methodology, writing manuscript and validation of results, while M.F.A. contributed in writing-review and editing.
Funding
This research received no external funding.
Acknowledgments
The authors acknowledge the anonymous reviewers for their potential inputs to increase the quality of the manuscript.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Doyle, J. Analysis of feedback systems with structured uncertainties. IEE Proc. D Control Theory Appl. 1982, 129, 242–250. [Google Scholar] [CrossRef]
- Balas, G.J.; Doyle, J.C.; Glover, K.; Packard, A.; Smith, R. μ-Analysis and Synthesis Toolbox User’S Guide; The Mathworks Inc.: Natick, MA, USA, 1995. [Google Scholar]
- Packard, A.; Doyle, J. The complex structured singular value. Automatica 1993, 29, 71–109. [Google Scholar] [CrossRef]
- Ferreres, G. A Practical Approach to Robustness Analysis with Aeronautical Applications; Springer Science & Business Media: Berlin, Germany, 1999. [Google Scholar]
- Braatz, R.P.; Young, P.M.; Doyle, J.C.; Morari, M. Computational complexity of mu-calculation. IEEE Trans. Autom. Control 1994, 39, 1000–1002. [Google Scholar] [CrossRef]
- Demmel, J. The componentwise distance to the nearest singular matrix. SIAM J. Matrix Anal. Appl. 1992, 13, 10–19. [Google Scholar] [CrossRef]
- Fu, M. The real structured singular value is hardly approximable. IEEE Trans. Autom. Control 1997, 42, 1286–1288. [Google Scholar]
- Packard, A.; Fan, M.K.H.; Doyle, J. A power method for the structured singular value. In Proceedings of the 27th IEEE Conference on Decision and Control, Austin, TX, USA, 7–9 December 1988; pp. 2132–2137. [Google Scholar]
- Young, P.M.; Doyle, J.C. Computation of mu with real and complex uncertainties. In Proceedings of the 29th IEEE Conference on Decision and Control, Honolulu, HI, USA, 5–7 December 1990; pp. 1230–1235. [Google Scholar]
- Young, P.M.; Doyle, J.C. A lower bound for the mixed mu-problem. IEEE Trans. Autom. Control 1997, 42, 123–128. [Google Scholar] [CrossRef]
- Young, P.M.; Newlin, M.P.; Doyle, J.C. Practical computation of the mixed μ problem. In Proceedings of the 1992 IEEE American Control Conference, Chicago, IL, USA, 24–26 June 1992; pp. 2190–2194. [Google Scholar]
- Bates, D.G.; Mannchen, T. Improved computation of mixed μ bounds for flight control law robustness analysis. Proc. Inst. Mech. Eng. Part I J. Syst. Control Eng. 2004, 218, 609–619. [Google Scholar] [CrossRef]
- Dailey, R.L. A new algorithm for the real structured singular value. In Proceedings of the IEEE 1990 American Control Conference, San Diego, CA, USA, 23–25 May 1990; pp. 3036–3040. [Google Scholar]
- De Gaston, R.R.E.; Safonov, M.G. Exact calculation of the multiloop stability margin. IEEE Trans. Autom. Control 1988, 33, 156–171. [Google Scholar] [CrossRef]
- Elgersma, M.; Freudenberg, J.; Morton, B. Polynomial methods for the structured singular value with real parameters. Int. J. Robust Nonlinear Control 1996, 6, 147–170. [Google Scholar] [CrossRef]
- Hayes, M.J.; Bates, D.G.; Postlethwaite, I. New tools for computing tight bounds on the real structured singular value. J. Guid. Control Dyn. 2001, 24, 1204–1213. [Google Scholar] [CrossRef]
- Newlin, M.P.; Glavaski, S.T. Advances in the computation of the mu-lower bound. In Proceedings of the 1995 IEEE American Control Conference-ACC’95, Seattle, WA, USA, 21–23 June 1995; pp. 442–446. [Google Scholar]
- Newlin, M.P.; Young, P.M. Mixed μ problems and branch and bound techniques. Int. J. Robust Nonlinear Control 1997, 7, 145–164. [Google Scholar] [CrossRef]
- Sideris, A.; Pena, R.S.S. Mixed μ Fast computation of the multivariable stability margin for real interrelated uncertain parameters. IEEE Trans. Autom. Control 1989, 34, 1272–1276. [Google Scholar] [CrossRef]
- Sideris, A.; Pena, R.S.S. Mixed μ Robustness margin calculation with dynamic and real parametric uncertainty. In Proceedings of the 1988 IEEE American Control Conference, Atlanta, GA, USA, 15–17 June 1988; pp. 1201–1206. [Google Scholar]
- Barmish, B.R.; Khargonekar, P.P.; Shi, Z.C.; Tempo, R. Robustness Margin Need Not Be a Continuous Function of the Problem Data; Elsevier: Amsterdam, The Netherlands, 1990. [Google Scholar]
- Packard, A.; Pandey, P. Robustness Continuity properties of the real/complex structured singular value. IEEE Trans. Autom. Control 1993, 38, 415–428. [Google Scholar] [CrossRef]
- Guglielmi, N.; Rehman, M.-U.; Kressner, D. A novel iterative method to approximate structured singular values. SIAM J. Matrix Anal. Appl. 2017, 38, 361–386. [Google Scholar] [CrossRef]
- Rehman, M.-U.; Anwar, M.F. Robustness μ-Values for Matrices Corresponding to Symmetries in Control Systems. Int. J. Anal. Appl. 2018, 16, 673–688. [Google Scholar]
- Wright, T.G.; Trefethen, L.N. Robustness Eigtool. 2002. Available online: http://www.comlab.ox.ac uk/pseudospectra/eigtool (accessed on 15 March 2019).
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).


