T. Iwasaki
University of Virginia, Charlottesville, Virginia
M. Fu
University of Newcastle, Newcastle, Australia
4.1. Introduction
A B
:= C(sl -
C D
4.2. Analysis
4.2.1. A General Framework
> Oil)
U = (j)(z) | < c*i (4.2)
< Oi
x =f(x), e = g(x)
where / : Kn > IRn and g : IRn > Mm are continuous functions passing
through the origin. Let X be a subset of Kn containing the origin. Assume
existence and uniqueness of the solution to x = f ( x ) for any initial state
rc(0) e X. Suppose there exists a continuously differentiable function V :
Hn > H satisfying, for some positive constants a, 6, and c,
a\\x\2 <V(x]
dV_
-g(x)rg(x) < -c\\x 2
(4.3)
~dx' 7
PCX
where
P := { x e IRn : V(x) < I }. (4.4)
Proof. The fact that P is an invariant set and that x ( t ) approaches the
origin directly follows from Lemma 2 of [12]. From (4.3) and the system
equations, we have
dV
X := { x IR" : < p% (i = 1, . . . , m) }
th
where /Q is the i row of matrix K, and pi are real scalars to be specified
in the analysis.
If pi are chosen as px ct;, then 0(/Cx) = /Cx for all x E Xn and thus
the above analysis becomes very simple. In this special case, we have the
following linear analysis result.
Proof. The result follows from Lemma 4.1 by noting that (4.3) and
P C X reduces to (4.6) and (4.7), respectively, where we redefine 7/2 to
be 7. D
We now consider the case where pt > on. In this case, condition (4.3)
reduces to the following:
a p z
PA - 1CTS1C PB + JCT
He TSTC -T <0
C V
where S and T are the diagonal matrices with Si : Oii/ Pi and ti on the
diagonal, respectively. A congruence transformation of this inequality leads
to (4.11) by defining R := I S and redefining 7/2 to be 7. Finally, it can
be verified that (4.12) implies P C X. D
It should be noted that the circle analysis in Lemma 4.3 reduces exactly
to the linear analysis in Lemma 4.2 when p = a. This can be seen once we
notice that there exists a (sufficiently large) T > 0 satisfying (4.11) if and
only if (4.6) holds, because p a implies R = 0.
By the congruence transformation with diag(P"" 1 ,T~ 1 ,/) and by the
Schur complement, it can be shown that the conditions in (4.11) and (4.12)
are equivalent to
(A + BJC)Q BV
-RJCQ -V > (4.13)
(C
4.3. Synthesis
4.3.1. Problem Formulation and a Critical Observation
where x(t) e Hn is the state, u(t) e IRm is the control input, e(t) <E H is
the performance output (e.g., error signal), and y ( t ) & Hfe is the measured
output. Suppose the actuator has a limited power and we have the following
constraint on the magnitude of admissible control input:
is minimized.
y (4.18)
z u
The closed-loop system with these controllers are depicted in Fig. 3 where
the dashed part is absent and K(s] := Ks(s) for (4.17) while the dashed
part is present and K(s) : Ka(s) for (4.18). The additional dashed feed-
back loop has been suggested in the literature to account for the actuator
saturation effect and used as a basis for anti-windup compensation. Here-
after, we shall refer to (4.17) as the directly-saturating (DS) controller and
to (4.18) as the anti-windup (AW) controller.
Recall that Lemmas 4.2 and 4.3 provide sufficient conditions for a closed-
loop system to meet the specifications (a) and (b) in the Synthesis Problem
and to satisfy J < 27 where J is the worst case performance in (4.16)
and 7 is a given scalar. Hence, an approximation of the original Synthesis
Problem would be to minimize 7 over the class of DS or AW controllers
subject to the conditions given by either Lemma 4.2 or Lemma 4.3. Thus
we have four possible problem formulations.
Table 1 shows the four formulations, where each of 7's denotes the
optimal performance bound achievable by the corresponding problem for-
mulation. Clearly, the class of AW controllers is larger than the class of
DS controllers, and the sufficient condition in Lemma 4.3 is no more con-
servative than that in Lemma 4.2. Hence we immediately see the following
relations:
> lia > lea
> Tcs > 7ca
and hence neither the circle criterion nor the anti-windup structure im-
proves the achievable guaranteed performance within the control synthesis
framework discussed here. The following formally states this result.
Theorem 4.1. Consider the plant P(s) in (4.14) and the control sys-
tem in Fig. 3. Fix the controller order n c to be any nonnegative integer.
Let a desired domain of performance P in (4.5) and a desired performance
bound 7 > 0 be given. Suppose there exists an AW controller (4.18) such
that the corresponding closed-loop transfer function H(s) in Fig. 1 is par-
tially strictly proper from u to z and satisfies the condition in Lemma 4.3
(the circle criterion). Then there exists a DS controller (4.17) such that the
corresponding closed- loop system satisfies the condition in Lemma 4.2 (the
linear analysis). Consequently, we have jS = ~fca. Moreover, one such DS
controller is given by (4.17) with Ks(s) being the transfer function from y
to u in Fig. 4.
Z
y
4
T ff Ka(s]
+ ,
*r\
A
Ka(s] =
Ca ca Dal
with state vector x c (t) IRn' be given, where Ba and Da are partitioned
compatibly with the dimensions of the two input vectors in (4.18).
If we view the closed-loop system in Fig. 3 with K(s) := Ka(s) as a
special case of the general feedback system in Fig. 1, we see that H(s) is
determined by P(s) and Ka(s}. Denote this particular transfer function by
Ha(s}. The analysis results in Section 4.2 require that the upper m x m
block of Ha(s) is strictly proper. It can be verified that
0
D D
and hence Da2 must be zero. A state space realization of Ha(s) is then
given by
/ A 0 B \
(Bai + Ba2Dai)M Aa + Ba^Ca Ba2
Ha(s] =
DalM Ca 0
L n n n i
Af Ba
Ks(s] =
(I - R)Dal Df
where the state vector is x c . Denote the corresponding closed-loop transfer
function by Hs(s}. Its state space realization is given by
B\
0
HM = 0 (4.19)
0
\ C 0 )
We show that this Hs(s) satisfies linear analysis conditions (4.6) and (4.7).
Noting that
condition (4.12) with JC := ACa implies (in fact is equivalent to) (4.7) with
/C := /Cs. Also note that satisfaction of (4.11) by Ha(s) implies
P(Aa+BaJCa) 0
He Nr -RTJCa -T 0 JV<0
-7!
0
<0
where
0
0 /
It is tedious but straightforward to verify that
In view of Theorem 4.1, the circle criterion (Lemma 4.3) does not help to
improve the H? performance bound for the closed-loop system when design-
ing a controller with actuator saturation. Hence we use the linear analysis
result (Lemma 4.2) as a basis for developing a control design method. The
following provides a necessary and sufficient condition for existence of an
output feedback controller that yields a closed-loop system satisfying the
linear analysis condition.
Theorem 4.2. Consider the feedback system given by the plant (4.14)
and the DS controller (4.17). Suppose there exist symmetric matrices X
and Y and matrices F, K and L such that
XA + FM 0
He <0 (4.20)
C + DIM -7/
, AY + BK 0 ,
He| (4.21)
CY + DK -77 l < 0
X I
I Y > 0, (i = 1 , . . . , m) (4.22)
Ki a
Bs XB N-XAY -Y
D8 I K MY
has the following properties: For any initial closed-loop state vector x :
[ XT xj! ] T (where x and xc are the plant and the controller state, respectively)
satisfying
" x(0) ! T r X Z ] \ x(0)
< 1. (4.24)
x c (0) J [ Z Z \ [ x c (0)
the control input never saturates (i.e. u z in (4.17)), the state trajectory
converges to the origin, and
oo
2
/ \\e(t) dt < 27.
P=
x z
z z
Let
I 0 -i
Y :=(X- Z)
y -y
Then we have the following identity:
XA+FM N
T O O P(Aa BS1C&
A + BLM AY + BK
0 / 0 Cs
C + DLM CY + DK
0 0 7 /Cc
LM K
It is then easy to verify that (4.7) and (4.22) are related by the congruence
transformation by F and the Schur complement. Similarly, by congruence
transformation with diag(F,/), (4.6) can be equivalently transformed to
XA + FM N 0
He A + BLM AY + BK 0
C + >LM CT + DK -77
It can further be shown that this condition is equivalent to (4.20) and (4.21)
by eliminating N using the projection lemma [3,8]. D
In Theorem 4.2, the domain of performance is characterized by (4.24).
Note that the region of plant initial state x(0) to yield the desired H<2
performance is dependent upon the choice of the initial controller state
x c (0). Rewriting (4.24) as
we see that the best choice of x c (0) to maximize the plant state domain of
performance is given by x c (0) = x(0), in which case the Ji-2 performance
is guaranteed whenever
xto^y-^o) < i.
Thus the plant state domain of performance can be maximized within our
framework by solving the following quasi-convex optimization problem:
0, (i = l , . . . , m ) . (4.25)
It turns out that this is exactly the same problem as that for the state
feedback synthesis. This makes sense because it means that if the initial
plant state is known then the output feedback with an observer achieves
the same plant domain of performance as that achievable by state feedback.
When the initial plant state is not known, we may simply choose the zero
initial controller state x c (0) = 0. In this case, the domain of performance
is characterized by
x(0) T JsTx(0) < 1.
Corollary 4.1. Consider the feedback system given by the plant (4.14)
and the DS controller (4.17). Suppose there exist symmetric matrices X
and Y and matrices F, K and L such that
satisfy conditions (4.26), (4.27) and (4.22) for sufficiently small e > 0. Since
\X\\ can be arbitrarily close to zero, the domain of attraction for the plant
state can be arbitrarily large, assuming zero initial controller state.
We now consider the state feedback problem. The result basically fol-
lows from Theorem 4.2 by letting M I.
\ AQ + BK 0 1 f Q Kl] (
He
[ CQ + DK -7! J < ' [Ki 0} \>Q' (4<28)
Let u = JCx with /C := KQ~l be the state feedback controller. Suppose the
initial state satisfies
x(QYQ-1x(Q) < I . (4.29)
Then we have Ui(t) < on for alH > 0 and
\\e(t)\\2dt<2-f.
Proof. It is easy to verify that the closed-loop system with the indicated
state feedback controller satisfy conditions (4.6) and (4.7) with
In general, there exist Q and K satisfying (4.28) for any fixed value
of 7 > 0, provided (A, B) is stabilizable. This can be seen as follows.
Stabilizability of (A, J5) implies existence of Q0 and K0 such that He(AQ0 +
BK0] < 0 and Q0 > 0. Since the second condition in (4.28) is equivalent
to o?Q > K]Ki, there exists a sufficiently small e > 0 such that Q := eQ0
and K := eK0 satisfy this condition. Now, for these Q and K, there exists
a sufficiently large 7 > 0 such that the first condition in (4.28) holds. Thus
we have shown that there is a triple (Q, K, 7) satisfying (4.28) and Q > 0
whenever (A, B) is stabilizable. Let (Q0,K0,^0] be redefined to be one
such triple. For 7 > 70, it is clear that (Q0,Ko,"l} satisfies (4.28). On the
other hand, if 7 < 70, then it can be verified that (aQ0^aK0^} satisfies
(4.28) where a := 7/70. In general, the more stringent the performance
requirement (i.e. smaller 7), the smaller the domain of performance (i.e.
smaller Q).
A state feedback controller that maximizes the domain of performance
for a given level 7 can be designed as follows: Fix 7 > 0 and solve the
following:
max det(Q) subject to (4.28).
Q,K
Pfc+i c P f c (fc = 0 , . . . , g )
whenever rr(0) Pfc. Now, suppose that the gains are switched in ac-
cordance with (4.30). Let tk (k ! , . . . , < ? ) be the time instants when
the switchings occur and define to := 0, tq+i := oo, and xk '= x ( t k )
/
JO fc=0
For each k = 1, . . . , <?, by definition xJkPhXk 1 holds and hence the value
of x\Pk-\Xk is bounded below by
where A m i n (-) denotes the minimum eigenvalue. Thus we have the following
H^ performance bound for the switching controller:
9
2
dt < 70 + fc - 7fc-iA m in(P fc " 1 Pfc-i)) (4.31)
k=i
whenever x(0) PO-
Specializing the general idea to the linear analysis case, we have the
following result. We consider for brevity the single input case only.
0 1 \Qk i
CQk + DKk -7fc/ J < ' [ Kk c
for k = 0, . . . , q, and
7fc + / fc
" Q fc _i < gfc < g fc _! (4.33)
7fe-i
for A; = 1, . . . , q. Then the switching controller
with /Cfc : KkQfr1 and Q+t := ool yields |w(t) < a for alH > 0 and
Proof. The result basically follows from the preceding argument and
the fixed-gain state feedback synthesis result of Corollary 4.2 with the
change of variables Qk := P/71 and Kk := fckQk- The additional con-
straint Qk < Qk-i in (4.33) is imposed to guarantee the nesting property
P/c C Pfc-i- The performance bound can be shown as follows. The second
term on the right hand side of (4.31) is bounded above by ^k if and only
if
A (T)~ 1//2 D O~ 1/2s )
or equivalently.
Redefining 7fc/2 and ^fc/2 to be 7^ and /z^, respectively, we have the first
inequality in (4.33) and the performance level is bounded as in (4.34). D
In view of Theorem 4.3, the switching mechanism in the controller im-
proves the closed-loop performance bound by 2/^ := 2^|_ 1 /^fc, for the
performance bound with the fixed-gain controller u = )Cox is 270- The
best switching controller within this framework results when 70 n is min-
imized over the variables Qk, K^, 7^ and //fc (k = 0 , . . . , q) subject to the
constraints in Theorem 4.3. This problem is nonconvex and it is difficult
to compute the globally optimal solution. Hence, we propose a successive
convex optimization to find a reasonable switching controller as follows.
The switching controller thus obtained does not optimize the overall per-
formance. However, the gain /Cfc is chosen so that the performance bound
We use the design condition derived from the linear analysis (Theo-
rem 4.3) to design a switching state feedback controller. The following
example illustrates the design procedure and the benefit of the switching
strategy.
A := B := C := \ 1 0 D := 0, M = I.
0.1 0 1
We consider the Synthesis Problem with a = 1 and design a switching state
feedback controller based on the Switching Control Design Algorithm with
<? = 4. We have chosen 70 = 50 and designed the initial feedback gain /Co
as described in Step 1 of the algorithm. We then successively computed
the gains /Ci through 4 following Step 2. The results are as follows:
" 7o " " 50.0000 "
1.9348
7i 16.2234
= 0.6954
72 5.3730
0.2447
73 1.7991
0.0850
. 74 . 0.6063
" -0.2467 -0.1497 "
/Co
JCi-0.3615 -0.1795
/C2 = -0.5405 -0.2179
/C3 -0.8170 -0.2667
/C4 -1.2433 -0.3279
The domain of performance for each value of 7$ is plotted as an ellipse in
the xi-x-2 plane in Fig. 5. Note that the ellipses are nested, as specified.
-10
- 6 - 4 - 2 0 2 4 6
& 2
8
10 20 30 40 50 10 20 30 40 50
Time Time
BVk
Qk
He -rKk -Vk (4.35)
DVk
. < Qk-i
Qk-i < Qk . (4-36)
7/c-i
for A; 1 , . . . , q. Then the switching controller
with /Cfe := KkQ^1 and Q^+i := oo/ yields |2(t)| < p for all t > 0, and
f ( 9 \
/ \e(t)\2dt<'2
Jo
V
Proof. The result directly follows from condition (4.13) with a change
of variable K := )CQ and from the argument for switching control design
presented in Section 4.3.4. D
for designing the initial gain /Co is to maximize the domain of performance
det(Qfc) for a fixed value of performance level 7^, over the variables Qk and
Kk, subject to constraints (4.35). This problem is a quasi-concave maxi-
mization which can be solved efficiently. The initial gain is then obtained as
/Co := KoQQ1. We then increment k and go on to calculate additional gain
JCk ' KkQ^1 by maximizing Hk over Kk, Qk, 7fc and ^ subject to (4.35)
and (4.36). Repeat this last step for k = 1 , . . . , q where q is the number of
switchings.
From Theorem 4.1 and its proof, we know that the optimal performance
bound is obtained when r = 0 (i.e. p = a 1) so that the circle criterion
(4.35) reduces to the linear analysis condition (4.32). Therefore, we should
always let p = I to optimize the performance bound. However, as we show
below, a "good" design may result when p > I . In particular, it will be seen
that increase in p does not substantially affect the domains of performance
but yet the control gain is very much influenced so that the actual output
response can be improved.
Fix p to be either p = 2 o r p = 1 0 , and follow the design procedure
outlined above. The results are found to be
50.0000
1.9014
16.3991
0.6792
5.4522
0.2388
1.8300
0.0830
0.6178
for the p 2 case (the values of 7^ and /j,k for the p = 10 case are similar),
and
(Case: p = 2) (Case: p = 10)
/Co " -0.4890 -0.3018 " -2.3963 -1.5302
1 -0.7053 -0.3635 -3.4303 -1.8405
/C2 -1.0453 -0.4420 -5.0704 -2.2372
/C3 -1.5720 -0.5412 -7.6041 -2.7386
/C4 -2.3843 -0.6656 -11.5061 -3.3676
10
5
N
0
-5
-10
- 6 - 4 - 2 0 2 4 6
0 10 20 30 40 50 0 10 20 30 40 50
Time Time
We have seen in Example 4.2 that the circle criterion can be used to
heuristically improve the actual performance of the "theoretically optimal"
controller designed in Example 4.1. In this section, we present another
heuristic method to design a fixed-gain (without switching) state feedback
controller that outperforms that in Example 4.1. To this end, we use the
following synthesis condition obtained by modifying Corollary 4.2 to accel-
erate the convergence of the output signal.
Let u KQ~lx be the state feedback controller. Suppose the initial state
satisfies
x(^Q-lx(Q} < 1. (4.38)
Then we have Ui(t) < on for alH > 0 and i = 1, . . . , m. and
Q) = e0tz(t]
where z(t) is the response of the original system. D
in Fig. 5. The feedback gain and the domain of performance for this case
are given by
29.8150 -44.6171
K = [ -0.6708 -0.4171 ] , Q=
-44.6171 108.8536
where the performance domain xTQ lx < 1 is plotted as the larger (dashed)
ellipse in Fig. 9. The optimal value of p that yielded this Q is p = 2.7858.
Note that the two straight lines correspond to K,x = 1 and thus the control
input does not saturate if and only if the state is in the region between the
lines. The smaller (solid) ellipse in Fig. 9 indicates the guaranteed domain
of performance weighted by (3 = 0.2.
10
o
-5
-10
-6 -4 -2 0 2 4 6
X
1
ft 2
8
-0.5
0 10 20 30 40 50 0 10 20 30 40 50
Time Time
and plotted in Figs. 9 and 10. Note that the case x(0) = 1 has been treated
in the previous examples. We see that the effective use of the circle criterion
yielded a fixed gain controller that outperforms the switching controller
designed in Example 4.1. Note, however, that the switching controller
was systematically obtained without design iterations while the fixed-gain
controller required a heuristic parameter tuning of f3. Finally, we remark
that the fixed gain controller does saturate for certain initial conditions
as shown by the plots for the case x(0) = 2, in contrast with the fact
that any controller, fixed or switched, designed by using Corollary 4.2 or
Theorem 4.3 would not saturate for any initial conditions within the domain
of performance.
4> F- i
Proof. We prove the result only for the case where u and are scalars.
The general case where u and are vectors directly follows because the
matrix G and the function 0 are both diagonal.
If G > 1, then the equation u 0( + Gu) is satisfied by both u = 1
and u I when is zero. Thus the mapping from to u is not uniquely
defined at = 0, and we conclude that G < I is a necessary condition for
well-posedness. Below, we show that this condition is also sufficient, by
explicitly constructing the mapping.
Suppose G < I . We claim that if u = </>( + Gu) holds then
> 1 -G & u = l,
K(s) = D2
Suppose that D2 is diagonal and the feedback loop in Fig. 12 is well posed,
i.e. the output u is uniquely determined by the input y. Then D2 < I and
the mapping from y to u in Fig. 12 with the above K(s) is identical to the
mapping from y to u in Fig. 12 with K(s) replaced by
A Bl B2(I-D2]
K0(s] =
C 0
Proof. Let us explicitly write down the equations describing the map-
ping from y to u in Fig. 12 as follows:
x = Ax + B2(z ~ u), z = Cx + D\y + D2(z - u), u = 0(2).
Well-posedness requires that / D2 is invertible, in which case the second
equation can be solved for z as
(D2-I)-1D2<I, or D2<I
holds. In this case, u is given by
References
[8] T. Iwasaki and R. E. Skelton. All Controllers for the General H^ Con-
trol Problem: LMI Existence Conditions and State Space Formulas,
Automatica, 30(8) (1994) 1307-1317.
[23] A. Saberi, Z. Lin, and A. Teel. Control of Linear Systems with Satu-
rating Actuators, IEEE Trans. Auto. Contr., 41(3) (1996) 368-378.