a r t i c l e in fo abstract
Article history: This paper presents an adaptive internal model controller for stable but not necessarily minimum-
Received 22 December 2008 phase SISO plants and its application to the air/fuel ratio control system of a spark-ignited engine. The
Accepted 17 March 2010 internal model of the controller is formulated in an output-error structure that can be adapted by using
Available online 8 April 2010
standard adaptive laws. The method is applied to an air/fuel ratio control system with a reduced-order
Keywords: internal model and unknown sensor dynamics. Experiments on an engine test bench demonstrate the
Adaptive control capability of the adaptive controller to recover the performance and robustness properties of the
Internal model control control system in the case of an aged oxygen sensor.
Output-error model & 2010 Elsevier Ltd. All rights reserved.
Air/fuel ratio
Oxygen sensor
Sensor ageing
0967-0661/$ - see front matter & 2010 Elsevier Ltd. All rights reserved.
doi:10.1016/j.conengprac.2010.03.011
874 D. Rupp, L. Guzzella / Control Engineering Practice 18 (2010) 873–881
local stability results obtained are shown here to be sufficient in p. 190) where the injected fuel mass is varied from 10% to + 10%
the case of AFR control, which is a representative application of of the nominal fuel mass without any compensation of the wall-
internal model controllers. It is also shown that by foregoing wetting dynamics. The two parameters of this model are
global stability the robustness of the adaptation regarding dependent on the operating point of the engine, as determined
external disturbances and the control performance can be by the engine speed and the mass of air in the cylinders. The
increased. These are important features when adaptive control values of the two parameters are typically available from engine-
methods are used for processes such as AFR control where only a specific maps that are identified off-line. A typical range for both
reduced-order model is available. parameters is from 30 ms for high speed and high air mass up to
In contrast to classical adaptive control systems, for the 0.5 s for low speed and low air mass. The relative errors of the
method described in this paper, typically a substantial amount maps that are used in production-type cars are less than 20% for
of prior information about the model is available, i.e. the initial all operating points except very low air mass and speed. The
internal model is already a good approximation of the dominant wide-range lambda sensor can also be modeled as a first-order
plant dynamics. In classical model reference adaptive controllers, low-pass element with the time constant ts :
the adaptation signals are used to compensate for disturbances in
order to match a reference model. With the method presented Dls 1
Ps ðsÞ ¼ ¼ : ð2Þ
here, these signals are used solely to improve the internal model DlmC ts s þ 1
of the IMC, while the resulting adapted but static IMC handles the
rejection of disturbances. The new method can thus be seen as a The time constant of a new state-of-the-art wide-range lambda
stable way to increase controller performance by online closed- sensor is about 50 ms, but during its lifetime this time constant ts
loop system identification. This implies that the adaptation needs can increase to 1 s.
to be turned on only when the model deviates from the plant.
Lambda sensors are an essential part of modern AFR control The main goal of the feedback controller is to compensate for
systems. Based on the measurement data provided by the oxygen the disturbances in the AFR as a result of potentially rapidly
sensor, the controller in the engine control unit (ECU) regulates varying torque commands issued by the driver. For several
the correct amount of fuel to be injected. Due to ageing and harsh reasons, such as easy tunability and parametrization as well as
operating conditions, a wide-range oxygen sensor can undergo robustness, an IMC as illustrated in Fig. 2 is used. The performance
substantial changes in its dynamics, which have a detrimental and robustness of a control system governed by a model-based
effect on the performance of the control system. controller obviously is strongly connected to the quality of the
model available. To illustrate this, let us assume that the relative
2.1. The air/fuel ratio dynamics of an SI engine uncertainty of the model PðsÞ ^ with respect to the plant P(s)
satisfies the inequality
Fig. 1 shows the fuel path of an SI engine. Its dynamics
PðjoÞPðj
^ oÞ
comprise several delays, the wall-wetting dynamics, the gas
o W2 ðoÞ, 8o
mixing dynamics, and the sensor dynamics. The input uf to the ^ oÞ
Pðj
plant is a multiplicative factor for the nominal injection duration,
and the output ls is the signal produced by the lambda sensor, for all frequencies o, where W2 ðoÞ is the frequency-dependent
which is assumed to measure the lambda value lmC at the main uncertainty bound. The IMC control system is robustly stable if
confluence point of the exhaust pipes. A detailed analysis of this the inequality
system can be found in Onder, Roduner, and Geering (1997).
However, for control purposes, the complete fuel path from the 1 1
jQ ðjoÞj o , 8o ð3Þ
fuel injector to the main confluence point can be approximated ^ oÞj W2 ðoÞ
jPðj
fairly well by a first-order low-pass element with a time constant
t and a transport delay d (Guzzella & Onder, 2004) holds for all frequencies o (Morari & Zafiriou, 1989). In the ideal
DlmC 1 case, when no disturbances or model uncertainties are present,
Pe ðsÞ ¼ ¼ esd , ð1Þ the internal controller Q(s) acts as a pure feedforward controller.
Duf t sþ1
It is thus typically designed to invert the plant, at least in the
where s is the Laplace variable and D stands for a small deviation control-relevant frequency range. However, (3) shows that the
from the nominal value. For small deviations of the nominal model uncertainty W2 ðoÞ acts as a border line in the tradeoff of
injected fuel mass the linear model Pe(s) also covers the wall- robustness versus performance. Specifically, given a fixed internal
wetting dynamics. This can be seen in Guzzella and Onder (2004, controller Q(s), the robustness can be increased or recovered by
improving the precision of the model.
hT ^ ^ ^ T
y ¼ ½an1 a n1 ,an2 a n2 , . . . ,a0 a 0
In this section an adaptive law is derived for the nominal case
in which no disturbances are acting on the system and in which such that the model transfer function resulting from (9) matches
the order of the plant is fully known. the plant P(s):
^ þ hT bn
NðsÞ NðsÞ
u
3.1. Plant matching adaptation parameters ¼ : ð10Þ
^ þ hT an
DðsÞ DðsÞ
y
hT ^ ^ ^ T
u ¼ ½bm b m ,bm1 b m1 , . . . ,b0 b 0 Fig. 3. Structure of the adaptive IMC.
876 D. Rupp, L. Guzzella / Control Engineering Practice 18 (2010) 873–881
transfer function
^
DðsÞ
Pe~ ðsÞ ¼ ð17Þ
DðsÞ
is strictly positive real (SPR), the adaptive system shown in Fig. 3
is globally stable and the error e~ converges to zero as t-1.
Furthermore, if n is a persistently exciting signal, then
lim J/J ¼ 0,
t-1
The transfer function Pe~ ðsÞ of the error dynamics as defined in Fig. 4. Maximal allowable relative errors of o0 and z for different values of z, such
(17) is the crucial part of the stability analysis of the adaptive that (23) remains SPR.
control system. Global stability can be guaranteed if Pe~ ðsÞ is SPR.
Since Pe~ ðsÞ contains the unknown denominator polynomial of the is obtained. This equation is useful to analyze the SPR robustness
plant PðsÞ, its strictly positive realness cannot be determined prior of a given setup of the control system.
to the adaptive control design. However, since the parameters of
the internal model PðsÞ ^ of the initial control design are typically Example. Given is the second-order plant
derived using an off-line system identification procedure they can NðsÞ
PðsÞ ¼
be assumed to represent the dynamics of the plant quite well. s2 þ 2zo0 s þ o20
From this assumption it follows that the transfer function Pe~ ðsÞ is
and its associated model
close to unity and thus SPR.
Based on the ideas presented in Karimi, Kunze, and Longchamp ^
NðsÞ
^ ¼
PðsÞ ,
(2007), a method was developed to determine a region for the s2 þ 2z^ o^ 0 s þ o^ 20
coefficients of the polynomial D(s) given the polynomial DðsÞ ^ such
that the transfer function Pe~ ðsÞ is SPR. To this end, consider the where z is the damping ratio, o0 is the natural frequency, and z^
transfer function and o ^ 0 are their corresponding estimates. The order of the
^
numerator polynomial NðsÞ is equal to the order of the numerator
^
DðsÞ ^
DðsÞ
Pe~ ðsÞ ¼ ¼ , ð18Þ polynomial N(s). With (17) the error model of this setup can be
DðsÞ ^
DðsÞ þ DðsÞ written as
where s2 þ 2z^ o ^ 20
^ 0 sþo
Pe~ ðsÞ ¼ : ð23Þ
DðsÞ ¼ dn1 a^ n1 sn1 þ þ d1 a^ 1 s þ d0 a^ 0 ð19Þ s2 þ 2zo0 s þ o20
is an unknown polynomial, with the coefficients a^ 0 , a^ 1 , . . . , a^ n1 For this error model, Eq. (21) can be solved analytically. The areas
from (6) and the unknown tuning factors d0 ,d1 , . . . ,dn1 . By below the graphs in Fig. 4 represent the allowable relative error of
assumption, the transfer function in (18) has relative degree 0 and o0 and z, for different values of z, such that (23) remains SPR.
is analytic in Re½s Z0, where Re[s] stands for the real part of s, Clearly, the maximal allowable error is small for weakly damped
thus Pe~ ðsÞ is SPR if and only if (Ioannou & Tao, 1987) systems, whereas for sufficiently damped systems a large relative
" # error can be accepted. It is also worth mentioning that the graphs
^ oÞ
Dðj shown in Fig. 4 are independent of the (nominal) value of o0 .
Re 4 0, 8 o A ð1,1Þ:
^ oÞ þ DðjoÞ
Dðj
4. Adaptation under real conditions
In Kim and Meadows (1971) it is shown that if and only if a
transfer function is SPR then its inverse is SPR as well. Thus, in
For obvious reasons, the assumptions that the plant order is
order to guarantee strict positive realness the inequality
fully known and that no disturbance is acting on the system are
" #
DðjoÞ not valid when the adaptive controller is applied to a real system.
1 þRe 4 0, 8 o A ð1,1Þ ð20Þ The use of a low-order model results in the loss of the strictly
^ oÞ
Dðj
positive realness of the error dynamics Pe~ ðsÞ, which in turn leads
has to hold. With (19), expression (20) can be written as to the loss of the global stability of the adaptive control system.
" # However, the local stability results that are presented in this
a ^ ðjoÞT
1 þRe N d 4 0, 8 o A ð1,1Þ, ð21Þ section prove to be sufficient in the case of AFR control, which can
^ oÞ
Dðj be seen as a representative application of internal model
with d ¼ ½dn1 , . . . d0 T and aN^ ðsÞ ¼ ½a^ n1 sn1 , . . . , a^ 1 s, a^ 0 T . In- controllers.
equality (21) can now be discretized at the frequencies oi of To deal with the difficulties evolving from neglected system
interest. As a result a linear matrix inequality (LMI) dynamics and disturbances, the following modified version of the
2 3 adaptive law (16) is used:
a ^ ðjo1 ÞT Z
6 N 7 g tk n e~
6 Dðj
^ o1 Þ 7 htk ¼ htk1 þ dt, ð24Þ
6 7 T tk1 1 þ nT n
6 ^ 7
IN þ Re6 7 d 40 ð22Þ
6 7 where htk is the adaptation parameter vector h at the time tk, g is
6 a ^ ðjoN ÞT 7
4 N 5 the adaptation gain, and T¼tk tk 1 is the adaptation interval,
^ oN Þ
Dðj
respectively. The modification incorporates the normalization and
D. Rupp, L. Guzzella / Control Engineering Practice 18 (2010) 873–881 877
the averaging of the update step, which is often referred to as For reasons of symmetry, Eq. (30) applied to condition (27) then
hybrid adaptation (Elliott, 1982). yields
X
1
T
Re½Pe~ ðjoi Þ Re½ni n i 4 0: ð31Þ
4.1. Stability analysis i ¼ 1
This condition is always satisfied if Pe~ ðsÞ is SPR and if the matrix
With (11), (15), and (24) the adaptation parameter error vector T
ni n i is positive definite due to persistent excitation. However,
/ at time tk can be written as
expression (31) allows the formulation of a less conservative
Z
g tk n Pe~ f/Ttk1 ng condition for stability. The SPR condition is relaxed to a positivity
/tk ¼ /tk1 dt: condition of the energy of the signal n weighted by the real parts
T tk1 1þ nT n
of the transfer function Pe~ . For the specific case of the adaptation
Since /Ttk1 is constant, it can be taken out of the integral of the internal model, the condition (31) implies that the main
Z energy of the signals u and y^ should be in the frequency range
g tk n Pe~ fnT g
/tk ¼ /tk1 dt /tk1 , where the structure of the internal model P^ is flexible enough to
T tk1 1 þ nT n
closely match the plant P(s). Given the quasi-stationary hybrid
which can now be rewritten as adaptation and a small adaptation gain g, the frequency content of
" Z # the adaptation signal hT n is mainly governed by the signal n. The
g tk n Pe~ fnT g reference signal r and the plant output y thus are the two main
/tk ¼ I dt /tk1 : ð25Þ
T tk1 1 þ nT n ‘‘sources’’ of frequencies in the control system. The frequency
content of the reference signal r is thus to be chosen by the user in
To analyze the stability properties of (25), the following lemma is such a way that the sum of its weighted energy enters positively
used: in (31) to account for the negative entries due to disturbances and
noise in the non-SPR frequency region. In the case of air/fuel ratio
Lemma 1. Consider the sequence of the vector x:
control, this condition is easy to meet since the air/fuel ratio can
xk ¼ x0 for k ¼ 0 be excited quite strongly without too much impact on the tailpipe
emissions. However, this method is suitable also to be applied to
xk ¼ ½Igk F k xk1 for k ¼ 1,2, . . . , ð26Þ any other practical problems of the same type.
where F k and gk are the matrix F and the adaptation gain g at step k,
respectively. If the matrix gk F k is bounded and if the matrix 5. Application to air/fuel ratio control
Rk ¼ F k þ F Tk satisfies the inequality
Rk 4 0 8 k, ð27Þ The internal model of the IMC for the AFR control can be split
into two transfer functions, as shown in Fig. 5. The transfer
then (g 4 0 such that for all gk A ð0, g Þ xk -0 asymptotically as
function P^ e covers the dynamics and the delay time of the fuel
k-1.
path, which are assumed to be known, whereas P^ s represents the
An outline of the proof of this lemma is given in Appendix B. In first-order dynamics of the healthy lambda sensor with the time
the following, this lemma is used to weaken the SPR condition constant t^ s,0 :
under the assumption that the adaptation gain g is small. For the 1=t^ s,0
P^ s ¼ :
further analysis, the averaging analysis introduced by Anderson s þ 1=t^ s,0
et al. (1986) is adopted. Assuming that the signal vector nðtÞ is T-
According to Section 3.1 and by using the fact that the static gain
periodic, i.e.
of the adapted model is equal to one at all times, the signal x can
X
1
2pi be defined as
nðtÞ ¼ ni ejoi t with oi ¼ , ð28Þ
i ¼ 1
T 1=t^ s,0
x¼ fy^ e yg:
^ ð32Þ
s þ 1=t^ s,0
and where ni is the amplitude of the i-th harmonic. The signal
Pe~ fnT g can be written as By inserting (32) into (8), the signal y^ can be derived as
X
1 1=t^ s,0 ð1 þ yÞ
Pe~ fnT g ¼ Pe~ ðjoi Þ fni ejoi t g: y^ ¼ fy^ e g,
s þ 1=t^ s,0 ð1 þ yÞ
i ¼ 1
where y is the adaptation parameter. Furthermore, the matching
For the evaluation of the positivity condition (27) the matrix
error can be written as
Z
1 T s þ 1=t^ s,0
n P e~ fnT g e~ ¼ ff ðy^ e yÞg,
^
T 0 s þ1=ts
is considered without the normalizing scalar 1 þ nT n. Thus, with
(28) it can be written as
8 !T 9
Z < X =
1 T X 1
joi t
1
jo i t
ni e Pe~ ðjoi Þ ni e : ð29Þ
T 0 : ;
i ¼ 1 i ¼ 1
Considering the periodicity of the signals and the fact that for the
complex conjugate n i of ni it holds that x i ¼ ni , (29) can be
written as
X
1
T
Pe~ ðjoi Þ ni n i : ð30Þ
i ¼ 1 Fig. 5. AFR control system with an IMC and excitation at the input of the plant.
878 D. Rupp, L. Guzzella / Control Engineering Practice 18 (2010) 873–881
6. Experiments
lambda signal and the output of the internal model during the
first and the last 10 s of the adaptation at OP2. The comparison of Table 1
the output and equation errors is shown in Fig. 11. The equation Normalized sums of the squared control error signal during the (warm) start phase
of the FTP-75 cycle with a sensor time constant of 0.5 s in three different scenarios
error method results in a considerable bias at OP2 due to the large
(second to fourth columns) and with a production-type sensor (last column).
disturbances at this operating point. The effect of small static
disturbances of 2% that were introduced at the input of the plant t^ s ¼ 0:05 s t^ s ¼ 0:5 s t^ s ¼ 0:5 s and inv. Production type
was also investigated. The method presented in this paper results
P 1 0.75 0.63 0.58
Dl2
ðt s þ 1Þðt^ s s þ 1Þ
Q ðsÞ ¼ ,
ðd s þ 1Þ2
where t^ s is the adapted time constant of the sensor. The last entry
in Table 1 shows the result achieved with a production-type
sensor (Bosch LSU 4.2). In order to obtain an emission-relevant
result in all four scenarios, the calculation of the square sum of the
lambda deviations is based on the signal of a production-type
sensor rather than on the signal of the slow sensor that is fed into
the controller. Thus, under stationary conditions, the internal
model can be adapted efficiently with the method introduced
in this section. However, in a passenger car, the adaptation has to
Fig. 10. Measured lambda (black) and output of the internal model (grey) during
the first and the last 10 s of the adaptation at OP2 with the output error method as
be performed under highly transient conditions such as they
shown in Fig. 11. The dashed line indicates the excitation signal ue at the input of occur in normal driving situations. During engine transients, the
the plant. disturbances that act on the AFR control loop due to the imprecise
880 D. Rupp, L. Guzzella / Control Engineering Practice 18 (2010) 873–881
Fig. 12. Adaptation of time constant during the FTP-75 driving cycle. Three e~ ¼ cx þ d½/T n ð33Þ
different initial values are shown in the case of a sensor time constant of ts ¼ 0:5 s.
with the system matrices fA,b,c,dg. Since Pe~ is SPR, it follows from
Lemma 4 in Meyer (1965) that there exist the symmetric positive-
feedforward compensation of the AFR have a detrimental effect on
definite matrices P and Q , a vector q, and a scalar e 4 0 such that
the performance of the adaptive algorithm. It is thus important to
ensure that the adaptation is active only when the engine is AT P þPA ¼ qqT eQ
operating near stationary conditions. To that end, a heuristic
pffiffiffi
decision logic has been developed that rejects the parameter Pbc ¼ dq: ð34Þ
update of the hybrid adaptive law in (24) whenever an
unacceptable engine transient has occurred since the last Note that the standard Kalman–Yacubovich Lemma cannot be
update step. The main ‘‘sources’’ of potential disturbances of the applied since the error dynamics transfer function Pe~ is not
feedback control systems are the movements of the throttle. Thus, strictly proper, and due to the potential zero-pole cancelations the
in order to obtain a measure for the movements of the throttle, pair ðA,bÞ cannot be guaranteed to be fully controllable. Now
the integration of the sum of squares of the deviations from the consider the Lyapunov function candidate
throttle position a at the beginning of the integration in (24) is
Vðx, /Þ ¼ xT Pxþ /T C1 /
calculated
Z with Vðx, /Þ 4 0, 8x, / a 0. The derivative of Vðx, /Þ with respect to
1 tk
Ja ¼ ðaðtk1 ÞaðtÞÞ2 dt: the time t can be written as
T tk1
T _ T C1 / þ /T C1 /
V_ ðx, /Þ ¼ x_ Px þ xT P x_ þ / _: ð35Þ
The update of the adaptation is then rejected if the measure Ja is
larger than a certain predefined threshold value. Furthermore, for With the adaptive law (16) and the error dynamics (33), and after
the reasons discussed in Section 5, the update of the adaptation is some straightforward algebraic manipulations, (35) can be
also rejected if the engine is idling. Fig. 12 depicts the adaptation written as
during the hot-start phase of an FTP-75 driving cycle for various
initial values. At certain points of the adaptation, the value of the V_ ðx, /Þ ¼ xT ðAT P þ PAÞx þ2xT Pb½/T n2e½
~ /T n,
estimated time constant t^ s remains constant for some time due to and thus with (34)
the decision logic. pffiffiffiffiffiffi
V_ ðx, /Þ ¼ xT ½qqT þ eQ x2d½/T n2 þ 2 2dxT q½/T n,
which can be written as
7. Conclusions
V_ ðx, /Þ ¼ exT QxvT v, ð36Þ
The problem of sensor ageing in AFR control systems is pffiffiffiffiffiffi T
with v ¼ ½x q 2d½/ n and thus V_ ðx, /Þ o 0, 8 x, / a 0, which
T
addressed by presenting a method to adapt the internal model of
proves the global stability of the adaptive system. The stability
an IMC during closed-loop operation. Inspired by the IMC
implies that e~ and / are globally bounded. Thus, since r is
principle, an output error model structure was used as the basis
assumed to be bounded and the transfer function Q(s) is stable
of the adaptive algorithm. The analysis of the theoretical stability ^ ^ ^
and proper, and the transfer functions PðsÞ, an =DðsÞ and bn =DðsÞ
properties can be reduced to the analysis of the dynamics Pe~ of the
from (7) are stable and strictly proper, it follows that the signals u
adaptation error e. ~ This has been investigated in a general
and y^ and thus n and n_ are also bounded. From the boundedness
framework and then studied in detail on a general second-order
of fng and / it follows that x_ in (33) is also bounded. Thus the
example to demonstrate the applicability of the method to other
second derivative of Vðx, /Þ with respect to time
industrial processes. The strictly positive realness of Pe~ is a
T T
condition for global stability of the adaptive system. However, V€ ðx, /Þ ¼ ex_ QxexT Q x2
_ v_ v,
assuming that a reasonable initial estimate of the internal model pffiffiffiffiffiffi pffiffiffiffiffiffi
^ with v_ ¼ ½x_ T q þ 2de~ nT CT n 2d½/T n_ is bounded and thus
PðsÞ of the IMC is known, the SPR requirement can be replaced by _
V ðx, /Þ is uniformly continuous. Thus according to Barbalat’s
more practical conditions on the frequency content of the
lemma it holds that
reference signal r. The adaptive controller has been applied to
an AFR control system to adapt the time constant of an aged lim V_ ðx, /Þ ¼ 0
t-1
oxygen sensor. The disturbances due to the cyclic operation of the
engine considerably depend on the operating point of the engine and thus from (36) it follows that
and the actual time constant of the oxygen sensor. The experi-
lim x ¼ 0
ments on the test bench have thus been performed at several t-1
D. Rupp, L. Guzzella / Control Engineering Practice 18 (2010) 873–881 881