Abstract— Teleoperation systems, consisting of a pair of the linear disturbance observer limitations for the highly
master and slave robots are subject to different types of nonlinear and coupled dynamics of robotic manipulators,
disturbances such as joint frictions, varying contact points, un- Chen et al. proposed a nonlinear disturbance observer for
modeled dynamics and unknown payloads. Such disturbances,
when unaccounted for, cause poor teleoperation transparency nonlinear robotic manipulators and designed it such that
and even instability. This paper presents a novel nonlinear no acceleration measurement was needed [10]. However,
bilateral control scheme, based on the concept of disturbance the closed-loop stability of the overall system including the
observer based control, to counter these disturbances and their disturbance observer and the controller was not investigated.
negative effects on the teleoperation systems. The proposed The investigation of the stability and performance of a
disturbance observer based bilateral control law is able to
acheive global asymptotic force tracking, and global exponential master-slave teleoperation system under disturbance observer
position and disturbance tracking in the presence of various based control is even more challenging and not studied
disturbances. The minimum exponential convergence rate of either. While a distrubance observer based controller was
the position and the disturbance tracking errors can be tuned designed for bilateral teleoperation systems in [11], the
by the controller parameters. Simulations are presented to show master and the slave robots were considered to be linear
the effectiveness of the proposed control scheme.
with only one DOF. This serves as the motivation to look
I. INTRODUCTION for a disturbance observer based control law for nonlinear
Every teleoperation system consists of a master robot and and n-DOF teleoperation systems.
a slave robot. The master interacts with a human operator This paper1 addresses the problem of disturbance observer
and the slave interacts with a remote environment. If force based control of nonlinear teleoperation systems. A dis-
feedback from the slave side to the master side is provided, turbance observer based control law will be proposed and
the system is called a bilateral teleoperation system to dis- incorporated into the framework of the 4-channel teleopera-
tinguish it from a unilateral teleoperation system. A bilateral tion architecture. Under the proposed control law, full trans-
teleoperation system is said to be transparent if the slave parency and exponential disturbance and position tracking
robot precisely follows the position of the master robot and are achieved.
the master robot faithfully displays the slave-environment The organization of this paper is as follows. Section II
contact force to the human operator. introduces the nonlinear model of the teleoperation systems
The most successful control scheme in achieving a fully and 4-channel bilateral control architecture. Section III pro-
transparent teleoperation system is the 4-channel architecture poses a novel disturbance observer based controller for non-
[1], [2], which is mostly suitable for teleoperation systems linear teleoperation systems subject to various disturbances.
with fixed linear models. Physical robots, however, are The teleoperation system transparency is also addressed in
nonlinear systems subject to various disturbances, such as this section. Finally, simulations in section IV show the
unknown dynamics, joint frictions, unknown payloads, etc. efficiency of the proposed control scheme as compared with
[3]. Such disturbances, when unaccounted for, cause poor the case where no disturbance observer is employed.
teleoperation transparency and even instability. One way II. NONLINEAR MODEL OF A TELEOPERATION
to suppress these disturbances, is to employ disturbance SYSTEM
observers [4]. Disturbance observer based control has been
used in applications such as independent robot joint control The dynamical models investigated in this paper and our
[5], and robot joint friction estimation and compensation [6], proposed control law in section III will be in the Cartesian
[7]. space. This enables us to make a teleoperation system
A considerable part of the existing literature on disturbance transparent without requiring the master and the slave robots
observer design for robotic applications uses linearized mod- to have similar kinematics and dynamics.
els or linear system techniques [8], [9]. In order to overcome
A. Model of a teleoperation system in the Cartesian space
This work was supported by the Natural Sciences and Engineering The dynamic equations describing the motions of the end-
Research Council of Canada (NSERC).
A. Mohammadi was with the Department of Electrical & Computer
effectors of n-DOF master and slave robots, which interact
Engineering, University of Alberta, Edmonton, AB T6G 2V4 Canada. He is with the human operator and the remote environment, in the
now with the Edward S. Rogers Sr. Department of Electrical & Computer presence of disturbances can be written as
Engineering, University of Toronto, Toronto, ON M5S 3G4 Canada. Email:
alireza.mohammadi@mail.utoronto.ca
M. Tavakoli is with the Department of Electrical & Computer Engi-
neering, University of Alberta, Edmonton, AB T6G 2V4 Canada. Email: Mxm (qm )ẍm + Nxm (qm , q̇m ) = fm + fh + dm (1)
tavakoli@ece.ualberta.ca Mxs (qs )ẍs + Nxs (qs , q̇s ) = fs − fe + ds (2)
H. J. Marquez is with the Department of Electrical & Computer Engi-
neering, University of Alberta, Edmonton, AB T6G 2V4 Canada. Email:
marquez@ece.ualberta.ca 1A more complete version of this paper can be found in [12].
1766
ẍm = −Cm xm − C2 fe − C4 xs + C6 fh Δẍ + Kv Δẋ + K p Δx = Ψxm (qm )Δdm −Ψ
Ψxs (qs )Δds (13)
+fh + M−1
xm (qm )Δdm (6) where
ẍs = −Cs xs + C1 xm + C3 fh − C5 fe
−fe + M−1
xs (qs )Δds (7) = (C−1 −1 −1 −1 −1
Kv m f + Cs f ) (Cm f Kmv + Cs f Ksv )
where Δdm = dm − d̂m and Δds = ds − d̂s are the master and (14)
the slave disturbance estimation errors, respectively. Kp = (C−1 −1 −1 −1 −1
m f + Cs f ) (Cm f Kmp + Cs f Ksp )
Remark 1. When Δdm = 0 and Δds = 0, i.e., under ideal
(15)
disturbance tracking, the closed-loop system equations (6)
and (7) describe an n-DOF teleoperation system without Ψ xm (qm ) = (C−1 −1 −1 −1 −1
m f + Cs f ) Cm f Mxm (qm ) (16)
disturbances, similar to the one shown in Figure 1 with Ψ xs (qs ) = (C−1 −1 −1 −1 −1
m f + Cs f ) Cs f Mxs (qs ) (17)
the master and slave robots represented by identity inertia
matrices, i.e., Zm (s) = s2 I and Zs (s) = s2 I. ♦ C. Proposed disturbance observers
Let us choose the master and the slave local position In this section, we will design the disturbance observers
controllers in (4) and (5) to be of proportional-derivative in a way that full transparency and disturbance tracking are
type: acheived under the control laws (4) and (5) with choices
in (8), (9) and (10). Our proposed disturbance observers
Cm = Kmv s + Kmp designed in the Cartesian space given the master and slave
dynamics (1)–(2) are
Cs = Ksv s + Ksp (8)
where Kmv , Kmp , Ksv and Ksp are constant gain matrices. d̂˙ m = −Lm d̂m + Lm [Mxm (qm )ẍm + Nxm (qm , q̇m )
Also, let us choose the force reflection gains in (4) and (5)
ΨTxm (qm )(Δẋ + γΔx)
−fh − fm ] +Ψ (18)
to be
d̂˙ s = −Ls d̂s + Ls [Mxs (qs )ẍs + Nxs (qs , q̇s )
C2 = Cm f ΨTxs (qs )(−Δẋ − γΔx)
+fe − fs ] +Ψ (19)
C3 = Cs f (9) where γ is an arbitrary positive constant. Also, Lm and Ls
are constant gain matrices.
where Cm f and Cs f are constant force reflection gain matri- Note that in the 4-channel teleoperation control architec-
ces. We choose the other controllers in (4) and (5) according ture, it is assumed that fh and fe are measured and the same
to (3) to satisfy the full transparency conditions: measurements will be used in (18) and (19). The proposed
nonlinear disturbance observers in (18) and (19) also need
C1 = s2 I + Ksv s + Ksp acceleration measurements. As mentioned before, the need
for full transparency in a wide frequency range justifies
C4 = −(s2 I + Kmv s + Kmp ) using accelerometer – again, the same measurements will be
C5 = Cs f − I needed in (18) and (19). Equations (1) and (2), along with
C6 = Cm f − I (10) (18) and (19), result in the following disturbance estimation
error dynamics:
Remark 2. In order to implement C1 and C4 in (10), we
need to measure or compute the acceleration of the master
and the slave robots. We can omit the acceleration terms if d̂˙ m ΨTxm (qm )(Δẋ + γΔx)
= Lm Δdm +Ψ (20)
good low-frequency transparency is enough in the desired d̂˙
s = ΨTxs (qs )(−Δẋ − γΔx)
Ls Δds +Ψ (21)
application. However, requiring good transparency over both
low and high frequencies justifies using accelerometers [2]. Thoroughout the paper, we assume that the rate of change
♦ of the lumped disturbance is neglibgible in comparsion with
Using (8), (9) and (10) in the master and the slave closed- the estimation error dynamics, i.e. ḋm ∼ = 0 and ḋs ∼ = 0.
loop dynamics (6) and (7) result in This assumption is not overly restrictive and is commonly
encountered in the robotics literature (see, for example, [10]).
Thus, the following disturbance estimation error dynamics
Δẍ = −Kmv Δẋ − Kmp Δx + Cm f Δf + M−1 xm (qm )Δdm result from (20) and (21) for the master and the slave,
(11) respectively:
−1
Δẍ = Ksv Δẋ + Ksp Δx − Cs f Δf − Mxs (qs )Δds (12)
Δḋm = −Lm Δdm −ΨΨTxm (qm )(Δẋ + γΔx) (22)
where Δx = xm − xs is the position tracking error and Δf =
fh − fe is the force tracking error. Assume that matrices Cm f , Δḋs ΨTxs (qs )(−Δẋ − γΔx)
= −Ls Δds −Ψ (23)
Cs f and C−1 −1 −1
m f + Cs f are invertible. Multiplying (11) by Cm f Remark 3. The terms Ψ Txm (qm )(Δẋ + γΔx) and
−1
and (12) by Cs f and adding them together, we can find the Ψ Txs (qs )(Δẋ + γΔx) in (18) and (19) are new and do
dynamic equation governing the position tracking error not exist in the nonlinear disturbance observer proposed
1767
by [10]. These new terms will help us to guarantee global
force tracking, global exponential position tracking and T
Gx (q) = m1 g cs21 + m2 gs12 m2 gc12
disturbance tracking in our teleoperation system. ♦
The following two theorems state the main results of this where
paper.
Theorem 1: Consider the teleoperation system subject to
disturbances described by (1) and (2). The master and the Vx1 = −(m2 l1 c2 + m2 l2 )q̇21 − m2 l2 q̇22 −
slave disturbance observers are given in (18) and (19). Then c2
(2m2 l2 + m2 l1 c2 + m1 l1 2 )q̇1 q̇2
the disturbance observer based control laws given in (4) s2
and (5) with choices in (8), (9) and (10), guarantee global
Vx2 = m2 l1 s2 q̇21 + l1 m2 s2 q̇1 q̇2
asymptotic stability of the disturbance tracking error, the
position tracking error, and the force tracking error if the Also, the forward kinematics and the Jacobian matrix are
following conditions hold:
1) Lm = LTm > 0 and Ls = LTs > 0 are constant symmetric T T
and positive definite matrices, h(q) = x1 x2 = l1 c1 + l2 c12 l1 s1 + l2 s12
2) Kv given by (14) exists and is a constant symmetric
and positive definite matrix satisfying Kv > γI,
3) K p given by (15) exists and is a constant symmetric l1 s2 0
J(q) =
and positive definite matrix, l1 c 2 + l 2 l2
4) ḋm ∼= 0 and ḋs ∼ = 0, i.e., the rates of change of dis- where l1 and l2 are the lengths of the links, and m1 and m2
turbances acting on the master and the slave robots are the point masses of the links. Also, we have s1 = sin(q1 ),
are negligible in comparison with the estimation error s2 = sin(q2 ), c1 = cos(q1 ) and c2 = cos(q2 ).
dynamics (20) and (21). In this simulation study, the remote environment and the
Proof: Proof can be found in [12]. human operator’s hand are modeled as linear impedances
The previous theorem addresses the case when we have with mass, damping and stiffness terms. We take Ze (s) =
slow-varying disturbances. In tha case of fast-varying dis- (me s2 + be s + ke )I and Zh (s) = (mh s2 + bh s + kh )I, where I
turbances, the tracking errors will be globally uniformly is the identity matrix. In the simulations, the human hand
ultimately bounded [12]. The next theorem states that the parameters are chosen as in [15]. The remote environment
disturbance tracking and the position tracking errors of the is chosen to be a relatively stiff and damped medium,
teleoperation system can converge exponentially to zero modeled by dampers and springs. These lead us to mh =
under certain conditions. 11.6kg, bh = 17Nsm−1 , kh = 243Nm−1 and me = 0.0kg, be =
Theorem 2: Consider the teleoperation system subject to
800Nsm−1 , ke = 1000Nm−1 .
disturbances described by (1) and (2). The master and the
The friction torques acting on the joints of the robots are
slave disturbance observers are given in (18) and (19). Under
generated based on the model in [16]. For the i − th joint of
the control laws (4) and (5) with choices in (8), (9) and
the robot, i = 1, 2, we have the frictions modeled as
(10), the disturbance tracking and position tracking errors
converge exponentially to zero provided that the conditions
of Theorem 1 hold and γ ≤ λmax (K p + γKv ) where λmax (.) −q̇2i
τi f riction = Fci sgn(q̇i )[1 − exp( )]
represents the maximum eigenvalue of a matrix. v2si
Proof: Proof can be found in [12].
−q̇2
Remark 4. As it is shown in Theorem 2, the mini- +Fsi sgn(q̇i ) exp( 2 i ) + Fvi q̇i
mum exponential rate of convergence for the disturbance vsi
tracking and the position tracking errors to the origin is where Fci , Fsi , Fvi are the Coulomb, static, and viscous
Γ2 )
equal to λλmax
min (Γ
Γ
Γ1 ) . On the other hand, we have λmax (Γ 1 ) =
(Γ friction coefficients, respectively. The parameter vsi is the
κ1 = max{1, λmax (K p + γKv )} and λmin (Γ2 ) = κ2 = Stribeck parameter. In the simulations, the friction coeffi-
min{λmin (Kv − γI), γλmin (K p ), λmin (Lm ), λmin (Ls )}. Thus, cients and the Stribeck parameter for the master and the slave
one can simply determine the minimum rate of convergence are chosen as follows [3]:
by computing κκ21 . ♦
IV. SIMULATION STUDY Fci = 0.49, Fsi = 3.5, Fvi = 0.15, vsi = 0.189, i = 1, 2
In this section, computer simulations will illustrate the ef- In the simulations, we take the actual dynamic parameter
fectiveness of the proposed control scheme. Both the master values of the master and the slave robots to be
and the slave robots are considered to be planar two-link
manipulators with revolute joints. The Cartesian dynamics
are [14] m1m = 2.3kg, m2m = 2.3kg, l1m = 0.5m, l2m = 0.5m
m1s = 1.5kg, m2s = 1.5kg, l1s = 0.5m, l2s = 0.5m
m2 + ms21 0
Mx (q) = 2 Assuming a maximum of ±25% uncertainty in these parame-
0 m2 ters, we take the approximate values of these master and the
T slave parameters to be randomly deviated from the actual
Vx (q, q̇) = Vx1 (q, q̇) Vx2 (q, q̇) values:
1768
m̂1m = 2.82kg, m̂2m = 2.36kg, lˆ1m = 0.62m, lˆ2m = 0.56m
m̂1s = 1.16kg, m̂2s = 1.29kg, lˆ1s = 0.38m, lˆ2s = 0.52m
The controllers Cm , Cs , C1 , . . . , and C6 are chosen as in (8),
(9) and (10). The controllers and disturbance observer gains
and initial conditions are chosen as
γ =1
Kmv = 10I , Ksv = 10I
Kmp = 20I , Ksp = 20I
Cm f = I , Cs f = I
Lm = 20I , Ls = 20I
d̂0m = 0 , d̂0s = 0
Kv = 5I , K p = 10I
The above gains satisfy the conditions in Theorem 1 and the
Theorem 2. Note that the master and the slave controller and Fig. 4. Force tracking of the teleoperation system with conventional scheme
(no disturbance observer).
observer gains have been chosen to be equal– this choice is
not necessary but is one that results in identical closed-loop Figures 5 and 6 show the distrubance tracking of the
master and slave dynamics (11) and (12) when Δdm = 0 and disturbance observer at the master and the slave sides,
Δds = 0. repectively. As it can be seen in Figure 3, the disturbance
To start the simulations, there is no need to apply exoge- tracking error is small when there are no fast changes in the
nous forces to the master and the slave, i.e., we take f∗h = 0 disturbances. In fact, the estimated disturbances tend towards
and f∗e = 0. Instead, we choose different values for initial the actual disturbances in the steady state.
joint positions of the master and the slave while assuming
that both robots are initially at rest. We take the initial joint
position vectors to be
κ2
=
κ1
min{λmin (Kv − γI), γλmin (K p ), λmin (Lm ), λmin (Ls )}
max{1, λmax (K p + γKv )}
4
Fig. 3. Position tracking of the teleoperation system with conventional =
scheme (no disturbance observer). 15
As it can be seen from the disturbance tracking and position
1769
Fig. 6. Disturbance tracking at the slave side. Fig. 8. Force tracking of the teleoperation system with disturbance
observer-based controller.
tracking plots, the slowest tracking speed belongs to Δx2 . In
this case we have R EFERENCES
[1] K. Hashtrudi-Zaad and S. E. Salcudean, “Transparency in time
delay systems and the effect of local force feedback for transparent
Δx2 (1sec ) 0.14 κ2 4 teleoperation,” IEEE Trans. Robot. Autom., vol. 18, no. 1, pp. 108–
ln( ) ≈ ln( ) = 0.33 ≥ = 114, 2002.
Δx2 (0sec ) 0.1 κ1 15 [2] D. A. Lawrence, “Stability and transparency in bilateral teleoperation,”
IEEE Trans. Robot. Autom., vol. 9, pp. 624–637, Oct. 1993.
[3] N.V.Q. Hung, H.D. Tuan, T. Narikiyo, and P. Apkarian, “Adaptive
control for nonlinearly parameterized uncertainties in robot manipula-
tors,” IEEE Trans. Cont. Syst. Technol., vol. 16, no. 3, pp. 458–468,
2008.
[4] K. Ohnishi, M. Shibata, and T. Murakami, “Motion control for
advanced mechatronics,” IEEE/ASME Trans. Mechatron., vol. 1, no.
1, pp. 56–67, Mar. 1996.
[5] K. S. Eom, I. H. Suh, and W. K. Chung, “Disturbance observer
based path tracking control of robot manipulator considering torque
saturation,” in Proc. Int. Conf. Advanced Robot., 1997, pp. 651–657.
[6] S. Sankaranarayanan and F. Khorrami, “Model independent friction
compensation,” in Proc. American Control Conference, 1998, pp. 463–
467.
[7] G. G. Zhang and J. Furusho, “Control of robot arms using joint torque
sensors,” in Proc. IEEE Int. Conf. Robot. Autom., 1997, pp. 3148–
3153.
[8] S. Kim, J. Y. Lee, and D. K. Sung, “A shifted gamma distribution
model for long-range dependent internet traffic,” IEEE Commun. Lett.,
vol. 7, no. 3, pp. 124–126, Mar. 2003.
[9] S. Komada, N. Machii, and T. Hori, “Control of redundant manip-
ulators considering order of disturbance observer,” IEEE Trans. Ind.
Electron., vol. 47, no. 2, pp. 413–420, Apr. 2000.
[10] W. H. Chen, D. J. Ballance, P. J. Gawthrop, and J. O’Reilly, “A
nonlinear disturbance observer for robotic manipulators,” IEEE Trans.
Fig. 7. Position tracking of the teleoperation system with disturbance Ind. Electron., vol. 47, no. 4, pp. 932–938, Aug. 2000.
observer-based controller. [11] Y. Matsumoto, S. Katsura, and K. Ohnishi, “An analysis and design
of bilateral control based on disturbance observer,” in Proc. IEEE Int.
Conf. Ind. Technol., 2003, pp. 802–807.
[12] A. Mohammadi, M. Tavakoli, and H. J. Marquez, “Disturbance
V. CONCLUSION observer based control of nonlinear haptic teleoperation systems,” IET
Control Theory Appl., 2011, In Press.
In this paper, a novel control scheme has been proposed [13] M. Tavakoli, A. Aziminejad, R.V. Patel, and M. Moallem, “High-
fidelity bilateral teleoperation systems and the effect of multimodal
for nonlinear teleoperation systems subject to dynamic uncer- haptics,” IEEE Trans. Syst., Man Cybern. B, bern., vol. 37, no. 6, pp.
tainties and disturbances. The designed nonlinear disturbance 1512–1528, Dec. 2007.
observer-based controller is incorporated into the 4-channel [14] J. J. Craig, Introduction to Robotics: Mechanics and Control, Upper
Saddle River, NJ: Pearson Prentice Hall, 2005.
bilateral teleoperation control framework. The proposed con- [15] K. Kosuge, Y. Fujisawa, and T. Fukuda, “Control of mechanical system
trol scheme is able to suppress the disturbances present in the with man-machine interaction,” in Proc. IEEE/RSJ Int. Conf. Intell.
teleoperation system. Transparency, in terms of asymptotic Robots Syst., 1992, pp. 87–92.
[16] B. Armstrong-Hélouvry, P. Dupont, and C. Canudas de Wit, “A survey
convergence of the position and force tracking errors to zero of models, analysis tools and compensation methods for the control of
and exponential convergence of disturbance tracking and machines with friction,” Automatica, vol. 30, no. 7, pp. 1083–1138,
position tracking errors to zero are achieved. The minimum 1994.
exponential convergence rate can be adjusted to a desired
value by proposed controller parameters. Simulations are
done to show the effectiveness of the proposed approach.
1770