999
This paper reports on the development of an on-line where 77 is a positive constant called the learning-rate
Artificial Neural Network (A")harmonic estimation parameter.
scheme. The scheme is used for harmonic estimation in
Given the old value of the kth weight W , , ( k ) at iteration
an industrial facility.
k, the updated value of this weight at the next iteration k
2. Development of a Fourier Neural Network Model +1 is computed as:
W,(k+l)= w,(k)+Aw,(k) (2.8)
2.1 Fourier Neural Network W,(k+l)=wn(k)-qV%J(k), n=1,2, . . . p (2.9)
A special type of ANN model will be derived and
formulated. The model is similar to the one presented by Equation 2.9 can be applied to the problem of estimation
Osowski [9,10]. Cichocki [ll-161 did further work on the of A, , A,, and B,, . Moreover, the frequency can be
model.
The method of steepest descent can be applied to the adapted if there is any deviation from nominal 0,. The
estimation of harmonic parameters (amplitude and phase adjustment applied to the dc component A, at iteration k
angle) from noisy measurements. Assume that the signal
is defined by
x(t) that has been measured or observed is in the form:
N dE
A,(k+l)= A,(k)-q,- (2.10)
x(t) = A, + n=l
C X, cos(noo + e,) (2.1)
JA,
where
00 =2@0 (2.2) By chain rule, equation 2.10 can be re-written as:
A. dE ah
00is the fundamental angular frequency, is the DC A, (k + 1) = A, (k)- qo -- (2.1 1)
& dA,
component, x, and @,, are the magnitude and phase
Using equations 2.3 and 2.6, equation. 2.1 1 can be
angle of the nth harmonic of the estimated signal
rewritten as:
respectively. Equation 2.1 can be re-written in the form:
N A,@ + 1) = A,(k) + 9 , [ W ) - x(k)l (2.12)
x(t) = A, + n=l A, sin nuor + B, cos mot (2.3) Similarly A, and B, can be written as:
A,(k + 1) = A , ( k ) + qn[d(k) - x(k)Jsin(nw(k)t)
where A,, and B,,
are the deterministic, but
(2.13)
unknown, amplitudes of the in- phase angle and
B,(k + 1) = B,(k) + q n [ d ( k )- x(k)]sin(no(k)t)
quadrature components of the estimated harmonic. By
estimating A,, and B,, the magnitudex,, and phase
(2.14)
angle @n are calculated as follows: Moreover, the same technique can be applied to 0
x, =Jm (2.4)
which might encounter some variation from nominal
value 0,.
N
0, = tan-'(B,, 1 A,,) (2.5) o ( k + 1) = m ( k ) + q [ d 9 k ) - x ( k ) ] t n{ A, (k)cos
0
n=l
where A,, = X,, cos@, and B,, = X,,sin@,, -
((nw(k)t) B ( k ) sin(nw(k)t)]
n
(2.15)
Treating 0 as variable complicates the structure of the
Harmonic estimation can be done using the neural
network steepest descent method to minimize the error in estimator ait will intmon-linearity to the model.
the least-square sense. The error is defined as follows: Equations 2.12, 2.13, 2.14, and 2.15 wbe used to update
harmonic parameters in the estimator model. In .this
1 2
E ( k ) = - ( d ( k ) - x(k)) paper, this model will be referred to as the Fourier
(2.6)
2 Neural (FNN).This name was chosen since the model
Let w,,(k)denotes the value of weight w,, calculated at resembles the Fourier Transform to some extent.
discrete time k by the method of steepest descent. The
adjustment applied to the weight at iteration k is defined In order to reduce the spiky noise [16], the energy
by: function defined in equation. 2.6 can be modified as
follows:
E ( k ) = OH (0)) (2.16)
AW,(k) = -qVwn J(k), n=1.2 ,...,p (2.7)
where
-
e(k)= d(k) x(k) (2.17)
and 0 ,,is defined as follows: The estimation of the frequency 0 will be as follows:
N
o ( k + 1) = o ( k ) - q w [ d ( k )+ x(k)]t Cn
n=l
I
The model FNN was simulated using a specially written
program. The parameters were estimated according to
equations 2.12, 2.13, 2.14, and 2.15. The program contains
a subroutine to simulate a sinusoidal signal with harmonic
content and measurement noise. Parameters like the learning
rate, sampling time and thresholds of the non-linear limiter
are to be selected.
A0 (k + 1) = A, (k)+ q o [ d ) k )- x ( k ) ) (2.20)
The estimation of X, is given as:
3.1.2 Signal To Noise Ratio (SNR)
x, (k + 1) = x, 9k)+ qx(d( k) - x ( k ) )cos(n(lll+t$ )
In order to study the influence of noise on the estimation
(2.21) model, a simulated Gaussian (normal) distribution noise
signal was generated and injected into the estimation model
1001
with the measured input signal. The level of noise to be starting frequency (nominal) and the actual frequency is
injected into the model is related to the power of signal by small. The best value for 7, was found to be 0.8.
the Signal to Noise Ratio (SNR).
The model was tested under different values of SNR,
3.1.5 Error Limiter
ranging from no noise to 0 dB noise. A Gaussian noise of
zero mean and variance that changes according to S N R was In an effort to reduce the influence of spiky noise
used. The power system voltage and current signals are (outlier), Huber's function was used to shape the error
contaminated by impulsive noise and large isolated errors e(r) as shown in equation 2.19. The limiter has a
caused by the malfunction of some sensors and transient threshold that is set to give the best performance in
components. These large wild noises (spiky or impulsive)
are called outliers. The impulsive noise was included in
different conditions. A relatively low p was used for
frequency adaptation.
measurements to simulate an outlier.
3.2 Model Testing
3.13 Sampling Time
3.2.1 Linear Model
The measurements of the estimated waveform are After the model was tuned, its performance was studied
sampled at a time h or at a sampling frequency in comparison to the FFT.The F"and FFT models
f, = 1/ h . It was assumed that harmonics up to the 64" estimate all harmonic frequencies up to the 64"
order might exist in power systems. High harmonic harmonic. The trajectory of frequencies that were
orders are too small to be considered. For power systems originally injected in the power signal will be traced
with nominal frequency of 60 Hz,the 64" harmonic is through the estimation time. Other frequencies are not
3840 Hz.The sampling time h was then calculated to be shown but they were checked to make sure that their
l.3028X1O4seconds. estimated values go to zero. Table 3.2 shows the results
of a simulation that was done on 1024 sample points. No
3.1.4 Learning Rate noise was added to the measurement in this simulation.
The trajectories of the estimated signals are shown in
figure 3.1. The estimation of the 7", 11" and 13"
Learning rates, or q's, of the FNN model are very harmonics follow the same pattern as the 5" harmonic.
important parameters. They affect the convergence and
the accuracy of results. These rates are, namely, the Table 3.2 Comparison Of Estimated Harmonics
learning rate of the A component: 7 A , the learning rate
of the B component qB, the learning rate of the DC
component VA,, and the learning rate of the system
frequency q , . Each A, and B, component has an
independent learning rate. This means that 2N values are
to be assigned for learning rates where N is the number of
harmonics estimated. After several trials, it was found
that assigning all these rates to one value, ,would
help the system to converge faster. As a compromise
between accuracy and time of convergence, q A B was
set to 0.017. The learning rate of the DC component
q h had to take a relatively lower value. A value of
0.008 gave good results. The learning rate of frequency,
q , ,is very sensitive. Large values cause the system to
diverge. Low values give better performance if the
difference between the starting frequency (nominal) and
the actual frequency is small. The best value for 7,
was found to be 0.8.
1002
E
l...-.-
I
,3) mrmdmagihded 5lh h;rmnric
The FNN model produced estimation values that Noise has an effect on the performance of the estimation
are nearer to the actual values than the FFT. The FNN method. The noise does not prevent the model from
produced better estimation for phase angle than the FNN. convergence but it affects the accuracy of the estimation.
The F"model converges to the actual value, while the The model was tested under different SNRs to define its
FFT has a constant value throughout the estimation. The limitations. An SNR of 20 dB was injected into the
FFT converges to the estimation value slightly faster than measurement. The estimation was good for the
the FNN model, but its steady state error is higher.
1003
magnitudes and phase angle of all estimated harmonics. 4. Model Implementation
Table 3.3 shows the estimation results.
An on-line measuring system, based on the FNN
model, was constructed. The system collects continuous
signals. Signals are then discretized by an analogue to
Table 3.3 Comparison of Estimated Harmonics with 20 dB digital converter and are stored temporarily in a memory
buffer. An online program scans the stored data and
transfers it to the FNN module. The output is displayed
on a screen and is stored in data files as well.
1004
4 3 System Specifications
The system specifications are as follows:
0 Input: Single voltage and current signals
0 Measured voltage range: 0 - 500 V.
Measured current range: 0 - lo00 A.
0 Input Power: 110 V AC.
0 Over Voltage protection k 1.7 %
Over Current Protection f 1.7 96
0 Voltage sampling Rate: 7680
Current sampling Rate.: 7680 Hit any key to return to main
menu.:-
4.4 I3.ogrcun User Interfme Figure 4.2 Voltage and Current Waveform plot. Option 4
The program is driven from a main menu 5. Harmonics Measurement Using FNN
that is first displayed when the program is Harmonic measurements were conducted using the FNN.
called..The options represents functions of the The measurements were taken within the power
main program. The options are as follows:
1. Display settings and parameters distribution system of an industrial facility. The
2. On-line analysis (new reading): This option industrial plant includes potential harmonic sources and
starts the harmonic measurement study. The harmonic sensitive equipment. The study is not intended as a
system displays analysis results immediately measure of the power quality within the facility. It will
after calculations. Harmonic values will be provide real-time data for an assessment of the FNN
listed in a table form as shown in Fig. 4.1 measuring system. Measurements were also conducted using
3. Plot of voltage and current: By choosing this an industry-known harmonic meter.
option, the program will display the voltage
and current waveforms ,as shown in Fig. 4.2. I
The program has the features to display the 5.1 Description of Study Power System
voltage and current harmonic spectrum in a bar Fig. 5.1 shows the power distribution of the industrial
facility. The main feeder is 13.8 kV, 4 MVA. The voltage is
chart f o m stepped down to 460 V through four transformers. Each
transformer is 13.8kV/46OV IMVA delta/star connected.
Fig. 5.1 shows the points at which harmonic measurements
v") FliASEv46 Ut=) RUFE I% were conducted. The points were selected to be near non-
0 4.01 0 0 a74 0 a01
1 12511 0 101.7 555 -30.1 449
linear loads and to cover different voltage levels of the
2 0 . 2 -1403 ai 05 -77 OA industrial facility. The measurements were also compared
3 a7 -I103 as 24 -fB 2 with FLUKE 41 Power Harmonics Analyzer using FLUKE
4 OA -27.7 a4 1.4 -Bal 1.1
5 21 -PY 1.7 42 -.I 339 View 1.1. FLUKE 41 is an advanced hand held harmonic-
6 ai -25.2 ai 1 4.9 0.8 measuring device that is capable of sampling the waveforms
7 15 -1169 13 33.7 -2.7 273
R 0.7 -135.2 as I 3.8 0.8 of voltage and current instantaneously. The calculations of
Y a4 -1s 0.3 15 -1423 2 harmonic content associated with voltage and current are
10 03 -1333 0.2 I2 -165 I
11 13 -1u.4 1.1 Y6 41.1 7.8 done using the FlT method. The results of the two
12 02 43 0.2 as a 2 0.4 measuring systems will be shown only at points no.1 (AC
13 03 42.4 03 29 -41.4 U
14 a4 4.7 0.3 0.8 -1395 0.6
drive) and no.2 (DCdrives).
15 0.2 61.1 ai 12 68 0.Y
16 02 -1DL.I 0.2 0.4 -79.7 0.3
17 03 -77 03 84 .ay bR
I8 a1 -1m.7 ai 13 4.R 1.1
*Mm068 V~TtUkZS ioai w.=
1005
Table 5.1 Voltage Harmonics at an AC drive
A W
I I I FLUKE41 I
HAR
- ORDfR
Dc
1
2
3
4
5
8
7
a
9
Fig. 5.1 Study System with Harmonic Measuring Points 10
I1
5.2 ACDrivs 12
AC drives are used to control the speed of ac 13
motors within the plant. AC drives are processor- 14
controlled inverters. The AC drives can supply 15
frequencies in range of 30- 80 Hz.The installed inverters 16
use Pulse Width Modulation (PWM). Figure 5.2 shows 17
the waveforms of the voltage and current supplied by the 18
I I I
drive to the motor. The harmonic contents of the current 7tw, 25% I 2!j% I
and voltage were measured using FNN and FLUKE 41.
The estimation results are shown in tables 5.1 and 5.2.
The current spectrum is shown in Fig. 5.3
Table 5.2 Estimation of Current Harmonics of an AC
drive
- -- FN ii-
(XIAIECC R1116I pH116I
Hlyl
?R38
Dc
- %
21
3Bjw
0
-
m
0
1 a7 -19.0 -1545
2 1.7 l
a0 1990
3 0.3 BA0 -1a7.0
4 15 1m imo
5 54.0 la0 1083
6 1.9 40 880
7 446 -190 -7.0
8 a5 -1aaO -1250
I 9 1.6 BnO mo
10 Q3 00 -120
Fig. 5.2 Waveform of Voltage and Current Supplying an 11 2% 8QO -755
12 0.1 -130 -21.O
AC drive 13 17.0 111.0 lDQ0
14 a5 -1880 la0
15 0.8 1n.o imo
16 02 0.0 -17.0
17 57 -120 a0
-1no
-
- --
‘M)
18 0.3
1012h
-161.0
-
1006
7. Reference
results were compared with the data obtained using a Transactions On Industry Applications, Vol., 29,
FLUKE 41 harmonics meter. The comparison revealed No, 1, pp. 202- 208, January/ February 1993.
that the A” based harmonic estimation model
perform similarly to industrial-approved meters. It 9 ) Osowski, S., “Neural Network for Estimation
also has the ability to accurately estimate the phase of Harmonic Components in a Power System,”
angles. IEE Proceedings-C, Vol. 139, No. 2, pp. 129-
135, March 1992.
1007
Fig. 5.4 Wave-Form Ofvoltage And Current Supplying
DC Drive
Fig. 5.3 FNN and Fluke 41 Harmonic Contents of The harmonics content of the current and voltage were
Voltage and Current measured using FNN and FLUKE 41. The voltage
estimation results are shown in Table 5.3. The estimates
The comparison of the data in tables 5.1 and 5.2 showed similar values for the magnitudes. The phase
indicate that the estimation results are almost equal for the angles have some variations.
FNN and the FLUKE 41. Harmonic analysis of the In general the developed FNN based harmonics
current shows more variations than the voltage. The measuring system proved to be as reliable as industrial
reason for this is that the current is badly distorted. It €i" based devices such as FLUKE 41. Reconstructing
might contain more noise or higher order harmonics that the two signals as shown in figure 5.5 did a comparison
are not calculated by either meter. The FLUKE 41 between the estimated results. It can be seen that the
considers only up to 32 harmonics, while the FNN was signals are close to each other.
designed to go up to 64 harmonics. Phase angles have
some variations but they are close for the fundamental. Table 5.3 Estimation Results Of DC Drive Voltage
The variation for harmonics might be due to the triggering
difference. Triggering was done manually so that data
collection of both devices is synchronized. This might
have caused differences since harmonics are dynamic in
nature.
5 3 DC Drives
The variable speed DC drives are used to drive the critical
machines in the plant. A Reliance Electric DC Drive
(Model: Max Pak Plus D-C VS Drive) was used for the
harmonic measurements. The DC drive provides an
annatum voltage of 500 volts dc. The drive provides shunt
field excitation and adjustable voltage to drive a shunt
wound dc machine. The machine is intended for an
adjustable speed service. Voltage and current waveforms,
supplied to the motor, are shown in Fig. 5.4.
1008
111 Cichoki, A., Pawel Kostyla, Tadeusz Lobos, 18 1 National Instruments. “NI-DAQ Software Reference
Zbigniew Waclawek, “Neural Networks For Manual for DOS/Windows/LapWindows,” National
Real-time Estimation of Parameters of Signals in Insmments Corporate Headquarters, Austin,
Power Systems,” Conference. October,1993.
1 2 ) Cichocki, A., Rolf Unbehauen, “Neural 1 9 ) National Instruments. “NI- DAQ Function Reference
Networks For Solving Systems of Linear Manual for DOS/Windows/LapWindows,” National
Equations- Part II: Minimal and Least Absolute Instruments Corporate Headquarters, Austin,
Value Problems,” IEEE Transactionson Circuits October,1993.
And Systems-II Analogue and Digital Signal
Processing, Vol. 39, No. 9, pp. 619-633, 2 0 ) IEEE Industry Application Society/ Power
September 1992. Engineering Society, “IEEE Recommended Practices and
Requirements for Harmonic Control in Electrical System-
13) Cichocki, A., Rolf Unbehauen, “Neural IEEE Std 519-1992, ” Institute of Electrical and
Networks for Solving Systems of Linear Electronics, Inc., New York, USA, April 1993.
Equation and Related Problems,” IEEE
Transaction on Circuits and Systems-1: 8. Acknowledgement
Fundamental, Theory and Applications, Vol. 39,
NO.2, 124-137, February 1992. The authors would like the facilities and support of King
Fahd University of Petroleum and Minerals, Dhahran
14) Cichocki, A., T. Lobos, “Adaptive Saudi Arabia.
Analogue Network for Real -Time Estimation of
Waveforms of Voltages and Currents,” ZEE 9. Biographiea
Proceedings-C, Vol. 139, No. 4, pp. 343-350,
July 1992.
Ibrahim El-- graduated with B.Sc. in electrical
engineering from University of Khartoum, Sudan, in
1971. He received his MSc. & Ph.D. from UMIST, UK
1 5 ) Cichoki, A., T. Lobos, “Artificial Neural
Networks For Real-time Estimation of Basic in 1975 & 1978 respectively. He is currently an Associate
Waveforms of Voltages and Currents,” IEEE Professor in KFLTPM, Dhahran, Saudi Arabia.
Transaction on Power System, Vol. 9,No. 2, pp.
Dr. El-Amin’s research interests include power system,
612-618. May 1994.
HVDC transmission, Power quality and system Harmonics
and energy conservation.
16) Cichocki, A., Rolf Unbehauen, “Neural
Ihab Arafah received his B.Sc. & M.Sc. in electrical
Networksfor Optimkation and Signal Processi,”
engineering from KFUPM in 1990 & 1996 respectively.
John Wiley & Sons Ltd., New York, 1994.
He is currently with the Arabian Canning Co., Dhahran,
17) National Instruments. “AT-MIO-16User
Saudi Arabia.
Manual,” National Instruments Corporate
Headquarters, Austin, October, 1993.
1009