IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, VOL. 18, NO. 2, MARCH 2014
AbstractContactless vital sign measurement technologies often have the drawback of severe motion artifacts and periods in
which no signal is available. However, using several identical or
physically different sensors, redundancy can be used to decrease
the error in noncontact heart rate estimation, while increasing the
time period during which reliable data are available. In this paper,
we show for the first time two major results in case of contactless heart rate measurements deduced from a capacitive ECG and
optical pulse signals. First, an artifact detection is an essential preprocessing step to allow a reliable fusion. Second, the robust but
computationally efficient median already provides good results;
however, using a Bayesian approach, and a short time estimation
of the variance, best results in terms of difference to reference
heart rate and temporal coverage can be achieved. In this paper,
six sensor signals were used and coverage increased from 090%
to 8094%, while the difference between the estimated heart rate
and the gold standard was less than 2 BPM.
Index TermsBayes, capacitive ECG (cECG), fusion, quality
index, robust, unobtrusive.
I. INTRODUCTION
NOBTRUSIVE vital sign monitoring technologies can
nowadays be integrated into many everyday objects. This
enables implementation of unsupervised automatic monitoring
and, therefore, preventive monitoring without the need for interaction, expert knowledge, or disturbing a persons daily routine. Most of these technologies do not require mechanical contact with the patient, e.g., in case of video analysis [1], or at
least do not need direct or galvanic contact with the skin, e.g.,
magnetic induction monitoring or the capacitive electrocardiogram (cECG) [2], [3]. Also, because these methods require no
preparation before a measurement, they are often called zeropreparation techniques.
Despite these advantages, these technologies tend to have two
main drawbacks related to contactless measurement:
1) severe motion artifacts, which may totally disrupt the signal of interest;
Manuscript received February 4, 2013; revised June 24, 2013; accepted July
17, 2013. Date of publication July 19, 2013; date of current version March 3,
2014.
The authors are with the Chair of Medical Information Technology,
RWTH Aachen University, 52062 Aachen, Germany (e-mail: wartzek@
hia.rwth-aachen.de; brueser@hia.rwth-aachen.de; walter@hia.rwth-aachen.de;
leonhardt@hia.rwth-aachen.de).
Color versions of one or more of the figures in this paper are available online
at http://ieeexplore.ieee.org.
Digital Object Identifier 10.1109/JBHI.2013.2274211
2168-2194 2013 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications standards/publications/rights/index.html for more information.
Fig. 1.
Fig. 2. Measurement setup of the bed and mattress with the integrated contactless sensors.
ference between the fused heart rate estimate and the reference
heart rate is reduced.
II. MATERIALS AND METHODS
The principle of the fusion concept is shown in Fig. 1. The sensors measure a signal which contains information about the heart
rate: in this case a cECG and an optical pulse signal. Afterward,
each signal is processed separately. First, peak detection is performed which results in a vector pl = [pl1 , . . . , plk , . . . , plK ] of
peak locations in which l describes the index of the corresponding sensor. An artifact detection algorithm calculates a quality
index kl for each detected peak plk . This allows us to estimate
a peak-to-peak frequency f l (or heart rate HR, respectively)
with a corresponding quality index. Finally, all peak-to-peak
frequencies are fused in the last processing step.
Since classified frequency values instead of raw data or
features are fused, this fusion concept is called decision fusion [12]. Furthermore, the proposed method can be classified
according to a definition of Durrant-Whyte, as a complementary (i.e., the sensors are independent and can be combined to
increase completeness) and competing (i.e., all sensors measure
the same quantities which may result in increased accuracy)
fusion [13].
A. Measurement Setup and Preprocessing
The measurement setup is shown in Fig. 2 and consists of a
bed and a mattress with the integrated sensors. The sensors are
cECG sensors with an integrated optical sensor, as described
in [14]. A cECG sensor is similar to a standard ECG sensor
with the main difference that the coupling is capacitive rather
than conductive [3]. This allows us to measure through, e.g.,
clothes, which act as a dielectric layer within a capacitor. The
integrated optical sensor emits light through the clothes into the
body and measures the reflected signal strength. This fulfills two
functions: first, it detects motion at the electrodebody interface,
655
656
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, VOL. 18, NO. 2, MARCH 2014
TABLE I
NOTATION IN CASE OF A BAYESIAN FUSION
B. Fusion Algorithms
Fig. 3. Two cECG and one optical signal as an example for the effect of
artifacts, the peak detector, and the artifact detection method.
(1)
Fig. 4. Calculated beat-to-beat heart rate and the effect of the artifact detection
motivating the fusion process.
(2)
l=1...L
(3)
P (f = fk2 |f 1k f 2k ).
(4)
To derive the final fusion algorithm and to use Bayes theorem, the previous sensor values are separated from the current
657
value
P (f |f 1k f 2k ) = P (f |fk1 fk2 , f 1k 1 f 2k 1 ).
(5)
P (f |f 1k f 2k ) = P (f |fk1 fk2 , f 1k 1 f 2k 1 )
likeliho o d
prior
P (fk1 fk2 |f, f 1k 1 f 2k 1 ) P (f |f 1k 1 f 2k 1 )
=
. (6)
P (fk1 fk2 |f 1k 1 f 2k 1 )
norm alization
P (f |f 1k f 2k ) =
P (f | f 1k f 2k ) =
P (f | f 1k ) P (fk1 | f 1k 1 )
P (f | f 1k 1 )
P (f |f 1k 1 f 2k 1 )
P (f |f 2k )P (fk2 |f 2k 1 )
P (f |f 2k 1 )
P (fk1 fk2 |f 1k 1 f 2k 1 )
P (f |f 1k )P (f |f 2k )P (f |f 1k 1 f 2k 1 )
.
P (f |f 1k 1 )P (f |f 2k 1 )
(9)
However, up to this point, (9) cannot be used for the estimation of heart rate. Each sensor, and its subsequent stages for
estimating the peak-to-peak frequency, provides only one discrete frequency fkl at each step k. In contrast, when a Bayesian
fusion is applied each sensor generally provides a probability
for all possible states (e.g., in the case of three aircrafts, each
sensor provides three probabilities [11]). This is also apparent
in (9), as the probability of all sensors is needed for each frequency. A graphical description of this circumstance is given in
Fig. 5. Only two discrete sensor values are available; however,
a probability distribution like P (f |f 1k ) for the first sensor is
needed to assess the other sensor values.
658
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, VOL. 18, NO. 2, MARCH 2014
Fig. 7. Difference between the estimated heart rate and the reference heart
rate using different fusion algorithms.
Even within a 10 s period, there are only a few frequency values. This may lead to underestimation of the standard deviation
(SD) which, in turn, has a negative effect on the fusion algorithm. In the case of a very small SD, the Bayesian algorithm
becomes locked in a tight normal distribution and no longer accurately follows changes in heart rate. For this reason, the upper
l
value
ol of the 99% confidence interval of the estimated SD
is used
n1
l
l
.
(10)
o =
2
0,005;n 1
The denominator in (10) refers to the 2 -distribution and n
denotes the number of frequency values.
Finally, it is possible to estimate the necessary probabilities
in (9) to allow for the Bayesian fusion
12
1
P (f |f lk ) =
e
2
ol
f f l
k
ol
2
(11)
Fig. 9. Example of the fused heart rate compared to the reference of the same
time interval as in Figs. 3 and 4.
659
TABLE II
EXAMPLE OF DETAILED RESULTS OF ONE MEASUREMENT ACQUIRED
WITH A BAYESIAN FUSION
660
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, VOL. 18, NO. 2, MARCH 2014
REFERENCES
[1] L. Scalise, N. Bernacchia, I. Ercoli, and P. Marchionni, Heart rate measurement in neonatal patients using a webcamera, in Proc. IEEE Int.
Symp. Med. Meas. Appl. Proc.. Budapest, Ungarn: IEEE, May 1819,
2012, pp. 14.
[2] M. Steffen, A. Aleksandrowicz, and S. Leonhardt, Mobile noncontact
monitoring of heart and lung activity, IEEE Trans. Biomed. Circuits
Syst., vol. 1, no. 4, pp. 250257, Dec. 2007.
[3] Y. M. Chi, T.-P. Jung, and G. Cauwenberghs, Dry-contact and noncontact
biopotential electrodes: Methodological review, IEEE Rev. Biomed. Eng.,
vol. 3, pp. 106119, 2010. DOI: 10.1109/RBME.2010.2084078
[4] T. Wartzek, B. Eilebrecht, J. Lem, H.-J. Lindner, S. Leonhardt, and
M. Walter, ECG on the road: Robust and unobtrusive estimation of heart
rate, IEEE Trans. Biomed. Eng., vol. 58, no. 11, pp. 31123120, Nov.
2011.
[5] J. M. Feldman, M. H. Ebrahim, and I. Bar-Kana, Robust sensor fusion improves heart rate estimation: Clinical evaluation, J. Clin. Monit., vol. 13,
no. 6, pp. 379384, 1997.
[6] M. H. Ebrahim, J. M. Feldman, and I. Bar-Kana, A robust sensor fusion
method for heart rate estimation, J. Clin. Monit., vol. 13, no. 6, pp. 385
393, 1997.
[7] L. Tarassenko, L. Mason, and N. Townsend, Multi-sensor fusion for
robust computation of breathing rate, Electron. Lett., vol. 38, no. 22,
pp. 13141316, Oct. 2002.
[8] Q. Li, R. G. Mark, and G. D. Clifford, Robust heart rate estimation from
multiple asynchronous noisy sources using signal quality indices and a
Kalman filter, Physiol. Meas., vol. 29, no. 1, pp. 1532, 2008.
[9] P. Yang, G. A. Dumont, and J. M. Ansermino, Sensor fusion using a
hybrid median filter for artifact removal in intraoperative heart rate monitoring, J. Clin. Monit. Comput., vol. 23, no. 2, pp. 7583, 2009.
[10] C. Orphanidou, S. Fleming, S. Shah, and L. Tarassenko, Data fusion
for estimating respiratory rate from a single-lead ECG, Biomed. Signal
Process. Control, vol. 8, no. 1, pp. 98105, 2013.
[11] S. Challa and D. Koks, Bayesian and Dempster-Shafer fusion, Sadhana,
vol. 29, no. 2, pp. 145174, 2004.
[12] J. Llinas and D. L. Hall, An introduction to multi-sensor data fusion, in
Proc. IEEE Int. Symp. Circuits Syst., Buffalo, NY, May. 31Jun. 3, 1998,
pp. 537540.
[13] H. F. Durrant-Whyte, Sensor models and multisensor integration, Int. J.
Robot. Res., vol. 7, no. 6, pp. 97113, 1988.
[14] T. Wartzek, R. Elfring, A. Jansen, B. Eilebrecht, M. Walter, and S. Leonhardt, On the way to a cable free operating theater: An operating table
with integrated multimodal monitoring, presented at the Comput. Cardiol., Hangzhou, China, Sep. 1821, 2011
[15] T. Wartzek, H. Weber, M. Walter, B. Eilebrecht, and S. Leonhardt, Automatic electrode selection in unobtrusive capacitive ECG measurements,
presented at the 25th Int. Symp. Comput.-Based Med. Syst., Rome, Italy,
Jun. 2222, 2012
[16] P. S. Hamilton, Open Source ECG Analysis Software Documentation,
2002.
[17] S. Verboven and M. Hubert, LIBRA: A MATLAB library for robust
analysis, Chemometr. Intell. Lab. Syst., vol. 75, no. 2, pp. 127136, 2005.
[18] Association for the Advancement of Medical Instrumentation. (2002).
ANSI/AAMI EC13:2002: Cardiac monitors, heart rate meters, and
alarms, [Online]. Available:http://webstore.ansi.org
[19] L. Tarassenko, A. Hann, and D. Young, Integrated monitoring and analysis for early warning of patient deterioration, Brit. J. Anaesth., vol. 97,
no. 1, pp. 6468, 2006.
[20] R. Barbieri, A point-process model of human heartbeat intervals: New
definitions of heart rate and heart rate variability, AJP: Heart Circulat.
Physiol., vol. 288, no. 1, pp. H424H435, 2004.
Christoph Bruser
(S05) was born in Troisdorf,
Germany, in 1983. He received the Dipl.-Ing. degree
in computer engineering from the RWTH Aachen
University, Aachen, Germany, where he is currently
working toward the Dr.-Ing. (Ph.D.) degree at the
Chair of Medical Information Technology.
He is also working as a Research Assistant
at RWTH Aachen University. His research interests include biosignal processing and classification
as well as unobtrusive physiological measurement
techniques.