J. V. Krogmeier
August 26, 2014
1
1 Probability [1] Rayleigh: A r.v. R is said to be Rayleigh dis-
tributed with parameter if its pdf is
1.1 Discrete Distributions r
r 2 /2 2
for r 0
fR (r) = 2 e
Bernoulli: A random variable (r.v.) X is said to 0 for r < 0
be a Bernoulli r.v. with parameter p (0 p For such a r.v.
1) if it only takes two values 0 and 1 and its r
probability mass function (pmf) is of the form E(R) =
2
pX (1) = Pr(X = 1) = p 1
Var(R) = (4 ) 2 .
pX (0) = Pr(X = 0) = 1 p. 2
k Q(x) = ez /2 dz.
pX (k) = e 2 x
!
Note that Q(x) = 1 Q(x). A table of values
for k = 0, 1, 2, . . .. For such a r.v. X of the Q function is given on the next page.
E(X) =
Gaussian (two variable): Two r.v.s X and Y are
Var(X) = . said to be bivariate normal (or Gaussian) if their
joint pdf is
1.2 Continuous Distributions 1
fX,Y (x, y) = p
Uniform: A r.v. X is said to be uniform on an 2x y 1 2
interval a x b if its probability density func- 1
exp F (x, y)
tion (pdf) is 2(1 2 )
where F (x, y) is the quadratic form:
1
ba for a x b
fX (x) = .
0 for x < a or x > b 2 2
x x y y (x x )(y y )
+ 2 .
For such a r.v. x y x y
E(X) = (a + b)/2 For such r.v.s
2
Var(X) = (b a) /12. E(X) = x
Exponential: A r.v. X is said to be an exponen- E(Y ) = y
tial r.v. with parameter > 0 if its pdf is Var(X) = x2
Var(Y ) = y2
ex for x 0
fX (x) = . Cov(X, Y ) = x y
0 for x < 0
For such a r.v. where 1 +1. (The bivariate normal dis-
tribution can be generalized to an arbitrary num-
E(X) = 1/ ber of random variables. Such are called jointly
Var(X) = 1/2 . Gaussian r.v.s.)
2
1.3 Gaussian Properties 1.4 Useful Theorems
Jointly Gaussian r.v.s X and Y are statistically Markovs Inequalitiy: X a r.v. taking only non-
independent if and only if (iff) they are uncorre- negative values. Then for any a > 0
lated, i.e., = 0.
E[X]
Pr{X a} .
A linear combination of an arbitrary number of a
jointly Gaussian r.v.s is a Gaussian r.v.
Chebyshevs Inequalitiy: X a r.v. with finite
Conditional Gaussian: Let r.v.s X and Y be mean and variance 2 , then for any value k > 0
jointly Gaussian with the pdf given in the previ-
ous bullet. Then the conditional pdf of X given 2
Y = y is a single variable Gaussian pdf with Pr{|X | k} .
k2
x
E(X|Y = y) = x + (y y ) Weak Law of Large Numbers: X1 , X2 , . . . a
y sequence of independent and identically dis-
Var(X|Y = y) = x2 (1 2 ). tributed (i.i.d.) r.v.s, each having a finite mean
E[Xi ] = . Then, for any > 0
Gaussian Moments: Let X be a Gaussian ran-
X1 + + Xn
dom variable with mean zero and variance 2 ,
Pr > 0
i.e., N (0, 2 ). Then n
3
E[Xi ] = . Then 2.2.1 Special Lemma on Correlation
X1 + + Xn
Let A(t) and B(t) be 2nd order rps. Let h1 (t) and
Pr lim = =1 h2 (t) be BIBO stable impulse responses. Generate
n n
two additonal rps via:
(i.e., the sample mean converges to the true
mean with probability one.) C(t) = h1 A(t)
D(t) = h2 B(t).
4
Autocovariance: CX ( ) = RX ( ) 2X . 2.5 Theorem on Modulation
Cross-correlation RX,Y ( ) = E[X(t)Y (t + )]. A(t), B(t) jointly WSS. r.v. uniform on [0, 2),
statistically independent of A(t), B(t):
Cross-covariance CX,Y ( ) = RX,Y ( ) X Y . Thm Part A: Then X(t) = A(t) cos(2fc t + ) is
WSS with X = 0 and
Then the following definitions make sense:
RX ( ) = 0.5RA ( ) cos(2fc )
Power: l
SX (f ) = 0.25[SA (f fc ) + SA (f + fc )]
def
power[X(t)] = RX (0)
= CX (0) + 2X Thm Part B: If RA ( ) = RB ( ) and RA,B ( ) =
RB,A ( ), then
= ac power + dc power
X(t) = A(t) cos(2fc t) B(t) sin(2fc t)
Power spectral density (SX (f )):
has
RX ( ) SX (f ); RX ( ) = RA ( ) cos(2fc )
Z RA,B ( ) sin(2fc )
power[X(t)] = RX (0) = SX (f )df. l
SX (f ) = 0.5[SA (f fc ) + SA (f + fc )]
+ j0.5[SA,B (f fc ) SA,B (f + fc )].
2.4 WSS and LTI Systems
Moreover, if A(t), B(t) are zero mean, then X(t) has
WSS X(t) input to LTI system with h(t) H(f ).
zero mean and is WSS.
Then output Y (t) = X h(t) is WSS, X(t) and Y (t)
are jointly WSS, and: Thm Part C: Then
R X(t) = A(t) cos(2fc t + ) B(t) sin(2fc t + )
Y = X
h(t)dt = X H(0).
is zero mean, WSS with
Crosscorrelation / cross spectral density
RX ( ) = 0.5[RA ( ) + RB ( )] cos(2fc )
RX,Y ( ) = h RX ( ) 0.5[RA,B ( ) RA,B ( )] sin(2fc )
l l
SX,Y (f ) = H(f )SX (f ). SX (f ) = 0.25[SA (f fc ) + SB (f fc )
+ SA (f + fc ) + SB (f + fc )]
Autocorrelation / psds:
+ j0.25[SA,B (f fc ) SA,B (f + fc )
RY ( ) = h h RX ( ) SA,B (f + fc ) + SA,B (f fc )]
l
SY (f ) = |H(f )|2 SX (f ). 2.5.1 Gaussian RPs
def
X(t) is a Gaussian r.p. if any finite col-
where h(t) = h(t). lection of time samples from the process:
X(t1 ), X(t2 ), . . . , X(tN ) is a set of jointly Gaus-
LTI sian random variables.
h(t) H(f )
X(t) Y (t)
If input to LTI system is WSS Gaussian r.p.,
then output is WSS Gaussian. Moreover, input
and output are jointly Gaussian r.p.s.
LTI LTI
RX (t)
h(t) H(f )
RX,Y (t) h(t) H (f ) R (t) X(t) WSS and Gaussian. If CX ( ) = 0, then
Y
X(t) and X(t + ) are statistically independent
SX (f ) SX,Y (f ) SY (f ) for any t.
5
X(t), Y (t) jointly WSS and jointly Gaussian. If Maximum power from a noisy resistor is deliv-
CX,Y ( ) = 0, then X(t) and Y (t + ) are sta- ered to a matched load and the maximum power
tistically independent for any t. that can be delivered over a one-sided bandwidth
B is
kT
2.5.2 AWGN Pmax = 2B = kT B.
2
WSS Gaussian r.p. N (t) with zero mean and Therefore, the two-sided available power spec-
autocorrelation / psd tral density (psd) of a resistive noise source is
N0 flat with height = kT /2, depending only on the
RN ( ) = ( ) physical temperature T .
2
l
N0 3.2 Communication System Compo-
SN (f ) = for < f <
2 nent Models
said to be a white Gaussian noise (WGN). When Important components in communications systems
N (t) appears in a problem added to a desired include antennas, filters, oscillators, noise sources,
signal, we call it additive white Gaussian noise mixers, amplifiers, and attenuators. These blocks are
(AWGN). used to implement modulators, demodulators, and
detectors. They are used to process signals in the
presence of noise with the goal of minimizing noise
3 Communication Link Param- related impairments. However, since the blocks are
eters [3] contructed from electronics and lossy elements, they
introduce noise in their own right.
Noise arises in communications systems from two The tables below show the basic blocks. The
main sources: 1) Thermal noise1 associated with the first contains the fundamental noiseless components
random motion of electrons in a resistor or other lossy and the second contains the fundamental noisy com-
devices, and 2) shot noise associated with the dis- ponents. Basic parameters are given.
crete nature of charge carriers in tubes and semicon- All noise psds in the equations of this section
ductors. Thermal noise voltages are proportional to will be assumed to be flat (white) over the frequency
the square root of temperature while shot noise is in- band of interest. All filters are assumed to be ideal
dependent of temperature. Both are wideband and and all impedances are assumed to be matched2 .
often modeled as white.
3.2.1 Noiseless Components
3.1 Nyquists Noisy R Model Component Parameters
Resistor of value R at temperature T K has
across its terminals a random noise voltage with
Gaussian distribution, zero mean, and flat psd Antenna Gant
given in the below model. noiseless LPF fH
noiseless BPF fL fH
R +
v(t)
R
noiseless HPF fL
(k = 1.38 1023 J/K) 2 Non-ideal filters can be accomodated under this assump-
6
gain via * Effect of internal noise sources modeled by
4Aant placing an additive white noise source at
Gant =
2 the amplifier input. Parameter is equivalent
noise temperature Te . Then the noise power
where is the operating wavelength.
in the amplifier output in a one-sided BW
Filters. Ideal noiseless filters will have symmet- B due to internal sources is
ric, brickwall responses and unity passband gain.
Pout,internal = kTe Gamp B.
Therefore, the only parameters are passband
cutoff frequencies. noisy amp model
f f
0 fH 0 fL fH
Then
Noise Source Te
Pout
F =
Amplifier Te Gamp Pout,external
Pout,internal Te
= 1+ =1+ 1
Attenuator T L Pout,external T0
Also Te = T0 (F 1).
Mixer Te * May also interpret noise figure and equiv-
Noise Sources. Modeled as though they were alent noise temperature in terms of the
noisy resistors, i.e., they are zero mean, degradation in signal-to-noise ratio occur-
white, Gaussian random processes with two- ring due to the addition of internal noise.
sided power spectral density In below figure
kTe Ps
Sv (f ) = < f < . SNRin =
2 Pn
Gamp Ps
The only parameter is the equivalent noise tem- SNRout =
Gamp (kTe B + Pn )
perature, Te , given in K. Boltzmans constant is
k = 1.38 1023 J/K. assuming that the system does not filter or
reduce the bandwidth of either the input
Amplifiers. Parameters are power gain Gamp and signal or input noise. Can show that in a
equivalent temperature Te . Ideal amplifiers are band of one-sided BW B:
assumed of infinite bandwidth.
SNRin kTe B
=1+ 1.
SNRout Pn
p
* Voltage gain is Vamp = Gamp .
7
noisy amp model Receiver Antenna: Reciprocity holds. There-
s(t); Ps
fore, antenna properties such as pattern, gain,
Gamp
(noiseless)
impedance, loss must be the same for an antenna
be it used in receive or transmit mode.
n(t); Pn
f
0 fL fH
3 Sources of natural and man-made background noise in-
nw (t) : Snw (f ) = kTe /2 clude: cosmic remnants of big bang, sun and stars, thermal
noisy bandpass amplifier
noise from ground, lightening, high voltage lines, interference
from electronics and lighting, and other undesired radio trans-
Lossy Filter: This can be made using the noisy missions.
4 Note that if we wish also to model the attenuation of
bandlimited amplifier block. Here, however,
the signal due to atmospheric loss, then a noiseless attenua-
Te = T , the physical temperature of the filter,
tor should follow the noisy antenna model. Attenuation would
and Gamp < 1 since a passive filter attenuates depend strongly on frequency particularly near water and oxy-
an input signal. gen resonances and it would also depend weakly on elevation.
8
Sky noise temperature vs. frequency7 shows that low angles and high frequencies are
disadvantaged relative to frequencies below 10 GHz.
9
Therefore SNRD = Pm /(N0 W ) = PT /(N0 W ). with zero mean and power Pm = Rm (0). Also as-
sume that the r.v. below is uniform on [0, 2) and
statistically independent of all other r.v.s.
4.4 Generic Passband Transmission
Zero SNR: For simplicity set Hchan (f ) = 1. 4.5.1 AM DSB-SC
Then xr (t) = x(t) + nw (t). The SNR at this
point
def power[x(t)]
x(t) = Ac m(t) cos(2fc t + ).
SNRr =
power[nw (t)]
Autocorrelation:
is always zero since white Gaussian noise has in-
finite power. Rx ( ) = 0.5A2c Rm ( ) cos(2fc ).
Nonzero SNR: In order to have a non-zero SNR
at passband we need to apply a predetection Power spectrum:
BPF which passes the signal component and lim-
Sx (f ) = 0.25A2c [Sm (f fc ) + Sm (f + fc )] .
its the power in the noise component.
Computing SNR at IF:
m(t) x(t) xr (t)
modulator Hchan (f )
* power[x(t)] = Rx (0) = 0.5A2c Pm .
* Transmission BW = 2W minimum noise
channel
nw (t) power = 2N0 W .
* Ratio:
A2c Pm PT
SNRif = = .
4N0 W 2N0 W
xr (t) xif (t) yD (t)
HBP (f ) demodulator
M0
Sm (f )
f
2B
1.0 W W
Sx (f )
f 0.25M0 A2c
f0 f0
f
fc fc W fc fc + W
Now SNRif > 0 since the noise component in
xif (t) will have finite power. In fact
4.5.2 AM-LC
xif (t) = x hBP (t) + nw hBP (t)
= x(t) + n(t)
x(t) = Ac [1 + ka m(t)] cos(2fc t + ).
where assume BPF does not distort the signal
and n(t) is a bandpass Gaussian noise with zero Autocorrelation:
mean and psd of height N0 /2 and shape identical
to that of HBP (f ). Then Rx ( ) = 0.5A2c [1 + ka2 Rm ( )] cos(2fc ).
10
Sn (f )
* Ratio: N0 /2
2W
A2c (1 + ka2 Pm ) PT
SNRif = = . f
4N0 W 2N0 W 2fc fc fc 2fc
M0
Sm (f )
N0 /4
N0 /8
f
2fc fc fc 2fc
f 2W
W W
Passes LPF to output
Sx (f )
(0.25A2c )
0.25M0 ka2 A2c
4.6.2 AM-LC
f
fc fc W fc fc + W
Signal component of yD :
n(t) cos(2fc t + )
R( ) = 0.5Rn ( ) cos(2fc )
l
S(f ) = 0.25Sn (f fc ) + 0.25Sn (f + fc )
11
A Basic Math A.5 Convolution
x2 x3
Z
exp(x) = 1+x+ + + x(t) = X(f )ej2f t df
2! 3!
x2 x4 l
cos(x) = 1 +
2! 4! Z
x3 x5 X(f ) = x(t)ej2f t dt
sin(x) = x +
3! 5!
X 1 CTFT properties in Figure 1.
an = if |a| < 1
1a
n=0 CTFT pairs in Figure 2.
N N +1
X 1a x(t), periodic in time with Fourier Series Xk has
an = if a 6= 1
n=0
1a CTFT which is aPweighted impulse train in fre-
N quency: X(f ) = k Xk (f kf0 ).
X N (N + 1)
k =
2
k=0
C Deterministic Autocorrela-
A.3 Taylor Series tion and Power Spectral
f 00 (a)
Density
f (x) = f (a) + f 0 (a)(x a) + (x a)2 +
2!
C.1 Energy Signals
f (n) (a)
+ (x a)n +
n! x(t) X(f ) of finite energy.
def R
A.4 Integration by Parts Autocorrelation: Rx ( ) =
x(t)x(t + )dt.
12
Figure 1: Some Properties of Fourier Transforms. (From [5])
13
Figure 2: Some Fourier Transform Pairs (From [5])
14
1 The complex-valued signal m(t) + j m(t) has a
hHilbert (t) = Fourier Transform that is identically zero on the
m(t) t m(t)
negative frequencies. Such are called analytic
HHilbert (f ) = jsgn(f ) signals.
HT can also be defined for power signals.
Figure 3: Hilbert transform as LTI system.
References
C.2 Power Signals
[1] S. M. Ross. A First Course in Probability.
If CTFT exists denote it: x(t) X(f ).
Prentice-Hall, Upper Saddle River, NJ, fifth edi-
Time Average Operator: For an arbitrary func- tion, 1998.
tion f (t) [2] Athanasios Papoulis. Probability, Random Vari-
T ables, and Stochastic Processes. McGraw-Hill,
1
Z
def
hf (t)i = lim x(t)x(t + )dt New York, 1965.
T 2T T
[3] D. M. Pozar. Microwave and RF Design of Wire-
(hf (t)i is not a function of t, notation is used less Systems. Wiley, New York, 2001.
only to show the averaging variable).
[4] Roger E. Ziemer and William H. Tranter. Prin-
def
Autocorrelation: Rx ( ) = hx(t)x(t + )i. ciples of Communications. Wiley, Hoboken, NJ,
sixth edition, 2009.
Properties of autocorrelation:
[5] W. M. Siebert. Circuits, Signals, and Systems.
* Rx (0) |Rx ( )|. The MIT Press, Cambridge, MA, 1986.
* Rx ( ) = Rx ( ).
* lim| | Rx ( ) = hx(t)i2 if x(t) does not
contain periodic components.
* If x(t) is periodic with period T0 then so is
Rx ( ).
* CTFT of Rx ( ) is non-negative for all f .
Rx ( ) Sx (f ).
D Hilbert Transform
The Hilbert Transform of a real-valued finite energy
signal m(t) is the the output of the LTI system shown
in Fig. 3 below (which is a /2 phase shifter).
Notes:
15