Claude Elwood Shannon (April 30, 1916 – February 24, 2001) was an
American mathematician, electrical engineer, and cryptographer known as "the father
of information theory". Shannon is noted for having founded information theory with a
landmark paper, A Mathematical Theory of Communication, that he published in 1948.
5.1 Introduction
What is a Signal?
If the independent variable (t) takes on only discrete values, for example t = ±1, ±2, ±3, ...
Fig 5.2 Discrete Time Signal
5.3 Sampling
The signals we use in the real world, such as our voices, are called "analog" signals. To process
these signals in computers, we need to convert the signals to "digital" form. While an analog
signal is continuous in both time and amplitude, a digital signal is discrete in both time and
amplitude. To convert a signal from continuous time to discrete time, a process called sampling
is used. The value of the signal is measured at certain intervals in time. Each measurement is
referred to as a sample. How many samples are necessary to ensure we are preserving the
information contained in the signal? If the signal contains high frequency components, we will
need to sample at a higher rate to avoid losing information that is in the signal. In general, to
preserve the full information in the signal, it is necessary to sample at twice the maximum
frequency of the signal.
Sampling theorem
The sampling theorem by C.E. Shannon in 1949 places restrictions on the frequency content of the time
function signal, f(t), and can be simply stated as follows: In order to recover the signal function f(t) exactly,
it is necessary to sample f(t) at a rate greater than twice its highest frequency component.
Handwritten notes about sampling
Sampling Techniques
a. Ideal sampling
b. Natural sampling
We can see that due to the flat-top pulses, the spectrum of the sampled signal is distorted. The
narrower the pulse width, the less distortion. The original signal may be obtained by using a low-
pass filter with a characteristic which inverts the distortion.
The word Companding is a combination of Compressing and Expanding, which means that it
does both.
This is a non-linear technique used to compresses the data at the transmitter and expands the
same data at the receiver. The effects of noise and crosstalk are reduced by using this technique.
A-Law
European countries practice A-Law companding. The mathematical expression for A-law
compression in continuous domain (PDF) is given as:
where:
x is the input signal
where:
µ-law
The µ-law companding technique is deployed in North America and Japan. The analog version
of µ-law (PDF) is given as:
where:
x is the input signal
Figure: Compression curves for different values of compression parameters in (a) µ law (b) A
law.
Pulse modulation may be used to transmit information, such as continuous speech or data. It is a
system in which continuous waveforms are sampled at regular intervals. Information regarding
the signal is transmitted only at the sampling times, together with any synchronizing pulses that
may be required. At the receiving end, the original waveforms may be reconstituted from the
information regarding the samples, if these are taken frequently enough.
The pulse modulation techniques can be classified into two main types:
(i) pulse amplitude modulation (PAM) and
(ii) pulse time modulation (PTM).
Out of these techniques, PAM is frequently used whereas PTM is very rarely used.
In the pulse amplitude modulation, the message signal is sampled at regular periodic or time
intervals and this each sample is made proportional to the magnitude of the message signal.
These sample pulses can be transmitted directly using wired media or we can use a carrier signal
for transmitting through wireless. There are two types of sampling techniques for transmitting
messages using pulse amplitude modulation, they are
FLAT TOP PAM: The amplitude of each pulse is directly proportional to instantaneous
modulating signal amplitude at the time of pulse occurrence and then keeps the amplitude
of the pulse for the rest of the half cycle.
Natural PAM: The amplitude of each pulse is directly proportional to the instantaneous
modulating signal amplitude at the time of pulse occurrence and then follows the
amplitude of the modulating signal for the rest of the half cycle
Generation
One of the simplest ways to sample or discrete an analog signal is to mix a sine wave
message signal non-linearly with a low duty cycle rectangular wave (a pulse) using a
class D amplifier.
The amplifier is held in cut off state by a dc base bias circuit working between + V cc and
−Vcc. The analog signal is fed at the emitter. The dc bias is adjusted such that even at the
maximum negative amplitude of sine wave the amplifier remains cut off.
The amplifier is allowed to switch ON when the base is driven positive by the large
amplitude pulses at the base input. This will happen when base voltage is larger than the
analog voltage at emitter by at least V BE.
Now, for a silicon transistor, VBE~ 0.7V, hence the transistor will conduct only when the
base voltages, which is the sum of biasing voltage and the pulse amplitude is greater than
the emitter voltage (analog input) by at least 0.7V.
The ON condition caused by the pulse given to base combined with the instantaneous
level of the signal at the emitter will produce a pulsed voltage at the collector. This pulse
amplitude is proportional to the level of the input analog signal at the emitter at that
instant.
A simple low pass filter (LPF) shown in Figure can work as a PAM demodulator. A low
pass filter is basically an integrator. It filters out the high frequency sampling pulses of the
rectangular wave generator.
Each pulse gets integrated, the amplitude of the integrated output being proportional to
the input pulse amplitude. The capacitor will get charged at every pulse output and will keep on
supplying this charged voltage at the output during the off time of the pulse.
This restores the fidelity of the message. The only precaution to be observed is to ensure
that the LPF has a flat frequency response over the entire base band frequency range and
provides sufficient attenuation at the pulse rate frequency.
Applications
Advantages
Disadvantages
In PTM, the sampling of original analog signal is done at fixed intervals just as in case of
PAM, but the output of PTM circuit results into pulses which have either variable duration or
variable position on time axis with respect to the sampling instant.
Fig. a shows the analog signal s(t). In Fig. b, the pulse width modulation (PWM) or pulse
length modulation (PLM) is shown. In this case, the analog signal is sampled at a constant time
interval (T) by rectangular pulses. When s(t) = 0, the pulse width of modulated pulse is equal to
that of unmodulated pulse T0. At other amplitudes of the signal s(t), the width of the pulse
changes and is proportional to the amplitude of analogsignal s(t).
In this case, the modulation appears in the timing of the trailing edge of the pulse. The
amplitude of rectangular pulse is constant.
Pulse Position Modulation (PPM) technique is shown in Fig. c. The amplitude and width
of the pulse remains constant in case of PPM. Here, the pulse is delayed with respect to the
sampling instant. The change in delay is proportional to the amplitude of the signal s(t).
Generation of PWM
A circuit generating PWM using this principle is shown in Fig. . Here we use a triangular
wave instead of ramp. It can be easily generated by integrating a square wave from a
generator.
The triangular wave is added to the signal S (t). This addition signal is fed to the
comparator’s non-inverting input and the dc reference level to the inverting terminal.
The output gives the PWM signal.
Demodulation of PWM
For PWM demodulation, put a ramp at the +ve edge which will stop at the arrival of –ve
egde.
The ramp will attain different heights in each cycle since the widths are different and the
heights attained are directly proportional to the pulse width and in turn the amplitude of
the message signal.
This is then passed through a low pass filter where it will follow the envelop i.e. the
message signal, which produces the demodulated signal at the output.
Advantages of PWM
Disadvantages of PWM
Applications of PWM
Motor control
PWM is used in asynchronous transmission over noisy channel
used in brightness control applications
Generation of PPM from PWM
PWM signal shown in Fig. b is first differentiated by R1-C1. The differentiator gives both
positive and negative going pulses.
The positive pulses at the differentiator output are eliminated by diode D1, and then
given to the trigger input of MMV.
The differentiated output is shown in Fig. c. The pulse width of the MMV output is
determined by the values of Rand C. Output at pin No. 3 is a PPM signal. The signal is
shown in Fig. d.
Demodulation of PPM
For PPM demodulation, ramp is used which starts at the +ve edge of the one pulse and
stops at the +ve edge of the next pulse.
Thus the height of the generated ramp is determined by the delay between the pulses
which indirectly follows the amplitude of the modulating signal.
This is then passed through a low pass filter which filters the envelop information as the
demodulated signal.
Fig Demodulation of (b) PPM
Advantages of PPM
Disadvantages of PPM
Applications of PPM
The Pulse Code Modulation process is done in three steps Sampling, Quantization, and
Coding. There are two specific types of pulse code modulations such as differential pulse code
modulation(DPCM) and adaptive differential pulse code modulation(ADPCM).
In Pulse Code Modulation, the message signal is represented by a sequence of coded pulses.
This message signal is achieved by representing the signal in discrete form in both time and
amplitude. Instead of a pulse train, PCM produces a series of numbers or digits, and hence this
process is called as digital. Each one of these digits, though in binary code, represent the
approximate amplitude of the signal sample at that instant.
Fig PCM Block diagram
Block diagram of PCM is given above. The source of continuous time message signal is passed
through a low pass filter and then sampling, Quantization, Encoding will be done.
A.Transmitter
B.Channel
C.Receiver
A.Transmitter
The transmitter section of a Pulse Code Modulator circuit consists of Sampling, Quantizing and
Encoding, which are performed in the analog-to-digital converter section. The low pass filter
prior to sampling prevents aliasing of the message signal.
This filter eliminates the high frequency components present in the input analog signal which is
greater than the highest frequency of the message signal, to avoid aliasing of the message signal.
Sampler
Quantizer
In quantization, an analog sample with an amplitude that converted into a digital sample
with an amplitude that takes one of a specific defined set of quantization values. Quantization is
done by dividing the range of possible values of the analog samples into some different levels,
and assigning the center value of each level to any sample in quantization interval. Quantization
approximates the analog sample values with the nearest quantization values. Quantizing is a
process of reducing the excessive bits and confining the data. The sampled output when given to
Quantizer, reduces the redundant bits and compresses the value.
Encoder
The digitization of analog signal is done by the encoder. It designates each quantized level by a
binary code. The sampling done here is the sample-and-hold process. These three sections (LPF,
Sampler, and Quantizer) will act as an analog to digital converter. Encoding minimizes the
bandwidth used.
B.Channel
Regenerative Repeater
This section increases the signal strength. The output of the channel also has one regenerative
repeater circuit, to compensate the signal loss and reconstruct the signal, and also to increase its
strength.
C.Receiver
The basic operations in the receiver section are regeneration of impaired signals, decoding,
and reconstruction of the quantized pulse train.
Decoder
The decoder circuit decodes the pulse coded waveform to reproduce the original signal. This
circuit acts as the demodulator.
Reconstruction Filter
After the digital-to-analog conversion is done by the regenerative circuit and the decoder, a low-
pass filter is employed, called as the reconstruction filter to get back the original signal.
In DPCM only the difference between a sample and the previous value is encoded. The
difference will be much smaller than the total sample value so we need some bits for
getting same accuracy as in ordinary PCM. So that the required bit rate will also reduce.
For example, in 5 bit code 1 bit is for polarity and the remaining 4 bits for 16 quantum
levels.
ADPCM is achieved by adapting the quantizing levels to analog signal characteristics.
We can estimate the values with preceding sample values. Error estimation is done as
same as in DPCM. In 32Kbps ADPCM method difference between predicted value and
sample value is coded with 4 bits, so that we’ll get 15 quantum levels. In this method data
rate is half of the conventional PCM.
Analog signal can be transmitted over a high- speed digital communication system.
Probability of occurring error will reduce by the use of appropriate coding methods.
The PCM signal is more resistant to interference than normal signal.
It is robust against noise and interference.
Disadvantages
Applications
It is used in digital audio recording, digitized video special effects, digital video, voice
mail.
It is also used in Radio control units as transmitter and also receiver for remote controlled
cars, boats, planes.
It is used in the satellite transmission system