Lecture Plan for the subject of INFORMATION THEORY & CODING

Class Module Dat Topic Covered

No. No. e
1 Introduction to Information Theory, Uncertainty and Information, Average Mutual
Information and Entropy
3 Information Measures for Continuous Random Variables, waveform sources
4 Amplitude Quantizing: quantizing noise, uniform quantizing, non-uniform
quantizing
6 Differential Pulse Code Modulation: one-tap prediction, N-tap prediction
7 sigma delta A-to-D convertor(ADC), sigma delta D-to-A convertor(DAC).
9 Block coding: vector quantizing, Transform Coding: quantization for transform
coding, Sub-band Coding
10 Source Coding for Digital Data: properties of codes, Huffman codes, Run-length
codes
Modu
le 2
11 Waveform coding: Antipodal and Orthogonal signals, Orthogonal and Biorthogonal
codes
12
13 waveform coding system example, Types of error control: Terminal connectivity,
automatic repeat request
14 Structured Sequence: Channel models, Channel capacity, Channel coding,
Information Capacity Theorem, The Shannon
Limit
15 &
16
17 & Introduction to Error correcting codes, code rate & redundancy, parity check codes:
18 Single parity check code,
Rectangular code
19 Generator matrix, systematic linear block codes, parity-check matrix
20
21 syndrome testing, error correction , Decoder implementation, Error Detecting &
Correcting Capability: weight & distance of binary vectors, minimum distance of
linear code,
22
3 Error detection & correction, visualization of a 6-tuple space, erasure correction
24 & Usefulness of Standard Array: estimating code capability, an (n, k) example,
25 designing the (8,2) code, error detection vs. error correction trade-off
26 Cyclic Codes: algebraic structures of cyclic code, binary cyclic code properties,
27 encoding in systematic form, circuit for dividing polynomial, systematic encoding
with an (n-k)-stage shift register, error detection with an (n-k)-shift register
28 Well-Known Block Codes: Hamming codes, extended Golay code, BCH codes
odule
3
29 Convolutional Encoding, Convolutional Encoder Representation: connection
representation
30 & state representation & the state diagram, the tree diagram, the trellis diagram
31
32 Formulation of the Convolutional Decoding Problem: maximum likelihood
decoding, channel models: hard versus soft decisions,
33 & Viterbi Convolutional Decoding Algorithm, an example of viterbi convolutional
34 decoding, decoder implementation, path memory and synchronization
35, Properties of Convolutional Codes: distance properties of convolutional codes,
36 & systematic & non-systematic convolutional codes, catastrophic error propagation in
37 convolutional codes, performance bounds for convolutional codes, coding gain,
38 39 Best known convolutional codes, convolutional code rate trade-off, soft-decision
viterbi decoding
40 41 Other Convolutional Decoding Algorithms: sequential decoding, comparisons &
limitations of viterbi & sequential decoding, feedback decoding.
Modu
le 4
42 Reed-Solomon Codes: Reed-Solomon Error Probability, Why R-S codes perform
well against burst noise,
43 R-S performance as a function of size, redundancy, and code rate
44 Interleaving & Concatenated Codes: Block interleaving, Convolutional interleaving,
concatenated codes
45 Coding & Interleaving Applied to CD Digital Audio System: CIRC encodings
46 CIRC decoding, interpolation & muting
47 Turbo Codes: turbo code concepts,
48 log-likelihood algebra.

Text Books:-
1. Digital Communications - Fundamentals and Applications - Bernard Sklar, 2nd Edition of
Person
Education Publication
2. Information Theory, Coding & Cryptography - Ranjan Bose, TMH Publication
3. Digital Communications Simon Haykin, Wiley Edition
4. Digital Communications - J.G.Proakis, 3rd Edition, Mc Graw Hill Publications.