| Topics |
Text Reference |
Problems |
Solutions |
| Introduction, Review of Probability Theory |
- |
- |
- |
| Entropy, Relative Entropy, Mutual Information, Data Processing
Inequality |
2.1-2.6, 2.8,2.11 |
Chap.2
1, 2, 3, 5, 8, 10, 15, 30 |
Solns.1 |
| Asymptotic Equipartition Property (AEP) |
3.1-2 |
Chap.3
1, 3, 5 |
Solns.2 |
| Efficient Source Representation |
5.1-8 |
Chap.5
2, 3, 4, 5, 6, 9, 10, 12, 14, 15, 21 |
Solns.3 |
| Entropy Rates of Stochastic Processes |
4.1-3 |
Chap.4
4, 5 |
Solns.4 |
| Channel Capacity |
8.1-7,8.9
9.1-6
10.1-4 |
Chap.8
2,
3, 5, 6, 7, 8, 9
Chap.9,10
9.1,3,6,10.3 |
Solns.5
Solns.6 |
| Error Control Coding |
- |
Refer to Course Notes. |
- |
| - |
Final Exam |
|
