Topics |
Text Reference |
Problems |
Solutions |
Introduction, Review of Probability Theory |
- |
- |
- |
Entropy, Relative Entropy, Mutual Information, Data Processing
Inequality |
2.1-2.6, 2.8,2.11 |
Chap.2 1, 2, 3, 5, 8, 10, 15, 30 |
Solns.1 |
Asymptotic Equipartition Property (AEP) |
3.1-2 |
Chap.3 1, 3, 5 |
Solns.2 |
Efficient Source Representation |
5.1-8 |
Chap.5 2, 3, 4, 5, 6, 9, 10, 12, 14, 15, 21 |
Solns.3 |
Entropy Rates of Stochastic Processes |
4.1-3 |
Chap.4 4, 5 |
Solns.4 |
Channel Capacity |
8.1-7,8.9 9.1-6 10.1-4 |
Chap.8 2,
3, 5, 6, 7, 8, 9
Chap.9,10
9.1,3,6,10.3 |
Solns.5
Solns.6 |
Error Control Coding |
- |
Refer to Course Notes. |
- |
|