McMaster University, Faculty of Engineering  
ECE 723 - Information Theory & Coding
Course Schedule, Assignments, Projects
 


Course Syllabus
The course syllabus available for download here.
Lecture Topics, Notes, Assignments and Solutions
The most recent version of the notes can be dowloaded here (updated 17/09/06).
Topics Text Reference Problems Solutions
Introduction, Review of Probability Theory - - -
Entropy, Relative Entropy, Mutual Information, Data Processing Inequality 2.1-2.6, 2.8,2.11 Chap.2
1, 2, 3, 5, 8, 10, 15, 30
Solns.1
Asymptotic Equipartition Property (AEP) 3.1-2 Chap.3
1, 3, 5
Solns.2
Efficient Source Representation 5.1-8 Chap.5
2, 3, 4, 5, 6, 9, 10, 12, 14, 15, 21
Solns.3
Entropy Rates of Stochastic Processes 4.1-3 Chap.4
4, 5
Solns.4
Channel Capacity 8.1-7,8.9
9.1-6
10.1-4
Chap.8
2, 3, 5, 6, 7, 8, 9
Chap.9,10
9.1,3,6,10.3
Solns.5
Solns.6
Error Control Coding - Refer to Course Notes. -
Course Assignments
Mutual Information and Equiprobable Signalling
Assignment Description: Download here.
Due Date: November 27, 2018 (to instructor)