Course: Information theory and coding

Weekly outline

General

Collapse all Expand all
Course Instructor
Emre Telatar, INR 117, emre.telatar@epfl.ch

Teaching Assistants
Reka Inovan, INR 033, reka.inovan@epfl.ch
Yunus Inan, INR 033, yunus.inan@epfl.ch

Lectures
Monday, 11h15-13h00, BC01 & Zoom
Tuesday, 13h15-15h00, ELA02 & Zoom

Zoom Link
https://epfl.zoom.us/j/94124727857

Exercise Session
Tuesday, 15h15-17h00, ELA02

Grading Scheme

Take-Home Midterm (30%)

Graded Homework (20%)

Final Exam (50%)

Course Webpage
https://www.epfl.ch/schools/ic/ipg/teaching/2020-2021/information-theory-and-coding/
14 September - 20 September
21 September - 27 September
- FYI : You are not required to submit the weekly homeworks. There will be a graded homework, but we will announce it after the midterm.
- Homework 2 File
- Tuesday Lecture (Please skip to 00:41:00) URL
- Tuesday Lecture Notes File
- Solution to Homework 2 File
28 September - 4 October
- Monday Lecture URL
- Monday Lecture Note File
- Typical Sets : Cover & Thomas, Chapter 3
  Huffman Procedure : Cover & Thomas, Section 5.6-5.8
- Homework 3 File
- Tuesday Lecture URL
- Entropy Rate : Cover & Thomas, Section 4.1-4.2
- Tuesday Lecture Note File
- Solution to Homework 3 File
5 October - 11 October
- Notes on FSM Compressor and Lempel-Ziv File
- Lempel-Ziv Algorithm : Cover & Thomas, Section 13.4-13.5
  From this week onwards, we will handle exercise session questions through zoom.
- Monday Lecture URL
- Monday Lecture Note File
- Homework 4 File
- Tuesday Lecture URL
- Tuesday Lecture Note File
- Solution to Homework 4 File
12 October - 18 October
19 October - 25 October
- Monday Lecture URL
- Monday Lecture Note File
- Data Transmission Problem : Cover and Thomas, section 7.5
  Converse to Data Transmission : Cover and Thomas, section 7.9
  (The version we proved in the class is stronger than in the textbook)
- Homework 6 File
- Tuesday Lecture URL
- Solution to Homework 6 File
- Computation of C (KKT conditions) : Cover & Thomas, 10.7-10.8
- Tuesday Lecture Note File
26 October - 1 November
- Monday Lecture URL
- Monday Lecture Note File
- Take Home Midterm Assignment
- Tuesday Lecture URL
- Tuesday Lecture Note File
- Joint Typicality : Cover&Thomas 8.6
  Channel Coding Theorem : Cover&Thomas 8.7
- Midterm Solution File
2 November - 8 November
- Channel Coding Theorem with Threshold Decoder : See last year Graded HW problem 2 (Feinstein Theorem) or HW 7
  Joint Source-Channel Coding Theorem : Cover & Thomas 8.13
- Monday Lecture URL
- Monday Lecture Note File
- Homework 7 File
- Tuesday Lecture URL
- Tuesday Lecture Note File
- Differential Entropy : Cover & Thomas, Chapter 8
- Solution to Homework 7 File
9 November - 15 November
- Monday Lecture URL
- Monday Lecture Note File
- Homework 8 File
- Tuesday Lecture URL
- Tuesday Lecture Note File
- Solution to Homework 8 File
- Bandlimited AWGN Channel : Cover & Thomas 9.3
  Parallel AWGN Channel : Cover & Thomas 9.4
16 November - 22 November
23 November - 29 November
30 November - 6 December
7 December - 13 December
14 December - 20 December
- Monday Lecture URL
- Tuesday Lectures URL
- Monday Lecture Note File
- Other Homeworks :
- Homework 11 File
- Solution to HW 11 File
- Homework 12 File
- Solution to HW 12 File
- Homework 13 File
- Solution to HW 13 File
- Tuesday Lecture Notes File

Weekly outline

General

Course Instructor

Teaching Assistants

Lectures

Zoom Link

Exercise Session

Grading Scheme

Course Webpage

14 September - 20 September

21 September - 27 September

28 September - 4 October

5 October - 11 October

12 October - 18 October

19 October - 25 October

26 October - 1 November

2 November - 8 November

9 November - 15 November

16 November - 22 November

23 November - 29 November

30 November - 6 December

7 December - 13 December

14 December - 20 December