Information Theory
2022. Fall
 

Class meetings:

Tuesday 9:15 -12:00 (first time on September 6, 2022) location: lecture room R514

Lecturer: Marta Pinter (email:marti(a)cs.bme.hu)

Topical information will be placed in the Moodle page


Lecture notes:

The material presented at each lecture is summarized in the lecture notes below. These notes will be updated after each lecture.

First lecture (Sep. 6, 2022)

Second lecture (Sep. 13, 2022)

Third lecture (Sep. 20, 2022)

Fourth lecture (Sep. 27, 2022)

Fifth lecture (Oct. 4, 2022)

Sixth lecture (Oct. 11, 2022)

Seventh lecture (Oct. 18, 2022)

Eighth lecture (Oct. 25, 2022)

Ninth lecture (Nov. 8, 2022)

Tenth lecture (Nov. 15, 2022): Entropy of the uniform quantizer, Problems, home works, Channel coding

Eleventh lecture (Nov. 22, 2022)



Midterms:

There will be two midterms during the semester scheduled as written below. The duration of both midterms will be 90 minutes. They will consist of two "theoretical" questions and four exercises. Given the nature of the first two questions the midterms are closed book and closed notes that is neither book nor notes are allowed to be used when writing them.

As a sample midterm, here is the first midterm of an earlier semester. The file contain sketches of solutions of the exercises but not on the first page which contains only the problems. It is suggested to look at solutions only after you have solved or at least tried to solve the exercises yourself. And a sample midterm for the second midterm. This file also contains sketches of solutions of the exercises, so again, try to solve the exercises yourself, and look at solutions only after you have tried.

1st midterm: October 10, 6 p.m. room: Q-I

2nd midterm: November 30, 6 p.m. room: Q-I



Grading:

For getting a valid grade at least 40% of the score should be achieved (separately) on both midterms. The final grade is calculated by averaging the results of the two midterms both taken into account with weight 1/2. Conversion to grades is as follows: from 80% to 100% performance the grade is 5. Below that it is 4 from 70%, 3 from 55%, and 2 from 40%. Below 40% no valid grade is obtained.



Make up tests:

There will be one separate make up test for both midterms.

Retake of 1st midterm: October 24, 6 p.m. room: IB025

Retake of 2nd midterm: December 12, 10 am room: IE007

Rules of how make up midterm scores are taken into account:

If someone takes a make up midterm for improving the result of the corresponding midterm, then the new result will be valid even if it is weaker than the original one. There is one exception to this: If on an original midterm one already achieved 40% of the score then the midterm remains valid (counted with a minimum 40% score) even if the make up score is below 40%.

Final retake possibility (available only for those who have one valid midterm and miss only the other one, it also has a fee) is planned to December 19.