EE 253 - Winter 2008

Lecture: Monday and Wednesday 5-6:45 p.m. Room Crown, 202.

Instructor: Hamid R. Sadjadpour, BE2-245B, Email: hamid@soe.ucsc.edu,
Phone: (831)459-1483.

Instructor Office Hours:
Mondays 2-4 p.m. Also by appointment.

Textbooks:
Thomas Cover, Joy Thomas, Elements of Information Theory, 2nd edition, Wiley.
Reymond Yeung, A first course in Information Theory, Springer publisher.

Homeworks (10%):
Problems will be given at the end of each chapter. Late homework will not be accepted.

Exams (45% each):

   Midterm Exam: 2nd or 3rd week of February during the class schedule.

   Final Exam: As scheduled by registration office.

No make-up exam under any circumstances. Exams most likely are closed book. You can bring 1 page note.

Tentative Schedule:
Week 1: Chapter 2, Entropy, Relative Entropy and Mutual Information.
Week 2: Chapters 2.
Week 3: Chapters 3, Asymptotic Equipartition Property.
Week 4: Chapter 4Entropy Rates of A Stochastic Process.
Week 5: Chapter 4. (Midterm 1 contains the first three chapters)
Week 6: Chapter 5, Data Compression.
Week 7: Chapter 5.
Week 8: Chapter 7, Channel Capacity.
Week 9: Chapter 7.

Final exam will cover the last part of the course.
We may not be able to teach all sections of these chapters.
The exams will be based on class materials and homeworks.

Announcements:

There will be no class on Monday, January 28. We will reschedule that lecture during class.
HW # 1: Chapter 2, problems 2, 4, 10, 12, 15, 26, and 32. Due date: Monday February 4.

Solution

Next week on Wednesday , January 23 and also Wednesday, January 30 the class will be held in a new location, E2-215, from 5 to 7:30 p.m.
Chapter 1 slides.
Chapter 2 slides.
HW # 2: Chapter 3, problems 1, 2, 6, and 11(a & b). Due date: Wednesday February 6.

Solution

Chapter 3 slides.
Midterm: Wednesday February 20 during class. It includes the first three chapters.
Chapter 4 slides.
HW # 3: Chapter 4, problems 1, 6, 7, 9, 11(a,b,c). Due date: Wednesday February 13.

Solution

HW # 4: Chapter 5, problems 1, 2, 4, 6, 12. Due date: Monday March 3.

Solution

Chapter 5 slides. These slides will be updated every week.
HW#5: Chapter 7, problems 3, 4, 7, 11, 13, 20. Due Date: Monday March 17.

Solution

Academic Dishonesty

Any confirmed academic dishonesty including but not limited to copying homeworks or cheating on exams, will result in a no-pass or failing grade. You are encouraged to read the campus policies regarding academic integrity. Examples of cheating include (but are not limited to):

Sharing results or other information during an examination.
Working on an exam before or after the official time allowed.
Submitting homework that is not your own work.
Reading another student's homework solution before it is due.
Allowing someone else to read your homework solution before the assignment is due.
If there is any question as to whether a given action might be construed as cheating, see me before you engage in any such action.