Information Theory in CS
COMPSCI 2211
Subject & Catalog Number
Course Information
Description
Information Theory originated in the seminal work of Shannon (1948) that aimed to formalize and quantify information. Since the 1990s tools and concepts from Information Theory have played a central role in theoretical computer science. Notable examples include the Parallel Repetition Theorem of Raz (1994), the development of the Information Complexity to understand Communication Complexity (2001). Today Information Theoretic measures and tools influence many aspects of CS theory including analysis of streaming algorithms, differential privacy and game theory. This course will introduce the basic concepts in information theory and then sample topics of interest to CS theory.
Course Notes
Instructor permission needed for undergraduates. Undergraduates planning to take the class must write to the instructor indicating (1) what they hope to learn from the class and (2) their level of preparation in math and CS theory (e.g., CS 1210, CS 1240, or CS 1200). This course was formerly offered as CS 229R in Fall 2022.
Recommended Prep
CS 1210 (recommended) or 1240 (recommended) or CS 1200 or equivalent.
Available for Harvard Cross Registration
