SySc 645 Information Theory

Establishes theoretical limits on the performance of techniques for compression or error correction of signals. This course focuses on communications applications, specifically source coding and channel coding for discrete signals. Topics will include: Entropy and Mutual Information, Asymptotic Equipartition (the Ergodic Theorem of Information Theory), Entropy Rates of Information Sources, Data Compression, and Channel Capacity.