Information Theory

**Course Notes by Jean-Yves Chouinard****A First Course in Information Theory by Raymond W. Yeung****Information Theory, Inference, and Learning Algorithms by David J.C. MacKay****"A Mathematical Theory of Communication," by Claude E. Shannon****"Data Compression," by Debra A. Lelewer and Daniel S. Hirschberg****"The ABCs of Linear Block Codes," by Bernard Sklar and Fredric J. Harris**

**Introduction****Joint Entropy, Equivocation and Mutual Information****Distortionless Source Coding****Channel Capacity and Coding****Error Correcting Codes****Review**

2017-09-01