ELEC 619A
Selected Topics in Digital Communications: Information Theory
Course Description
Information theory and its relationship to probability, statistics and
data compression;
entropy, relative entropy and mutual information;
Huffman coding, arithmetic coding and Lempel-Ziv coding;
channel capacity;
group codes: generator and
parity check matrices; Hamming codes and the Hamming
bound; bounds on the dimension of a linear code;
random coding bounds;
code constructions.
Aaron Gulliver
2005-08-31