Information theory explores the fundamental limits of the representation and transmission of information. We will focus on the definition and implications of (information) entropy, the source coding theorem, and the channel coding theorem. These concepts provide a vital background for researchers in the areas of data compression, signal processing, controls, and pattern recognition.
Recommended CitationMoon, Todd K., "ECE7680 - Information Theory, Spring 2006" (2006). Electrical and Computer Engineering - OCW. Course 3.