Information Theory

Last updated on Aug 26, 2025
Elements of Information Theory
Binary Entropy Function

These notes follow Prof. Andrew Barron’s S&DS664: Information Theory as taught in Spring 2024. The course roughly follows Elements of Information Theory by Thomas Cover and Joy Thomas. The notes attached cover the first 7 chapters of the text with comments for future improvement.

LATEX Notes: Notes from Elements of Information Theory

Statistics
Varun Varanasi
Varun Varanasi
Physics (Intensive) and Statistics & Data Science