Information theory

The asymptotic equipartition property

−(1/n) log p(Xⁿ) → H; typical sequences have probability about 2^{−nH}.

About 20 minutes6 activities Paper packet