Information theory

Information and entropy

Surprise in bits, the entropy of a distribution as the average surprise, and why the surprise has to be a logarithm.

About 30 minutes6 activities Paper packet