Skip to content
Nydus Open Learning

Information theory

The chain rule for entropy

Why $H(X, Y) = H(X) + H(Y \mid X)$, how it extends to any number of variables, and how it finds whichever entropy is awkward to compute directly.

About 25 minutes6 activities Paper packet