Information theory

Gibbs' inequality and cross-entropy

Why a divergence is never negative, and why no model ever codes a source more cheaply than the truth.

About 25 minutes6 activities Paper packet