Skip to content
Nydus Open Learning

Numerical methods

Catastrophic cancellation

Why subtracting nearly equal numbers destroys the leading digits, how to count what is lost, and the rewrites that stop it happening.

About 20 minutes6 activities Paper packet