B.3 Computation and Information
Checkpoint 5 of 6
formalism
Compute the letter-frequency entropy of a large English text, compare it against the 4.14 bits per letter that Shannon estimated from letter frequencies alone[^shannon1951], then write a Huffman coder and check its compression ratio against that entropy.