HW1 (due September 4, 2013)

1. Estimate the entropy of the Tao-te-ching.

a. What is the source entropy (in terms of bits per character) you got if we assume the lower and upper cases of a character are different?

b. What is the source entropy (in terms of bits per character) you got if we assume the lower and upper cases of a character are the same?

Compress the same document with your favorite tools (winzip, winrar...).

c. What is the size of the compressed document?

d. What is the compressed data rate (in terms of bits per character)?

e. Is the compressed data rate bigger or smaller than the source entropy obtained in a).? Is the result reasonable (please give a reason why and why not)?