[28] Let = 12 ... be an infinite binary sequence. The entropy function H(p) is defined by H(p) = p log 1/p+ (1p) log

[28] Let ω = ω1ω2 ... be an infinite binary sequence. The entropy function H(p) is defined by H(p) = p log 1/p+ (1−p) log 1/(1−p).

(b) Prove the following: If the ωi’s are generated by coin flips with probability p for outcome 1 (a Bernoulli process with probability p), then for as n goes to infinity.