Problem 2.2: An information source X produces statistically independent binary digits with the following probabilities: p(x1) = 3/4 and p(2) = 1/4. Consider sequences of N binary digits, where the probability of unlikely sequences Ty (6) is bounded as: N log2 P(In) - H(X) 26 56 (2.88) n=1 a) Using the Weak Law of Large Numbers, determine the minimum sequence length No such that for N 2 No the inequality holds when 6 = 5 x 10-2 and e = 10-1. b) Repeat for 6 = 10-3 and ( = 10-6. c) For these two cases, find the lower and upper bounds for the number of typical sequences | | Ix (8) ||