Let Y be a random variable with possible outcomes 0, 1, and p(Y = 1) = 1/2. Let X be a random variable with possible outcomes X = a, b, c. Define p = (p(Xa|Y = 1), p(X = b|Y = 1), p(X = c|Y = 1)) q= (p(X = a|Y = 0), p(X = b|Y = 0), p(X = c|Y = 0)). Suppose that 3 1 1 3 1 5'5'5' (a) Using the definition of mutual information, show that for any choice of p, q, where m = + (b) Compute I(X;Y). DKL (p||m) + DKL (q||m) I(X;Y) = 2 (c) Let Z be a random variable with outcomes x = X, such that for all x = x and y = {0, 1}, p(Z = x|Y = y) = p(X = x|Y = 1 y). Using part (a) compute I(Z;Y). Explain intuitively the relation of your answer to part (a). (d) Suppose p and q are as in part (a). Using part (b), or otherwise, give an example of a random variable Z with possible outcomes X satisfying I(X;Y) > I(Z;Y). Explain your answer in terms of the data-processing inequality. (e) Suppose p and q are as in part (a). Give an example of a random variable Z with possible outcomes x = X satisfying I(X;Y) < I(Z;Y). Explain your answer in terms of the data- processing inequality.